2024-04-17T08:30:00.490 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-17T08:30:00.490 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_rishabh@teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/xfstests-dev} --verbose --archive /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659946 --name rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi -- /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659946/orig.config.yaml 2024-04-17T08:30:00.537 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T08:30:00.619 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659946 branch: wip-rishabh-testing-20240416.193735 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/xfstests-dev} email: null first_in_suite: false job_id: '7659946' kernel: flavor: default kdb: true sha1: 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-rishabh-testing-20240416.193735 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: a8c84f5997950fd7d008204839253291d52e6eda ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: a8c84f5997950fd7d008204839253291d52e6eda subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240416.193735 sha1: a8c84f5997950fd7d008204839253291d52e6eda owner: scheduled_rishabh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 3521 sha1: a8c84f5997950fd7d008204839253291d52e6eda sleep_before_teardown: 0 subset: 410/512 suite: fs suite_branch: wip-rishabh-testing-20240416.193735 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: a8c84f5997950fd7d008204839253291d52e6eda syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi152.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHu3KvyayiKpi7Ig+sxgXozqjMoZs7hbVJQXjG2i96yDzIKmoAglpzQXQvbMhMczqjk+bqc678bfDjzjMygyHHY= smithi196.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMY0cG94j5lZZaMgNVTdcj44LaJ/9q+TQ7sKFsD+hgminMHD3DUlRcfoOy/g25Bt8Z+J7XYxsHA50RebIkM/v80= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 6c637841c215537a4502385240412f1966e0faab timestamp: 2024-04-17_04:58:44 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-17T08:30:00.621 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa; will attempt to use it 2024-04-17T08:30:00.622 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa/tasks 2024-04-17T08:30:00.622 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-17T08:30:00.624 INFO:teuthology.task.internal:Checking packages... 2024-04-17T08:30:00.647 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'a8c84f5997950fd7d008204839253291d52e6eda' 2024-04-17T08:30:00.647 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-17T08:30:00.647 INFO:teuthology.packaging:ref: None 2024-04-17T08:30:00.647 INFO:teuthology.packaging:tag: None 2024-04-17T08:30:00.647 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240416.193735 2024-04-17T08:30:00.647 INFO:teuthology.packaging:sha1: a8c84f5997950fd7d008204839253291d52e6eda 2024-04-17T08:30:00.647 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-rishabh-testing-20240416.193735 2024-04-17T08:30:00.794 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3133-ga8c84f59-1jammy 2024-04-17T08:30:00.795 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-17T08:30:00.802 INFO:teuthology.task.internal:no buildpackages task found 2024-04-17T08:30:00.802 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-17T08:30:00.838 INFO:teuthology.task.internal:Saving configuration 2024-04-17T08:30:00.854 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-17T08:30:00.862 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-17T08:30:00.888 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659946', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-17 08:24:03.974166', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIMQfosyNdaWy2IUf4OWZbTAHTJZDWZ95+1PztgioEok+'} 2024-04-17T08:30:00.908 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi196.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659946', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-17 08:24:03.972762', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHbJuFrjNHAdzdXT/fURd6+vxlqnH4QfCPuxS8kBOEH9'} 2024-04-17T08:30:00.908 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-17T08:30:00.914 INFO:teuthology.task.internal:roles: ubuntu@smithi152.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-04-17T08:30:00.914 INFO:teuthology.task.internal:roles: ubuntu@smithi196.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-04-17T08:30:00.915 INFO:teuthology.run_tasks:Running task console_log... 2024-04-17T08:30:00.998 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5e9bfc24c0>, signals=[15]) 2024-04-17T08:30:00.999 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-17T08:30:01.005 INFO:teuthology.task.internal:Opening connections... 2024-04-17T08:30:01.005 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi152.front.sepia.ceph.com 2024-04-17T08:30:01.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:30:01.086 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi196.front.sepia.ceph.com 2024-04-17T08:30:01.087 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:30:01.164 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-17T08:30:01.172 DEBUG:teuthology.orchestra.run.smithi152:> uname -m 2024-04-17T08:30:01.177 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64 2024-04-17T08:30:01.177 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2024-04-17T08:30:01.225 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-17T08:30:01.225 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="Ubuntu" 2024-04-17T08:30:01.225 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="22.04" 2024-04-17T08:30:01.225 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-17T08:30:01.225 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_CODENAME=jammy 2024-04-17T08:30:01.225 INFO:teuthology.orchestra.run.smithi152.stdout:ID=ubuntu 2024-04-17T08:30:01.225 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE=debian 2024-04-17T08:30:01.225 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-17T08:30:01.225 INFO:teuthology.orchestra.run.smithi152.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-17T08:30:01.225 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-17T08:30:01.226 INFO:teuthology.orchestra.run.smithi152.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-17T08:30:01.226 INFO:teuthology.orchestra.run.smithi152.stdout:UBUNTU_CODENAME=jammy 2024-04-17T08:30:01.226 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2024-04-17T08:30:01.252 DEBUG:teuthology.orchestra.run.smithi196:> uname -m 2024-04-17T08:30:01.257 INFO:teuthology.orchestra.run.smithi196.stdout:x86_64 2024-04-17T08:30:01.258 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release 2024-04-17T08:30:01.305 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-17T08:30:01.305 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="Ubuntu" 2024-04-17T08:30:01.305 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="22.04" 2024-04-17T08:30:01.305 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-17T08:30:01.305 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_CODENAME=jammy 2024-04-17T08:30:01.305 INFO:teuthology.orchestra.run.smithi196.stdout:ID=ubuntu 2024-04-17T08:30:01.305 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE=debian 2024-04-17T08:30:01.305 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-17T08:30:01.305 INFO:teuthology.orchestra.run.smithi196.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-17T08:30:01.305 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-17T08:30:01.306 INFO:teuthology.orchestra.run.smithi196.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-17T08:30:01.306 INFO:teuthology.orchestra.run.smithi196.stdout:UBUNTU_CODENAME=jammy 2024-04-17T08:30:01.306 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server 2024-04-17T08:30:01.351 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-17T08:30:01.361 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-17T08:30:01.387 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-17T08:30:01.388 DEBUG:teuthology.orchestra.run.smithi152:> test '!' -e /home/ubuntu/cephtest 2024-04-17T08:30:01.390 DEBUG:teuthology.orchestra.run.smithi196:> test '!' -e /home/ubuntu/cephtest 2024-04-17T08:30:01.395 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-17T08:30:01.412 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-17T08:30:01.413 DEBUG:teuthology.orchestra.run.smithi152:> test -z $(ls -A /var/lib/ceph) 2024-04-17T08:30:01.439 DEBUG:teuthology.orchestra.run.smithi196:> test -z $(ls -A /var/lib/ceph) 2024-04-17T08:30:01.545 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-17T08:30:01.604 INFO:teuthology.run_tasks:Running task kernel... 2024-04-17T08:30:01.618 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8'} 2024-04-17T08:30:01.618 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': '3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8'}}, timeout 300 2024-04-17T08:30:01.619 DEBUG:teuthology.orchestra.run.smithi152:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-17T08:30:01.619 DEBUG:teuthology.orchestra.run.smithi196:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-17T08:30:01.623 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T08:30:01.624 DEBUG:teuthology.task.kernel:sha1 for mon.a is 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-17T08:30:01.624 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8"... 2024-04-17T08:30:01.624 DEBUG:teuthology.orchestra.run.smithi152:> uname -r 2024-04-17T08:30:01.625 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T08:30:01.625 DEBUG:teuthology.task.kernel:sha1 for mon.b is 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-17T08:30:01.625 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8"... 2024-04-17T08:30:01.625 DEBUG:teuthology.orchestra.run.smithi196:> uname -r 2024-04-17T08:30:01.670 INFO:teuthology.orchestra.run.smithi152.stdout:5.15.0-56-generic 2024-04-17T08:30:01.670 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-17T08:30:01.670 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-17T08:30:01.671 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-17T08:30:01.675 INFO:teuthology.orchestra.run.smithi196.stdout:5.15.0-56-generic 2024-04-17T08:30:01.675 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-17T08:30:01.675 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-17T08:30:01.675 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-17T08:30:01.818 INFO:teuthology.task.kernel:Installing linux-firmware on mon.b... 2024-04-17T08:30:01.818 DEBUG:teuthology.orchestra.run.smithi196:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-04-17T08:30:01.820 INFO:teuthology.task.kernel:Installing linux-firmware on mon.a... 2024-04-17T08:30:01.820 DEBUG:teuthology.orchestra.run.smithi152:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-04-17T08:30:01.843 INFO:teuthology.orchestra.run.smithi152.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-04-17T08:30:01.845 INFO:teuthology.orchestra.run.smithi196.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-04-17T08:30:01.987 INFO:teuthology.orchestra.run.smithi152.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-04-17T08:30:01.987 INFO:teuthology.orchestra.run.smithi152.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-04-17T08:30:01.988 INFO:teuthology.orchestra.run.smithi152.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-04-17T08:30:01.988 INFO:teuthology.orchestra.run.smithi152.stderr:hint: 2024-04-17T08:30:01.988 INFO:teuthology.orchestra.run.smithi152.stderr:hint: git config --global init.defaultBranch 2024-04-17T08:30:01.988 INFO:teuthology.orchestra.run.smithi152.stderr:hint: 2024-04-17T08:30:01.988 INFO:teuthology.orchestra.run.smithi152.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-04-17T08:30:01.988 INFO:teuthology.orchestra.run.smithi152.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-04-17T08:30:01.988 INFO:teuthology.orchestra.run.smithi152.stderr:hint: 2024-04-17T08:30:01.988 INFO:teuthology.orchestra.run.smithi152.stderr:hint: git branch -m 2024-04-17T08:30:01.988 INFO:teuthology.orchestra.run.smithi152.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-04-17T08:30:01.991 DEBUG:teuthology.orchestra.run.smithi152:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-04-17T08:30:02.002 INFO:teuthology.orchestra.run.smithi196.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-04-17T08:30:02.002 INFO:teuthology.orchestra.run.smithi196.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-04-17T08:30:02.002 INFO:teuthology.orchestra.run.smithi196.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-04-17T08:30:02.002 INFO:teuthology.orchestra.run.smithi196.stderr:hint: 2024-04-17T08:30:02.002 INFO:teuthology.orchestra.run.smithi196.stderr:hint: git config --global init.defaultBranch 2024-04-17T08:30:02.002 INFO:teuthology.orchestra.run.smithi196.stderr:hint: 2024-04-17T08:30:02.002 INFO:teuthology.orchestra.run.smithi196.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-04-17T08:30:02.002 INFO:teuthology.orchestra.run.smithi196.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-04-17T08:30:02.003 INFO:teuthology.orchestra.run.smithi196.stderr:hint: 2024-04-17T08:30:02.003 INFO:teuthology.orchestra.run.smithi196.stderr:hint: git branch -m 2024-04-17T08:30:02.004 INFO:teuthology.orchestra.run.smithi196.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-04-17T08:30:02.006 DEBUG:teuthology.orchestra.run.smithi196:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-04-17T08:30:02.059 DEBUG:teuthology.orchestra.run.smithi152:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-04-17T08:30:02.072 DEBUG:teuthology.orchestra.run.smithi196:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-04-17T08:30:02.115 DEBUG:teuthology.orchestra.run.smithi152:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-04-17T08:30:02.126 DEBUG:teuthology.orchestra.run.smithi196:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-04-17T08:31:20.935 INFO:teuthology.orchestra.run.smithi196.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-04-17T08:31:20.935 INFO:teuthology.orchestra.run.smithi196.stderr: * [new branch] main -> origin/main 2024-04-17T08:31:20.968 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20190312 -> 20190312 2024-04-17T08:31:20.968 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20190416 -> 20190416 2024-04-17T08:31:20.968 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20190514 -> 20190514 2024-04-17T08:31:20.968 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20190618 -> 20190618 2024-04-17T08:31:20.969 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20190717 -> 20190717 2024-04-17T08:31:20.969 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20190815 -> 20190815 2024-04-17T08:31:20.969 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20190923 -> 20190923 2024-04-17T08:31:20.969 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20191022 -> 20191022 2024-04-17T08:31:20.969 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20191215 -> 20191215 2024-04-17T08:31:20.969 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20200122 -> 20200122 2024-04-17T08:31:20.970 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20200316 -> 20200316 2024-04-17T08:31:20.970 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20200421 -> 20200421 2024-04-17T08:31:20.970 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20200519 -> 20200519 2024-04-17T08:31:20.970 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20200619 -> 20200619 2024-04-17T08:31:20.970 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20200721 -> 20200721 2024-04-17T08:31:20.970 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20200817 -> 20200817 2024-04-17T08:31:20.971 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20200918 -> 20200918 2024-04-17T08:31:20.972 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20201022 -> 20201022 2024-04-17T08:31:20.972 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20201118 -> 20201118 2024-04-17T08:31:20.972 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20201218 -> 20201218 2024-04-17T08:31:20.972 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20210208 -> 20210208 2024-04-17T08:31:20.972 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20210315 -> 20210315 2024-04-17T08:31:20.972 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20210511 -> 20210511 2024-04-17T08:31:20.972 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20210716 -> 20210716 2024-04-17T08:31:20.973 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20210818 -> 20210818 2024-04-17T08:31:20.973 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20210919 -> 20210919 2024-04-17T08:31:20.973 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20211027 -> 20211027 2024-04-17T08:31:20.973 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20211216 -> 20211216 2024-04-17T08:31:20.973 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20220209 -> 20220209 2024-04-17T08:31:20.974 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20220310 -> 20220310 2024-04-17T08:31:20.974 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20220411 -> 20220411 2024-04-17T08:31:20.974 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20220509 -> 20220509 2024-04-17T08:31:20.974 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20220610 -> 20220610 2024-04-17T08:31:20.974 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20220708 -> 20220708 2024-04-17T08:31:20.975 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20220815 -> 20220815 2024-04-17T08:31:20.975 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20220913 -> 20220913 2024-04-17T08:31:20.975 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20221012 -> 20221012 2024-04-17T08:31:20.975 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20221109 -> 20221109 2024-04-17T08:31:20.976 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20221214 -> 20221214 2024-04-17T08:31:20.976 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20230117 -> 20230117 2024-04-17T08:31:20.977 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20230210 -> 20230210 2024-04-17T08:31:20.977 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20230310 -> 20230310 2024-04-17T08:31:20.977 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20230404 -> 20230404 2024-04-17T08:31:20.977 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20230515 -> 20230515 2024-04-17T08:31:20.977 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20230625 -> 20230625 2024-04-17T08:31:20.977 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20230804 -> 20230804 2024-04-17T08:31:20.977 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20230919 -> 20230919 2024-04-17T08:31:20.977 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20231030 -> 20231030 2024-04-17T08:31:20.977 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20231111 -> 20231111 2024-04-17T08:31:20.978 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20231211 -> 20231211 2024-04-17T08:31:20.978 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20240115 -> 20240115 2024-04-17T08:31:20.978 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20240220 -> 20240220 2024-04-17T08:31:20.978 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20240312 -> 20240312 2024-04-17T08:31:20.978 INFO:teuthology.orchestra.run.smithi196.stderr: * [new tag] 20240410 -> 20240410 2024-04-17T08:31:24.437 INFO:teuthology.orchestra.run.smithi152.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-04-17T08:31:24.437 INFO:teuthology.orchestra.run.smithi152.stderr: * [new branch] main -> origin/main 2024-04-17T08:31:24.470 INFO:teuthology.orchestra.run.smithi152.stderr: * [new tag] 20190312 -> 20190312 2024-04-17T08:31:24.470 INFO:teuthology.orchestra.run.smithi152.stderr: * [new tag] 20190416 -> 20190416 2024-04-17T08:31:24.470 INFO:teuthology.orchestra.run.smithi152.stderr: * [new tag] 20190514 -> 20190514 2024-04-17T08:31:24.470 INFO:teuthology.orchestra.run.smithi152.stderr: * [new tag] 20190618 -> 20190618 2024-04-17T08:31:24.470 INFO:teuthology.orchestra.run.smithi152.stderr: * [new tag] 20190717 -> 20190717 2024-04-17T08:31:24.470 INFO:teuthology.orchestra.run.smithi152.stderr: * [new tag] 20190815 -> 20190815 2024-04-17T08:31:24.470 INFO:teuthology.orchestra.run.smithi152.stderr: * [new tag] 20190923 -> 20190923 2024-04-17T08:31:24.470 INFO:teuthology.orchestra.run.smithi152.stderr: * [new tag] 20191022 -> 20191022 2024-04-17T08:31:24.473 INFO:teuthology.orchestra.run.smithi152.stderr: * [new tag] 20191215 -> 20191215 2024-04-17T08:31:24.473 INFO:teuthology.orchestra.run.smithi152.stderr: * [new tag] 20200122 -> 20200122 2024-04-17T08:31:24.473 INFO:teuthology.orchestra.run.smithi152.stderr: * [new tag] 20200316 -> 20200316 2024-04-17T08:31:24.473 INFO:teuthology.orchestra.run.smithi152.stderr: * [new tag] 20200421 -> 20200421 2024-04-17T08:31:24.473 INFO:teuthology.orchestra.run.smithi152.stderr: * [new tag] 20200519 -> 20200519 2024-04-17T08:31:24.473 INFO:teuthology.orchestra.run.smithi152.stderr: * [new tag] 20200619 -> 20200619 2024-04-17T08:31:24.473 INFO:teuthology.orchestra.run.smithi152.stderr: * [new tag] 20200721 -> 20200721 2024-04-17T08:31:24.473 INFO:teuthology.orchestra.run.smithi152.stderr: * [new tag] 20200817 -> 20200817 2024-04-17T08:31:24.473 INFO:teuthology.orchestra.run.smithi152.stderr: * [new tag] 20200918 -> 20200918 2024-04-17T08:31:24.473 INFO:teuthology.orchestra.run.smithi152.stderr: * [new tag] 20201022 -> 20201022 2024-04-17T08:31:24.473 INFO:teuthology.orchestra.run.smithi152.stderr: * [new tag] 20201118 -> 20201118 2024-04-17T08:31:24.473 INFO:teuthology.orchestra.run.smithi152.stderr: * [new tag] 20201218 -> 20201218 2024-04-17T08:31:24.473 INFO:teuthology.orchestra.run.smithi152.stderr: * [new tag] 20210208 -> 20210208 2024-04-17T08:31:24.473 INFO:teuthology.orchestra.run.smithi152.stderr: * [new tag] 20210315 -> 20210315 2024-04-17T08:31:24.474 INFO:teuthology.orchestra.run.smithi152.stderr: * [new tag] 20210511 -> 20210511 2024-04-17T08:31:24.474 INFO:teuthology.orchestra.run.smithi152.stderr: * [new tag] 20210716 -> 20210716 2024-04-17T08:31:24.474 INFO:teuthology.orchestra.run.smithi152.stderr: * [new tag] 20210818 -> 20210818 2024-04-17T08:31:24.474 INFO:teuthology.orchestra.run.smithi152.stderr: * [new tag] 20210919 -> 20210919 2024-04-17T08:31:24.474 INFO:teuthology.orchestra.run.smithi152.stderr: * [new tag] 20211027 -> 20211027 2024-04-17T08:31:24.477 INFO:teuthology.orchestra.run.smithi152.stderr: * [new tag] 20211216 -> 20211216 2024-04-17T08:31:24.477 INFO:teuthology.orchestra.run.smithi152.stderr: * [new tag] 20220209 -> 20220209 2024-04-17T08:31:24.477 INFO:teuthology.orchestra.run.smithi152.stderr: * [new tag] 20220310 -> 20220310 2024-04-17T08:31:24.477 INFO:teuthology.orchestra.run.smithi152.stderr: * [new tag] 20220411 -> 20220411 2024-04-17T08:31:24.477 INFO:teuthology.orchestra.run.smithi152.stderr: * [new tag] 20220509 -> 20220509 2024-04-17T08:31:24.477 INFO:teuthology.orchestra.run.smithi152.stderr: * [new tag] 20220610 -> 20220610 2024-04-17T08:31:24.477 INFO:teuthology.orchestra.run.smithi152.stderr: * [new tag] 20220708 -> 20220708 2024-04-17T08:31:24.477 INFO:teuthology.orchestra.run.smithi152.stderr: * [new tag] 20220815 -> 20220815 2024-04-17T08:31:24.477 INFO:teuthology.orchestra.run.smithi152.stderr: * [new tag] 20220913 -> 20220913 2024-04-17T08:31:24.477 INFO:teuthology.orchestra.run.smithi152.stderr: * [new tag] 20221012 -> 20221012 2024-04-17T08:31:24.477 INFO:teuthology.orchestra.run.smithi152.stderr: * [new tag] 20221109 -> 20221109 2024-04-17T08:31:24.477 INFO:teuthology.orchestra.run.smithi152.stderr: * [new tag] 20221214 -> 20221214 2024-04-17T08:31:24.478 INFO:teuthology.orchestra.run.smithi152.stderr: * [new tag] 20230117 -> 20230117 2024-04-17T08:31:24.478 INFO:teuthology.orchestra.run.smithi152.stderr: * [new tag] 20230210 -> 20230210 2024-04-17T08:31:24.478 INFO:teuthology.orchestra.run.smithi152.stderr: * [new tag] 20230310 -> 20230310 2024-04-17T08:31:24.478 INFO:teuthology.orchestra.run.smithi152.stderr: * [new tag] 20230404 -> 20230404 2024-04-17T08:31:24.478 INFO:teuthology.orchestra.run.smithi152.stderr: * [new tag] 20230515 -> 20230515 2024-04-17T08:31:24.478 INFO:teuthology.orchestra.run.smithi152.stderr: * [new tag] 20230625 -> 20230625 2024-04-17T08:31:24.478 INFO:teuthology.orchestra.run.smithi152.stderr: * [new tag] 20230804 -> 20230804 2024-04-17T08:31:24.478 INFO:teuthology.orchestra.run.smithi152.stderr: * [new tag] 20230919 -> 20230919 2024-04-17T08:31:24.478 INFO:teuthology.orchestra.run.smithi152.stderr: * [new tag] 20231030 -> 20231030 2024-04-17T08:31:24.478 INFO:teuthology.orchestra.run.smithi152.stderr: * [new tag] 20231111 -> 20231111 2024-04-17T08:31:24.478 INFO:teuthology.orchestra.run.smithi152.stderr: * [new tag] 20231211 -> 20231211 2024-04-17T08:31:24.478 INFO:teuthology.orchestra.run.smithi152.stderr: * [new tag] 20240115 -> 20240115 2024-04-17T08:31:24.478 INFO:teuthology.orchestra.run.smithi152.stderr: * [new tag] 20240220 -> 20240220 2024-04-17T08:31:24.478 INFO:teuthology.orchestra.run.smithi152.stderr: * [new tag] 20240312 -> 20240312 2024-04-17T08:31:24.479 INFO:teuthology.orchestra.run.smithi152.stderr: * [new tag] 20240410 -> 20240410 2024-04-17T08:31:25.145 INFO:teuthology.orchestra.run.smithi196.stderr:Updating files: 50% (1824/3602) Updating files: 51% (1838/3602) Updating files: 52% (1874/3602) Updating files: 53% (1910/3602) Updating files: 54% (1946/3602) Updating files: 55% (1982/3602) Updating files: 56% (2018/3602) Updating files: 57% (2054/3602) Updating files: 58% (2090/3602) Updating files: 59% (2126/3602) Updating files: 60% (2162/3602) Updating files: 61% (2198/3602) Updating files: 62% (2234/3602) Updating files: 63% (2270/3602) Updating files: 63% (2302/3602) Updating files: 64% (2306/3602) Updating files: 65% (2342/3602) Updating files: 66% (2378/3602) Updating files: 67% (2414/3602) Updating files: 68% (2450/3602) Updating files: 69% (2486/3602) Updating files: 70% (2522/3602) Updating files: 71% (2558/3602) Updating files: 72% (2594/3602) Updating files: 73% (2630/3602) Updating files: 74% (2666/3602) Updating files: 75% (2702/3602) Updating files: 76% (2738/3602) Updating files: 77% (2774/3602) Updating files: 77% (2789/3602) Updating files: 78% (2810/3602) Updating files: 79% (2846/3602) Updating files: 80% (2882/3602) Updating files: 81% (2918/3602) Updating files: 82% (2954/3602) Updating files: 83% (2990/3602) Updating files: 84% (3026/3602) Updating files: 85% (3062/3602) Updating files: 86% (3098/3602) Updating files: 87% (3134/3602) Updating files: 88% (3170/3602) Updating files: 89% (3206/3602) Updating files: 90% (3242/3602) Updating files: 91% (3278/3602) Updating files: 92% (3314/3602) Updating files: 92% (3338/3602) Updating files: 93% (3350/3602) Updating files: 94% (3386/3602) Updating files: 95% (3422/3602) Updating files: 96% (3458/3602) Updating files: 97% (3494/3602) Updating files: 98% (3530/3602) Updating files: 99% (3566/3602) Updating files: 100% (3602/3602) Updating files: 100% (3602/3602), done. 2024-04-17T08:31:25.150 INFO:teuthology.orchestra.run.smithi196.stdout:HEAD is now at 5da74b16 Merge branch 'robot/pr-0-1712895838' into 'main' 2024-04-17T08:31:25.170 INFO:teuthology.task.kernel:Downloading kernel 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 on mon.b... 2024-04-17T08:31:25.171 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-17T08:31:25.321 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g3f60ed14f7c1/ 2024-04-17T08:31:25.321 DEBUG:teuthology.orchestra.run.smithi196:> rm -f /tmp/linux-image.deb && echo linux-image-6.9.0-rc3-g3f60ed14f7c1_6.9.0-rc3-g3f60ed14f7c1-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://1.chacra.ceph.com/r/kernel/testing/3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g3f60ed14f7c1/ --input-file=- 2024-04-17T08:31:25.324 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi196.front.sepia.ceph.com to complete... 2024-04-17T08:31:28.638 INFO:teuthology.orchestra.run.smithi152.stderr:Updating files: 50% (1823/3602) Updating files: 51% (1838/3602) Updating files: 52% (1874/3602) Updating files: 53% (1910/3602) Updating files: 54% (1946/3602) Updating files: 55% (1982/3602) Updating files: 56% (2018/3602) Updating files: 57% (2054/3602) Updating files: 58% (2090/3602) Updating files: 59% (2126/3602) Updating files: 60% (2162/3602) Updating files: 61% (2198/3602) Updating files: 62% (2234/3602) Updating files: 63% (2270/3602) Updating files: 63% (2298/3602) Updating files: 64% (2306/3602) Updating files: 65% (2342/3602) Updating files: 66% (2378/3602) Updating files: 67% (2414/3602) Updating files: 68% (2450/3602) Updating files: 69% (2486/3602) Updating files: 70% (2522/3602) Updating files: 71% (2558/3602) Updating files: 72% (2594/3602) Updating files: 73% (2630/3602) Updating files: 74% (2666/3602) Updating files: 75% (2702/3602) Updating files: 76% (2738/3602) Updating files: 77% (2774/3602) Updating files: 77% (2789/3602) Updating files: 78% (2810/3602) Updating files: 79% (2846/3602) Updating files: 80% (2882/3602) Updating files: 81% (2918/3602) Updating files: 82% (2954/3602) Updating files: 83% (2990/3602) Updating files: 84% (3026/3602) Updating files: 85% (3062/3602) Updating files: 86% (3098/3602) Updating files: 87% (3134/3602) Updating files: 88% (3170/3602) Updating files: 89% (3206/3602) Updating files: 90% (3242/3602) Updating files: 91% (3278/3602) Updating files: 92% (3314/3602) Updating files: 93% (3350/3602) Updating files: 93% (3360/3602) Updating files: 94% (3386/3602) Updating files: 95% (3422/3602) Updating files: 96% (3458/3602) Updating files: 97% (3494/3602) Updating files: 98% (3530/3602) Updating files: 99% (3566/3602) Updating files: 100% (3602/3602) Updating files: 100% (3602/3602), done. 2024-04-17T08:31:28.643 INFO:teuthology.orchestra.run.smithi152.stdout:HEAD is now at 5da74b16 Merge branch 'robot/pr-0-1712895838' into 'main' 2024-04-17T08:31:28.664 INFO:teuthology.task.kernel:Downloading kernel 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 on mon.a... 2024-04-17T08:31:28.664 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-17T08:31:28.914 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g3f60ed14f7c1/ 2024-04-17T08:31:28.915 DEBUG:teuthology.orchestra.run.smithi152:> rm -f /tmp/linux-image.deb && echo linux-image-6.9.0-rc3-g3f60ed14f7c1_6.9.0-rc3-g3f60ed14f7c1-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://1.chacra.ceph.com/r/kernel/testing/3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g3f60ed14f7c1/ --input-file=- 2024-04-17T08:31:28.917 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi152.front.sepia.ceph.com to complete... 2024-04-17T08:31:33.531 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17 08:31:33 URL:https://1.chacra.ceph.com/r/kernel/testing/3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g3f60ed14f7c1/linux-image-6.9.0-rc3-g3f60ed14f7c1_6.9.0-rc3-g3f60ed14f7c1-1_amd64.deb [44839714/44839714] -> "/tmp/linux-image.deb" [1] 2024-04-17T08:31:33.531 INFO:teuthology.orchestra.run.smithi196.stderr:FINISHED --2024-04-17 08:31:33-- 2024-04-17T08:31:33.532 INFO:teuthology.orchestra.run.smithi196.stderr:Total wall clock time: 8.2s 2024-04-17T08:31:33.532 INFO:teuthology.orchestra.run.smithi196.stderr:Downloaded: 1 files, 43M in 7.8s (5.47 MB/s) 2024-04-17T08:31:33.536 INFO:teuthology.task.kernel:Installing kernel 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 on mon.b... 2024-04-17T08:31:33.536 DEBUG:teuthology.orchestra.run.smithi196:> sudo dpkg -i /tmp/linux-image.deb 2024-04-17T08:31:33.784 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package linux-image-6.9.0-rc3-g3f60ed14f7c1. 2024-04-17T08:31:34.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17 08:31:34 URL:https://1.chacra.ceph.com/r/kernel/testing/3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g3f60ed14f7c1/linux-image-6.9.0-rc3-g3f60ed14f7c1_6.9.0-rc3-g3f60ed14f7c1-1_amd64.deb [44839714/44839714] -> "/tmp/linux-image.deb" [1] 2024-04-17T08:31:34.626 INFO:teuthology.orchestra.run.smithi152.stderr:FINISHED --2024-04-17 08:31:34-- 2024-04-17T08:31:34.626 INFO:teuthology.orchestra.run.smithi152.stderr:Total wall clock time: 5.7s 2024-04-17T08:31:34.626 INFO:teuthology.orchestra.run.smithi152.stderr:Downloaded: 1 files, 43M in 5.4s (7.98 MB/s) 2024-04-17T08:31:34.632 INFO:teuthology.task.kernel:Installing kernel 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 on mon.a... 2024-04-17T08:31:34.632 DEBUG:teuthology.orchestra.run.smithi152:> sudo dpkg -i /tmp/linux-image.deb 2024-04-17T08:31:34.884 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package linux-image-6.9.0-rc3-g3f60ed14f7c1. 2024-04-17T08:31:35.795 INFO:teuthology.orchestra.run.smithi196.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-04-17T08:31:35.801 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-04-17T08:31:35.933 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking linux-image-6.9.0-rc3-g3f60ed14f7c1 (6.9.0-rc3-g3f60ed14f7c1-1) ... 2024-04-17T08:31:36.927 INFO:teuthology.orchestra.run.smithi152.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-04-17T08:31:36.931 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-04-17T08:31:37.138 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking linux-image-6.9.0-rc3-g3f60ed14f7c1 (6.9.0-rc3-g3f60ed14f7c1-1) ... 2024-04-17T08:31:39.534 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up linux-image-6.9.0-rc3-g3f60ed14f7c1 (6.9.0-rc3-g3f60ed14f7c1-1) ... 2024-04-17T08:31:39.693 INFO:teuthology.orchestra.run.smithi196.stderr:update-initramfs: Generating /boot/initrd.img-6.9.0-rc3-g3f60ed14f7c1 2024-04-17T08:31:40.898 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up linux-image-6.9.0-rc3-g3f60ed14f7c1 (6.9.0-rc3-g3f60ed14f7c1-1) ... 2024-04-17T08:31:40.985 INFO:teuthology.orchestra.run.smithi152.stderr:update-initramfs: Generating /boot/initrd.img-6.9.0-rc3-g3f60ed14f7c1 2024-04-17T08:32:02.396 INFO:teuthology.orchestra.run.smithi196.stderr:Sourcing file `/etc/default/grub' 2024-04-17T08:32:02.415 INFO:teuthology.orchestra.run.smithi196.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-17T08:32:02.440 INFO:teuthology.orchestra.run.smithi196.stderr:Generating grub configuration file ... 2024-04-17T08:32:02.751 INFO:teuthology.orchestra.run.smithi196.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g3f60ed14f7c1 2024-04-17T08:32:02.773 INFO:teuthology.orchestra.run.smithi196.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g3f60ed14f7c1 2024-04-17T08:32:03.080 INFO:teuthology.orchestra.run.smithi196.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-17T08:32:03.094 INFO:teuthology.orchestra.run.smithi196.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-17T08:32:03.160 INFO:teuthology.orchestra.run.smithi196.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-17T08:32:03.165 INFO:teuthology.orchestra.run.smithi196.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-17T08:32:03.325 INFO:teuthology.orchestra.run.smithi196.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-17T08:32:03.325 INFO:teuthology.orchestra.run.smithi196.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-17T08:32:03.325 INFO:teuthology.orchestra.run.smithi196.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-17T08:32:03.357 INFO:teuthology.orchestra.run.smithi196.stderr:done 2024-04-17T08:32:03.362 INFO:teuthology.orchestra.run.smithi152.stderr:Sourcing file `/etc/default/grub' 2024-04-17T08:32:03.380 INFO:teuthology.orchestra.run.smithi152.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-17T08:32:03.408 INFO:teuthology.orchestra.run.smithi152.stderr:Generating grub configuration file ... 2024-04-17T08:32:03.532 DEBUG:teuthology.orchestra.run.smithi196:> dpkg-deb -c /tmp/linux-image.deb 2024-04-17T08:32:03.540 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./ 2024-04-17T08:32:03.540 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./boot/ 2024-04-17T08:32:03.540 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 7002012 2024-04-11 18:50 ./boot/System.map-6.9.0-rc3-g3f60ed14f7c1 2024-04-17T08:32:03.554 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 172073 2024-04-11 18:50 ./boot/config-6.9.0-rc3-g3f60ed14f7c1 2024-04-17T08:32:03.554 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13120512 2024-04-11 18:50 ./boot/vmlinuz-6.9.0-rc3-g3f60ed14f7c1 2024-04-17T08:32:03.573 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./etc/ 2024-04-17T08:32:03.573 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./etc/kernel/ 2024-04-17T08:32:03.573 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./etc/kernel/postinst.d/ 2024-04-17T08:32:03.573 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./etc/kernel/postrm.d/ 2024-04-17T08:32:03.573 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./etc/kernel/preinst.d/ 2024-04-17T08:32:03.573 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./etc/kernel/prerm.d/ 2024-04-17T08:32:03.574 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/ 2024-04-17T08:32:03.574 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/ 2024-04-17T08:32:03.574 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/ 2024-04-17T08:32:03.574 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/ 2024-04-17T08:32:03.574 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/ 2024-04-17T08:32:03.574 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/ 2024-04-17T08:32:03.574 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/ 2024-04-17T08:32:03.574 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 507569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/aesni-intel.ko 2024-04-17T08:32:03.577 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-17T08:32:03.577 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 34313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-17T08:32:03.577 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 35009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-17T08:32:03.577 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 97953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-17T08:32:03.577 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 109905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-17T08:32:03.578 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 155249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-17T08:32:03.578 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-17T08:32:03.578 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-17T08:32:03.578 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 87009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-17T08:32:03.578 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-17T08:32:03.578 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 50305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-17T08:32:03.578 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 50377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-17T08:32:03.578 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 54513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-17T08:32:03.578 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 44657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-17T08:32:03.578 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 48049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-17T08:32:03.578 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 62873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-17T08:32:03.578 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 53569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-17T08:32:03.578 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 34761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-17T08:32:03.579 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-17T08:32:03.579 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/ 2024-04-17T08:32:03.579 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpu/ 2024-04-17T08:32:03.579 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpu/mce/ 2024-04-17T08:32:03.579 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 49081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-17T08:32:03.579 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpuid.ko 2024-04-17T08:32:03.579 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/msr.ko 2024-04-17T08:32:03.579 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/ 2024-04-17T08:32:03.579 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 444425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-17T08:32:03.579 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 1035881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-17T08:32:03.579 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 2849609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/kvm.ko 2024-04-17T08:32:03.655 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/ 2024-04-17T08:32:03.655 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 65025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/af_alg.ko 2024-04-17T08:32:03.655 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 27961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/algif_hash.ko 2024-04-17T08:32:03.655 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/algif_skcipher.ko 2024-04-17T08:32:03.656 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/ansi_cprng.ko 2024-04-17T08:32:03.656 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/anubis.ko 2024-04-17T08:32:03.656 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10929 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/arc4.ko 2024-04-17T08:32:03.656 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/asymmetric_keys/ 2024-04-17T08:32:03.656 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-04-17T08:32:03.656 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/ 2024-04-17T08:32:03.656 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_memcpy.ko 2024-04-17T08:32:03.656 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_pq.ko 2024-04-17T08:32:03.656 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-17T08:32:03.656 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_tx.ko 2024-04-17T08:32:03.656 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_xor.ko 2024-04-17T08:32:03.656 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/raid6test.ko 2024-04-17T08:32:03.656 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/authenc.ko 2024-04-17T08:32:03.656 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 27953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/authencesn.ko 2024-04-17T08:32:03.656 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/blake2b_generic.ko 2024-04-17T08:32:03.657 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/blowfish_common.ko 2024-04-17T08:32:03.657 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/blowfish_generic.ko 2024-04-17T08:32:03.657 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 40889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/camellia_generic.ko 2024-04-17T08:32:03.657 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 29113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cast5_generic.ko 2024-04-17T08:32:03.657 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cast6_generic.ko 2024-04-17T08:32:03.657 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cast_common.ko 2024-04-17T08:32:03.657 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 43281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/ccm.ko 2024-04-17T08:32:03.657 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cmac.ko 2024-04-17T08:32:03.657 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crc32_generic.ko 2024-04-17T08:32:03.657 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 59129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cryptd.ko 2024-04-17T08:32:03.657 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 48113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crypto_engine.ko 2024-04-17T08:32:03.657 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 32169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crypto_simd.ko 2024-04-17T08:32:03.657 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 30881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crypto_user.ko 2024-04-17T08:32:03.657 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cts.ko 2024-04-17T08:32:03.658 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/des_generic.ko 2024-04-17T08:32:03.658 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/dh_generic.ko 2024-04-17T08:32:03.658 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/echainiv.ko 2024-04-17T08:32:03.658 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 30689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/essiv.ko 2024-04-17T08:32:03.658 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/fcrypt.ko 2024-04-17T08:32:03.658 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/khazad.ko 2024-04-17T08:32:03.658 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/lrw.ko 2024-04-17T08:32:03.658 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/lz4.ko 2024-04-17T08:32:03.658 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/lz4hc.ko 2024-04-17T08:32:03.658 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/md4.ko 2024-04-17T08:32:03.658 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/michael_mic.ko 2024-04-17T08:32:03.658 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/pcbc.ko 2024-04-17T08:32:03.658 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/pcrypt.ko 2024-04-17T08:32:03.659 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/rmd160.ko 2024-04-17T08:32:03.659 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 30673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/seed.ko 2024-04-17T08:32:03.659 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/serpent_generic.ko 2024-04-17T08:32:03.659 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 169065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/tcrypt.ko 2024-04-17T08:32:03.659 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/tea.ko 2024-04-17T08:32:03.659 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 29641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/twofish_common.ko 2024-04-17T08:32:03.659 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/twofish_generic.ko 2024-04-17T08:32:03.659 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/vmac.ko 2024-04-17T08:32:03.659 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 38209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/wp512.ko 2024-04-17T08:32:03.659 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xcbc.ko 2024-04-17T08:32:03.659 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 30345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xor.ko 2024-04-17T08:32:03.659 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xts.ko 2024-04-17T08:32:03.659 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xxhash_generic.ko 2024-04-17T08:32:03.659 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ 2024-04-17T08:32:03.659 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/ 2024-04-17T08:32:03.660 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/acpi_extlog.ko 2024-04-17T08:32:03.660 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 31921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-17T08:32:03.660 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 32281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/acpi_pad.ko 2024-04-17T08:32:03.660 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/apei/ 2024-04-17T08:32:03.660 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 44705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/apei/einj.ko 2024-04-17T08:32:03.660 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/ec_sys.ko 2024-04-17T08:32:03.660 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/platform_profile.ko 2024-04-17T08:32:03.660 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 29017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/sbs.ko 2024-04-17T08:32:03.660 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/sbshc.ko 2024-04-17T08:32:03.660 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 119033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/video.ko 2024-04-17T08:32:03.660 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/ 2024-04-17T08:32:03.660 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/acard-ahci.ko 2024-04-17T08:32:03.660 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 96825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/ahci.ko 2024-04-17T08:32:03.661 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/ahci_platform.ko 2024-04-17T08:32:03.661 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 107737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/libahci.ko 2024-04-17T08:32:03.661 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 42001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/libahci_platform.ko 2024-04-17T08:32:03.661 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_acpi.ko 2024-04-17T08:32:03.661 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 35705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ali.ko 2024-04-17T08:32:03.661 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 38329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_amd.ko 2024-04-17T08:32:03.661 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_artop.ko 2024-04-17T08:32:03.661 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_atiixp.ko 2024-04-17T08:32:03.661 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_atp867x.ko 2024-04-17T08:32:03.661 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_cmd640.ko 2024-04-17T08:32:03.661 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28929 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_cmd64x.ko 2024-04-17T08:32:03.661 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_cypress.ko 2024-04-17T08:32:03.661 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_efar.ko 2024-04-17T08:32:03.661 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt366.ko 2024-04-17T08:32:03.661 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 38913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt37x.ko 2024-04-17T08:32:03.662 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-17T08:32:03.662 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-17T08:32:03.662 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_it8213.ko 2024-04-17T08:32:03.662 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 41289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_it821x.ko 2024-04-17T08:32:03.662 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_jmicron.ko 2024-04-17T08:32:03.662 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 60257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_legacy.ko 2024-04-17T08:32:03.662 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_marvell.ko 2024-04-17T08:32:03.662 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_mpiix.ko 2024-04-17T08:32:03.662 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_netcell.ko 2024-04-17T08:32:03.662 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ninja32.ko 2024-04-17T08:32:03.662 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ns87410.ko 2024-04-17T08:32:03.662 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ns87415.ko 2024-04-17T08:32:03.662 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_oldpiix.ko 2024-04-17T08:32:03.663 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_opti.ko 2024-04-17T08:32:03.663 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_optidma.ko 2024-04-17T08:32:03.663 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 35145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_pcmcia.ko 2024-04-17T08:32:03.666 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 43009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-17T08:32:03.666 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-17T08:32:03.666 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_piccolo.ko 2024-04-17T08:32:03.666 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_radisys.ko 2024-04-17T08:32:03.666 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_rdc.ko 2024-04-17T08:32:03.666 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_rz1000.ko 2024-04-17T08:32:03.666 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sch.ko 2024-04-17T08:32:03.666 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_serverworks.ko 2024-04-17T08:32:03.666 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 27305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sil680.ko 2024-04-17T08:32:03.666 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sl82c105.ko 2024-04-17T08:32:03.667 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_triflex.ko 2024-04-17T08:32:03.667 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 35025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_via.ko 2024-04-17T08:32:03.667 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pdc_adma.ko 2024-04-17T08:32:03.667 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 34889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_inic162x.ko 2024-04-17T08:32:03.667 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 102121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_mv.ko 2024-04-17T08:32:03.667 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 85409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_nv.ko 2024-04-17T08:32:03.667 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 44313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_promise.ko 2024-04-17T08:32:03.667 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_qstor.ko 2024-04-17T08:32:03.667 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 34025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sil.ko 2024-04-17T08:32:03.667 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 45905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sil24.ko 2024-04-17T08:32:03.667 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sis.ko 2024-04-17T08:32:03.667 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_svw.ko 2024-04-17T08:32:03.667 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 53353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sx4.ko 2024-04-17T08:32:03.667 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_uli.ko 2024-04-17T08:32:03.667 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 41049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_via.ko 2024-04-17T08:32:03.668 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_vsc.ko 2024-04-17T08:32:03.668 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/auxdisplay/ 2024-04-17T08:32:03.668 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/auxdisplay/ks0108.ko 2024-04-17T08:32:03.668 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/bcma/ 2024-04-17T08:32:03.668 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 163969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/bcma/bcma.ko 2024-04-17T08:32:03.668 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/ 2024-04-17T08:32:03.668 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/aoe/ 2024-04-17T08:32:03.668 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 140865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/aoe/aoe.ko 2024-04-17T08:32:03.668 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/drbd/ 2024-04-17T08:32:03.668 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 1241657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/drbd/drbd.ko 2024-04-17T08:32:03.668 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 203289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/floppy.ko 2024-04-17T08:32:03.668 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/mtip32xx/ 2024-04-17T08:32:03.668 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 115265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-17T08:32:03.668 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 143433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/nbd.ko 2024-04-17T08:32:03.669 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/null_blk/ 2024-04-17T08:32:03.669 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 126617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/null_blk/null_blk.ko 2024-04-17T08:32:03.669 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 119873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/pktcdvd.ko 2024-04-17T08:32:03.669 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 313217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/rbd.ko 2024-04-17T08:32:03.669 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/xen-blkback/ 2024-04-17T08:32:03.669 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 117233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-17T08:32:03.669 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/zram/ 2024-04-17T08:32:03.669 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 70385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/zram/zram.ko 2024-04-17T08:32:03.669 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ 2024-04-17T08:32:03.669 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 35377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/applicom.ko 2024-04-17T08:32:03.669 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hangcheck-timer.ko 2024-04-17T08:32:03.669 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/ 2024-04-17T08:32:03.669 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-17T08:32:03.669 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-17T08:32:03.669 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-17T08:32:03.670 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/via-rng.ko 2024-04-17T08:32:03.670 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-17T08:32:03.670 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ 2024-04-17T08:32:03.670 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 37257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-17T08:32:03.670 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 186921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-17T08:32:03.670 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 32521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-17T08:32:03.670 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 179561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-17T08:32:03.670 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 85441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-17T08:32:03.670 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 65313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-17T08:32:03.670 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 43857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/lp.ko 2024-04-17T08:32:03.670 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/mwave/ 2024-04-17T08:32:03.670 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 103409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/mwave/mwave.ko 2024-04-17T08:32:03.670 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 31833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/nvram.ko 2024-04-17T08:32:03.670 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 38977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ppdev.ko 2024-04-17T08:32:03.671 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 59241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tlclk.ko 2024-04-17T08:32:03.671 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/ 2024-04-17T08:32:03.671 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-17T08:32:03.671 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-04-17T08:32:03.671 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 29425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-04-17T08:32:03.671 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 39193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-04-17T08:32:03.671 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 34169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-17T08:32:03.671 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-17T08:32:03.671 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-04-17T08:32:03.671 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/xillybus/ 2024-04-17T08:32:03.671 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/xillybus/xillybus_class.ko 2024-04-17T08:32:03.671 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 62545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/xillybus/xillybus_core.ko 2024-04-17T08:32:03.671 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13929 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-04-17T08:32:03.671 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/clk/ 2024-04-17T08:32:03.672 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/clk/clk-palmas.ko 2024-04-17T08:32:03.672 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 57289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/clk/clk-si5351.ko 2024-04-17T08:32:03.672 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/clk/clk-twl6040.ko 2024-04-17T08:32:03.672 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/clk/clk-wm831x.ko 2024-04-17T08:32:03.672 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/ 2024-04-17T08:32:03.672 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-17T08:32:03.672 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-17T08:32:03.672 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-17T08:32:03.672 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ 2024-04-17T08:32:03.672 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ccp/ 2024-04-17T08:32:03.672 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 89257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-17T08:32:03.672 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 333657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ccp/ccp.ko 2024-04-17T08:32:03.672 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/ 2024-04-17T08:32:03.672 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/ 2024-04-17T08:32:03.672 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_common/ 2024-04-17T08:32:03.673 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 751713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-17T08:32:03.673 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-04-17T08:32:03.673 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 29497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-17T08:32:03.673 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/padlock-aes.ko 2024-04-17T08:32:03.673 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/padlock-sha.ko 2024-04-17T08:32:03.673 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/virtio/ 2024-04-17T08:32:03.673 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 90441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-17T08:32:03.673 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dca/ 2024-04-17T08:32:03.673 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 36105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dca/dca.ko 2024-04-17T08:32:03.673 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/ 2024-04-17T08:32:03.673 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/dw/ 2024-04-17T08:32:03.673 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-17T08:32:03.673 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/ioat/ 2024-04-17T08:32:03.673 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 146769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-17T08:32:03.674 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/ 2024-04-17T08:32:03.674 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 96145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/amd64_edac.ko 2024-04-17T08:32:03.674 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 41993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/e752x_edac.ko 2024-04-17T08:32:03.674 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 51105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/edac_mce_amd.ko 2024-04-17T08:32:03.674 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i3000_edac.ko 2024-04-17T08:32:03.674 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i3200_edac.ko 2024-04-17T08:32:03.674 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i5100_edac.ko 2024-04-17T08:32:03.674 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 29593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i5400_edac.ko 2024-04-17T08:32:03.674 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i7300_edac.ko 2024-04-17T08:32:03.674 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 64161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i7core_edac.ko 2024-04-17T08:32:03.674 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i82975x_edac.ko 2024-04-17T08:32:03.674 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/ie31200_edac.ko 2024-04-17T08:32:03.674 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 68697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/sb_edac.ko 2024-04-17T08:32:03.674 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/x38_edac.ko 2024-04-17T08:32:03.674 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/ 2024-04-17T08:32:03.675 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/extcon-gpio.ko 2024-04-17T08:32:03.675 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 31369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/extcon-max14577.ko 2024-04-17T08:32:03.675 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 35601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/extcon-max77693.ko 2024-04-17T08:32:03.675 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 29273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/extcon-max8997.ko 2024-04-17T08:32:03.675 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 30961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/extcon-palmas.ko 2024-04-17T08:32:03.675 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 27201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/extcon-rt8973a.ko 2024-04-17T08:32:03.675 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 31993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/extcon-sm5502.ko 2024-04-17T08:32:03.675 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/ 2024-04-17T08:32:03.675 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 42953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/dmi-sysfs.ko 2024-04-17T08:32:03.675 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/efi/ 2024-04-17T08:32:03.675 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/efi/efi-pstore.ko 2024-04-17T08:32:03.675 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-17T08:32:03.675 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/ 2024-04-17T08:32:03.675 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-adp5520.ko 2024-04-17T08:32:03.676 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-amd8111.ko 2024-04-17T08:32:03.676 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-arizona.ko 2024-04-17T08:32:03.676 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-da9052.ko 2024-04-17T08:32:03.676 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-da9055.ko 2024-04-17T08:32:03.676 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-dln2.ko 2024-04-17T08:32:03.676 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 81073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-f7188x.ko 2024-04-17T08:32:03.676 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 40761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-generic.ko 2024-04-17T08:32:03.676 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-ich.ko 2024-04-17T08:32:03.676 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-04-17T08:32:03.676 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-kempld.ko 2024-04-17T08:32:03.676 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-lp3943.ko 2024-04-17T08:32:03.676 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-max7300.ko 2024-04-17T08:32:03.676 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-max730x.ko 2024-04-17T08:32:03.676 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-max732x.ko 2024-04-17T08:32:03.677 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 29945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-04-17T08:32:03.677 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 55505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-pca953x.ko 2024-04-17T08:32:03.677 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 31881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-pcf857x.ko 2024-04-17T08:32:03.677 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-rdc321x.ko 2024-04-17T08:32:03.677 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-sch.ko 2024-04-17T08:32:03.677 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-sch311x.ko 2024-04-17T08:32:03.677 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-tps65912.ko 2024-04-17T08:32:03.677 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-twl4030.ko 2024-04-17T08:32:03.677 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-twl6040.ko 2024-04-17T08:32:03.677 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-17T08:32:03.677 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-vx855.ko 2024-04-17T08:32:03.677 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-wm831x.ko 2024-04-17T08:32:03.677 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-wm8350.ko 2024-04-17T08:32:03.677 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-wm8994.ko 2024-04-17T08:32:03.677 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/ 2024-04-17T08:32:03.678 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-a4tech.ko 2024-04-17T08:32:03.678 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 43553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-apple.ko 2024-04-17T08:32:03.678 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-appleir.ko 2024-04-17T08:32:03.678 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-aureal.ko 2024-04-17T08:32:03.678 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-axff.ko 2024-04-17T08:32:03.678 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-belkin.ko 2024-04-17T08:32:03.678 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-cherry.ko 2024-04-17T08:32:03.678 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-chicony.ko 2024-04-17T08:32:03.678 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 74393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-cp2112.ko 2024-04-17T08:32:03.678 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-cypress.ko 2024-04-17T08:32:03.678 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-dr.ko 2024-04-17T08:32:03.678 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-elecom.ko 2024-04-17T08:32:03.678 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-elo.ko 2024-04-17T08:32:03.678 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-emsff.ko 2024-04-17T08:32:03.679 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-ezkey.ko 2024-04-17T08:32:03.679 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-gaff.ko 2024-04-17T08:32:03.679 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-generic.ko 2024-04-17T08:32:03.679 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-gt683r.ko 2024-04-17T08:32:03.679 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-gyration.ko 2024-04-17T08:32:03.679 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-17T08:32:03.679 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-17T08:32:03.679 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-holtekff.ko 2024-04-17T08:32:03.679 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-hyperv.ko 2024-04-17T08:32:03.679 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-icade.ko 2024-04-17T08:32:03.679 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-kensington.ko 2024-04-17T08:32:03.679 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-keytouch.ko 2024-04-17T08:32:03.679 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-kye.ko 2024-04-17T08:32:03.679 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-lcpower.ko 2024-04-17T08:32:03.680 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-led.ko 2024-04-17T08:32:03.680 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 54217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-lenovo.ko 2024-04-17T08:32:03.680 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 37553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-lg-g15.ko 2024-04-17T08:32:03.680 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 68081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-17T08:32:03.680 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 121369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-17T08:32:03.680 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 97953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-logitech.ko 2024-04-17T08:32:03.680 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 36689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-magicmouse.ko 2024-04-17T08:32:03.680 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-microsoft.ko 2024-04-17T08:32:03.680 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-monterey.ko 2024-04-17T08:32:03.680 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 59001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-multitouch.ko 2024-04-17T08:32:03.680 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 39697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-ntrig.ko 2024-04-17T08:32:03.680 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-ortek.ko 2024-04-17T08:32:03.680 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-penmount.ko 2024-04-17T08:32:03.680 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-petalynx.ko 2024-04-17T08:32:03.680 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 91241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-picolcd.ko 2024-04-17T08:32:03.681 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-pl.ko 2024-04-17T08:32:03.681 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-plantronics.ko 2024-04-17T08:32:03.681 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-primax.ko 2024-04-17T08:32:03.681 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 42889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-rmi.ko 2024-04-17T08:32:03.681 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-17T08:32:03.681 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-common.ko 2024-04-17T08:32:03.681 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 38865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-17T08:32:03.681 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 36305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-17T08:32:03.681 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 38073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-17T08:32:03.681 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-17T08:32:03.681 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 35625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-17T08:32:03.681 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-17T08:32:03.681 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 35425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-17T08:32:03.681 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 35561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-17T08:32:03.681 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-17T08:32:03.682 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat.ko 2024-04-17T08:32:03.682 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-saitek.ko 2024-04-17T08:32:03.682 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 42305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-samsung.ko 2024-04-17T08:32:03.682 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 43609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-17T08:32:03.682 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sjoy.ko 2024-04-17T08:32:03.682 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 62129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sony.ko 2024-04-17T08:32:03.682 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-speedlink.ko 2024-04-17T08:32:03.682 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 30017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-steelseries.ko 2024-04-17T08:32:03.682 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sunplus.ko 2024-04-17T08:32:03.682 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-17T08:32:03.682 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-tivo.ko 2024-04-17T08:32:03.682 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-tmff.ko 2024-04-17T08:32:03.682 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-topseed.ko 2024-04-17T08:32:03.682 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-twinhan.ko 2024-04-17T08:32:03.683 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 81113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-uclogic.ko 2024-04-17T08:32:03.683 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-waltop.ko 2024-04-17T08:32:03.683 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 184745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-wiimote.ko 2024-04-17T08:32:03.683 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-xinmo.ko 2024-04-17T08:32:03.683 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-zpff.ko 2024-04-17T08:32:03.683 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-zydacron.ko 2024-04-17T08:32:03.683 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 319921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid.ko 2024-04-17T08:32:03.683 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 39529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/uhid.ko 2024-04-17T08:32:03.683 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/usbhid/ 2024-04-17T08:32:03.683 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 153633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/usbhid/usbhid.ko 2024-04-17T08:32:03.683 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/usbhid/usbkbd.ko 2024-04-17T08:32:03.683 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/usbhid/usbmouse.ko 2024-04-17T08:32:03.683 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 261945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/wacom.ko 2024-04-17T08:32:03.683 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/ 2024-04-17T08:32:03.683 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 75065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/hv_balloon.ko 2024-04-17T08:32:03.683 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 110681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/hv_utils.ko 2024-04-17T08:32:03.684 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 382033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/hv_vmbus.ko 2024-04-17T08:32:03.684 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ 2024-04-17T08:32:03.684 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 77153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/abituguru.ko 2024-04-17T08:32:03.684 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 67009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/abituguru3.ko 2024-04-17T08:32:03.684 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 42249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-17T08:32:03.684 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ad7414.ko 2024-04-17T08:32:03.684 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ad7418.ko 2024-04-17T08:32:03.684 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 29449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adc128d818.ko 2024-04-17T08:32:03.684 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 38097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1025.ko 2024-04-17T08:32:03.684 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 115057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1026.ko 2024-04-17T08:32:03.684 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1029.ko 2024-04-17T08:32:03.684 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 55225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1031.ko 2024-04-17T08:32:03.684 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 31441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm9240.ko 2024-04-17T08:32:03.684 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ads7828.ko 2024-04-17T08:32:03.685 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7410.ko 2024-04-17T08:32:03.685 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7411.ko 2024-04-17T08:32:03.685 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 89025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7462.ko 2024-04-17T08:32:03.685 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 49153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7470.ko 2024-04-17T08:32:03.685 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 81473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7475.ko 2024-04-17T08:32:03.685 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7x10.ko 2024-04-17T08:32:03.685 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 48177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/amc6821.ko 2024-04-17T08:32:03.685 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 68865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/applesmc.ko 2024-04-17T08:32:03.685 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 60193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/asb100.ko 2024-04-17T08:32:03.685 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 69009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/asc7621.ko 2024-04-17T08:32:03.685 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 47977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-17T08:32:03.685 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/atxp1.ko 2024-04-17T08:32:03.685 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 33641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/coretemp.ko 2024-04-17T08:32:03.685 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 29401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/da9052-hwmon.ko 2024-04-17T08:32:03.686 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/da9055-hwmon.ko 2024-04-17T08:32:03.686 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 55713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-17T08:32:03.686 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 113201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/dme1737.ko 2024-04-17T08:32:03.686 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ds1621.ko 2024-04-17T08:32:03.686 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ds620.ko 2024-04-17T08:32:03.686 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 33665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/emc1403.ko 2024-04-17T08:32:03.686 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 40177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/emc2103.ko 2024-04-17T08:32:03.686 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 34649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/emc6w201.ko 2024-04-17T08:32:03.686 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 78921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/f71805f.ko 2024-04-17T08:32:03.686 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 108961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/f71882fg.ko 2024-04-17T08:32:03.686 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 50697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/f75375s.ko 2024-04-17T08:32:03.686 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/fam15h_power.ko 2024-04-17T08:32:03.686 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 65769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/fschmd.ko 2024-04-17T08:32:03.687 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/g760a.ko 2024-04-17T08:32:03.687 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 30585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/g762.ko 2024-04-17T08:32:03.687 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 59761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/gl518sm.ko 2024-04-17T08:32:03.687 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 56313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/gl520sm.ko 2024-04-17T08:32:03.687 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/hih6130.ko 2024-04-17T08:32:03.687 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-17T08:32:03.687 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/i5500_temp.ko 2024-04-17T08:32:03.687 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 27633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/i5k_amb.ko 2024-04-17T08:32:03.687 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 42585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ibmaem.ko 2024-04-17T08:32:03.687 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ibmpex.ko 2024-04-17T08:32:03.687 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ina209.ko 2024-04-17T08:32:03.687 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ina2xx.ko 2024-04-17T08:32:03.687 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 156465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/it87.ko 2024-04-17T08:32:03.687 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/jc42.ko 2024-04-17T08:32:03.688 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/k10temp.ko 2024-04-17T08:32:03.688 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/k8temp.ko 2024-04-17T08:32:03.688 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lineage-pem.ko 2024-04-17T08:32:03.688 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 57769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm63.ko 2024-04-17T08:32:03.688 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm73.ko 2024-04-17T08:32:03.688 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 44121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm75.ko 2024-04-17T08:32:03.688 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm77.ko 2024-04-17T08:32:03.688 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 41473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm78.ko 2024-04-17T08:32:03.688 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 37049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm80.ko 2024-04-17T08:32:03.688 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm83.ko 2024-04-17T08:32:03.688 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 86497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm85.ko 2024-04-17T08:32:03.688 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 55641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm87.ko 2024-04-17T08:32:03.688 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 42249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm90.ko 2024-04-17T08:32:03.688 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm92.ko 2024-04-17T08:32:03.689 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 131505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm93.ko 2024-04-17T08:32:03.689 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 40225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm95234.ko 2024-04-17T08:32:03.689 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm95241.ko 2024-04-17T08:32:03.689 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm95245.ko 2024-04-17T08:32:03.689 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc2945.ko 2024-04-17T08:32:03.689 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4151.ko 2024-04-17T08:32:03.689 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4215.ko 2024-04-17T08:32:03.689 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4222.ko 2024-04-17T08:32:03.689 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4245.ko 2024-04-17T08:32:03.689 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4260.ko 2024-04-17T08:32:03.689 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4261.ko 2024-04-17T08:32:03.689 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 36769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max16065.ko 2024-04-17T08:32:03.689 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max1619.ko 2024-04-17T08:32:03.689 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max1668.ko 2024-04-17T08:32:03.690 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max197.ko 2024-04-17T08:32:03.690 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 32505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max6639.ko 2024-04-17T08:32:03.690 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 27305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max6650.ko 2024-04-17T08:32:03.690 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 39729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max6697.ko 2024-04-17T08:32:03.690 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/mc13783-adc.ko 2024-04-17T08:32:03.690 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/mcp3021.ko 2024-04-17T08:32:03.690 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-04-17T08:32:03.690 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 56505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct6683.ko 2024-04-17T08:32:03.690 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 141353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct6775-core.ko 2024-04-17T08:32:03.690 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 72737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct6775.ko 2024-04-17T08:32:03.690 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 67841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct7802.ko 2024-04-17T08:32:03.690 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 97777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pc87360.ko 2024-04-17T08:32:03.690 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 61921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pc87427.ko 2024-04-17T08:32:03.690 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pcf8591.ko 2024-04-17T08:32:03.690 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ 2024-04-17T08:32:03.691 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-17T08:32:03.691 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-17T08:32:03.691 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 33265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-17T08:32:03.691 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-17T08:32:03.691 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-17T08:32:03.691 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-17T08:32:03.691 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-17T08:32:03.691 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 101233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-17T08:32:03.691 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-17T08:32:03.691 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 36177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-17T08:32:03.691 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-17T08:32:03.691 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-17T08:32:03.691 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/powr1220.ko 2024-04-17T08:32:03.691 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sch5627.ko 2024-04-17T08:32:03.691 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 32945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sch5636.ko 2024-04-17T08:32:03.692 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 34561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-17T08:32:03.692 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 40849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sht15.ko 2024-04-17T08:32:03.692 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sht21.ko 2024-04-17T08:32:03.692 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/shtc1.ko 2024-04-17T08:32:03.692 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 48713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sis5595.ko 2024-04-17T08:32:03.692 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/smsc47b397.ko 2024-04-17T08:32:03.692 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 46473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/smsc47m1.ko 2024-04-17T08:32:03.692 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 44313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/smsc47m192.ko 2024-04-17T08:32:03.692 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 31417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/thmc50.ko 2024-04-17T08:32:03.692 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp102.ko 2024-04-17T08:32:03.692 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp103.ko 2024-04-17T08:32:03.692 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp401.ko 2024-04-17T08:32:03.692 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp421.ko 2024-04-17T08:32:03.692 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/via-cputemp.ko 2024-04-17T08:32:03.693 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 50217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/via686a.ko 2024-04-17T08:32:03.693 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 59665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/vt1211.ko 2024-04-17T08:32:03.693 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 62737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/vt8231.ko 2024-04-17T08:32:03.693 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 71169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83627ehf.ko 2024-04-17T08:32:03.693 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 96577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83627hf.ko 2024-04-17T08:32:03.693 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 85913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83781d.ko 2024-04-17T08:32:03.693 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 75129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83791d.ko 2024-04-17T08:32:03.693 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 83425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83792d.ko 2024-04-17T08:32:03.693 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 116777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83793.ko 2024-04-17T08:32:03.693 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 134441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83795.ko 2024-04-17T08:32:03.693 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83l785ts.ko 2024-04-17T08:32:03.693 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 43385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83l786ng.ko 2024-04-17T08:32:03.693 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-04-17T08:32:03.693 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-04-17T08:32:03.693 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/ 2024-04-17T08:32:03.694 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/algos/ 2024-04-17T08:32:03.694 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 27353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-17T08:32:03.694 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-17T08:32:03.694 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/ 2024-04-17T08:32:03.694 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 33345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-04-17T08:32:03.694 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 35073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-04-17T08:32:03.694 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 32905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-04-17T08:32:03.694 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-17T08:32:03.694 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 30361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-17T08:32:03.694 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-17T08:32:03.694 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-04-17T08:32:03.694 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 7729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-17T08:32:03.694 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-04-17T08:32:03.694 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 64233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-17T08:32:03.695 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-17T08:32:03.695 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-17T08:32:03.695 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-17T08:32:03.695 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-04-17T08:32:03.695 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-04-17T08:32:03.695 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 76969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-17T08:32:03.695 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-17T08:32:03.695 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 52937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-17T08:32:03.695 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-04-17T08:32:03.695 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-17T08:32:03.695 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-17T08:32:03.695 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 33209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-04-17T08:32:03.695 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 30049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-17T08:32:03.695 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-17T08:32:03.695 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 57217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-17T08:32:03.696 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-04-17T08:32:03.696 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-17T08:32:03.696 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-17T08:32:03.696 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-04-17T08:32:03.696 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 32585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-04-17T08:32:03.696 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-17T08:32:03.696 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-04-17T08:32:03.696 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-17T08:32:03.696 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-17T08:32:03.696 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 29993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-17T08:32:03.696 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-17T08:32:03.696 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 59193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-04-17T08:32:03.696 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 27849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-mux.ko 2024-04-17T08:32:03.696 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-smbus.ko 2024-04-17T08:32:03.697 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 29577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-stub.ko 2024-04-17T08:32:03.697 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/muxes/ 2024-04-17T08:32:03.697 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-04-17T08:32:03.697 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-04-17T08:32:03.697 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 36569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-04-17T08:32:03.697 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ 2024-04-17T08:32:03.697 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ 2024-04-17T08:32:03.697 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 329697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-17T08:32:03.697 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 1119913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_core.ko 2024-04-17T08:32:03.697 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 83905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-17T08:32:03.697 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 408433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-17T08:32:03.697 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 120921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-17T08:32:03.697 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 347217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-17T08:32:03.697 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 84945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-17T08:32:03.698 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/ 2024-04-17T08:32:03.698 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/cxgb4/ 2024-04-17T08:32:03.698 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 590929 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-17T08:32:03.698 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx4/ 2024-04-17T08:32:03.698 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 514641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-17T08:32:03.698 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx5/ 2024-04-17T08:32:03.698 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 911665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-17T08:32:03.698 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mthca/ 2024-04-17T08:32:03.698 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 375545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-17T08:32:03.698 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/ocrdma/ 2024-04-17T08:32:03.698 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 197121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-04-17T08:32:03.698 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/usnic/ 2024-04-17T08:32:03.698 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 212553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-04-17T08:32:03.698 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/ 2024-04-17T08:32:03.699 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/ipoib/ 2024-04-17T08:32:03.699 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 334401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-17T08:32:03.699 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/iser/ 2024-04-17T08:32:03.699 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 120673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-17T08:32:03.699 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/isert/ 2024-04-17T08:32:03.699 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 132585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-17T08:32:03.699 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srp/ 2024-04-17T08:32:03.699 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 157937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-17T08:32:03.699 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srpt/ 2024-04-17T08:32:03.699 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 156673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-17T08:32:03.699 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/ 2024-04-17T08:32:03.699 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/evbug.ko 2024-04-17T08:32:03.699 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 27609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/ff-memless.ko 2024-04-17T08:32:03.699 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/ 2024-04-17T08:32:03.699 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-17T08:32:03.700 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-17T08:32:03.700 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 50713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/gameport.ko 2024-04-17T08:32:03.700 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 49441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/joydev.ko 2024-04-17T08:32:03.700 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/ 2024-04-17T08:32:03.700 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-04-17T08:32:03.700 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-04-17T08:32:03.700 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 35665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-04-17T08:32:03.700 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-04-17T08:32:03.700 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 45473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-17T08:32:03.700 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-04-17T08:32:03.700 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/lkkbd.ko 2024-04-17T08:32:03.700 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 31857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/lm8323.ko 2024-04-17T08:32:03.700 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/lm8333.ko 2024-04-17T08:32:03.700 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-04-17T08:32:03.700 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-04-17T08:32:03.701 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-04-17T08:32:03.701 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-04-17T08:32:03.701 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/newtonkbd.ko 2024-04-17T08:32:03.701 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-04-17T08:32:03.701 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/qt1070.ko 2024-04-17T08:32:03.701 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/qt2160.ko 2024-04-17T08:32:03.701 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-04-17T08:32:03.701 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/stowaway.ko 2024-04-17T08:32:03.701 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/sunkbd.ko 2024-04-17T08:32:03.701 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-04-17T08:32:03.701 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-04-17T08:32:03.701 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-04-17T08:32:03.701 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/xtkbd.ko 2024-04-17T08:32:03.701 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/matrix-keymap.ko 2024-04-17T08:32:03.701 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/ 2024-04-17T08:32:03.702 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 40617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/appletouch.ko 2024-04-17T08:32:03.702 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 39553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/bcm5974.ko 2024-04-17T08:32:03.702 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 160017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/cyapatp.ko 2024-04-17T08:32:03.702 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 114273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-17T08:32:03.702 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/gpio_mouse.ko 2024-04-17T08:32:03.702 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 428185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/psmouse.ko 2024-04-17T08:32:03.702 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/sermouse.ko 2024-04-17T08:32:03.702 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 27865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-17T08:32:03.702 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 27193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-17T08:32:03.702 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-17T08:32:03.702 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/rmi4/ 2024-04-17T08:32:03.702 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 140969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-17T08:32:03.702 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/ 2024-04-17T08:32:03.702 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/altera_ps2.ko 2024-04-17T08:32:03.703 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/arc_ps2.ko 2024-04-17T08:32:03.703 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/ct82c710.ko 2024-04-17T08:32:03.703 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-17T08:32:03.703 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/parkbd.ko 2024-04-17T08:32:03.703 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/pcips2.ko 2024-04-17T08:32:03.703 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/ps2mult.ko 2024-04-17T08:32:03.703 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/serio_raw.ko 2024-04-17T08:32:03.703 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/serport.ko 2024-04-17T08:32:03.703 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/sparse-keymap.ko 2024-04-17T08:32:03.703 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/ 2024-04-17T08:32:03.703 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-88pm860x.ko 2024-04-17T08:32:03.703 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-adp5520.ko 2024-04-17T08:32:03.703 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 77265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-bd2802.ko 2024-04-17T08:32:03.703 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 31097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-blinkm.ko 2024-04-17T08:32:03.704 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-da903x.ko 2024-04-17T08:32:03.704 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-da9052.ko 2024-04-17T08:32:03.704 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-gpio.ko 2024-04-17T08:32:03.704 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lm3530.ko 2024-04-17T08:32:03.704 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 36705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lm3533.ko 2024-04-17T08:32:03.704 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lm355x.ko 2024-04-17T08:32:03.704 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lm3642.ko 2024-04-17T08:32:03.704 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lp3944.ko 2024-04-17T08:32:03.704 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lp8788.ko 2024-04-17T08:32:03.704 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-max8997.ko 2024-04-17T08:32:03.704 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-mc13783.ko 2024-04-17T08:32:03.704 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-menf21bmc.ko 2024-04-17T08:32:03.704 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-pca9532.ko 2024-04-17T08:32:03.704 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-pca955x.ko 2024-04-17T08:32:03.704 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-pca963x.ko 2024-04-17T08:32:03.705 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 38113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-ss4200.ko 2024-04-17T08:32:03.705 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-tca6507.ko 2024-04-17T08:32:03.705 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-wm831x-status.ko 2024-04-17T08:32:03.705 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-wm8350.ko 2024-04-17T08:32:03.705 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ 2024-04-17T08:32:03.705 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-17T08:32:03.705 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-17T08:32:03.705 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-17T08:32:03.705 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-17T08:32:03.705 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-17T08:32:03.705 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-17T08:32:03.705 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-17T08:32:03.705 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-17T08:32:03.705 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-17T08:32:03.705 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/ 2024-04-17T08:32:03.706 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/bcache/ 2024-04-17T08:32:03.706 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 790753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/bcache/bcache.ko 2024-04-17T08:32:03.706 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 49081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-bio-prison.ko 2024-04-17T08:32:03.706 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 116825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-bufio.ko 2024-04-17T08:32:03.706 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 58281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-cache-smq.ko 2024-04-17T08:32:03.706 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 199041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-cache.ko 2024-04-17T08:32:03.706 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 134945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-crypt.ko 2024-04-17T08:32:03.706 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-delay.ko 2024-04-17T08:32:03.706 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 67497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-era.ko 2024-04-17T08:32:03.706 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 33017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-flakey.ko 2024-04-17T08:32:03.706 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 50457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-log-userspace.ko 2024-04-17T08:32:03.706 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 41145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-log.ko 2024-04-17T08:32:03.706 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 60977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-mirror.ko 2024-04-17T08:32:03.707 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 97209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-multipath.ko 2024-04-17T08:32:03.707 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-queue-length.ko 2024-04-17T08:32:03.707 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 85689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-raid.ko 2024-04-17T08:32:03.707 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 44289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-region-hash.ko 2024-04-17T08:32:03.707 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-round-robin.ko 2024-04-17T08:32:03.707 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-service-time.ko 2024-04-17T08:32:03.707 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 139817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-snapshot.ko 2024-04-17T08:32:03.707 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-switch.ko 2024-04-17T08:32:03.707 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 234457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-thin-pool.ko 2024-04-17T08:32:03.707 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 66425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-verity.ko 2024-04-17T08:32:03.707 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-zero.ko 2024-04-17T08:32:03.707 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/persistent-data/ 2024-04-17T08:32:03.707 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 264329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-17T08:32:03.707 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 43137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid0.ko 2024-04-17T08:32:03.708 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 125009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid1.ko 2024-04-17T08:32:03.708 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 157681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid10.ko 2024-04-17T08:32:03.708 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 444665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid456.ko 2024-04-17T08:32:03.708 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/ 2024-04-17T08:32:03.708 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/ 2024-04-17T08:32:03.708 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 214841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptbase.ko 2024-04-17T08:32:03.708 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 77985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptctl.ko 2024-04-17T08:32:03.708 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 54785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptfc.ko 2024-04-17T08:32:03.708 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 44633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptlan.ko 2024-04-17T08:32:03.708 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 150761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptsas.ko 2024-04-17T08:32:03.708 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 97281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptscsih.ko 2024-04-17T08:32:03.708 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 63873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptspi.ko 2024-04-17T08:32:03.708 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/ 2024-04-17T08:32:03.708 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/88pm800.ko 2024-04-17T08:32:03.708 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/88pm805.ko 2024-04-17T08:32:03.709 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/88pm80x.ko 2024-04-17T08:32:03.709 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/arizona-i2c.ko 2024-04-17T08:32:03.709 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 148633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/arizona.ko 2024-04-17T08:32:03.709 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/bcm590xx.ko 2024-04-17T08:32:03.709 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/cros_ec_dev.ko 2024-04-17T08:32:03.709 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 41009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/dln2.ko 2024-04-17T08:32:03.709 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/janz-cmodio.ko 2024-04-17T08:32:03.709 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 59089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/kempld-core.ko 2024-04-17T08:32:03.709 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 31897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lm3533-core.ko 2024-04-17T08:32:03.709 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-04-17T08:32:03.709 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lp3943.ko 2024-04-17T08:32:03.709 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 60497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lpc_ich.ko 2024-04-17T08:32:03.709 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lpc_sch.ko 2024-04-17T08:32:03.709 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/max8907.ko 2024-04-17T08:32:03.710 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 35537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/mc13xxx-core.ko 2024-04-17T08:32:03.710 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-04-17T08:32:03.710 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/menf21bmc.ko 2024-04-17T08:32:03.710 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/pcf50633-adc.ko 2024-04-17T08:32:03.710 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/pcf50633-gpio.ko 2024-04-17T08:32:03.710 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 42297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/pcf50633.ko 2024-04-17T08:32:03.710 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-04-17T08:32:03.710 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/retu-mfd.ko 2024-04-17T08:32:03.710 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 99425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/si476x-core.ko 2024-04-17T08:32:03.710 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 58057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/sm501.ko 2024-04-17T08:32:03.710 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 60681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/tps65010.ko 2024-04-17T08:32:03.710 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/tps6507x.ko 2024-04-17T08:32:03.710 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/viperboard.ko 2024-04-17T08:32:03.710 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/vx855.ko 2024-04-17T08:32:03.710 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/wl1273-core.ko 2024-04-17T08:32:03.711 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 52361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/wm8994.ko 2024-04-17T08:32:03.711 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ 2024-04-17T08:32:03.711 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-04-17T08:32:03.711 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 64265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ad525x_dpot.ko 2024-04-17T08:32:03.711 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/altera-stapl/ 2024-04-17T08:32:03.711 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 57521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-17T08:32:03.711 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/apds9802als.ko 2024-04-17T08:32:03.711 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 47689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/apds990x.ko 2024-04-17T08:32:03.711 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 58633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/bh1770glc.ko 2024-04-17T08:32:03.711 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/c2port/ 2024-04-17T08:32:03.711 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-04-17T08:32:03.711 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 47449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/c2port/core.ko 2024-04-17T08:32:03.711 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/cb710/ 2024-04-17T08:32:03.711 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 29721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/cb710/cb710.ko 2024-04-17T08:32:03.711 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ds1682.ko 2024-04-17T08:32:03.712 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/dummy-irq.ko 2024-04-17T08:32:03.712 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/echo/ 2024-04-17T08:32:03.712 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/echo/echo.ko 2024-04-17T08:32:03.712 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/ 2024-04-17T08:32:03.712 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 43041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/at24.ko 2024-04-17T08:32:03.712 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-17T08:32:03.712 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/max6875.ko 2024-04-17T08:32:03.712 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 41185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/enclosure.ko 2024-04-17T08:32:03.712 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/genwqe/ 2024-04-17T08:32:03.712 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 191649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-04-17T08:32:03.712 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/hmc6352.ko 2024-04-17T08:32:03.712 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 37761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/hpilo.ko 2024-04-17T08:32:03.712 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ibmasm/ 2024-04-17T08:32:03.712 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 92345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-04-17T08:32:03.712 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ics932s401.ko 2024-04-17T08:32:03.712 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/isl29003.ko 2024-04-17T08:32:03.713 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/isl29020.ko 2024-04-17T08:32:03.713 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/lis3lv02d/ 2024-04-17T08:32:03.713 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 54865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-17T08:32:03.713 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-17T08:32:03.713 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/ 2024-04-17T08:32:03.713 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 154169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/mei-me.ko 2024-04-17T08:32:03.713 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 69809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/mei-txe.ko 2024-04-17T08:32:03.713 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 389033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/mei.ko 2024-04-17T08:32:03.713 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 37961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/phantom.ko 2024-04-17T08:32:03.713 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ti-st/ 2024-04-17T08:32:03.713 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 91145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ti-st/st_drv.ko 2024-04-17T08:32:03.713 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/tifm_7xx1.ko 2024-04-17T08:32:03.713 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 34457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/tifm_core.ko 2024-04-17T08:32:03.713 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/tsl2550.ko 2024-04-17T08:32:03.714 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 55793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/vmw_balloon.ko 2024-04-17T08:32:03.714 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/vmw_vmci/ 2024-04-17T08:32:03.714 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 234905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-17T08:32:03.714 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ 2024-04-17T08:32:03.714 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/bonding/ 2024-04-17T08:32:03.714 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 620961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/bonding/bonding.ko 2024-04-17T08:32:03.714 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/ 2024-04-17T08:32:03.714 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/b53/ 2024-04-17T08:32:03.714 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 139817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-17T08:32:03.714 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 49545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-17T08:32:03.714 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-17T08:32:03.714 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/mv88e6xxx/ 2024-04-17T08:32:03.714 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 587065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-17T08:32:03.714 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dummy.ko 2024-04-17T08:32:03.715 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/eql.ko 2024-04-17T08:32:03.715 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ 2024-04-17T08:32:03.715 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/ 2024-04-17T08:32:03.715 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 53753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-17T08:32:03.715 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 49201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-17T08:32:03.715 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 158649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-17T08:32:03.715 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 85953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-17T08:32:03.715 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/ 2024-04-17T08:32:03.715 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 44161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-17T08:32:03.715 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 73865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-17T08:32:03.715 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 33313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-17T08:32:03.715 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 109521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-17T08:32:03.715 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/adaptec/ 2024-04-17T08:32:03.715 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 64705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-17T08:32:03.715 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/agere/ 2024-04-17T08:32:03.716 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 84329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-17T08:32:03.716 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/alteon/ 2024-04-17T08:32:03.716 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 70737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-17T08:32:03.716 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/altera/ 2024-04-17T08:32:03.716 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 52705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-17T08:32:03.716 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/ 2024-04-17T08:32:03.716 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 65857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-17T08:32:03.716 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 56057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-17T08:32:03.716 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 115881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-17T08:32:03.716 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/ 2024-04-17T08:32:03.716 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/alx/ 2024-04-17T08:32:03.716 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 124497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-17T08:32:03.716 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-04-17T08:32:03.717 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 128409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-17T08:32:03.717 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-04-17T08:32:03.717 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 110345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-17T08:32:03.717 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atlx/ 2024-04-17T08:32:03.717 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 101857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-17T08:32:03.717 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 88953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-17T08:32:03.717 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/ 2024-04-17T08:32:03.717 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 105633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-17T08:32:03.717 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 228985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-17T08:32:03.717 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-04-17T08:32:03.717 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 1733353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-17T08:32:03.750 INFO:teuthology.orchestra.run.smithi152.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g3f60ed14f7c1 2024-04-17T08:32:03.771 INFO:teuthology.orchestra.run.smithi152.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g3f60ed14f7c1 2024-04-17T08:32:03.797 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 167185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-17T08:32:03.797 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/genet/ 2024-04-17T08:32:03.798 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 161417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-17T08:32:03.798 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 440625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-17T08:32:03.798 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/brocade/ 2024-04-17T08:32:03.798 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/brocade/bna/ 2024-04-17T08:32:03.798 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 432201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-17T08:32:03.798 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/ 2024-04-17T08:32:03.798 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-04-17T08:32:03.798 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 257201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-17T08:32:03.798 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-04-17T08:32:03.798 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 446177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-17T08:32:03.798 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-04-17T08:32:03.798 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 1311433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-17T08:32:03.798 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-04-17T08:32:03.798 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 206689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-17T08:32:03.799 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-04-17T08:32:03.799 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 40161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-17T08:32:03.799 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/cisco/ 2024-04-17T08:32:03.799 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/cisco/enic/ 2024-04-17T08:32:03.799 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 269313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-17T08:32:03.799 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/ 2024-04-17T08:32:03.799 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/ 2024-04-17T08:32:03.799 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 85385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-17T08:32:03.799 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 77457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-17T08:32:03.799 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 169089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-17T08:32:03.799 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 65913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-17T08:32:03.799 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 76209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-17T08:32:03.799 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 38065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-17T08:32:03.799 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dlink/ 2024-04-17T08:32:03.800 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 75945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-17T08:32:03.800 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 78705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-17T08:32:03.800 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 52313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dnet.ko 2024-04-17T08:32:03.800 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 30409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ec_bhf.ko 2024-04-17T08:32:03.800 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/emulex/ 2024-04-17T08:32:03.800 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/emulex/benet/ 2024-04-17T08:32:03.800 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 356377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-17T08:32:03.800 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 61737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ethoc.ko 2024-04-17T08:32:03.800 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 63185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/fealnx.ko 2024-04-17T08:32:03.800 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/fujitsu/ 2024-04-17T08:32:03.800 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 51513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-04-17T08:32:03.800 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ 2024-04-17T08:32:03.800 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 115569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-17T08:32:03.800 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000/ 2024-04-17T08:32:03.801 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 366217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-17T08:32:03.801 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000e/ 2024-04-17T08:32:03.801 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 755793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-17T08:32:03.801 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/fm10k/ 2024-04-17T08:32:03.801 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 324577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-17T08:32:03.801 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/i40e/ 2024-04-17T08:32:03.801 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 1196297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-17T08:32:03.801 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/iavf/ 2024-04-17T08:32:03.801 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 362593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-17T08:32:03.801 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igb/ 2024-04-17T08:32:03.801 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 671801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-17T08:32:03.801 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igbvf/ 2024-04-17T08:32:03.801 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 121537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-17T08:32:03.801 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-04-17T08:32:03.801 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 966705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-17T08:32:03.802 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-04-17T08:32:03.802 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 193585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-17T08:32:03.802 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 108633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/jme.ko 2024-04-17T08:32:03.802 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/ 2024-04-17T08:32:03.802 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-17T08:32:03.802 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 126881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-17T08:32:03.802 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 150777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-17T08:32:03.802 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/ 2024-04-17T08:32:03.802 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-04-17T08:32:03.802 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 905033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-17T08:32:03.802 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 344145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-17T08:32:03.802 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-04-17T08:32:03.802 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-04-17T08:32:03.803 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 1412417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-17T08:32:03.803 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel/ 2024-04-17T08:32:03.803 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 65913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-04-17T08:32:03.803 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 54497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-04-17T08:32:03.803 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-04-17T08:32:03.803 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 117353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-17T08:32:03.803 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/myricom/ 2024-04-17T08:32:03.803 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-04-17T08:32:03.803 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 131425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-17T08:32:03.803 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/natsemi/ 2024-04-17T08:32:03.803 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 91465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-17T08:32:03.803 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 56689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-17T08:32:03.803 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/neterion/ 2024-04-17T08:32:03.803 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 181081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-17T08:32:03.803 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/nvidia/ 2024-04-17T08:32:03.804 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 171417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-17T08:32:03.804 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/packetengines/ 2024-04-17T08:32:03.804 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 58249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-17T08:32:03.804 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 50121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-17T08:32:03.804 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/ 2024-04-17T08:32:03.804 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-04-17T08:32:03.804 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 300817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-17T08:32:03.804 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 105689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-17T08:32:03.804 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-04-17T08:32:03.804 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 885129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-17T08:32:03.804 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rdc/ 2024-04-17T08:32:03.804 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 52305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-17T08:32:03.804 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/ 2024-04-17T08:32:03.804 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 81641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-17T08:32:03.804 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 100689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-17T08:32:03.805 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 34073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-17T08:32:03.805 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 264161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-17T08:32:03.805 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/samsung/ 2024-04-17T08:32:03.805 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-04-17T08:32:03.805 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 142449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-04-17T08:32:03.805 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sfc/ 2024-04-17T08:32:03.805 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 1350385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-17T08:32:03.805 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/silan/ 2024-04-17T08:32:03.805 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 57953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-17T08:32:03.805 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sis/ 2024-04-17T08:32:03.805 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 66505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-17T08:32:03.805 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 80065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-17T08:32:03.805 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/ 2024-04-17T08:32:03.805 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 74289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-17T08:32:03.805 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 79457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-17T08:32:03.806 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 100785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-17T08:32:03.806 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 83441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-17T08:32:03.806 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/ 2024-04-17T08:32:03.806 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-04-17T08:32:03.806 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-04-17T08:32:03.806 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 46985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-17T08:32:03.806 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-04-17T08:32:03.806 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 644537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-17T08:32:03.806 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/ 2024-04-17T08:32:03.806 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 128497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-17T08:32:03.806 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 207993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-17T08:32:03.806 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 82633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-17T08:32:03.806 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 91353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-17T08:32:03.806 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/tehuti/ 2024-04-17T08:32:03.806 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 59865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-17T08:32:03.807 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ti/ 2024-04-17T08:32:03.807 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 110729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-17T08:32:03.807 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/via/ 2024-04-17T08:32:03.807 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 98689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-17T08:32:03.807 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 102513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-17T08:32:03.807 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/wiznet/ 2024-04-17T08:32:03.807 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 61497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-17T08:32:03.807 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 40609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-17T08:32:03.807 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/xircom/ 2024-04-17T08:32:03.807 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 69913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-17T08:32:03.807 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/fddi/ 2024-04-17T08:32:03.807 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 49449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/fddi/defxx.ko 2024-04-17T08:32:03.807 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/fddi/skfp/ 2024-04-17T08:32:03.807 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 275801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/fddi/skfp/skfp.ko 2024-04-17T08:32:03.808 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 91105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/geneve.ko 2024-04-17T08:32:03.808 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/hyperv/ 2024-04-17T08:32:03.808 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 290441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-17T08:32:03.808 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ieee802154/ 2024-04-17T08:32:03.808 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-17T08:32:03.808 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 30001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ifb.ko 2024-04-17T08:32:03.808 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ipvlan/ 2024-04-17T08:32:03.808 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 108329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-17T08:32:03.808 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 78065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/macvlan.ko 2024-04-17T08:32:03.808 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/macvtap.ko 2024-04-17T08:32:03.808 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/ 2024-04-17T08:32:03.808 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-17T08:32:03.808 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-17T08:32:03.808 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-gpio.ko 2024-04-17T08:32:03.808 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-17T08:32:03.808 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio.ko 2024-04-17T08:32:03.809 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mii.ko 2024-04-17T08:32:03.809 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 62681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/netconsole.ko 2024-04-17T08:32:03.809 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/nlmon.ko 2024-04-17T08:32:03.809 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/pcs/ 2024-04-17T08:32:03.809 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-17T08:32:03.809 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 48313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-17T08:32:03.809 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/ 2024-04-17T08:32:03.809 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/amd.ko 2024-04-17T08:32:03.809 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 61985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-17T08:32:03.809 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 52865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-17T08:32:03.809 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm87xx.ko 2024-04-17T08:32:03.809 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 53409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/broadcom.ko 2024-04-17T08:32:03.809 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/cicada.ko 2024-04-17T08:32:03.809 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/davicom.ko 2024-04-17T08:32:03.809 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/et1011c.ko 2024-04-17T08:32:03.810 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 31313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/icplus.ko 2024-04-17T08:32:03.810 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/lxt.ko 2024-04-17T08:32:03.810 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 103377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/marvell.ko 2024-04-17T08:32:03.810 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 96025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/micrel.ko 2024-04-17T08:32:03.810 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/national.ko 2024-04-17T08:32:03.810 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 121105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/phylink.ko 2024-04-17T08:32:03.810 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/qsemi.ko 2024-04-17T08:32:03.810 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 62113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/realtek.ko 2024-04-17T08:32:03.810 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 35513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/smsc.ko 2024-04-17T08:32:03.810 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/ste10Xp.ko 2024-04-17T08:32:03.810 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 29217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/vitesse.ko 2024-04-17T08:32:03.810 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/plip/ 2024-04-17T08:32:03.810 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 55353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/plip/plip.ko 2024-04-17T08:32:03.810 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ 2024-04-17T08:32:03.810 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-17T08:32:03.811 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 36273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_async.ko 2024-04-17T08:32:03.811 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-17T08:32:03.811 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-17T08:32:03.811 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 35369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-17T08:32:03.811 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 53233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/pppoe.ko 2024-04-17T08:32:03.811 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/pppox.ko 2024-04-17T08:32:03.811 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 40081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/pptp.ko 2024-04-17T08:32:03.811 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 35937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/sb1000.ko 2024-04-17T08:32:03.811 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/slip/ 2024-04-17T08:32:03.811 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 52073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/slip/slip.ko 2024-04-17T08:32:03.811 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 42409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/sungem_phy.ko 2024-04-17T08:32:03.811 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 80161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/tap.ko 2024-04-17T08:32:03.811 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/ 2024-04-17T08:32:03.811 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 137321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team.ko 2024-04-17T08:32:03.811 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-17T08:32:03.812 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-17T08:32:03.812 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 36209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-17T08:32:03.812 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_random.ko 2024-04-17T08:32:03.812 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-17T08:32:03.812 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 108089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/veth.ko 2024-04-17T08:32:03.812 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vmxnet3/ 2024-04-17T08:32:03.812 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 176497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-17T08:32:03.812 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vxlan/ 2024-04-17T08:32:03.812 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 383593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vxlan/vxlan.ko 2024-04-17T08:32:03.812 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/xen-netback/ 2024-04-17T08:32:03.812 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 175537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-17T08:32:03.812 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ntb/ 2024-04-17T08:32:03.812 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ntb/ntb.ko 2024-04-17T08:32:03.812 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/ 2024-04-17T08:32:03.812 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/host/ 2024-04-17T08:32:03.813 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 335857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/host/nvme-core.ko 2024-04-17T08:32:03.813 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 126553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/host/nvme.ko 2024-04-17T08:32:03.813 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/ 2024-04-17T08:32:03.813 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 168145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport.ko 2024-04-17T08:32:03.813 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport_cs.ko 2024-04-17T08:32:03.813 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 103889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport_pc.ko 2024-04-17T08:32:03.813 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 30313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport_serial.ko 2024-04-17T08:32:03.813 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/ 2024-04-17T08:32:03.813 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/hotplug/ 2024-04-17T08:32:03.813 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-17T08:32:03.813 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-04-17T08:32:03.813 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-04-17T08:32:03.813 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/pci-stub.ko 2024-04-17T08:32:03.813 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 55329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/xen-pcifront.ko 2024-04-17T08:32:03.813 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/ 2024-04-17T08:32:03.814 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 31529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/i82092.ko 2024-04-17T08:32:03.814 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 179961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/pcmcia.ko 2024-04-17T08:32:03.814 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 78161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/pcmcia_core.ko 2024-04-17T08:32:03.814 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 41945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-04-17T08:32:03.814 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 40457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/pd6729.ko 2024-04-17T08:32:03.814 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 133753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-17T08:32:03.814 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/phy/ 2024-04-17T08:32:03.814 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/phy/broadcom/ 2024-04-17T08:32:03.814 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-04-17T08:32:03.814 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/phy/samsung/ 2024-04-17T08:32:03.814 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-04-17T08:32:03.814 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pinctrl/ 2024-04-17T08:32:03.814 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pinctrl/intel/ 2024-04-17T08:32:03.814 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 78193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-17T08:32:03.814 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/ 2024-04-17T08:32:03.814 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/ 2024-04-17T08:32:03.815 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 61041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-04-17T08:32:03.815 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 29657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/cros_ec.ko 2024-04-17T08:32:03.815 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-04-17T08:32:03.815 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 30217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-04-17T08:32:03.815 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 31801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-04-17T08:32:03.815 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-04-17T08:32:03.815 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-04-17T08:32:03.815 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/ 2024-04-17T08:32:03.815 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 87481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-17T08:32:03.815 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 44105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/acerhdf.ko 2024-04-17T08:32:03.815 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 48257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-17T08:32:03.815 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 73865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-17T08:32:03.815 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 33321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-17T08:32:03.815 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 164769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-17T08:32:03.815 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 46185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-17T08:32:03.816 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 62073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-17T08:32:03.816 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-17T08:32:03.816 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 51881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-17T08:32:03.816 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-17T08:32:03.816 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 42761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/hdaps.ko 2024-04-17T08:32:03.816 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/ibm_rtl.ko 2024-04-17T08:32:03.816 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel/ 2024-04-17T08:32:03.816 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-17T08:32:03.816 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-04-17T08:32:03.816 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 54001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel_ips.ko 2024-04-17T08:32:03.816 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-17T08:32:03.816 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-17T08:32:03.816 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 43753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-17T08:32:03.816 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 51897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-17T08:32:03.817 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-17T08:32:03.817 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-17T08:32:03.817 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-17T08:32:03.817 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-17T08:32:03.817 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-17T08:32:03.817 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 61417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/wmi.ko 2024-04-17T08:32:03.817 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/ 2024-04-17T08:32:03.817 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/ 2024-04-17T08:32:03.817 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 36513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/88pm860x_battery.ko 2024-04-17T08:32:03.817 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 40425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/88pm860x_charger.ko 2024-04-17T08:32:03.817 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 68833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/bq2415x_charger.ko 2024-04-17T08:32:03.817 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 73073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/bq24190_charger.ko 2024-04-17T08:32:03.817 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/bq24735-charger.ko 2024-04-17T08:32:03.817 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-04-17T08:32:03.817 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/da9030_battery.ko 2024-04-17T08:32:03.818 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/da9052-battery.ko 2024-04-17T08:32:03.818 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 34489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/ds2760_battery.ko 2024-04-17T08:32:03.818 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/ds2780_battery.ko 2024-04-17T08:32:03.818 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/ds2781_battery.ko 2024-04-17T08:32:03.818 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/ds2782_battery.ko 2024-04-17T08:32:03.818 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/gpio-charger.ko 2024-04-17T08:32:03.818 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/isp1704_charger.ko 2024-04-17T08:32:03.818 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/lp8727_charger.ko 2024-04-17T08:32:03.818 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/max14577_charger.ko 2024-04-17T08:32:03.818 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 37833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/max17042_battery.ko 2024-04-17T08:32:03.818 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/max8903_charger.ko 2024-04-17T08:32:03.818 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 27689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/max8925_power.ko 2024-04-17T08:32:03.818 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/pcf50633-charger.ko 2024-04-17T08:32:03.818 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 44841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/sbs-battery.ko 2024-04-17T08:32:03.818 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 34905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/test_power.ko 2024-04-17T08:32:03.819 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/tps65090-charger.ko 2024-04-17T08:32:03.819 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/wm831x_backup.ko 2024-04-17T08:32:03.819 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 29081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/wm831x_power.ko 2024-04-17T08:32:03.819 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 27441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/wm8350_power.ko 2024-04-17T08:32:03.819 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/powercap/ 2024-04-17T08:32:03.819 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 73297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-17T08:32:03.819 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-17T08:32:03.819 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/ 2024-04-17T08:32:03.819 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/ 2024-04-17T08:32:03.819 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-17T08:32:03.819 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-17T08:32:03.819 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/pps_parport.ko 2024-04-17T08:32:03.819 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 49817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/pps_core.ko 2024-04-17T08:32:03.819 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ptp/ 2024-04-17T08:32:03.819 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 91393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ptp/ptp.ko 2024-04-17T08:32:03.820 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ptp/ptp_kvm.ko 2024-04-17T08:32:03.820 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/ 2024-04-17T08:32:03.820 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/ 2024-04-17T08:32:03.820 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/atl/ 2024-04-17T08:32:03.820 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 67513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-17T08:32:03.820 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 47137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/fmpm.ko 2024-04-17T08:32:03.820 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/ 2024-04-17T08:32:03.820 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 27593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-88pm80x.ko 2024-04-17T08:32:03.820 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-88pm860x.ko 2024-04-17T08:32:03.820 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-17T08:32:03.820 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-da9052.ko 2024-04-17T08:32:03.820 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-da9055.ko 2024-04-17T08:32:03.820 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-da9063.ko 2024-04-17T08:32:03.820 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-17T08:32:03.820 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 82225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-17T08:32:03.821 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-17T08:32:03.821 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-17T08:32:03.821 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-17T08:32:03.821 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-17T08:32:03.821 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-17T08:32:03.821 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-17T08:32:03.821 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 29017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-17T08:32:03.821 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-em3027.ko 2024-04-17T08:32:03.821 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-17T08:32:03.821 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-17T08:32:03.821 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 44129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-17T08:32:03.821 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-lp8788.ko 2024-04-17T08:32:03.821 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 46913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-17T08:32:03.821 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-17T08:32:03.821 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 33969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-17T08:32:03.822 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m48t86.ko 2024-04-17T08:32:03.822 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-max6900.ko 2024-04-17T08:32:03.822 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-max8907.ko 2024-04-17T08:32:03.822 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-max8925.ko 2024-04-17T08:32:03.822 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 31337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-max8997.ko 2024-04-17T08:32:03.822 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-max8998.ko 2024-04-17T08:32:03.822 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-04-17T08:32:03.822 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-17T08:32:03.822 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-palmas.ko 2024-04-17T08:32:03.822 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 56777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-17T08:32:03.822 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf50633.ko 2024-04-17T08:32:03.822 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 32657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-17T08:32:03.822 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-17T08:32:03.822 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 36065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-17T08:32:03.823 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-17T08:32:03.823 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rc5t583.ko 2024-04-17T08:32:03.823 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-17T08:32:03.823 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 40081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-17T08:32:03.823 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 34529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-17T08:32:03.823 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 29977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-17T08:32:03.823 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-17T08:32:03.823 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-s35390a.ko 2024-04-17T08:32:03.823 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-17T08:32:03.823 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-tps6586x.ko 2024-04-17T08:32:03.823 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-tps65910.ko 2024-04-17T08:32:03.823 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-wm831x.ko 2024-04-17T08:32:03.823 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-wm8350.ko 2024-04-17T08:32:03.823 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 33409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-x1205.ko 2024-04-17T08:32:03.824 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ 2024-04-17T08:32:03.824 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 90377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/3w-9xxx.ko 2024-04-17T08:32:03.824 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 69593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/3w-sas.ko 2024-04-17T08:32:03.824 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 65945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/3w-xxxx.ko 2024-04-17T08:32:03.824 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 164569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/BusLogic.ko 2024-04-17T08:32:03.824 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 31617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/a100u2w.ko 2024-04-17T08:32:03.824 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aacraid/ 2024-04-17T08:32:03.824 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 340721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-17T08:32:03.824 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 120337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/advansys.ko 2024-04-17T08:32:03.824 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic7xxx/ 2024-04-17T08:32:03.824 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 468081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-17T08:32:03.824 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 380673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-17T08:32:03.824 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic94xx/ 2024-04-17T08:32:03.824 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 243705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-04-17T08:32:03.824 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/am53c974.ko 2024-04-17T08:32:03.825 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/arcmsr/ 2024-04-17T08:32:03.825 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 135617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-17T08:32:03.825 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 44289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/atp870u.ko 2024-04-17T08:32:03.825 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/be2iscsi/ 2024-04-17T08:32:03.825 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 304993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-17T08:32:03.825 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bfa/ 2024-04-17T08:32:03.825 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 1527113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bfa/bfa.ko 2024-04-17T08:32:03.825 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2fc/ 2024-04-17T08:32:03.825 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 297801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-17T08:32:03.825 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2i/ 2024-04-17T08:32:03.825 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 144401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-17T08:32:03.825 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 47457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ch.ko 2024-04-17T08:32:03.825 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/csiostor/ 2024-04-17T08:32:03.825 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 390713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-17T08:32:03.825 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/ 2024-04-17T08:32:03.826 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-04-17T08:32:03.826 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 88881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-17T08:32:03.826 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-04-17T08:32:03.826 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 117481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-17T08:32:03.826 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 173017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-17T08:32:03.826 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 91569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/dc395x.ko 2024-04-17T08:32:03.826 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 45401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/dmx3191d.ko 2024-04-17T08:32:03.826 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/esas2r/ 2024-04-17T08:32:03.826 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 267577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-17T08:32:03.826 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 78969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/esp_scsi.ko 2024-04-17T08:32:03.826 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fcoe/ 2024-04-17T08:32:03.826 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 95329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-17T08:32:03.826 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 194017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-17T08:32:03.826 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fdomain.ko 2024-04-17T08:32:03.826 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fnic/ 2024-04-17T08:32:03.827 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 366529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fnic/fnic.ko 2024-04-17T08:32:03.827 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 251505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/hpsa.ko 2024-04-17T08:32:03.827 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 65761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/hptiop.ko 2024-04-17T08:32:03.827 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 57097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/hv_storvsc.ko 2024-04-17T08:32:03.827 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 44689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/imm.ko 2024-04-17T08:32:03.827 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 55153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/initio.ko 2024-04-17T08:32:03.827 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 327841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ipr.ko 2024-04-17T08:32:03.827 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 129785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ips.ko 2024-04-17T08:32:03.827 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/isci/ 2024-04-17T08:32:03.827 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 397785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/isci/isci.ko 2024-04-17T08:32:03.827 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 32017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-17T08:32:03.827 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 63121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-17T08:32:03.827 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libfc/ 2024-04-17T08:32:03.827 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 386849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libfc/libfc.ko 2024-04-17T08:32:03.827 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 178177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libiscsi.ko 2024-04-17T08:32:03.828 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 64809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-17T08:32:03.828 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libsas/ 2024-04-17T08:32:03.828 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 274009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libsas/libsas.ko 2024-04-17T08:32:03.828 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/lpfc/ 2024-04-17T08:32:03.828 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 2736001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-17T08:32:03.828 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/ 2024-04-17T08:32:03.828 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 88529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-17T08:32:03.828 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 40145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-17T08:32:03.828 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 389177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-17T08:32:03.828 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 104769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid.ko 2024-04-17T08:32:03.828 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mpt3sas/ 2024-04-17T08:32:03.828 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 836945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-17T08:32:03.828 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mvsas/ 2024-04-17T08:32:03.828 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 158729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-17T08:32:03.828 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 96537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mvumi.ko 2024-04-17T08:32:03.829 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pcmcia/ 2024-04-17T08:32:03.829 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 101625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-04-17T08:32:03.829 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-04-17T08:32:03.829 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-04-17T08:32:03.829 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-04-17T08:32:03.829 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pm8001/ 2024-04-17T08:32:03.829 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 443745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-17T08:32:03.829 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 152033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pmcraid.ko 2024-04-17T08:32:03.829 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 41625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ppa.ko 2024-04-17T08:32:03.829 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 66977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla1280.ko 2024-04-17T08:32:03.829 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla2xxx/ 2024-04-17T08:32:03.829 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 2324809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-17T08:32:03.829 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 103601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-17T08:32:03.829 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla4xxx/ 2024-04-17T08:32:03.829 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 697337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-17T08:32:03.830 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qlogicfas408.ko 2024-04-17T08:32:03.830 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/raid_class.ko 2024-04-17T08:32:03.830 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 322865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_debug.ko 2024-04-17T08:32:03.830 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 219857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-17T08:32:03.830 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 357153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-17T08:32:03.830 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 121185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-17T08:32:03.830 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 93481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-17T08:32:03.830 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 55401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-17T08:32:03.830 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 33009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ses.ko 2024-04-17T08:32:03.830 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 138121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/st.ko 2024-04-17T08:32:03.830 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 57401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/stex.ko 2024-04-17T08:32:03.830 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/sym53c8xx_2/ 2024-04-17T08:32:03.830 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 205025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-17T08:32:03.830 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 55425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/virtio_scsi.ko 2024-04-17T08:32:03.831 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 59185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-17T08:32:03.831 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 48777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/wd719x.ko 2024-04-17T08:32:03.831 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 59417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/xen-scsifront.ko 2024-04-17T08:32:03.831 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ssb/ 2024-04-17T08:32:03.831 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 174913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ssb/ssb.ko 2024-04-17T08:32:03.831 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/ 2024-04-17T08:32:03.831 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/iscsi/ 2024-04-17T08:32:03.831 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 920169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-17T08:32:03.831 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/loopback/ 2024-04-17T08:32:03.831 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 60321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-17T08:32:03.831 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 48129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_file.ko 2024-04-17T08:32:03.831 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 54233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_iblock.ko 2024-04-17T08:32:03.831 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 1170033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_mod.ko 2024-04-17T08:32:03.831 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 51897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_pscsi.ko 2024-04-17T08:32:03.831 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 149721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_user.ko 2024-04-17T08:32:03.832 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/tcm_fc/ 2024-04-17T08:32:03.832 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 90057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-17T08:32:03.832 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/ 2024-04-17T08:32:03.832 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/ 2024-04-17T08:32:03.832 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/ 2024-04-17T08:32:03.832 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-17T08:32:03.832 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 35209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-17T08:32:03.832 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-17T08:32:03.832 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-17T08:32:03.832 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-17T08:32:03.832 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-17T08:32:03.832 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 36729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-17T08:32:03.832 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-17T08:32:03.832 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-17T08:32:03.833 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12929 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-17T08:32:03.833 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-17T08:32:03.833 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-17T08:32:03.833 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 46065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-17T08:32:03.833 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-17T08:32:03.833 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-17T08:32:03.833 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 35913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-04-17T08:32:03.833 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-17T08:32:03.833 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-17T08:32:03.833 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 30577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-17T08:32:03.833 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/ 2024-04-17T08:32:03.833 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/ipwireless/ 2024-04-17T08:32:03.833 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 99313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-17T08:32:03.833 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 69729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/moxa.ko 2024-04-17T08:32:03.833 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 61649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/mxser.ko 2024-04-17T08:32:03.833 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 134401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/n_gsm.ko 2024-04-17T08:32:03.834 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 37905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/n_hdlc.ko 2024-04-17T08:32:03.834 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 78969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/nozomi.ko 2024-04-17T08:32:03.834 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/ 2024-04-17T08:32:03.834 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/8250/ 2024-04-17T08:32:03.834 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 44057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-04-17T08:32:03.834 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 65121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-17T08:32:03.834 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-04-17T08:32:03.834 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/altera_uart.ko 2024-04-17T08:32:03.834 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/arc_uart.ko 2024-04-17T08:32:03.834 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 91665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-04-17T08:32:03.834 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/jsm/ 2024-04-17T08:32:03.834 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 120577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-17T08:32:03.834 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 35161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/rp2.ko 2024-04-17T08:32:03.835 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 65641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/sc16is7xx.ko 2024-04-17T08:32:03.835 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/ 2024-04-17T08:32:03.835 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/core/ 2024-04-17T08:32:03.835 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 693081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-17T08:32:03.835 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/host/ 2024-04-17T08:32:03.835 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 34449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-17T08:32:03.835 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-04-17T08:32:03.835 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/ 2024-04-17T08:32:03.835 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 55617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio.ko 2024-04-17T08:32:03.835 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_aec.ko 2024-04-17T08:32:03.835 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_cif.ko 2024-04-17T08:32:03.835 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_dmem_genirq.ko 2024-04-17T08:32:03.835 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_mf624.ko 2024-04-17T08:32:03.835 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_netx.ko 2024-04-17T08:32:03.835 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_pci_generic.ko 2024-04-17T08:32:03.836 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-04-17T08:32:03.836 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_sercos3.ko 2024-04-17T08:32:03.836 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/ 2024-04-17T08:32:03.836 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/c67x00/ 2024-04-17T08:32:03.836 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 90321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/c67x00/c67x00.ko 2024-04-17T08:32:03.836 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/chipidea/ 2024-04-17T08:32:03.836 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 189209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-04-17T08:32:03.836 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-04-17T08:32:03.836 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-04-17T08:32:03.836 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-04-17T08:32:03.836 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-04-17T08:32:03.836 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/ 2024-04-17T08:32:03.836 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 101545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/cdc-acm.ko 2024-04-17T08:32:03.836 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 63073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-17T08:32:03.836 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 56721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/usblp.ko 2024-04-17T08:32:03.837 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 107417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/usbtmc.ko 2024-04-17T08:32:03.837 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/common/ 2024-04-17T08:32:03.837 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 29353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/common/ulpi.ko 2024-04-17T08:32:03.837 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/dwc2/ 2024-04-17T08:32:03.837 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-04-17T08:32:03.837 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/dwc3/ 2024-04-17T08:32:03.837 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-04-17T08:32:03.837 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 33465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-04-17T08:32:03.837 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 574593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/dwc3/dwc3.ko 2024-04-17T08:32:03.837 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/ 2024-04-17T08:32:03.837 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/ 2024-04-17T08:32:03.837 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 72249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/u_ether.ko 2024-04-17T08:32:03.837 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 61953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/u_serial.ko 2024-04-17T08:32:03.837 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 33721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-04-17T08:32:03.837 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 49737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-04-17T08:32:03.838 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 33041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-04-17T08:32:03.838 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 43553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-04-17T08:32:03.838 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 131345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-04-17T08:32:03.838 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 62321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-04-17T08:32:03.838 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 146617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-04-17T08:32:03.838 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 70689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-04-17T08:32:03.838 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-04-17T08:32:03.838 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 37649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-04-17T08:32:03.838 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 70017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-04-17T08:32:03.838 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 101249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-04-17T08:32:03.838 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-04-17T08:32:03.838 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 71257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-04-17T08:32:03.838 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 84937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-04-17T08:32:03.838 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/ 2024-04-17T08:32:03.839 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-04-17T08:32:03.839 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-04-17T08:32:03.839 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-04-17T08:32:03.839 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-04-17T08:32:03.839 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 33041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-04-17T08:32:03.839 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-04-17T08:32:03.839 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-04-17T08:32:03.839 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-04-17T08:32:03.839 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 35689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-04-17T08:32:03.839 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-04-17T08:32:03.839 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-04-17T08:32:03.839 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 30345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-04-17T08:32:03.839 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 78073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-04-17T08:32:03.839 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-04-17T08:32:03.839 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 204049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/libcomposite.ko 2024-04-17T08:32:03.840 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/ 2024-04-17T08:32:03.840 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-04-17T08:32:03.840 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/bdc/ 2024-04-17T08:32:03.840 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 182561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-04-17T08:32:03.840 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 45545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-04-17T08:32:03.840 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 66513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-04-17T08:32:03.840 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 85217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-04-17T08:32:03.840 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 69313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-04-17T08:32:03.840 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 90313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/net2272.ko 2024-04-17T08:32:03.840 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 90361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/net2280.ko 2024-04-17T08:32:03.840 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 94841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-04-17T08:32:03.840 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 80521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-04-17T08:32:03.840 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 87465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-04-17T08:32:03.840 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 95441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-04-17T08:32:03.840 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 195969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-04-17T08:32:03.841 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/ 2024-04-17T08:32:03.841 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/bcma-hcd.ko 2024-04-17T08:32:03.841 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 108321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/isp116x-hcd.ko 2024-04-17T08:32:03.841 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 104377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-04-17T08:32:03.841 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 102273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-04-17T08:32:03.841 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 60105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-17T08:32:03.841 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/sl811_cs.ko 2024-04-17T08:32:03.841 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/ssb-hcd.ko 2024-04-17T08:32:03.841 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 32553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-04-17T08:32:03.841 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/image/ 2024-04-17T08:32:03.841 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 40409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/image/mdc800.ko 2024-04-17T08:32:03.841 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/image/microtek.ko 2024-04-17T08:32:03.841 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/ 2024-04-17T08:32:03.841 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 47353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/adutux.ko 2024-04-17T08:32:03.841 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/appledisplay.ko 2024-04-17T08:32:03.841 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-04-17T08:32:03.842 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/cytherm.ko 2024-04-17T08:32:03.842 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/ehset.ko 2024-04-17T08:32:03.842 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/emi26.ko 2024-04-17T08:32:03.842 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/emi62.ko 2024-04-17T08:32:03.842 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/ezusb.ko 2024-04-17T08:32:03.842 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/idmouse.ko 2024-04-17T08:32:03.842 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 42729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/iowarrior.ko 2024-04-17T08:32:03.842 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-17T08:32:03.842 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 42241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/ldusb.ko 2024-04-17T08:32:03.842 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 42233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/legousbtower.ko 2024-04-17T08:32:03.842 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 33641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/lvstest.ko 2024-04-17T08:32:03.842 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/sisusbvga/ 2024-04-17T08:32:03.842 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 85313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-17T08:32:03.842 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-17T08:32:03.843 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usb3503.ko 2024-04-17T08:32:03.843 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 29625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usblcd.ko 2024-04-17T08:32:03.843 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 27809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-17T08:32:03.843 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 84265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usbtest.ko 2024-04-17T08:32:03.843 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 52065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/uss720.ko 2024-04-17T08:32:03.843 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 32345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/yurex.ko 2024-04-17T08:32:03.843 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/mon/ 2024-04-17T08:32:03.843 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 91529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/mon/usbmon.ko 2024-04-17T08:32:03.843 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/musb/ 2024-04-17T08:32:03.843 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 396209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/musb/musb_hdrc.ko 2024-04-17T08:32:03.843 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy/ 2024-04-17T08:32:03.843 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy/phy-generic.ko 2024-04-17T08:32:03.843 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-04-17T08:32:03.843 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy/phy-isp1301.ko 2024-04-17T08:32:03.843 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy/phy-tahvo.ko 2024-04-17T08:32:03.844 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ 2024-04-17T08:32:03.844 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/aircable.ko 2024-04-17T08:32:03.844 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 38209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ark3116.ko 2024-04-17T08:32:03.844 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 30681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-17T08:32:03.844 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 44329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ch341.ko 2024-04-17T08:32:03.844 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 79681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/cp210x.ko 2024-04-17T08:32:03.844 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 35137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/cyberjack.ko 2024-04-17T08:32:03.844 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 66873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-17T08:32:03.844 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 58329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-17T08:32:03.844 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/empeg.ko 2024-04-17T08:32:03.844 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 53009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/f81232.ko 2024-04-17T08:32:03.844 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 188609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-17T08:32:03.844 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 61489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-17T08:32:03.844 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 152305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-17T08:32:03.844 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 142833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/io_ti.ko 2024-04-17T08:32:03.845 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 69217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ipaq.ko 2024-04-17T08:32:03.845 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ipw.ko 2024-04-17T08:32:03.845 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 29769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ir-usb.ko 2024-04-17T08:32:03.845 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 66361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-17T08:32:03.845 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 122329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/keyspan.ko 2024-04-17T08:32:03.845 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 41297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-17T08:32:03.845 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 29465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-17T08:32:03.845 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 38049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-17T08:32:03.845 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 38041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mct_u232.ko 2024-04-17T08:32:03.845 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/metro-usb.ko 2024-04-17T08:32:03.845 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 79681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mos7720.ko 2024-04-17T08:32:03.845 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 89969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mos7840.ko 2024-04-17T08:32:03.845 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 65073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mxuport.ko 2024-04-17T08:32:03.845 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/navman.ko 2024-04-17T08:32:03.845 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/omninet.ko 2024-04-17T08:32:03.845 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/opticon.ko 2024-04-17T08:32:03.846 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 193857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/option.ko 2024-04-17T08:32:03.846 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 45337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/oti6858.ko 2024-04-17T08:32:03.846 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 61761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/pl2303.ko 2024-04-17T08:32:03.846 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/qcaux.ko 2024-04-17T08:32:03.846 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 39985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/qcserial.ko 2024-04-17T08:32:03.846 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 40529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/quatech2.ko 2024-04-17T08:32:03.846 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/safe_serial.ko 2024-04-17T08:32:03.846 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 59345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/sierra.ko 2024-04-17T08:32:03.846 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-17T08:32:03.846 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 34065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ssu100.ko 2024-04-17T08:32:03.846 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/symbolserial.ko 2024-04-17T08:32:03.846 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 70497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-17T08:32:03.846 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-17T08:32:03.846 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usb_debug.ko 2024-04-17T08:32:03.846 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 39321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-17T08:32:03.847 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 151137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usbserial.ko 2024-04-17T08:32:03.847 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 32505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/visor.ko 2024-04-17T08:32:03.847 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 43577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/whiteheat.ko 2024-04-17T08:32:03.847 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/wishbone-serial.ko 2024-04-17T08:32:03.847 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-17T08:32:03.847 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ 2024-04-17T08:32:03.847 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 64049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/uas.ko 2024-04-17T08:32:03.847 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 30209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-17T08:32:03.847 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-17T08:32:03.847 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-17T08:32:03.847 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 41073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-17T08:32:03.847 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-17T08:32:03.847 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-17T08:32:03.847 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-17T08:32:03.847 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-karma.ko 2024-04-17T08:32:03.848 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-17T08:32:03.848 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 33873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-17T08:32:03.848 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 33849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-17T08:32:03.848 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-17T08:32:03.848 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 41785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-17T08:32:03.848 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 201193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/usb-storage.ko 2024-04-17T08:32:03.848 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/ 2024-04-17T08:32:03.848 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 76041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-17T08:32:03.848 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 85257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-17T08:32:03.848 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 122321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-17T08:32:03.848 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/ 2024-04-17T08:32:03.848 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/pci/ 2024-04-17T08:32:03.848 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 206921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-17T08:32:03.848 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 33577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-17T08:32:03.848 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 134265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/vfio.ko 2024-04-17T08:32:03.849 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 93673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-17T08:32:03.849 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/ 2024-04-17T08:32:03.849 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 138721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost.ko 2024-04-17T08:32:03.849 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-17T08:32:03.849 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 71281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost_net.ko 2024-04-17T08:32:03.849 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 107905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost_scsi.ko 2024-04-17T08:32:03.849 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/ 2024-04-17T08:32:03.849 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/ 2024-04-17T08:32:03.849 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-04-17T08:32:03.849 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/aat2870_bl.ko 2024-04-17T08:32:03.849 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 29153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/adp5520_bl.ko 2024-04-17T08:32:03.849 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 41169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/adp8860_bl.ko 2024-04-17T08:32:03.849 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 51745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/adp8870_bl.ko 2024-04-17T08:32:03.849 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/apple_bl.ko 2024-04-17T08:32:03.849 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/as3711_bl.ko 2024-04-17T08:32:03.850 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/bd6107.ko 2024-04-17T08:32:03.850 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/da903x_bl.ko 2024-04-17T08:32:03.850 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/da9052_bl.ko 2024-04-17T08:32:03.850 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/gpio_backlight.ko 2024-04-17T08:32:03.850 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/kb3886_bl.ko 2024-04-17T08:32:03.850 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/lcd.ko 2024-04-17T08:32:03.850 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/lm3533_bl.ko 2024-04-17T08:32:03.850 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/lm3639_bl.ko 2024-04-17T08:32:03.850 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/lv5207lp.ko 2024-04-17T08:32:03.850 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/max8925_bl.ko 2024-04-17T08:32:03.850 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/pandora_bl.ko 2024-04-17T08:32:03.850 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-04-17T08:32:03.850 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-17T08:32:03.850 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/wm831x_bl.ko 2024-04-17T08:32:03.850 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/ 2024-04-17T08:32:03.851 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/ 2024-04-17T08:32:03.851 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/ds2482.ko 2024-04-17T08:32:03.851 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 46801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/ds2490.ko 2024-04-17T08:32:03.851 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/matrox_w1.ko 2024-04-17T08:32:03.851 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/w1-gpio.ko 2024-04-17T08:32:03.851 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/ 2024-04-17T08:32:03.851 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-17T08:32:03.851 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 27257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-17T08:32:03.851 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-17T08:32:03.851 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-17T08:32:03.851 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-17T08:32:03.851 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-17T08:32:03.852 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-17T08:32:03.852 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-17T08:32:03.852 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-17T08:32:03.852 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-17T08:32:03.852 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 70369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-17T08:32:03.852 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 129433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/wire.ko 2024-04-17T08:32:03.852 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ 2024-04-17T08:32:03.852 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/acquirewdt.ko 2024-04-17T08:32:03.852 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/advantechwdt.ko 2024-04-17T08:32:03.852 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-17T08:32:03.852 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 27401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-17T08:32:03.852 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/cpu5wdt.ko 2024-04-17T08:32:03.852 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/da9052_wdt.ko 2024-04-17T08:32:03.852 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/da9055_wdt.ko 2024-04-17T08:32:03.852 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/da9063_wdt.ko 2024-04-17T08:32:03.853 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/dw_wdt.ko 2024-04-17T08:32:03.853 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/eurotechwdt.ko 2024-04-17T08:32:03.853 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-17T08:32:03.853 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 32857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/hpwdt.ko 2024-04-17T08:32:03.853 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/i6300esb.ko 2024-04-17T08:32:03.853 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-17T08:32:03.853 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-17T08:32:03.853 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ib700wdt.ko 2024-04-17T08:32:03.853 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ibmasr.ko 2024-04-17T08:32:03.853 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-17T08:32:03.853 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-17T08:32:03.853 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/it87_wdt.ko 2024-04-17T08:32:03.853 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/kempld_wdt.ko 2024-04-17T08:32:03.853 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/machzwd.ko 2024-04-17T08:32:03.853 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/mena21_wdt.ko 2024-04-17T08:32:03.854 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-04-17T08:32:03.854 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 29753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/nv_tco.ko 2024-04-17T08:32:03.854 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-04-17T08:32:03.854 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 27721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/pc87413_wdt.ko 2024-04-17T08:32:03.854 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 46953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-17T08:32:03.854 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 37193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-17T08:32:03.854 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/retu_wdt.ko 2024-04-17T08:32:03.854 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-04-17T08:32:03.854 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-04-17T08:32:03.854 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-17T08:32:03.854 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 29169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sc1200wdt.ko 2024-04-17T08:32:03.854 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 27489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-17T08:32:03.854 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-04-17T08:32:03.854 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/softdog.ko 2024-04-17T08:32:03.854 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-17T08:32:03.855 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/twl4030_wdt.ko 2024-04-17T08:32:03.855 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/via_wdt.ko 2024-04-17T08:32:03.855 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-17T08:32:03.855 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-17T08:32:03.855 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 32481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-17T08:32:03.855 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/wafer5823wdt.ko 2024-04-17T08:32:03.855 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 33465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/wdt_pci.ko 2024-04-17T08:32:03.855 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/wm831x_wdt.ko 2024-04-17T08:32:03.855 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/wm8350_wdt.ko 2024-04-17T08:32:03.855 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/xen_wdt.ko 2024-04-17T08:32:03.855 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/ 2024-04-17T08:32:03.855 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 30049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-evtchn.ko 2024-04-17T08:32:03.855 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 30649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-gntalloc.ko 2024-04-17T08:32:03.855 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 55713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-gntdev.ko 2024-04-17T08:32:03.855 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-pciback/ 2024-04-17T08:32:03.856 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 213913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-17T08:32:03.856 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 47689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-privcmd.ko 2024-04-17T08:32:03.856 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 85713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-scsiback.ko 2024-04-17T08:32:03.856 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xenfs/ 2024-04-17T08:32:03.856 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-17T08:32:03.856 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ 2024-04-17T08:32:03.856 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/9p/ 2024-04-17T08:32:03.856 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 192617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/9p/9p.ko 2024-04-17T08:32:03.856 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/adfs/ 2024-04-17T08:32:03.856 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 78153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/adfs/adfs.ko 2024-04-17T08:32:03.856 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/affs/ 2024-04-17T08:32:03.856 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 197849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/affs/affs.ko 2024-04-17T08:32:03.856 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/afs/ 2024-04-17T08:32:03.856 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 1261113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/afs/kafs.ko 2024-04-17T08:32:03.856 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/autofs/ 2024-04-17T08:32:03.856 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 127377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/autofs/autofs4.ko 2024-04-17T08:32:03.857 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/befs/ 2024-04-17T08:32:03.857 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 80521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/befs/befs.ko 2024-04-17T08:32:03.857 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/bfs/ 2024-04-17T08:32:03.857 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 50473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/bfs/bfs.ko 2024-04-17T08:32:03.857 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 45561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/binfmt_misc.ko 2024-04-17T08:32:03.857 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/btrfs/ 2024-04-17T08:32:03.857 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 4489593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/btrfs/btrfs.ko 2024-04-17T08:32:03.857 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cachefiles/ 2024-04-17T08:32:03.857 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 376857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cachefiles/cachefiles.ko 2024-04-17T08:32:03.857 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ceph/ 2024-04-17T08:32:03.857 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 1586089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ceph/ceph.ko 2024-04-17T08:32:03.857 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/coda/ 2024-04-17T08:32:03.857 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 130073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/coda/coda.ko 2024-04-17T08:32:03.857 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/configfs/ 2024-04-17T08:32:03.858 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 139081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/configfs/configfs.ko 2024-04-17T08:32:03.858 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cramfs/ 2024-04-17T08:32:03.858 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 35665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cramfs/cramfs.ko 2024-04-17T08:32:03.858 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/dlm/ 2024-04-17T08:32:03.858 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 813225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/dlm/dlm.ko 2024-04-17T08:32:03.858 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/efs/ 2024-04-17T08:32:03.858 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 46409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/efs/efs.ko 2024-04-17T08:32:03.858 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/f2fs/ 2024-04-17T08:32:03.858 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 1906817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/f2fs/f2fs.ko 2024-04-17T08:32:03.858 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat/ 2024-04-17T08:32:03.858 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 35137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat/msdos.ko 2024-04-17T08:32:03.858 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/freevxfs/ 2024-04-17T08:32:03.858 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 52313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/freevxfs/freevxfs.ko 2024-04-17T08:32:03.858 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fuse/ 2024-04-17T08:32:03.858 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 29177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fuse/cuse.ko 2024-04-17T08:32:03.859 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/gfs2/ 2024-04-17T08:32:03.859 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 1486521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/gfs2/gfs2.ko 2024-04-17T08:32:03.859 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfs/ 2024-04-17T08:32:03.859 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 183305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfs/hfs.ko 2024-04-17T08:32:03.859 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfsplus/ 2024-04-17T08:32:03.859 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 282097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfsplus/hfsplus.ko 2024-04-17T08:32:03.859 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hpfs/ 2024-04-17T08:32:03.859 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 249009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hpfs/hpfs.ko 2024-04-17T08:32:03.859 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/isofs/ 2024-04-17T08:32:03.859 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 93033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/isofs/isofs.ko 2024-04-17T08:32:03.859 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/jfs/ 2024-04-17T08:32:03.859 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 533073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/jfs/jfs.ko 2024-04-17T08:32:03.859 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/lockd/ 2024-04-17T08:32:03.859 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 361369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/lockd/lockd.ko 2024-04-17T08:32:03.859 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/minix/ 2024-04-17T08:32:03.860 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 112609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/minix/minix.ko 2024-04-17T08:32:03.860 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/netfs/ 2024-04-17T08:32:03.860 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 591585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/netfs/netfs.ko 2024-04-17T08:32:03.860 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/ 2024-04-17T08:32:03.860 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/blocklayout/ 2024-04-17T08:32:03.860 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 102561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-17T08:32:03.860 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/filelayout/ 2024-04-17T08:32:03.860 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 74353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-17T08:32:03.860 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/flexfilelayout/ 2024-04-17T08:32:03.860 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 147689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-17T08:32:03.860 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 1320249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfs.ko 2024-04-17T08:32:03.910 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 82105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfsv2.ko 2024-04-17T08:32:03.910 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 151641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfsv3.ko 2024-04-17T08:32:03.910 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 2518505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfsv4.ko 2024-04-17T08:32:03.910 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs_common/ 2024-04-17T08:32:03.911 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs_common/grace.ko 2024-04-17T08:32:03.911 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs_common/nfs_acl.ko 2024-04-17T08:32:03.911 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfsd/ 2024-04-17T08:32:03.911 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 2024049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfsd/nfsd.ko 2024-04-17T08:32:03.911 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nilfs2/ 2024-04-17T08:32:03.911 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 734025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nilfs2/nilfs2.ko 2024-04-17T08:32:03.911 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/ 2024-04-17T08:32:03.911 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-celtic.ko 2024-04-17T08:32:03.911 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-centeuro.ko 2024-04-17T08:32:03.911 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-croatian.ko 2024-04-17T08:32:03.911 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-cyrillic.ko 2024-04-17T08:32:03.911 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-gaelic.ko 2024-04-17T08:32:03.911 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-greek.ko 2024-04-17T08:32:03.911 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-iceland.ko 2024-04-17T08:32:03.912 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-inuit.ko 2024-04-17T08:32:03.912 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-roman.ko 2024-04-17T08:32:03.912 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-romanian.ko 2024-04-17T08:32:03.912 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-turkish.ko 2024-04-17T08:32:03.912 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_ascii.ko 2024-04-17T08:32:03.912 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp1250.ko 2024-04-17T08:32:03.912 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp1251.ko 2024-04-17T08:32:03.912 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp1255.ko 2024-04-17T08:32:03.912 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp737.ko 2024-04-17T08:32:03.912 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp775.ko 2024-04-17T08:32:03.912 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp850.ko 2024-04-17T08:32:03.912 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp852.ko 2024-04-17T08:32:03.912 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp855.ko 2024-04-17T08:32:03.912 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp857.ko 2024-04-17T08:32:03.913 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp860.ko 2024-04-17T08:32:03.913 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp861.ko 2024-04-17T08:32:03.913 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp862.ko 2024-04-17T08:32:03.913 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp863.ko 2024-04-17T08:32:03.913 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp864.ko 2024-04-17T08:32:03.913 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp865.ko 2024-04-17T08:32:03.913 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp866.ko 2024-04-17T08:32:03.913 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp869.ko 2024-04-17T08:32:03.913 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp874.ko 2024-04-17T08:32:03.913 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 95625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp932.ko 2024-04-17T08:32:03.913 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 144209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp936.ko 2024-04-17T08:32:03.913 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 167137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp949.ko 2024-04-17T08:32:03.913 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 119513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp950.ko 2024-04-17T08:32:03.913 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_euc-jp.ko 2024-04-17T08:32:03.913 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-1.ko 2024-04-17T08:32:03.913 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-13.ko 2024-04-17T08:32:03.914 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-14.ko 2024-04-17T08:32:03.914 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-15.ko 2024-04-17T08:32:03.914 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-2.ko 2024-04-17T08:32:03.914 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-3.ko 2024-04-17T08:32:03.914 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-4.ko 2024-04-17T08:32:03.914 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-5.ko 2024-04-17T08:32:03.914 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-6.ko 2024-04-17T08:32:03.914 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-7.ko 2024-04-17T08:32:03.914 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-9.ko 2024-04-17T08:32:03.914 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_koi8-r.ko 2024-04-17T08:32:03.914 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_koi8-ru.ko 2024-04-17T08:32:03.914 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_koi8-u.ko 2024-04-17T08:32:03.914 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 7521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-17T08:32:03.914 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_utf8.ko 2024-04-17T08:32:03.915 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ 2024-04-17T08:32:03.915 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/cluster/ 2024-04-17T08:32:03.915 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 302073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-17T08:32:03.915 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlm/ 2024-04-17T08:32:03.915 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 548169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-17T08:32:03.915 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlmfs/ 2024-04-17T08:32:03.915 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 66361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-17T08:32:03.915 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 3245617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2.ko 2024-04-17T08:32:03.915 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 22113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-17T08:32:03.915 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 39313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-17T08:32:03.915 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 43073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-17T08:32:03.915 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/omfs/ 2024-04-17T08:32:03.915 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 67489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/omfs/omfs.ko 2024-04-17T08:32:03.915 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/overlayfs/ 2024-04-17T08:32:03.916 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 462873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/overlayfs/overlay.ko 2024-04-17T08:32:03.916 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/pstore/ 2024-04-17T08:32:03.916 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 67977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/pstore/ramoops.ko 2024-04-17T08:32:03.916 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/qnx4/ 2024-04-17T08:32:03.916 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 33209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/qnx4/qnx4.ko 2024-04-17T08:32:03.916 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/qnx6/ 2024-04-17T08:32:03.916 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 56097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/qnx6/qnx6.ko 2024-04-17T08:32:03.916 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/quota/ 2024-04-17T08:32:03.916 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 40313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/quota/quota_tree.ko 2024-04-17T08:32:03.916 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/quota/quota_v1.ko 2024-04-17T08:32:03.916 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/quota/quota_v2.ko 2024-04-17T08:32:03.916 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/reiserfs/ 2024-04-17T08:32:03.916 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 684841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/reiserfs/reiserfs.ko 2024-04-17T08:32:03.916 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/romfs/ 2024-04-17T08:32:03.916 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 34673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/romfs/romfs.ko 2024-04-17T08:32:03.917 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/ 2024-04-17T08:32:03.917 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/client/ 2024-04-17T08:32:03.917 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 3319041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/client/cifs.ko 2024-04-17T08:32:03.917 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/common/ 2024-04-17T08:32:03.917 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/common/cifs_arc4.ko 2024-04-17T08:32:03.917 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/common/cifs_md4.ko 2024-04-17T08:32:03.917 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/squashfs/ 2024-04-17T08:32:03.917 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 164185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/squashfs/squashfs.ko 2024-04-17T08:32:03.917 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/sysv/ 2024-04-17T08:32:03.917 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 115977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/sysv/sysv.ko 2024-04-17T08:32:03.917 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/udf/ 2024-04-17T08:32:03.917 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 310017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/udf/udf.ko 2024-04-17T08:32:03.917 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ufs/ 2024-04-17T08:32:03.917 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 198233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ufs/ufs.ko 2024-04-17T08:32:03.918 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/xfs/ 2024-04-17T08:32:03.918 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 5192705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/xfs/xfs.ko 2024-04-17T08:32:03.918 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/ 2024-04-17T08:32:03.918 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/locking/ 2024-04-17T08:32:03.918 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 97625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/locking/locktorture.ko 2024-04-17T08:32:03.918 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/time/ 2024-04-17T08:32:03.918 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/time/test_udelay.ko 2024-04-17T08:32:03.918 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 72665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/torture.ko 2024-04-17T08:32:03.918 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ 2024-04-17T08:32:03.918 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 7313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crc-itu-t.ko 2024-04-17T08:32:03.918 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 7081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crc7.ko 2024-04-17T08:32:03.918 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 7953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crc8.ko 2024-04-17T08:32:03.918 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crypto/ 2024-04-17T08:32:03.918 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crypto/libarc4.ko 2024-04-17T08:32:03.919 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 38985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crypto/libdes.ko 2024-04-17T08:32:03.919 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/interval_tree_test.ko 2024-04-17T08:32:03.919 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/libcrc32c.ko 2024-04-17T08:32:03.919 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 29065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lru_cache.ko 2024-04-17T08:32:03.919 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lz4/ 2024-04-17T08:32:03.919 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 36169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lz4/lz4_compress.ko 2024-04-17T08:32:03.919 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lz4/lz4hc_compress.ko 2024-04-17T08:32:03.919 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/math/ 2024-04-17T08:32:03.919 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 7281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/math/cordic.ko 2024-04-17T08:32:03.919 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/memory-notifier-error-inject.ko 2024-04-17T08:32:03.919 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/notifier-error-inject.ko 2024-04-17T08:32:03.919 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/percpu_test.ko 2024-04-17T08:32:03.919 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/pm-notifier-error-inject.ko 2024-04-17T08:32:03.919 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/raid6/ 2024-04-17T08:32:03.919 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 152025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/raid6/raid6_pq.ko 2024-04-17T08:32:03.920 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/rbtree_test.ko 2024-04-17T08:32:03.920 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/reed_solomon/ 2024-04-17T08:32:03.920 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-17T08:32:03.920 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 40969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/test-kstrtox.ko 2024-04-17T08:32:03.920 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 4912441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/test_bpf.ko 2024-04-17T08:32:03.920 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 61169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/test_firmware.ko 2024-04-17T08:32:03.920 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 7121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/test_module.ko 2024-04-17T08:32:03.920 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/test_user_copy.ko 2024-04-17T08:32:03.920 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ts_bm.ko 2024-04-17T08:32:03.920 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ts_fsm.ko 2024-04-17T08:32:03.920 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ts_kmp.ko 2024-04-17T08:32:03.920 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/xz/ 2024-04-17T08:32:03.920 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/xz/xz_dec_test.ko 2024-04-17T08:32:03.920 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/mm/ 2024-04-17T08:32:03.920 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/mm/hwpoison-inject.ko 2024-04-17T08:32:03.921 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ 2024-04-17T08:32:03.921 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/ 2024-04-17T08:32:03.921 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 66969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/6lowpan.ko 2024-04-17T08:32:03.921 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 7577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_dest.ko 2024-04-17T08:32:03.921 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 7529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_fragment.ko 2024-04-17T08:32:03.921 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 7513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_hop.ko 2024-04-17T08:32:03.921 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 7513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-17T08:32:03.921 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 7529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_mobility.ko 2024-04-17T08:32:03.921 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 7521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_routing.ko 2024-04-17T08:32:03.921 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_udp.ko 2024-04-17T08:32:03.921 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/ 2024-04-17T08:32:03.921 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 36729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/garp.ko 2024-04-17T08:32:03.921 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 42297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/mrp.ko 2024-04-17T08:32:03.921 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/p8022.ko 2024-04-17T08:32:03.921 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/psnap.ko 2024-04-17T08:32:03.922 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/stp.ko 2024-04-17T08:32:03.922 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/8021q/ 2024-04-17T08:32:03.922 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 106793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/8021q/8021q.ko 2024-04-17T08:32:03.922 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/ 2024-04-17T08:32:03.922 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 236793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet.ko 2024-04-17T08:32:03.922 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 44449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet_fd.ko 2024-04-17T08:32:03.922 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 32209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet_rdma.ko 2024-04-17T08:32:03.922 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 39513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet_virtio.ko 2024-04-17T08:32:03.922 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/batman-adv/ 2024-04-17T08:32:03.922 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 879697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/batman-adv/batman-adv.ko 2024-04-17T08:32:03.922 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/ 2024-04-17T08:32:03.922 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 84761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/br_netfilter.ko 2024-04-17T08:32:03.922 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 1030873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/bridge.ko 2024-04-17T08:32:03.922 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ 2024-04-17T08:32:03.923 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-17T08:32:03.923 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-17T08:32:03.923 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-17T08:32:03.923 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-17T08:32:03.923 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-17T08:32:03.923 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-17T08:32:03.923 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-17T08:32:03.923 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-17T08:32:03.923 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-17T08:32:03.923 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-17T08:32:03.923 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-17T08:32:03.923 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-17T08:32:03.923 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-17T08:32:03.923 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-17T08:32:03.923 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-17T08:32:03.923 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-17T08:32:03.924 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-17T08:32:03.924 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-17T08:32:03.924 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-17T08:32:03.924 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-17T08:32:03.924 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 70529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtables.ko 2024-04-17T08:32:03.924 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-17T08:32:03.924 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-17T08:32:03.924 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ceph/ 2024-04-17T08:32:03.924 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 1243505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ceph/libceph.ko 2024-04-17T08:32:03.924 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/core/ 2024-04-17T08:32:03.924 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 153801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/core/pktgen.ko 2024-04-17T08:32:03.924 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/ 2024-04-17T08:32:03.924 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 244889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp.ko 2024-04-17T08:32:03.924 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp_diag.ko 2024-04-17T08:32:03.924 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 71033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp_ipv4.ko 2024-04-17T08:32:03.925 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 74993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp_ipv6.ko 2024-04-17T08:32:03.925 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/ 2024-04-17T08:32:03.925 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 507705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/dsa_core.ko 2024-04-17T08:32:03.925 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_brcm.ko 2024-04-17T08:32:03.925 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_dsa.ko 2024-04-17T08:32:03.925 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_none.ko 2024-04-17T08:32:03.925 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_trailer.ko 2024-04-17T08:32:03.925 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/hsr/ 2024-04-17T08:32:03.925 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 128873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/hsr/hsr.ko 2024-04-17T08:32:03.925 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/ 2024-04-17T08:32:03.925 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/6lowpan/ 2024-04-17T08:32:03.925 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 55505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-17T08:32:03.925 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 357425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/ieee802154.ko 2024-04-17T08:32:03.925 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 59393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-17T08:32:03.925 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ 2024-04-17T08:32:03.926 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 29041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ah4.ko 2024-04-17T08:32:03.926 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 46417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/esp4.ko 2024-04-17T08:32:03.926 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 60233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/fou.ko 2024-04-17T08:32:03.926 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/gre.ko 2024-04-17T08:32:03.926 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 65665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/inet_diag.ko 2024-04-17T08:32:03.926 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 75489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ip_gre.ko 2024-04-17T08:32:03.926 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 77721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ip_tunnel.ko 2024-04-17T08:32:03.926 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 43705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ip_vti.ko 2024-04-17T08:32:03.926 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ipcomp.ko 2024-04-17T08:32:03.926 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 34745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ipip.ko 2024-04-17T08:32:03.926 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ 2024-04-17T08:32:03.926 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 45521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-17T08:32:03.926 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-17T08:32:03.926 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-17T08:32:03.927 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 50169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ip_tables.ko 2024-04-17T08:32:03.927 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-17T08:32:03.927 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-04-17T08:32:03.927 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-17T08:32:03.927 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-17T08:32:03.927 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-17T08:32:03.927 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-04-17T08:32:03.927 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-17T08:32:03.927 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-17T08:32:03.927 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-17T08:32:03.927 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-17T08:32:03.927 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-17T08:32:03.927 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-17T08:32:03.927 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 32473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-17T08:32:03.928 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-17T08:32:03.928 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-17T08:32:03.928 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-04-17T08:32:03.928 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-17T08:32:03.928 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-17T08:32:03.928 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-17T08:32:03.928 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-17T08:32:03.928 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-17T08:32:03.928 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_bic.ko 2024-04-17T08:32:03.928 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_dctcp.ko 2024-04-17T08:32:03.928 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_diag.ko 2024-04-17T08:32:03.928 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_highspeed.ko 2024-04-17T08:32:03.928 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_htcp.ko 2024-04-17T08:32:03.928 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_hybla.ko 2024-04-17T08:32:03.928 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_illinois.ko 2024-04-17T08:32:03.929 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_lp.ko 2024-04-17T08:32:03.929 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_scalable.ko 2024-04-17T08:32:03.929 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_vegas.ko 2024-04-17T08:32:03.929 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_veno.ko 2024-04-17T08:32:03.929 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_westwood.ko 2024-04-17T08:32:03.929 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_yeah.ko 2024-04-17T08:32:03.929 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tunnel4.ko 2024-04-17T08:32:03.929 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/udp_diag.ko 2024-04-17T08:32:03.929 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 54441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/udp_tunnel.ko 2024-04-17T08:32:03.929 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-17T08:32:03.929 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ 2024-04-17T08:32:03.929 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 31073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ah6.ko 2024-04-17T08:32:03.929 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 47433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/esp6.ko 2024-04-17T08:32:03.929 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/fou6.ko 2024-04-17T08:32:03.929 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 103177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_gre.ko 2024-04-17T08:32:03.929 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 118881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_tunnel.ko 2024-04-17T08:32:03.930 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-17T08:32:03.930 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 71089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_vti.ko 2024-04-17T08:32:03.930 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ipcomp6.ko 2024-04-17T08:32:03.930 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/mip6.ko 2024-04-17T08:32:03.930 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ 2024-04-17T08:32:03.930 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 50673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-17T08:32:03.930 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-04-17T08:32:03.930 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-17T08:32:03.930 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-17T08:32:03.930 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15929 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-17T08:32:03.930 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-17T08:32:03.930 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-17T08:32:03.930 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-17T08:32:03.931 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-17T08:32:03.931 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-17T08:32:03.931 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-17T08:32:03.931 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-17T08:32:03.931 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-17T08:32:03.931 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-17T08:32:03.931 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-17T08:32:03.931 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-17T08:32:03.931 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-17T08:32:03.931 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 46313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-17T08:32:03.931 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-17T08:32:03.931 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 29817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-17T08:32:03.931 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-17T08:32:03.931 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-17T08:32:03.931 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-17T08:32:03.932 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-17T08:32:03.932 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-17T08:32:03.932 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 94089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/sit.ko 2024-04-17T08:32:03.932 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 30297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/tunnel6.ko 2024-04-17T08:32:03.932 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-17T08:32:03.932 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/key/ 2024-04-17T08:32:03.932 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 106369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/key/af_key.ko 2024-04-17T08:32:03.932 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/ 2024-04-17T08:32:03.932 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 153217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_core.ko 2024-04-17T08:32:03.932 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-17T08:32:03.932 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 31985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_eth.ko 2024-04-17T08:32:03.932 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 43641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_ip.ko 2024-04-17T08:32:03.932 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 44993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_ip6.ko 2024-04-17T08:32:03.932 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 42049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_netlink.ko 2024-04-17T08:32:03.932 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 66241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_ppp.ko 2024-04-17T08:32:03.933 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/lapb/ 2024-04-17T08:32:03.933 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 63345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/lapb/lapb.ko 2024-04-17T08:32:03.933 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/llc/ 2024-04-17T08:32:03.933 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 27385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/llc/llc.ko 2024-04-17T08:32:03.933 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 332889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/llc/llc2.ko 2024-04-17T08:32:03.933 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mac802154/ 2024-04-17T08:32:03.933 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 388873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mac802154/mac802154.ko 2024-04-17T08:32:03.933 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mpls/ 2024-04-17T08:32:03.933 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mpls/mpls_gso.ko 2024-04-17T08:32:03.933 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ 2024-04-17T08:32:03.933 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ 2024-04-17T08:32:03.933 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 147745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set.ko 2024-04-17T08:32:03.933 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 34473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-17T08:32:03.933 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 33073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-17T08:32:03.934 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 32553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-17T08:32:03.934 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 124041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-17T08:32:03.934 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 124345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-17T08:32:03.934 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 126681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-17T08:32:03.934 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 126473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-17T08:32:03.934 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 137833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-17T08:32:03.934 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 72353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-17T08:32:03.934 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 133681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-17T08:32:03.934 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 139073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-17T08:32:03.934 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 138265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-17T08:32:03.934 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 136177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-17T08:32:03.934 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 139897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-17T08:32:03.934 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 37129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-17T08:32:03.934 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ 2024-04-17T08:32:03.935 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 534113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-17T08:32:03.935 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-17T08:32:03.935 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-17T08:32:03.935 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-17T08:32:03.935 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-17T08:32:03.935 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-17T08:32:03.935 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-17T08:32:03.935 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-17T08:32:03.935 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-17T08:32:03.935 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-17T08:32:03.935 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-17T08:32:03.935 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-17T08:32:03.935 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-17T08:32:03.935 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-17T08:32:03.935 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 55217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conncount.ko 2024-04-17T08:32:03.935 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 496817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack.ko 2024-04-17T08:32:03.936 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-17T08:32:03.936 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-17T08:32:03.936 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 37865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-17T08:32:03.936 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 134377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-17T08:32:03.936 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-17T08:32:03.936 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-17T08:32:03.936 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 140801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-17T08:32:03.936 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 38305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-17T08:32:03.936 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-17T08:32:03.936 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 79873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-17T08:32:03.936 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-17T08:32:03.936 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-17T08:32:03.936 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-17T08:32:03.936 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 117201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_flow_table.ko 2024-04-17T08:32:03.937 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-17T08:32:03.937 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 46105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_log_syslog.ko 2024-04-17T08:32:03.937 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 118369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat.ko 2024-04-17T08:32:03.937 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-17T08:32:03.937 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-17T08:32:03.937 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_irc.ko 2024-04-17T08:32:03.937 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 34609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_sip.ko 2024-04-17T08:32:03.937 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-17T08:32:03.937 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 53393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-17T08:32:03.937 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 807985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_tables.ko 2024-04-17T08:32:03.937 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 53049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink.ko 2024-04-17T08:32:03.937 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 36481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-17T08:32:03.937 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 37209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-04-17T08:32:03.937 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 49297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_log.ko 2024-04-17T08:32:03.937 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-17T08:32:03.938 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 65145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-17T08:32:03.938 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_chain_nat.ko 2024-04-17T08:32:03.938 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 41769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_compat.ko 2024-04-17T08:32:03.938 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 50657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_ct.ko 2024-04-17T08:32:03.938 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-17T08:32:03.938 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_fib.ko 2024-04-17T08:32:03.938 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-17T08:32:03.938 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_hash.ko 2024-04-17T08:32:03.938 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_limit.ko 2024-04-17T08:32:03.938 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_log.ko 2024-04-17T08:32:03.938 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_masq.ko 2024-04-17T08:32:03.938 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_nat.ko 2024-04-17T08:32:03.938 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_numgen.ko 2024-04-17T08:32:03.938 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_osf.ko 2024-04-17T08:32:03.939 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_queue.ko 2024-04-17T08:32:03.939 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_redir.ko 2024-04-17T08:32:03.939 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_reject.ko 2024-04-17T08:32:03.939 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_reject_inet.ko 2024-04-17T08:32:03.939 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_socket.ko 2024-04-17T08:32:03.939 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 24993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_synproxy.ko 2024-04-17T08:32:03.939 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_tproxy.ko 2024-04-17T08:32:03.939 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 108393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/x_tables.ko 2024-04-17T08:32:03.939 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_AUDIT.ko 2024-04-17T08:32:03.939 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-17T08:32:03.939 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-17T08:32:03.939 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-17T08:32:03.939 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 21865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CT.ko 2024-04-17T08:32:03.939 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_DSCP.ko 2024-04-17T08:32:03.939 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_HL.ko 2024-04-17T08:32:03.939 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_HMARK.ko 2024-04-17T08:32:03.940 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 45217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-17T08:32:03.940 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_LED.ko 2024-04-17T08:32:03.940 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_LOG.ko 2024-04-17T08:32:03.940 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-17T08:32:03.940 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_NETMAP.ko 2024-04-17T08:32:03.940 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_NFLOG.ko 2024-04-17T08:32:03.940 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-17T08:32:03.940 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_RATEEST.ko 2024-04-17T08:32:03.940 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-17T08:32:03.940 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_SECMARK.ko 2024-04-17T08:32:03.940 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-17T08:32:03.940 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-17T08:32:03.940 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TEE.ko 2024-04-17T08:32:03.940 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TPROXY.ko 2024-04-17T08:32:03.941 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TRACE.ko 2024-04-17T08:32:03.941 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_addrtype.ko 2024-04-17T08:32:03.941 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_bpf.ko 2024-04-17T08:32:03.941 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_cgroup.ko 2024-04-17T08:32:03.941 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_cluster.ko 2024-04-17T08:32:03.941 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_comment.ko 2024-04-17T08:32:03.941 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connbytes.ko 2024-04-17T08:32:03.941 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connlabel.ko 2024-04-17T08:32:03.941 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connlimit.ko 2024-04-17T08:32:03.941 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connmark.ko 2024-04-17T08:32:03.941 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_conntrack.ko 2024-04-17T08:32:03.941 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_cpu.ko 2024-04-17T08:32:03.941 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_dccp.ko 2024-04-17T08:32:03.941 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_devgroup.ko 2024-04-17T08:32:03.941 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_dscp.ko 2024-04-17T08:32:03.941 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_ecn.ko 2024-04-17T08:32:03.942 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_esp.ko 2024-04-17T08:32:03.942 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 52817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_hashlimit.ko 2024-04-17T08:32:03.942 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_helper.ko 2024-04-17T08:32:03.942 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_hl.ko 2024-04-17T08:32:03.942 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_ipcomp.ko 2024-04-17T08:32:03.942 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_iprange.ko 2024-04-17T08:32:03.942 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_ipvs.ko 2024-04-17T08:32:03.942 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_l2tp.ko 2024-04-17T08:32:03.942 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_length.ko 2024-04-17T08:32:03.942 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_limit.ko 2024-04-17T08:32:03.942 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_mac.ko 2024-04-17T08:32:03.942 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_mark.ko 2024-04-17T08:32:03.942 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_multiport.ko 2024-04-17T08:32:03.942 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 16161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_nat.ko 2024-04-17T08:32:03.942 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_nfacct.ko 2024-04-17T08:32:03.943 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_osf.ko 2024-04-17T08:32:03.943 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_owner.ko 2024-04-17T08:32:03.943 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_physdev.ko 2024-04-17T08:32:03.943 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_pkttype.ko 2024-04-17T08:32:03.943 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_policy.ko 2024-04-17T08:32:03.943 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_quota.ko 2024-04-17T08:32:03.943 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 11881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_rateest.ko 2024-04-17T08:32:03.943 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_realm.ko 2024-04-17T08:32:03.943 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 43465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_recent.ko 2024-04-17T08:32:03.943 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_sctp.ko 2024-04-17T08:32:03.943 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 36489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_set.ko 2024-04-17T08:32:03.943 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 19777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_socket.ko 2024-04-17T08:32:03.943 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_state.ko 2024-04-17T08:32:03.943 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_statistic.ko 2024-04-17T08:32:03.943 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_string.ko 2024-04-17T08:32:03.944 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_tcpmss.ko 2024-04-17T08:32:03.944 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_tcpudp.ko 2024-04-17T08:32:03.944 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_time.ko 2024-04-17T08:32:03.944 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_u32.ko 2024-04-17T08:32:03.944 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netlink/ 2024-04-17T08:32:03.944 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 17233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netlink/netlink_diag.ko 2024-04-17T08:32:03.944 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/nsh/ 2024-04-17T08:32:03.944 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 14073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/nsh/nsh.ko 2024-04-17T08:32:03.944 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/ 2024-04-17T08:32:03.944 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 488825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/openvswitch.ko 2024-04-17T08:32:03.944 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/vport-geneve.ko 2024-04-17T08:32:03.944 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 10873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/vport-gre.ko 2024-04-17T08:32:03.944 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/vport-vxlan.ko 2024-04-17T08:32:03.944 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/packet/ 2024-04-17T08:32:03.945 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15929 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/packet/af_packet_diag.ko 2024-04-17T08:32:03.945 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/phonet/ 2024-04-17T08:32:03.945 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 142025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/phonet/phonet.ko 2024-04-17T08:32:03.945 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 68817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/phonet/pn_pep.ko 2024-04-17T08:32:03.945 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/ 2024-04-17T08:32:03.945 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 318617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/rds.ko 2024-04-17T08:32:03.945 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 202305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/rds_rdma.ko 2024-04-17T08:32:03.945 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 85105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/rds_tcp.ko 2024-04-17T08:32:03.945 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rxrpc/ 2024-04-17T08:32:03.945 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 1027897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rxrpc/rxrpc.ko 2024-04-17T08:32:03.945 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/ 2024-04-17T08:32:03.945 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 39001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_csum.ko 2024-04-17T08:32:03.945 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 28721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_gact.ko 2024-04-17T08:32:03.945 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 45409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_mirred.ko 2024-04-17T08:32:03.945 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 27593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_nat.ko 2024-04-17T08:32:03.945 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 53465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_pedit.ko 2024-04-17T08:32:03.946 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 38705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_police.ko 2024-04-17T08:32:03.946 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_simple.ko 2024-04-17T08:32:03.946 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 43417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_skbedit.ko 2024-04-17T08:32:03.946 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 45673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_vlan.ko 2024-04-17T08:32:03.946 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 32129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_basic.ko 2024-04-17T08:32:03.946 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 41457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_bpf.ko 2024-04-17T08:32:03.946 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_cgroup.ko 2024-04-17T08:32:03.946 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 37305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_flow.ko 2024-04-17T08:32:03.946 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 39601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_fw.ko 2024-04-17T08:32:03.946 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 49321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_route.ko 2024-04-17T08:32:03.946 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 79145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_u32.ko 2024-04-17T08:32:03.946 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_cmp.ko 2024-04-17T08:32:03.946 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 15385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_ipset.ko 2024-04-17T08:32:03.946 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 48785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_meta.ko 2024-04-17T08:32:03.947 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_nbyte.ko 2024-04-17T08:32:03.947 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_text.ko 2024-04-17T08:32:03.947 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 8377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_u32.ko 2024-04-17T08:32:03.947 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_choke.ko 2024-04-17T08:32:03.947 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 25097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_codel.ko 2024-04-17T08:32:03.947 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 43481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_drr.ko 2024-04-17T08:32:03.947 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 43153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_fq.ko 2024-04-17T08:32:03.947 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 39177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_fq_codel.ko 2024-04-17T08:32:03.947 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 42889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_gred.ko 2024-04-17T08:32:03.947 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 62817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_hfsc.ko 2024-04-17T08:32:03.947 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_hhf.ko 2024-04-17T08:32:03.947 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 81833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_htb.ko 2024-04-17T08:32:03.947 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 33545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_ingress.ko 2024-04-17T08:32:03.947 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 36625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_mqprio.ko 2024-04-17T08:32:03.947 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_mqprio_lib.ko 2024-04-17T08:32:03.947 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 33065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_multiq.ko 2024-04-17T08:32:03.948 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 44793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_netem.ko 2024-04-17T08:32:03.948 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 32833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_pie.ko 2024-04-17T08:32:03.948 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 13505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_plug.ko 2024-04-17T08:32:03.948 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 31801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_prio.ko 2024-04-17T08:32:03.948 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 60249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_qfq.ko 2024-04-17T08:32:03.948 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 40889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_red.ko 2024-04-17T08:32:03.948 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 33433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_sfb.ko 2024-04-17T08:32:03.948 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 38329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_sfq.ko 2024-04-17T08:32:03.948 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 35777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_tbf.ko 2024-04-17T08:32:03.948 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 34161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_teql.ko 2024-04-17T08:32:03.948 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sctp/ 2024-04-17T08:32:03.948 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 1187313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sctp/sctp.ko 2024-04-17T08:32:03.948 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sctp/sctp_diag.ko 2024-04-17T08:32:03.948 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/ 2024-04-17T08:32:03.948 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/auth_gss/ 2024-04-17T08:32:03.949 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 432409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-17T08:32:03.949 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 70113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-17T08:32:03.949 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 1940889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/sunrpc.ko 2024-04-17T08:32:03.949 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/xprtrdma/ 2024-04-17T08:32:03.949 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 890729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-17T08:32:03.949 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/tipc/ 2024-04-17T08:32:03.949 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 1122337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/tipc/tipc.ko 2024-04-17T08:32:03.949 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/tipc/tipc_diag.ko 2024-04-17T08:32:03.949 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/unix/ 2024-04-17T08:32:03.949 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 18801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/unix/unix_diag.ko 2024-04-17T08:32:03.949 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/ 2024-04-17T08:32:03.949 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 105609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-17T08:32:03.949 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 90265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-17T08:32:03.949 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 123769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vsock.ko 2024-04-17T08:32:03.950 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 12905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-17T08:32:03.950 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 20401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-17T08:32:03.950 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/x25/ 2024-04-17T08:32:03.950 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 165841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/x25/x25.ko 2024-04-17T08:32:03.950 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/xfrm/ 2024-04-17T08:32:03.950 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 26729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/xfrm/xfrm_algo.ko 2024-04-17T08:32:03.950 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-17T08:32:03.950 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 131865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/xfrm/xfrm_user.ko 2024-04-17T08:32:03.950 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 644769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.alias 2024-04-17T08:32:03.950 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 628542 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.alias.bin 2024-04-17T08:32:03.950 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 7706 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin 2024-04-17T08:32:03.950 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 23609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin.alias.bin 2024-04-17T08:32:03.950 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 9941 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin.bin 2024-04-17T08:32:03.950 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 70990 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin.modinfo 2024-04-17T08:32:03.950 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 146959 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.dep 2024-04-17T08:32:03.951 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 232835 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.dep.bin 2024-04-17T08:32:03.951 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 210 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.devname 2024-04-17T08:32:03.951 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 72602 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.order 2024-04-17T08:32:03.951 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 879 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.softdep 2024-04-17T08:32:03.951 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 258450 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.symbols 2024-04-17T08:32:03.951 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 313019 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.symbols.bin 2024-04-17T08:32:03.951 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./usr/ 2024-04-17T08:32:03.951 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./usr/share/ 2024-04-17T08:32:03.951 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./usr/share/doc/ 2024-04-17T08:32:03.951 INFO:teuthology.orchestra.run.smithi196.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./usr/share/doc/linux-image-6.9.0-rc3-g3f60ed14f7c1/ 2024-04-17T08:32:03.951 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 174 2024-04-11 18:50 ./usr/share/doc/linux-image-6.9.0-rc3-g3f60ed14f7c1/changelog.Debian.gz 2024-04-17T08:32:03.951 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r-- root/root 691 2024-04-11 18:50 ./usr/share/doc/linux-image-6.9.0-rc3-g3f60ed14f7c1/copyright 2024-04-17T08:32:03.957 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g3f60ed14f7c1 2024-04-17T08:32:03.957 INFO:teuthology.task.kernel:searching for kernel 6.9.0-rc3-g3f60ed14f7c1 2024-04-17T08:32:03.957 DEBUG:teuthology.orchestra.run.smithi196:> egrep '(submenu|menuentry.*6.9.0-rc3-g3f60ed14f7c1).*{' /boot/grub/grub.cfg 2024-04-17T08:32:03.964 INFO:teuthology.orchestra.run.smithi196.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-17T08:32:03.964 INFO:teuthology.orchestra.run.smithi196.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g3f60ed14f7c1' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g3f60ed14f7c1-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-17T08:32:03.964 INFO:teuthology.orchestra.run.smithi196.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g3f60ed14f7c1 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g3f60ed14f7c1-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-17T08:32:03.964 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-04-17T08:32:03.965 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.9.0-rc3-g3f60ed14f7c1 2024-04-17T08:32:03.965 DEBUG:teuthology.orchestra.run.smithi196:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-04-17T08:32:04.009 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi196.front.sepia.ceph.com to complete... 2024-04-17T08:32:04.076 INFO:teuthology.orchestra.run.smithi152.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-17T08:32:04.086 INFO:teuthology.orchestra.run.smithi152.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-17T08:32:04.148 INFO:teuthology.orchestra.run.smithi152.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-17T08:32:04.153 INFO:teuthology.orchestra.run.smithi152.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-17T08:32:04.294 INFO:teuthology.orchestra.run.smithi152.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-17T08:32:04.294 INFO:teuthology.orchestra.run.smithi152.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-17T08:32:04.294 INFO:teuthology.orchestra.run.smithi152.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-17T08:32:04.330 INFO:teuthology.orchestra.run.smithi152.stderr:done 2024-04-17T08:32:04.412 INFO:teuthology.orchestra.run.smithi196.stderr:Sourcing file `/etc/default/grub' 2024-04-17T08:32:04.413 INFO:teuthology.orchestra.run.smithi196.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-17T08:32:04.439 INFO:teuthology.orchestra.run.smithi196.stderr:Generating grub configuration file ... 2024-04-17T08:32:04.489 DEBUG:teuthology.orchestra.run.smithi152:> dpkg-deb -c /tmp/linux-image.deb 2024-04-17T08:32:04.496 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./ 2024-04-17T08:32:04.497 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./boot/ 2024-04-17T08:32:04.497 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 7002012 2024-04-11 18:50 ./boot/System.map-6.9.0-rc3-g3f60ed14f7c1 2024-04-17T08:32:04.511 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 172073 2024-04-11 18:50 ./boot/config-6.9.0-rc3-g3f60ed14f7c1 2024-04-17T08:32:04.511 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13120512 2024-04-11 18:50 ./boot/vmlinuz-6.9.0-rc3-g3f60ed14f7c1 2024-04-17T08:32:04.534 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./etc/ 2024-04-17T08:32:04.534 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./etc/kernel/ 2024-04-17T08:32:04.534 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./etc/kernel/postinst.d/ 2024-04-17T08:32:04.534 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./etc/kernel/postrm.d/ 2024-04-17T08:32:04.534 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./etc/kernel/preinst.d/ 2024-04-17T08:32:04.534 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./etc/kernel/prerm.d/ 2024-04-17T08:32:04.534 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/ 2024-04-17T08:32:04.534 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/ 2024-04-17T08:32:04.535 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/ 2024-04-17T08:32:04.535 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/ 2024-04-17T08:32:04.535 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/ 2024-04-17T08:32:04.535 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/ 2024-04-17T08:32:04.535 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/ 2024-04-17T08:32:04.535 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 507569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/aesni-intel.ko 2024-04-17T08:32:04.535 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 28361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-17T08:32:04.535 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 34313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-17T08:32:04.535 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 35009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-17T08:32:04.535 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 97953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-17T08:32:04.535 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 109905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-17T08:32:04.535 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 155249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-17T08:32:04.535 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-17T08:32:04.536 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-17T08:32:04.536 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 87009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-17T08:32:04.536 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 22865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-17T08:32:04.536 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 50305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-17T08:32:04.536 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 50377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-17T08:32:04.536 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 54513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-17T08:32:04.536 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 44657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-17T08:32:04.536 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 48049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-17T08:32:04.536 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 62873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-17T08:32:04.536 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 53569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-17T08:32:04.536 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 34761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-17T08:32:04.536 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-17T08:32:04.536 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/ 2024-04-17T08:32:04.537 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpu/ 2024-04-17T08:32:04.537 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpu/mce/ 2024-04-17T08:32:04.537 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 49081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-17T08:32:04.537 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpuid.ko 2024-04-17T08:32:04.537 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 21625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/msr.ko 2024-04-17T08:32:04.537 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/ 2024-04-17T08:32:04.537 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 444425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-17T08:32:04.537 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 1035881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-17T08:32:04.538 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 2849609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/kvm.ko 2024-04-17T08:32:04.556 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/ 2024-04-17T08:32:04.556 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 65025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/af_alg.ko 2024-04-17T08:32:04.556 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 27961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/algif_hash.ko 2024-04-17T08:32:04.556 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 25721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/algif_skcipher.ko 2024-04-17T08:32:04.556 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/ansi_cprng.ko 2024-04-17T08:32:04.556 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 21065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/anubis.ko 2024-04-17T08:32:04.556 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 10929 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/arc4.ko 2024-04-17T08:32:04.556 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/asymmetric_keys/ 2024-04-17T08:32:04.556 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-04-17T08:32:04.556 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/ 2024-04-17T08:32:04.556 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_memcpy.ko 2024-04-17T08:32:04.556 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 22609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_pq.ko 2024-04-17T08:32:04.557 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 24841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-17T08:32:04.557 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_tx.ko 2024-04-17T08:32:04.557 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_xor.ko 2024-04-17T08:32:04.557 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/raid6test.ko 2024-04-17T08:32:04.557 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 25137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/authenc.ko 2024-04-17T08:32:04.557 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 27953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/authencesn.ko 2024-04-17T08:32:04.557 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 24049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/blake2b_generic.ko 2024-04-17T08:32:04.557 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/blowfish_common.ko 2024-04-17T08:32:04.557 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/blowfish_generic.ko 2024-04-17T08:32:04.557 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 40889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/camellia_generic.ko 2024-04-17T08:32:04.557 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 29113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cast5_generic.ko 2024-04-17T08:32:04.557 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cast6_generic.ko 2024-04-17T08:32:04.557 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 10489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cast_common.ko 2024-04-17T08:32:04.557 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 43281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/ccm.ko 2024-04-17T08:32:04.557 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 17497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cmac.ko 2024-04-17T08:32:04.557 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crc32_generic.ko 2024-04-17T08:32:04.558 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 59129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cryptd.ko 2024-04-17T08:32:04.558 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 48113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crypto_engine.ko 2024-04-17T08:32:04.558 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 32169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crypto_simd.ko 2024-04-17T08:32:04.558 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 30881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crypto_user.ko 2024-04-17T08:32:04.558 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 21697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cts.ko 2024-04-17T08:32:04.558 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/des_generic.ko 2024-04-17T08:32:04.558 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 18561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/dh_generic.ko 2024-04-17T08:32:04.558 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/echainiv.ko 2024-04-17T08:32:04.558 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 30689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/essiv.ko 2024-04-17T08:32:04.558 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 19209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/fcrypt.ko 2024-04-17T08:32:04.558 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 28201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/khazad.ko 2024-04-17T08:32:04.558 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 19089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/lrw.ko 2024-04-17T08:32:04.558 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/lz4.ko 2024-04-17T08:32:04.558 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/lz4hc.ko 2024-04-17T08:32:04.559 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/md4.ko 2024-04-17T08:32:04.559 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/michael_mic.ko 2024-04-17T08:32:04.559 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/pcbc.ko 2024-04-17T08:32:04.559 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 23073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/pcrypt.ko 2024-04-17T08:32:04.559 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 17665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/rmd160.ko 2024-04-17T08:32:04.559 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 30673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/seed.ko 2024-04-17T08:32:04.559 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 28865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/serpent_generic.ko 2024-04-17T08:32:04.559 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 169065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/tcrypt.ko 2024-04-17T08:32:04.559 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/tea.ko 2024-04-17T08:32:04.559 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 29641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/twofish_common.ko 2024-04-17T08:32:04.559 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/twofish_generic.ko 2024-04-17T08:32:04.559 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 19905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/vmac.ko 2024-04-17T08:32:04.559 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 38209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/wp512.ko 2024-04-17T08:32:04.559 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xcbc.ko 2024-04-17T08:32:04.560 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 30345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xor.ko 2024-04-17T08:32:04.560 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 23833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xts.ko 2024-04-17T08:32:04.560 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xxhash_generic.ko 2024-04-17T08:32:04.560 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ 2024-04-17T08:32:04.560 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/ 2024-04-17T08:32:04.560 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 21121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/acpi_extlog.ko 2024-04-17T08:32:04.560 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 31921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-17T08:32:04.560 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 32281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/acpi_pad.ko 2024-04-17T08:32:04.560 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/apei/ 2024-04-17T08:32:04.560 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 44705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/apei/einj.ko 2024-04-17T08:32:04.560 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/ec_sys.ko 2024-04-17T08:32:04.560 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 17705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/platform_profile.ko 2024-04-17T08:32:04.560 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 29017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/sbs.ko 2024-04-17T08:32:04.560 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 23385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/sbshc.ko 2024-04-17T08:32:04.561 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 119033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/video.ko 2024-04-17T08:32:04.561 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/ 2024-04-17T08:32:04.561 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 24497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/acard-ahci.ko 2024-04-17T08:32:04.561 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 96825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/ahci.ko 2024-04-17T08:32:04.561 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/ahci_platform.ko 2024-04-17T08:32:04.561 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 107737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/libahci.ko 2024-04-17T08:32:04.561 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 42001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/libahci_platform.ko 2024-04-17T08:32:04.561 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 19665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_acpi.ko 2024-04-17T08:32:04.561 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 35705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ali.ko 2024-04-17T08:32:04.561 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 38329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_amd.ko 2024-04-17T08:32:04.561 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 24649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_artop.ko 2024-04-17T08:32:04.561 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 23777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_atiixp.ko 2024-04-17T08:32:04.561 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 28785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_atp867x.ko 2024-04-17T08:32:04.561 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_cmd640.ko 2024-04-17T08:32:04.562 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 28929 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_cmd64x.ko 2024-04-17T08:32:04.562 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_cypress.ko 2024-04-17T08:32:04.562 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_efar.ko 2024-04-17T08:32:04.562 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 25209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt366.ko 2024-04-17T08:32:04.562 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 38913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt37x.ko 2024-04-17T08:32:04.562 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 26969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-17T08:32:04.562 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 19105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-17T08:32:04.562 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 19201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_it8213.ko 2024-04-17T08:32:04.562 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 41289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_it821x.ko 2024-04-17T08:32:04.562 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_jmicron.ko 2024-04-17T08:32:04.562 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 60257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_legacy.ko 2024-04-17T08:32:04.562 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 17017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_marvell.ko 2024-04-17T08:32:04.562 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 18065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_mpiix.ko 2024-04-17T08:32:04.562 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_netcell.ko 2024-04-17T08:32:04.562 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 18977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ninja32.ko 2024-04-17T08:32:04.563 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ns87410.ko 2024-04-17T08:32:04.563 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ns87415.ko 2024-04-17T08:32:04.563 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 18425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_oldpiix.ko 2024-04-17T08:32:04.563 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 17481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_opti.ko 2024-04-17T08:32:04.563 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 23681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_optidma.ko 2024-04-17T08:32:04.563 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 35145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_pcmcia.ko 2024-04-17T08:32:04.563 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 43009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-17T08:32:04.563 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 23873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-17T08:32:04.563 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_piccolo.ko 2024-04-17T08:32:04.563 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 17257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_radisys.ko 2024-04-17T08:32:04.563 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 22233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_rdc.ko 2024-04-17T08:32:04.563 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 17297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_rz1000.ko 2024-04-17T08:32:04.563 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sch.ko 2024-04-17T08:32:04.563 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 26793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_serverworks.ko 2024-04-17T08:32:04.563 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 27305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sil680.ko 2024-04-17T08:32:04.564 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 22833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sl82c105.ko 2024-04-17T08:32:04.564 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 18041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_triflex.ko 2024-04-17T08:32:04.564 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 35025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_via.ko 2024-04-17T08:32:04.564 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 26337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pdc_adma.ko 2024-04-17T08:32:04.564 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 34889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_inic162x.ko 2024-04-17T08:32:04.564 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 102121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_mv.ko 2024-04-17T08:32:04.564 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 85409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_nv.ko 2024-04-17T08:32:04.564 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 44313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_promise.ko 2024-04-17T08:32:04.564 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 26673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_qstor.ko 2024-04-17T08:32:04.564 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 34025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sil.ko 2024-04-17T08:32:04.564 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 45905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sil24.ko 2024-04-17T08:32:04.565 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sis.ko 2024-04-17T08:32:04.565 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 24257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_svw.ko 2024-04-17T08:32:04.565 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 53353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sx4.ko 2024-04-17T08:32:04.565 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 17273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_uli.ko 2024-04-17T08:32:04.565 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 41049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_via.ko 2024-04-17T08:32:04.565 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 23257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_vsc.ko 2024-04-17T08:32:04.565 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/auxdisplay/ 2024-04-17T08:32:04.565 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 19113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/auxdisplay/ks0108.ko 2024-04-17T08:32:04.565 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/bcma/ 2024-04-17T08:32:04.565 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 163969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/bcma/bcma.ko 2024-04-17T08:32:04.565 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/ 2024-04-17T08:32:04.565 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/aoe/ 2024-04-17T08:32:04.565 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 140865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/aoe/aoe.ko 2024-04-17T08:32:04.565 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/drbd/ 2024-04-17T08:32:04.566 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 1241657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/drbd/drbd.ko 2024-04-17T08:32:04.566 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 203289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/floppy.ko 2024-04-17T08:32:04.566 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/mtip32xx/ 2024-04-17T08:32:04.566 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 115265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-17T08:32:04.566 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 143433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/nbd.ko 2024-04-17T08:32:04.566 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/null_blk/ 2024-04-17T08:32:04.566 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 126617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/null_blk/null_blk.ko 2024-04-17T08:32:04.566 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 119873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/pktcdvd.ko 2024-04-17T08:32:04.566 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 313217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/rbd.ko 2024-04-17T08:32:04.566 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/xen-blkback/ 2024-04-17T08:32:04.566 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 117233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-17T08:32:04.566 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/zram/ 2024-04-17T08:32:04.566 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 70385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/zram/zram.ko 2024-04-17T08:32:04.567 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ 2024-04-17T08:32:04.567 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 35377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/applicom.ko 2024-04-17T08:32:04.567 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hangcheck-timer.ko 2024-04-17T08:32:04.567 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/ 2024-04-17T08:32:04.567 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-17T08:32:04.567 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 21537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-17T08:32:04.567 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-17T08:32:04.567 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/via-rng.ko 2024-04-17T08:32:04.567 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 19273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-17T08:32:04.567 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ 2024-04-17T08:32:04.567 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 37257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-17T08:32:04.567 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 186921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-17T08:32:04.567 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 32521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-17T08:32:04.567 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 179561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-17T08:32:04.568 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 85441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-17T08:32:04.568 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 65313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-17T08:32:04.568 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 43857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/lp.ko 2024-04-17T08:32:04.568 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/mwave/ 2024-04-17T08:32:04.568 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 103409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/mwave/mwave.ko 2024-04-17T08:32:04.568 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 31833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/nvram.ko 2024-04-17T08:32:04.568 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 38977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ppdev.ko 2024-04-17T08:32:04.568 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 59241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tlclk.ko 2024-04-17T08:32:04.568 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/ 2024-04-17T08:32:04.568 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 18889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-17T08:32:04.568 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 18177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-04-17T08:32:04.568 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 29425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-04-17T08:32:04.568 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 39193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-04-17T08:32:04.568 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 34169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-17T08:32:04.568 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 25961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-17T08:32:04.568 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 28497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-04-17T08:32:04.569 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/xillybus/ 2024-04-17T08:32:04.569 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 19225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/xillybus/xillybus_class.ko 2024-04-17T08:32:04.569 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 62545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/xillybus/xillybus_core.ko 2024-04-17T08:32:04.569 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13929 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-04-17T08:32:04.569 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/clk/ 2024-04-17T08:32:04.569 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/clk/clk-palmas.ko 2024-04-17T08:32:04.569 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 57289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/clk/clk-si5351.ko 2024-04-17T08:32:04.569 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/clk/clk-twl6040.ko 2024-04-17T08:32:04.569 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 24129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/clk/clk-wm831x.ko 2024-04-17T08:32:04.569 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/ 2024-04-17T08:32:04.569 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-17T08:32:04.569 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 19185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-17T08:32:04.569 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 28633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-17T08:32:04.569 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ 2024-04-17T08:32:04.569 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ccp/ 2024-04-17T08:32:04.570 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 89257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-17T08:32:04.570 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 333657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ccp/ccp.ko 2024-04-17T08:32:04.570 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/ 2024-04-17T08:32:04.570 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/ 2024-04-17T08:32:04.570 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_common/ 2024-04-17T08:32:04.570 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 751713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-17T08:32:04.607 INFO:teuthology.orchestra.run.smithi196.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g3f60ed14f7c1 2024-04-17T08:32:04.613 INFO:teuthology.orchestra.run.smithi196.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g3f60ed14f7c1 2024-04-17T08:32:04.633 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-04-17T08:32:04.633 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 29497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-17T08:32:04.633 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 23169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/padlock-aes.ko 2024-04-17T08:32:04.634 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 26721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/padlock-sha.ko 2024-04-17T08:32:04.634 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/virtio/ 2024-04-17T08:32:04.634 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 90441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-17T08:32:04.634 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dca/ 2024-04-17T08:32:04.634 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 36105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dca/dca.ko 2024-04-17T08:32:04.634 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/ 2024-04-17T08:32:04.634 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/dw/ 2024-04-17T08:32:04.634 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 18593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-17T08:32:04.634 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/ioat/ 2024-04-17T08:32:04.634 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 146769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-17T08:32:04.634 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/ 2024-04-17T08:32:04.634 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 96145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/amd64_edac.ko 2024-04-17T08:32:04.635 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 41993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/e752x_edac.ko 2024-04-17T08:32:04.635 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 51105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/edac_mce_amd.ko 2024-04-17T08:32:04.635 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 21017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i3000_edac.ko 2024-04-17T08:32:04.635 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i3200_edac.ko 2024-04-17T08:32:04.635 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 26729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i5100_edac.ko 2024-04-17T08:32:04.635 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 29593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i5400_edac.ko 2024-04-17T08:32:04.635 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 28385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i7300_edac.ko 2024-04-17T08:32:04.635 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 64161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i7core_edac.ko 2024-04-17T08:32:04.635 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 21289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i82975x_edac.ko 2024-04-17T08:32:04.635 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 22369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/ie31200_edac.ko 2024-04-17T08:32:04.635 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 68697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/sb_edac.ko 2024-04-17T08:32:04.635 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/x38_edac.ko 2024-04-17T08:32:04.635 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/ 2024-04-17T08:32:04.636 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/extcon-gpio.ko 2024-04-17T08:32:04.636 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 31369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/extcon-max14577.ko 2024-04-17T08:32:04.636 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 35601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/extcon-max77693.ko 2024-04-17T08:32:04.636 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 29273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/extcon-max8997.ko 2024-04-17T08:32:04.636 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 30961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/extcon-palmas.ko 2024-04-17T08:32:04.636 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 27201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/extcon-rt8973a.ko 2024-04-17T08:32:04.636 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 31993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/extcon-sm5502.ko 2024-04-17T08:32:04.636 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/ 2024-04-17T08:32:04.636 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 42953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/dmi-sysfs.ko 2024-04-17T08:32:04.636 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/efi/ 2024-04-17T08:32:04.636 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 19721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/efi/efi-pstore.ko 2024-04-17T08:32:04.636 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 26361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-17T08:32:04.636 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/ 2024-04-17T08:32:04.637 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-adp5520.ko 2024-04-17T08:32:04.637 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 23233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-amd8111.ko 2024-04-17T08:32:04.637 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 17689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-arizona.ko 2024-04-17T08:32:04.637 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-da9052.ko 2024-04-17T08:32:04.637 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-da9055.ko 2024-04-17T08:32:04.637 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 26945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-dln2.ko 2024-04-17T08:32:04.637 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 81073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-f7188x.ko 2024-04-17T08:32:04.637 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 40761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-generic.ko 2024-04-17T08:32:04.637 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 22513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-ich.ko 2024-04-17T08:32:04.637 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-04-17T08:32:04.637 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-kempld.ko 2024-04-17T08:32:04.638 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-lp3943.ko 2024-04-17T08:32:04.638 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-max7300.ko 2024-04-17T08:32:04.638 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-max730x.ko 2024-04-17T08:32:04.638 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 24745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-max732x.ko 2024-04-17T08:32:04.638 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 29945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-04-17T08:32:04.638 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 55505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-pca953x.ko 2024-04-17T08:32:04.638 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 31881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-pcf857x.ko 2024-04-17T08:32:04.638 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-rdc321x.ko 2024-04-17T08:32:04.638 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 24353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-sch.ko 2024-04-17T08:32:04.638 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 23145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-sch311x.ko 2024-04-17T08:32:04.638 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-tps65912.ko 2024-04-17T08:32:04.638 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 25009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-twl4030.ko 2024-04-17T08:32:04.638 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-twl6040.ko 2024-04-17T08:32:04.638 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 24457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-17T08:32:04.639 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 17897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-vx855.ko 2024-04-17T08:32:04.639 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 19129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-wm831x.ko 2024-04-17T08:32:04.639 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-wm8350.ko 2024-04-17T08:32:04.639 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-wm8994.ko 2024-04-17T08:32:04.639 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/ 2024-04-17T08:32:04.639 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-a4tech.ko 2024-04-17T08:32:04.639 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 43553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-apple.ko 2024-04-17T08:32:04.639 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-appleir.ko 2024-04-17T08:32:04.639 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 9393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-aureal.ko 2024-04-17T08:32:04.639 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 17097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-axff.ko 2024-04-17T08:32:04.639 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-belkin.ko 2024-04-17T08:32:04.639 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-cherry.ko 2024-04-17T08:32:04.639 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 19089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-chicony.ko 2024-04-17T08:32:04.640 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 74393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-cp2112.ko 2024-04-17T08:32:04.640 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-cypress.ko 2024-04-17T08:32:04.640 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 18769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-dr.ko 2024-04-17T08:32:04.640 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-elecom.ko 2024-04-17T08:32:04.640 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-elo.ko 2024-04-17T08:32:04.640 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-emsff.ko 2024-04-17T08:32:04.640 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-ezkey.ko 2024-04-17T08:32:04.640 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-gaff.ko 2024-04-17T08:32:04.640 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 10681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-generic.ko 2024-04-17T08:32:04.640 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 19793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-gt683r.ko 2024-04-17T08:32:04.640 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-gyration.ko 2024-04-17T08:32:04.640 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-17T08:32:04.640 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-17T08:32:04.640 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-holtekff.ko 2024-04-17T08:32:04.641 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 22889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-hyperv.ko 2024-04-17T08:32:04.641 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-icade.ko 2024-04-17T08:32:04.641 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 10457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-kensington.ko 2024-04-17T08:32:04.641 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 9529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-keytouch.ko 2024-04-17T08:32:04.641 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 19169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-kye.ko 2024-04-17T08:32:04.641 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-lcpower.ko 2024-04-17T08:32:04.641 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 24961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-led.ko 2024-04-17T08:32:04.641 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 54217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-lenovo.ko 2024-04-17T08:32:04.641 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 37553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-lg-g15.ko 2024-04-17T08:32:04.641 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 68081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-17T08:32:04.641 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 121369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-17T08:32:04.641 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 97953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-logitech.ko 2024-04-17T08:32:04.641 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 36689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-magicmouse.ko 2024-04-17T08:32:04.641 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 25769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-microsoft.ko 2024-04-17T08:32:04.642 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-monterey.ko 2024-04-17T08:32:04.642 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 59001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-multitouch.ko 2024-04-17T08:32:04.642 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 39697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-ntrig.ko 2024-04-17T08:32:04.642 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 9985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-ortek.ko 2024-04-17T08:32:04.642 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 10177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-penmount.ko 2024-04-17T08:32:04.642 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-petalynx.ko 2024-04-17T08:32:04.642 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 91241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-picolcd.ko 2024-04-17T08:32:04.642 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-pl.ko 2024-04-17T08:32:04.642 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-plantronics.ko 2024-04-17T08:32:04.642 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 9417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-primax.ko 2024-04-17T08:32:04.642 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 42889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-rmi.ko 2024-04-17T08:32:04.642 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 25177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-17T08:32:04.642 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-common.ko 2024-04-17T08:32:04.643 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 38865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-17T08:32:04.643 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 36305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-17T08:32:04.643 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 38073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-17T08:32:04.643 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 26097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-17T08:32:04.643 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 35625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-17T08:32:04.643 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-17T08:32:04.643 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 35425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-17T08:32:04.643 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 35561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-17T08:32:04.643 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 23993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-17T08:32:04.643 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 28001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat.ko 2024-04-17T08:32:04.643 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-saitek.ko 2024-04-17T08:32:04.643 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 42305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-samsung.ko 2024-04-17T08:32:04.643 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 43609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-17T08:32:04.643 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sjoy.ko 2024-04-17T08:32:04.643 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 62129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sony.ko 2024-04-17T08:32:04.644 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 9353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-speedlink.ko 2024-04-17T08:32:04.644 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 30017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-steelseries.ko 2024-04-17T08:32:04.644 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sunplus.ko 2024-04-17T08:32:04.644 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 19289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-17T08:32:04.644 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-tivo.ko 2024-04-17T08:32:04.644 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-tmff.ko 2024-04-17T08:32:04.644 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-topseed.ko 2024-04-17T08:32:04.644 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 19273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-twinhan.ko 2024-04-17T08:32:04.644 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 81113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-uclogic.ko 2024-04-17T08:32:04.644 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-waltop.ko 2024-04-17T08:32:04.644 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 184745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-wiimote.ko 2024-04-17T08:32:04.644 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 9185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-xinmo.ko 2024-04-17T08:32:04.644 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-zpff.ko 2024-04-17T08:32:04.644 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 19201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-zydacron.ko 2024-04-17T08:32:04.644 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 319921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid.ko 2024-04-17T08:32:04.645 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 39529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/uhid.ko 2024-04-17T08:32:04.645 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/usbhid/ 2024-04-17T08:32:04.645 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 153633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/usbhid/usbhid.ko 2024-04-17T08:32:04.645 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 22361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/usbhid/usbkbd.ko 2024-04-17T08:32:04.645 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 17457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/usbhid/usbmouse.ko 2024-04-17T08:32:04.645 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 261945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/wacom.ko 2024-04-17T08:32:04.645 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/ 2024-04-17T08:32:04.645 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 75065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/hv_balloon.ko 2024-04-17T08:32:04.645 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 110681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/hv_utils.ko 2024-04-17T08:32:04.645 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 382033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/hv_vmbus.ko 2024-04-17T08:32:04.645 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ 2024-04-17T08:32:04.645 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 77153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/abituguru.ko 2024-04-17T08:32:04.645 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 67009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/abituguru3.ko 2024-04-17T08:32:04.645 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 42249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-17T08:32:04.645 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ad7414.ko 2024-04-17T08:32:04.645 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 22009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ad7418.ko 2024-04-17T08:32:04.646 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 29449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adc128d818.ko 2024-04-17T08:32:04.646 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 38097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1025.ko 2024-04-17T08:32:04.646 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 115057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1026.ko 2024-04-17T08:32:04.646 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 23321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1029.ko 2024-04-17T08:32:04.646 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 55225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1031.ko 2024-04-17T08:32:04.646 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 31441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm9240.ko 2024-04-17T08:32:04.646 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ads7828.ko 2024-04-17T08:32:04.646 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7410.ko 2024-04-17T08:32:04.646 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 26505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7411.ko 2024-04-17T08:32:04.646 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 89025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7462.ko 2024-04-17T08:32:04.646 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 49153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7470.ko 2024-04-17T08:32:04.646 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 81473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7475.ko 2024-04-17T08:32:04.646 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 22913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7x10.ko 2024-04-17T08:32:04.647 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 48177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/amc6821.ko 2024-04-17T08:32:04.647 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 68865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/applesmc.ko 2024-04-17T08:32:04.647 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 60193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/asb100.ko 2024-04-17T08:32:04.647 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 69009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/asc7621.ko 2024-04-17T08:32:04.647 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 47977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-17T08:32:04.647 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/atxp1.ko 2024-04-17T08:32:04.647 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 33641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/coretemp.ko 2024-04-17T08:32:04.647 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 29401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/da9052-hwmon.ko 2024-04-17T08:32:04.647 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 19801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/da9055-hwmon.ko 2024-04-17T08:32:04.647 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 55713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-17T08:32:04.647 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 113201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/dme1737.ko 2024-04-17T08:32:04.647 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 22689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ds1621.ko 2024-04-17T08:32:04.647 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 17489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ds620.ko 2024-04-17T08:32:04.647 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 33665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/emc1403.ko 2024-04-17T08:32:04.647 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 40177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/emc2103.ko 2024-04-17T08:32:04.647 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 34649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/emc6w201.ko 2024-04-17T08:32:04.648 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 78921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/f71805f.ko 2024-04-17T08:32:04.648 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 108961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/f71882fg.ko 2024-04-17T08:32:04.648 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 50697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/f75375s.ko 2024-04-17T08:32:04.648 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 25361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/fam15h_power.ko 2024-04-17T08:32:04.648 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 65769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/fschmd.ko 2024-04-17T08:32:04.648 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 17201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/g760a.ko 2024-04-17T08:32:04.648 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 30585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/g762.ko 2024-04-17T08:32:04.648 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 59761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/gl518sm.ko 2024-04-17T08:32:04.648 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 56313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/gl520sm.ko 2024-04-17T08:32:04.648 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/hih6130.ko 2024-04-17T08:32:04.648 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-17T08:32:04.648 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/i5500_temp.ko 2024-04-17T08:32:04.648 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 27633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/i5k_amb.ko 2024-04-17T08:32:04.648 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 42585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ibmaem.ko 2024-04-17T08:32:04.648 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 24945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ibmpex.ko 2024-04-17T08:32:04.649 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 28409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ina209.ko 2024-04-17T08:32:04.649 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ina2xx.ko 2024-04-17T08:32:04.649 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 156465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/it87.ko 2024-04-17T08:32:04.649 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 23129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/jc42.ko 2024-04-17T08:32:04.649 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 28273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/k10temp.ko 2024-04-17T08:32:04.649 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/k8temp.ko 2024-04-17T08:32:04.649 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 21713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lineage-pem.ko 2024-04-17T08:32:04.649 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 57769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm63.ko 2024-04-17T08:32:04.649 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 19777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm73.ko 2024-04-17T08:32:04.649 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 44121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm75.ko 2024-04-17T08:32:04.649 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 23241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm77.ko 2024-04-17T08:32:04.649 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 41473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm78.ko 2024-04-17T08:32:04.649 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 37049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm80.ko 2024-04-17T08:32:04.649 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm83.ko 2024-04-17T08:32:04.649 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 86497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm85.ko 2024-04-17T08:32:04.650 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 55641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm87.ko 2024-04-17T08:32:04.650 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 42249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm90.ko 2024-04-17T08:32:04.650 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 23385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm92.ko 2024-04-17T08:32:04.650 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 131505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm93.ko 2024-04-17T08:32:04.650 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 40225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm95234.ko 2024-04-17T08:32:04.650 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 19137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm95241.ko 2024-04-17T08:32:04.650 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 21689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm95245.ko 2024-04-17T08:32:04.650 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 26393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc2945.ko 2024-04-17T08:32:04.650 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4151.ko 2024-04-17T08:32:04.650 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 17793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4215.ko 2024-04-17T08:32:04.650 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4222.ko 2024-04-17T08:32:04.650 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 18377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4245.ko 2024-04-17T08:32:04.650 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4260.ko 2024-04-17T08:32:04.650 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 17113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4261.ko 2024-04-17T08:32:04.651 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 36769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max16065.ko 2024-04-17T08:32:04.651 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 21585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max1619.ko 2024-04-17T08:32:04.651 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 28313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max1668.ko 2024-04-17T08:32:04.651 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 22753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max197.ko 2024-04-17T08:32:04.651 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 32505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max6639.ko 2024-04-17T08:32:04.651 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 27305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max6650.ko 2024-04-17T08:32:04.651 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 39729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max6697.ko 2024-04-17T08:32:04.651 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 21513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/mc13783-adc.ko 2024-04-17T08:32:04.651 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/mcp3021.ko 2024-04-17T08:32:04.651 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 17873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-04-17T08:32:04.651 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 56505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct6683.ko 2024-04-17T08:32:04.651 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 141353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct6775-core.ko 2024-04-17T08:32:04.651 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 72737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct6775.ko 2024-04-17T08:32:04.651 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 67841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct7802.ko 2024-04-17T08:32:04.651 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 97777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pc87360.ko 2024-04-17T08:32:04.651 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 61921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pc87427.ko 2024-04-17T08:32:04.652 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 21825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pcf8591.ko 2024-04-17T08:32:04.652 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ 2024-04-17T08:32:04.652 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 24753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-17T08:32:04.652 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 19313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-17T08:32:04.652 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 33265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-17T08:32:04.652 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 10793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-17T08:32:04.652 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 19841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-17T08:32:04.652 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-17T08:32:04.652 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 17585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-17T08:32:04.652 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 101233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-17T08:32:04.652 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 9337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-17T08:32:04.652 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 36177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-17T08:32:04.652 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-17T08:32:04.652 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 24441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-17T08:32:04.652 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/powr1220.ko 2024-04-17T08:32:04.653 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 25433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sch5627.ko 2024-04-17T08:32:04.653 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 32945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sch5636.ko 2024-04-17T08:32:04.653 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 34561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-17T08:32:04.653 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 40849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sht15.ko 2024-04-17T08:32:04.653 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sht21.ko 2024-04-17T08:32:04.653 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 19337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/shtc1.ko 2024-04-17T08:32:04.653 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 48713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sis5595.ko 2024-04-17T08:32:04.653 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 22401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/smsc47b397.ko 2024-04-17T08:32:04.653 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 46473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/smsc47m1.ko 2024-04-17T08:32:04.653 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 44313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/smsc47m192.ko 2024-04-17T08:32:04.653 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 31417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/thmc50.ko 2024-04-17T08:32:04.653 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp102.ko 2024-04-17T08:32:04.653 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp103.ko 2024-04-17T08:32:04.653 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 25185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp401.ko 2024-04-17T08:32:04.653 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 23097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp421.ko 2024-04-17T08:32:04.654 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 23033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/via-cputemp.ko 2024-04-17T08:32:04.654 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 50217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/via686a.ko 2024-04-17T08:32:04.654 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 59665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/vt1211.ko 2024-04-17T08:32:04.654 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 62737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/vt8231.ko 2024-04-17T08:32:04.654 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 71169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83627ehf.ko 2024-04-17T08:32:04.654 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 96577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83627hf.ko 2024-04-17T08:32:04.654 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 85913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83781d.ko 2024-04-17T08:32:04.654 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 75129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83791d.ko 2024-04-17T08:32:04.654 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 83425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83792d.ko 2024-04-17T08:32:04.654 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 116777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83793.ko 2024-04-17T08:32:04.654 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 134441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83795.ko 2024-04-17T08:32:04.654 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83l785ts.ko 2024-04-17T08:32:04.654 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 43385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83l786ng.ko 2024-04-17T08:32:04.654 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-04-17T08:32:04.655 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-04-17T08:32:04.655 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/ 2024-04-17T08:32:04.655 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/algos/ 2024-04-17T08:32:04.655 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 27353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-17T08:32:04.655 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 25273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-17T08:32:04.655 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/ 2024-04-17T08:32:04.655 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 33345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-04-17T08:32:04.655 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 35073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-04-17T08:32:04.655 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 32905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-04-17T08:32:04.655 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 21369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-17T08:32:04.655 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 30361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-17T08:32:04.655 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 19313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-17T08:32:04.655 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 17737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-04-17T08:32:04.655 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 7729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-17T08:32:04.656 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-04-17T08:32:04.656 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 64233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-17T08:32:04.656 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 28161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-17T08:32:04.656 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 24233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-17T08:32:04.656 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 19905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-17T08:32:04.656 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-04-17T08:32:04.656 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-04-17T08:32:04.656 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 76969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-17T08:32:04.656 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 24705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-17T08:32:04.656 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 52937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-17T08:32:04.656 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-04-17T08:32:04.656 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 21305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-17T08:32:04.656 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 25945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-17T08:32:04.657 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 33209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-04-17T08:32:04.657 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 30049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-17T08:32:04.657 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-17T08:32:04.657 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 57217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-17T08:32:04.657 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 17441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-04-17T08:32:04.657 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 21145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-17T08:32:04.657 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-17T08:32:04.657 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 24713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-04-17T08:32:04.657 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 32585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-04-17T08:32:04.657 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 22609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-17T08:32:04.657 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 22825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-04-17T08:32:04.657 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 22649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-17T08:32:04.657 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-17T08:32:04.657 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 29993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-17T08:32:04.658 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 21793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-17T08:32:04.658 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 59193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-04-17T08:32:04.658 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 27849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-mux.ko 2024-04-17T08:32:04.658 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 21873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-smbus.ko 2024-04-17T08:32:04.658 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 29577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-stub.ko 2024-04-17T08:32:04.658 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/muxes/ 2024-04-17T08:32:04.658 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 17649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-04-17T08:32:04.658 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-04-17T08:32:04.658 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 36569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-04-17T08:32:04.658 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ 2024-04-17T08:32:04.658 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ 2024-04-17T08:32:04.658 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 329697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-17T08:32:04.658 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 1119913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_core.ko 2024-04-17T08:32:04.659 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 83905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-17T08:32:04.659 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 408433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-17T08:32:04.659 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 120921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-17T08:32:04.659 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 347217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-17T08:32:04.659 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 84945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-17T08:32:04.659 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/ 2024-04-17T08:32:04.659 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/cxgb4/ 2024-04-17T08:32:04.659 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 590929 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-17T08:32:04.659 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx4/ 2024-04-17T08:32:04.659 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 514641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-17T08:32:04.659 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx5/ 2024-04-17T08:32:04.659 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 911665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-17T08:32:04.659 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mthca/ 2024-04-17T08:32:04.659 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 375545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-17T08:32:04.660 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/ocrdma/ 2024-04-17T08:32:04.660 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 197121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-04-17T08:32:04.660 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/usnic/ 2024-04-17T08:32:04.660 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 212553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-04-17T08:32:04.660 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/ 2024-04-17T08:32:04.660 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/ipoib/ 2024-04-17T08:32:04.660 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 334401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-17T08:32:04.660 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/iser/ 2024-04-17T08:32:04.660 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 120673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-17T08:32:04.660 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/isert/ 2024-04-17T08:32:04.660 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 132585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-17T08:32:04.660 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srp/ 2024-04-17T08:32:04.660 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 157937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-17T08:32:04.660 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srpt/ 2024-04-17T08:32:04.660 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 156673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-17T08:32:04.661 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/ 2024-04-17T08:32:04.661 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/evbug.ko 2024-04-17T08:32:04.661 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 27609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/ff-memless.ko 2024-04-17T08:32:04.661 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/ 2024-04-17T08:32:04.661 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-17T08:32:04.661 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-17T08:32:04.661 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 50713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/gameport.ko 2024-04-17T08:32:04.661 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 49441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/joydev.ko 2024-04-17T08:32:04.661 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/ 2024-04-17T08:32:04.661 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-04-17T08:32:04.661 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-04-17T08:32:04.661 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 35665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-04-17T08:32:04.661 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 28305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-04-17T08:32:04.661 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 45473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-17T08:32:04.662 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 22257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-04-17T08:32:04.662 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 25617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/lkkbd.ko 2024-04-17T08:32:04.662 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 31857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/lm8323.ko 2024-04-17T08:32:04.662 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/lm8333.ko 2024-04-17T08:32:04.662 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 25825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-04-17T08:32:04.662 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 21465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-04-17T08:32:04.662 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 19257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-04-17T08:32:04.662 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 19121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-04-17T08:32:04.662 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/newtonkbd.ko 2024-04-17T08:32:04.662 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-04-17T08:32:04.662 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 17105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/qt1070.ko 2024-04-17T08:32:04.662 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 21561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/qt2160.ko 2024-04-17T08:32:04.662 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 28689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-04-17T08:32:04.663 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/stowaway.ko 2024-04-17T08:32:04.663 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 22337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/sunkbd.ko 2024-04-17T08:32:04.663 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-04-17T08:32:04.663 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 18921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-04-17T08:32:04.663 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 19569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-04-17T08:32:04.663 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/xtkbd.ko 2024-04-17T08:32:04.663 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/matrix-keymap.ko 2024-04-17T08:32:04.663 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/ 2024-04-17T08:32:04.663 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 40617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/appletouch.ko 2024-04-17T08:32:04.663 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 39553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/bcm5974.ko 2024-04-17T08:32:04.663 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 160017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/cyapatp.ko 2024-04-17T08:32:04.663 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 114273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-17T08:32:04.663 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/gpio_mouse.ko 2024-04-17T08:32:04.664 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 428185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/psmouse.ko 2024-04-17T08:32:04.664 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/sermouse.ko 2024-04-17T08:32:04.664 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 27865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-17T08:32:04.664 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 27193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-17T08:32:04.664 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 18809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-17T08:32:04.664 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/rmi4/ 2024-04-17T08:32:04.664 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 140969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-17T08:32:04.664 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/ 2024-04-17T08:32:04.664 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/altera_ps2.ko 2024-04-17T08:32:04.664 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 18865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/arc_ps2.ko 2024-04-17T08:32:04.664 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/ct82c710.ko 2024-04-17T08:32:04.664 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-17T08:32:04.664 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 18393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/parkbd.ko 2024-04-17T08:32:04.664 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/pcips2.ko 2024-04-17T08:32:04.664 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 23777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/ps2mult.ko 2024-04-17T08:32:04.665 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 28905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/serio_raw.ko 2024-04-17T08:32:04.665 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 21721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/serport.ko 2024-04-17T08:32:04.665 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/sparse-keymap.ko 2024-04-17T08:32:04.665 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/ 2024-04-17T08:32:04.665 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-88pm860x.ko 2024-04-17T08:32:04.665 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-adp5520.ko 2024-04-17T08:32:04.665 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 77265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-bd2802.ko 2024-04-17T08:32:04.665 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 31097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-blinkm.ko 2024-04-17T08:32:04.665 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-da903x.ko 2024-04-17T08:32:04.665 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-da9052.ko 2024-04-17T08:32:04.665 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-gpio.ko 2024-04-17T08:32:04.665 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 18721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lm3530.ko 2024-04-17T08:32:04.665 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 36705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lm3533.ko 2024-04-17T08:32:04.665 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 22873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lm355x.ko 2024-04-17T08:32:04.665 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 23833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lm3642.ko 2024-04-17T08:32:04.666 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 18769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lp3944.ko 2024-04-17T08:32:04.666 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lp8788.ko 2024-04-17T08:32:04.666 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 18041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-max8997.ko 2024-04-17T08:32:04.666 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-mc13783.ko 2024-04-17T08:32:04.666 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-menf21bmc.ko 2024-04-17T08:32:04.666 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 25617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-pca9532.ko 2024-04-17T08:32:04.666 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 23809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-pca955x.ko 2024-04-17T08:32:04.666 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 21817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-pca963x.ko 2024-04-17T08:32:04.666 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 38113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-ss4200.ko 2024-04-17T08:32:04.666 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 28337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-tca6507.ko 2024-04-17T08:32:04.666 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 18177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-wm831x-status.ko 2024-04-17T08:32:04.666 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-wm8350.ko 2024-04-17T08:32:04.666 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ 2024-04-17T08:32:04.666 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-17T08:32:04.666 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-17T08:32:04.667 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 10233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-17T08:32:04.667 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 8641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-17T08:32:04.667 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-17T08:32:04.667 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-17T08:32:04.667 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-17T08:32:04.667 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-17T08:32:04.667 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-17T08:32:04.667 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/ 2024-04-17T08:32:04.667 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/bcache/ 2024-04-17T08:32:04.667 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 790753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/bcache/bcache.ko 2024-04-17T08:32:04.667 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 49081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-bio-prison.ko 2024-04-17T08:32:04.667 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 116825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-bufio.ko 2024-04-17T08:32:04.667 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 58281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-cache-smq.ko 2024-04-17T08:32:04.667 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 199041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-cache.ko 2024-04-17T08:32:04.667 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 134945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-crypt.ko 2024-04-17T08:32:04.668 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 28897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-delay.ko 2024-04-17T08:32:04.668 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 67497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-era.ko 2024-04-17T08:32:04.668 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 33017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-flakey.ko 2024-04-17T08:32:04.668 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 50457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-log-userspace.ko 2024-04-17T08:32:04.668 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 41145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-log.ko 2024-04-17T08:32:04.668 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 60977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-mirror.ko 2024-04-17T08:32:04.668 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 97209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-multipath.ko 2024-04-17T08:32:04.668 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 19809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-queue-length.ko 2024-04-17T08:32:04.668 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 85689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-raid.ko 2024-04-17T08:32:04.668 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 44289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-region-hash.ko 2024-04-17T08:32:04.668 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 18993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-round-robin.ko 2024-04-17T08:32:04.668 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-service-time.ko 2024-04-17T08:32:04.668 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 139817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-snapshot.ko 2024-04-17T08:32:04.668 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 22873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-switch.ko 2024-04-17T08:32:04.668 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 234457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-thin-pool.ko 2024-04-17T08:32:04.668 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 66425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-verity.ko 2024-04-17T08:32:04.669 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 9985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-zero.ko 2024-04-17T08:32:04.669 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/persistent-data/ 2024-04-17T08:32:04.669 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 264329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-17T08:32:04.669 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 43137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid0.ko 2024-04-17T08:32:04.669 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 125009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid1.ko 2024-04-17T08:32:04.669 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 157681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid10.ko 2024-04-17T08:32:04.669 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 444665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid456.ko 2024-04-17T08:32:04.669 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/ 2024-04-17T08:32:04.669 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/ 2024-04-17T08:32:04.669 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 214841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptbase.ko 2024-04-17T08:32:04.669 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 77985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptctl.ko 2024-04-17T08:32:04.669 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 54785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptfc.ko 2024-04-17T08:32:04.669 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 44633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptlan.ko 2024-04-17T08:32:04.669 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 150761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptsas.ko 2024-04-17T08:32:04.669 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 97281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptscsih.ko 2024-04-17T08:32:04.670 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 63873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptspi.ko 2024-04-17T08:32:04.670 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/ 2024-04-17T08:32:04.670 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 19977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/88pm800.ko 2024-04-17T08:32:04.670 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/88pm805.ko 2024-04-17T08:32:04.670 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/88pm80x.ko 2024-04-17T08:32:04.670 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/arizona-i2c.ko 2024-04-17T08:32:04.670 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 148633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/arizona.ko 2024-04-17T08:32:04.670 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/bcm590xx.ko 2024-04-17T08:32:04.670 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/cros_ec_dev.ko 2024-04-17T08:32:04.670 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 41009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/dln2.ko 2024-04-17T08:32:04.670 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 18601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/janz-cmodio.ko 2024-04-17T08:32:04.670 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 59089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/kempld-core.ko 2024-04-17T08:32:04.670 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 31897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lm3533-core.ko 2024-04-17T08:32:04.670 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 17889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-04-17T08:32:04.670 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lp3943.ko 2024-04-17T08:32:04.671 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 60497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lpc_ich.ko 2024-04-17T08:32:04.671 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lpc_sch.ko 2024-04-17T08:32:04.671 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 21113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/max8907.ko 2024-04-17T08:32:04.671 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 35537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/mc13xxx-core.ko 2024-04-17T08:32:04.671 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-04-17T08:32:04.671 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/menf21bmc.ko 2024-04-17T08:32:04.671 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/pcf50633-adc.ko 2024-04-17T08:32:04.671 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 10449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/pcf50633-gpio.ko 2024-04-17T08:32:04.671 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 42297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/pcf50633.ko 2024-04-17T08:32:04.671 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-04-17T08:32:04.671 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 22913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/retu-mfd.ko 2024-04-17T08:32:04.671 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 99425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/si476x-core.ko 2024-04-17T08:32:04.671 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 58057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/sm501.ko 2024-04-17T08:32:04.671 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 60681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/tps65010.ko 2024-04-17T08:32:04.671 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/tps6507x.ko 2024-04-17T08:32:04.672 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/viperboard.ko 2024-04-17T08:32:04.672 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/vx855.ko 2024-04-17T08:32:04.672 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 21137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/wl1273-core.ko 2024-04-17T08:32:04.672 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 52361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/wm8994.ko 2024-04-17T08:32:04.672 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ 2024-04-17T08:32:04.672 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-04-17T08:32:04.672 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 64265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ad525x_dpot.ko 2024-04-17T08:32:04.672 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/altera-stapl/ 2024-04-17T08:32:04.672 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 57521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-17T08:32:04.672 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 22201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/apds9802als.ko 2024-04-17T08:32:04.672 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 47689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/apds990x.ko 2024-04-17T08:32:04.672 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 58633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/bh1770glc.ko 2024-04-17T08:32:04.672 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/c2port/ 2024-04-17T08:32:04.672 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-04-17T08:32:04.672 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 47449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/c2port/core.ko 2024-04-17T08:32:04.672 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/cb710/ 2024-04-17T08:32:04.673 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 29721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/cb710/cb710.ko 2024-04-17T08:32:04.673 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ds1682.ko 2024-04-17T08:32:04.673 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 10153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/dummy-irq.ko 2024-04-17T08:32:04.673 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/echo/ 2024-04-17T08:32:04.673 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/echo/echo.ko 2024-04-17T08:32:04.673 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/ 2024-04-17T08:32:04.673 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 43041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/at24.ko 2024-04-17T08:32:04.673 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 18777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-17T08:32:04.673 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/max6875.ko 2024-04-17T08:32:04.673 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 41185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/enclosure.ko 2024-04-17T08:32:04.673 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/genwqe/ 2024-04-17T08:32:04.673 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 191649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-04-17T08:32:04.673 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/hmc6352.ko 2024-04-17T08:32:04.673 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 37761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/hpilo.ko 2024-04-17T08:32:04.673 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ibmasm/ 2024-04-17T08:32:04.674 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 92345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-04-17T08:32:04.674 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 23961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ics932s401.ko 2024-04-17T08:32:04.674 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 26737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/isl29003.ko 2024-04-17T08:32:04.674 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 18617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/isl29020.ko 2024-04-17T08:32:04.674 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/lis3lv02d/ 2024-04-17T08:32:04.674 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 54865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-17T08:32:04.674 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 17825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-17T08:32:04.674 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/ 2024-04-17T08:32:04.674 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 154169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/mei-me.ko 2024-04-17T08:32:04.674 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 69809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/mei-txe.ko 2024-04-17T08:32:04.674 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 389033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/mei.ko 2024-04-17T08:32:04.674 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 37961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/phantom.ko 2024-04-17T08:32:04.674 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ti-st/ 2024-04-17T08:32:04.674 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 91145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ti-st/st_drv.ko 2024-04-17T08:32:04.674 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 28865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/tifm_7xx1.ko 2024-04-17T08:32:04.675 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 34457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/tifm_core.ko 2024-04-17T08:32:04.675 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 22233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/tsl2550.ko 2024-04-17T08:32:04.675 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 55793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/vmw_balloon.ko 2024-04-17T08:32:04.675 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/vmw_vmci/ 2024-04-17T08:32:04.675 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 234905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-17T08:32:04.675 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ 2024-04-17T08:32:04.675 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/bonding/ 2024-04-17T08:32:04.675 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 620961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/bonding/bonding.ko 2024-04-17T08:32:04.675 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/ 2024-04-17T08:32:04.675 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/b53/ 2024-04-17T08:32:04.675 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 139817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-17T08:32:04.675 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 49545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-17T08:32:04.675 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 18921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-17T08:32:04.675 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/mv88e6xxx/ 2024-04-17T08:32:04.675 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 587065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-17T08:32:04.676 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 19553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dummy.ko 2024-04-17T08:32:04.676 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 21369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/eql.ko 2024-04-17T08:32:04.676 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ 2024-04-17T08:32:04.676 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/ 2024-04-17T08:32:04.676 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 53753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-17T08:32:04.676 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 49201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-17T08:32:04.676 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 158649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-17T08:32:04.676 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 85953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-17T08:32:04.676 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/ 2024-04-17T08:32:04.676 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 44161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-17T08:32:04.676 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 73865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-17T08:32:04.676 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 33313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-17T08:32:04.676 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 109521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-17T08:32:04.676 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/adaptec/ 2024-04-17T08:32:04.676 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 64705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-17T08:32:04.677 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/agere/ 2024-04-17T08:32:04.677 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 84329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-17T08:32:04.677 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/alteon/ 2024-04-17T08:32:04.677 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 70737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-17T08:32:04.677 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/altera/ 2024-04-17T08:32:04.677 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 52705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-17T08:32:04.677 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/ 2024-04-17T08:32:04.677 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 65857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-17T08:32:04.677 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 56057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-17T08:32:04.677 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 115881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-17T08:32:04.677 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/ 2024-04-17T08:32:04.677 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/alx/ 2024-04-17T08:32:04.677 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 124497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-17T08:32:04.677 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-04-17T08:32:04.677 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 128409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-17T08:32:04.677 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-04-17T08:32:04.678 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 110345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-17T08:32:04.678 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atlx/ 2024-04-17T08:32:04.678 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 101857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-17T08:32:04.678 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 88953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-17T08:32:04.678 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/ 2024-04-17T08:32:04.678 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 105633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-17T08:32:04.678 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 228985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-17T08:32:04.678 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-04-17T08:32:04.678 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 1733353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-17T08:32:04.678 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 167185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-17T08:32:04.678 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/genet/ 2024-04-17T08:32:04.678 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 161417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-17T08:32:04.678 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 440625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-17T08:32:04.679 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/brocade/ 2024-04-17T08:32:04.679 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/brocade/bna/ 2024-04-17T08:32:04.679 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 432201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-17T08:32:04.679 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/ 2024-04-17T08:32:04.679 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-04-17T08:32:04.679 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 257201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-17T08:32:04.679 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-04-17T08:32:04.679 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 446177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-17T08:32:04.679 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-04-17T08:32:04.679 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 1311433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-17T08:32:04.679 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-04-17T08:32:04.679 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 206689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-17T08:32:04.679 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-04-17T08:32:04.679 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 40161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-17T08:32:04.679 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/cisco/ 2024-04-17T08:32:04.680 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/cisco/enic/ 2024-04-17T08:32:04.680 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 269313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-17T08:32:04.680 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/ 2024-04-17T08:32:04.680 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/ 2024-04-17T08:32:04.680 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 85385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-17T08:32:04.680 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 77457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-17T08:32:04.680 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 169089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-17T08:32:04.680 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 65913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-17T08:32:04.680 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 76209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-17T08:32:04.680 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 38065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-17T08:32:04.680 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dlink/ 2024-04-17T08:32:04.680 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 75945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-17T08:32:04.680 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 78705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-17T08:32:04.680 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 52313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dnet.ko 2024-04-17T08:32:04.680 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 30409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ec_bhf.ko 2024-04-17T08:32:04.681 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/emulex/ 2024-04-17T08:32:04.681 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/emulex/benet/ 2024-04-17T08:32:04.681 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 356377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-17T08:32:04.681 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 61737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ethoc.ko 2024-04-17T08:32:04.681 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 63185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/fealnx.ko 2024-04-17T08:32:04.681 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/fujitsu/ 2024-04-17T08:32:04.681 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 51513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-04-17T08:32:04.681 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ 2024-04-17T08:32:04.681 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 115569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-17T08:32:04.681 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000/ 2024-04-17T08:32:04.681 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 366217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-17T08:32:04.681 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000e/ 2024-04-17T08:32:04.681 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 755793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-17T08:32:04.681 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/fm10k/ 2024-04-17T08:32:04.681 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 324577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-17T08:32:04.682 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/i40e/ 2024-04-17T08:32:04.682 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 1196297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-17T08:32:04.682 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/iavf/ 2024-04-17T08:32:04.682 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 362593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-17T08:32:04.682 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igb/ 2024-04-17T08:32:04.682 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 671801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-17T08:32:04.682 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igbvf/ 2024-04-17T08:32:04.682 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 121537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-17T08:32:04.682 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-04-17T08:32:04.682 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 966705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-17T08:32:04.682 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-04-17T08:32:04.682 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 193585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-17T08:32:04.682 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 108633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/jme.ko 2024-04-17T08:32:04.682 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/ 2024-04-17T08:32:04.682 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 25697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-17T08:32:04.683 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 126881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-17T08:32:04.683 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 150777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-17T08:32:04.683 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/ 2024-04-17T08:32:04.683 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-04-17T08:32:04.683 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 905033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-17T08:32:04.683 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 344145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-17T08:32:04.683 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-04-17T08:32:04.683 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-04-17T08:32:04.683 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 1412417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-17T08:32:04.767 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel/ 2024-04-17T08:32:04.767 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 65913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-04-17T08:32:04.767 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 54497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-04-17T08:32:04.768 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 22417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-04-17T08:32:04.768 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 117353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-17T08:32:04.768 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/myricom/ 2024-04-17T08:32:04.768 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-04-17T08:32:04.768 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 131425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-17T08:32:04.768 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/natsemi/ 2024-04-17T08:32:04.768 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 91465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-17T08:32:04.768 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 56689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-17T08:32:04.768 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/neterion/ 2024-04-17T08:32:04.768 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 181081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-17T08:32:04.768 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/nvidia/ 2024-04-17T08:32:04.768 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 171417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-17T08:32:04.768 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/packetengines/ 2024-04-17T08:32:04.769 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 58249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-17T08:32:04.769 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 50121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-17T08:32:04.769 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/ 2024-04-17T08:32:04.769 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-04-17T08:32:04.769 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 300817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-17T08:32:04.769 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 105689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-17T08:32:04.769 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-04-17T08:32:04.769 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 885129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-17T08:32:04.769 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rdc/ 2024-04-17T08:32:04.769 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 52305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-17T08:32:04.769 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/ 2024-04-17T08:32:04.769 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 81641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-17T08:32:04.770 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 100689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-17T08:32:04.770 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 34073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-17T08:32:04.770 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 264161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-17T08:32:04.770 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/samsung/ 2024-04-17T08:32:04.770 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-04-17T08:32:04.770 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 142449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-04-17T08:32:04.770 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sfc/ 2024-04-17T08:32:04.770 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 1350385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-17T08:32:04.770 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/silan/ 2024-04-17T08:32:04.770 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 57953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-17T08:32:04.770 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sis/ 2024-04-17T08:32:04.770 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 66505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-17T08:32:04.771 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 80065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-17T08:32:04.771 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/ 2024-04-17T08:32:04.771 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 74289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-17T08:32:04.771 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 79457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-17T08:32:04.771 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 100785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-17T08:32:04.771 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 83441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-17T08:32:04.771 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/ 2024-04-17T08:32:04.771 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-04-17T08:32:04.771 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-04-17T08:32:04.771 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 46985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-17T08:32:04.771 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 23345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-04-17T08:32:04.771 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 644537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-17T08:32:04.771 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/ 2024-04-17T08:32:04.771 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 128497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-17T08:32:04.772 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 207993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-17T08:32:04.772 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 82633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-17T08:32:04.772 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 91353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-17T08:32:04.772 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/tehuti/ 2024-04-17T08:32:04.772 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 59865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-17T08:32:04.772 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ti/ 2024-04-17T08:32:04.772 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 110729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-17T08:32:04.772 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/via/ 2024-04-17T08:32:04.772 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 98689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-17T08:32:04.772 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 102513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-17T08:32:04.772 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/wiznet/ 2024-04-17T08:32:04.772 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 61497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-17T08:32:04.772 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 40609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-17T08:32:04.773 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/xircom/ 2024-04-17T08:32:04.773 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 69913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-17T08:32:04.773 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/fddi/ 2024-04-17T08:32:04.773 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 49449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/fddi/defxx.ko 2024-04-17T08:32:04.773 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/fddi/skfp/ 2024-04-17T08:32:04.773 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 275801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/fddi/skfp/skfp.ko 2024-04-17T08:32:04.773 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 91105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/geneve.ko 2024-04-17T08:32:04.773 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/hyperv/ 2024-04-17T08:32:04.773 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 290441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-17T08:32:04.773 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ieee802154/ 2024-04-17T08:32:04.773 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 21409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-17T08:32:04.773 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 30001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ifb.ko 2024-04-17T08:32:04.773 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ipvlan/ 2024-04-17T08:32:04.773 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 108329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-17T08:32:04.774 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 78065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/macvlan.ko 2024-04-17T08:32:04.774 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 19273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/macvtap.ko 2024-04-17T08:32:04.774 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/ 2024-04-17T08:32:04.774 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 26105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-17T08:32:04.774 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 18209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-17T08:32:04.774 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-gpio.ko 2024-04-17T08:32:04.774 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 10025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-17T08:32:04.774 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio.ko 2024-04-17T08:32:04.774 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 26417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mii.ko 2024-04-17T08:32:04.774 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 62681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/netconsole.ko 2024-04-17T08:32:04.774 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/nlmon.ko 2024-04-17T08:32:04.774 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/pcs/ 2024-04-17T08:32:04.774 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-17T08:32:04.775 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 48313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-17T08:32:04.775 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/ 2024-04-17T08:32:04.775 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/amd.ko 2024-04-17T08:32:04.775 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 61985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-17T08:32:04.775 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 52865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-17T08:32:04.775 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm87xx.ko 2024-04-17T08:32:04.775 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 53409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/broadcom.ko 2024-04-17T08:32:04.775 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/cicada.ko 2024-04-17T08:32:04.775 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/davicom.ko 2024-04-17T08:32:04.775 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 10753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/et1011c.ko 2024-04-17T08:32:04.775 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 31313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/icplus.ko 2024-04-17T08:32:04.775 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 19177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/lxt.ko 2024-04-17T08:32:04.775 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 103377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/marvell.ko 2024-04-17T08:32:04.776 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 96025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/micrel.ko 2024-04-17T08:32:04.776 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/national.ko 2024-04-17T08:32:04.776 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 121105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/phylink.ko 2024-04-17T08:32:04.776 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/qsemi.ko 2024-04-17T08:32:04.776 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 62113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/realtek.ko 2024-04-17T08:32:04.776 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 35513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/smsc.ko 2024-04-17T08:32:04.776 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/ste10Xp.ko 2024-04-17T08:32:04.776 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 29217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/vitesse.ko 2024-04-17T08:32:04.776 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/plip/ 2024-04-17T08:32:04.776 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 55353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/plip/plip.ko 2024-04-17T08:32:04.776 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ 2024-04-17T08:32:04.776 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 19361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-17T08:32:04.776 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 36273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_async.ko 2024-04-17T08:32:04.777 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 21529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-17T08:32:04.777 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 23105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-17T08:32:04.777 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 35369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-17T08:32:04.777 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 53233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/pppoe.ko 2024-04-17T08:32:04.777 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/pppox.ko 2024-04-17T08:32:04.777 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 40081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/pptp.ko 2024-04-17T08:32:04.777 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 35937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/sb1000.ko 2024-04-17T08:32:04.777 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/slip/ 2024-04-17T08:32:04.777 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 52073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/slip/slip.ko 2024-04-17T08:32:04.777 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 42409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/sungem_phy.ko 2024-04-17T08:32:04.777 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 80161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/tap.ko 2024-04-17T08:32:04.777 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/ 2024-04-17T08:32:04.777 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 137321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team.ko 2024-04-17T08:32:04.777 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-17T08:32:04.778 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-17T08:32:04.778 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 36209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-17T08:32:04.778 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 10841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_random.ko 2024-04-17T08:32:04.778 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 10473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-17T08:32:04.778 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 108089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/veth.ko 2024-04-17T08:32:04.778 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vmxnet3/ 2024-04-17T08:32:04.778 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 176497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-17T08:32:04.778 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vxlan/ 2024-04-17T08:32:04.778 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 383593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vxlan/vxlan.ko 2024-04-17T08:32:04.778 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/xen-netback/ 2024-04-17T08:32:04.778 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 175537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-17T08:32:04.778 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ntb/ 2024-04-17T08:32:04.778 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 25489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ntb/ntb.ko 2024-04-17T08:32:04.778 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/ 2024-04-17T08:32:04.779 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/host/ 2024-04-17T08:32:04.779 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 335857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/host/nvme-core.ko 2024-04-17T08:32:04.779 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 126553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/host/nvme.ko 2024-04-17T08:32:04.779 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/ 2024-04-17T08:32:04.779 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 168145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport.ko 2024-04-17T08:32:04.779 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport_cs.ko 2024-04-17T08:32:04.779 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 103889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport_pc.ko 2024-04-17T08:32:04.779 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 30313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport_serial.ko 2024-04-17T08:32:04.779 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/ 2024-04-17T08:32:04.779 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/hotplug/ 2024-04-17T08:32:04.779 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 28489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-17T08:32:04.779 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-04-17T08:32:04.779 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 23889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-04-17T08:32:04.779 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/pci-stub.ko 2024-04-17T08:32:04.780 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 55329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/xen-pcifront.ko 2024-04-17T08:32:04.780 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/ 2024-04-17T08:32:04.780 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 31529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/i82092.ko 2024-04-17T08:32:04.780 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 179961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/pcmcia.ko 2024-04-17T08:32:04.780 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 78161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/pcmcia_core.ko 2024-04-17T08:32:04.780 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 41945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-04-17T08:32:04.780 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 40457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/pd6729.ko 2024-04-17T08:32:04.780 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 133753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-17T08:32:04.780 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/phy/ 2024-04-17T08:32:04.780 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/phy/broadcom/ 2024-04-17T08:32:04.780 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-04-17T08:32:04.780 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/phy/samsung/ 2024-04-17T08:32:04.780 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 9481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-04-17T08:32:04.781 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pinctrl/ 2024-04-17T08:32:04.781 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pinctrl/intel/ 2024-04-17T08:32:04.781 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 78193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-17T08:32:04.781 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/ 2024-04-17T08:32:04.781 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/ 2024-04-17T08:32:04.781 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 61041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-04-17T08:32:04.781 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 29657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/cros_ec.ko 2024-04-17T08:32:04.781 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 25521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-04-17T08:32:04.781 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 30217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-04-17T08:32:04.781 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 31801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-04-17T08:32:04.781 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 21721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-04-17T08:32:04.781 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-04-17T08:32:04.781 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/ 2024-04-17T08:32:04.781 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 87481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-17T08:32:04.781 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 44105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/acerhdf.ko 2024-04-17T08:32:04.782 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 48257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-17T08:32:04.782 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 73865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-17T08:32:04.782 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 33321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-17T08:32:04.782 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 164769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-17T08:32:04.782 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 46185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-17T08:32:04.782 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 62073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-17T08:32:04.782 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-17T08:32:04.782 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 51881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-17T08:32:04.782 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 25889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-17T08:32:04.782 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 42761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/hdaps.ko 2024-04-17T08:32:04.782 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 22905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/ibm_rtl.ko 2024-04-17T08:32:04.783 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel/ 2024-04-17T08:32:04.783 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-17T08:32:04.783 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 10033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-04-17T08:32:04.783 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 54001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel_ips.ko 2024-04-17T08:32:04.783 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 22913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-17T08:32:04.783 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-17T08:32:04.783 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 43753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-17T08:32:04.783 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 51897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-17T08:32:04.783 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-17T08:32:04.783 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-17T08:32:04.783 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-17T08:32:04.783 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-17T08:32:04.783 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-17T08:32:04.783 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 61417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/wmi.ko 2024-04-17T08:32:04.784 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/ 2024-04-17T08:32:04.784 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/ 2024-04-17T08:32:04.784 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 36513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/88pm860x_battery.ko 2024-04-17T08:32:04.784 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 40425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/88pm860x_charger.ko 2024-04-17T08:32:04.784 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 68833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/bq2415x_charger.ko 2024-04-17T08:32:04.784 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 73073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/bq24190_charger.ko 2024-04-17T08:32:04.784 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 25953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/bq24735-charger.ko 2024-04-17T08:32:04.784 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-04-17T08:32:04.784 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 23233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/da9030_battery.ko 2024-04-17T08:32:04.784 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 23297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/da9052-battery.ko 2024-04-17T08:32:04.784 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 34489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/ds2760_battery.ko 2024-04-17T08:32:04.784 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 28641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/ds2780_battery.ko 2024-04-17T08:32:04.784 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 28809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/ds2781_battery.ko 2024-04-17T08:32:04.785 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 28657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/ds2782_battery.ko 2024-04-17T08:32:04.785 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 24217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/gpio-charger.ko 2024-04-17T08:32:04.785 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 23225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/isp1704_charger.ko 2024-04-17T08:32:04.785 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 24121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/lp8727_charger.ko 2024-04-17T08:32:04.785 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/max14577_charger.ko 2024-04-17T08:32:04.785 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 37833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/max17042_battery.ko 2024-04-17T08:32:04.785 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 22017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/max8903_charger.ko 2024-04-17T08:32:04.785 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 27689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/max8925_power.ko 2024-04-17T08:32:04.785 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 25833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/pcf50633-charger.ko 2024-04-17T08:32:04.785 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 44841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/sbs-battery.ko 2024-04-17T08:32:04.785 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 34905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/test_power.ko 2024-04-17T08:32:04.785 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 21585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/tps65090-charger.ko 2024-04-17T08:32:04.785 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/wm831x_backup.ko 2024-04-17T08:32:04.785 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 29081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/wm831x_power.ko 2024-04-17T08:32:04.785 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 27441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/wm8350_power.ko 2024-04-17T08:32:04.786 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/powercap/ 2024-04-17T08:32:04.786 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 73297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-17T08:32:04.786 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-17T08:32:04.786 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/ 2024-04-17T08:32:04.786 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/ 2024-04-17T08:32:04.786 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 17913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-17T08:32:04.786 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-17T08:32:04.786 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 18985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/pps_parport.ko 2024-04-17T08:32:04.786 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 49817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/pps_core.ko 2024-04-17T08:32:04.786 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ptp/ 2024-04-17T08:32:04.786 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 91393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ptp/ptp.ko 2024-04-17T08:32:04.786 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 21945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ptp/ptp_kvm.ko 2024-04-17T08:32:04.786 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/ 2024-04-17T08:32:04.786 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/ 2024-04-17T08:32:04.786 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/atl/ 2024-04-17T08:32:04.787 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 67513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-17T08:32:04.787 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 47137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/fmpm.ko 2024-04-17T08:32:04.787 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/ 2024-04-17T08:32:04.787 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 27593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-88pm80x.ko 2024-04-17T08:32:04.787 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 28969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-88pm860x.ko 2024-04-17T08:32:04.787 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 18457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-17T08:32:04.787 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 24721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-da9052.ko 2024-04-17T08:32:04.787 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 22569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-da9055.ko 2024-04-17T08:32:04.787 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 24337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-da9063.ko 2024-04-17T08:32:04.787 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 19729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-17T08:32:04.787 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 82225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-17T08:32:04.787 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 24481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-17T08:32:04.787 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 21993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-17T08:32:04.788 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-17T08:32:04.788 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-17T08:32:04.788 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-17T08:32:04.788 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 18025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-17T08:32:04.788 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 29017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-17T08:32:04.788 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-em3027.ko 2024-04-17T08:32:04.788 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 28665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-17T08:32:04.788 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 24097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-17T08:32:04.788 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 44129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-17T08:32:04.788 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 17145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-lp8788.ko 2024-04-17T08:32:04.788 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 46913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-17T08:32:04.788 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-17T08:32:04.788 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 33969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-17T08:32:04.788 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 17337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m48t86.ko 2024-04-17T08:32:04.788 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-max6900.ko 2024-04-17T08:32:04.789 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 17921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-max8907.ko 2024-04-17T08:32:04.789 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 18521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-max8925.ko 2024-04-17T08:32:04.789 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 31337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-max8997.ko 2024-04-17T08:32:04.789 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-max8998.ko 2024-04-17T08:32:04.789 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 22409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-04-17T08:32:04.789 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-17T08:32:04.789 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 24329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-palmas.ko 2024-04-17T08:32:04.789 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 56777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-17T08:32:04.789 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 21601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf50633.ko 2024-04-17T08:32:04.789 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 32657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-17T08:32:04.789 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 28289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-17T08:32:04.789 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 36065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-17T08:32:04.789 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-17T08:32:04.789 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 21921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rc5t583.ko 2024-04-17T08:32:04.790 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-17T08:32:04.790 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 40081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-17T08:32:04.790 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 34529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-17T08:32:04.790 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 29977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-17T08:32:04.790 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 22865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-17T08:32:04.790 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 26185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-s35390a.ko 2024-04-17T08:32:04.790 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-17T08:32:04.790 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 21697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-tps6586x.ko 2024-04-17T08:32:04.790 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 25993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-tps65910.ko 2024-04-17T08:32:04.790 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 24801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-wm831x.ko 2024-04-17T08:32:04.790 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 25801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-wm8350.ko 2024-04-17T08:32:04.790 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 33409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-x1205.ko 2024-04-17T08:32:04.790 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ 2024-04-17T08:32:04.790 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 90377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/3w-9xxx.ko 2024-04-17T08:32:04.790 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 69593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/3w-sas.ko 2024-04-17T08:32:04.791 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 65945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/3w-xxxx.ko 2024-04-17T08:32:04.791 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 164569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/BusLogic.ko 2024-04-17T08:32:04.791 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 31617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/a100u2w.ko 2024-04-17T08:32:04.791 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aacraid/ 2024-04-17T08:32:04.791 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 340721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-17T08:32:04.791 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 120337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/advansys.ko 2024-04-17T08:32:04.791 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic7xxx/ 2024-04-17T08:32:04.791 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 468081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-17T08:32:04.791 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 380673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-17T08:32:04.791 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic94xx/ 2024-04-17T08:32:04.791 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 243705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-04-17T08:32:04.791 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 28841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/am53c974.ko 2024-04-17T08:32:04.791 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/arcmsr/ 2024-04-17T08:32:04.791 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 135617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-17T08:32:04.791 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 44289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/atp870u.ko 2024-04-17T08:32:04.791 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/be2iscsi/ 2024-04-17T08:32:04.792 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 304993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-17T08:32:04.792 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bfa/ 2024-04-17T08:32:04.792 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 1527113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bfa/bfa.ko 2024-04-17T08:32:04.792 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2fc/ 2024-04-17T08:32:04.792 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 297801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-17T08:32:04.792 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2i/ 2024-04-17T08:32:04.792 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 144401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-17T08:32:04.792 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 47457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ch.ko 2024-04-17T08:32:04.792 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/csiostor/ 2024-04-17T08:32:04.792 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 390713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-17T08:32:04.792 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/ 2024-04-17T08:32:04.792 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-04-17T08:32:04.792 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 88881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-17T08:32:04.792 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-04-17T08:32:04.792 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 117481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-17T08:32:04.793 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 173017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-17T08:32:04.793 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 91569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/dc395x.ko 2024-04-17T08:32:04.793 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 45401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/dmx3191d.ko 2024-04-17T08:32:04.793 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/esas2r/ 2024-04-17T08:32:04.793 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 267577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-17T08:32:04.793 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 78969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/esp_scsi.ko 2024-04-17T08:32:04.793 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fcoe/ 2024-04-17T08:32:04.793 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 95329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-17T08:32:04.793 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 194017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-17T08:32:04.793 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 22617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fdomain.ko 2024-04-17T08:32:04.793 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fnic/ 2024-04-17T08:32:04.793 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 366529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fnic/fnic.ko 2024-04-17T08:32:04.793 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 251505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/hpsa.ko 2024-04-17T08:32:04.793 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 65761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/hptiop.ko 2024-04-17T08:32:04.793 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 57097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/hv_storvsc.ko 2024-04-17T08:32:04.794 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 44689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/imm.ko 2024-04-17T08:32:04.794 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 55153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/initio.ko 2024-04-17T08:32:04.794 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 327841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ipr.ko 2024-04-17T08:32:04.794 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 129785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ips.ko 2024-04-17T08:32:04.794 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/isci/ 2024-04-17T08:32:04.794 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 397785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/isci/isci.ko 2024-04-17T08:32:04.794 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 32017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-17T08:32:04.794 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 63121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-17T08:32:04.794 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libfc/ 2024-04-17T08:32:04.794 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 386849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libfc/libfc.ko 2024-04-17T08:32:04.794 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 178177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libiscsi.ko 2024-04-17T08:32:04.794 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 64809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-17T08:32:04.794 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libsas/ 2024-04-17T08:32:04.794 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 274009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libsas/libsas.ko 2024-04-17T08:32:04.794 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/lpfc/ 2024-04-17T08:32:04.795 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 2736001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-17T08:32:04.795 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/ 2024-04-17T08:32:04.795 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 88529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-17T08:32:04.795 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 40145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-17T08:32:04.795 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 389177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-17T08:32:04.795 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 104769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid.ko 2024-04-17T08:32:04.795 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mpt3sas/ 2024-04-17T08:32:04.795 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 836945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-17T08:32:04.795 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mvsas/ 2024-04-17T08:32:04.795 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 158729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-17T08:32:04.795 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 96537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mvumi.ko 2024-04-17T08:32:04.795 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pcmcia/ 2024-04-17T08:32:04.795 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 101625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-04-17T08:32:04.795 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-04-17T08:32:04.795 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 23153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-04-17T08:32:04.796 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 28265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-04-17T08:32:04.796 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pm8001/ 2024-04-17T08:32:04.796 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 443745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-17T08:32:04.796 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 152033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pmcraid.ko 2024-04-17T08:32:04.796 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 41625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ppa.ko 2024-04-17T08:32:04.796 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 66977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla1280.ko 2024-04-17T08:32:04.796 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla2xxx/ 2024-04-17T08:32:04.796 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 2324809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-17T08:32:04.796 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 103601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-17T08:32:04.796 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla4xxx/ 2024-04-17T08:32:04.796 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 697337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-17T08:32:04.796 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 23801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qlogicfas408.ko 2024-04-17T08:32:04.796 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 18993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/raid_class.ko 2024-04-17T08:32:04.796 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 322865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_debug.ko 2024-04-17T08:32:04.796 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 219857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-17T08:32:04.797 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 357153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-17T08:32:04.797 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 121185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-17T08:32:04.797 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 93481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-17T08:32:04.797 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 55401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-17T08:32:04.797 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 33009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ses.ko 2024-04-17T08:32:04.797 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 138121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/st.ko 2024-04-17T08:32:04.797 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 57401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/stex.ko 2024-04-17T08:32:04.797 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/sym53c8xx_2/ 2024-04-17T08:32:04.797 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 205025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-17T08:32:04.797 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 55425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/virtio_scsi.ko 2024-04-17T08:32:04.797 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 59185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-17T08:32:04.797 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 48777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/wd719x.ko 2024-04-17T08:32:04.797 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 59417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/xen-scsifront.ko 2024-04-17T08:32:04.797 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ssb/ 2024-04-17T08:32:04.797 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 174913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ssb/ssb.ko 2024-04-17T08:32:04.797 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/ 2024-04-17T08:32:04.798 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/iscsi/ 2024-04-17T08:32:04.798 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 920169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-17T08:32:04.798 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/loopback/ 2024-04-17T08:32:04.798 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 60321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-17T08:32:04.798 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 48129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_file.ko 2024-04-17T08:32:04.798 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 54233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_iblock.ko 2024-04-17T08:32:04.798 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 1170033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_mod.ko 2024-04-17T08:32:04.798 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 51897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_pscsi.ko 2024-04-17T08:32:04.798 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 149721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_user.ko 2024-04-17T08:32:04.798 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/tcm_fc/ 2024-04-17T08:32:04.798 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 90057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-17T08:32:04.798 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/ 2024-04-17T08:32:04.798 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/ 2024-04-17T08:32:04.798 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/ 2024-04-17T08:32:04.798 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 28121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-17T08:32:04.799 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 35209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-17T08:32:04.799 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-17T08:32:04.799 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-17T08:32:04.799 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 17385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-17T08:32:04.799 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 18993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-17T08:32:04.799 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 36729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-17T08:32:04.799 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 26289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-17T08:32:04.799 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-17T08:32:04.799 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12929 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-17T08:32:04.799 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-17T08:32:04.799 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-17T08:32:04.799 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 46065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-17T08:32:04.799 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 17673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-17T08:32:04.799 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-17T08:32:04.799 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 35913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-04-17T08:32:04.800 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 21665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-17T08:32:04.800 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-17T08:32:04.800 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 30577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-17T08:32:04.800 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/ 2024-04-17T08:32:04.800 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/ipwireless/ 2024-04-17T08:32:04.800 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 99313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-17T08:32:04.800 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 69729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/moxa.ko 2024-04-17T08:32:04.800 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 61649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/mxser.ko 2024-04-17T08:32:04.800 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 134401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/n_gsm.ko 2024-04-17T08:32:04.800 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 37905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/n_hdlc.ko 2024-04-17T08:32:04.800 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 78969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/nozomi.ko 2024-04-17T08:32:04.800 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/ 2024-04-17T08:32:04.800 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/8250/ 2024-04-17T08:32:04.800 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 44057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-04-17T08:32:04.800 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 65121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-17T08:32:04.801 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 23121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-04-17T08:32:04.801 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 28161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/altera_uart.ko 2024-04-17T08:32:04.801 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 10673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/arc_uart.ko 2024-04-17T08:32:04.801 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 91665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-04-17T08:32:04.801 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/jsm/ 2024-04-17T08:32:04.801 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 120577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-17T08:32:04.801 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 35161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/rp2.ko 2024-04-17T08:32:04.801 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 65641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/sc16is7xx.ko 2024-04-17T08:32:04.801 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/ 2024-04-17T08:32:04.801 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/core/ 2024-04-17T08:32:04.801 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 693081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-17T08:32:04.801 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/host/ 2024-04-17T08:32:04.801 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 34449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-17T08:32:04.801 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-04-17T08:32:04.801 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/ 2024-04-17T08:32:04.802 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 55617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio.ko 2024-04-17T08:32:04.802 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_aec.ko 2024-04-17T08:32:04.802 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_cif.ko 2024-04-17T08:32:04.802 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_dmem_genirq.ko 2024-04-17T08:32:04.802 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_mf624.ko 2024-04-17T08:32:04.802 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_netx.ko 2024-04-17T08:32:04.802 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_pci_generic.ko 2024-04-17T08:32:04.802 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 18633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-04-17T08:32:04.802 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_sercos3.ko 2024-04-17T08:32:04.802 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/ 2024-04-17T08:32:04.802 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/c67x00/ 2024-04-17T08:32:04.802 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 90321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/c67x00/c67x00.ko 2024-04-17T08:32:04.802 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/chipidea/ 2024-04-17T08:32:04.802 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 189209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-04-17T08:32:04.802 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 21529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-04-17T08:32:04.803 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-04-17T08:32:04.803 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-04-17T08:32:04.803 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-04-17T08:32:04.803 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/ 2024-04-17T08:32:04.803 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 101545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/cdc-acm.ko 2024-04-17T08:32:04.803 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 63073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-17T08:32:04.803 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 56721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/usblp.ko 2024-04-17T08:32:04.803 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 107417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/usbtmc.ko 2024-04-17T08:32:04.803 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/common/ 2024-04-17T08:32:04.803 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 29353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/common/ulpi.ko 2024-04-17T08:32:04.803 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/dwc2/ 2024-04-17T08:32:04.803 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-04-17T08:32:04.803 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/dwc3/ 2024-04-17T08:32:04.803 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-04-17T08:32:04.803 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 33465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-04-17T08:32:04.804 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 574593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/dwc3/dwc3.ko 2024-04-17T08:32:04.804 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/ 2024-04-17T08:32:04.804 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/ 2024-04-17T08:32:04.804 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 72249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/u_ether.ko 2024-04-17T08:32:04.804 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 61953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/u_serial.ko 2024-04-17T08:32:04.804 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 33721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-04-17T08:32:04.804 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 49737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-04-17T08:32:04.804 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 33041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-04-17T08:32:04.804 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 43553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-04-17T08:32:04.804 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 131345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-04-17T08:32:04.804 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 62321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-04-17T08:32:04.804 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 146617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-04-17T08:32:04.804 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 70689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-04-17T08:32:04.804 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 25705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-04-17T08:32:04.804 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 37649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-04-17T08:32:04.804 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 70017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-04-17T08:32:04.805 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 101249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-04-17T08:32:04.805 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 22425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-04-17T08:32:04.805 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 71257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-04-17T08:32:04.805 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 84937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-04-17T08:32:04.805 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/ 2024-04-17T08:32:04.805 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 23441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-04-17T08:32:04.805 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-04-17T08:32:04.805 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-04-17T08:32:04.805 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 24497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-04-17T08:32:04.805 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 33041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-04-17T08:32:04.805 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 21609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-04-17T08:32:04.805 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 22385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-04-17T08:32:04.805 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 18913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-04-17T08:32:04.805 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 35689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-04-17T08:32:04.806 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 18521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-04-17T08:32:04.806 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 21705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-04-17T08:32:04.806 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 30345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-04-17T08:32:04.806 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 78073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-04-17T08:32:04.806 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 17505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-04-17T08:32:04.806 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 204049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/libcomposite.ko 2024-04-17T08:32:04.806 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/ 2024-04-17T08:32:04.806 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 19569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-04-17T08:32:04.806 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/bdc/ 2024-04-17T08:32:04.806 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 182561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-04-17T08:32:04.806 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 45545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-04-17T08:32:04.806 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 66513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-04-17T08:32:04.806 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 85217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-04-17T08:32:04.806 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 69313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-04-17T08:32:04.807 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 90313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/net2272.ko 2024-04-17T08:32:04.807 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 90361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/net2280.ko 2024-04-17T08:32:04.807 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 94841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-04-17T08:32:04.807 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 80521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-04-17T08:32:04.807 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 87465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-04-17T08:32:04.807 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 95441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-04-17T08:32:04.807 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 195969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-04-17T08:32:04.807 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/ 2024-04-17T08:32:04.807 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/bcma-hcd.ko 2024-04-17T08:32:04.807 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 108321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/isp116x-hcd.ko 2024-04-17T08:32:04.807 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 104377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-04-17T08:32:04.807 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 102273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-04-17T08:32:04.807 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 60105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-17T08:32:04.807 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 17505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/sl811_cs.ko 2024-04-17T08:32:04.807 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/ssb-hcd.ko 2024-04-17T08:32:04.807 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 32553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-04-17T08:32:04.808 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/image/ 2024-04-17T08:32:04.808 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 40409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/image/mdc800.ko 2024-04-17T08:32:04.808 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 25113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/image/microtek.ko 2024-04-17T08:32:04.808 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/ 2024-04-17T08:32:04.808 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 47353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/adutux.ko 2024-04-17T08:32:04.808 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 23825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/appledisplay.ko 2024-04-17T08:32:04.808 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-04-17T08:32:04.808 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 26673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/cytherm.ko 2024-04-17T08:32:04.808 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/ehset.ko 2024-04-17T08:32:04.808 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 17873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/emi26.ko 2024-04-17T08:32:04.808 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 18881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/emi62.ko 2024-04-17T08:32:04.808 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/ezusb.ko 2024-04-17T08:32:04.808 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 22241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/idmouse.ko 2024-04-17T08:32:04.808 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 42729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/iowarrior.ko 2024-04-17T08:32:04.808 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-17T08:32:04.808 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 42241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/ldusb.ko 2024-04-17T08:32:04.809 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 42233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/legousbtower.ko 2024-04-17T08:32:04.809 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 33641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/lvstest.ko 2024-04-17T08:32:04.809 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/sisusbvga/ 2024-04-17T08:32:04.809 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 85313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-17T08:32:04.809 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-17T08:32:04.809 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 24593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usb3503.ko 2024-04-17T08:32:04.809 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 29625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usblcd.ko 2024-04-17T08:32:04.809 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 27809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-17T08:32:04.809 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 84265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usbtest.ko 2024-04-17T08:32:04.809 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 52065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/uss720.ko 2024-04-17T08:32:04.809 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 32345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/yurex.ko 2024-04-17T08:32:04.809 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/mon/ 2024-04-17T08:32:04.809 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 91529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/mon/usbmon.ko 2024-04-17T08:32:04.809 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/musb/ 2024-04-17T08:32:04.809 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 396209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/musb/musb_hdrc.ko 2024-04-17T08:32:04.810 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy/ 2024-04-17T08:32:04.810 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 25497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy/phy-generic.ko 2024-04-17T08:32:04.810 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 23697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-04-17T08:32:04.810 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy/phy-isp1301.ko 2024-04-17T08:32:04.810 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 26361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy/phy-tahvo.ko 2024-04-17T08:32:04.810 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ 2024-04-17T08:32:04.810 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/aircable.ko 2024-04-17T08:32:04.810 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 38209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ark3116.ko 2024-04-17T08:32:04.810 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 30681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-17T08:32:04.810 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 44329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ch341.ko 2024-04-17T08:32:04.810 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 79681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/cp210x.ko 2024-04-17T08:32:04.810 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 35137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/cyberjack.ko 2024-04-17T08:32:04.810 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 66873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-17T08:32:04.810 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 58329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-17T08:32:04.811 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 10625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/empeg.ko 2024-04-17T08:32:04.811 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 53009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/f81232.ko 2024-04-17T08:32:04.811 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 188609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-17T08:32:04.811 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 61489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-17T08:32:04.811 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 152305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-17T08:32:04.811 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 142833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/io_ti.ko 2024-04-17T08:32:04.811 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 69217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ipaq.ko 2024-04-17T08:32:04.811 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 21425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ipw.ko 2024-04-17T08:32:04.811 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 29769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ir-usb.ko 2024-04-17T08:32:04.811 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 66361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-17T08:32:04.811 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 122329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/keyspan.ko 2024-04-17T08:32:04.811 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 41297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-17T08:32:04.811 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 29465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-17T08:32:04.811 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 38049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-17T08:32:04.811 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 38041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mct_u232.ko 2024-04-17T08:32:04.811 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 25569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/metro-usb.ko 2024-04-17T08:32:04.812 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 79681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mos7720.ko 2024-04-17T08:32:04.812 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 89969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mos7840.ko 2024-04-17T08:32:04.812 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 65073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mxuport.ko 2024-04-17T08:32:04.812 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/navman.ko 2024-04-17T08:32:04.812 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/omninet.ko 2024-04-17T08:32:04.812 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 28881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/opticon.ko 2024-04-17T08:32:04.812 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 193857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/option.ko 2024-04-17T08:32:04.812 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 45337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/oti6858.ko 2024-04-17T08:32:04.812 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 61761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/pl2303.ko 2024-04-17T08:32:04.812 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 10321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/qcaux.ko 2024-04-17T08:32:04.812 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 39985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/qcserial.ko 2024-04-17T08:32:04.812 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 40529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/quatech2.ko 2024-04-17T08:32:04.812 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/safe_serial.ko 2024-04-17T08:32:04.812 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 59345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/sierra.ko 2024-04-17T08:32:04.813 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 25225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-17T08:32:04.813 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 34065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ssu100.ko 2024-04-17T08:32:04.813 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 19601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/symbolserial.ko 2024-04-17T08:32:04.813 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 70497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-17T08:32:04.813 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 24297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-17T08:32:04.813 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usb_debug.ko 2024-04-17T08:32:04.813 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 39321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-17T08:32:04.813 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 151137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usbserial.ko 2024-04-17T08:32:04.813 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 32505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/visor.ko 2024-04-17T08:32:04.813 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 43577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/whiteheat.ko 2024-04-17T08:32:04.813 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/wishbone-serial.ko 2024-04-17T08:32:04.813 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 10257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-17T08:32:04.813 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ 2024-04-17T08:32:04.814 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 64049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/uas.ko 2024-04-17T08:32:04.814 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 30209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-17T08:32:04.814 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-17T08:32:04.814 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 25665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-17T08:32:04.814 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 41073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-17T08:32:04.814 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-17T08:32:04.814 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 22953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-17T08:32:04.814 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 22769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-17T08:32:04.814 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-karma.ko 2024-04-17T08:32:04.814 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-17T08:32:04.814 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 33873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-17T08:32:04.814 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 33849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-17T08:32:04.814 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 22577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-17T08:32:04.814 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 41785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-17T08:32:04.815 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 201193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/usb-storage.ko 2024-04-17T08:32:04.815 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/ 2024-04-17T08:32:04.815 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 76041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-17T08:32:04.815 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 85257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-17T08:32:04.815 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 122321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-17T08:32:04.815 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/ 2024-04-17T08:32:04.815 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/pci/ 2024-04-17T08:32:04.815 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 206921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-17T08:32:04.815 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 33577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-17T08:32:04.815 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 134265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/vfio.ko 2024-04-17T08:32:04.815 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 93673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-17T08:32:04.815 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/ 2024-04-17T08:32:04.815 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 138721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost.ko 2024-04-17T08:32:04.815 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-17T08:32:04.815 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 71281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost_net.ko 2024-04-17T08:32:04.816 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 107905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost_scsi.ko 2024-04-17T08:32:04.816 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/ 2024-04-17T08:32:04.816 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/ 2024-04-17T08:32:04.816 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 17993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-04-17T08:32:04.816 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/aat2870_bl.ko 2024-04-17T08:32:04.816 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 29153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/adp5520_bl.ko 2024-04-17T08:32:04.816 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 41169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/adp8860_bl.ko 2024-04-17T08:32:04.816 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 51745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/adp8870_bl.ko 2024-04-17T08:32:04.816 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/apple_bl.ko 2024-04-17T08:32:04.816 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 19825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/as3711_bl.ko 2024-04-17T08:32:04.816 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/bd6107.ko 2024-04-17T08:32:04.816 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/da903x_bl.ko 2024-04-17T08:32:04.816 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/da9052_bl.ko 2024-04-17T08:32:04.816 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/gpio_backlight.ko 2024-04-17T08:32:04.817 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 17473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/kb3886_bl.ko 2024-04-17T08:32:04.817 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 26457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/lcd.ko 2024-04-17T08:32:04.817 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 28209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/lm3533_bl.ko 2024-04-17T08:32:04.817 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 23393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/lm3639_bl.ko 2024-04-17T08:32:04.817 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/lv5207lp.ko 2024-04-17T08:32:04.817 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/max8925_bl.ko 2024-04-17T08:32:04.817 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/pandora_bl.ko 2024-04-17T08:32:04.817 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-04-17T08:32:04.817 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-17T08:32:04.817 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/wm831x_bl.ko 2024-04-17T08:32:04.817 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/ 2024-04-17T08:32:04.817 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/ 2024-04-17T08:32:04.818 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 23033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/ds2482.ko 2024-04-17T08:32:04.818 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 46801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/ds2490.ko 2024-04-17T08:32:04.818 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/matrox_w1.ko 2024-04-17T08:32:04.818 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/w1-gpio.ko 2024-04-17T08:32:04.818 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/ 2024-04-17T08:32:04.818 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-17T08:32:04.818 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 27257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-17T08:32:04.818 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-17T08:32:04.818 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-17T08:32:04.818 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-17T08:32:04.818 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-17T08:32:04.819 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-17T08:32:04.819 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-17T08:32:04.819 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 21513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-17T08:32:04.819 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 8313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-17T08:32:04.819 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 70369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-17T08:32:04.819 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 129433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/wire.ko 2024-04-17T08:32:04.819 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ 2024-04-17T08:32:04.819 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 22337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/acquirewdt.ko 2024-04-17T08:32:04.819 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 23825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/advantechwdt.ko 2024-04-17T08:32:04.819 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 22209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-17T08:32:04.819 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 27401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-17T08:32:04.819 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 21985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/cpu5wdt.ko 2024-04-17T08:32:04.820 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/da9052_wdt.ko 2024-04-17T08:32:04.820 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/da9055_wdt.ko 2024-04-17T08:32:04.820 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/da9063_wdt.ko 2024-04-17T08:32:04.820 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 24457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/dw_wdt.ko 2024-04-17T08:32:04.820 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 23521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/eurotechwdt.ko 2024-04-17T08:32:04.820 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 26817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-17T08:32:04.820 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 32857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/hpwdt.ko 2024-04-17T08:32:04.820 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 18049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/i6300esb.ko 2024-04-17T08:32:04.820 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-17T08:32:04.820 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 26737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-17T08:32:04.820 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 23289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ib700wdt.ko 2024-04-17T08:32:04.820 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 21721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ibmasr.ko 2024-04-17T08:32:04.820 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 22713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-17T08:32:04.820 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 24857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-17T08:32:04.820 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/it87_wdt.ko 2024-04-17T08:32:04.821 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 26441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/kempld_wdt.ko 2024-04-17T08:32:04.821 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 21569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/machzwd.ko 2024-04-17T08:32:04.821 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 17105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/mena21_wdt.ko 2024-04-17T08:32:04.821 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-04-17T08:32:04.821 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 29753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/nv_tco.ko 2024-04-17T08:32:04.821 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-04-17T08:32:04.821 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 27721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/pc87413_wdt.ko 2024-04-17T08:32:04.821 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 46953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-17T08:32:04.821 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 37193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-17T08:32:04.821 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/retu_wdt.ko 2024-04-17T08:32:04.821 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 24433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-04-17T08:32:04.821 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-04-17T08:32:04.821 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-17T08:32:04.821 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 29169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sc1200wdt.ko 2024-04-17T08:32:04.821 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 27489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-17T08:32:04.822 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 25625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-04-17T08:32:04.822 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 19721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/softdog.ko 2024-04-17T08:32:04.822 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 26009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-17T08:32:04.822 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/twl4030_wdt.ko 2024-04-17T08:32:04.822 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/via_wdt.ko 2024-04-17T08:32:04.822 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 23393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-17T08:32:04.822 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 24905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-17T08:32:04.822 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 32481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-17T08:32:04.822 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 22577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/wafer5823wdt.ko 2024-04-17T08:32:04.822 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 33465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/wdt_pci.ko 2024-04-17T08:32:04.822 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 18905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/wm831x_wdt.ko 2024-04-17T08:32:04.822 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/wm8350_wdt.ko 2024-04-17T08:32:04.822 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 18457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/xen_wdt.ko 2024-04-17T08:32:04.822 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/ 2024-04-17T08:32:04.823 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 30049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-evtchn.ko 2024-04-17T08:32:04.823 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 30649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-gntalloc.ko 2024-04-17T08:32:04.823 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 55713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-gntdev.ko 2024-04-17T08:32:04.823 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-pciback/ 2024-04-17T08:32:04.823 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 213913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-17T08:32:04.823 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 47689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-privcmd.ko 2024-04-17T08:32:04.823 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 85713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-scsiback.ko 2024-04-17T08:32:04.823 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xenfs/ 2024-04-17T08:32:04.823 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 23433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-17T08:32:04.823 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ 2024-04-17T08:32:04.823 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/9p/ 2024-04-17T08:32:04.823 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 192617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/9p/9p.ko 2024-04-17T08:32:04.823 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/adfs/ 2024-04-17T08:32:04.823 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 78153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/adfs/adfs.ko 2024-04-17T08:32:04.824 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/affs/ 2024-04-17T08:32:04.824 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 197849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/affs/affs.ko 2024-04-17T08:32:04.824 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/afs/ 2024-04-17T08:32:04.824 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 1261113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/afs/kafs.ko 2024-04-17T08:32:04.824 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/autofs/ 2024-04-17T08:32:04.824 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 127377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/autofs/autofs4.ko 2024-04-17T08:32:04.824 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/befs/ 2024-04-17T08:32:04.824 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 80521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/befs/befs.ko 2024-04-17T08:32:04.824 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/bfs/ 2024-04-17T08:32:04.824 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 50473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/bfs/bfs.ko 2024-04-17T08:32:04.824 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 45561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/binfmt_misc.ko 2024-04-17T08:32:04.825 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/btrfs/ 2024-04-17T08:32:04.825 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 4489593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/btrfs/btrfs.ko 2024-04-17T08:32:04.825 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cachefiles/ 2024-04-17T08:32:04.825 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 376857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cachefiles/cachefiles.ko 2024-04-17T08:32:04.825 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ceph/ 2024-04-17T08:32:04.825 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 1586089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ceph/ceph.ko 2024-04-17T08:32:04.825 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/coda/ 2024-04-17T08:32:04.825 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 130073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/coda/coda.ko 2024-04-17T08:32:04.825 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/configfs/ 2024-04-17T08:32:04.825 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 139081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/configfs/configfs.ko 2024-04-17T08:32:04.825 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cramfs/ 2024-04-17T08:32:04.825 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 35665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cramfs/cramfs.ko 2024-04-17T08:32:04.825 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/dlm/ 2024-04-17T08:32:04.825 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 813225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/dlm/dlm.ko 2024-04-17T08:32:04.826 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/efs/ 2024-04-17T08:32:04.826 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 46409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/efs/efs.ko 2024-04-17T08:32:04.826 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/f2fs/ 2024-04-17T08:32:04.826 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 1906817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/f2fs/f2fs.ko 2024-04-17T08:32:04.826 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat/ 2024-04-17T08:32:04.826 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 35137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat/msdos.ko 2024-04-17T08:32:04.826 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/freevxfs/ 2024-04-17T08:32:04.826 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 52313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/freevxfs/freevxfs.ko 2024-04-17T08:32:04.826 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fuse/ 2024-04-17T08:32:04.826 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 29177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fuse/cuse.ko 2024-04-17T08:32:04.826 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/gfs2/ 2024-04-17T08:32:04.826 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 1486521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/gfs2/gfs2.ko 2024-04-17T08:32:04.826 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfs/ 2024-04-17T08:32:04.827 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 183305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfs/hfs.ko 2024-04-17T08:32:04.827 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfsplus/ 2024-04-17T08:32:04.827 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 282097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfsplus/hfsplus.ko 2024-04-17T08:32:04.827 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hpfs/ 2024-04-17T08:32:04.827 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 249009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hpfs/hpfs.ko 2024-04-17T08:32:04.827 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/isofs/ 2024-04-17T08:32:04.827 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 93033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/isofs/isofs.ko 2024-04-17T08:32:04.827 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/jfs/ 2024-04-17T08:32:04.827 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 533073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/jfs/jfs.ko 2024-04-17T08:32:04.827 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/lockd/ 2024-04-17T08:32:04.827 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 361369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/lockd/lockd.ko 2024-04-17T08:32:04.827 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/minix/ 2024-04-17T08:32:04.827 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 112609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/minix/minix.ko 2024-04-17T08:32:04.827 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/netfs/ 2024-04-17T08:32:04.827 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 591585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/netfs/netfs.ko 2024-04-17T08:32:04.828 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/ 2024-04-17T08:32:04.828 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/blocklayout/ 2024-04-17T08:32:04.828 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 102561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-17T08:32:04.828 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/filelayout/ 2024-04-17T08:32:04.828 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 74353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-17T08:32:04.828 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/flexfilelayout/ 2024-04-17T08:32:04.828 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 147689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-17T08:32:04.828 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 1320249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfs.ko 2024-04-17T08:32:04.828 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 82105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfsv2.ko 2024-04-17T08:32:04.828 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 151641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfsv3.ko 2024-04-17T08:32:04.828 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 2518505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfsv4.ko 2024-04-17T08:32:04.828 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs_common/ 2024-04-17T08:32:04.828 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 19849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs_common/grace.ko 2024-04-17T08:32:04.828 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 19345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs_common/nfs_acl.ko 2024-04-17T08:32:04.829 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfsd/ 2024-04-17T08:32:04.829 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 2024049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfsd/nfsd.ko 2024-04-17T08:32:04.829 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nilfs2/ 2024-04-17T08:32:04.829 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 734025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nilfs2/nilfs2.ko 2024-04-17T08:32:04.829 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/ 2024-04-17T08:32:04.829 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-celtic.ko 2024-04-17T08:32:04.829 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-centeuro.ko 2024-04-17T08:32:04.829 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-croatian.ko 2024-04-17T08:32:04.829 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-cyrillic.ko 2024-04-17T08:32:04.829 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-gaelic.ko 2024-04-17T08:32:04.829 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-greek.ko 2024-04-17T08:32:04.830 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-iceland.ko 2024-04-17T08:32:04.830 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-inuit.ko 2024-04-17T08:32:04.830 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-roman.ko 2024-04-17T08:32:04.830 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-romanian.ko 2024-04-17T08:32:04.830 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-turkish.ko 2024-04-17T08:32:04.830 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_ascii.ko 2024-04-17T08:32:04.830 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp1250.ko 2024-04-17T08:32:04.830 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp1251.ko 2024-04-17T08:32:04.830 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp1255.ko 2024-04-17T08:32:04.830 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp737.ko 2024-04-17T08:32:04.830 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp775.ko 2024-04-17T08:32:04.830 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp850.ko 2024-04-17T08:32:04.830 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp852.ko 2024-04-17T08:32:04.830 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp855.ko 2024-04-17T08:32:04.830 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp857.ko 2024-04-17T08:32:04.831 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp860.ko 2024-04-17T08:32:04.831 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp861.ko 2024-04-17T08:32:04.831 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp862.ko 2024-04-17T08:32:04.831 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp863.ko 2024-04-17T08:32:04.831 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp864.ko 2024-04-17T08:32:04.831 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp865.ko 2024-04-17T08:32:04.831 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp866.ko 2024-04-17T08:32:04.831 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp869.ko 2024-04-17T08:32:04.831 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp874.ko 2024-04-17T08:32:04.831 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 95625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp932.ko 2024-04-17T08:32:04.831 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 144209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp936.ko 2024-04-17T08:32:04.831 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 167137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp949.ko 2024-04-17T08:32:04.831 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 119513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp950.ko 2024-04-17T08:32:04.831 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_euc-jp.ko 2024-04-17T08:32:04.832 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-1.ko 2024-04-17T08:32:04.832 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-13.ko 2024-04-17T08:32:04.832 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-14.ko 2024-04-17T08:32:04.832 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-15.ko 2024-04-17T08:32:04.832 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-2.ko 2024-04-17T08:32:04.832 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-3.ko 2024-04-17T08:32:04.832 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-4.ko 2024-04-17T08:32:04.832 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-5.ko 2024-04-17T08:32:04.832 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-6.ko 2024-04-17T08:32:04.832 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-7.ko 2024-04-17T08:32:04.832 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-9.ko 2024-04-17T08:32:04.832 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_koi8-r.ko 2024-04-17T08:32:04.832 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 9833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_koi8-ru.ko 2024-04-17T08:32:04.832 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_koi8-u.ko 2024-04-17T08:32:04.832 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 7521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-17T08:32:04.833 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 9601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_utf8.ko 2024-04-17T08:32:04.833 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ 2024-04-17T08:32:04.833 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/cluster/ 2024-04-17T08:32:04.833 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 302073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-17T08:32:04.833 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlm/ 2024-04-17T08:32:04.833 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 548169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-17T08:32:04.833 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlmfs/ 2024-04-17T08:32:04.833 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 66361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-17T08:32:04.833 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 3245617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2.ko 2024-04-17T08:32:04.833 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 22113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-17T08:32:04.833 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 39313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-17T08:32:04.833 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 43073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-17T08:32:04.833 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/omfs/ 2024-04-17T08:32:04.833 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 67489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/omfs/omfs.ko 2024-04-17T08:32:04.833 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/overlayfs/ 2024-04-17T08:32:04.833 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 462873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/overlayfs/overlay.ko 2024-04-17T08:32:04.834 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/pstore/ 2024-04-17T08:32:04.834 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 67977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/pstore/ramoops.ko 2024-04-17T08:32:04.834 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/qnx4/ 2024-04-17T08:32:04.834 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 33209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/qnx4/qnx4.ko 2024-04-17T08:32:04.834 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/qnx6/ 2024-04-17T08:32:04.834 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 56097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/qnx6/qnx6.ko 2024-04-17T08:32:04.834 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/quota/ 2024-04-17T08:32:04.834 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 40313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/quota/quota_tree.ko 2024-04-17T08:32:04.834 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 17513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/quota/quota_v1.ko 2024-04-17T08:32:04.834 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 28817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/quota/quota_v2.ko 2024-04-17T08:32:04.834 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/reiserfs/ 2024-04-17T08:32:04.834 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 684841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/reiserfs/reiserfs.ko 2024-04-17T08:32:04.834 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/romfs/ 2024-04-17T08:32:04.834 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 34673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/romfs/romfs.ko 2024-04-17T08:32:04.835 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/ 2024-04-17T08:32:04.835 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/client/ 2024-04-17T08:32:04.835 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 3319041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/client/cifs.ko 2024-04-17T08:32:04.836 INFO:teuthology.orchestra.run.smithi196.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-17T08:32:04.836 INFO:teuthology.orchestra.run.smithi196.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-17T08:32:04.868 INFO:teuthology.orchestra.run.smithi196.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-17T08:32:04.875 INFO:teuthology.orchestra.run.smithi196.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-17T08:32:04.876 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/common/ 2024-04-17T08:32:04.877 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 8073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/common/cifs_arc4.ko 2024-04-17T08:32:04.877 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/common/cifs_md4.ko 2024-04-17T08:32:04.877 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/squashfs/ 2024-04-17T08:32:04.877 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 164185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/squashfs/squashfs.ko 2024-04-17T08:32:04.877 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/sysv/ 2024-04-17T08:32:04.877 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 115977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/sysv/sysv.ko 2024-04-17T08:32:04.877 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/udf/ 2024-04-17T08:32:04.877 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 310017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/udf/udf.ko 2024-04-17T08:32:04.877 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ufs/ 2024-04-17T08:32:04.877 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 198233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ufs/ufs.ko 2024-04-17T08:32:04.877 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/xfs/ 2024-04-17T08:32:04.877 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 5192705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/xfs/xfs.ko 2024-04-17T08:32:04.877 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/ 2024-04-17T08:32:04.878 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/locking/ 2024-04-17T08:32:04.878 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 97625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/locking/locktorture.ko 2024-04-17T08:32:04.878 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/time/ 2024-04-17T08:32:04.878 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/time/test_udelay.ko 2024-04-17T08:32:04.878 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 72665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/torture.ko 2024-04-17T08:32:04.878 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ 2024-04-17T08:32:04.878 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 7313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crc-itu-t.ko 2024-04-17T08:32:04.878 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 7081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crc7.ko 2024-04-17T08:32:04.878 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 7953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crc8.ko 2024-04-17T08:32:04.878 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crypto/ 2024-04-17T08:32:04.878 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 8009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crypto/libarc4.ko 2024-04-17T08:32:04.878 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 38985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crypto/libdes.ko 2024-04-17T08:32:04.878 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/interval_tree_test.ko 2024-04-17T08:32:04.878 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 9401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/libcrc32c.ko 2024-04-17T08:32:04.879 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 29065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lru_cache.ko 2024-04-17T08:32:04.879 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lz4/ 2024-04-17T08:32:04.879 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 36169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lz4/lz4_compress.ko 2024-04-17T08:32:04.879 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 24729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lz4/lz4hc_compress.ko 2024-04-17T08:32:04.879 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/math/ 2024-04-17T08:32:04.879 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 7281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/math/cordic.ko 2024-04-17T08:32:04.879 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 9169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/memory-notifier-error-inject.ko 2024-04-17T08:32:04.879 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/notifier-error-inject.ko 2024-04-17T08:32:04.879 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/percpu_test.ko 2024-04-17T08:32:04.879 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 9249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/pm-notifier-error-inject.ko 2024-04-17T08:32:04.879 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/raid6/ 2024-04-17T08:32:04.879 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 152025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/raid6/raid6_pq.ko 2024-04-17T08:32:04.879 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 24481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/rbtree_test.ko 2024-04-17T08:32:04.880 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/reed_solomon/ 2024-04-17T08:32:04.880 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 21385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-17T08:32:04.880 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 40969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/test-kstrtox.ko 2024-04-17T08:32:04.880 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 4912441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/test_bpf.ko 2024-04-17T08:32:04.880 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 61169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/test_firmware.ko 2024-04-17T08:32:04.880 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 7121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/test_module.ko 2024-04-17T08:32:04.880 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 24937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/test_user_copy.ko 2024-04-17T08:32:04.880 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ts_bm.ko 2024-04-17T08:32:04.880 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ts_fsm.ko 2024-04-17T08:32:04.880 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ts_kmp.ko 2024-04-17T08:32:04.880 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/xz/ 2024-04-17T08:32:04.880 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/xz/xz_dec_test.ko 2024-04-17T08:32:04.880 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/mm/ 2024-04-17T08:32:04.881 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/mm/hwpoison-inject.ko 2024-04-17T08:32:04.881 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ 2024-04-17T08:32:04.881 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/ 2024-04-17T08:32:04.881 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 66969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/6lowpan.ko 2024-04-17T08:32:04.881 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 7577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_dest.ko 2024-04-17T08:32:04.881 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 7529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_fragment.ko 2024-04-17T08:32:04.881 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 7513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_hop.ko 2024-04-17T08:32:04.881 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 7513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-17T08:32:04.881 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 7529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_mobility.ko 2024-04-17T08:32:04.881 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 7521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_routing.ko 2024-04-17T08:32:04.881 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 17225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_udp.ko 2024-04-17T08:32:04.881 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/ 2024-04-17T08:32:04.882 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 36729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/garp.ko 2024-04-17T08:32:04.882 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 42297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/mrp.ko 2024-04-17T08:32:04.882 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 9849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/p8022.ko 2024-04-17T08:32:04.882 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 19417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/psnap.ko 2024-04-17T08:32:04.882 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/stp.ko 2024-04-17T08:32:04.882 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/8021q/ 2024-04-17T08:32:04.882 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 106793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/8021q/8021q.ko 2024-04-17T08:32:04.882 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/ 2024-04-17T08:32:04.882 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 236793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet.ko 2024-04-17T08:32:04.882 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 44449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet_fd.ko 2024-04-17T08:32:04.882 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 32209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet_rdma.ko 2024-04-17T08:32:04.883 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 39513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet_virtio.ko 2024-04-17T08:32:04.883 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/batman-adv/ 2024-04-17T08:32:04.883 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 879697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/batman-adv/batman-adv.ko 2024-04-17T08:32:04.883 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/ 2024-04-17T08:32:04.883 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 84761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/br_netfilter.ko 2024-04-17T08:32:04.883 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 1030873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/bridge.ko 2024-04-17T08:32:04.883 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ 2024-04-17T08:32:04.883 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 8905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-17T08:32:04.883 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-17T08:32:04.883 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 10457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-17T08:32:04.883 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 10417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-17T08:32:04.883 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 10953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-17T08:32:04.883 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 10001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-17T08:32:04.883 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 10337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-17T08:32:04.884 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-17T08:32:04.884 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-17T08:32:04.884 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 8841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-17T08:32:04.884 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 8777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-17T08:32:04.884 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 9569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-17T08:32:04.884 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 8625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-17T08:32:04.884 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 10913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-17T08:32:04.884 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 9953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-17T08:32:04.884 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 10105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-17T08:32:04.884 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-17T08:32:04.884 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-17T08:32:04.884 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-17T08:32:04.884 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-17T08:32:04.884 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 70529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtables.ko 2024-04-17T08:32:04.885 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-17T08:32:04.885 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-17T08:32:04.885 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ceph/ 2024-04-17T08:32:04.885 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 1243505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ceph/libceph.ko 2024-04-17T08:32:04.885 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/core/ 2024-04-17T08:32:04.885 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 153801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/core/pktgen.ko 2024-04-17T08:32:04.885 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/ 2024-04-17T08:32:04.885 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 244889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp.ko 2024-04-17T08:32:04.885 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 10273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp_diag.ko 2024-04-17T08:32:04.885 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 71033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp_ipv4.ko 2024-04-17T08:32:04.885 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 74993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp_ipv6.ko 2024-04-17T08:32:04.885 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/ 2024-04-17T08:32:04.886 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 507705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/dsa_core.ko 2024-04-17T08:32:04.886 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_brcm.ko 2024-04-17T08:32:04.886 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_dsa.ko 2024-04-17T08:32:04.886 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 8873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_none.ko 2024-04-17T08:32:04.886 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 10465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_trailer.ko 2024-04-17T08:32:04.886 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/hsr/ 2024-04-17T08:32:04.886 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 128873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/hsr/hsr.ko 2024-04-17T08:32:04.886 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/ 2024-04-17T08:32:04.886 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/6lowpan/ 2024-04-17T08:32:04.886 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 55505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-17T08:32:04.886 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 357425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/ieee802154.ko 2024-04-17T08:32:04.886 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 59393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-17T08:32:04.886 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ 2024-04-17T08:32:04.887 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 29041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ah4.ko 2024-04-17T08:32:04.887 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 46417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/esp4.ko 2024-04-17T08:32:04.887 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 60233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/fou.ko 2024-04-17T08:32:04.887 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 21937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/gre.ko 2024-04-17T08:32:04.887 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 65665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/inet_diag.ko 2024-04-17T08:32:04.887 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 75489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ip_gre.ko 2024-04-17T08:32:04.887 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 77721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ip_tunnel.ko 2024-04-17T08:32:04.887 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 43705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ip_vti.ko 2024-04-17T08:32:04.887 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ipcomp.ko 2024-04-17T08:32:04.887 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 34745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ipip.ko 2024-04-17T08:32:04.887 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ 2024-04-17T08:32:04.887 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 45521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-17T08:32:04.887 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 10137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-17T08:32:04.888 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-17T08:32:04.890 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 50169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ip_tables.ko 2024-04-17T08:32:04.890 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-17T08:32:04.890 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-04-17T08:32:04.890 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-17T08:32:04.890 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-17T08:32:04.891 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 17289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-17T08:32:04.891 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-04-17T08:32:04.891 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-17T08:32:04.891 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 17297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-17T08:32:04.891 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-17T08:32:04.891 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-17T08:32:04.891 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-17T08:32:04.891 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 9705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-17T08:32:04.891 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 32473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-17T08:32:04.891 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-17T08:32:04.891 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-17T08:32:04.891 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 25753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-04-17T08:32:04.891 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 10249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-17T08:32:04.892 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 17161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-17T08:32:04.892 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-17T08:32:04.892 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 19513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-17T08:32:04.892 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 10065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-17T08:32:04.892 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_bic.ko 2024-04-17T08:32:04.892 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_dctcp.ko 2024-04-17T08:32:04.892 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 19409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_diag.ko 2024-04-17T08:32:04.892 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_highspeed.ko 2024-04-17T08:32:04.892 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_htcp.ko 2024-04-17T08:32:04.892 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_hybla.ko 2024-04-17T08:32:04.892 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_illinois.ko 2024-04-17T08:32:04.892 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_lp.ko 2024-04-17T08:32:04.892 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 9601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_scalable.ko 2024-04-17T08:32:04.892 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_vegas.ko 2024-04-17T08:32:04.893 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_veno.ko 2024-04-17T08:32:04.893 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_westwood.ko 2024-04-17T08:32:04.893 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_yeah.ko 2024-04-17T08:32:04.893 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 28585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tunnel4.ko 2024-04-17T08:32:04.893 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 21137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/udp_diag.ko 2024-04-17T08:32:04.893 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 54441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/udp_tunnel.ko 2024-04-17T08:32:04.893 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-17T08:32:04.893 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ 2024-04-17T08:32:04.893 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 31073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ah6.ko 2024-04-17T08:32:04.893 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 47433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/esp6.ko 2024-04-17T08:32:04.893 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 17113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/fou6.ko 2024-04-17T08:32:04.893 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 103177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_gre.ko 2024-04-17T08:32:04.894 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 118881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_tunnel.ko 2024-04-17T08:32:04.894 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-17T08:32:04.894 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 71089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_vti.ko 2024-04-17T08:32:04.894 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ipcomp6.ko 2024-04-17T08:32:04.894 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 23017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/mip6.ko 2024-04-17T08:32:04.894 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ 2024-04-17T08:32:04.894 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 50673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-17T08:32:04.894 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-04-17T08:32:04.894 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-17T08:32:04.894 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-17T08:32:04.894 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15929 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-17T08:32:04.894 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 8721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-17T08:32:04.894 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 17953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-17T08:32:04.895 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 17625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-17T08:32:04.895 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 10049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-17T08:32:04.895 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-17T08:32:04.895 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-17T08:32:04.895 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-17T08:32:04.895 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-17T08:32:04.895 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-17T08:32:04.895 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 17449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-17T08:32:04.895 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-17T08:32:04.895 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-17T08:32:04.895 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 46313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-17T08:32:04.895 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 9361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-17T08:32:04.895 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 29817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-17T08:32:04.896 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 10833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-17T08:32:04.896 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 17257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-17T08:32:04.896 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-17T08:32:04.896 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 18521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-17T08:32:04.896 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 10065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-17T08:32:04.896 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 94089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/sit.ko 2024-04-17T08:32:04.896 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 30297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/tunnel6.ko 2024-04-17T08:32:04.896 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 28369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-17T08:32:04.896 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/key/ 2024-04-17T08:32:04.896 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 106369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/key/af_key.ko 2024-04-17T08:32:04.896 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/ 2024-04-17T08:32:04.896 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 153217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_core.ko 2024-04-17T08:32:04.896 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 24273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-17T08:32:04.896 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 31985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_eth.ko 2024-04-17T08:32:04.897 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 43641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_ip.ko 2024-04-17T08:32:04.897 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 44993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_ip6.ko 2024-04-17T08:32:04.897 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 42049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_netlink.ko 2024-04-17T08:32:04.897 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 66241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_ppp.ko 2024-04-17T08:32:04.897 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/lapb/ 2024-04-17T08:32:04.897 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 63345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/lapb/lapb.ko 2024-04-17T08:32:04.897 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/llc/ 2024-04-17T08:32:04.897 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 27385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/llc/llc.ko 2024-04-17T08:32:04.897 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 332889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/llc/llc2.ko 2024-04-17T08:32:04.897 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mac802154/ 2024-04-17T08:32:04.897 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 388873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mac802154/mac802154.ko 2024-04-17T08:32:04.897 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mpls/ 2024-04-17T08:32:04.898 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 10577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mpls/mpls_gso.ko 2024-04-17T08:32:04.898 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ 2024-04-17T08:32:04.898 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ 2024-04-17T08:32:04.898 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 147745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set.ko 2024-04-17T08:32:04.898 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 34473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-17T08:32:04.898 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 33073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-17T08:32:04.898 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 32553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-17T08:32:04.898 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 124041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-17T08:32:04.898 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 124345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-17T08:32:04.898 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 126681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-17T08:32:04.898 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 126473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-17T08:32:04.899 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 137833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-17T08:32:04.899 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 72353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-17T08:32:04.899 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 133681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-17T08:32:04.899 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 139073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-17T08:32:04.899 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 138265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-17T08:32:04.899 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 136177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-17T08:32:04.899 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 139897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-17T08:32:04.899 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 37129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-17T08:32:04.899 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ 2024-04-17T08:32:04.899 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 534113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-17T08:32:04.899 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-17T08:32:04.899 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 8801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-17T08:32:04.899 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-17T08:32:04.899 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-17T08:32:04.900 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 24577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-17T08:32:04.900 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 8801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-17T08:32:04.900 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 8865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-17T08:32:04.900 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-17T08:32:04.900 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 10873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-17T08:32:04.900 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 8921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-17T08:32:04.900 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-17T08:32:04.900 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 8921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-17T08:32:04.900 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-17T08:32:04.900 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 55217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conncount.ko 2024-04-17T08:32:04.900 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 496817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack.ko 2024-04-17T08:32:04.900 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 18097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-17T08:32:04.901 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-17T08:32:04.901 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 37865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-17T08:32:04.901 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 134377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-17T08:32:04.901 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 24513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-17T08:32:04.901 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 9401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-17T08:32:04.901 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 140801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-17T08:32:04.901 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 38305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-17T08:32:04.901 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 18937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-17T08:32:04.901 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 79873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-17T08:32:04.901 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-17T08:32:04.901 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 21089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-17T08:32:04.901 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-17T08:32:04.901 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 117201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_flow_table.ko 2024-04-17T08:32:04.902 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 10961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-17T08:32:04.902 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 46105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_log_syslog.ko 2024-04-17T08:32:04.902 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 118369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat.ko 2024-04-17T08:32:04.902 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-17T08:32:04.902 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-17T08:32:04.902 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_irc.ko 2024-04-17T08:32:04.902 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 34609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_sip.ko 2024-04-17T08:32:04.902 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 9889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-17T08:32:04.902 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 53393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-17T08:32:04.902 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 807985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_tables.ko 2024-04-17T08:32:04.902 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 53049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink.ko 2024-04-17T08:32:04.902 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 36481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-17T08:32:04.902 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 37209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-04-17T08:32:04.903 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 49297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_log.ko 2024-04-17T08:32:04.903 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 26473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-17T08:32:04.903 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 65145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-17T08:32:04.903 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_chain_nat.ko 2024-04-17T08:32:04.903 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 41769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_compat.ko 2024-04-17T08:32:04.903 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 50657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_ct.ko 2024-04-17T08:32:04.903 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-17T08:32:04.903 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_fib.ko 2024-04-17T08:32:04.903 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-17T08:32:04.903 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 17177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_hash.ko 2024-04-17T08:32:04.903 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 25225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_limit.ko 2024-04-17T08:32:04.903 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 17921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_log.ko 2024-04-17T08:32:04.903 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 17449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_masq.ko 2024-04-17T08:32:04.903 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_nat.ko 2024-04-17T08:32:04.904 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_numgen.ko 2024-04-17T08:32:04.904 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_osf.ko 2024-04-17T08:32:04.904 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_queue.ko 2024-04-17T08:32:04.904 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_redir.ko 2024-04-17T08:32:04.904 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_reject.ko 2024-04-17T08:32:04.904 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_reject_inet.ko 2024-04-17T08:32:04.904 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_socket.ko 2024-04-17T08:32:04.904 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 24993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_synproxy.ko 2024-04-17T08:32:04.904 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 17641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_tproxy.ko 2024-04-17T08:32:04.904 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 108393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/x_tables.ko 2024-04-17T08:32:04.904 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_AUDIT.ko 2024-04-17T08:32:04.904 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 10865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-17T08:32:04.904 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 8625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-17T08:32:04.905 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-17T08:32:04.905 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 21865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CT.ko 2024-04-17T08:32:04.905 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_DSCP.ko 2024-04-17T08:32:04.905 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_HL.ko 2024-04-17T08:32:04.905 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_HMARK.ko 2024-04-17T08:32:04.905 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 45217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-17T08:32:04.905 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_LED.ko 2024-04-17T08:32:04.905 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_LOG.ko 2024-04-17T08:32:04.905 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-17T08:32:04.905 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_NETMAP.ko 2024-04-17T08:32:04.905 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 10857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_NFLOG.ko 2024-04-17T08:32:04.905 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-17T08:32:04.905 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 23089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_RATEEST.ko 2024-04-17T08:32:04.905 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-17T08:32:04.906 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_SECMARK.ko 2024-04-17T08:32:04.906 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 18985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-17T08:32:04.906 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-17T08:32:04.906 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TEE.ko 2024-04-17T08:32:04.906 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 19625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TPROXY.ko 2024-04-17T08:32:04.906 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 9449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TRACE.ko 2024-04-17T08:32:04.906 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_addrtype.ko 2024-04-17T08:32:04.906 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_bpf.ko 2024-04-17T08:32:04.906 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_cgroup.ko 2024-04-17T08:32:04.906 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_cluster.ko 2024-04-17T08:32:04.906 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 8465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_comment.ko 2024-04-17T08:32:04.906 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connbytes.ko 2024-04-17T08:32:04.907 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connlabel.ko 2024-04-17T08:32:04.907 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 10617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connlimit.ko 2024-04-17T08:32:04.907 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connmark.ko 2024-04-17T08:32:04.907 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_conntrack.ko 2024-04-17T08:32:04.907 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 8913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_cpu.ko 2024-04-17T08:32:04.907 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_dccp.ko 2024-04-17T08:32:04.907 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 9001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_devgroup.ko 2024-04-17T08:32:04.907 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 10257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_dscp.ko 2024-04-17T08:32:04.907 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_ecn.ko 2024-04-17T08:32:04.907 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_esp.ko 2024-04-17T08:32:04.907 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 52817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_hashlimit.ko 2024-04-17T08:32:04.907 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_helper.ko 2024-04-17T08:32:04.907 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 9521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_hl.ko 2024-04-17T08:32:04.908 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_ipcomp.ko 2024-04-17T08:32:04.908 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_iprange.ko 2024-04-17T08:32:04.908 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_ipvs.ko 2024-04-17T08:32:04.908 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 19193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_l2tp.ko 2024-04-17T08:32:04.908 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 9137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_length.ko 2024-04-17T08:32:04.908 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_limit.ko 2024-04-17T08:32:04.908 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 8449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_mac.ko 2024-04-17T08:32:04.908 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 9881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_mark.ko 2024-04-17T08:32:04.908 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_multiport.ko 2024-04-17T08:32:04.908 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 16161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_nat.ko 2024-04-17T08:32:04.908 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_nfacct.ko 2024-04-17T08:32:04.908 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 9433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_osf.ko 2024-04-17T08:32:04.908 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_owner.ko 2024-04-17T08:32:04.908 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_physdev.ko 2024-04-17T08:32:04.909 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 8625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_pkttype.ko 2024-04-17T08:32:04.909 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_policy.ko 2024-04-17T08:32:04.909 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 10905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_quota.ko 2024-04-17T08:32:04.909 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 11881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_rateest.ko 2024-04-17T08:32:04.909 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 9273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_realm.ko 2024-04-17T08:32:04.909 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 43465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_recent.ko 2024-04-17T08:32:04.909 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_sctp.ko 2024-04-17T08:32:04.909 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 36489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_set.ko 2024-04-17T08:32:04.909 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 19777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_socket.ko 2024-04-17T08:32:04.909 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 10753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_state.ko 2024-04-17T08:32:04.909 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 10849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_statistic.ko 2024-04-17T08:32:04.909 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 10025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_string.ko 2024-04-17T08:32:04.909 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 9593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_tcpmss.ko 2024-04-17T08:32:04.910 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 18449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_tcpudp.ko 2024-04-17T08:32:04.910 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_time.ko 2024-04-17T08:32:04.910 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 10617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_u32.ko 2024-04-17T08:32:04.910 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netlink/ 2024-04-17T08:32:04.910 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 17233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netlink/netlink_diag.ko 2024-04-17T08:32:04.910 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/nsh/ 2024-04-17T08:32:04.910 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 14073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/nsh/nsh.ko 2024-04-17T08:32:04.910 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/ 2024-04-17T08:32:04.910 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 488825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/openvswitch.ko 2024-04-17T08:32:04.910 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/vport-geneve.ko 2024-04-17T08:32:04.910 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 10873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/vport-gre.ko 2024-04-17T08:32:04.910 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/vport-vxlan.ko 2024-04-17T08:32:04.910 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/packet/ 2024-04-17T08:32:04.911 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15929 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/packet/af_packet_diag.ko 2024-04-17T08:32:04.911 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/phonet/ 2024-04-17T08:32:04.911 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 142025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/phonet/phonet.ko 2024-04-17T08:32:04.911 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 68817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/phonet/pn_pep.ko 2024-04-17T08:32:04.911 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/ 2024-04-17T08:32:04.911 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 318617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/rds.ko 2024-04-17T08:32:04.911 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 202305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/rds_rdma.ko 2024-04-17T08:32:04.911 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 85105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/rds_tcp.ko 2024-04-17T08:32:04.911 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rxrpc/ 2024-04-17T08:32:04.911 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 1027897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rxrpc/rxrpc.ko 2024-04-17T08:32:04.911 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/ 2024-04-17T08:32:04.911 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 39001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_csum.ko 2024-04-17T08:32:04.911 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 28721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_gact.ko 2024-04-17T08:32:04.912 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 45409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_mirred.ko 2024-04-17T08:32:04.912 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 27593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_nat.ko 2024-04-17T08:32:04.912 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 53465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_pedit.ko 2024-04-17T08:32:04.912 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 38705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_police.ko 2024-04-17T08:32:04.912 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 23969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_simple.ko 2024-04-17T08:32:04.912 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 43417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_skbedit.ko 2024-04-17T08:32:04.912 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 45673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_vlan.ko 2024-04-17T08:32:04.912 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 32129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_basic.ko 2024-04-17T08:32:04.912 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 41457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_bpf.ko 2024-04-17T08:32:04.912 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 23225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_cgroup.ko 2024-04-17T08:32:04.912 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 37305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_flow.ko 2024-04-17T08:32:04.912 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 39601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_fw.ko 2024-04-17T08:32:04.912 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 49321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_route.ko 2024-04-17T08:32:04.912 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 79145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_u32.ko 2024-04-17T08:32:04.913 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 8713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_cmp.ko 2024-04-17T08:32:04.913 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 15385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_ipset.ko 2024-04-17T08:32:04.913 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 48785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_meta.ko 2024-04-17T08:32:04.913 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 9241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_nbyte.ko 2024-04-17T08:32:04.913 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_text.ko 2024-04-17T08:32:04.913 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 8377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_u32.ko 2024-04-17T08:32:04.913 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 25801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_choke.ko 2024-04-17T08:32:04.913 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 25097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_codel.ko 2024-04-17T08:32:04.913 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 43481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_drr.ko 2024-04-17T08:32:04.913 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 43153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_fq.ko 2024-04-17T08:32:04.913 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 39177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_fq_codel.ko 2024-04-17T08:32:04.914 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 42889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_gred.ko 2024-04-17T08:32:04.914 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 62817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_hfsc.ko 2024-04-17T08:32:04.914 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 26585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_hhf.ko 2024-04-17T08:32:04.914 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 81833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_htb.ko 2024-04-17T08:32:04.914 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 33545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_ingress.ko 2024-04-17T08:32:04.914 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 36625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_mqprio.ko 2024-04-17T08:32:04.914 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_mqprio_lib.ko 2024-04-17T08:32:04.914 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 33065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_multiq.ko 2024-04-17T08:32:04.914 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 44793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_netem.ko 2024-04-17T08:32:04.914 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 32833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_pie.ko 2024-04-17T08:32:04.914 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 13505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_plug.ko 2024-04-17T08:32:04.914 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 31801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_prio.ko 2024-04-17T08:32:04.915 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 60249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_qfq.ko 2024-04-17T08:32:04.915 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 40889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_red.ko 2024-04-17T08:32:04.915 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 33433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_sfb.ko 2024-04-17T08:32:04.915 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 38329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_sfq.ko 2024-04-17T08:32:04.915 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 35777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_tbf.ko 2024-04-17T08:32:04.915 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 34161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_teql.ko 2024-04-17T08:32:04.915 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sctp/ 2024-04-17T08:32:04.915 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 1187313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sctp/sctp.ko 2024-04-17T08:32:04.915 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 23913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sctp/sctp_diag.ko 2024-04-17T08:32:04.915 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/ 2024-04-17T08:32:04.915 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/auth_gss/ 2024-04-17T08:32:04.915 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 432409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-17T08:32:04.915 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 70113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-17T08:32:04.915 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 1940889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/sunrpc.ko 2024-04-17T08:32:04.916 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/xprtrdma/ 2024-04-17T08:32:04.916 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 890729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-17T08:32:04.916 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/tipc/ 2024-04-17T08:32:04.916 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 1122337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/tipc/tipc.ko 2024-04-17T08:32:04.916 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/tipc/tipc_diag.ko 2024-04-17T08:32:04.916 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/unix/ 2024-04-17T08:32:04.916 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 18801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/unix/unix_diag.ko 2024-04-17T08:32:04.916 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/ 2024-04-17T08:32:04.916 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 105609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-17T08:32:04.916 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 90265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-17T08:32:04.916 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 123769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vsock.ko 2024-04-17T08:32:04.916 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 12905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-17T08:32:04.916 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 20401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-17T08:32:04.917 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/x25/ 2024-04-17T08:32:04.917 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 165841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/x25/x25.ko 2024-04-17T08:32:04.917 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/xfrm/ 2024-04-17T08:32:04.917 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 26729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/xfrm/xfrm_algo.ko 2024-04-17T08:32:04.917 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 23353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-17T08:32:04.917 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 131865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/xfrm/xfrm_user.ko 2024-04-17T08:32:04.917 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 644769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.alias 2024-04-17T08:32:04.917 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 628542 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.alias.bin 2024-04-17T08:32:04.917 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 7706 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin 2024-04-17T08:32:04.917 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 23609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin.alias.bin 2024-04-17T08:32:04.917 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 9941 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin.bin 2024-04-17T08:32:04.917 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 70990 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin.modinfo 2024-04-17T08:32:04.917 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 146959 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.dep 2024-04-17T08:32:04.917 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 232835 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.dep.bin 2024-04-17T08:32:04.918 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 210 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.devname 2024-04-17T08:32:04.918 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 72602 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.order 2024-04-17T08:32:04.918 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 879 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.softdep 2024-04-17T08:32:04.918 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 258450 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.symbols 2024-04-17T08:32:04.918 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 313019 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.symbols.bin 2024-04-17T08:32:04.918 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./usr/ 2024-04-17T08:32:04.918 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./usr/share/ 2024-04-17T08:32:04.918 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./usr/share/doc/ 2024-04-17T08:32:04.918 INFO:teuthology.orchestra.run.smithi152.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./usr/share/doc/linux-image-6.9.0-rc3-g3f60ed14f7c1/ 2024-04-17T08:32:04.918 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 174 2024-04-11 18:50 ./usr/share/doc/linux-image-6.9.0-rc3-g3f60ed14f7c1/changelog.Debian.gz 2024-04-17T08:32:04.918 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r-- root/root 691 2024-04-11 18:50 ./usr/share/doc/linux-image-6.9.0-rc3-g3f60ed14f7c1/copyright 2024-04-17T08:32:04.923 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g3f60ed14f7c1 2024-04-17T08:32:04.923 INFO:teuthology.task.kernel:searching for kernel 6.9.0-rc3-g3f60ed14f7c1 2024-04-17T08:32:04.924 DEBUG:teuthology.orchestra.run.smithi152:> egrep '(submenu|menuentry.*6.9.0-rc3-g3f60ed14f7c1).*{' /boot/grub/grub.cfg 2024-04-17T08:32:04.931 INFO:teuthology.orchestra.run.smithi152.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-17T08:32:04.931 INFO:teuthology.orchestra.run.smithi152.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g3f60ed14f7c1' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g3f60ed14f7c1-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-17T08:32:04.931 INFO:teuthology.orchestra.run.smithi152.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g3f60ed14f7c1 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g3f60ed14f7c1-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-17T08:32:04.931 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-04-17T08:32:04.932 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.9.0-rc3-g3f60ed14f7c1 2024-04-17T08:32:04.932 DEBUG:teuthology.orchestra.run.smithi152:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-04-17T08:32:04.977 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi152.front.sepia.ceph.com to complete... 2024-04-17T08:32:04.981 INFO:teuthology.orchestra.run.smithi196.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-17T08:32:04.981 INFO:teuthology.orchestra.run.smithi196.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-17T08:32:04.981 INFO:teuthology.orchestra.run.smithi196.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-17T08:32:04.990 INFO:teuthology.orchestra.run.smithi196.stderr:done 2024-04-17T08:32:05.351 INFO:teuthology.orchestra.run.smithi152.stderr:Sourcing file `/etc/default/grub' 2024-04-17T08:32:05.352 INFO:teuthology.orchestra.run.smithi152.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-17T08:32:05.376 INFO:teuthology.orchestra.run.smithi152.stderr:Generating grub configuration file ... 2024-04-17T08:32:05.565 INFO:teuthology.orchestra.run.smithi152.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g3f60ed14f7c1 2024-04-17T08:32:05.571 INFO:teuthology.orchestra.run.smithi152.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g3f60ed14f7c1 2024-04-17T08:32:05.788 INFO:teuthology.orchestra.run.smithi152.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-17T08:32:05.792 INFO:teuthology.orchestra.run.smithi152.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-17T08:32:05.831 INFO:teuthology.orchestra.run.smithi152.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-17T08:32:05.836 INFO:teuthology.orchestra.run.smithi152.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-17T08:32:05.975 INFO:teuthology.orchestra.run.smithi152.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-17T08:32:05.975 INFO:teuthology.orchestra.run.smithi152.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-17T08:32:05.975 INFO:teuthology.orchestra.run.smithi152.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-17T08:32:05.984 INFO:teuthology.orchestra.run.smithi152.stderr:done 2024-04-17T08:32:06.148 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2024-04-17T08:32:07.114 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2024-04-17T08:32:36.174 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-04-17T08:32:36.175 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-04-17T08:32:36.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:32:37.116 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-17T08:32:37.116 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-04-17T08:32:37.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:32:54.559 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-04-17T08:32:55.582 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.152 2024-04-17T08:33:03.567 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-04-17T08:33:03.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:33:04.584 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-04-17T08:33:04.585 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:33:06.622 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-04-17T08:33:07.646 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.152 2024-04-17T08:33:18.634 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-04-17T08:33:18.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:33:19.648 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-04-17T08:33:19.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:33:50.331 DEBUG:teuthology.orchestra.run.smithi196:> true 2024-04-17T08:33:51.014 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-04-17T08:33:51.015 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.9.0-rc3-g3f60ed14f7c1"... 2024-04-17T08:33:51.015 DEBUG:teuthology.orchestra.run.smithi196:> uname -r 2024-04-17T08:33:51.063 INFO:teuthology.orchestra.run.smithi196.stdout:6.9.0-rc3-g3f60ed14f7c1 2024-04-17T08:33:51.063 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g3f60ed14f7c1 vs 6.9.0-rc3-g3f60ed14f7c1 2024-04-17T08:33:51.064 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-17T08:33:51.064 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-17T08:33:52.064 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-17T08:33:52.065 DEBUG:teuthology.orchestra.run.smithi196:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-17T08:33:52.157 INFO:teuthology.orchestra.run.smithi196.stdout:ttyS1 2024-04-17T08:33:52.215 DEBUG:teuthology.parallel:result is None 2024-04-17T08:34:19.651 DEBUG:teuthology.orchestra.remote:timed out 2024-04-17T08:34:34.652 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-04-17T08:34:34.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:34:35.057 DEBUG:teuthology.orchestra.run.smithi152:> true 2024-04-17T08:34:35.732 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-04-17T08:34:35.732 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.9.0-rc3-g3f60ed14f7c1"... 2024-04-17T08:34:35.732 DEBUG:teuthology.orchestra.run.smithi152:> uname -r 2024-04-17T08:34:35.784 INFO:teuthology.orchestra.run.smithi152.stdout:6.9.0-rc3-g3f60ed14f7c1 2024-04-17T08:34:35.784 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g3f60ed14f7c1 vs 6.9.0-rc3-g3f60ed14f7c1 2024-04-17T08:34:35.784 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-17T08:34:35.784 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-17T08:34:36.785 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-17T08:34:36.785 DEBUG:teuthology.orchestra.run.smithi152:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-17T08:34:37.135 INFO:teuthology.orchestra.run.smithi152.stdout:ttyS1 2024-04-17T08:34:37.202 DEBUG:teuthology.parallel:result is None 2024-04-17T08:34:37.203 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-17T08:34:37.212 INFO:teuthology.task.internal:Creating test directory... 2024-04-17T08:34:37.212 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-17T08:34:37.215 DEBUG:teuthology.orchestra.run.smithi196:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-17T08:34:37.224 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-17T08:34:37.263 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-17T08:34:37.294 INFO:teuthology.task.internal:Creating archive directory... 2024-04-17T08:34:37.294 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-17T08:34:37.297 DEBUG:teuthology.orchestra.run.smithi196:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-17T08:34:37.319 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-17T08:34:37.331 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-17T08:34:37.331 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-17T08:34:37.353 DEBUG:teuthology.orchestra.run.smithi196:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-17T08:34:37.378 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-17T08:34:37.392 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-17T08:34:37.393 INFO:teuthology.orchestra.run.smithi196.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-17T08:34:37.407 INFO:teuthology.orchestra.run.smithi196.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-17T08:34:37.409 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-17T08:34:37.421 INFO:teuthology.task.internal:Configuring sudo... 2024-04-17T08:34:37.421 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-17T08:34:37.438 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-17T08:34:37.474 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-17T08:34:37.485 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-17T08:34:37.485 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-17T08:34:37.506 DEBUG:teuthology.orchestra.run.smithi196:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-17T08:34:37.524 DEBUG:teuthology.orchestra.run.smithi152:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-17T08:34:37.563 DEBUG:teuthology.orchestra.run.smithi152:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-17T08:34:37.615 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-17T08:34:37.615 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-17T08:34:37.690 DEBUG:teuthology.orchestra.run.smithi196:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-17T08:34:37.699 DEBUG:teuthology.orchestra.run.smithi196:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-17T08:34:37.748 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-17T08:34:37.748 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-17T08:34:37.823 DEBUG:teuthology.orchestra.run.smithi152:> sudo service rsyslog restart 2024-04-17T08:34:37.826 DEBUG:teuthology.orchestra.run.smithi196:> sudo service rsyslog restart 2024-04-17T08:34:37.949 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-17T08:34:37.957 INFO:teuthology.task.internal:Starting timer... 2024-04-17T08:34:37.958 INFO:teuthology.run_tasks:Running task pcp... 2024-04-17T08:34:38.003 INFO:teuthology.run_tasks:Running task selinux... 2024-04-17T08:34:38.037 DEBUG:teuthology.task.selinux:Excluding smithi152: OS 'ubuntu' does not support SELinux 2024-04-17T08:34:38.037 DEBUG:teuthology.task.selinux:Excluding smithi196: OS 'ubuntu' does not support SELinux 2024-04-17T08:34:38.037 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-17T08:34:38.038 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-17T08:34:38.038 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-17T08:34:38.038 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-17T08:34:38.075 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-17T08:34:38.092 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-17T08:34:38.093 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi152.front.sepia.ceph.com,smithi196.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-17T08:42:16.630 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi152.front.sepia.ceph.com'), Remote(name='ubuntu@smithi196.front.sepia.ceph.com')] 2024-04-17T08:42:16.631 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-04-17T08:42:16.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:42:16.712 DEBUG:teuthology.orchestra.run.smithi152:> true 2024-04-17T08:42:16.845 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-04-17T08:42:16.845 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-04-17T08:42:16.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:42:16.928 DEBUG:teuthology.orchestra.run.smithi196:> true 2024-04-17T08:42:17.053 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-04-17T08:42:17.053 INFO:teuthology.run_tasks:Running task clock... 2024-04-17T08:42:17.064 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-17T08:42:17.064 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-17T08:42:17.064 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-17T08:42:17.067 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-17T08:42:17.067 DEBUG:teuthology.orchestra.run.smithi196:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-17T08:42:17.102 INFO:teuthology.orchestra.run.smithi152.stdout:17 Apr 08:42:17 ntpd[17203]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-17T08:42:17.103 INFO:teuthology.orchestra.run.smithi152.stdout:17 Apr 08:42:17 ntpd[17203]: Command line: ntpd -gq 2024-04-17T08:42:17.103 INFO:teuthology.orchestra.run.smithi152.stdout:17 Apr 08:42:17 ntpd[17203]: ---------------------------------------------------- 2024-04-17T08:42:17.103 INFO:teuthology.orchestra.run.smithi152.stdout:17 Apr 08:42:17 ntpd[17203]: ntp-4 is maintained by Network Time Foundation, 2024-04-17T08:42:17.103 INFO:teuthology.orchestra.run.smithi152.stdout:17 Apr 08:42:17 ntpd[17203]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-17T08:42:17.103 INFO:teuthology.orchestra.run.smithi152.stdout:17 Apr 08:42:17 ntpd[17203]: corporation. Support and training for ntp-4 are 2024-04-17T08:42:17.103 INFO:teuthology.orchestra.run.smithi152.stdout:17 Apr 08:42:17 ntpd[17203]: available at https://www.nwtime.org/support 2024-04-17T08:42:17.103 INFO:teuthology.orchestra.run.smithi152.stdout:17 Apr 08:42:17 ntpd[17203]: ---------------------------------------------------- 2024-04-17T08:42:17.104 INFO:teuthology.orchestra.run.smithi152.stdout:17 Apr 08:42:17 ntpd[17203]: proto: precision = 0.041 usec (-24) 2024-04-17T08:42:17.104 INFO:teuthology.orchestra.run.smithi152.stdout:17 Apr 08:42:17 ntpd[17203]: basedate set to 2022-02-04 2024-04-17T08:42:17.104 INFO:teuthology.orchestra.run.smithi152.stdout:17 Apr 08:42:17 ntpd[17203]: gps base set to 2022-02-06 (week 2196) 2024-04-17T08:42:17.104 INFO:teuthology.orchestra.run.smithi152.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-17T08:42:17.104 INFO:teuthology.orchestra.run.smithi152.stdout:17 Apr 08:42:17 ntpd[17203]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-17T08:42:17.105 INFO:teuthology.orchestra.run.smithi152.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-17T08:42:17.106 INFO:teuthology.orchestra.run.smithi152.stdout:17 Apr 08:42:17 ntpd[17203]: restrict ::: KOD does nothing without LIMITED. 2024-04-17T08:42:17.106 INFO:teuthology.orchestra.run.smithi152.stdout:17 Apr 08:42:17 ntpd[17203]: Listen and drop on 0 v6wildcard [::]:123 2024-04-17T08:42:17.106 INFO:teuthology.orchestra.run.smithi152.stdout:17 Apr 08:42:17 ntpd[17203]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-17T08:42:17.106 INFO:teuthology.orchestra.run.smithi152.stdout:17 Apr 08:42:17 ntpd[17203]: Listen normally on 2 lo 127.0.0.1:123 2024-04-17T08:42:17.106 INFO:teuthology.orchestra.run.smithi152.stdout:17 Apr 08:42:17 ntpd[17203]: Listen normally on 3 enp3s0f1 172.21.15.152:123 2024-04-17T08:42:17.106 INFO:teuthology.orchestra.run.smithi152.stdout:17 Apr 08:42:17 ntpd[17203]: Listen normally on 4 lo [::1]:123 2024-04-17T08:42:17.106 INFO:teuthology.orchestra.run.smithi152.stdout:17 Apr 08:42:17 ntpd[17203]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6de3%5]:123 2024-04-17T08:42:17.106 INFO:teuthology.orchestra.run.smithi152.stdout:17 Apr 08:42:17 ntpd[17203]: Listening on routing socket on fd #22 for interface updates 2024-04-17T08:42:17.133 INFO:teuthology.orchestra.run.smithi196.stdout:17 Apr 08:42:17 ntpd[17179]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-17T08:42:17.133 INFO:teuthology.orchestra.run.smithi196.stdout:17 Apr 08:42:17 ntpd[17179]: Command line: ntpd -gq 2024-04-17T08:42:17.133 INFO:teuthology.orchestra.run.smithi196.stdout:17 Apr 08:42:17 ntpd[17179]: ---------------------------------------------------- 2024-04-17T08:42:17.134 INFO:teuthology.orchestra.run.smithi196.stdout:17 Apr 08:42:17 ntpd[17179]: ntp-4 is maintained by Network Time Foundation, 2024-04-17T08:42:17.134 INFO:teuthology.orchestra.run.smithi196.stdout:17 Apr 08:42:17 ntpd[17179]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-17T08:42:17.134 INFO:teuthology.orchestra.run.smithi196.stdout:17 Apr 08:42:17 ntpd[17179]: corporation. Support and training for ntp-4 are 2024-04-17T08:42:17.134 INFO:teuthology.orchestra.run.smithi196.stdout:17 Apr 08:42:17 ntpd[17179]: available at https://www.nwtime.org/support 2024-04-17T08:42:17.134 INFO:teuthology.orchestra.run.smithi196.stdout:17 Apr 08:42:17 ntpd[17179]: ---------------------------------------------------- 2024-04-17T08:42:17.134 INFO:teuthology.orchestra.run.smithi196.stdout:17 Apr 08:42:17 ntpd[17179]: proto: precision = 0.044 usec (-24) 2024-04-17T08:42:17.135 INFO:teuthology.orchestra.run.smithi196.stdout:17 Apr 08:42:17 ntpd[17179]: basedate set to 2022-02-04 2024-04-17T08:42:17.135 INFO:teuthology.orchestra.run.smithi196.stdout:17 Apr 08:42:17 ntpd[17179]: gps base set to 2022-02-06 (week 2196) 2024-04-17T08:42:17.135 INFO:teuthology.orchestra.run.smithi196.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-17T08:42:17.135 INFO:teuthology.orchestra.run.smithi196.stdout:17 Apr 08:42:17 ntpd[17179]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-17T08:42:17.135 INFO:teuthology.orchestra.run.smithi196.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-17T08:42:17.137 INFO:teuthology.orchestra.run.smithi196.stdout:17 Apr 08:42:17 ntpd[17179]: restrict ::: KOD does nothing without LIMITED. 2024-04-17T08:42:17.137 INFO:teuthology.orchestra.run.smithi196.stdout:17 Apr 08:42:17 ntpd[17179]: Listen and drop on 0 v6wildcard [::]:123 2024-04-17T08:42:17.137 INFO:teuthology.orchestra.run.smithi196.stdout:17 Apr 08:42:17 ntpd[17179]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-17T08:42:17.137 INFO:teuthology.orchestra.run.smithi196.stdout:17 Apr 08:42:17 ntpd[17179]: Listen normally on 2 lo 127.0.0.1:123 2024-04-17T08:42:17.137 INFO:teuthology.orchestra.run.smithi196.stdout:17 Apr 08:42:17 ntpd[17179]: Listen normally on 3 enp3s0f1 172.21.15.196:123 2024-04-17T08:42:17.137 INFO:teuthology.orchestra.run.smithi196.stdout:17 Apr 08:42:17 ntpd[17179]: Listen normally on 4 lo [::1]:123 2024-04-17T08:42:17.137 INFO:teuthology.orchestra.run.smithi196.stdout:17 Apr 08:42:17 ntpd[17179]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7f47%5]:123 2024-04-17T08:42:17.137 INFO:teuthology.orchestra.run.smithi196.stdout:17 Apr 08:42:17 ntpd[17179]: Listening on routing socket on fd #22 for interface updates 2024-04-17T08:42:18.104 INFO:teuthology.orchestra.run.smithi152.stderr:17 Apr 08:42:18 ntpd[17203]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T08:42:18.104 INFO:teuthology.orchestra.run.smithi152.stderr:17 Apr 08:42:18 ntpd[17203]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T08:42:18.104 INFO:teuthology.orchestra.run.smithi152.stderr:17 Apr 08:42:18 ntpd[17203]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T08:42:18.104 INFO:teuthology.orchestra.run.smithi152.stderr:17 Apr 08:42:18 ntpd[17203]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T08:42:18.104 INFO:teuthology.orchestra.run.smithi152.stderr:17 Apr 08:42:18 ntpd[17203]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T08:42:18.104 INFO:teuthology.orchestra.run.smithi152.stderr:17 Apr 08:42:18 ntpd[17203]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T08:42:20.105 INFO:teuthology.orchestra.run.smithi152.stderr:17 Apr 08:42:20 ntpd[17203]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T08:42:20.105 INFO:teuthology.orchestra.run.smithi152.stderr:17 Apr 08:42:20 ntpd[17203]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T08:42:20.105 INFO:teuthology.orchestra.run.smithi152.stderr:17 Apr 08:42:20 ntpd[17203]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T08:42:20.105 INFO:teuthology.orchestra.run.smithi152.stderr:17 Apr 08:42:20 ntpd[17203]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T08:42:20.105 INFO:teuthology.orchestra.run.smithi152.stderr:17 Apr 08:42:20 ntpd[17203]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T08:42:20.105 INFO:teuthology.orchestra.run.smithi152.stderr:17 Apr 08:42:20 ntpd[17203]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T08:42:20.105 INFO:teuthology.orchestra.run.smithi152.stderr:17 Apr 08:42:20 ntpd[17203]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T08:42:20.105 INFO:teuthology.orchestra.run.smithi152.stderr:17 Apr 08:42:20 ntpd[17203]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T08:42:20.105 INFO:teuthology.orchestra.run.smithi152.stderr:17 Apr 08:42:20 ntpd[17203]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T08:42:20.105 INFO:teuthology.orchestra.run.smithi152.stderr:17 Apr 08:42:20 ntpd[17203]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T08:42:20.106 INFO:teuthology.orchestra.run.smithi152.stderr:17 Apr 08:42:20 ntpd[17203]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T08:42:20.106 INFO:teuthology.orchestra.run.smithi152.stderr:17 Apr 08:42:20 ntpd[17203]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T08:42:20.106 INFO:teuthology.orchestra.run.smithi152.stderr:17 Apr 08:42:20 ntpd[17203]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T08:42:20.106 INFO:teuthology.orchestra.run.smithi152.stderr:17 Apr 08:42:20 ntpd[17203]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T08:42:20.135 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:20 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T08:42:20.135 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:20 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T08:42:20.135 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:20 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T08:42:20.135 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:20 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T08:42:20.135 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:20 ntpd[17179]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T08:42:20.135 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:20 ntpd[17179]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T08:42:21.134 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:21 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T08:42:21.134 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:21 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T08:42:21.134 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:21 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T08:42:21.135 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:21 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T08:42:21.135 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:21 ntpd[17179]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T08:42:21.135 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:21 ntpd[17179]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T08:42:22.105 INFO:teuthology.orchestra.run.smithi152.stderr:17 Apr 08:42:22 ntpd[17203]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T08:42:22.105 INFO:teuthology.orchestra.run.smithi152.stderr:17 Apr 08:42:22 ntpd[17203]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T08:42:22.105 INFO:teuthology.orchestra.run.smithi152.stderr:17 Apr 08:42:22 ntpd[17203]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T08:42:22.105 INFO:teuthology.orchestra.run.smithi152.stderr:17 Apr 08:42:22 ntpd[17203]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T08:42:22.105 INFO:teuthology.orchestra.run.smithi152.stderr:17 Apr 08:42:22 ntpd[17203]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T08:42:22.105 INFO:teuthology.orchestra.run.smithi152.stderr:17 Apr 08:42:22 ntpd[17203]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T08:42:22.105 INFO:teuthology.orchestra.run.smithi152.stderr:17 Apr 08:42:22 ntpd[17203]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T08:42:22.105 INFO:teuthology.orchestra.run.smithi152.stderr:17 Apr 08:42:22 ntpd[17203]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T08:42:22.105 INFO:teuthology.orchestra.run.smithi152.stderr:17 Apr 08:42:22 ntpd[17203]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T08:42:22.105 INFO:teuthology.orchestra.run.smithi152.stderr:17 Apr 08:42:22 ntpd[17203]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T08:42:22.106 INFO:teuthology.orchestra.run.smithi152.stderr:17 Apr 08:42:22 ntpd[17203]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T08:42:22.106 INFO:teuthology.orchestra.run.smithi152.stderr:17 Apr 08:42:22 ntpd[17203]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T08:42:22.106 INFO:teuthology.orchestra.run.smithi152.stderr:17 Apr 08:42:22 ntpd[17203]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T08:42:22.106 INFO:teuthology.orchestra.run.smithi152.stderr:17 Apr 08:42:22 ntpd[17203]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T08:42:22.106 INFO:teuthology.orchestra.run.smithi152.stderr:17 Apr 08:42:22 ntpd[17203]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T08:42:22.106 INFO:teuthology.orchestra.run.smithi152.stderr:17 Apr 08:42:22 ntpd[17203]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T08:42:22.106 INFO:teuthology.orchestra.run.smithi152.stderr:17 Apr 08:42:22 ntpd[17203]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T08:42:22.106 INFO:teuthology.orchestra.run.smithi152.stderr:17 Apr 08:42:22 ntpd[17203]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T08:42:22.135 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:22 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T08:42:22.135 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:22 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T08:42:22.135 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:22 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T08:42:22.135 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:22 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T08:42:22.135 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:22 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T08:42:22.135 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:22 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T08:42:22.135 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:22 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T08:42:22.135 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:22 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T08:42:22.136 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:22 ntpd[17179]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T08:42:22.136 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:22 ntpd[17179]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T08:42:22.136 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:22 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T08:42:22.136 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:22 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T08:42:22.136 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:22 ntpd[17179]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T08:42:22.136 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:22 ntpd[17179]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T08:42:23.134 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:23 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T08:42:23.135 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:23 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T08:42:23.135 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:23 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T08:42:23.135 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:23 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T08:42:23.135 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:23 ntpd[17179]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T08:42:23.135 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:23 ntpd[17179]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T08:42:24.104 INFO:teuthology.orchestra.run.smithi152.stderr:17 Apr 08:42:24 ntpd[17203]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T08:42:24.104 INFO:teuthology.orchestra.run.smithi152.stderr:17 Apr 08:42:24 ntpd[17203]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T08:42:24.104 INFO:teuthology.orchestra.run.smithi152.stderr:17 Apr 08:42:24 ntpd[17203]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T08:42:24.104 INFO:teuthology.orchestra.run.smithi152.stderr:17 Apr 08:42:24 ntpd[17203]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T08:42:24.104 INFO:teuthology.orchestra.run.smithi152.stderr:17 Apr 08:42:24 ntpd[17203]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T08:42:24.104 INFO:teuthology.orchestra.run.smithi152.stderr:17 Apr 08:42:24 ntpd[17203]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T08:42:24.104 INFO:teuthology.orchestra.run.smithi152.stderr:17 Apr 08:42:24 ntpd[17203]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T08:42:24.104 INFO:teuthology.orchestra.run.smithi152.stderr:17 Apr 08:42:24 ntpd[17203]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T08:42:24.105 INFO:teuthology.orchestra.run.smithi152.stderr:17 Apr 08:42:24 ntpd[17203]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T08:42:24.105 INFO:teuthology.orchestra.run.smithi152.stderr:17 Apr 08:42:24 ntpd[17203]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T08:42:24.105 INFO:teuthology.orchestra.run.smithi152.stdout:17 Apr 08:42:24 ntpd[17203]: ntpd: time slew -0.000052 s 2024-04-17T08:42:24.105 INFO:teuthology.orchestra.run.smithi152.stdout:ntpd: time slew -0.000052s 2024-04-17T08:42:24.105 INFO:teuthology.orchestra.run.smithi152.stderr:17 Apr 08:42:24 ntpd[17203]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-17T08:42:24.105 INFO:teuthology.orchestra.run.smithi152.stderr:17 Apr 08:42:24 ntpd[17203]: can't open /var/log/ntpstats/loopstats.20240417: Permission denied 2024-04-17T08:42:24.135 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:24 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T08:42:24.135 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:24 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T08:42:24.135 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:24 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T08:42:24.135 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:24 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T08:42:24.135 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:24 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T08:42:24.135 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:24 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T08:42:24.135 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:24 ntpd[17179]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T08:42:24.135 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:24 ntpd[17179]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T08:42:24.135 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:24 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T08:42:24.135 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:24 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T08:42:24.135 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:24 ntpd[17179]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T08:42:24.135 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:24 ntpd[17179]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T08:42:24.194 INFO:teuthology.orchestra.run.smithi152.stdout: remote refid st t when poll reach delay offset jitter 2024-04-17T08:42:24.195 INFO:teuthology.orchestra.run.smithi152.stdout:============================================================================== 2024-04-17T08:42:24.195 INFO:teuthology.orchestra.run.smithi152.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-17T08:42:24.195 INFO:teuthology.orchestra.run.smithi152.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-17T08:42:24.195 INFO:teuthology.orchestra.run.smithi152.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-17T08:42:24.195 INFO:teuthology.orchestra.run.smithi152.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-17T08:42:25.134 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:25 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T08:42:25.134 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:25 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T08:42:25.135 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:25 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T08:42:25.135 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:25 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T08:42:25.135 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:25 ntpd[17179]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T08:42:25.135 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:25 ntpd[17179]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T08:42:26.135 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:26 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T08:42:26.135 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:26 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T08:42:26.135 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:26 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T08:42:26.135 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:26 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T08:42:26.135 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:26 ntpd[17179]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T08:42:26.135 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:26 ntpd[17179]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T08:42:26.135 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:26 ntpd[17179]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T08:42:26.135 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:26 ntpd[17179]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T08:42:26.135 INFO:teuthology.orchestra.run.smithi196.stdout:17 Apr 08:42:26 ntpd[17179]: ntpd: time slew -0.000052 s 2024-04-17T08:42:26.135 INFO:teuthology.orchestra.run.smithi196.stdout:ntpd: time slew -0.000052s 2024-04-17T08:42:26.136 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:26 ntpd[17179]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-17T08:42:26.136 INFO:teuthology.orchestra.run.smithi196.stderr:17 Apr 08:42:26 ntpd[17179]: can't open /var/log/ntpstats/loopstats.20240417: Permission denied 2024-04-17T08:42:26.251 INFO:teuthology.orchestra.run.smithi196.stdout: remote refid st t when poll reach delay offset jitter 2024-04-17T08:42:26.251 INFO:teuthology.orchestra.run.smithi196.stdout:============================================================================== 2024-04-17T08:42:26.251 INFO:teuthology.orchestra.run.smithi196.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-17T08:42:26.251 INFO:teuthology.orchestra.run.smithi196.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-17T08:42:26.251 INFO:teuthology.orchestra.run.smithi196.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-17T08:42:26.251 INFO:teuthology.orchestra.run.smithi196.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-17T08:42:26.252 INFO:teuthology.run_tasks:Running task install... 2024-04-17T08:42:26.262 DEBUG:teuthology.task.install:project ceph 2024-04-17T08:42:26.262 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda'}} 2024-04-17T08:42:26.262 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda'} 2024-04-17T08:42:26.262 INFO:teuthology.task.install:Using flavor: default 2024-04-17T08:42:26.267 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-17T08:42:26.268 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-17T08:42:26.268 DEBUG:teuthology.orchestra.run.smithi152:> sudo apt-key list | grep Ceph 2024-04-17T08:42:26.268 DEBUG:teuthology.orchestra.run.smithi196:> sudo apt-key list | grep Ceph 2024-04-17T08:42:26.373 INFO:teuthology.orchestra.run.smithi152.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-17T08:42:26.400 INFO:teuthology.orchestra.run.smithi196.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-17T08:42:26.424 INFO:teuthology.orchestra.run.smithi152.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-17T08:42:26.424 INFO:teuthology.orchestra.run.smithi152.stdout:uid [ unknown] Ceph.com (release key) 2024-04-17T08:42:26.425 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-17T08:42:26.425 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-17T08:42:26.425 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a8c84f5997950fd7d008204839253291d52e6eda 2024-04-17T08:42:26.449 INFO:teuthology.orchestra.run.smithi196.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-17T08:42:26.449 INFO:teuthology.orchestra.run.smithi196.stdout:uid [ unknown] Ceph.com (release key) 2024-04-17T08:42:26.450 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-17T08:42:26.450 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-17T08:42:26.450 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a8c84f5997950fd7d008204839253291d52e6eda 2024-04-17T08:42:26.596 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default/ 2024-04-17T08:42:26.596 INFO:teuthology.task.install.deb:Package version is 19.0.0-3133-ga8c84f59-1jammy 2024-04-17T08:42:26.644 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default/ 2024-04-17T08:42:26.644 INFO:teuthology.task.install.deb:Package version is 19.0.0-3133-ga8c84f59-1jammy 2024-04-17T08:42:26.756 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-17T08:42:26.756 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-17T08:42:26.769 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-17T08:42:26.769 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-17T08:42:26.775 DEBUG:teuthology.orchestra.run.smithi152:> sudo apt-get update 2024-04-17T08:42:26.788 DEBUG:teuthology.orchestra.run.smithi196:> sudo apt-get update 2024-04-17T08:42:26.966 INFO:teuthology.orchestra.run.smithi152.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-17T08:42:26.966 INFO:teuthology.orchestra.run.smithi152.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-17T08:42:26.975 INFO:teuthology.orchestra.run.smithi152.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-17T08:42:26.995 INFO:teuthology.orchestra.run.smithi152.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-17T08:42:27.008 INFO:teuthology.orchestra.run.smithi152.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy InRelease 2024-04-17T08:42:27.024 INFO:teuthology.orchestra.run.smithi196.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy InRelease 2024-04-17T08:42:27.029 INFO:teuthology.orchestra.run.smithi152.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-17T08:42:27.045 INFO:teuthology.orchestra.run.smithi196.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-17T08:42:27.051 INFO:teuthology.orchestra.run.smithi152.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-17T08:42:27.068 INFO:teuthology.orchestra.run.smithi196.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-17T08:42:27.072 INFO:teuthology.orchestra.run.smithi152.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,409 B] 2024-04-17T08:42:27.089 INFO:teuthology.orchestra.run.smithi196.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-17T08:42:27.104 INFO:teuthology.orchestra.run.smithi152.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-17T08:42:27.110 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-17T08:42:27.110 INFO:teuthology.orchestra.run.smithi196.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-17T08:42:27.131 INFO:teuthology.orchestra.run.smithi196.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,409 B] 2024-04-17T08:42:27.176 INFO:teuthology.orchestra.run.smithi196.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-17T08:42:27.549 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-17T08:42:27.554 INFO:teuthology.orchestra.run.smithi152.stdout:Fetched 29.2 kB in 1s (52.7 kB/s) 2024-04-17T08:42:27.866 INFO:teuthology.orchestra.run.smithi196.stdout:Fetched 258 kB in 1s (303 kB/s) 2024-04-17T08:42:28.525 INFO:teuthology.orchestra.run.smithi152.stdout:Reading package lists... 2024-04-17T08:42:28.540 DEBUG:teuthology.orchestra.run.smithi152:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3133-ga8c84f59-1jammy cephadm=19.0.0-3133-ga8c84f59-1jammy ceph-mds=19.0.0-3133-ga8c84f59-1jammy ceph-mgr=19.0.0-3133-ga8c84f59-1jammy ceph-common=19.0.0-3133-ga8c84f59-1jammy ceph-fuse=19.0.0-3133-ga8c84f59-1jammy ceph-test=19.0.0-3133-ga8c84f59-1jammy ceph-volume=19.0.0-3133-ga8c84f59-1jammy radosgw=19.0.0-3133-ga8c84f59-1jammy python3-rados=19.0.0-3133-ga8c84f59-1jammy python3-rgw=19.0.0-3133-ga8c84f59-1jammy python3-cephfs=19.0.0-3133-ga8c84f59-1jammy python3-rbd=19.0.0-3133-ga8c84f59-1jammy libcephfs2=19.0.0-3133-ga8c84f59-1jammy libcephfs-dev=19.0.0-3133-ga8c84f59-1jammy librados2=19.0.0-3133-ga8c84f59-1jammy librbd1=19.0.0-3133-ga8c84f59-1jammy rbd-fuse=19.0.0-3133-ga8c84f59-1jammy python3-cephfs=19.0.0-3133-ga8c84f59-1jammy cephfs-shell=19.0.0-3133-ga8c84f59-1jammy cephfs-top=19.0.0-3133-ga8c84f59-1jammy cephfs-mirror=19.0.0-3133-ga8c84f59-1jammy 2024-04-17T08:42:28.614 INFO:teuthology.orchestra.run.smithi152.stdout:Reading package lists... 2024-04-17T08:42:28.785 INFO:teuthology.orchestra.run.smithi152.stdout:Building dependency tree... 2024-04-17T08:42:28.786 INFO:teuthology.orchestra.run.smithi152.stdout:Reading state information... 2024-04-17T08:42:28.835 INFO:teuthology.orchestra.run.smithi196.stdout:Reading package lists... 2024-04-17T08:42:28.850 DEBUG:teuthology.orchestra.run.smithi196:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3133-ga8c84f59-1jammy cephadm=19.0.0-3133-ga8c84f59-1jammy ceph-mds=19.0.0-3133-ga8c84f59-1jammy ceph-mgr=19.0.0-3133-ga8c84f59-1jammy ceph-common=19.0.0-3133-ga8c84f59-1jammy ceph-fuse=19.0.0-3133-ga8c84f59-1jammy ceph-test=19.0.0-3133-ga8c84f59-1jammy ceph-volume=19.0.0-3133-ga8c84f59-1jammy radosgw=19.0.0-3133-ga8c84f59-1jammy python3-rados=19.0.0-3133-ga8c84f59-1jammy python3-rgw=19.0.0-3133-ga8c84f59-1jammy python3-cephfs=19.0.0-3133-ga8c84f59-1jammy python3-rbd=19.0.0-3133-ga8c84f59-1jammy libcephfs2=19.0.0-3133-ga8c84f59-1jammy libcephfs-dev=19.0.0-3133-ga8c84f59-1jammy librados2=19.0.0-3133-ga8c84f59-1jammy librbd1=19.0.0-3133-ga8c84f59-1jammy rbd-fuse=19.0.0-3133-ga8c84f59-1jammy python3-cephfs=19.0.0-3133-ga8c84f59-1jammy cephfs-shell=19.0.0-3133-ga8c84f59-1jammy cephfs-top=19.0.0-3133-ga8c84f59-1jammy cephfs-mirror=19.0.0-3133-ga8c84f59-1jammy 2024-04-17T08:42:28.923 INFO:teuthology.orchestra.run.smithi196.stdout:Reading package lists... 2024-04-17T08:42:28.956 INFO:teuthology.orchestra.run.smithi152.stdout:The following packages were automatically installed and are no longer required: 2024-04-17T08:42:28.956 INFO:teuthology.orchestra.run.smithi152.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-17T08:42:28.956 INFO:teuthology.orchestra.run.smithi152.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-17T08:42:28.956 INFO:teuthology.orchestra.run.smithi152.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-17T08:42:28.956 INFO:teuthology.orchestra.run.smithi152.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-17T08:42:28.957 INFO:teuthology.orchestra.run.smithi152.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-17T08:42:28.957 INFO:teuthology.orchestra.run.smithi152.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-17T08:42:28.957 INFO:teuthology.orchestra.run.smithi152.stdout:The following additional packages will be installed: 2024-04-17T08:42:28.957 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-17T08:42:28.957 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-17T08:42:28.958 INFO:teuthology.orchestra.run.smithi152.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-17T08:42:28.958 INFO:teuthology.orchestra.run.smithi152.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-17T08:42:28.959 INFO:teuthology.orchestra.run.smithi152.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-17T08:42:28.959 INFO:teuthology.orchestra.run.smithi152.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-17T08:42:28.959 INFO:teuthology.orchestra.run.smithi152.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-17T08:42:28.959 INFO:teuthology.orchestra.run.smithi152.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-17T08:42:28.959 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-17T08:42:28.959 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-17T08:42:28.959 INFO:teuthology.orchestra.run.smithi152.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-17T08:42:28.959 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-17T08:42:28.959 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-17T08:42:28.960 INFO:teuthology.orchestra.run.smithi152.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-17T08:42:28.960 INFO:teuthology.orchestra.run.smithi152.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-17T08:42:28.960 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-17T08:42:28.960 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-17T08:42:28.960 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-17T08:42:28.960 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-17T08:42:28.960 INFO:teuthology.orchestra.run.smithi152.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-17T08:42:28.960 INFO:teuthology.orchestra.run.smithi152.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-17T08:42:28.960 INFO:teuthology.orchestra.run.smithi152.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-17T08:42:28.960 INFO:teuthology.orchestra.run.smithi152.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-17T08:42:28.960 INFO:teuthology.orchestra.run.smithi152.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-17T08:42:28.961 INFO:teuthology.orchestra.run.smithi152.stdout:Suggested packages: 2024-04-17T08:42:28.961 INFO:teuthology.orchestra.run.smithi152.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-17T08:42:28.961 INFO:teuthology.orchestra.run.smithi152.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-17T08:42:28.961 INFO:teuthology.orchestra.run.smithi152.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-17T08:42:28.961 INFO:teuthology.orchestra.run.smithi152.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-17T08:42:28.961 INFO:teuthology.orchestra.run.smithi152.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-17T08:42:28.961 INFO:teuthology.orchestra.run.smithi152.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-17T08:42:28.961 INFO:teuthology.orchestra.run.smithi152.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-17T08:42:28.961 INFO:teuthology.orchestra.run.smithi152.stdout:Recommended packages: 2024-04-17T08:42:28.961 INFO:teuthology.orchestra.run.smithi152.stdout: btrfs-tools 2024-04-17T08:42:29.095 INFO:teuthology.orchestra.run.smithi196.stdout:Building dependency tree... 2024-04-17T08:42:29.096 INFO:teuthology.orchestra.run.smithi196.stdout:Reading state information... 2024-04-17T08:42:29.111 INFO:teuthology.orchestra.run.smithi152.stdout:The following NEW packages will be installed: 2024-04-17T08:42:29.112 INFO:teuthology.orchestra.run.smithi152.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-17T08:42:29.112 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-17T08:42:29.112 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-17T08:42:29.112 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-17T08:42:29.113 INFO:teuthology.orchestra.run.smithi152.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-17T08:42:29.113 INFO:teuthology.orchestra.run.smithi152.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-17T08:42:29.114 INFO:teuthology.orchestra.run.smithi152.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-17T08:42:29.114 INFO:teuthology.orchestra.run.smithi152.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-17T08:42:29.114 INFO:teuthology.orchestra.run.smithi152.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-17T08:42:29.114 INFO:teuthology.orchestra.run.smithi152.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-17T08:42:29.114 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-17T08:42:29.114 INFO:teuthology.orchestra.run.smithi152.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-17T08:42:29.114 INFO:teuthology.orchestra.run.smithi152.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-17T08:42:29.114 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-17T08:42:29.114 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-17T08:42:29.114 INFO:teuthology.orchestra.run.smithi152.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-17T08:42:29.114 INFO:teuthology.orchestra.run.smithi152.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-17T08:42:29.114 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-17T08:42:29.114 INFO:teuthology.orchestra.run.smithi152.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-17T08:42:29.114 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-17T08:42:29.115 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-17T08:42:29.115 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-17T08:42:29.115 INFO:teuthology.orchestra.run.smithi152.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-17T08:42:29.115 INFO:teuthology.orchestra.run.smithi152.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-17T08:42:29.115 INFO:teuthology.orchestra.run.smithi152.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-17T08:42:29.115 INFO:teuthology.orchestra.run.smithi152.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-17T08:42:29.115 INFO:teuthology.orchestra.run.smithi152.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-17T08:42:29.115 INFO:teuthology.orchestra.run.smithi152.stdout: socat unzip xmlstarlet zip 2024-04-17T08:42:29.220 INFO:teuthology.orchestra.run.smithi152.stdout:0 upgraded, 124 newly installed, 0 to remove and 305 not upgraded. 2024-04-17T08:42:29.220 INFO:teuthology.orchestra.run.smithi152.stdout:Need to get 182 MB of archives. 2024-04-17T08:42:29.220 INFO:teuthology.orchestra.run.smithi152.stdout:After this operation, 831 MB of additional disk space will be used. 2024-04-17T08:42:29.220 INFO:teuthology.orchestra.run.smithi152.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-17T08:42:29.243 INFO:teuthology.orchestra.run.smithi152.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-17T08:42:29.260 INFO:teuthology.orchestra.run.smithi152.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-17T08:42:29.261 INFO:teuthology.orchestra.run.smithi152.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3133-ga8c84f59-1jammy [3,555 kB] 2024-04-17T08:42:29.271 INFO:teuthology.orchestra.run.smithi196.stdout:The following packages were automatically installed and are no longer required: 2024-04-17T08:42:29.271 INFO:teuthology.orchestra.run.smithi196.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-17T08:42:29.271 INFO:teuthology.orchestra.run.smithi196.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-17T08:42:29.271 INFO:teuthology.orchestra.run.smithi196.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-17T08:42:29.271 INFO:teuthology.orchestra.run.smithi196.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-17T08:42:29.271 INFO:teuthology.orchestra.run.smithi196.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-17T08:42:29.271 INFO:teuthology.orchestra.run.smithi196.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-17T08:42:29.272 INFO:teuthology.orchestra.run.smithi196.stdout:The following additional packages will be installed: 2024-04-17T08:42:29.272 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-17T08:42:29.272 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-17T08:42:29.272 INFO:teuthology.orchestra.run.smithi196.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-17T08:42:29.272 INFO:teuthology.orchestra.run.smithi196.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-17T08:42:29.272 INFO:teuthology.orchestra.run.smithi196.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-17T08:42:29.272 INFO:teuthology.orchestra.run.smithi196.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-17T08:42:29.272 INFO:teuthology.orchestra.run.smithi196.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-17T08:42:29.272 INFO:teuthology.orchestra.run.smithi196.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-17T08:42:29.272 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-17T08:42:29.272 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-17T08:42:29.272 INFO:teuthology.orchestra.run.smithi196.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-17T08:42:29.272 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-17T08:42:29.272 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-17T08:42:29.272 INFO:teuthology.orchestra.run.smithi196.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-17T08:42:29.272 INFO:teuthology.orchestra.run.smithi196.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-17T08:42:29.273 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-17T08:42:29.273 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-17T08:42:29.273 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-17T08:42:29.273 INFO:teuthology.orchestra.run.smithi196.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-17T08:42:29.273 INFO:teuthology.orchestra.run.smithi196.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-17T08:42:29.273 INFO:teuthology.orchestra.run.smithi196.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-17T08:42:29.273 INFO:teuthology.orchestra.run.smithi196.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-17T08:42:29.273 INFO:teuthology.orchestra.run.smithi196.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-17T08:42:29.273 INFO:teuthology.orchestra.run.smithi196.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-17T08:42:29.273 INFO:teuthology.orchestra.run.smithi196.stdout:Suggested packages: 2024-04-17T08:42:29.274 INFO:teuthology.orchestra.run.smithi196.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-17T08:42:29.274 INFO:teuthology.orchestra.run.smithi196.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-17T08:42:29.274 INFO:teuthology.orchestra.run.smithi196.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-17T08:42:29.274 INFO:teuthology.orchestra.run.smithi196.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-17T08:42:29.274 INFO:teuthology.orchestra.run.smithi196.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-17T08:42:29.274 INFO:teuthology.orchestra.run.smithi196.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-17T08:42:29.274 INFO:teuthology.orchestra.run.smithi196.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-17T08:42:29.274 INFO:teuthology.orchestra.run.smithi196.stdout:Recommended packages: 2024-04-17T08:42:29.274 INFO:teuthology.orchestra.run.smithi196.stdout: btrfs-tools 2024-04-17T08:42:29.316 INFO:teuthology.orchestra.run.smithi152.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-17T08:42:29.364 INFO:teuthology.orchestra.run.smithi152.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-17T08:42:29.364 INFO:teuthology.orchestra.run.smithi152.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-17T08:42:29.366 INFO:teuthology.orchestra.run.smithi152.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-17T08:42:29.413 INFO:teuthology.orchestra.run.smithi152.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-17T08:42:29.415 INFO:teuthology.orchestra.run.smithi152.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-17T08:42:29.422 INFO:teuthology.orchestra.run.smithi196.stdout:The following NEW packages will be installed: 2024-04-17T08:42:29.422 INFO:teuthology.orchestra.run.smithi196.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-17T08:42:29.422 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-17T08:42:29.423 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-17T08:42:29.423 INFO:teuthology.orchestra.run.smithi196.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-17T08:42:29.423 INFO:teuthology.orchestra.run.smithi152.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-17T08:42:29.424 INFO:teuthology.orchestra.run.smithi196.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-17T08:42:29.425 INFO:teuthology.orchestra.run.smithi196.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-17T08:42:29.425 INFO:teuthology.orchestra.run.smithi196.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-17T08:42:29.425 INFO:teuthology.orchestra.run.smithi196.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-17T08:42:29.425 INFO:teuthology.orchestra.run.smithi196.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-17T08:42:29.425 INFO:teuthology.orchestra.run.smithi196.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-17T08:42:29.425 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-17T08:42:29.425 INFO:teuthology.orchestra.run.smithi196.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-17T08:42:29.425 INFO:teuthology.orchestra.run.smithi196.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-17T08:42:29.425 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-17T08:42:29.425 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-17T08:42:29.425 INFO:teuthology.orchestra.run.smithi196.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-17T08:42:29.425 INFO:teuthology.orchestra.run.smithi196.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-17T08:42:29.425 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-17T08:42:29.425 INFO:teuthology.orchestra.run.smithi196.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-17T08:42:29.425 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-17T08:42:29.425 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-17T08:42:29.426 INFO:teuthology.orchestra.run.smithi196.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-17T08:42:29.426 INFO:teuthology.orchestra.run.smithi196.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-17T08:42:29.426 INFO:teuthology.orchestra.run.smithi196.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-17T08:42:29.426 INFO:teuthology.orchestra.run.smithi196.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-17T08:42:29.426 INFO:teuthology.orchestra.run.smithi196.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-17T08:42:29.426 INFO:teuthology.orchestra.run.smithi196.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-17T08:42:29.426 INFO:teuthology.orchestra.run.smithi196.stdout: socat unzip xmlstarlet zip 2024-04-17T08:42:29.426 INFO:teuthology.orchestra.run.smithi152.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-17T08:42:29.427 INFO:teuthology.orchestra.run.smithi152.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-17T08:42:29.433 INFO:teuthology.orchestra.run.smithi152.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-17T08:42:29.434 INFO:teuthology.orchestra.run.smithi152.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-17T08:42:29.436 INFO:teuthology.orchestra.run.smithi152.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-17T08:42:29.496 INFO:teuthology.orchestra.run.smithi152.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-17T08:42:29.496 INFO:teuthology.orchestra.run.smithi152.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-17T08:42:29.500 INFO:teuthology.orchestra.run.smithi196.stdout:0 upgraded, 124 newly installed, 0 to remove and 305 not upgraded. 2024-04-17T08:42:29.500 INFO:teuthology.orchestra.run.smithi196.stdout:Need to get 182 MB of archives. 2024-04-17T08:42:29.500 INFO:teuthology.orchestra.run.smithi196.stdout:After this operation, 831 MB of additional disk space will be used. 2024-04-17T08:42:29.500 INFO:teuthology.orchestra.run.smithi196.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-17T08:42:29.518 INFO:teuthology.orchestra.run.smithi152.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-17T08:42:29.520 INFO:teuthology.orchestra.run.smithi152.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-17T08:42:29.521 INFO:teuthology.orchestra.run.smithi196.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-17T08:42:29.522 INFO:teuthology.orchestra.run.smithi152.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-17T08:42:29.522 INFO:teuthology.orchestra.run.smithi152.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-17T08:42:29.523 INFO:teuthology.orchestra.run.smithi152.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-17T08:42:29.524 INFO:teuthology.orchestra.run.smithi152.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-17T08:42:29.533 INFO:teuthology.orchestra.run.smithi196.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-17T08:42:29.544 INFO:teuthology.orchestra.run.smithi152.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-17T08:42:29.544 INFO:teuthology.orchestra.run.smithi152.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-17T08:42:29.545 INFO:teuthology.orchestra.run.smithi152.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-17T08:42:29.545 INFO:teuthology.orchestra.run.smithi152.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-17T08:42:29.546 INFO:teuthology.orchestra.run.smithi152.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-17T08:42:29.546 INFO:teuthology.orchestra.run.smithi152.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-17T08:42:29.548 INFO:teuthology.orchestra.run.smithi152.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-17T08:42:29.548 INFO:teuthology.orchestra.run.smithi152.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-17T08:42:29.549 INFO:teuthology.orchestra.run.smithi152.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-17T08:42:29.564 INFO:teuthology.orchestra.run.smithi152.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-17T08:42:29.569 INFO:teuthology.orchestra.run.smithi152.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-17T08:42:29.570 INFO:teuthology.orchestra.run.smithi152.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-17T08:42:29.570 INFO:teuthology.orchestra.run.smithi152.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-17T08:42:29.571 INFO:teuthology.orchestra.run.smithi152.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-17T08:42:29.572 INFO:teuthology.orchestra.run.smithi152.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-17T08:42:29.572 INFO:teuthology.orchestra.run.smithi152.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-17T08:42:29.577 INFO:teuthology.orchestra.run.smithi152.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-17T08:42:29.577 INFO:teuthology.orchestra.run.smithi152.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-17T08:42:29.582 INFO:teuthology.orchestra.run.smithi196.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-17T08:42:29.583 INFO:teuthology.orchestra.run.smithi152.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-17T08:42:29.600 INFO:teuthology.orchestra.run.smithi152.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-17T08:42:29.601 INFO:teuthology.orchestra.run.smithi152.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-17T08:42:29.603 INFO:teuthology.orchestra.run.smithi152.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-17T08:42:29.603 INFO:teuthology.orchestra.run.smithi152.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-17T08:42:29.604 INFO:teuthology.orchestra.run.smithi152.stdout:Get:48 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3133-ga8c84f59-1jammy [3,224 kB] 2024-04-17T08:42:29.605 INFO:teuthology.orchestra.run.smithi152.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-17T08:42:29.605 INFO:teuthology.orchestra.run.smithi152.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-17T08:42:29.607 INFO:teuthology.orchestra.run.smithi196.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-17T08:42:29.611 INFO:teuthology.orchestra.run.smithi196.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-17T08:42:29.633 INFO:teuthology.orchestra.run.smithi196.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-17T08:42:29.651 INFO:teuthology.orchestra.run.smithi152.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-17T08:42:29.651 INFO:teuthology.orchestra.run.smithi152.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-17T08:42:29.652 INFO:teuthology.orchestra.run.smithi152.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-17T08:42:29.654 INFO:teuthology.orchestra.run.smithi152.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-17T08:42:29.662 INFO:teuthology.orchestra.run.smithi196.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3133-ga8c84f59-1jammy [3,555 kB] 2024-04-17T08:42:29.700 INFO:teuthology.orchestra.run.smithi152.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-17T08:42:29.701 INFO:teuthology.orchestra.run.smithi152.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-17T08:42:29.702 INFO:teuthology.orchestra.run.smithi152.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-17T08:42:29.702 INFO:teuthology.orchestra.run.smithi152.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-17T08:42:29.703 INFO:teuthology.orchestra.run.smithi152.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-17T08:42:29.712 INFO:teuthology.orchestra.run.smithi196.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-17T08:42:29.719 INFO:teuthology.orchestra.run.smithi196.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-17T08:42:29.725 INFO:teuthology.orchestra.run.smithi152.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-17T08:42:29.728 INFO:teuthology.orchestra.run.smithi152.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-17T08:42:29.732 INFO:teuthology.orchestra.run.smithi152.stdout:Get:62 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3133-ga8c84f59-1jammy [716 kB] 2024-04-17T08:42:29.732 INFO:teuthology.orchestra.run.smithi152.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-17T08:42:29.732 INFO:teuthology.orchestra.run.smithi196.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-17T08:42:29.742 INFO:teuthology.orchestra.run.smithi196.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-17T08:42:29.742 INFO:teuthology.orchestra.run.smithi196.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-17T08:42:29.757 INFO:teuthology.orchestra.run.smithi152.stdout:Get:64 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3133-ga8c84f59-1jammy [356 kB] 2024-04-17T08:42:29.757 INFO:teuthology.orchestra.run.smithi152.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-17T08:42:29.757 INFO:teuthology.orchestra.run.smithi152.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-17T08:42:29.758 INFO:teuthology.orchestra.run.smithi196.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-17T08:42:29.760 INFO:teuthology.orchestra.run.smithi196.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-17T08:42:29.762 INFO:teuthology.orchestra.run.smithi196.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-17T08:42:29.763 INFO:teuthology.orchestra.run.smithi196.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-17T08:42:29.763 INFO:teuthology.orchestra.run.smithi196.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-17T08:42:29.768 INFO:teuthology.orchestra.run.smithi152.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-17T08:42:29.769 INFO:teuthology.orchestra.run.smithi152.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-17T08:42:29.769 INFO:teuthology.orchestra.run.smithi152.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-17T08:42:29.770 INFO:teuthology.orchestra.run.smithi152.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-17T08:42:29.770 INFO:teuthology.orchestra.run.smithi152.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-17T08:42:29.771 INFO:teuthology.orchestra.run.smithi152.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-17T08:42:29.772 INFO:teuthology.orchestra.run.smithi152.stdout:Get:73 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3133-ga8c84f59-1jammy [32.8 kB] 2024-04-17T08:42:29.773 INFO:teuthology.orchestra.run.smithi152.stdout:Get:74 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3133-ga8c84f59-1jammy [180 kB] 2024-04-17T08:42:29.774 INFO:teuthology.orchestra.run.smithi152.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-17T08:42:29.777 INFO:teuthology.orchestra.run.smithi152.stdout:Get:76 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3133-ga8c84f59-1jammy [66.9 kB] 2024-04-17T08:42:29.780 INFO:teuthology.orchestra.run.smithi196.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-17T08:42:29.782 INFO:teuthology.orchestra.run.smithi196.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-17T08:42:29.784 INFO:teuthology.orchestra.run.smithi196.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-17T08:42:29.784 INFO:teuthology.orchestra.run.smithi196.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-17T08:42:29.789 INFO:teuthology.orchestra.run.smithi152.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-17T08:42:29.789 INFO:teuthology.orchestra.run.smithi152.stdout:Get:78 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3133-ga8c84f59-1jammy [330 kB] 2024-04-17T08:42:29.790 INFO:teuthology.orchestra.run.smithi152.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-17T08:42:29.791 INFO:teuthology.orchestra.run.smithi152.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-17T08:42:29.793 INFO:teuthology.orchestra.run.smithi152.stdout:Get:81 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3133-ga8c84f59-1jammy [6,890 kB] 2024-04-17T08:42:29.800 INFO:teuthology.orchestra.run.smithi196.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-17T08:42:29.801 INFO:teuthology.orchestra.run.smithi196.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-17T08:42:29.802 INFO:teuthology.orchestra.run.smithi196.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-17T08:42:29.802 INFO:teuthology.orchestra.run.smithi196.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-17T08:42:29.803 INFO:teuthology.orchestra.run.smithi196.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-17T08:42:29.803 INFO:teuthology.orchestra.run.smithi196.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-17T08:42:29.808 INFO:teuthology.orchestra.run.smithi152.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-17T08:42:29.811 INFO:teuthology.orchestra.run.smithi152.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-17T08:42:29.812 INFO:teuthology.orchestra.run.smithi152.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-17T08:42:29.813 INFO:teuthology.orchestra.run.smithi152.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-17T08:42:29.813 INFO:teuthology.orchestra.run.smithi152.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-17T08:42:29.820 INFO:teuthology.orchestra.run.smithi152.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-17T08:42:29.821 INFO:teuthology.orchestra.run.smithi152.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-17T08:42:29.824 INFO:teuthology.orchestra.run.smithi196.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-17T08:42:29.824 INFO:teuthology.orchestra.run.smithi196.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-17T08:42:29.826 INFO:teuthology.orchestra.run.smithi196.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-17T08:42:29.827 INFO:teuthology.orchestra.run.smithi196.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-17T08:42:29.829 INFO:teuthology.orchestra.run.smithi152.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-17T08:42:29.829 INFO:teuthology.orchestra.run.smithi152.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-17T08:42:29.829 INFO:teuthology.orchestra.run.smithi152.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-17T08:42:29.845 INFO:teuthology.orchestra.run.smithi196.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-17T08:42:29.845 INFO:teuthology.orchestra.run.smithi196.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-17T08:42:29.846 INFO:teuthology.orchestra.run.smithi196.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-17T08:42:29.847 INFO:teuthology.orchestra.run.smithi196.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-17T08:42:29.847 INFO:teuthology.orchestra.run.smithi196.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-17T08:42:29.848 INFO:teuthology.orchestra.run.smithi196.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-17T08:42:29.848 INFO:teuthology.orchestra.run.smithi152.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-17T08:42:29.850 INFO:teuthology.orchestra.run.smithi152.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-17T08:42:29.851 INFO:teuthology.orchestra.run.smithi152.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-17T08:42:29.858 INFO:teuthology.orchestra.run.smithi152.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-17T08:42:29.858 INFO:teuthology.orchestra.run.smithi152.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-17T08:42:29.859 INFO:teuthology.orchestra.run.smithi152.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-17T08:42:29.861 INFO:teuthology.orchestra.run.smithi152.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-17T08:42:29.866 INFO:teuthology.orchestra.run.smithi196.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-17T08:42:29.867 INFO:teuthology.orchestra.run.smithi196.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-17T08:42:29.870 INFO:teuthology.orchestra.run.smithi152.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-17T08:42:29.872 INFO:teuthology.orchestra.run.smithi196.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-17T08:42:29.872 INFO:teuthology.orchestra.run.smithi196.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-17T08:42:29.889 INFO:teuthology.orchestra.run.smithi196.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-17T08:42:29.889 INFO:teuthology.orchestra.run.smithi196.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-17T08:42:29.890 INFO:teuthology.orchestra.run.smithi196.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-17T08:42:29.892 INFO:teuthology.orchestra.run.smithi196.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-17T08:42:29.894 INFO:teuthology.orchestra.run.smithi196.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-17T08:42:29.896 INFO:teuthology.orchestra.run.smithi196.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-17T08:42:29.909 INFO:teuthology.orchestra.run.smithi196.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-17T08:42:29.911 INFO:teuthology.orchestra.run.smithi196.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-17T08:42:29.912 INFO:teuthology.orchestra.run.smithi196.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-17T08:42:29.912 INFO:teuthology.orchestra.run.smithi196.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-17T08:42:29.930 INFO:teuthology.orchestra.run.smithi196.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-17T08:42:29.982 INFO:teuthology.orchestra.run.smithi196.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-17T08:42:29.983 INFO:teuthology.orchestra.run.smithi196.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-17T08:42:29.984 INFO:teuthology.orchestra.run.smithi196.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-17T08:42:29.985 INFO:teuthology.orchestra.run.smithi196.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-17T08:42:29.986 INFO:teuthology.orchestra.run.smithi196.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-17T08:42:30.005 INFO:teuthology.orchestra.run.smithi196.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-17T08:42:30.007 INFO:teuthology.orchestra.run.smithi196.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-17T08:42:30.007 INFO:teuthology.orchestra.run.smithi196.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-17T08:42:30.025 INFO:teuthology.orchestra.run.smithi196.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-17T08:42:30.025 INFO:teuthology.orchestra.run.smithi196.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-17T08:42:30.030 INFO:teuthology.orchestra.run.smithi152.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3133-ga8c84f59-1jammy [112 kB] 2024-04-17T08:42:30.031 INFO:teuthology.orchestra.run.smithi152.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3133-ga8c84f59-1jammy [466 kB] 2024-04-17T08:42:30.034 INFO:teuthology.orchestra.run.smithi196.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-17T08:42:30.035 INFO:teuthology.orchestra.run.smithi196.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-17T08:42:30.035 INFO:teuthology.orchestra.run.smithi196.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-17T08:42:30.036 INFO:teuthology.orchestra.run.smithi196.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-17T08:42:30.036 INFO:teuthology.orchestra.run.smithi196.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-17T08:42:30.037 INFO:teuthology.orchestra.run.smithi196.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-17T08:42:30.041 INFO:teuthology.orchestra.run.smithi196.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-17T08:42:30.046 INFO:teuthology.orchestra.run.smithi152.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3133-ga8c84f59-1jammy [25.8 MB] 2024-04-17T08:42:30.055 INFO:teuthology.orchestra.run.smithi196.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-17T08:42:30.057 INFO:teuthology.orchestra.run.smithi196.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-17T08:42:30.057 INFO:teuthology.orchestra.run.smithi196.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-17T08:42:30.076 INFO:teuthology.orchestra.run.smithi196.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-17T08:42:30.078 INFO:teuthology.orchestra.run.smithi196.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-17T08:42:30.079 INFO:teuthology.orchestra.run.smithi196.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-17T08:42:30.080 INFO:teuthology.orchestra.run.smithi196.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-17T08:42:30.081 INFO:teuthology.orchestra.run.smithi196.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-17T08:42:30.085 INFO:teuthology.orchestra.run.smithi196.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-17T08:42:30.086 INFO:teuthology.orchestra.run.smithi196.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-17T08:42:30.096 INFO:teuthology.orchestra.run.smithi196.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-17T08:42:30.096 INFO:teuthology.orchestra.run.smithi196.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-17T08:42:30.097 INFO:teuthology.orchestra.run.smithi196.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-17T08:42:30.117 INFO:teuthology.orchestra.run.smithi196.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-17T08:42:30.119 INFO:teuthology.orchestra.run.smithi196.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-17T08:42:30.120 INFO:teuthology.orchestra.run.smithi196.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-17T08:42:30.126 INFO:teuthology.orchestra.run.smithi196.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-17T08:42:30.127 INFO:teuthology.orchestra.run.smithi196.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-17T08:42:30.127 INFO:teuthology.orchestra.run.smithi196.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-17T08:42:30.130 INFO:teuthology.orchestra.run.smithi196.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-17T08:42:30.140 INFO:teuthology.orchestra.run.smithi196.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-17T08:42:30.941 INFO:teuthology.orchestra.run.smithi152.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3133-ga8c84f59-1jammy [5,092 kB] 2024-04-17T08:42:31.123 INFO:teuthology.orchestra.run.smithi152.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3133-ga8c84f59-1jammy [244 kB] 2024-04-17T08:42:31.130 INFO:teuthology.orchestra.run.smithi152.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3133-ga8c84f59-1jammy [124 kB] 2024-04-17T08:42:31.132 INFO:teuthology.orchestra.run.smithi152.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3133-ga8c84f59-1jammy [1,529 kB] 2024-04-17T08:42:31.183 INFO:teuthology.orchestra.run.smithi152.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3133-ga8c84f59-1jammy [6,259 kB] 2024-04-17T08:42:31.405 INFO:teuthology.orchestra.run.smithi152.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3133-ga8c84f59-1jammy [22.8 MB] 2024-04-17T08:42:31.769 INFO:teuthology.orchestra.run.smithi196.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3133-ga8c84f59-1jammy [3,224 kB] 2024-04-17T08:42:32.247 INFO:teuthology.orchestra.run.smithi152.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3133-ga8c84f59-1jammy [14.0 kB] 2024-04-17T08:42:32.247 INFO:teuthology.orchestra.run.smithi152.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3133-ga8c84f59-1jammy [873 kB] 2024-04-17T08:42:32.276 INFO:teuthology.orchestra.run.smithi152.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3133-ga8c84f59-1jammy [2,437 kB] 2024-04-17T08:42:32.369 INFO:teuthology.orchestra.run.smithi152.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3133-ga8c84f59-1jammy [791 kB] 2024-04-17T08:42:32.397 INFO:teuthology.orchestra.run.smithi152.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3133-ga8c84f59-1jammy [148 kB] 2024-04-17T08:42:32.404 INFO:teuthology.orchestra.run.smithi152.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3133-ga8c84f59-1jammy [2,297 kB] 2024-04-17T08:42:32.493 INFO:teuthology.orchestra.run.smithi152.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3133-ga8c84f59-1jammy [8,625 kB] 2024-04-17T08:42:32.567 INFO:teuthology.orchestra.run.smithi196.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3133-ga8c84f59-1jammy [716 kB] 2024-04-17T08:42:32.719 INFO:teuthology.orchestra.run.smithi196.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3133-ga8c84f59-1jammy [356 kB] 2024-04-17T08:42:32.784 INFO:teuthology.orchestra.run.smithi196.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3133-ga8c84f59-1jammy [32.8 kB] 2024-04-17T08:42:32.794 INFO:teuthology.orchestra.run.smithi196.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3133-ga8c84f59-1jammy [180 kB] 2024-04-17T08:42:32.822 INFO:teuthology.orchestra.run.smithi196.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3133-ga8c84f59-1jammy [66.9 kB] 2024-04-17T08:42:32.832 INFO:teuthology.orchestra.run.smithi152.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3133-ga8c84f59-1jammy [14.2 kB] 2024-04-17T08:42:32.832 INFO:teuthology.orchestra.run.smithi152.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3133-ga8c84f59-1jammy [51.7 MB] 2024-04-17T08:42:32.836 INFO:teuthology.orchestra.run.smithi196.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3133-ga8c84f59-1jammy [330 kB] 2024-04-17T08:42:32.897 INFO:teuthology.orchestra.run.smithi196.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3133-ga8c84f59-1jammy [6,890 kB] 2024-04-17T08:42:33.985 INFO:teuthology.orchestra.run.smithi196.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3133-ga8c84f59-1jammy [112 kB] 2024-04-17T08:42:34.007 INFO:teuthology.orchestra.run.smithi196.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3133-ga8c84f59-1jammy [466 kB] 2024-04-17T08:42:34.075 INFO:teuthology.orchestra.run.smithi196.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3133-ga8c84f59-1jammy [25.8 MB] 2024-04-17T08:42:35.021 INFO:teuthology.orchestra.run.smithi152.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3133-ga8c84f59-1jammy [124 kB] 2024-04-17T08:42:35.022 INFO:teuthology.orchestra.run.smithi152.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3133-ga8c84f59-1jammy [232 kB] 2024-04-17T08:42:35.024 INFO:teuthology.orchestra.run.smithi152.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3133-ga8c84f59-1jammy [34.0 kB] 2024-04-17T08:42:35.024 INFO:teuthology.orchestra.run.smithi152.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3133-ga8c84f59-1jammy [23.4 kB] 2024-04-17T08:42:35.025 INFO:teuthology.orchestra.run.smithi152.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3133-ga8c84f59-1jammy [38.9 kB] 2024-04-17T08:42:35.025 INFO:teuthology.orchestra.run.smithi152.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3133-ga8c84f59-1jammy [13.6 MB] 2024-04-17T08:42:35.622 INFO:teuthology.orchestra.run.smithi152.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3133-ga8c84f59-1jammy [91.4 kB] 2024-04-17T08:42:36.257 INFO:teuthology.orchestra.run.smithi152.stdout:Fetched 182 MB in 6s (28.0 MB/s) 2024-04-17T08:42:36.387 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-17T08:42:36.453 INFO:teuthology.orchestra.run.smithi152.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132922 files and directories currently installed.) 2024-04-17T08:42:36.457 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-17T08:42:36.473 INFO:teuthology.orchestra.run.smithi196.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3133-ga8c84f59-1jammy [5,092 kB] 2024-04-17T08:42:36.494 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-17T08:42:36.760 INFO:teuthology.orchestra.run.smithi196.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3133-ga8c84f59-1jammy [244 kB] 2024-04-17T08:42:36.763 INFO:teuthology.orchestra.run.smithi196.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3133-ga8c84f59-1jammy [124 kB] 2024-04-17T08:42:36.764 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-17T08:42:36.768 INFO:teuthology.orchestra.run.smithi196.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3133-ga8c84f59-1jammy [1,529 kB] 2024-04-17T08:42:36.777 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-17T08:42:36.822 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-17T08:42:36.861 INFO:teuthology.orchestra.run.smithi196.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3133-ga8c84f59-1jammy [6,259 kB] 2024-04-17T08:42:37.133 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-cmd2. 2024-04-17T08:42:37.147 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-17T08:42:37.192 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-17T08:42:37.268 INFO:teuthology.orchestra.run.smithi196.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3133-ga8c84f59-1jammy [22.8 MB] 2024-04-17T08:42:37.529 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-17T08:42:37.542 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-17T08:42:37.629 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-17T08:42:37.958 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-17T08:42:37.971 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-17T08:42:38.016 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-17T08:42:38.311 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-17T08:42:38.325 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-17T08:42:38.370 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-17T08:42:38.498 INFO:teuthology.orchestra.run.smithi196.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3133-ga8c84f59-1jammy [14.0 kB] 2024-04-17T08:42:38.499 INFO:teuthology.orchestra.run.smithi196.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3133-ga8c84f59-1jammy [873 kB] 2024-04-17T08:42:38.537 INFO:teuthology.orchestra.run.smithi196.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3133-ga8c84f59-1jammy [2,437 kB] 2024-04-17T08:42:38.661 INFO:teuthology.orchestra.run.smithi196.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3133-ga8c84f59-1jammy [791 kB] 2024-04-17T08:42:38.715 INFO:teuthology.orchestra.run.smithi196.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3133-ga8c84f59-1jammy [148 kB] 2024-04-17T08:42:38.717 INFO:teuthology.orchestra.run.smithi196.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3133-ga8c84f59-1jammy [2,297 kB] 2024-04-17T08:42:38.807 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-17T08:42:38.822 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-17T08:42:38.833 INFO:teuthology.orchestra.run.smithi196.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3133-ga8c84f59-1jammy [8,625 kB] 2024-04-17T08:42:38.873 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T08:42:39.219 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-17T08:42:39.233 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-17T08:42:39.268 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T08:42:39.298 INFO:teuthology.orchestra.run.smithi196.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3133-ga8c84f59-1jammy [14.2 kB] 2024-04-17T08:42:39.298 INFO:teuthology.orchestra.run.smithi196.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3133-ga8c84f59-1jammy [51.7 MB] 2024-04-17T08:42:39.589 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-17T08:42:39.603 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-17T08:42:39.655 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T08:42:39.992 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-17T08:42:40.007 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-17T08:42:40.058 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-17T08:42:40.454 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package librados2. 2024-04-17T08:42:40.468 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../010-librados2_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T08:42:40.520 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking librados2 (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:42:40.998 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package librbd1. 2024-04-17T08:42:41.013 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../011-librbd1_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T08:42:41.065 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking librbd1 (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:42:41.518 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libcephfs2. 2024-04-17T08:42:41.533 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T08:42:41.576 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libcephfs2 (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:42:41.913 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-rados. 2024-04-17T08:42:41.927 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T08:42:41.979 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-rados (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:42:42.035 INFO:teuthology.orchestra.run.smithi196.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3133-ga8c84f59-1jammy [124 kB] 2024-04-17T08:42:42.036 INFO:teuthology.orchestra.run.smithi196.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3133-ga8c84f59-1jammy [232 kB] 2024-04-17T08:42:42.038 INFO:teuthology.orchestra.run.smithi196.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3133-ga8c84f59-1jammy [34.0 kB] 2024-04-17T08:42:42.049 INFO:teuthology.orchestra.run.smithi196.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3133-ga8c84f59-1jammy [23.4 kB] 2024-04-17T08:42:42.049 INFO:teuthology.orchestra.run.smithi196.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3133-ga8c84f59-1jammy [38.9 kB] 2024-04-17T08:42:42.050 INFO:teuthology.orchestra.run.smithi196.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3133-ga8c84f59-1jammy [13.6 MB] 2024-04-17T08:42:42.365 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-17T08:42:42.380 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3133-ga8c84f59-1jammy_all.deb ... 2024-04-17T08:42:42.432 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-ceph-argparse (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:42:42.735 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-cephfs. 2024-04-17T08:42:42.749 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T08:42:42.774 INFO:teuthology.orchestra.run.smithi196.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3133-ga8c84f59-1jammy [91.4 kB] 2024-04-17T08:42:42.793 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-cephfs (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:42:43.189 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-17T08:42:43.203 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3133-ga8c84f59-1jammy_all.deb ... 2024-04-17T08:42:43.255 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-ceph-common (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:42:43.411 INFO:teuthology.orchestra.run.smithi196.stdout:Fetched 182 MB in 13s (13.6 MB/s) 2024-04-17T08:42:43.554 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-17T08:42:43.621 INFO:teuthology.orchestra.run.smithi196.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132922 files and directories currently installed.) 2024-04-17T08:42:43.624 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-17T08:42:43.658 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-prettytable. 2024-04-17T08:42:43.669 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-17T08:42:43.673 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-17T08:42:43.725 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-17T08:42:43.964 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-17T08:42:43.977 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-17T08:42:44.022 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-17T08:42:44.036 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-rbd. 2024-04-17T08:42:44.051 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T08:42:44.103 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-rbd (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:42:44.316 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-cmd2. 2024-04-17T08:42:44.330 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-17T08:42:44.366 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-17T08:42:44.473 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-17T08:42:44.488 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-17T08:42:44.531 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-17T08:42:44.686 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-17T08:42:44.700 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-17T08:42:44.786 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-17T08:42:44.851 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-17T08:42:44.865 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-17T08:42:44.917 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-17T08:42:45.288 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-17T08:42:45.303 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-17T08:42:45.354 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-17T08:42:45.365 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-17T08:42:45.379 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-17T08:42:45.423 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-17T08:42:45.724 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package lua5.1. 2024-04-17T08:42:45.739 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-17T08:42:45.783 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-17T08:42:45.792 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-17T08:42:45.807 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-17T08:42:45.852 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-17T08:42:46.119 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package lua-any. 2024-04-17T08:42:46.134 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-17T08:42:46.186 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-17T08:42:46.237 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-17T08:42:46.252 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-17T08:42:46.295 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T08:42:46.489 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package zip. 2024-04-17T08:42:46.504 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-17T08:42:46.572 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking zip (3.0-12build2) ... 2024-04-17T08:42:46.690 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-17T08:42:46.705 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-17T08:42:46.774 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T08:42:46.959 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package unzip. 2024-04-17T08:42:46.974 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-17T08:42:47.017 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-17T08:42:47.143 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-17T08:42:47.158 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-17T08:42:47.201 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T08:42:47.422 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package luarocks. 2024-04-17T08:42:47.437 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-17T08:42:47.490 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-17T08:42:47.546 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-17T08:42:47.561 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-17T08:42:47.596 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-17T08:42:47.930 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package librgw2. 2024-04-17T08:42:47.944 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../027-librgw2_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T08:42:47.966 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package librados2. 2024-04-17T08:42:47.981 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../010-librados2_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T08:42:47.997 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking librgw2 (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:42:48.024 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking librados2 (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:42:48.443 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package librbd1. 2024-04-17T08:42:48.458 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../011-librbd1_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T08:42:48.493 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking librbd1 (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:42:48.583 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-rgw. 2024-04-17T08:42:48.598 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T08:42:48.650 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-rgw (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:42:48.871 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libcephfs2. 2024-04-17T08:42:48.884 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T08:42:48.929 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libcephfs2 (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:42:49.223 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-rados. 2024-04-17T08:42:49.237 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T08:42:49.282 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-rados (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:42:49.303 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-17T08:42:49.318 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-17T08:42:49.361 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-17T08:42:49.609 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-17T08:42:49.624 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3133-ga8c84f59-1jammy_all.deb ... 2024-04-17T08:42:49.668 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-ceph-argparse (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:42:49.673 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libradosstriper1. 2024-04-17T08:42:49.688 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T08:42:49.731 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libradosstriper1 (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:42:49.912 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-cephfs. 2024-04-17T08:42:49.926 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T08:42:49.962 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-cephfs (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:42:50.185 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-common. 2024-04-17T08:42:50.200 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T08:42:50.243 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-common (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:42:50.289 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-17T08:42:50.304 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3133-ga8c84f59-1jammy_all.deb ... 2024-04-17T08:42:50.347 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-ceph-common (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:42:50.676 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-prettytable. 2024-04-17T08:42:50.690 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-17T08:42:50.734 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-17T08:42:50.995 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-rbd. 2024-04-17T08:42:51.009 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T08:42:51.053 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-rbd (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:42:51.274 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-base. 2024-04-17T08:42:51.289 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T08:42:51.333 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-base (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:42:51.431 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-17T08:42:51.446 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-17T08:42:51.489 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-17T08:42:51.742 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-17T08:42:51.756 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-17T08:42:51.791 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-17T08:42:51.862 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-17T08:42:51.876 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-17T08:42:51.921 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-17T08:42:52.111 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-17T08:42:52.126 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-17T08:42:52.169 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-17T08:42:52.224 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-cheroot. 2024-04-17T08:42:52.238 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-17T08:42:52.299 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-17T08:42:52.506 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package lua5.1. 2024-04-17T08:42:52.521 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-17T08:42:52.564 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-17T08:42:52.619 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-17T08:42:52.633 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-17T08:42:52.677 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-17T08:42:52.859 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package lua-any. 2024-04-17T08:42:52.873 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-17T08:42:52.908 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-17T08:42:52.947 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-17T08:42:52.962 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-17T08:42:52.997 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-17T08:42:53.128 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package zip. 2024-04-17T08:42:53.142 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-17T08:42:53.186 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking zip (3.0-12build2) ... 2024-04-17T08:42:53.300 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-17T08:42:53.315 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-17T08:42:53.358 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-17T08:42:53.522 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package unzip. 2024-04-17T08:42:53.537 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-17T08:42:53.581 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-17T08:42:53.678 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-tempora. 2024-04-17T08:42:53.693 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-17T08:42:53.736 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-17T08:42:53.984 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package luarocks. 2024-04-17T08:42:53.999 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-17T08:42:54.007 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-portend. 2024-04-17T08:42:54.021 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-17T08:42:54.042 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-17T08:42:54.056 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-17T08:42:54.343 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-17T08:42:54.358 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-17T08:42:54.401 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-17T08:42:54.433 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package librgw2. 2024-04-17T08:42:54.447 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../027-librgw2_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T08:42:54.492 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking librgw2 (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:42:54.713 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-17T08:42:54.726 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-17T08:42:54.771 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-17T08:42:54.927 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-rgw. 2024-04-17T08:42:54.942 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T08:42:54.977 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-rgw (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:42:55.108 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-natsort. 2024-04-17T08:42:55.122 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-17T08:42:55.167 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-17T08:42:55.322 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-17T08:42:55.337 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-17T08:42:55.495 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-logutils. 2024-04-17T08:42:55.509 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-17T08:42:55.553 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-17T08:42:55.587 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-17T08:42:55.859 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-17T08:42:55.873 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-17T08:42:55.917 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-17T08:42:55.950 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libradosstriper1. 2024-04-17T08:42:55.965 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T08:42:56.008 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libradosstriper1 (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:42:56.270 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-mako. 2024-04-17T08:42:56.284 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-17T08:42:56.336 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-17T08:42:56.361 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-common. 2024-04-17T08:42:56.376 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T08:42:56.411 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-common (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:42:56.707 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-17T08:42:56.721 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-17T08:42:56.765 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-17T08:42:57.068 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-17T08:42:57.082 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-17T08:42:57.126 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-17T08:42:57.421 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-webob. 2024-04-17T08:42:57.435 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-17T08:42:57.479 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-17T08:42:57.525 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-base. 2024-04-17T08:42:57.540 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T08:42:57.592 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-base (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:42:57.824 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-waitress. 2024-04-17T08:42:57.838 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-17T08:42:57.885 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-17T08:42:58.177 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-tempita. 2024-04-17T08:42:58.191 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-17T08:42:58.235 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-17T08:42:58.237 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-17T08:42:58.251 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-17T08:42:58.295 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-17T08:42:58.505 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-paste. 2024-04-17T08:42:58.519 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-17T08:42:58.554 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-17T08:42:58.600 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-cheroot. 2024-04-17T08:42:58.614 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-17T08:42:58.658 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-17T08:42:58.925 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-17T08:42:58.939 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-17T08:42:58.983 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-17T08:42:58.986 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-17T08:42:59.000 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-17T08:42:59.070 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-17T08:42:59.339 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-17T08:42:59.354 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-17T08:42:59.389 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-17T08:42:59.419 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-17T08:42:59.434 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-17T08:42:59.469 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-17T08:42:59.692 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-17T08:42:59.707 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-17T08:42:59.747 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-webtest. 2024-04-17T08:42:59.750 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-17T08:42:59.761 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-17T08:42:59.806 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-17T08:43:00.052 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-tempora. 2024-04-17T08:43:00.067 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-17T08:43:00.111 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-17T08:43:00.117 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-pecan. 2024-04-17T08:43:00.130 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-17T08:43:00.175 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-17T08:43:00.413 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-portend. 2024-04-17T08:43:00.428 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-17T08:43:00.463 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-17T08:43:00.555 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-certifi. 2024-04-17T08:43:00.568 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-17T08:43:00.613 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-17T08:43:00.741 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-17T08:43:00.757 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-17T08:43:00.799 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-17T08:43:00.933 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-idna. 2024-04-17T08:43:00.947 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-17T08:43:00.991 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-17T08:43:01.086 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-17T08:43:01.101 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-17T08:43:01.144 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-17T08:43:01.245 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-urllib3. 2024-04-17T08:43:01.257 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-17T08:43:01.294 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-17T08:43:01.464 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-natsort. 2024-04-17T08:43:01.479 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-17T08:43:01.514 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-17T08:43:01.564 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-requests. 2024-04-17T08:43:01.578 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-17T08:43:01.614 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-17T08:43:01.825 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-logutils. 2024-04-17T08:43:01.841 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-17T08:43:01.883 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-17T08:43:01.884 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-17T08:43:01.897 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-17T08:43:01.942 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-17T08:43:02.279 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-17T08:43:02.293 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3133-ga8c84f59-1jammy_all.deb ... 2024-04-17T08:43:02.345 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:43:02.818 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-17T08:43:02.832 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T08:43:02.862 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-17T08:43:02.877 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-17T08:43:02.884 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:43:02.919 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-17T08:43:03.187 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-17T08:43:03.201 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-17T08:43:03.222 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-mako. 2024-04-17T08:43:03.236 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-17T08:43:03.237 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-17T08:43:03.272 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-17T08:43:03.515 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-openssl. 2024-04-17T08:43:03.529 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-17T08:43:03.573 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-17T08:43:03.584 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-17T08:43:03.597 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-17T08:43:03.633 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-17T08:43:03.926 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-mgr. 2024-04-17T08:43:03.941 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T08:43:03.953 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-17T08:43:03.969 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-17T08:43:03.984 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-mgr (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:43:04.011 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-17T08:43:04.314 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-webob. 2024-04-17T08:43:04.331 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-17T08:43:04.371 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-mon. 2024-04-17T08:43:04.372 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-17T08:43:04.386 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T08:43:04.429 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-mon (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:43:04.733 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-waitress. 2024-04-17T08:43:04.748 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-17T08:43:04.794 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-17T08:43:04.966 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-osd. 2024-04-17T08:43:04.977 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T08:43:05.016 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-osd (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:43:05.128 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-tempita. 2024-04-17T08:43:05.143 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-17T08:43:05.186 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-17T08:43:05.447 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-paste. 2024-04-17T08:43:05.462 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-17T08:43:05.497 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-17T08:43:05.792 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-17T08:43:05.794 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph. 2024-04-17T08:43:05.806 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../068-ceph_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T08:43:05.806 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-17T08:43:05.844 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:43:05.850 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-17T08:43:06.144 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-17T08:43:06.159 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-17T08:43:06.164 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-fuse. 2024-04-17T08:43:06.175 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T08:43:06.194 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-17T08:43:06.213 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-fuse (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:43:06.489 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-webtest. 2024-04-17T08:43:06.504 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-17T08:43:06.534 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-mds. 2024-04-17T08:43:06.545 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T08:43:06.547 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-17T08:43:06.575 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-mds (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:43:06.842 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pecan. 2024-04-17T08:43:06.857 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-17T08:43:06.900 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-17T08:43:06.928 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package cephadm. 2024-04-17T08:43:06.940 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../071-cephadm_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T08:43:06.978 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking cephadm (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:43:07.271 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-certifi. 2024-04-17T08:43:07.285 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-17T08:43:07.314 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-17T08:43:07.326 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-17T08:43:07.329 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-17T08:43:07.372 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-17T08:43:07.665 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-idna. 2024-04-17T08:43:07.680 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-17T08:43:07.709 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-17T08:43:07.720 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-17T08:43:07.723 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-17T08:43:07.758 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-17T08:43:08.001 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-urllib3. 2024-04-17T08:43:08.016 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-17T08:43:08.051 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-17T08:43:08.363 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-requests. 2024-04-17T08:43:08.378 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-17T08:43:08.412 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-17T08:43:08.682 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-17T08:43:08.697 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-17T08:43:08.722 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-babel. 2024-04-17T08:43:08.732 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-17T08:43:08.740 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-17T08:43:08.763 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-17T08:43:09.010 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-17T08:43:09.025 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3133-ga8c84f59-1jammy_all.deb ... 2024-04-17T08:43:09.060 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:43:09.092 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-jinja2. 2024-04-17T08:43:09.102 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-17T08:43:09.142 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-17T08:43:09.428 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-17T08:43:09.439 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3133-ga8c84f59-1jammy_all.deb ... 2024-04-17T08:43:09.439 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-17T08:43:09.454 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T08:43:09.478 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:43:09.497 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:43:09.807 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-17T08:43:09.817 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-17T08:43:09.820 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-17T08:43:09.832 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-17T08:43:09.865 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-17T08:43:09.875 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-17T08:43:10.168 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-routes. 2024-04-17T08:43:10.178 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-openssl. 2024-04-17T08:43:10.179 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-17T08:43:10.193 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-17T08:43:10.218 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-17T08:43:10.227 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-17T08:43:10.547 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mgr. 2024-04-17T08:43:10.563 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T08:43:10.563 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-17T08:43:10.575 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3133-ga8c84f59-1jammy_all.deb ... 2024-04-17T08:43:10.597 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mgr (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:43:10.612 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:43:11.250 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mon. 2024-04-17T08:43:11.266 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T08:43:11.308 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mon (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:43:11.893 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-17T08:43:11.905 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-17T08:43:11.943 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-17T08:43:11.945 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-osd. 2024-04-17T08:43:11.960 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T08:43:12.003 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-osd (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:43:12.438 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-joblib. 2024-04-17T08:43:12.450 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-17T08:43:12.488 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-17T08:43:12.798 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph. 2024-04-17T08:43:12.813 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../068-ceph_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T08:43:12.856 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:43:12.875 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-17T08:43:12.890 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-17T08:43:13.019 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-17T08:43:13.159 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-fuse. 2024-04-17T08:43:13.174 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T08:43:13.217 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-fuse (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:43:13.314 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-sklearn. 2024-04-17T08:43:13.330 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-17T08:43:13.372 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-17T08:43:13.587 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mds. 2024-04-17T08:43:13.597 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T08:43:13.636 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mds (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:43:14.023 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-17T08:43:14.036 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3133-ga8c84f59-1jammy_all.deb ... 2024-04-17T08:43:14.047 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package cephadm. 2024-04-17T08:43:14.057 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../071-cephadm_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T08:43:14.073 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:43:14.097 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking cephadm (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:43:14.359 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-17T08:43:14.368 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-17T08:43:14.408 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-17T08:43:14.719 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-17T08:43:14.729 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-17T08:43:14.769 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-17T08:43:15.193 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-cachetools. 2024-04-17T08:43:15.207 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-17T08:43:15.234 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-17T08:43:15.537 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-17T08:43:15.550 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-17T08:43:15.587 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-17T08:43:15.757 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-babel. 2024-04-17T08:43:15.769 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-17T08:43:15.807 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-17T08:43:15.908 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-17T08:43:15.923 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-17T08:43:15.977 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-17T08:43:16.160 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-jinja2. 2024-04-17T08:43:16.169 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-17T08:43:16.210 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-17T08:43:16.319 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-rsa. 2024-04-17T08:43:16.333 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-17T08:43:16.377 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-17T08:43:16.554 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-17T08:43:16.564 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3133-ga8c84f59-1jammy_all.deb ... 2024-04-17T08:43:16.604 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:43:16.698 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-google-auth. 2024-04-17T08:43:16.712 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-17T08:43:16.756 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-17T08:43:16.966 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-17T08:43:16.976 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-17T08:43:17.016 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-17T08:43:17.077 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-17T08:43:17.093 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-17T08:43:17.135 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-17T08:43:17.344 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-routes. 2024-04-17T08:43:17.356 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-17T08:43:17.393 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-17T08:43:17.463 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-websocket. 2024-04-17T08:43:17.477 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-17T08:43:17.521 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-17T08:43:17.738 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-17T08:43:17.749 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3133-ga8c84f59-1jammy_all.deb ... 2024-04-17T08:43:17.788 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:43:17.808 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-17T08:43:17.825 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-17T08:43:17.858 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-17T08:43:18.480 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-17T08:43:18.494 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3133-ga8c84f59-1jammy_all.deb ... 2024-04-17T08:43:18.530 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:43:18.850 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-17T08:43:18.864 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-17T08:43:18.916 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-17T08:43:19.010 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-17T08:43:19.020 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-17T08:43:19.059 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-17T08:43:19.253 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-17T08:43:19.267 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-17T08:43:19.311 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-17T08:43:19.538 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-joblib. 2024-04-17T08:43:19.548 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-17T08:43:19.579 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-17T08:43:19.580 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package jq. 2024-04-17T08:43:19.595 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-17T08:43:19.630 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-17T08:43:19.867 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package socat. 2024-04-17T08:43:19.882 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-17T08:43:19.925 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-17T08:43:19.941 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-17T08:43:19.951 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-17T08:43:20.069 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-17T08:43:20.220 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package xmlstarlet. 2024-04-17T08:43:20.236 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-17T08:43:20.278 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-17T08:43:20.379 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-sklearn. 2024-04-17T08:43:20.392 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-17T08:43:20.437 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-17T08:43:20.599 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-test. 2024-04-17T08:43:20.613 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T08:43:20.649 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-test (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:43:21.138 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-17T08:43:21.149 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3133-ga8c84f59-1jammy_all.deb ... 2024-04-17T08:43:21.187 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:43:22.291 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-cachetools. 2024-04-17T08:43:22.304 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-17T08:43:22.349 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-17T08:43:22.652 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-17T08:43:22.665 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-17T08:43:22.710 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-17T08:43:22.720 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-volume. 2024-04-17T08:43:22.736 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3133-ga8c84f59-1jammy_all.deb ... 2024-04-17T08:43:22.778 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-volume (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:43:23.030 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-17T08:43:23.043 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-17T08:43:23.079 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-17T08:43:23.133 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-17T08:43:23.150 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T08:43:23.190 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking cephfs-mirror (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:43:23.416 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-rsa. 2024-04-17T08:43:23.429 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-17T08:43:23.474 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-17T08:43:23.502 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-colorama. 2024-04-17T08:43:23.518 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-17T08:43:23.560 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-17T08:43:23.795 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-google-auth. 2024-04-17T08:43:23.796 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package cephfs-shell. 2024-04-17T08:43:23.810 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-17T08:43:23.812 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3133-ga8c84f59-1jammy_all.deb ... 2024-04-17T08:43:23.852 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-17T08:43:23.854 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking cephfs-shell (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:43:24.116 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package cephfs-top. 2024-04-17T08:43:24.131 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3133-ga8c84f59-1jammy_all.deb ... 2024-04-17T08:43:24.172 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-17T08:43:24.174 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking cephfs-top (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:43:24.185 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-17T08:43:24.222 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-17T08:43:24.410 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-17T08:43:24.425 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T08:43:24.468 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libcephfs-dev (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:43:24.500 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-websocket. 2024-04-17T08:43:24.516 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-17T08:43:24.550 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-17T08:43:24.779 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-17T08:43:24.795 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-17T08:43:24.829 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-17T08:43:24.836 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-17T08:43:24.850 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-17T08:43:24.886 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-17T08:43:25.142 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-17T08:43:25.158 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-17T08:43:25.200 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-17T08:43:25.571 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package nvme-cli. 2024-04-17T08:43:25.583 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-17T08:43:25.587 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-17T08:43:25.596 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3133-ga8c84f59-1jammy_all.deb ... 2024-04-17T08:43:25.629 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-17T08:43:25.633 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:43:25.952 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-17T08:43:25.965 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-17T08:43:26.002 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-17T08:43:26.018 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package pkg-config. 2024-04-17T08:43:26.034 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-17T08:43:26.076 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-17T08:43:26.346 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-17T08:43:26.361 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-17T08:43:26.404 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-17T08:43:26.522 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-17T08:43:26.535 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-17T08:43:26.588 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-17T08:43:26.799 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-17T08:43:26.814 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-17T08:43:26.825 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package jq. 2024-04-17T08:43:26.838 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-17T08:43:26.849 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-17T08:43:26.883 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-17T08:43:27.136 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package socat. 2024-04-17T08:43:27.144 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-pastescript. 2024-04-17T08:43:27.149 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-17T08:43:27.159 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-17T08:43:27.193 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-17T08:43:27.202 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-17T08:43:27.513 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package xmlstarlet. 2024-04-17T08:43:27.522 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-pluggy. 2024-04-17T08:43:27.527 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-17T08:43:27.538 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-17T08:43:27.571 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-17T08:43:27.580 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-17T08:43:27.891 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-psutil. 2024-04-17T08:43:27.907 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-17T08:43:27.950 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-17T08:43:27.959 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-test. 2024-04-17T08:43:27.972 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T08:43:28.009 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-test (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:43:28.303 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-py. 2024-04-17T08:43:28.319 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-17T08:43:28.361 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-17T08:43:28.690 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-pygments. 2024-04-17T08:43:28.706 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-17T08:43:28.747 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-17T08:43:29.169 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-17T08:43:29.184 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-17T08:43:29.227 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-17T08:43:29.530 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-toml. 2024-04-17T08:43:29.546 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-17T08:43:29.588 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-17T08:43:29.907 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-pytest. 2024-04-17T08:43:29.923 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-17T08:43:29.965 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-17T08:43:30.105 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-volume. 2024-04-17T08:43:30.118 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3133-ga8c84f59-1jammy_all.deb ... 2024-04-17T08:43:30.162 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-volume (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:43:30.261 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-simplejson. 2024-04-17T08:43:30.277 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-17T08:43:30.310 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-17T08:43:30.556 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-17T08:43:30.567 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-17T08:43:30.572 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-17T08:43:30.581 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T08:43:30.614 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-17T08:43:30.624 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking cephfs-mirror (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:43:30.911 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-colorama. 2024-04-17T08:43:30.924 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-17T08:43:30.960 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-17T08:43:31.163 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package cephfs-shell. 2024-04-17T08:43:31.177 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3133-ga8c84f59-1jammy_all.deb ... 2024-04-17T08:43:31.221 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking cephfs-shell (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:43:31.335 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package radosgw. 2024-04-17T08:43:31.349 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../122-radosgw_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T08:43:31.384 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking radosgw (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:43:31.507 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package cephfs-top. 2024-04-17T08:43:31.521 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3133-ga8c84f59-1jammy_all.deb ... 2024-04-17T08:43:31.565 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking cephfs-top (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:43:31.818 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-17T08:43:31.832 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T08:43:31.876 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libcephfs-dev (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:43:32.021 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package rbd-fuse. 2024-04-17T08:43:32.037 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T08:43:32.079 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking rbd-fuse (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:43:32.204 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-17T08:43:32.218 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-17T08:43:32.262 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-17T08:43:32.382 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-17T08:43:32.608 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-17T08:43:32.622 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-17T08:43:32.643 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-17T08:43:32.658 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-17T08:43:32.769 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-17T08:43:33.023 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-17T08:43:33.036 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package nvme-cli. 2024-04-17T08:43:33.050 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-17T08:43:33.095 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-17T08:43:33.415 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-17T08:43:33.500 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package pkg-config. 2024-04-17T08:43:33.513 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-17T08:43:33.591 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-17T08:43:33.836 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-17T08:43:33.849 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-17T08:43:33.894 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-17T08:43:34.105 INFO:teuthology.orchestra.run.smithi152.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-17T08:43:34.144 INFO:teuthology.orchestra.run.smithi152.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-04-17T08:43:34.188 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up cephadm (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:43:34.330 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-17T08:43:34.343 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-17T08:43:34.388 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-17T08:43:34.683 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pastescript. 2024-04-17T08:43:34.697 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-17T08:43:34.734 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-17T08:43:35.038 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pluggy. 2024-04-17T08:43:35.051 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-17T08:43:35.096 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-17T08:43:35.152 INFO:teuthology.orchestra.run.smithi152.stdout:Adding system user cephadm....done 2024-04-17T08:43:35.313 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-17T08:43:35.407 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-psutil. 2024-04-17T08:43:35.420 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-17T08:43:35.465 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-17T08:43:35.835 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-py. 2024-04-17T08:43:35.848 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-17T08:43:35.884 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-17T08:43:35.931 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-17T08:43:36.163 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pygments. 2024-04-17T08:43:36.176 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-17T08:43:36.182 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-17T08:43:36.212 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-17T08:43:36.322 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-17T08:43:36.576 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-17T08:43:36.877 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-17T08:43:36.967 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-17T08:43:36.981 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-17T08:43:36.994 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-17T08:43:37.025 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-17T08:43:37.294 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-toml. 2024-04-17T08:43:37.296 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-17T08:43:37.308 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-17T08:43:37.344 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-17T08:43:37.638 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pytest. 2024-04-17T08:43:37.652 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-17T08:43:37.664 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-17T08:43:37.696 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-17T08:43:37.924 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-17T08:43:38.058 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-simplejson. 2024-04-17T08:43:38.072 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-17T08:43:38.108 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-17T08:43:38.275 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-17T08:43:38.336 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-17T08:43:38.350 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-17T08:43:38.386 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-17T08:43:38.534 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-17T08:43:38.819 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-17T08:43:39.073 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package radosgw. 2024-04-17T08:43:39.078 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-17T08:43:39.085 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../122-radosgw_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T08:43:39.123 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking radosgw (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:43:39.330 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-17T08:43:39.589 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-ceph-argparse (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:43:39.717 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package rbd-fuse. 2024-04-17T08:43:39.731 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3133-ga8c84f59-1jammy_amd64.deb ... 2024-04-17T08:43:39.784 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking rbd-fuse (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:43:39.856 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-17T08:43:39.982 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-17T08:43:40.083 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-17T08:43:40.094 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-17T08:43:40.359 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-17T08:43:40.372 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-17T08:43:40.485 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-17T08:43:40.498 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-17T08:43:40.734 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-17T08:43:40.745 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-17T08:43:41.131 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-17T08:43:41.137 INFO:teuthology.orchestra.run.smithi152.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-17T08:43:41.167 INFO:teuthology.orchestra.run.smithi152.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-17T08:43:41.231 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-17T08:43:41.357 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-17T08:43:41.725 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-17T08:43:41.774 INFO:teuthology.orchestra.run.smithi196.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-17T08:43:41.814 INFO:teuthology.orchestra.run.smithi196.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-04-17T08:43:41.850 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-17T08:43:42.034 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up cephadm (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:43:42.126 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-17T08:43:42.403 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-17T08:43:42.611 INFO:teuthology.orchestra.run.smithi196.stdout:Adding system user cephadm....done 2024-04-17T08:43:42.704 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up zip (3.0-12build2) ... 2024-04-17T08:43:42.756 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-17T08:43:42.830 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-17T08:43:43.042 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-17T08:43:43.309 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-17T08:43:43.435 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-17T08:43:43.515 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-17T08:43:43.695 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-17T08:43:43.774 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-17T08:43:43.909 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-17T08:43:43.945 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-17T08:43:44.026 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-17T08:43:44.071 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-17T08:43:44.353 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-17T08:43:44.381 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-17T08:43:44.737 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-17T08:43:44.783 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-17T08:43:44.988 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-17T08:43:45.026 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-17T08:43:45.286 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-17T08:43:45.390 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-17T08:43:45.545 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-17T08:43:45.674 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-17T08:43:45.796 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-17T08:43:45.983 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-17T08:43:46.072 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-17T08:43:46.318 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-17T08:43:46.340 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-17T08:43:46.586 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-17T08:43:46.608 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-ceph-argparse (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:43:46.712 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-ceph-common (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:43:46.909 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-17T08:43:47.013 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-idna (3.3-1) ... 2024-04-17T08:43:47.147 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-17T08:43:47.311 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-17T08:43:47.373 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-17T08:43:47.587 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-17T08:43:47.713 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-17T08:43:47.981 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-17T08:43:48.377 INFO:teuthology.orchestra.run.smithi196.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-17T08:43:48.436 INFO:teuthology.orchestra.run.smithi196.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-17T08:43:48.500 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-17T08:43:48.597 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-17T08:43:48.610 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-17T08:43:48.848 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T08:43:48.961 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-17T08:43:49.014 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-17T08:43:49.087 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-17T08:43:49.284 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-17T08:43:49.363 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-17T08:43:49.402 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-17T08:43:49.535 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-17T08:43:49.639 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-17T08:43:49.837 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-17T08:43:49.932 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up zip (3.0-12build2) ... 2024-04-17T08:43:50.057 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-17T08:43:50.105 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-17T08:43:50.381 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T08:43:50.506 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-17T08:43:50.751 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-17T08:43:50.833 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-17T08:43:51.003 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-17T08:43:51.092 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-17T08:43:51.128 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-17T08:43:51.279 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-17T08:43:51.368 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-17T08:43:51.597 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-17T08:43:51.628 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-17T08:43:51.887 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-17T08:43:52.163 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-17T08:43:52.289 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-17T08:43:52.307 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-17T08:43:52.558 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-17T08:43:52.581 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-17T08:43:52.716 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-17T08:43:52.976 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-17T08:43:53.000 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-17T08:43:53.277 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-17T08:43:53.309 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-17T08:43:53.578 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-17T08:43:53.587 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-17T08:43:53.686 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-17T08:43:53.813 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-17T08:43:53.901 INFO:teuthology.orchestra.run.smithi152.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-17T08:43:53.938 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-17T08:43:54.147 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-17T08:43:54.189 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-17T08:43:54.282 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-17T08:43:54.290 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-ceph-common (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:43:54.583 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-idna (3.3-1) ... 2024-04-17T08:43:54.667 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-17T08:43:54.926 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-17T08:43:54.934 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-17T08:43:55.060 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-17T08:43:55.303 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T08:43:55.429 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-17T08:43:55.764 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-17T08:43:56.081 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-17T08:43:56.140 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-17T08:43:56.358 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T08:43:56.374 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-17T08:43:56.493 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-17T08:43:56.760 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-17T08:43:56.868 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-17T08:43:56.878 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-17T08:43:57.004 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-17T08:43:57.120 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-17T08:43:57.338 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-17T08:43:57.397 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-17T08:43:57.606 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-17T08:43:57.672 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-17T08:43:57.866 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T08:43:57.992 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-17T08:43:58.048 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-17T08:43:58.293 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-17T08:43:58.349 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-17T08:43:58.536 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-17T08:43:58.702 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-17T08:43:58.795 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-17T08:43:58.811 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up librados2 (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:43:58.937 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:43:59.054 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-17T08:43:59.063 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-17T08:43:59.339 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-17T08:43:59.424 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libcephfs2 (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:43:59.550 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libradosstriper1 (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:43:59.615 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-17T08:43:59.676 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-17T08:43:59.740 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-17T08:43:59.978 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up librbd1 (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:00.042 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-17T08:44:00.095 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-mgr-modules-core (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:00.143 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-17T08:44:00.221 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-fuse (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:00.430 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-17T08:44:00.430 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-17T08:44:00.453 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-17T08:44:00.761 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-17T08:44:01.021 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-17T08:44:01.056 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libcephfs-dev (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:01.147 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-17T08:44:01.215 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-rados (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:01.273 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-17T08:44:01.341 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up librgw2 (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:01.361 INFO:teuthology.orchestra.run.smithi196.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-17T08:44:01.467 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up cephfs-top (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:01.593 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-17T08:44:01.600 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-17T08:44:01.717 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-17T08:44:02.094 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-17T08:44:02.345 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-17T08:44:02.470 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-17T08:44:02.738 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T08:44:02.864 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-17T08:44:02.871 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-rbd (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:03.064 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up rbd-fuse (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:03.190 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-rgw (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:03.198 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-17T08:44:03.316 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-cephfs (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:03.458 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up cephfs-shell (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:03.517 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-17T08:44:03.584 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-common (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:03.809 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-17T08:44:04.012 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-17T08:44:04.137 INFO:teuthology.orchestra.run.smithi152.stdout:Adding group ceph....done 2024-04-17T08:44:04.280 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-17T08:44:04.513 INFO:teuthology.orchestra.run.smithi152.stdout:Adding system user ceph....done 2024-04-17T08:44:04.556 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-17T08:44:04.707 INFO:teuthology.orchestra.run.smithi152.stdout:Setting system user ceph properties....done 2024-04-17T08:44:04.724 INFO:teuthology.orchestra.run.smithi152.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-17T08:44:04.824 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-17T08:44:04.867 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-17T08:44:05.226 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-17T08:44:05.272 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-17T08:44:05.502 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-17T08:44:05.854 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-17T08:44:05.980 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up librados2 (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:05.993 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up cephfs-mirror (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:06.132 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:06.203 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-17T08:44:06.203 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-17T08:44:06.266 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-17T08:44:06.544 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libcephfs2 (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:06.670 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libradosstriper1 (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:06.796 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-17T08:44:06.811 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-test (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:06.928 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up radosgw (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:07.097 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up librbd1 (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:07.248 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mgr-modules-core (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:07.374 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-fuse (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:07.584 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-17T08:44:07.589 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-17T08:44:07.650 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-17T08:44:07.650 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-17T08:44:08.200 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libcephfs-dev (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:08.248 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-base (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:08.326 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-rados (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:08.435 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up librgw2 (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:08.561 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up cephfs-top (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:08.606 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-17T08:44:08.687 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-17T08:44:09.274 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-mds (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:09.662 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-17T08:44:09.662 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-17T08:44:09.958 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-rbd (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:10.083 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up rbd-fuse (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:10.184 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-rgw (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:10.285 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-cephfs (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:10.317 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-mgr (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:10.386 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up cephfs-shell (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:10.529 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-17T08:44:10.529 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-17T08:44:10.546 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-common (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:11.073 INFO:teuthology.orchestra.run.smithi196.stdout:Adding group ceph....done 2024-04-17T08:44:11.160 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-osd (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:11.433 INFO:teuthology.orchestra.run.smithi196.stdout:Adding system user ceph....done 2024-04-17T08:44:11.453 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-17T08:44:11.453 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-17T08:44:11.594 INFO:teuthology.orchestra.run.smithi196.stdout:Setting system user ceph properties....done 2024-04-17T08:44:11.610 INFO:teuthology.orchestra.run.smithi196.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-17T08:44:11.750 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-17T08:44:12.086 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:12.147 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-17T08:44:12.237 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:12.371 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-mon (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:12.580 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-17T08:44:12.580 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-17T08:44:13.043 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up cephfs-mirror (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:13.223 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-mgr-cephadm (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:13.235 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-17T08:44:13.236 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-17T08:44:13.365 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:13.491 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-mgr-dashboard (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:13.634 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-volume (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:13.894 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-test (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:13.995 INFO:teuthology.orchestra.run.smithi152.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-17T08:44:14.011 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up radosgw (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:14.095 INFO:teuthology.orchestra.run.smithi152.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-17T08:44:14.239 INFO:teuthology.orchestra.run.smithi152.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-17T08:44:14.549 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-17T08:44:14.549 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-17T08:44:15.197 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-base (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:15.339 INFO:teuthology.orchestra.run.smithi152.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-17T08:44:15.552 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-17T08:44:16.057 INFO:teuthology.orchestra.run.smithi152.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-17T08:44:16.062 DEBUG:teuthology.orchestra.run.smithi152:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-17T08:44:16.135 INFO:teuthology.orchestra.run.smithi152.stdout:Reading package lists... 2024-04-17T08:44:16.224 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mds (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:16.316 INFO:teuthology.orchestra.run.smithi152.stdout:Building dependency tree... 2024-04-17T08:44:16.317 INFO:teuthology.orchestra.run.smithi152.stdout:Reading state information... 2024-04-17T08:44:16.446 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-17T08:44:16.446 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-17T08:44:16.491 INFO:teuthology.orchestra.run.smithi152.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-17T08:44:16.491 INFO:teuthology.orchestra.run.smithi152.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-17T08:44:16.491 INFO:teuthology.orchestra.run.smithi152.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-17T08:44:16.491 INFO:teuthology.orchestra.run.smithi152.stdout:The following packages were automatically installed and are no longer required: 2024-04-17T08:44:16.491 INFO:teuthology.orchestra.run.smithi152.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-17T08:44:16.491 INFO:teuthology.orchestra.run.smithi152.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-17T08:44:16.491 INFO:teuthology.orchestra.run.smithi152.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-17T08:44:16.492 INFO:teuthology.orchestra.run.smithi152.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-17T08:44:16.492 INFO:teuthology.orchestra.run.smithi152.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-17T08:44:16.492 INFO:teuthology.orchestra.run.smithi152.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-17T08:44:16.493 INFO:teuthology.orchestra.run.smithi152.stdout:The following additional packages will be installed: 2024-04-17T08:44:16.493 INFO:teuthology.orchestra.run.smithi152.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-17T08:44:16.493 INFO:teuthology.orchestra.run.smithi152.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-17T08:44:16.493 INFO:teuthology.orchestra.run.smithi152.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-17T08:44:16.494 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-17T08:44:16.494 INFO:teuthology.orchestra.run.smithi152.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-17T08:44:16.494 INFO:teuthology.orchestra.run.smithi152.stdout:Suggested packages: 2024-04-17T08:44:16.495 INFO:teuthology.orchestra.run.smithi152.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-17T08:44:16.495 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-17T08:44:16.495 INFO:teuthology.orchestra.run.smithi152.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-17T08:44:16.549 INFO:teuthology.orchestra.run.smithi152.stdout:The following NEW packages will be installed: 2024-04-17T08:44:16.549 INFO:teuthology.orchestra.run.smithi152.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-17T08:44:16.549 INFO:teuthology.orchestra.run.smithi152.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-17T08:44:16.550 INFO:teuthology.orchestra.run.smithi152.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-17T08:44:16.550 INFO:teuthology.orchestra.run.smithi152.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-17T08:44:16.550 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-17T08:44:16.550 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-17T08:44:16.550 INFO:teuthology.orchestra.run.smithi152.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-17T08:44:16.551 INFO:teuthology.orchestra.run.smithi152.stdout:The following packages will be upgraded: 2024-04-17T08:44:16.552 INFO:teuthology.orchestra.run.smithi152.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-17T08:44:16.748 INFO:teuthology.orchestra.run.smithi152.stdout:4 upgraded, 39 newly installed, 0 to remove and 301 not upgraded. 2024-04-17T08:44:16.748 INFO:teuthology.orchestra.run.smithi152.stdout:Need to get 55.7 MB of archives. 2024-04-17T08:44:16.748 INFO:teuthology.orchestra.run.smithi152.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-17T08:44:16.748 INFO:teuthology.orchestra.run.smithi152.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-17T08:44:17.092 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mgr (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:17.287 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-17T08:44:17.288 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-17T08:44:17.588 INFO:teuthology.orchestra.run.smithi152.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-17T08:44:17.652 INFO:teuthology.orchestra.run.smithi152.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-17T08:44:17.932 INFO:teuthology.orchestra.run.smithi152.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-17T08:44:17.933 INFO:teuthology.orchestra.run.smithi152.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-17T08:44:17.935 INFO:teuthology.orchestra.run.smithi152.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-17T08:44:18.004 INFO:teuthology.orchestra.run.smithi152.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-17T08:44:18.007 INFO:teuthology.orchestra.run.smithi152.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-17T08:44:18.010 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-osd (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:18.023 INFO:teuthology.orchestra.run.smithi152.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-17T08:44:18.035 INFO:teuthology.orchestra.run.smithi152.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-17T08:44:18.042 INFO:teuthology.orchestra.run.smithi152.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-17T08:44:18.218 INFO:teuthology.orchestra.run.smithi152.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-17T08:44:18.307 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-17T08:44:18.308 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-17T08:44:18.516 INFO:teuthology.orchestra.run.smithi152.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-17T08:44:18.529 INFO:teuthology.orchestra.run.smithi152.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-17T08:44:18.535 INFO:teuthology.orchestra.run.smithi152.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-17T08:44:18.679 INFO:teuthology.orchestra.run.smithi152.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-17T08:44:18.953 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:19.078 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:19.221 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mon (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:19.430 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-17T08:44:19.430 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-17T08:44:20.072 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mgr-cephadm (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:20.215 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:20.333 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mgr-dashboard (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:20.450 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-volume (19.0.0-3133-ga8c84f59-1jammy) ... 2024-04-17T08:44:20.795 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-17T08:44:20.903 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-17T08:44:21.056 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-17T08:44:22.165 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-17T08:44:22.601 INFO:teuthology.orchestra.run.smithi152.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-17T08:44:22.603 INFO:teuthology.orchestra.run.smithi152.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-17T08:44:22.604 INFO:teuthology.orchestra.run.smithi152.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-17T08:44:22.651 INFO:teuthology.orchestra.run.smithi152.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-17T08:44:22.657 INFO:teuthology.orchestra.run.smithi152.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-17T08:44:22.673 INFO:teuthology.orchestra.run.smithi152.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-17T08:44:22.846 INFO:teuthology.orchestra.run.smithi152.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-17T08:44:22.881 INFO:teuthology.orchestra.run.smithi196.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-17T08:44:22.886 DEBUG:teuthology.orchestra.run.smithi196:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-17T08:44:22.960 INFO:teuthology.orchestra.run.smithi196.stdout:Reading package lists... 2024-04-17T08:44:23.133 INFO:teuthology.orchestra.run.smithi196.stdout:Building dependency tree... 2024-04-17T08:44:23.134 INFO:teuthology.orchestra.run.smithi196.stdout:Reading state information... 2024-04-17T08:44:23.308 INFO:teuthology.orchestra.run.smithi196.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-17T08:44:23.308 INFO:teuthology.orchestra.run.smithi196.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-17T08:44:23.308 INFO:teuthology.orchestra.run.smithi196.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-17T08:44:23.308 INFO:teuthology.orchestra.run.smithi196.stdout:The following packages were automatically installed and are no longer required: 2024-04-17T08:44:23.308 INFO:teuthology.orchestra.run.smithi196.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-17T08:44:23.308 INFO:teuthology.orchestra.run.smithi196.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-17T08:44:23.308 INFO:teuthology.orchestra.run.smithi196.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-17T08:44:23.308 INFO:teuthology.orchestra.run.smithi196.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-17T08:44:23.309 INFO:teuthology.orchestra.run.smithi196.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-17T08:44:23.309 INFO:teuthology.orchestra.run.smithi196.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-17T08:44:23.309 INFO:teuthology.orchestra.run.smithi196.stdout:The following additional packages will be installed: 2024-04-17T08:44:23.310 INFO:teuthology.orchestra.run.smithi196.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-17T08:44:23.310 INFO:teuthology.orchestra.run.smithi196.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-17T08:44:23.310 INFO:teuthology.orchestra.run.smithi196.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-17T08:44:23.310 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-17T08:44:23.310 INFO:teuthology.orchestra.run.smithi196.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-17T08:44:23.311 INFO:teuthology.orchestra.run.smithi196.stdout:Suggested packages: 2024-04-17T08:44:23.311 INFO:teuthology.orchestra.run.smithi196.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-17T08:44:23.311 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-17T08:44:23.311 INFO:teuthology.orchestra.run.smithi196.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-17T08:44:23.364 INFO:teuthology.orchestra.run.smithi196.stdout:The following NEW packages will be installed: 2024-04-17T08:44:23.365 INFO:teuthology.orchestra.run.smithi196.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-17T08:44:23.365 INFO:teuthology.orchestra.run.smithi196.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-17T08:44:23.365 INFO:teuthology.orchestra.run.smithi196.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-17T08:44:23.365 INFO:teuthology.orchestra.run.smithi196.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-17T08:44:23.365 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-17T08:44:23.366 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-17T08:44:23.366 INFO:teuthology.orchestra.run.smithi196.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-17T08:44:23.366 INFO:teuthology.orchestra.run.smithi196.stdout:The following packages will be upgraded: 2024-04-17T08:44:23.367 INFO:teuthology.orchestra.run.smithi196.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-17T08:44:23.430 INFO:teuthology.orchestra.run.smithi196.stdout:4 upgraded, 39 newly installed, 0 to remove and 301 not upgraded. 2024-04-17T08:44:23.430 INFO:teuthology.orchestra.run.smithi196.stdout:Need to get 55.7 MB of archives. 2024-04-17T08:44:23.430 INFO:teuthology.orchestra.run.smithi196.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-17T08:44:23.430 INFO:teuthology.orchestra.run.smithi196.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-17T08:44:23.642 INFO:teuthology.orchestra.run.smithi196.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-17T08:44:23.645 INFO:teuthology.orchestra.run.smithi196.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-17T08:44:23.691 INFO:teuthology.orchestra.run.smithi196.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-17T08:44:23.692 INFO:teuthology.orchestra.run.smithi196.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-17T08:44:23.692 INFO:teuthology.orchestra.run.smithi196.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-17T08:44:23.700 INFO:teuthology.orchestra.run.smithi196.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-17T08:44:23.701 INFO:teuthology.orchestra.run.smithi196.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-17T08:44:23.702 INFO:teuthology.orchestra.run.smithi196.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-17T08:44:23.703 INFO:teuthology.orchestra.run.smithi196.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-17T08:44:23.704 INFO:teuthology.orchestra.run.smithi196.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-17T08:44:23.705 INFO:teuthology.orchestra.run.smithi196.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-17T08:44:23.720 INFO:teuthology.orchestra.run.smithi196.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-17T08:44:23.728 INFO:teuthology.orchestra.run.smithi196.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-17T08:44:23.728 INFO:teuthology.orchestra.run.smithi196.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-17T08:44:23.729 INFO:teuthology.orchestra.run.smithi196.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-17T08:44:23.958 INFO:teuthology.orchestra.run.smithi152.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-17T08:44:23.958 INFO:teuthology.orchestra.run.smithi196.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-17T08:44:23.959 INFO:teuthology.orchestra.run.smithi152.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-17T08:44:23.961 INFO:teuthology.orchestra.run.smithi196.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-17T08:44:23.961 INFO:teuthology.orchestra.run.smithi196.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-17T08:44:23.965 INFO:teuthology.orchestra.run.smithi196.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-17T08:44:23.965 INFO:teuthology.orchestra.run.smithi196.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-17T08:44:23.969 INFO:teuthology.orchestra.run.smithi196.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-17T08:44:23.971 INFO:teuthology.orchestra.run.smithi196.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-17T08:44:23.979 INFO:teuthology.orchestra.run.smithi196.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-17T08:44:23.980 INFO:teuthology.orchestra.run.smithi196.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-17T08:44:24.003 INFO:teuthology.orchestra.run.smithi196.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-17T08:44:24.004 INFO:teuthology.orchestra.run.smithi196.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-17T08:44:24.016 INFO:teuthology.orchestra.run.smithi196.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-17T08:44:24.051 INFO:teuthology.orchestra.run.smithi196.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-17T08:44:24.056 INFO:teuthology.orchestra.run.smithi196.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-17T08:44:24.057 INFO:teuthology.orchestra.run.smithi196.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-17T08:44:24.057 INFO:teuthology.orchestra.run.smithi196.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-17T08:44:24.058 INFO:teuthology.orchestra.run.smithi196.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-17T08:44:24.074 INFO:teuthology.orchestra.run.smithi196.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-17T08:44:24.082 INFO:teuthology.orchestra.run.smithi196.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-17T08:44:24.246 INFO:teuthology.orchestra.run.smithi196.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-17T08:44:24.246 INFO:teuthology.orchestra.run.smithi196.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-17T08:44:24.247 INFO:teuthology.orchestra.run.smithi196.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-17T08:44:24.247 INFO:teuthology.orchestra.run.smithi196.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-17T08:44:24.247 INFO:teuthology.orchestra.run.smithi196.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-17T08:44:24.247 INFO:teuthology.orchestra.run.smithi196.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-17T08:44:24.261 INFO:teuthology.orchestra.run.smithi196.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-17T08:44:24.261 INFO:teuthology.orchestra.run.smithi196.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-17T08:44:24.350 INFO:teuthology.orchestra.run.smithi152.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-17T08:44:24.351 INFO:teuthology.orchestra.run.smithi152.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-17T08:44:24.479 INFO:teuthology.orchestra.run.smithi152.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-17T08:44:24.640 INFO:teuthology.orchestra.run.smithi196.stdout:Preconfiguring packages ... 2024-04-17T08:44:24.689 INFO:teuthology.orchestra.run.smithi152.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-17T08:44:24.804 INFO:teuthology.orchestra.run.smithi196.stdout:Fetched 55.7 MB in 1s (62.9 MB/s) 2024-04-17T08:44:24.841 INFO:teuthology.orchestra.run.smithi152.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-17T08:44:24.873 INFO:teuthology.orchestra.run.smithi152.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-17T08:44:24.874 INFO:teuthology.orchestra.run.smithi152.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-17T08:44:24.875 INFO:teuthology.orchestra.run.smithi152.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-17T08:44:25.033 INFO:teuthology.orchestra.run.smithi196.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140923 files and directories currently installed.) 2024-04-17T08:44:25.037 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-17T08:44:25.204 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-17T08:44:25.243 INFO:teuthology.orchestra.run.smithi152.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-17T08:44:25.671 INFO:teuthology.orchestra.run.smithi152.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-17T08:44:25.828 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-17T08:44:26.948 INFO:teuthology.orchestra.run.smithi196.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-17T08:44:27.244 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package flex. 2024-04-17T08:44:27.344 INFO:teuthology.orchestra.run.smithi196.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140923 files and directories currently installed.) 2024-04-17T08:44:27.348 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-17T08:44:27.392 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-17T08:44:28.013 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-17T08:44:28.485 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-17T08:44:29.153 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-17T08:44:29.802 INFO:teuthology.orchestra.run.smithi196.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140996 files and directories currently installed.) 2024-04-17T08:44:29.805 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-17T08:44:29.973 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-17T08:44:30.343 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-17T08:44:30.479 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-17T08:44:30.826 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-17T08:44:31.121 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package bison. 2024-04-17T08:44:31.191 INFO:teuthology.orchestra.run.smithi196.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140996 files and directories currently installed.) 2024-04-17T08:44:31.198 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-17T08:44:31.240 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-17T08:44:31.649 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-17T08:44:31.663 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-17T08:44:31.707 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-17T08:44:32.044 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package dump. 2024-04-17T08:44:32.058 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-17T08:44:32.094 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking dump (0.4b47-3) ... 2024-04-17T08:44:32.381 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package indent. 2024-04-17T08:44:32.395 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-17T08:44:32.439 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-17T08:44:32.716 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-17T08:44:32.731 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-17T08:44:32.775 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-17T08:44:33.096 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-17T08:44:33.110 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-17T08:44:33.145 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-17T08:44:33.381 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-17T08:44:33.396 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-17T08:44:33.440 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-17T08:44:33.793 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-17T08:44:33.807 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-17T08:44:33.851 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-17T08:44:33.936 INFO:teuthology.orchestra.run.smithi152.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-17T08:44:33.936 INFO:teuthology.orchestra.run.smithi152.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-17T08:44:33.936 INFO:teuthology.orchestra.run.smithi152.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-17T08:44:33.936 INFO:teuthology.orchestra.run.smithi152.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-17T08:44:33.938 INFO:teuthology.orchestra.run.smithi152.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-17T08:44:33.941 INFO:teuthology.orchestra.run.smithi152.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-17T08:44:34.129 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-17T08:44:34.143 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-17T08:44:34.187 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-17T08:44:34.226 INFO:teuthology.orchestra.run.smithi152.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-17T08:44:34.241 INFO:teuthology.orchestra.run.smithi152.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-17T08:44:34.407 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libjson-perl. 2024-04-17T08:44:34.421 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-17T08:44:34.507 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-17T08:44:34.642 INFO:teuthology.orchestra.run.smithi152.stdout:Preconfiguring packages ... 2024-04-17T08:44:34.798 INFO:teuthology.orchestra.run.smithi152.stdout:Fetched 55.7 MB in 18s (3,149 kB/s) 2024-04-17T08:44:34.810 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-17T08:44:34.824 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-17T08:44:34.868 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-17T08:44:35.068 INFO:teuthology.orchestra.run.smithi152.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140923 files and directories currently installed.) 2024-04-17T08:44:35.072 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-17T08:44:35.231 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-17T08:44:35.872 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-17T08:44:36.238 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-17T08:44:36.253 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-17T08:44:36.321 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-17T08:44:36.590 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-17T08:44:36.605 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-17T08:44:36.640 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-17T08:44:36.943 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-17T08:44:36.958 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-17T08:44:36.973 INFO:teuthology.orchestra.run.smithi152.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-17T08:44:37.001 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-17T08:44:37.235 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package flex. 2024-04-17T08:44:37.305 INFO:teuthology.orchestra.run.smithi152.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140923 files and directories currently installed.) 2024-04-17T08:44:37.308 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-17T08:44:37.337 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-17T08:44:37.353 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-17T08:44:37.386 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-17T08:44:37.420 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-17T08:44:37.748 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-17T08:44:37.766 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-17T08:44:37.807 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-17T08:44:38.110 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-17T08:44:38.125 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-17T08:44:38.168 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-17T08:44:38.246 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-17T08:44:38.398 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-17T08:44:38.563 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-17T08:44:38.578 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-17T08:44:38.621 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-17T08:44:38.797 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-17T08:44:38.907 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-17T08:44:38.922 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-17T08:44:38.965 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-17T08:44:39.201 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-17T08:44:39.216 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-17T08:44:39.251 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-17T08:44:39.343 INFO:teuthology.orchestra.run.smithi152.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140996 files and directories currently installed.) 2024-04-17T08:44:39.347 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-17T08:44:39.471 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-17T08:44:39.821 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-17T08:44:39.833 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-17T08:44:39.835 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-17T08:44:39.879 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-17T08:44:39.969 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-17T08:44:40.224 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package modemmanager. 2024-04-17T08:44:40.238 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-17T08:44:40.273 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-17T08:44:40.282 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-17T08:44:40.760 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package bison. 2024-04-17T08:44:40.831 INFO:teuthology.orchestra.run.smithi152.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140996 files and directories currently installed.) 2024-04-17T08:44:40.834 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-17T08:44:40.880 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-17T08:44:40.922 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package network-manager. 2024-04-17T08:44:40.937 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-17T08:44:40.988 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-17T08:44:41.238 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-17T08:44:41.253 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-17T08:44:41.297 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-17T08:44:41.591 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package dump. 2024-04-17T08:44:41.606 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-17T08:44:41.641 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking dump (0.4b47-3) ... 2024-04-17T08:44:41.646 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ppp. 2024-04-17T08:44:41.662 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-17T08:44:41.903 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package indent. 2024-04-17T08:44:41.917 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-17T08:44:41.961 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-17T08:44:42.012 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-17T08:44:42.214 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-17T08:44:42.228 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-17T08:44:42.274 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-17T08:44:42.334 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package pptp-linux. 2024-04-17T08:44:42.348 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-17T08:44:42.393 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-17T08:44:42.603 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-17T08:44:42.603 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-17T08:44:42.617 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-17T08:44:42.617 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-17T08:44:42.661 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-17T08:44:42.661 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-17T08:44:42.922 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-17T08:44:42.936 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-17T08:44:42.964 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-17T08:44:42.979 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-17T08:44:42.980 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-17T08:44:43.031 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking postgresql-client-common (238) ... 2024-04-17T08:44:43.308 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-17T08:44:43.318 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-17T08:44:43.323 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-17T08:44:43.332 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-17T08:44:43.366 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-17T08:44:43.378 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-17T08:44:43.602 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-17T08:44:43.617 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-17T08:44:43.652 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-17T08:44:43.863 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libjson-perl. 2024-04-17T08:44:43.877 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-17T08:44:43.922 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-17T08:44:43.922 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package postgresql-common. 2024-04-17T08:44:43.937 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-17T08:44:43.998 INFO:teuthology.orchestra.run.smithi196.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-17T08:44:44.029 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking postgresql-common (238) ... 2024-04-17T08:44:44.224 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-17T08:44:44.239 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-17T08:44:44.308 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-17T08:44:44.521 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package postgresql-14. 2024-04-17T08:44:44.538 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-17T08:44:44.582 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-17T08:44:45.652 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-17T08:44:45.668 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-17T08:44:45.702 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-17T08:44:45.963 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-17T08:44:45.978 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-17T08:44:46.046 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-17T08:44:46.182 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package postgresql. 2024-04-17T08:44:46.197 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-17T08:44:46.240 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking postgresql (14+238) ... 2024-04-17T08:44:46.365 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-17T08:44:46.382 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-17T08:44:46.424 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-17T08:44:46.476 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package postgresql-client. 2024-04-17T08:44:46.490 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-17T08:44:46.534 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking postgresql-client (14+238) ... 2024-04-17T08:44:46.768 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-17T08:44:46.778 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-17T08:44:46.784 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-17T08:44:46.795 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-17T08:44:46.826 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-17T08:44:46.836 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-17T08:44:47.139 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package tcl8.6. 2024-04-17T08:44:47.146 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-17T08:44:47.153 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-17T08:44:47.162 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-17T08:44:47.197 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-17T08:44:47.204 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-17T08:44:47.474 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package tcl. 2024-04-17T08:44:47.489 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-17T08:44:47.537 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-17T08:44:47.566 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-17T08:44:47.582 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-17T08:44:47.623 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-17T08:44:47.869 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package wpasupplicant. 2024-04-17T08:44:47.883 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-17T08:44:47.919 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-17T08:44:48.151 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-17T08:44:48.168 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-17T08:44:48.273 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-17T08:44:48.287 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-17T08:44:48.331 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-17T08:44:48.418 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-17T08:44:48.704 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-17T08:44:48.709 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-17T08:44:48.719 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-17T08:44:48.724 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-17T08:44:48.762 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-17T08:44:48.775 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-17T08:44:49.006 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-17T08:44:49.022 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-17T08:44:49.073 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-17T08:44:49.092 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up postgresql-client-common (238) ... 2024-04-17T08:44:49.273 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-17T08:44:49.374 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-17T08:44:49.492 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-17T08:44:49.610 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-17T08:44:49.625 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-17T08:44:49.626 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-17T08:44:49.668 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-17T08:44:49.752 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-17T08:44:49.878 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-17T08:44:50.013 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package modemmanager. 2024-04-17T08:44:50.028 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-17T08:44:50.074 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-17T08:44:50.719 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package network-manager. 2024-04-17T08:44:50.734 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-17T08:44:50.785 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-17T08:44:50.822 INFO:teuthology.orchestra.run.smithi196.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-17T08:44:50.917 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-17T08:44:51.337 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-17T08:44:51.337 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-17T08:44:51.400 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ppp. 2024-04-17T08:44:51.416 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-17T08:44:51.787 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-17T08:44:52.028 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-17T08:44:52.121 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package pptp-linux. 2024-04-17T08:44:52.135 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-17T08:44:52.154 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-17T08:44:52.180 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-17T08:44:52.305 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-17T08:44:52.406 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-17T08:44:52.415 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-17T08:44:52.430 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-17T08:44:52.473 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-17T08:44:52.507 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-17T08:44:52.608 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-17T08:44:52.734 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-17T08:44:52.743 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-17T08:44:52.757 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-17T08:44:52.801 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking postgresql-client-common (238) ... 2024-04-17T08:44:52.868 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-17T08:44:53.121 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-17T08:44:53.136 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-17T08:44:53.180 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-17T08:44:53.632 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-17T08:44:53.692 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package postgresql-common. 2024-04-17T08:44:53.707 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-17T08:44:53.732 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up dump (0.4b47-3) ... 2024-04-17T08:44:53.767 INFO:teuthology.orchestra.run.smithi152.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-17T08:44:53.799 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking postgresql-common (238) ... 2024-04-17T08:44:53.819 INFO:teuthology.orchestra.run.smithi196.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-17T08:44:53.884 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-17T08:44:54.018 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-17T08:44:54.145 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-17T08:44:54.232 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package postgresql-14. 2024-04-17T08:44:54.247 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-17T08:44:54.270 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-17T08:44:54.293 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-17T08:44:54.396 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-17T08:44:54.486 INFO:teuthology.orchestra.run.smithi196.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-17T08:44:54.573 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-17T08:44:54.682 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-17T08:44:54.834 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-17T08:44:54.968 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-17T08:44:55.094 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-17T08:44:55.279 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up postgresql-client (14+238) ... 2024-04-17T08:44:55.351 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package postgresql. 2024-04-17T08:44:55.366 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-17T08:44:55.405 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-17T08:44:55.409 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking postgresql (14+238) ... 2024-04-17T08:44:55.636 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package postgresql-client. 2024-04-17T08:44:55.651 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-17T08:44:55.686 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking postgresql-client (14+238) ... 2024-04-17T08:44:55.905 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-17T08:44:55.919 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-17T08:44:55.963 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-17T08:44:56.282 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package tcl8.6. 2024-04-17T08:44:56.289 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-17T08:44:56.289 INFO:teuthology.orchestra.run.smithi196.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-17T08:44:56.289 INFO:teuthology.orchestra.run.smithi196.stdout:which means they are currently configured by ifupdown: 2024-04-17T08:44:56.289 INFO:teuthology.orchestra.run.smithi196.stdout:- enp3s0f1 2024-04-17T08:44:56.290 INFO:teuthology.orchestra.run.smithi196.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-17T08:44:56.290 INFO:teuthology.orchestra.run.smithi196.stdout:remove their configuration from /etc/network/interfaces. 2024-04-17T08:44:56.290 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-17T08:44:56.297 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-17T08:44:56.341 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-17T08:44:56.432 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-17T08:44:56.651 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package tcl. 2024-04-17T08:44:56.666 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-17T08:44:56.713 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-17T08:44:56.841 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-17T08:44:57.054 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package wpasupplicant. 2024-04-17T08:44:57.069 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-17T08:44:57.104 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-17T08:44:57.260 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-17T08:44:57.441 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-17T08:44:57.461 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-17T08:44:57.499 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-17T08:44:57.886 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-17T08:44:57.893 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-17T08:44:57.943 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-17T08:44:57.974 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-17T08:44:58.109 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-17T08:44:58.231 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up postgresql-client-common (238) ... 2024-04-17T08:44:58.243 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-17T08:44:58.378 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up postgresql-common (238) ... 2024-04-17T08:44:58.441 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-17T08:44:58.567 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-17T08:44:58.693 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-17T08:44:58.803 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-17T08:44:58.920 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-17T08:44:59.046 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-17T08:44:59.335 INFO:teuthology.orchestra.run.smithi196.stdout:Adding user postgres to group ssl-cert 2024-04-17T08:44:59.590 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-17T08:44:59.590 INFO:teuthology.orchestra.run.smithi196.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-17T08:44:59.842 INFO:teuthology.orchestra.run.smithi196.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-17T08:44:59.842 INFO:teuthology.orchestra.run.smithi196.stdout:Removing obsolete dictionary files: 2024-04-17T08:44:59.990 INFO:teuthology.orchestra.run.smithi152.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-17T08:45:00.126 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-17T08:45:00.504 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-17T08:45:00.504 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-17T08:45:00.592 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-17T08:45:01.112 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-17T08:45:01.179 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-17T08:45:01.330 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-17T08:45:01.449 INFO:teuthology.orchestra.run.smithi196.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-17T08:45:01.467 INFO:teuthology.orchestra.run.smithi196.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-17T08:45:01.481 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-17T08:45:01.521 INFO:teuthology.orchestra.run.smithi196.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-17T08:45:01.521 INFO:teuthology.orchestra.run.smithi196.stdout:This user must also own the server process. 2024-04-17T08:45:01.521 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-17T08:45:01.521 INFO:teuthology.orchestra.run.smithi196.stdout:The database cluster will be initialized with locale "en_US". 2024-04-17T08:45:01.521 INFO:teuthology.orchestra.run.smithi196.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-17T08:45:01.522 INFO:teuthology.orchestra.run.smithi196.stdout:The default text search configuration will be set to "english". 2024-04-17T08:45:01.522 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-17T08:45:01.522 INFO:teuthology.orchestra.run.smithi196.stdout:Data page checksums are disabled. 2024-04-17T08:45:01.522 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-17T08:45:01.522 INFO:teuthology.orchestra.run.smithi196.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-17T08:45:01.522 INFO:teuthology.orchestra.run.smithi196.stdout:creating subdirectories ... ok 2024-04-17T08:45:01.523 INFO:teuthology.orchestra.run.smithi196.stdout:selecting dynamic shared memory implementation ... posix 2024-04-17T08:45:01.547 INFO:teuthology.orchestra.run.smithi196.stdout:selecting default max_connections ... 100 2024-04-17T08:45:01.580 INFO:teuthology.orchestra.run.smithi196.stdout:selecting default shared_buffers ... 128MB 2024-04-17T08:45:01.594 INFO:teuthology.orchestra.run.smithi196.stdout:selecting default time zone ... Etc/UTC 2024-04-17T08:45:01.595 INFO:teuthology.orchestra.run.smithi196.stdout:creating configuration files ... ok 2024-04-17T08:45:01.648 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-17T08:45:01.760 INFO:teuthology.orchestra.run.smithi196.stdout:running bootstrap script ... ok 2024-04-17T08:45:01.799 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-17T08:45:01.959 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-17T08:45:02.110 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-17T08:45:02.236 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-17T08:45:02.354 INFO:teuthology.orchestra.run.smithi196.stdout:performing post-bootstrap initialization ... ok 2024-04-17T08:45:02.908 INFO:teuthology.orchestra.run.smithi196.stdout:syncing data to disk ... ok 2024-04-17T08:45:02.991 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-17T08:45:03.142 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up dump (0.4b47-3) ... 2024-04-17T08:45:03.253 INFO:teuthology.orchestra.run.smithi152.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-17T08:45:03.352 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-17T08:45:03.432 INFO:teuthology.orchestra.run.smithi196.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-17T08:45:03.478 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-17T08:45:03.604 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-17T08:45:03.755 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-17T08:45:03.906 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-17T08:45:04.012 INFO:teuthology.orchestra.run.smithi152.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-17T08:45:04.091 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-17T08:45:04.242 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-17T08:45:04.451 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-17T08:45:04.602 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-17T08:45:04.728 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-17T08:45:04.896 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up postgresql-client (14+238) ... 2024-04-17T08:45:04.997 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-17T08:45:05.591 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:45:05.591 INFO:teuthology.orchestra.run.smithi152.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-17T08:45:05.592 INFO:teuthology.orchestra.run.smithi152.stdout:which means they are currently configured by ifupdown: 2024-04-17T08:45:05.592 INFO:teuthology.orchestra.run.smithi152.stdout:- enp3s0f1 2024-04-17T08:45:05.592 INFO:teuthology.orchestra.run.smithi152.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-17T08:45:05.592 INFO:teuthology.orchestra.run.smithi152.stdout:remove their configuration from /etc/network/interfaces. 2024-04-17T08:45:05.592 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:45:05.723 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-17T08:45:06.126 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-17T08:45:06.519 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-17T08:45:06.536 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-17T08:45:06.662 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-17T08:45:06.788 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up postgresql (14+238) ... 2024-04-17T08:45:06.906 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-17T08:45:07.007 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-17T08:45:07.250 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-17T08:45:07.251 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-17T08:45:07.283 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-17T08:45:07.434 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-17T08:45:07.535 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-17T08:45:07.661 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up postgresql-common (238) ... 2024-04-17T08:45:08.034 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-17T08:45:08.127 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-17T08:45:08.504 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-17T08:45:08.581 INFO:teuthology.orchestra.run.smithi152.stdout:Adding user postgres to group ssl-cert 2024-04-17T08:45:08.655 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-17T08:45:08.832 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:45:08.832 INFO:teuthology.orchestra.run.smithi152.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-17T08:45:09.078 INFO:teuthology.orchestra.run.smithi152.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-17T08:45:09.078 INFO:teuthology.orchestra.run.smithi152.stdout:Removing obsolete dictionary files: 2024-04-17T08:45:09.820 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-17T08:45:09.999 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-17T08:45:10.082 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-17T08:45:10.304 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-17T08:45:10.623 INFO:teuthology.orchestra.run.smithi196.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-17T08:45:10.630 DEBUG:teuthology.parallel:result is None 2024-04-17T08:45:10.647 INFO:teuthology.orchestra.run.smithi152.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-17T08:45:10.669 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-17T08:45:10.761 INFO:teuthology.orchestra.run.smithi152.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-17T08:45:10.761 INFO:teuthology.orchestra.run.smithi152.stdout:This user must also own the server process. 2024-04-17T08:45:10.761 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:45:10.761 INFO:teuthology.orchestra.run.smithi152.stdout:The database cluster will be initialized with locale "en_US". 2024-04-17T08:45:10.761 INFO:teuthology.orchestra.run.smithi152.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-17T08:45:10.761 INFO:teuthology.orchestra.run.smithi152.stdout:The default text search configuration will be set to "english". 2024-04-17T08:45:10.762 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:45:10.762 INFO:teuthology.orchestra.run.smithi152.stdout:Data page checksums are disabled. 2024-04-17T08:45:10.762 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:45:10.762 INFO:teuthology.orchestra.run.smithi152.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-17T08:45:10.762 INFO:teuthology.orchestra.run.smithi152.stdout:creating subdirectories ... ok 2024-04-17T08:45:10.763 INFO:teuthology.orchestra.run.smithi152.stdout:selecting dynamic shared memory implementation ... posix 2024-04-17T08:45:10.785 INFO:teuthology.orchestra.run.smithi152.stdout:selecting default max_connections ... 100 2024-04-17T08:45:10.820 INFO:teuthology.orchestra.run.smithi152.stdout:selecting default shared_buffers ... 128MB 2024-04-17T08:45:10.834 INFO:teuthology.orchestra.run.smithi152.stdout:selecting default time zone ... Etc/UTC 2024-04-17T08:45:10.835 INFO:teuthology.orchestra.run.smithi152.stdout:creating configuration files ... ok 2024-04-17T08:45:11.001 INFO:teuthology.orchestra.run.smithi152.stdout:running bootstrap script ... ok 2024-04-17T08:45:11.703 INFO:teuthology.orchestra.run.smithi152.stdout:performing post-bootstrap initialization ... ok 2024-04-17T08:45:12.243 INFO:teuthology.orchestra.run.smithi152.stdout:syncing data to disk ... ok 2024-04-17T08:45:12.759 INFO:teuthology.orchestra.run.smithi152.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-17T08:45:16.243 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-17T08:45:16.376 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-17T08:45:16.477 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up postgresql (14+238) ... 2024-04-17T08:45:16.603 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-17T08:45:16.729 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-17T08:45:16.991 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-17T08:45:16.991 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-17T08:45:17.740 INFO:teuthology.orchestra.run.smithi152.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-17T08:45:17.840 INFO:teuthology.orchestra.run.smithi152.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-17T08:45:18.167 INFO:teuthology.orchestra.run.smithi152.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-17T08:45:18.310 INFO:teuthology.orchestra.run.smithi152.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-17T08:45:19.411 INFO:teuthology.orchestra.run.smithi152.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-17T08:45:19.494 INFO:teuthology.orchestra.run.smithi152.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-17T08:45:20.007 INFO:teuthology.orchestra.run.smithi152.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-17T08:45:20.013 DEBUG:teuthology.parallel:result is None 2024-04-17T08:45:20.014 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a8c84f5997950fd7d008204839253291d52e6eda 2024-04-17T08:45:20.243 DEBUG:teuthology.orchestra.run.smithi152:> dpkg-query -W -f '${Version}' ceph 2024-04-17T08:45:20.265 INFO:teuthology.orchestra.run.smithi152.stdout:19.0.0-3133-ga8c84f59-1jammy 2024-04-17T08:45:20.265 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3133-ga8c84f59-1jammy 2024-04-17T08:45:20.265 INFO:teuthology.task.install:The correct ceph version 19.0.0-3133-ga8c84f59-1jammy is installed. 2024-04-17T08:45:20.267 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a8c84f5997950fd7d008204839253291d52e6eda 2024-04-17T08:45:20.484 DEBUG:teuthology.orchestra.run.smithi196:> dpkg-query -W -f '${Version}' ceph 2024-04-17T08:45:20.508 INFO:teuthology.orchestra.run.smithi196.stdout:19.0.0-3133-ga8c84f59-1jammy 2024-04-17T08:45:20.508 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3133-ga8c84f59-1jammy 2024-04-17T08:45:20.508 INFO:teuthology.task.install:The correct ceph version 19.0.0-3133-ga8c84f59-1jammy is installed. 2024-04-17T08:45:20.510 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-17T08:45:20.510 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-17T08:45:20.510 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-17T08:45:20.530 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-17T08:45:20.530 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-17T08:45:20.570 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-17T08:45:20.571 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-17T08:45:20.571 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/daemon-helper 2024-04-17T08:45:20.595 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-17T08:45:20.659 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-17T08:45:20.659 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/usr/bin/daemon-helper 2024-04-17T08:45:20.680 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-17T08:45:20.741 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-17T08:45:20.741 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-17T08:45:20.741 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-17T08:45:20.761 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-17T08:45:20.819 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-17T08:45:20.819 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-17T08:45:20.839 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-17T08:45:20.901 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-17T08:45:20.901 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-17T08:45:20.901 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/stdin-killer 2024-04-17T08:45:20.919 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-17T08:45:20.983 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-17T08:45:20.983 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/usr/bin/stdin-killer 2024-04-17T08:45:21.003 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-17T08:45:21.064 INFO:teuthology.run_tasks:Running task ceph... 2024-04-17T08:45:21.143 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-17T08:45:21.143 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 777 /var/log/ceph 2024-04-17T08:45:21.146 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 777 /var/log/ceph 2024-04-17T08:45:21.165 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-17T08:45:21.165 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-17T08:45:21.212 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-17T08:45:21.232 INFO:tasks.ceph:Creating extra log directories... 2024-04-17T08:45:21.232 DEBUG:teuthology.orchestra.run.smithi152:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-17T08:45:21.272 DEBUG:teuthology.orchestra.run.smithi196:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-17T08:45:21.299 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-17T08:45:21.300 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-17T08:45:21.300 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-17T08:45:21.300 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-17T08:45:21.300 DEBUG:teuthology.orchestra.run.smithi152:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-17T08:45:21.336 DEBUG:teuthology.orchestra.run.smithi152:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-17T08:45:21.421 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-17T08:45:21.421 DEBUG:teuthology.orchestra.run.smithi196:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-17T08:45:21.430 DEBUG:teuthology.orchestra.run.smithi196:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-17T08:45:21.526 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-17T08:45:21.526 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-17T08:45:21.526 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659946', 'branch': 'wip-rishabh-testing-20240416.193735', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/xfstests-dev}', 'email': None, 'first_in_suite': False, 'job_id': '7659946', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-testing-20240416.193735'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda'}}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-testing-20240416.193735', 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 3521, 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda', 'sleep_before_teardown': 0, 'subset': '410/512', 'suite': 'fs', 'suite_branch': 'wip-rishabh-testing-20240416.193735', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'a8c84f5997950fd7d008204839253291d52e6eda', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi152.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHu3KvyayiKpi7Ig+sxgXozqjMoZs7hbVJQXjG2i96yDzIKmoAglpzQXQvbMhMczqjk+bqc678bfDjzjMygyHHY=', 'smithi196.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMY0cG94j5lZZaMgNVTdcj44LaJ/9q+TQ7sKFsD+hgminMHD3DUlRcfoOy/g25Bt8Z+J7XYxsHA50RebIkM/v80='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '6c637841c215537a4502385240412f1966e0faab', 'timestamp': '2024-04-17_04:58:44', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-17T08:45:21.527 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-17T08:45:21.530 DEBUG:teuthology.orchestra.run.smithi196:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-17T08:45:21.574 DEBUG:teuthology.orchestra.run.smithi152:> sudo install -d -m0777 -- /var/run/ceph 2024-04-17T08:45:21.584 DEBUG:teuthology.orchestra.run.smithi196:> sudo install -d -m0777 -- /var/run/ceph 2024-04-17T08:45:21.641 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-17T08:45:21.641 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/scratch_devs of=/dev/stdout 2024-04-17T08:45:21.649 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-17T08:45:21.649 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_1 2024-04-17T08:45:21.701 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-17T08:45:21.701 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T08:45:21.701 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 6h/6d Inode: 883 Links: 1 2024-04-17T08:45:21.701 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T08:45:21.701 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-04-17 08:38:47.018562092 +0000 2024-04-17T08:45:21.701 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-04-17 08:38:46.758564411 +0000 2024-04-17T08:45:21.702 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-04-17 08:38:46.758564411 +0000 2024-04-17T08:45:21.702 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2024-04-17 08:38:46.758564411 +0000 2024-04-17T08:45:21.702 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-17T08:45:21.761 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2024-04-17T08:45:21.762 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2024-04-17T08:45:21.762 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000377543 s, 1.4 MB/s 2024-04-17T08:45:21.763 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-17T08:45:21.814 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_2 2024-04-17T08:45:21.869 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-17T08:45:21.869 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T08:45:21.869 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 6h/6d Inode: 901 Links: 1 2024-04-17T08:45:21.869 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T08:45:21.869 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-04-17 08:38:47.722555816 +0000 2024-04-17T08:45:21.869 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-04-17 08:38:47.466558099 +0000 2024-04-17T08:45:21.869 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-04-17 08:38:47.466558099 +0000 2024-04-17T08:45:21.869 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2024-04-17 08:38:47.466558099 +0000 2024-04-17T08:45:21.869 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-17T08:45:21.926 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2024-04-17T08:45:21.926 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2024-04-17T08:45:21.926 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000345881 s, 1.5 MB/s 2024-04-17T08:45:21.928 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-17T08:45:21.983 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_3 2024-04-17T08:45:22.033 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-17T08:45:22.034 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T08:45:22.034 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 6h/6d Inode: 916 Links: 1 2024-04-17T08:45:22.034 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T08:45:22.034 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-04-17 08:38:48.290550753 +0000 2024-04-17T08:45:22.034 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-04-17 08:38:48.018553178 +0000 2024-04-17T08:45:22.034 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-04-17 08:38:48.018553178 +0000 2024-04-17T08:45:22.034 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2024-04-17 08:38:48.018553178 +0000 2024-04-17T08:45:22.034 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-17T08:45:22.094 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2024-04-17T08:45:22.094 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2024-04-17T08:45:22.094 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000355373 s, 1.4 MB/s 2024-04-17T08:45:22.095 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-17T08:45:22.151 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_4 2024-04-17T08:45:22.201 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-17T08:45:22.201 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T08:45:22.201 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 6h/6d Inode: 936 Links: 1 2024-04-17T08:45:22.201 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T08:45:22.202 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-04-17 08:38:48.870545583 +0000 2024-04-17T08:45:22.202 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-04-17 08:38:48.614547864 +0000 2024-04-17T08:45:22.202 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-04-17 08:38:48.614547864 +0000 2024-04-17T08:45:22.202 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2024-04-17 08:38:48.614547864 +0000 2024-04-17T08:45:22.202 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-17T08:45:22.261 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2024-04-17T08:45:22.262 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2024-04-17T08:45:22.262 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000356749 s, 1.4 MB/s 2024-04-17T08:45:22.263 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-17T08:45:22.314 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-17T08:45:22.314 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-17T08:45:22.314 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/scratch_devs of=/dev/stdout 2024-04-17T08:45:22.323 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-17T08:45:22.323 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_1 2024-04-17T08:45:22.374 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-17T08:45:22.374 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T08:45:22.374 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 6h/6d Inode: 891 Links: 1 2024-04-17T08:45:22.374 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T08:45:22.374 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2024-04-17 08:38:47.037440221 +0000 2024-04-17T08:45:22.374 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-04-17 08:38:46.749442794 +0000 2024-04-17T08:45:22.374 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-04-17 08:38:46.749442794 +0000 2024-04-17T08:45:22.374 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: 2024-04-17 08:38:46.749442794 +0000 2024-04-17T08:45:22.374 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-17T08:45:22.440 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-04-17T08:45:22.441 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-04-17T08:45:22.441 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000400986 s, 1.3 MB/s 2024-04-17T08:45:22.443 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-17T08:45:22.500 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_2 2024-04-17T08:45:22.554 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-17T08:45:22.554 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T08:45:22.554 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 6h/6d Inode: 909 Links: 1 2024-04-17T08:45:22.554 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T08:45:22.554 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2024-04-17 08:38:47.649434756 +0000 2024-04-17T08:45:22.554 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-04-17 08:38:47.349437435 +0000 2024-04-17T08:45:22.555 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-04-17 08:38:47.349437435 +0000 2024-04-17T08:45:22.555 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: 2024-04-17 08:38:47.349437435 +0000 2024-04-17T08:45:22.555 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-17T08:45:22.616 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-04-17T08:45:22.617 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-04-17T08:45:22.617 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000381326 s, 1.3 MB/s 2024-04-17T08:45:22.619 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-17T08:45:22.672 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_3 2024-04-17T08:45:22.722 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-17T08:45:22.722 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T08:45:22.722 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 6h/6d Inode: 925 Links: 1 2024-04-17T08:45:22.722 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T08:45:22.722 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2024-04-17 08:38:48.205429789 +0000 2024-04-17T08:45:22.722 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-04-17 08:38:47.921432325 +0000 2024-04-17T08:45:22.722 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-04-17 08:38:47.921432325 +0000 2024-04-17T08:45:22.722 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: 2024-04-17 08:38:47.921432325 +0000 2024-04-17T08:45:22.723 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-17T08:45:22.784 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-04-17T08:45:22.784 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-04-17T08:45:22.784 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000383214 s, 1.3 MB/s 2024-04-17T08:45:22.786 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-17T08:45:22.843 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_4 2024-04-17T08:45:22.898 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-17T08:45:22.898 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T08:45:22.898 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 6h/6d Inode: 943 Links: 1 2024-04-17T08:45:22.898 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T08:45:22.898 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2024-04-17 08:38:48.741425002 +0000 2024-04-17T08:45:22.898 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-04-17 08:38:48.461427502 +0000 2024-04-17T08:45:22.898 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-04-17 08:38:48.461427502 +0000 2024-04-17T08:45:22.898 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: 2024-04-17 08:38:48.461427502 +0000 2024-04-17T08:45:22.898 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-17T08:45:22.960 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-04-17T08:45:22.960 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-04-17T08:45:22.960 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000648269 s, 790 kB/s 2024-04-17T08:45:22.962 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-17T08:45:23.016 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-17T08:45:23.016 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi152.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi196.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-17T08:45:23.016 INFO:tasks.ceph:Generating config... 2024-04-17T08:45:23.017 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-17T08:45:23.017 INFO:tasks.ceph:[client] debug client = 20 2024-04-17T08:45:23.017 INFO:tasks.ceph:[client] debug ms = 1 2024-04-17T08:45:23.017 INFO:tasks.ceph:[client] pid file = 2024-04-17T08:45:23.017 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-17T08:45:23.017 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-17T08:45:23.017 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-17T08:45:23.018 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-17T08:45:23.018 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-17T08:45:23.018 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-17T08:45:23.018 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-17T08:45:23.018 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-17T08:45:23.018 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-17T08:45:23.018 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-17T08:45:23.018 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-17T08:45:23.018 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-17T08:45:23.018 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-17T08:45:23.018 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-17T08:45:23.018 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-17T08:45:23.018 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-17T08:45:23.018 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-17T08:45:23.019 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-17T08:45:23.019 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-17T08:45:23.019 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-17T08:45:23.019 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-17T08:45:23.019 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-17T08:45:23.019 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-17T08:45:23.019 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-17T08:45:23.019 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-17T08:45:23.019 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-17T08:45:23.019 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-17T08:45:23.019 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-17T08:45:23.019 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-17T08:45:23.019 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-17T08:45:23.019 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-17T08:45:23.020 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-17T08:45:23.020 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-17T08:45:23.020 INFO:tasks.ceph:Setting up mon.a... 2024-04-17T08:45:23.020 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-17T08:45:23.061 INFO:teuthology.orchestra.run.smithi152.stdout:creating /etc/ceph/ceph.keyring 2024-04-17T08:45:23.071 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-17T08:45:23.162 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-17T08:45:23.181 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.152'), ('mon.b', '172.21.15.196'), ('mon.c', '[v2:172.21.15.196:3301,v1:172.21.15.196:6790]')] 2024-04-17T08:45:23.182 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.152,172.21.15.196,[v2:172.21.15.196:3301,v1:172.21.15.196:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-17T08:45:23.183 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-17T08:45:23.183 DEBUG:teuthology.orchestra.run.smithi152:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-17T08:45:23.233 DEBUG:teuthology.orchestra.run.smithi152:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.152 --add b 172.21.15.196 --addv c '[v2:172.21.15.196:3301,v1:172.21.15.196:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-17T08:45:23.319 INFO:teuthology.orchestra.run.smithi152.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-17T08:45:23.319 INFO:teuthology.orchestra.run.smithi152.stdout:monmaptool: generated fsid ce68f82e-ec5f-4205-9fd5-bdfdf6ef31e2 2024-04-17T08:45:23.319 INFO:teuthology.orchestra.run.smithi152.stdout:setting min_mon_release = quincy 2024-04-17T08:45:23.319 INFO:teuthology.orchestra.run.smithi152.stdout:epoch 0 2024-04-17T08:45:23.319 INFO:teuthology.orchestra.run.smithi152.stdout:fsid ce68f82e-ec5f-4205-9fd5-bdfdf6ef31e2 2024-04-17T08:45:23.319 INFO:teuthology.orchestra.run.smithi152.stdout:last_changed 2024-04-17T08:45:23.321761+0000 2024-04-17T08:45:23.319 INFO:teuthology.orchestra.run.smithi152.stdout:created 2024-04-17T08:45:23.321761+0000 2024-04-17T08:45:23.319 INFO:teuthology.orchestra.run.smithi152.stdout:min_mon_release 17 (quincy) 2024-04-17T08:45:23.320 INFO:teuthology.orchestra.run.smithi152.stdout:election_strategy: 1 2024-04-17T08:45:23.320 INFO:teuthology.orchestra.run.smithi152.stdout:0: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.a 2024-04-17T08:45:23.320 INFO:teuthology.orchestra.run.smithi152.stdout:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-04-17T08:45:23.320 INFO:teuthology.orchestra.run.smithi152.stdout:2: [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] mon.c 2024-04-17T08:45:23.320 INFO:teuthology.orchestra.run.smithi152.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-17T08:45:23.322 DEBUG:teuthology.orchestra.run.smithi152:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-17T08:45:23.330 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID ce68f82e-ec5f-4205-9fd5-bdfdf6ef31e2... 2024-04-17T08:45:23.331 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-17T08:45:23.380 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-17T08:45:23.419 INFO:teuthology.orchestra.run.smithi152.stdout:[global] 2024-04-17T08:45:23.419 INFO:teuthology.orchestra.run.smithi152.stdout: chdir = "" 2024-04-17T08:45:23.419 INFO:teuthology.orchestra.run.smithi152.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-17T08:45:23.419 INFO:teuthology.orchestra.run.smithi152.stdout: auth supported = cephx 2024-04-17T08:45:23.419 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:45:23.420 INFO:teuthology.orchestra.run.smithi152.stdout: filestore xattr use omap = true 2024-04-17T08:45:23.420 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:45:23.420 INFO:teuthology.orchestra.run.smithi152.stdout: mon clock drift allowed = 1.000 2024-04-17T08:45:23.420 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:45:23.420 INFO:teuthology.orchestra.run.smithi152.stdout: osd crush chooseleaf type = 0 2024-04-17T08:45:23.420 INFO:teuthology.orchestra.run.smithi152.stdout: auth debug = true 2024-04-17T08:45:23.420 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:45:23.420 INFO:teuthology.orchestra.run.smithi152.stdout: ms die on old message = true 2024-04-17T08:45:23.420 INFO:teuthology.orchestra.run.smithi152.stdout: ms die on bug = true 2024-04-17T08:45:23.420 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:45:23.420 INFO:teuthology.orchestra.run.smithi152.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-17T08:45:23.420 INFO:teuthology.orchestra.run.smithi152.stdout: mon pg warn max object skew = 0 2024-04-17T08:45:23.420 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:45:23.420 INFO:teuthology.orchestra.run.smithi152.stdout: # disable pg_autoscaler by default for new pools 2024-04-17T08:45:23.420 INFO:teuthology.orchestra.run.smithi152.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-17T08:45:23.421 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:45:23.421 INFO:teuthology.orchestra.run.smithi152.stdout: osd pool default size = 2 2024-04-17T08:45:23.421 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:45:23.421 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd allow primary affinity = true 2024-04-17T08:45:23.421 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd allow pg remap = true 2024-04-17T08:45:23.421 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on legacy crush tunables = false 2024-04-17T08:45:23.421 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on crush straw calc version zero = false 2024-04-17T08:45:23.421 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on no sortbitwise = false 2024-04-17T08:45:23.421 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on osd down out interval zero = false 2024-04-17T08:45:23.421 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on too few osds = false 2024-04-17T08:45:23.421 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-17T08:45:23.421 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-17T08:45:23.421 INFO:teuthology.orchestra.run.smithi152.stdout: mon_allow_pool_size_one = true 2024-04-17T08:45:23.421 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:45:23.421 INFO:teuthology.orchestra.run.smithi152.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-17T08:45:23.422 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:45:23.422 INFO:teuthology.orchestra.run.smithi152.stdout: osd default data pool replay window = 5 2024-04-17T08:45:23.422 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:45:23.422 INFO:teuthology.orchestra.run.smithi152.stdout: mon allow pool delete = true 2024-04-17T08:45:23.422 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:45:23.422 INFO:teuthology.orchestra.run.smithi152.stdout: mon cluster log file level = debug 2024-04-17T08:45:23.422 INFO:teuthology.orchestra.run.smithi152.stdout: debug asserts on shutdown = true 2024-04-17T08:45:23.422 INFO:teuthology.orchestra.run.smithi152.stdout: mon health detail to clog = false 2024-04-17T08:45:23.422 INFO:teuthology.orchestra.run.smithi152.stdout: mon host = "172.21.15.152,172.21.15.196,[v2:172.21.15.196:3301,v1:172.21.15.196:6790]" 2024-04-17T08:45:23.422 INFO:teuthology.orchestra.run.smithi152.stdout: fsid = ce68f82e-ec5f-4205-9fd5-bdfdf6ef31e2 2024-04-17T08:45:23.422 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:45:23.422 INFO:teuthology.orchestra.run.smithi152.stdout:[osd] 2024-04-17T08:45:23.422 INFO:teuthology.orchestra.run.smithi152.stdout: osd journal size = 100 2024-04-17T08:45:23.422 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:45:23.422 INFO:teuthology.orchestra.run.smithi152.stdout: osd scrub load threshold = 5.0 2024-04-17T08:45:23.423 INFO:teuthology.orchestra.run.smithi152.stdout: osd scrub max interval = 600 2024-04-17T08:45:23.423 INFO:teuthology.orchestra.run.smithi152.stdout: osd mclock profile = high_recovery_ops 2024-04-17T08:45:23.423 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:45:23.423 INFO:teuthology.orchestra.run.smithi152.stdout: osd recover clone overlap = true 2024-04-17T08:45:23.423 INFO:teuthology.orchestra.run.smithi152.stdout: osd recovery max chunk = 1048576 2024-04-17T08:45:23.423 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:45:23.423 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug shutdown = true 2024-04-17T08:45:23.423 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug op order = true 2024-04-17T08:45:23.423 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug verify stray on activate = true 2024-04-17T08:45:23.423 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug trim objects = true 2024-04-17T08:45:23.423 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:45:23.423 INFO:teuthology.orchestra.run.smithi152.stdout: osd open classes on start = true 2024-04-17T08:45:23.423 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug pg log writeout = true 2024-04-17T08:45:23.423 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:45:23.423 INFO:teuthology.orchestra.run.smithi152.stdout: osd deep scrub update digest min age = 30 2024-04-17T08:45:23.423 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:45:23.424 INFO:teuthology.orchestra.run.smithi152.stdout: osd map max advance = 10 2024-04-17T08:45:23.424 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:45:23.424 INFO:teuthology.orchestra.run.smithi152.stdout: journal zero on create = true 2024-04-17T08:45:23.424 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:45:23.424 INFO:teuthology.orchestra.run.smithi152.stdout: filestore ondisk finisher threads = 3 2024-04-17T08:45:23.424 INFO:teuthology.orchestra.run.smithi152.stdout: filestore apply finisher threads = 3 2024-04-17T08:45:23.424 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:45:23.424 INFO:teuthology.orchestra.run.smithi152.stdout: bdev debug aio = true 2024-04-17T08:45:23.424 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug misdirected ops = true 2024-04-17T08:45:23.424 INFO:teuthology.orchestra.run.smithi152.stdout: bluestore block size = 96636764160 2024-04-17T08:45:23.425 INFO:teuthology.orchestra.run.smithi152.stdout: bluestore fsck on mount = True 2024-04-17T08:45:23.425 INFO:teuthology.orchestra.run.smithi152.stdout: debug bluefs = 20 2024-04-17T08:45:23.425 INFO:teuthology.orchestra.run.smithi152.stdout: debug bluestore = 20 2024-04-17T08:45:23.425 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2024-04-17T08:45:23.425 INFO:teuthology.orchestra.run.smithi152.stdout: debug osd = 20 2024-04-17T08:45:23.425 INFO:teuthology.orchestra.run.smithi152.stdout: debug rocksdb = 10 2024-04-17T08:45:23.425 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd backfillfull_ratio = 0.85 2024-04-17T08:45:23.425 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd full ratio = 0.9 2024-04-17T08:45:23.425 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd nearfull ratio = 0.8 2024-04-17T08:45:23.425 INFO:teuthology.orchestra.run.smithi152.stdout: osd failsafe full ratio = 0.95 2024-04-17T08:45:23.425 INFO:teuthology.orchestra.run.smithi152.stdout: osd objectstore = bluestore 2024-04-17T08:45:23.425 INFO:teuthology.orchestra.run.smithi152.stdout: osd op complaint time = 180 2024-04-17T08:45:23.425 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:45:23.425 INFO:teuthology.orchestra.run.smithi152.stdout:[mgr] 2024-04-17T08:45:23.425 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2024-04-17T08:45:23.426 INFO:teuthology.orchestra.run.smithi152.stdout: debug mgr = 20 2024-04-17T08:45:23.426 INFO:teuthology.orchestra.run.smithi152.stdout: debug mon = 20 2024-04-17T08:45:23.426 INFO:teuthology.orchestra.run.smithi152.stdout: debug auth = 20 2024-04-17T08:45:23.426 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min pgs per osd = 4 2024-04-17T08:45:23.426 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min bytes per osd = 10 2024-04-17T08:45:23.426 INFO:teuthology.orchestra.run.smithi152.stdout: mgr/telemetry/nag = false 2024-04-17T08:45:23.426 INFO:teuthology.orchestra.run.smithi152.stdout: debug client = 20 2024-04-17T08:45:23.426 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:45:23.426 INFO:teuthology.orchestra.run.smithi152.stdout:[mon] 2024-04-17T08:45:23.426 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2024-04-17T08:45:23.426 INFO:teuthology.orchestra.run.smithi152.stdout: debug mon = 20 2024-04-17T08:45:23.426 INFO:teuthology.orchestra.run.smithi152.stdout: debug paxos = 20 2024-04-17T08:45:23.426 INFO:teuthology.orchestra.run.smithi152.stdout: debug auth = 20 2024-04-17T08:45:23.426 INFO:teuthology.orchestra.run.smithi152.stdout: mon data avail warn = 5 2024-04-17T08:45:23.427 INFO:teuthology.orchestra.run.smithi152.stdout: mon mgr mkfs grace = 240 2024-04-17T08:45:23.427 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min pgs per osd = 4 2024-04-17T08:45:23.427 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd reporter subtree level = osd 2024-04-17T08:45:23.427 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd prime pg temp = true 2024-04-17T08:45:23.427 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min bytes per osd = 10 2024-04-17T08:45:23.427 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:45:23.427 INFO:teuthology.orchestra.run.smithi152.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-17T08:45:23.427 INFO:teuthology.orchestra.run.smithi152.stdout: auth mon ticket ttl = 660 # 11m 2024-04-17T08:45:23.427 INFO:teuthology.orchestra.run.smithi152.stdout: auth service ticket ttl = 240 # 4m 2024-04-17T08:45:23.427 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:45:23.427 INFO:teuthology.orchestra.run.smithi152.stdout: # don't complain about insecure global_id in the test suite 2024-04-17T08:45:23.427 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-17T08:45:23.427 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-17T08:45:23.427 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:45:23.427 INFO:teuthology.orchestra.run.smithi152.stdout: # 1m isn't quite enough 2024-04-17T08:45:23.428 INFO:teuthology.orchestra.run.smithi152.stdout: mon_down_mkfs_grace = 2m 2024-04-17T08:45:23.428 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:45:23.428 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_filestore_osds = false 2024-04-17T08:45:23.428 INFO:teuthology.orchestra.run.smithi152.stdout: mon down mkfs grace = 300 2024-04-17T08:45:23.428 INFO:teuthology.orchestra.run.smithi152.stdout: mon op complaint time = 120 2024-04-17T08:45:23.428 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:45:23.428 INFO:teuthology.orchestra.run.smithi152.stdout:[client] 2024-04-17T08:45:23.428 INFO:teuthology.orchestra.run.smithi152.stdout: rgw cache enabled = true 2024-04-17T08:45:23.428 INFO:teuthology.orchestra.run.smithi152.stdout: rgw enable ops log = true 2024-04-17T08:45:23.428 INFO:teuthology.orchestra.run.smithi152.stdout: rgw enable usage log = true 2024-04-17T08:45:23.428 INFO:teuthology.orchestra.run.smithi152.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-17T08:45:23.428 INFO:teuthology.orchestra.run.smithi152.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-17T08:45:23.428 INFO:teuthology.orchestra.run.smithi152.stdout: client mount timeout = 600 2024-04-17T08:45:23.428 INFO:teuthology.orchestra.run.smithi152.stdout: debug client = 20 2024-04-17T08:45:23.428 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2024-04-17T08:45:23.429 INFO:teuthology.orchestra.run.smithi152.stdout: pid file = "" 2024-04-17T08:45:23.429 INFO:teuthology.orchestra.run.smithi152.stdout: rados mon op timeout = 900 2024-04-17T08:45:23.429 INFO:teuthology.orchestra.run.smithi152.stdout: rados osd op timeout = 900 2024-04-17T08:45:23.429 INFO:teuthology.orchestra.run.smithi152.stdout:[mon.a] 2024-04-17T08:45:23.429 INFO:teuthology.orchestra.run.smithi152.stdout:[mon.b] 2024-04-17T08:45:23.429 INFO:teuthology.orchestra.run.smithi152.stdout:[mon.c] 2024-04-17T08:45:23.429 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.a] 2024-04-17T08:45:23.429 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.c] 2024-04-17T08:45:23.429 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.b] 2024-04-17T08:45:23.429 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.d] 2024-04-17T08:45:23.429 INFO:teuthology.orchestra.run.smithi152.stdout:[mds] 2024-04-17T08:45:23.429 INFO:teuthology.orchestra.run.smithi152.stdout: debug mds = 20 2024-04-17T08:45:23.429 INFO:teuthology.orchestra.run.smithi152.stdout: debug mds balancer = 20 2024-04-17T08:45:23.429 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2024-04-17T08:45:23.430 INFO:teuthology.orchestra.run.smithi152.stdout: mds debug frag = True 2024-04-17T08:45:23.430 INFO:teuthology.orchestra.run.smithi152.stdout: mds debug scatterstat = True 2024-04-17T08:45:23.430 INFO:teuthology.orchestra.run.smithi152.stdout: mds op complaint time = 180 2024-04-17T08:45:23.430 INFO:teuthology.orchestra.run.smithi152.stdout: mds verify scatter = True 2024-04-17T08:45:23.430 INFO:teuthology.orchestra.run.smithi152.stdout: osd op complaint time = 180 2024-04-17T08:45:23.430 INFO:teuthology.orchestra.run.smithi152.stdout: rados mon op timeout = 900 2024-04-17T08:45:23.430 INFO:teuthology.orchestra.run.smithi152.stdout: rados osd op timeout = 900 2024-04-17T08:45:23.430 INFO:teuthology.orchestra.run.smithi196.stdout:[global] 2024-04-17T08:45:23.431 INFO:teuthology.orchestra.run.smithi196.stdout: chdir = "" 2024-04-17T08:45:23.431 INFO:teuthology.orchestra.run.smithi196.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-17T08:45:23.431 INFO:teuthology.orchestra.run.smithi196.stdout: auth supported = cephx 2024-04-17T08:45:23.431 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-17T08:45:23.431 INFO:teuthology.orchestra.run.smithi196.stdout: filestore xattr use omap = true 2024-04-17T08:45:23.431 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-17T08:45:23.431 INFO:teuthology.orchestra.run.smithi196.stdout: mon clock drift allowed = 1.000 2024-04-17T08:45:23.431 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-17T08:45:23.431 INFO:teuthology.orchestra.run.smithi196.stdout: osd crush chooseleaf type = 0 2024-04-17T08:45:23.431 INFO:teuthology.orchestra.run.smithi196.stdout: auth debug = true 2024-04-17T08:45:23.431 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-17T08:45:23.431 INFO:teuthology.orchestra.run.smithi196.stdout: ms die on old message = true 2024-04-17T08:45:23.431 INFO:teuthology.orchestra.run.smithi196.stdout: ms die on bug = true 2024-04-17T08:45:23.431 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-17T08:45:23.431 INFO:teuthology.orchestra.run.smithi196.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-17T08:45:23.432 INFO:teuthology.orchestra.run.smithi196.stdout: mon pg warn max object skew = 0 2024-04-17T08:45:23.432 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-17T08:45:23.432 INFO:teuthology.orchestra.run.smithi196.stdout: # disable pg_autoscaler by default for new pools 2024-04-17T08:45:23.432 INFO:teuthology.orchestra.run.smithi196.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-17T08:45:23.432 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-17T08:45:23.432 INFO:teuthology.orchestra.run.smithi196.stdout: osd pool default size = 2 2024-04-17T08:45:23.432 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-17T08:45:23.432 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd allow primary affinity = true 2024-04-17T08:45:23.432 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd allow pg remap = true 2024-04-17T08:45:23.432 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on legacy crush tunables = false 2024-04-17T08:45:23.432 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on crush straw calc version zero = false 2024-04-17T08:45:23.432 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on no sortbitwise = false 2024-04-17T08:45:23.432 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on osd down out interval zero = false 2024-04-17T08:45:23.432 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on too few osds = false 2024-04-17T08:45:23.432 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-17T08:45:23.433 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-17T08:45:23.433 INFO:teuthology.orchestra.run.smithi196.stdout: mon_allow_pool_size_one = true 2024-04-17T08:45:23.433 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-17T08:45:23.433 INFO:teuthology.orchestra.run.smithi196.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-17T08:45:23.433 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-17T08:45:23.433 INFO:teuthology.orchestra.run.smithi196.stdout: osd default data pool replay window = 5 2024-04-17T08:45:23.433 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-17T08:45:23.433 INFO:teuthology.orchestra.run.smithi196.stdout: mon allow pool delete = true 2024-04-17T08:45:23.433 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-17T08:45:23.433 INFO:teuthology.orchestra.run.smithi196.stdout: mon cluster log file level = debug 2024-04-17T08:45:23.433 INFO:teuthology.orchestra.run.smithi196.stdout: debug asserts on shutdown = true 2024-04-17T08:45:23.433 INFO:teuthology.orchestra.run.smithi196.stdout: mon health detail to clog = false 2024-04-17T08:45:23.433 INFO:teuthology.orchestra.run.smithi196.stdout: mon host = "172.21.15.152,172.21.15.196,[v2:172.21.15.196:3301,v1:172.21.15.196:6790]" 2024-04-17T08:45:23.433 INFO:teuthology.orchestra.run.smithi196.stdout: fsid = ce68f82e-ec5f-4205-9fd5-bdfdf6ef31e2 2024-04-17T08:45:23.433 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-17T08:45:23.434 INFO:teuthology.orchestra.run.smithi196.stdout:[osd] 2024-04-17T08:45:23.434 INFO:teuthology.orchestra.run.smithi196.stdout: osd journal size = 100 2024-04-17T08:45:23.434 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-17T08:45:23.434 INFO:teuthology.orchestra.run.smithi196.stdout: osd scrub load threshold = 5.0 2024-04-17T08:45:23.434 INFO:teuthology.orchestra.run.smithi196.stdout: osd scrub max interval = 600 2024-04-17T08:45:23.434 INFO:teuthology.orchestra.run.smithi196.stdout: osd mclock profile = high_recovery_ops 2024-04-17T08:45:23.434 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-17T08:45:23.434 INFO:teuthology.orchestra.run.smithi196.stdout: osd recover clone overlap = true 2024-04-17T08:45:23.434 INFO:teuthology.orchestra.run.smithi196.stdout: osd recovery max chunk = 1048576 2024-04-17T08:45:23.434 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-17T08:45:23.434 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug shutdown = true 2024-04-17T08:45:23.434 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug op order = true 2024-04-17T08:45:23.434 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug verify stray on activate = true 2024-04-17T08:45:23.434 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug trim objects = true 2024-04-17T08:45:23.434 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-17T08:45:23.435 INFO:teuthology.orchestra.run.smithi196.stdout: osd open classes on start = true 2024-04-17T08:45:23.435 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug pg log writeout = true 2024-04-17T08:45:23.435 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-17T08:45:23.435 INFO:teuthology.orchestra.run.smithi196.stdout: osd deep scrub update digest min age = 30 2024-04-17T08:45:23.435 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-17T08:45:23.435 INFO:teuthology.orchestra.run.smithi196.stdout: osd map max advance = 10 2024-04-17T08:45:23.435 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-17T08:45:23.435 INFO:teuthology.orchestra.run.smithi196.stdout: journal zero on create = true 2024-04-17T08:45:23.435 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-17T08:45:23.435 INFO:teuthology.orchestra.run.smithi196.stdout: filestore ondisk finisher threads = 3 2024-04-17T08:45:23.435 INFO:teuthology.orchestra.run.smithi196.stdout: filestore apply finisher threads = 3 2024-04-17T08:45:23.435 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-17T08:45:23.435 INFO:teuthology.orchestra.run.smithi196.stdout: bdev debug aio = true 2024-04-17T08:45:23.435 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug misdirected ops = true 2024-04-17T08:45:23.435 INFO:teuthology.orchestra.run.smithi196.stdout: bluestore block size = 96636764160 2024-04-17T08:45:23.435 INFO:teuthology.orchestra.run.smithi196.stdout: bluestore fsck on mount = True 2024-04-17T08:45:23.436 INFO:teuthology.orchestra.run.smithi196.stdout: debug bluefs = 20 2024-04-17T08:45:23.436 INFO:teuthology.orchestra.run.smithi196.stdout: debug bluestore = 20 2024-04-17T08:45:23.436 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2024-04-17T08:45:23.436 INFO:teuthology.orchestra.run.smithi196.stdout: debug osd = 20 2024-04-17T08:45:23.436 INFO:teuthology.orchestra.run.smithi196.stdout: debug rocksdb = 10 2024-04-17T08:45:23.436 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd backfillfull_ratio = 0.85 2024-04-17T08:45:23.436 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd full ratio = 0.9 2024-04-17T08:45:23.436 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd nearfull ratio = 0.8 2024-04-17T08:45:23.436 INFO:teuthology.orchestra.run.smithi196.stdout: osd failsafe full ratio = 0.95 2024-04-17T08:45:23.436 INFO:teuthology.orchestra.run.smithi196.stdout: osd objectstore = bluestore 2024-04-17T08:45:23.436 INFO:teuthology.orchestra.run.smithi196.stdout: osd op complaint time = 180 2024-04-17T08:45:23.436 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-17T08:45:23.436 INFO:teuthology.orchestra.run.smithi196.stdout:[mgr] 2024-04-17T08:45:23.436 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2024-04-17T08:45:23.436 INFO:teuthology.orchestra.run.smithi196.stdout: debug mgr = 20 2024-04-17T08:45:23.436 INFO:teuthology.orchestra.run.smithi196.stdout: debug mon = 20 2024-04-17T08:45:23.437 INFO:teuthology.orchestra.run.smithi196.stdout: debug auth = 20 2024-04-17T08:45:23.437 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min pgs per osd = 4 2024-04-17T08:45:23.437 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min bytes per osd = 10 2024-04-17T08:45:23.437 INFO:teuthology.orchestra.run.smithi196.stdout: mgr/telemetry/nag = false 2024-04-17T08:45:23.437 INFO:teuthology.orchestra.run.smithi196.stdout: debug client = 20 2024-04-17T08:45:23.437 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-17T08:45:23.437 INFO:teuthology.orchestra.run.smithi196.stdout:[mon] 2024-04-17T08:45:23.437 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2024-04-17T08:45:23.437 INFO:teuthology.orchestra.run.smithi196.stdout: debug mon = 20 2024-04-17T08:45:23.437 INFO:teuthology.orchestra.run.smithi196.stdout: debug paxos = 20 2024-04-17T08:45:23.437 INFO:teuthology.orchestra.run.smithi196.stdout: debug auth = 20 2024-04-17T08:45:23.437 INFO:teuthology.orchestra.run.smithi196.stdout: mon data avail warn = 5 2024-04-17T08:45:23.437 INFO:teuthology.orchestra.run.smithi196.stdout: mon mgr mkfs grace = 240 2024-04-17T08:45:23.437 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min pgs per osd = 4 2024-04-17T08:45:23.437 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd reporter subtree level = osd 2024-04-17T08:45:23.437 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd prime pg temp = true 2024-04-17T08:45:23.438 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min bytes per osd = 10 2024-04-17T08:45:23.438 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-17T08:45:23.438 INFO:teuthology.orchestra.run.smithi196.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-17T08:45:23.438 INFO:teuthology.orchestra.run.smithi196.stdout: auth mon ticket ttl = 660 # 11m 2024-04-17T08:45:23.438 INFO:teuthology.orchestra.run.smithi196.stdout: auth service ticket ttl = 240 # 4m 2024-04-17T08:45:23.438 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-17T08:45:23.438 INFO:teuthology.orchestra.run.smithi196.stdout: # don't complain about insecure global_id in the test suite 2024-04-17T08:45:23.438 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-17T08:45:23.438 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-17T08:45:23.438 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-17T08:45:23.438 INFO:teuthology.orchestra.run.smithi196.stdout: # 1m isn't quite enough 2024-04-17T08:45:23.438 INFO:teuthology.orchestra.run.smithi196.stdout: mon_down_mkfs_grace = 2m 2024-04-17T08:45:23.438 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-17T08:45:23.438 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_filestore_osds = false 2024-04-17T08:45:23.438 INFO:teuthology.orchestra.run.smithi196.stdout: mon down mkfs grace = 300 2024-04-17T08:45:23.439 INFO:teuthology.orchestra.run.smithi196.stdout: mon op complaint time = 120 2024-04-17T08:45:23.439 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-17T08:45:23.439 INFO:teuthology.orchestra.run.smithi196.stdout:[client] 2024-04-17T08:45:23.439 INFO:teuthology.orchestra.run.smithi196.stdout: rgw cache enabled = true 2024-04-17T08:45:23.439 INFO:teuthology.orchestra.run.smithi196.stdout: rgw enable ops log = true 2024-04-17T08:45:23.439 INFO:teuthology.orchestra.run.smithi196.stdout: rgw enable usage log = true 2024-04-17T08:45:23.439 INFO:teuthology.orchestra.run.smithi196.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-17T08:45:23.439 INFO:teuthology.orchestra.run.smithi196.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-17T08:45:23.439 INFO:teuthology.orchestra.run.smithi196.stdout: client mount timeout = 600 2024-04-17T08:45:23.439 INFO:teuthology.orchestra.run.smithi196.stdout: debug client = 20 2024-04-17T08:45:23.439 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2024-04-17T08:45:23.439 INFO:teuthology.orchestra.run.smithi196.stdout: pid file = "" 2024-04-17T08:45:23.439 INFO:teuthology.orchestra.run.smithi196.stdout: rados mon op timeout = 900 2024-04-17T08:45:23.439 INFO:teuthology.orchestra.run.smithi196.stdout: rados osd op timeout = 900 2024-04-17T08:45:23.439 INFO:teuthology.orchestra.run.smithi196.stdout:[mon.a] 2024-04-17T08:45:23.440 INFO:teuthology.orchestra.run.smithi196.stdout:[mon.b] 2024-04-17T08:45:23.440 INFO:teuthology.orchestra.run.smithi196.stdout:[mon.c] 2024-04-17T08:45:23.440 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.a] 2024-04-17T08:45:23.440 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.c] 2024-04-17T08:45:23.440 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.b] 2024-04-17T08:45:23.440 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.d] 2024-04-17T08:45:23.440 INFO:teuthology.orchestra.run.smithi196.stdout:[mds] 2024-04-17T08:45:23.440 INFO:teuthology.orchestra.run.smithi196.stdout: debug mds = 20 2024-04-17T08:45:23.440 INFO:teuthology.orchestra.run.smithi196.stdout: debug mds balancer = 20 2024-04-17T08:45:23.440 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2024-04-17T08:45:23.440 INFO:teuthology.orchestra.run.smithi196.stdout: mds debug frag = True 2024-04-17T08:45:23.440 INFO:teuthology.orchestra.run.smithi196.stdout: mds debug scatterstat = True 2024-04-17T08:45:23.440 INFO:teuthology.orchestra.run.smithi196.stdout: mds op complaint time = 180 2024-04-17T08:45:23.440 INFO:teuthology.orchestra.run.smithi196.stdout: mds verify scatter = True 2024-04-17T08:45:23.440 INFO:teuthology.orchestra.run.smithi196.stdout: osd op complaint time = 180 2024-04-17T08:45:23.441 INFO:teuthology.orchestra.run.smithi196.stdout: rados mon op timeout = 900 2024-04-17T08:45:23.441 INFO:teuthology.orchestra.run.smithi196.stdout: rados osd op timeout = 900 2024-04-17T08:45:23.442 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-17T08:45:23.442 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-17T08:45:23.545 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-17T08:45:23.545 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-17T08:45:23.545 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-17T08:45:23.553 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-17T08:45:23.553 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-17T08:45:23.609 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi152.front.sepia.ceph.com 2024-04-17T08:45:23.609 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-17T08:45:23.609 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-17T08:45:23.609 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-17T08:45:23.680 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-17T08:45:23.680 DEBUG:teuthology.orchestra.run.smithi152:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-17T08:45:23.729 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi196.front.sepia.ceph.com 2024-04-17T08:45:23.730 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-17T08:45:23.730 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-17T08:45:23.730 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-17T08:45:23.764 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-17T08:45:23.764 DEBUG:teuthology.orchestra.run.smithi196:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-17T08:45:23.814 INFO:tasks.ceph:Setting up mon nodes... 2024-04-17T08:45:23.814 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-17T08:45:23.814 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-17T08:45:23.868 INFO:teuthology.orchestra.run.smithi152.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-17T08:45:23.873 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-17T08:45:23.930 INFO:teuthology.orchestra.run.smithi196.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-17T08:45:23.948 INFO:tasks.ceph:Setting up mds nodes... 2024-04-17T08:45:23.948 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-17T08:45:24.002 INFO:teuthology.orchestra.run.smithi152.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-17T08:45:24.006 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-17T08:45:24.026 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-17T08:45:24.122 INFO:teuthology.orchestra.run.smithi152.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-17T08:45:24.126 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-17T08:45:24.146 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-17T08:45:24.201 INFO:teuthology.orchestra.run.smithi196.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-17T08:45:24.206 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-17T08:45:24.225 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-17T08:45:24.326 INFO:teuthology.orchestra.run.smithi196.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-17T08:45:24.330 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-17T08:45:24.350 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-17T08:45:24.350 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-17T08:45:24.397 INFO:teuthology.orchestra.run.smithi152.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-17T08:45:24.414 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-04-17T08:45:24.498 INFO:teuthology.orchestra.run.smithi152.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-04-17T08:45:24.514 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-17T08:45:24.556 INFO:teuthology.orchestra.run.smithi196.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-17T08:45:24.572 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-04-17T08:45:24.658 INFO:teuthology.orchestra.run.smithi196.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-04-17T08:45:24.675 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-17T08:45:24.675 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi152.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi196.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-17T08:45:24.675 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-17T08:45:24.694 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-17T08:45:24.694 INFO:tasks.ceph:role: osd.0 2024-04-17T08:45:24.694 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi152.front.sepia.ceph.com 2024-04-17T08:45:24.694 DEBUG:teuthology.orchestra.run.smithi152:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-17T08:45:24.764 INFO:teuthology.orchestra.run.smithi152.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-17T08:45:24.764 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-17T08:45:24.764 INFO:teuthology.orchestra.run.smithi152.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-17T08:45:24.764 INFO:teuthology.orchestra.run.smithi152.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-17T08:45:24.764 INFO:teuthology.orchestra.run.smithi152.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-17T08:45:24.764 INFO:teuthology.orchestra.run.smithi152.stdout: = sunit=0 swidth=0 blks 2024-04-17T08:45:24.764 INFO:teuthology.orchestra.run.smithi152.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-17T08:45:24.764 INFO:teuthology.orchestra.run.smithi152.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-17T08:45:24.764 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-17T08:45:24.764 INFO:teuthology.orchestra.run.smithi152.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-17T08:45:25.182 INFO:teuthology.orchestra.run.smithi152.stdout:Discarding blocks...Done. 2024-04-17T08:45:25.185 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi152.front.sepia.ceph.com -o noatime 2024-04-17T08:45:25.185 DEBUG:teuthology.orchestra.run.smithi152:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-17T08:45:25.336 DEBUG:teuthology.orchestra.run.smithi152:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-17T08:45:25.352 INFO:teuthology.orchestra.run.smithi152.stderr:sudo: /sbin/restorecon: command not found 2024-04-17T08:45:25.352 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T08:45:25.353 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-17T08:45:25.413 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-17T08:45:25.413 INFO:tasks.ceph:role: osd.1 2024-04-17T08:45:25.413 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi152.front.sepia.ceph.com 2024-04-17T08:45:25.413 DEBUG:teuthology.orchestra.run.smithi152:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-17T08:45:25.480 INFO:teuthology.orchestra.run.smithi152.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-17T08:45:25.480 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-17T08:45:25.480 INFO:teuthology.orchestra.run.smithi152.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-17T08:45:25.480 INFO:teuthology.orchestra.run.smithi152.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-17T08:45:25.480 INFO:teuthology.orchestra.run.smithi152.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-17T08:45:25.480 INFO:teuthology.orchestra.run.smithi152.stdout: = sunit=0 swidth=0 blks 2024-04-17T08:45:25.481 INFO:teuthology.orchestra.run.smithi152.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-17T08:45:25.481 INFO:teuthology.orchestra.run.smithi152.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-17T08:45:25.481 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-17T08:45:25.481 INFO:teuthology.orchestra.run.smithi152.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-17T08:45:25.839 INFO:teuthology.orchestra.run.smithi152.stdout:Discarding blocks...Done. 2024-04-17T08:45:25.842 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi152.front.sepia.ceph.com -o noatime 2024-04-17T08:45:25.843 DEBUG:teuthology.orchestra.run.smithi152:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-17T08:45:25.919 DEBUG:teuthology.orchestra.run.smithi152:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-17T08:45:25.977 INFO:teuthology.orchestra.run.smithi152.stderr:sudo: /sbin/restorecon: command not found 2024-04-17T08:45:25.977 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T08:45:25.978 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-17T08:45:26.041 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-17T08:45:26.041 INFO:tasks.ceph:role: osd.2 2024-04-17T08:45:26.041 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi152.front.sepia.ceph.com 2024-04-17T08:45:26.041 DEBUG:teuthology.orchestra.run.smithi152:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-17T08:45:26.112 INFO:teuthology.orchestra.run.smithi152.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-17T08:45:26.112 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-17T08:45:26.112 INFO:teuthology.orchestra.run.smithi152.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-17T08:45:26.113 INFO:teuthology.orchestra.run.smithi152.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-17T08:45:26.113 INFO:teuthology.orchestra.run.smithi152.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-17T08:45:26.113 INFO:teuthology.orchestra.run.smithi152.stdout: = sunit=0 swidth=0 blks 2024-04-17T08:45:26.113 INFO:teuthology.orchestra.run.smithi152.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-17T08:45:26.113 INFO:teuthology.orchestra.run.smithi152.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-17T08:45:26.113 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-17T08:45:26.113 INFO:teuthology.orchestra.run.smithi152.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-17T08:45:26.498 INFO:teuthology.orchestra.run.smithi152.stdout:Discarding blocks...Done. 2024-04-17T08:45:26.501 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi152.front.sepia.ceph.com -o noatime 2024-04-17T08:45:26.502 DEBUG:teuthology.orchestra.run.smithi152:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-17T08:45:26.603 DEBUG:teuthology.orchestra.run.smithi152:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-17T08:45:26.620 INFO:teuthology.orchestra.run.smithi152.stderr:sudo: /sbin/restorecon: command not found 2024-04-17T08:45:26.621 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T08:45:26.621 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-17T08:45:26.680 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-17T08:45:26.680 INFO:tasks.ceph:role: osd.3 2024-04-17T08:45:26.680 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi152.front.sepia.ceph.com 2024-04-17T08:45:26.681 DEBUG:teuthology.orchestra.run.smithi152:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-17T08:45:26.749 INFO:teuthology.orchestra.run.smithi152.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-17T08:45:26.749 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-17T08:45:26.749 INFO:teuthology.orchestra.run.smithi152.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-17T08:45:26.749 INFO:teuthology.orchestra.run.smithi152.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-17T08:45:26.749 INFO:teuthology.orchestra.run.smithi152.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-17T08:45:26.749 INFO:teuthology.orchestra.run.smithi152.stdout: = sunit=0 swidth=0 blks 2024-04-17T08:45:26.749 INFO:teuthology.orchestra.run.smithi152.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-17T08:45:26.749 INFO:teuthology.orchestra.run.smithi152.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-17T08:45:26.749 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-17T08:45:26.749 INFO:teuthology.orchestra.run.smithi152.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-17T08:45:27.133 INFO:teuthology.orchestra.run.smithi152.stdout:Discarding blocks...Done. 2024-04-17T08:45:27.136 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi152.front.sepia.ceph.com -o noatime 2024-04-17T08:45:27.136 DEBUG:teuthology.orchestra.run.smithi152:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-17T08:45:27.256 DEBUG:teuthology.orchestra.run.smithi152:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-17T08:45:27.273 INFO:teuthology.orchestra.run.smithi152.stderr:sudo: /sbin/restorecon: command not found 2024-04-17T08:45:27.274 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T08:45:27.274 DEBUG:teuthology.orchestra.run.smithi152:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-17T08:45:27.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:27.411+0000 7fe77902b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-17T08:45:27.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:27.419+0000 7fe77902b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-17T08:45:27.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:27.419+0000 7fe77902b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-17T08:45:27.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:27.419+0000 7fe77902b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-17T08:45:27.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:27.419+0000 7fe77902b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-17T08:45:27.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:27.427+0000 7fe77902b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-17T08:45:30.477 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-17T08:45:30.498 DEBUG:teuthology.orchestra.run.smithi152:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-17T08:45:30.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:30.595+0000 7f4b77ed27c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-17T08:45:30.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:30.599+0000 7f4b77ed27c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-17T08:45:30.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:30.599+0000 7f4b77ed27c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-17T08:45:30.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:30.599+0000 7f4b77ed27c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-17T08:45:30.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:30.599+0000 7f4b77ed27c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-17T08:45:30.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:30.599+0000 7f4b77ed27c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-17T08:45:33.619 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-17T08:45:33.639 DEBUG:teuthology.orchestra.run.smithi152:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-17T08:45:33.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:33.735+0000 7f62b7b827c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-17T08:45:33.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:33.735+0000 7f62b7b827c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-17T08:45:33.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:33.735+0000 7f62b7b827c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-17T08:45:33.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:33.735+0000 7f62b7b827c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-17T08:45:33.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:33.735+0000 7f62b7b827c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-17T08:45:33.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:33.735+0000 7f62b7b827c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-17T08:45:36.775 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-17T08:45:36.796 DEBUG:teuthology.orchestra.run.smithi152:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-17T08:45:36.893 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:36.891+0000 7fc635aa07c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-17T08:45:36.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:36.895+0000 7fc635aa07c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-17T08:45:36.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:36.895+0000 7fc635aa07c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-17T08:45:36.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:36.895+0000 7fc635aa07c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-17T08:45:36.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:36.895+0000 7fc635aa07c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-17T08:45:36.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:36.895+0000 7fc635aa07c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-17T08:45:39.928 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-17T08:45:39.949 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-17T08:45:39.970 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-17T08:45:39.971 INFO:tasks.ceph:role: osd.4 2024-04-17T08:45:39.971 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi196.front.sepia.ceph.com 2024-04-17T08:45:39.971 DEBUG:teuthology.orchestra.run.smithi196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-17T08:45:40.046 INFO:teuthology.orchestra.run.smithi196.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-17T08:45:40.046 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-17T08:45:40.046 INFO:teuthology.orchestra.run.smithi196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-17T08:45:40.046 INFO:teuthology.orchestra.run.smithi196.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-17T08:45:40.046 INFO:teuthology.orchestra.run.smithi196.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-17T08:45:40.046 INFO:teuthology.orchestra.run.smithi196.stdout: = sunit=0 swidth=0 blks 2024-04-17T08:45:40.046 INFO:teuthology.orchestra.run.smithi196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-17T08:45:40.046 INFO:teuthology.orchestra.run.smithi196.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-17T08:45:40.046 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-17T08:45:40.046 INFO:teuthology.orchestra.run.smithi196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-17T08:45:40.444 INFO:teuthology.orchestra.run.smithi196.stdout:Discarding blocks...Done. 2024-04-17T08:45:40.447 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi196.front.sepia.ceph.com -o noatime 2024-04-17T08:45:40.447 DEBUG:teuthology.orchestra.run.smithi196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-17T08:45:40.545 DEBUG:teuthology.orchestra.run.smithi196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-17T08:45:40.562 INFO:teuthology.orchestra.run.smithi196.stderr:sudo: /sbin/restorecon: command not found 2024-04-17T08:45:40.563 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T08:45:40.563 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-17T08:45:40.626 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-17T08:45:40.626 INFO:tasks.ceph:role: osd.5 2024-04-17T08:45:40.626 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi196.front.sepia.ceph.com 2024-04-17T08:45:40.626 DEBUG:teuthology.orchestra.run.smithi196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-17T08:45:40.698 INFO:teuthology.orchestra.run.smithi196.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-17T08:45:40.698 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-17T08:45:40.698 INFO:teuthology.orchestra.run.smithi196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-17T08:45:40.698 INFO:teuthology.orchestra.run.smithi196.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-17T08:45:40.698 INFO:teuthology.orchestra.run.smithi196.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-17T08:45:40.698 INFO:teuthology.orchestra.run.smithi196.stdout: = sunit=0 swidth=0 blks 2024-04-17T08:45:40.698 INFO:teuthology.orchestra.run.smithi196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-17T08:45:40.698 INFO:teuthology.orchestra.run.smithi196.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-17T08:45:40.698 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-17T08:45:40.699 INFO:teuthology.orchestra.run.smithi196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-17T08:45:41.110 INFO:teuthology.orchestra.run.smithi196.stdout:Discarding blocks...Done. 2024-04-17T08:45:41.113 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi196.front.sepia.ceph.com -o noatime 2024-04-17T08:45:41.113 DEBUG:teuthology.orchestra.run.smithi196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-17T08:45:41.250 DEBUG:teuthology.orchestra.run.smithi196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-17T08:45:41.267 INFO:teuthology.orchestra.run.smithi196.stderr:sudo: /sbin/restorecon: command not found 2024-04-17T08:45:41.268 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T08:45:41.268 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-17T08:45:41.331 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-17T08:45:41.331 INFO:tasks.ceph:role: osd.6 2024-04-17T08:45:41.331 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi196.front.sepia.ceph.com 2024-04-17T08:45:41.331 DEBUG:teuthology.orchestra.run.smithi196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-17T08:45:41.406 INFO:teuthology.orchestra.run.smithi196.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-17T08:45:41.406 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-17T08:45:41.406 INFO:teuthology.orchestra.run.smithi196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-17T08:45:41.406 INFO:teuthology.orchestra.run.smithi196.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-17T08:45:41.406 INFO:teuthology.orchestra.run.smithi196.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-17T08:45:41.406 INFO:teuthology.orchestra.run.smithi196.stdout: = sunit=0 swidth=0 blks 2024-04-17T08:45:41.406 INFO:teuthology.orchestra.run.smithi196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-17T08:45:41.406 INFO:teuthology.orchestra.run.smithi196.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-17T08:45:41.407 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-17T08:45:41.407 INFO:teuthology.orchestra.run.smithi196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-17T08:45:41.816 INFO:teuthology.orchestra.run.smithi196.stdout:Discarding blocks...Done. 2024-04-17T08:45:41.820 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi196.front.sepia.ceph.com -o noatime 2024-04-17T08:45:41.820 DEBUG:teuthology.orchestra.run.smithi196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-17T08:45:41.941 DEBUG:teuthology.orchestra.run.smithi196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-17T08:45:41.959 INFO:teuthology.orchestra.run.smithi196.stderr:sudo: /sbin/restorecon: command not found 2024-04-17T08:45:41.959 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T08:45:41.960 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-17T08:45:42.025 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-17T08:45:42.025 INFO:tasks.ceph:role: osd.7 2024-04-17T08:45:42.025 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi196.front.sepia.ceph.com 2024-04-17T08:45:42.025 DEBUG:teuthology.orchestra.run.smithi196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-17T08:45:42.097 INFO:teuthology.orchestra.run.smithi196.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-17T08:45:42.097 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-17T08:45:42.097 INFO:teuthology.orchestra.run.smithi196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-17T08:45:42.097 INFO:teuthology.orchestra.run.smithi196.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-17T08:45:42.097 INFO:teuthology.orchestra.run.smithi196.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-17T08:45:42.097 INFO:teuthology.orchestra.run.smithi196.stdout: = sunit=0 swidth=0 blks 2024-04-17T08:45:42.098 INFO:teuthology.orchestra.run.smithi196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-17T08:45:42.098 INFO:teuthology.orchestra.run.smithi196.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-17T08:45:42.098 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-17T08:45:42.098 INFO:teuthology.orchestra.run.smithi196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-17T08:45:42.463 INFO:teuthology.orchestra.run.smithi196.stdout:Discarding blocks...Done. 2024-04-17T08:45:42.465 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi196.front.sepia.ceph.com -o noatime 2024-04-17T08:45:42.466 DEBUG:teuthology.orchestra.run.smithi196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-17T08:45:42.542 DEBUG:teuthology.orchestra.run.smithi196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-17T08:45:42.605 INFO:teuthology.orchestra.run.smithi196.stderr:sudo: /sbin/restorecon: command not found 2024-04-17T08:45:42.606 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T08:45:42.606 DEBUG:teuthology.orchestra.run.smithi196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-17T08:45:42.729 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:45:42.731+0000 7fc12122b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-17T08:45:42.731 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:45:42.735+0000 7fc12122b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-17T08:45:42.731 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:45:42.735+0000 7fc12122b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-17T08:45:42.731 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:45:42.735+0000 7fc12122b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-17T08:45:42.731 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:45:42.735+0000 7fc12122b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-17T08:45:42.735 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:45:42.739+0000 7fc12122b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-17T08:45:45.777 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-17T08:45:45.799 DEBUG:teuthology.orchestra.run.smithi196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-17T08:45:45.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:45:45.895+0000 7fef6c9207c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-17T08:45:45.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:45:45.899+0000 7fef6c9207c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-17T08:45:45.894 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:45:45.899+0000 7fef6c9207c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-17T08:45:45.894 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:45:45.899+0000 7fef6c9207c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-17T08:45:45.894 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:45:45.899+0000 7fef6c9207c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-17T08:45:45.896 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:45:45.899+0000 7fef6c9207c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-17T08:45:48.968 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-17T08:45:48.989 DEBUG:teuthology.orchestra.run.smithi196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-17T08:45:49.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:45:49.083+0000 7fec3788e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-17T08:45:49.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:45:49.083+0000 7fec3788e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-17T08:45:49.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:45:49.083+0000 7fec3788e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-17T08:45:49.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:45:49.083+0000 7fec3788e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-17T08:45:49.081 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:45:49.083+0000 7fec3788e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-17T08:45:49.082 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:45:49.083+0000 7fec3788e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-17T08:45:51.529 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T08:45:51.533 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T08:45:52.172 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-17T08:45:52.193 DEBUG:teuthology.orchestra.run.smithi196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-17T08:45:52.285 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:45:52.286+0000 7f3452d197c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-17T08:45:52.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:45:52.290+0000 7f3452d197c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-17T08:45:52.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:45:52.290+0000 7f3452d197c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-17T08:45:52.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:45:52.290+0000 7f3452d197c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-17T08:45:52.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:45:52.290+0000 7f3452d197c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-17T08:45:52.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:45:52.290+0000 7f3452d197c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-17T08:45:55.320 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-17T08:45:55.341 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-17T08:45:55.341 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-17T08:45:55.341 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-17T08:45:55.363 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-17T08:45:55.364 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-17T08:45:55.425 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-17T08:45:55.425 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-17T08:45:55.493 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-17T08:45:55.494 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-17T08:45:55.557 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-17T08:45:55.558 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-17T08:45:55.625 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-17T08:45:55.625 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-17T08:45:55.689 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-17T08:45:55.690 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-17T08:45:55.753 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-17T08:45:55.753 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-17T08:45:55.775 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-17T08:45:55.775 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-17T08:45:55.839 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-17T08:45:55.839 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-17T08:45:55.902 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-17T08:45:55.902 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-17T08:45:55.970 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-17T08:45:55.970 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-17T08:45:56.034 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-17T08:45:56.035 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-17T08:45:56.099 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-17T08:45:56.099 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-17T08:45:56.162 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-17T08:45:56.162 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-17T08:45:56.171 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-17T08:45:56.172 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-04-17T08:45:56.221 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-17T08:45:56.222 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-17T08:45:56.230 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-17T08:45:56.231 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-04-17T08:45:56.282 INFO:tasks.ceph:Adding keys to all mons... 2024-04-17T08:45:56.282 DEBUG:teuthology.orchestra.run.smithi152:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-17T08:45:56.285 DEBUG:teuthology.orchestra.run.smithi196:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-17T08:45:56.334 INFO:teuthology.orchestra.run.smithi152.stdout:[mgr.y] 2024-04-17T08:45:56.334 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQAjjB9mPxPpMxAAaNmkmPoNfoRHO9Jd/x8SeA== 2024-04-17T08:45:56.334 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.a] 2024-04-17T08:45:56.334 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQAkjB9m+ilEABAAVK3i5UGqk/+TD4cpzTIlJQ== 2024-04-17T08:45:56.334 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.c] 2024-04-17T08:45:56.334 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQAkjB9mGf5xBxAA1/A1rbRX6Z+qzsmQNAb1Lw== 2024-04-17T08:45:56.334 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.0] 2024-04-17T08:45:56.334 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQAnjB9m/8LNGBAAZFSeoFLldMHcRxotT6tmPw== 2024-04-17T08:45:56.334 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.1] 2024-04-17T08:45:56.334 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQAqjB9m5SbCIxAA+Jf9yKW3yTCOWVI1gpv0OQ== 2024-04-17T08:45:56.335 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.2] 2024-04-17T08:45:56.335 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQAtjB9mlZn6KxAAaKgc/jLBHOS8YTJ6BTNfpQ== 2024-04-17T08:45:56.335 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.3] 2024-04-17T08:45:56.335 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQAwjB9mT/NoNRAA7Fzs3L3df3qjKWYlMio71w== 2024-04-17T08:45:56.335 INFO:teuthology.orchestra.run.smithi152.stdout:[mgr.x] 2024-04-17T08:45:56.335 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQAjjB9mR+fQNxAAJM0Z33u1iYNtMqGYFak5tQ== 2024-04-17T08:45:56.335 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.b] 2024-04-17T08:45:56.335 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQAkjB9mF6ZbDBAAI4unnmSecCm8KoQVXSsVqQ== 2024-04-17T08:45:56.335 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.d] 2024-04-17T08:45:56.335 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQAkjB9mW7vLExAAtNjXP6TgkRsyeE67PovPoQ== 2024-04-17T08:45:56.335 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.4] 2024-04-17T08:45:56.335 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQA2jB9mHS3OKxAAP/3nMCB6mlZT8y+FJBPp1w== 2024-04-17T08:45:56.335 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.5] 2024-04-17T08:45:56.336 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQA5jB9meACWNRAAYx2W7obCh6nwVn+RWoO6AQ== 2024-04-17T08:45:56.336 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.6] 2024-04-17T08:45:56.336 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQA9jB9mz7cRBRAAlN7o8BUpJ0Zy8swnx2gU0g== 2024-04-17T08:45:56.336 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.7] 2024-04-17T08:45:56.336 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQBAjB9mjjdVERAA1BVeJPViaZojOl/Oz/tsXw== 2024-04-17T08:45:56.336 INFO:teuthology.orchestra.run.smithi152.stdout:[client.0] 2024-04-17T08:45:56.336 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQAkjB9mPgvRFxAAe9v2psm5V7QNTuK9ytMuxQ== 2024-04-17T08:45:56.336 INFO:teuthology.orchestra.run.smithi152.stdout:[client.2] 2024-04-17T08:45:56.336 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQAkjB9me8XUHRAAeFZRw9wxA8VPklmbWIvDOg== 2024-04-17T08:45:56.336 INFO:teuthology.orchestra.run.smithi152.stdout:[client.1] 2024-04-17T08:45:56.336 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQAkjB9mfMx7IRAAfvDOCRPcGBXZj7zKg4lHYw== 2024-04-17T08:45:56.336 INFO:teuthology.orchestra.run.smithi152.stdout:[client.3] 2024-04-17T08:45:56.336 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQAkjB9mnJWUJxAAz4RbvyEAn77/12N82VHHIw== 2024-04-17T08:45:56.348 INFO:teuthology.orchestra.run.smithi196.stdout:[mgr.y] 2024-04-17T08:45:56.348 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQAjjB9mPxPpMxAAaNmkmPoNfoRHO9Jd/x8SeA== 2024-04-17T08:45:56.349 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.a] 2024-04-17T08:45:56.349 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQAkjB9m+ilEABAAVK3i5UGqk/+TD4cpzTIlJQ== 2024-04-17T08:45:56.349 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.c] 2024-04-17T08:45:56.349 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQAkjB9mGf5xBxAA1/A1rbRX6Z+qzsmQNAb1Lw== 2024-04-17T08:45:56.349 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.0] 2024-04-17T08:45:56.349 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQAnjB9m/8LNGBAAZFSeoFLldMHcRxotT6tmPw== 2024-04-17T08:45:56.349 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.1] 2024-04-17T08:45:56.349 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQAqjB9m5SbCIxAA+Jf9yKW3yTCOWVI1gpv0OQ== 2024-04-17T08:45:56.349 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.2] 2024-04-17T08:45:56.349 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQAtjB9mlZn6KxAAaKgc/jLBHOS8YTJ6BTNfpQ== 2024-04-17T08:45:56.349 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.3] 2024-04-17T08:45:56.349 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQAwjB9mT/NoNRAA7Fzs3L3df3qjKWYlMio71w== 2024-04-17T08:45:56.349 INFO:teuthology.orchestra.run.smithi196.stdout:[mgr.x] 2024-04-17T08:45:56.350 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQAjjB9mR+fQNxAAJM0Z33u1iYNtMqGYFak5tQ== 2024-04-17T08:45:56.350 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.b] 2024-04-17T08:45:56.350 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQAkjB9mF6ZbDBAAI4unnmSecCm8KoQVXSsVqQ== 2024-04-17T08:45:56.350 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.d] 2024-04-17T08:45:56.350 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQAkjB9mW7vLExAAtNjXP6TgkRsyeE67PovPoQ== 2024-04-17T08:45:56.350 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.4] 2024-04-17T08:45:56.350 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQA2jB9mHS3OKxAAP/3nMCB6mlZT8y+FJBPp1w== 2024-04-17T08:45:56.350 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.5] 2024-04-17T08:45:56.350 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQA5jB9meACWNRAAYx2W7obCh6nwVn+RWoO6AQ== 2024-04-17T08:45:56.350 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.6] 2024-04-17T08:45:56.350 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQA9jB9mz7cRBRAAlN7o8BUpJ0Zy8swnx2gU0g== 2024-04-17T08:45:56.350 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.7] 2024-04-17T08:45:56.350 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQBAjB9mjjdVERAA1BVeJPViaZojOl/Oz/tsXw== 2024-04-17T08:45:56.351 INFO:teuthology.orchestra.run.smithi196.stdout:[client.0] 2024-04-17T08:45:56.351 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQAkjB9mPgvRFxAAe9v2psm5V7QNTuK9ytMuxQ== 2024-04-17T08:45:56.351 INFO:teuthology.orchestra.run.smithi196.stdout:[client.2] 2024-04-17T08:45:56.351 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQAkjB9me8XUHRAAeFZRw9wxA8VPklmbWIvDOg== 2024-04-17T08:45:56.351 INFO:teuthology.orchestra.run.smithi196.stdout:[client.1] 2024-04-17T08:45:56.351 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQAkjB9mfMx7IRAAfvDOCRPcGBXZj7zKg4lHYw== 2024-04-17T08:45:56.351 INFO:teuthology.orchestra.run.smithi196.stdout:[client.3] 2024-04-17T08:45:56.351 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQAkjB9mnJWUJxAAz4RbvyEAn77/12N82VHHIw== 2024-04-17T08:45:56.352 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-17T08:45:56.384 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-17T08:45:56.452 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-17T08:45:56.455 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-17T08:45:56.514 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-17T08:45:56.517 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-17T08:45:56.575 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T08:45:56.578 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T08:45:56.630 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T08:45:56.633 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T08:45:56.740 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T08:45:56.744 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T08:45:56.797 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T08:45:56.800 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T08:45:56.853 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-17T08:45:56.856 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-17T08:45:56.908 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-17T08:45:56.911 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-17T08:45:56.967 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-17T08:45:56.970 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-17T08:45:57.025 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T08:45:57.028 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T08:45:57.081 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T08:45:57.085 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T08:45:57.137 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T08:45:57.140 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T08:45:57.193 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T08:45:57.196 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T08:45:57.248 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-17T08:45:57.252 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-17T08:45:57.308 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-17T08:45:57.312 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-17T08:45:57.367 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-17T08:45:57.370 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-17T08:45:57.425 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-17T08:45:57.428 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-17T08:45:57.484 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-17T08:45:57.484 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-17T08:45:57.503 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-17T08:45:57.613 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-17T08:45:57.633 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-17T08:45:57.653 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-17T08:45:57.762 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-17T08:45:57.782 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-17T08:45:57.841 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-17T08:45:57.950 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-17T08:45:57.969 DEBUG:teuthology.orchestra.run.smithi152:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-17T08:45:57.972 DEBUG:teuthology.orchestra.run.smithi196:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-17T08:45:58.022 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-17T08:45:58.022 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-17T08:45:58.022 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-17T08:45:58.025 INFO:tasks.ceph.mon.a:Started 2024-04-17T08:45:58.025 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-17T08:45:58.025 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-17T08:45:58.065 INFO:tasks.ceph.mon.b:Started 2024-04-17T08:45:58.065 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-17T08:45:58.065 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-17T08:45:58.068 INFO:tasks.ceph.mon.c:Started 2024-04-17T08:45:58.068 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-17T08:45:58.068 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-17T08:45:58.068 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-17T08:45:58.071 INFO:tasks.ceph.mgr.y:Started 2024-04-17T08:45:58.071 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-17T08:45:58.071 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-17T08:45:58.074 INFO:tasks.ceph.mgr.x:Started 2024-04-17T08:45:58.074 INFO:tasks.ceph:Setting crush tunables to default 2024-04-17T08:45:58.075 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd crush tunables default 2024-04-17T08:45:58.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:58.214+0000 7fe61d000640 1 Processor -- start 2024-04-17T08:45:58.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:58.214+0000 7fe61d000640 1 -- start start 2024-04-17T08:45:58.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:58.214+0000 7fe61d000640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fe618071790 0x7fe61806d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:45:58.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:58.214+0000 7fe61d000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe6180d0250 0x7fe6180d06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:45:58.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:58.214+0000 7fe61d000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6181482f0 con 0x7fe618147a70 2024-04-17T08:45:58.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:58.214+0000 7fe61d000640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fe61806e660 con 0x7fe618071790 2024-04-17T08:45:58.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:58.214+0000 7fe61d000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fe61806da50 con 0x7fe6180d0250 2024-04-17T08:45:58.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:58.214+0000 7fe615e00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fe618071790 0x7fe61806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:45:58.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:58.214+0000 7fe615e00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fe618071790 0x7fe61806d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50836/0 (socket says 172.21.15.152:50836) 2024-04-17T08:45:58.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:58.214+0000 7fe615e00640 1 -- 172.21.15.152:0/1866792275 learned_addr learned my addr 172.21.15.152:0/1866792275 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:45:58.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:58.214+0000 7fe616800640 1 --2- 172.21.15.152:0/1866792275 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe6180d0250 0x7fe6180d06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:45:58.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:58.214+0000 7fe615e00640 1 -- 172.21.15.152:0/1866792275 >> v2:172.21.15.152:3300/0 conn(0x7fe618071790 msgr2=0x7fe61806d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-17T08:45:58.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:58.214+0000 7fe615e00640 1 -- 172.21.15.152:0/1866792275 >> v2:172.21.15.152:3300/0 conn(0x7fe618071790 msgr2=0x7fe61806d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T08:45:58.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:58.214+0000 7fe615e00640 1 --2- 172.21.15.152:0/1866792275 >> v2:172.21.15.152:3300/0 conn(0x7fe618071790 0x7fe61806d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T08:45:58.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:58.214+0000 7fe615e00640 1 --2- 172.21.15.152:0/1866792275 >> v2:172.21.15.152:3300/0 conn(0x7fe618071790 0x7fe61806d350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T08:45:58.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:58.214+0000 7fe616800640 1 -- 172.21.15.152:0/1866792275 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe6180d0250 msgr2=0x7fe6180d06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-17T08:45:58.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:58.214+0000 7fe616800640 1 -- 172.21.15.152:0/1866792275 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe6180d0250 msgr2=0x7fe6180d06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T08:45:58.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:58.214+0000 7fe616800640 1 --2- 172.21.15.152:0/1866792275 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe6180d0250 0x7fe6180d06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T08:45:58.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:58.214+0000 7fe616800640 1 --2- 172.21.15.152:0/1866792275 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe6180d0250 0x7fe6180d06e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T08:45:58.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:58.418+0000 7fe615e00640 1 --2- 172.21.15.152:0/1866792275 >> v2:172.21.15.152:3300/0 conn(0x7fe618071790 0x7fe61806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:45:58.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:58.418+0000 7fe615e00640 1 -- 172.21.15.152:0/1866792275 >> v2:172.21.15.152:3300/0 conn(0x7fe618071790 msgr2=0x7fe61806d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-17T08:45:58.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:58.418+0000 7fe615e00640 1 -- 172.21.15.152:0/1866792275 >> v2:172.21.15.152:3300/0 conn(0x7fe618071790 msgr2=0x7fe61806d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T08:45:58.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:58.418+0000 7fe615e00640 1 --2- 172.21.15.152:0/1866792275 >> v2:172.21.15.152:3300/0 conn(0x7fe618071790 0x7fe61806d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T08:45:58.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:58.418+0000 7fe616800640 1 --2- 172.21.15.152:0/1866792275 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe6180d0250 0x7fe6180d06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:45:58.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:58.418+0000 7fe615e00640 1 --2- 172.21.15.152:0/1866792275 >> v2:172.21.15.152:3300/0 conn(0x7fe618071790 0x7fe61806d350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-17T08:45:58.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:58.418+0000 7fe616800640 1 -- 172.21.15.152:0/1866792275 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe6180d0250 msgr2=0x7fe6180d06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-17T08:45:58.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:58.418+0000 7fe616800640 1 -- 172.21.15.152:0/1866792275 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe6180d0250 msgr2=0x7fe6180d06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T08:45:58.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:58.418+0000 7fe616800640 1 --2- 172.21.15.152:0/1866792275 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe6180d0250 0x7fe6180d06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T08:45:58.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:58.418+0000 7fe616800640 1 --2- 172.21.15.152:0/1866792275 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe6180d0250 0x7fe6180d06e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-17T08:45:58.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:58.822+0000 7fe615e00640 1 --2- 172.21.15.152:0/1866792275 >> v2:172.21.15.152:3300/0 conn(0x7fe618071790 0x7fe61806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:45:58.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:58.822+0000 7fe616800640 1 --2- 172.21.15.152:0/1866792275 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe6180d0250 0x7fe6180d06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:45:58.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:58.822+0000 7fe615e00640 1 -- 172.21.15.152:0/1866792275 >> v2:172.21.15.152:3300/0 conn(0x7fe618071790 msgr2=0x7fe61806d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-17T08:45:58.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:58.822+0000 7fe615e00640 1 -- 172.21.15.152:0/1866792275 >> v2:172.21.15.152:3300/0 conn(0x7fe618071790 msgr2=0x7fe61806d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T08:45:58.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:58.822+0000 7fe615e00640 1 --2- 172.21.15.152:0/1866792275 >> v2:172.21.15.152:3300/0 conn(0x7fe618071790 0x7fe61806d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T08:45:58.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:58.822+0000 7fe615e00640 1 --2- 172.21.15.152:0/1866792275 >> v2:172.21.15.152:3300/0 conn(0x7fe618071790 0x7fe61806d350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-17T08:45:58.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:58.822+0000 7fe616800640 1 -- 172.21.15.152:0/1866792275 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe6180d0250 msgr2=0x7fe6180d06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-17T08:45:58.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:58.822+0000 7fe616800640 1 -- 172.21.15.152:0/1866792275 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe6180d0250 msgr2=0x7fe6180d06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T08:45:58.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:58.822+0000 7fe616800640 1 --2- 172.21.15.152:0/1866792275 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe6180d0250 0x7fe6180d06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T08:45:58.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:58.822+0000 7fe616800640 1 --2- 172.21.15.152:0/1866792275 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe6180d0250 0x7fe6180d06e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-17T08:45:59.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:59.626+0000 7fe615e00640 1 --2- 172.21.15.152:0/1866792275 >> v2:172.21.15.152:3300/0 conn(0x7fe618071790 0x7fe61806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:45:59.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:59.626+0000 7fe615e00640 1 -- 172.21.15.152:0/1866792275 >> v2:172.21.15.152:3300/0 conn(0x7fe618071790 msgr2=0x7fe61806d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-17T08:45:59.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:59.626+0000 7fe615e00640 1 -- 172.21.15.152:0/1866792275 >> v2:172.21.15.152:3300/0 conn(0x7fe618071790 msgr2=0x7fe61806d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T08:45:59.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:59.626+0000 7fe615e00640 1 --2- 172.21.15.152:0/1866792275 >> v2:172.21.15.152:3300/0 conn(0x7fe618071790 0x7fe61806d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T08:45:59.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:59.626+0000 7fe615e00640 1 --2- 172.21.15.152:0/1866792275 >> v2:172.21.15.152:3300/0 conn(0x7fe618071790 0x7fe61806d350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-17T08:45:59.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:59.626+0000 7fe616800640 1 --2- 172.21.15.152:0/1866792275 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe6180d0250 0x7fe6180d06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:45:59.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:59.626+0000 7fe616800640 1 -- 172.21.15.152:0/1866792275 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe6180d0250 msgr2=0x7fe6180d06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-17T08:45:59.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:59.626+0000 7fe616800640 1 -- 172.21.15.152:0/1866792275 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe6180d0250 msgr2=0x7fe6180d06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T08:45:59.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:59.626+0000 7fe616800640 1 --2- 172.21.15.152:0/1866792275 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe6180d0250 0x7fe6180d06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T08:45:59.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:45:59.626+0000 7fe616800640 1 --2- 172.21.15.152:0/1866792275 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe6180d0250 0x7fe6180d06e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-17T08:46:01.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:01.214+0000 7fe60fe00640 1 -- 172.21.15.152:0/1866792275 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe6180d0250 msgr2=0x7fe6180d06e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-17T08:46:01.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:01.214+0000 7fe60fe00640 1 --2- 172.21.15.152:0/1866792275 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe6180d0250 0x7fe6180d06e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:01.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:01.214+0000 7fe60fe00640 1 -- 172.21.15.152:0/1866792275 >> v2:172.21.15.152:3300/0 conn(0x7fe618071790 msgr2=0x7fe61806d350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-17T08:46:01.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:01.214+0000 7fe60fe00640 1 --2- 172.21.15.152:0/1866792275 >> v2:172.21.15.152:3300/0 conn(0x7fe618071790 0x7fe61806d350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:01.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:01.214+0000 7fe60fe00640 1 -- 172.21.15.152:0/1866792275 >> v1:172.21.15.196:6789/0 conn(0x7fe618147a70 legacy=0x7fe618071b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:01.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:01.214+0000 7fe60fe00640 1 --2- 172.21.15.152:0/1866792275 >> v2:172.21.15.196:3300/0 conn(0x7fe5f40036f0 0x7fe5f4005b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:01.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:01.214+0000 7fe60fe00640 1 -- 172.21.15.152:0/1866792275 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe61806dd30 con 0x7fe5f4006180 2024-04-17T08:46:01.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:01.214+0000 7fe60fe00640 1 -- 172.21.15.152:0/1866792275 --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fe61806e660 con 0x7fe5f40036f0 2024-04-17T08:46:01.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:01.214+0000 7fe615e00640 1 --2- 172.21.15.152:0/1866792275 >> v2:172.21.15.196:3300/0 conn(0x7fe5f40036f0 0x7fe5f4005b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:01.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:01.214+0000 7fe615e00640 1 -- 172.21.15.152:0/1866792275 >> v2:172.21.15.196:3300/0 conn(0x7fe5f40036f0 msgr2=0x7fe5f4005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-17T08:46:01.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:01.214+0000 7fe615e00640 1 -- 172.21.15.152:0/1866792275 >> v2:172.21.15.196:3300/0 conn(0x7fe5f40036f0 msgr2=0x7fe5f4005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T08:46:01.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:01.214+0000 7fe615e00640 1 --2- 172.21.15.152:0/1866792275 >> v2:172.21.15.196:3300/0 conn(0x7fe5f40036f0 0x7fe5f4005b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T08:46:01.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:01.214+0000 7fe615e00640 1 --2- 172.21.15.152:0/1866792275 >> v2:172.21.15.196:3300/0 conn(0x7fe5f40036f0 0x7fe5f4005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T08:46:01.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:01.418+0000 7fe615e00640 1 --2- 172.21.15.152:0/1866792275 >> v2:172.21.15.196:3300/0 conn(0x7fe5f40036f0 0x7fe5f4005b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:01.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:01.418+0000 7fe615e00640 1 -- 172.21.15.152:0/1866792275 >> v2:172.21.15.196:3300/0 conn(0x7fe5f40036f0 msgr2=0x7fe5f4005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-17T08:46:01.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:01.418+0000 7fe615e00640 1 -- 172.21.15.152:0/1866792275 >> v2:172.21.15.196:3300/0 conn(0x7fe5f40036f0 msgr2=0x7fe5f4005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T08:46:01.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:01.418+0000 7fe615e00640 1 --2- 172.21.15.152:0/1866792275 >> v2:172.21.15.196:3300/0 conn(0x7fe5f40036f0 0x7fe5f4005b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T08:46:01.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:01.418+0000 7fe615e00640 1 --2- 172.21.15.152:0/1866792275 >> v2:172.21.15.196:3300/0 conn(0x7fe5f40036f0 0x7fe5f4005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-17T08:46:01.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:01.822+0000 7fe615e00640 1 --2- 172.21.15.152:0/1866792275 >> v2:172.21.15.196:3300/0 conn(0x7fe5f40036f0 0x7fe5f4005b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:01.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:01.822+0000 7fe615e00640 1 -- 172.21.15.152:0/1866792275 >> v2:172.21.15.196:3300/0 conn(0x7fe5f40036f0 msgr2=0x7fe5f4005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-17T08:46:01.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:01.822+0000 7fe615e00640 1 -- 172.21.15.152:0/1866792275 >> v2:172.21.15.196:3300/0 conn(0x7fe5f40036f0 msgr2=0x7fe5f4005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T08:46:01.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:01.822+0000 7fe615e00640 1 --2- 172.21.15.152:0/1866792275 >> v2:172.21.15.196:3300/0 conn(0x7fe5f40036f0 0x7fe5f4005b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T08:46:01.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:01.822+0000 7fe615e00640 1 --2- 172.21.15.152:0/1866792275 >> v2:172.21.15.196:3300/0 conn(0x7fe5f40036f0 0x7fe5f4005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-17T08:46:02.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:02.626+0000 7fe615e00640 1 --2- 172.21.15.152:0/1866792275 >> v2:172.21.15.196:3300/0 conn(0x7fe5f40036f0 0x7fe5f4005b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:02.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:02.626+0000 7fe615e00640 1 -- 172.21.15.152:0/1866792275 >> v2:172.21.15.196:3300/0 conn(0x7fe5f40036f0 msgr2=0x7fe5f4005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-17T08:46:02.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:02.626+0000 7fe615e00640 1 -- 172.21.15.152:0/1866792275 >> v2:172.21.15.196:3300/0 conn(0x7fe5f40036f0 msgr2=0x7fe5f4005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T08:46:02.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:02.626+0000 7fe615e00640 1 --2- 172.21.15.152:0/1866792275 >> v2:172.21.15.196:3300/0 conn(0x7fe5f40036f0 0x7fe5f4005b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T08:46:02.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:02.626+0000 7fe615e00640 1 --2- 172.21.15.152:0/1866792275 >> v2:172.21.15.196:3300/0 conn(0x7fe5f40036f0 0x7fe5f4005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-17T08:46:04.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:04.214+0000 7fe60fe00640 1 -- 172.21.15.152:0/1866792275 >> v2:172.21.15.196:3300/0 conn(0x7fe5f40036f0 msgr2=0x7fe5f4005b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-17T08:46:04.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:04.214+0000 7fe60fe00640 1 --2- 172.21.15.152:0/1866792275 >> v2:172.21.15.196:3300/0 conn(0x7fe5f40036f0 0x7fe5f4005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:04.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:04.214+0000 7fe60fe00640 1 -- 172.21.15.152:0/1866792275 >> v1:172.21.15.152:6789/0 conn(0x7fe5f4006180 legacy=0x7fe5f4008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:04.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:04.214+0000 7fe616800640 1 -- 172.21.15.152:0/1866792275 reap_dead start 2024-04-17T08:46:04.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:04.214+0000 7fe60fe00640 1 --2- 172.21.15.152:0/1866792275 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5f4005b30 0x7fe5f400e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:04.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:04.214+0000 7fe60fe00640 1 -- 172.21.15.152:0/1866792275 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5f400af00 con 0x7fe5f400a6d0 2024-04-17T08:46:04.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:04.214+0000 7fe60fe00640 1 -- 172.21.15.152:0/1866792275 --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5f400ac50 con 0x7fe618147a70 2024-04-17T08:46:04.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:04.214+0000 7fe60fe00640 1 -- 172.21.15.152:0/1866792275 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fe61806e660 con 0x7fe5f4005b30 2024-04-17T08:46:04.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:04.214+0000 7fe616800640 1 --2- 172.21.15.152:0/1866792275 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5f4005b30 0x7fe5f400e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:04.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:04.214+0000 7fe616800640 1 -- 172.21.15.152:0/1866792275 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5f4005b30 msgr2=0x7fe5f400e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-17T08:46:04.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:04.214+0000 7fe616800640 1 -- 172.21.15.152:0/1866792275 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5f4005b30 msgr2=0x7fe5f400e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T08:46:04.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:04.214+0000 7fe616800640 1 --2- 172.21.15.152:0/1866792275 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5f4005b30 0x7fe5f400e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T08:46:04.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:04.218+0000 7fe616800640 1 --2- 172.21.15.152:0/1866792275 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5f4005b30 0x7fe5f400e250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T08:46:04.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:04.422+0000 7fe616800640 1 --2- 172.21.15.152:0/1866792275 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5f4005b30 0x7fe5f400e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:04.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:04.422+0000 7fe616800640 1 -- 172.21.15.152:0/1866792275 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5f4005b30 msgr2=0x7fe5f400e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-17T08:46:04.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:04.422+0000 7fe616800640 1 -- 172.21.15.152:0/1866792275 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5f4005b30 msgr2=0x7fe5f400e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T08:46:04.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:04.422+0000 7fe616800640 1 --2- 172.21.15.152:0/1866792275 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5f4005b30 0x7fe5f400e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T08:46:04.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:04.422+0000 7fe616800640 1 --2- 172.21.15.152:0/1866792275 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5f4005b30 0x7fe5f400e250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-17T08:46:04.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:04.826+0000 7fe616800640 1 --2- 172.21.15.152:0/1866792275 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5f4005b30 0x7fe5f400e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:04.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:04.826+0000 7fe616800640 1 -- 172.21.15.152:0/1866792275 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5f4005b30 msgr2=0x7fe5f400e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-17T08:46:04.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:04.826+0000 7fe616800640 1 -- 172.21.15.152:0/1866792275 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5f4005b30 msgr2=0x7fe5f400e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T08:46:04.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:04.826+0000 7fe616800640 1 --2- 172.21.15.152:0/1866792275 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5f4005b30 0x7fe5f400e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T08:46:04.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:04.826+0000 7fe616800640 1 --2- 172.21.15.152:0/1866792275 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5f4005b30 0x7fe5f400e250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-17T08:46:05.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:05.630+0000 7fe616800640 1 --2- 172.21.15.152:0/1866792275 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5f4005b30 0x7fe5f400e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:05.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:05.630+0000 7fe616800640 1 -- 172.21.15.152:0/1866792275 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5f4005b30 msgr2=0x7fe5f400e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-17T08:46:05.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:05.630+0000 7fe616800640 1 -- 172.21.15.152:0/1866792275 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5f4005b30 msgr2=0x7fe5f400e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T08:46:05.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:05.630+0000 7fe616800640 1 --2- 172.21.15.152:0/1866792275 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5f4005b30 0x7fe5f400e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T08:46:05.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:05.630+0000 7fe616800640 1 --2- 172.21.15.152:0/1866792275 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5f4005b30 0x7fe5f400e250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-17T08:46:07.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:07.214+0000 7fe60fe00640 1 -- 172.21.15.152:0/1866792275 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5f4005b30 msgr2=0x7fe5f400e250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-17T08:46:07.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:07.214+0000 7fe60fe00640 1 --2- 172.21.15.152:0/1866792275 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe5f4005b30 0x7fe5f400e250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:07.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:07.214+0000 7fe60fe00640 1 -- 172.21.15.152:0/1866792275 >> v1:172.21.15.196:6789/0 conn(0x7fe618147a70 legacy=0x7fe5f4009fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:07.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:07.214+0000 7fe60fe00640 1 -- 172.21.15.152:0/1866792275 >> v1:172.21.15.152:6789/0 conn(0x7fe5f400a6d0 legacy=0x7fe5f4006630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:07.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:07.214+0000 7fe60fe00640 1 --2- 172.21.15.152:0/1866792275 >> v2:172.21.15.152:3300/0 conn(0x7fe5f400e9b0 0x7fe5f400ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:07.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:07.214+0000 7fe60fe00640 1 --2- 172.21.15.152:0/1866792275 >> v2:172.21.15.196:3300/0 conn(0x7fe5f400f4f0 0x7fe5f400f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:07.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:07.214+0000 7fe60fe00640 1 -- 172.21.15.152:0/1866792275 --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fe61806e660 con 0x7fe5f400e9b0 2024-04-17T08:46:07.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:07.214+0000 7fe60fe00640 1 -- 172.21.15.152:0/1866792275 --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fe61806da50 con 0x7fe5f400f4f0 2024-04-17T08:46:07.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:07.218+0000 7fe615e00640 1 --2- 172.21.15.152:0/1866792275 >> v2:172.21.15.152:3300/0 conn(0x7fe5f400e9b0 0x7fe5f400ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:07.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:07.218+0000 7fe60d400640 1 --2- 172.21.15.152:0/1866792275 >> v2:172.21.15.196:3300/0 conn(0x7fe5f400f4f0 0x7fe5f400f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:07.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:07.218+0000 7fe615e00640 1 -- 172.21.15.152:0/1866792275 >> v2:172.21.15.152:3300/0 conn(0x7fe5f400e9b0 msgr2=0x7fe5f400ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-17T08:46:07.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:07.218+0000 7fe615e00640 1 -- 172.21.15.152:0/1866792275 >> v2:172.21.15.152:3300/0 conn(0x7fe5f400e9b0 msgr2=0x7fe5f400ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T08:46:07.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:07.218+0000 7fe615e00640 1 --2- 172.21.15.152:0/1866792275 >> v2:172.21.15.152:3300/0 conn(0x7fe5f400e9b0 0x7fe5f400ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T08:46:07.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:07.218+0000 7fe615e00640 1 --2- 172.21.15.152:0/1866792275 >> v2:172.21.15.152:3300/0 conn(0x7fe5f400e9b0 0x7fe5f400ee20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T08:46:07.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:07.218+0000 7fe60d400640 1 -- 172.21.15.152:0/1866792275 >> v2:172.21.15.196:3300/0 conn(0x7fe5f400f4f0 msgr2=0x7fe5f400f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-17T08:46:07.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:07.218+0000 7fe60d400640 1 -- 172.21.15.152:0/1866792275 >> v2:172.21.15.196:3300/0 conn(0x7fe5f400f4f0 msgr2=0x7fe5f400f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T08:46:07.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:07.218+0000 7fe60d400640 1 --2- 172.21.15.152:0/1866792275 >> v2:172.21.15.196:3300/0 conn(0x7fe5f400f4f0 0x7fe5f400f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T08:46:07.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:07.218+0000 7fe60d400640 1 --2- 172.21.15.152:0/1866792275 >> v2:172.21.15.196:3300/0 conn(0x7fe5f400f4f0 0x7fe5f400f9a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T08:46:07.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:07.422+0000 7fe615e00640 1 --2- 172.21.15.152:0/1866792275 >> v2:172.21.15.152:3300/0 conn(0x7fe5f400e9b0 0x7fe5f400ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:07.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:07.422+0000 7fe615e00640 1 -- 172.21.15.152:0/1866792275 >> v2:172.21.15.152:3300/0 conn(0x7fe5f400e9b0 msgr2=0x7fe5f400ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-17T08:46:07.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:07.422+0000 7fe615e00640 1 -- 172.21.15.152:0/1866792275 >> v2:172.21.15.152:3300/0 conn(0x7fe5f400e9b0 msgr2=0x7fe5f400ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T08:46:07.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:07.422+0000 7fe615e00640 1 --2- 172.21.15.152:0/1866792275 >> v2:172.21.15.152:3300/0 conn(0x7fe5f400e9b0 0x7fe5f400ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T08:46:07.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:07.422+0000 7fe615e00640 1 --2- 172.21.15.152:0/1866792275 >> v2:172.21.15.152:3300/0 conn(0x7fe5f400e9b0 0x7fe5f400ee20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-17T08:46:07.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:07.422+0000 7fe60d400640 1 --2- 172.21.15.152:0/1866792275 >> v2:172.21.15.196:3300/0 conn(0x7fe5f400f4f0 0x7fe5f400f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:07.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:07.422+0000 7fe60d400640 1 -- 172.21.15.152:0/1866792275 >> v2:172.21.15.196:3300/0 conn(0x7fe5f400f4f0 msgr2=0x7fe5f400f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-17T08:46:07.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:07.422+0000 7fe60d400640 1 -- 172.21.15.152:0/1866792275 >> v2:172.21.15.196:3300/0 conn(0x7fe5f400f4f0 msgr2=0x7fe5f400f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T08:46:07.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:07.422+0000 7fe60d400640 1 --2- 172.21.15.152:0/1866792275 >> v2:172.21.15.196:3300/0 conn(0x7fe5f400f4f0 0x7fe5f400f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T08:46:07.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:07.422+0000 7fe60d400640 1 --2- 172.21.15.152:0/1866792275 >> v2:172.21.15.196:3300/0 conn(0x7fe5f400f4f0 0x7fe5f400f9a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-17T08:46:07.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:07.826+0000 7fe615e00640 1 --2- 172.21.15.152:0/1866792275 >> v2:172.21.15.152:3300/0 conn(0x7fe5f400e9b0 0x7fe5f400ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:07.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:07.826+0000 7fe60d400640 1 --2- 172.21.15.152:0/1866792275 >> v2:172.21.15.196:3300/0 conn(0x7fe5f400f4f0 0x7fe5f400f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:07.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:07.826+0000 7fe615e00640 1 -- 172.21.15.152:0/1866792275 >> v2:172.21.15.152:3300/0 conn(0x7fe5f400e9b0 msgr2=0x7fe5f400ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-17T08:46:07.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:07.826+0000 7fe615e00640 1 -- 172.21.15.152:0/1866792275 >> v2:172.21.15.152:3300/0 conn(0x7fe5f400e9b0 msgr2=0x7fe5f400ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T08:46:07.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:07.826+0000 7fe615e00640 1 --2- 172.21.15.152:0/1866792275 >> v2:172.21.15.152:3300/0 conn(0x7fe5f400e9b0 0x7fe5f400ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T08:46:07.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:07.826+0000 7fe615e00640 1 --2- 172.21.15.152:0/1866792275 >> v2:172.21.15.152:3300/0 conn(0x7fe5f400e9b0 0x7fe5f400ee20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-17T08:46:07.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:07.826+0000 7fe60d400640 1 -- 172.21.15.152:0/1866792275 >> v2:172.21.15.196:3300/0 conn(0x7fe5f400f4f0 msgr2=0x7fe5f400f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-17T08:46:07.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:07.826+0000 7fe60d400640 1 -- 172.21.15.152:0/1866792275 >> v2:172.21.15.196:3300/0 conn(0x7fe5f400f4f0 msgr2=0x7fe5f400f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T08:46:07.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:07.826+0000 7fe60d400640 1 --2- 172.21.15.152:0/1866792275 >> v2:172.21.15.196:3300/0 conn(0x7fe5f400f4f0 0x7fe5f400f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T08:46:07.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:07.826+0000 7fe60d400640 1 --2- 172.21.15.152:0/1866792275 >> v2:172.21.15.196:3300/0 conn(0x7fe5f400f4f0 0x7fe5f400f9a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-17T08:46:08.589 INFO:tasks.ceph.mgr.y.smithi152.stderr:2024-04-17T08:46:08.586+0000 7f9aa09b4180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-17T08:46:08.604 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-04-17T08:46:08.605+0000 7f4975269180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-17T08:46:08.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.630+0000 7fe615e00640 1 --2- 172.21.15.152:0/1866792275 >> v2:172.21.15.152:3300/0 conn(0x7fe5f400e9b0 0x7fe5f400ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:08.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.630+0000 7fe60d400640 1 --2- 172.21.15.152:0/1866792275 >> v2:172.21.15.196:3300/0 conn(0x7fe5f400f4f0 0x7fe5f400f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:08.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.630+0000 7fe615e00640 1 -- 172.21.15.152:0/1866792275 >> v2:172.21.15.196:3300/0 conn(0x7fe5f400f4f0 msgr2=0x7fe5f400f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:08.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.630+0000 7fe615e00640 1 --2- 172.21.15.152:0/1866792275 >> v2:172.21.15.196:3300/0 conn(0x7fe5f400f4f0 0x7fe5f400f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:08.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.630+0000 7fe615e00640 1 -- 172.21.15.152:0/1866792275 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5f4010840 con 0x7fe5f400e9b0 2024-04-17T08:46:08.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.630+0000 7fe60d400640 1 --2- 172.21.15.152:0/1866792275 >> v2:172.21.15.196:3300/0 conn(0x7fe5f400f4f0 0x7fe5f400f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:46:08.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.630+0000 7fe615e00640 1 --2- 172.21.15.152:0/1866792275 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5f400e9b0 0x7fe5f400ee20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe5f400f4c0 tx=0x7fe608007320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aae9cfa78cdb796c server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:08.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.630+0000 7fe615400640 1 -- 172.21.15.152:0/1866792275 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6080b2070 con 0x7fe5f400e9b0 2024-04-17T08:46:08.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.630+0000 7fe615400640 1 -- 172.21.15.152:0/1866792275 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe608004230 con 0x7fe5f400e9b0 2024-04-17T08:46:08.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.630+0000 7fe615400640 1 -- 172.21.15.152:0/1866792275 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe60800f040 con 0x7fe5f400e9b0 2024-04-17T08:46:08.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.634+0000 7fe61d000640 1 -- 172.21.15.152:0/1866792275 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5f400e9b0 msgr2=0x7fe5f400ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:08.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.634+0000 7fe61d000640 1 --2- 172.21.15.152:0/1866792275 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5f400e9b0 0x7fe5f400ee20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe5f400f4c0 tx=0x7fe608007320 comp rx=0 tx=0).stop 2024-04-17T08:46:08.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.634+0000 7fe616800640 1 -- 172.21.15.152:0/1866792275 reap_dead start 2024-04-17T08:46:08.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.634+0000 7fe61d000640 1 -- 172.21.15.152:0/1866792275 shutdown_connections 2024-04-17T08:46:08.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.634+0000 7fe61d000640 1 --2- 172.21.15.152:0/1866792275 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5f400e9b0 0x7fe5f400ee20 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:08.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.634+0000 7fe61d000640 1 -- 172.21.15.152:0/1866792275 >> 172.21.15.152:0/1866792275 conn(0x7fe6180d2350 msgr2=0x7fe6180d2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:08.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.634+0000 7fe61d000640 1 -- 172.21.15.152:0/1866792275 shutdown_connections 2024-04-17T08:46:08.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.634+0000 7fe61d000640 1 -- 172.21.15.152:0/1866792275 wait complete. 2024-04-17T08:46:08.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.634+0000 7fe61d000640 1 Processor -- start 2024-04-17T08:46:08.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.634+0000 7fe61d000640 1 -- start start 2024-04-17T08:46:08.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.634+0000 7fe61d000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5f400e9b0 0x7fe6180ae210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:08.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.634+0000 7fe61d000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe6180cafb0 0x7fe6181f78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:08.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.634+0000 7fe61d000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe618070470 0x7fe6180708d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:08.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.634+0000 7fe61d000640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe618147740 con 0x7fe5f400e9b0 2024-04-17T08:46:08.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.634+0000 7fe61d000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe61806ead0 con 0x7fe618070470 2024-04-17T08:46:08.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.634+0000 7fe61d000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fe618070e10 con 0x7fe6180cafb0 2024-04-17T08:46:08.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.634+0000 7fe615e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5f400e9b0 0x7fe6180ae210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:08.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.634+0000 7fe615e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5f400e9b0 0x7fe6180ae210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:45724/0 (socket says 172.21.15.152:45724) 2024-04-17T08:46:08.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.634+0000 7fe615e00640 1 -- 172.21.15.152:0/1908988720 learned_addr learned my addr 172.21.15.152:0/1908988720 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:08.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.638+0000 7fe60d400640 1 --2- 172.21.15.152:0/1908988720 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe6180cafb0 0x7fe6181f78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:08.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.638+0000 7fe616800640 1 --2- 172.21.15.152:0/1908988720 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe618070470 0x7fe6180708d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:08.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.638+0000 7fe615e00640 1 -- 172.21.15.152:0/1908988720 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe6180cafb0 msgr2=0x7fe6181f78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:08.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.638+0000 7fe615e00640 1 --2- 172.21.15.152:0/1908988720 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe6180cafb0 0x7fe6181f78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:08.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.638+0000 7fe615e00640 1 -- 172.21.15.152:0/1908988720 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe618070470 msgr2=0x7fe6180708d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:08.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.638+0000 7fe615e00640 1 --2- 172.21.15.152:0/1908988720 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe618070470 0x7fe6180708d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:08.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.638+0000 7fe615e00640 1 -- 172.21.15.152:0/1908988720 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6180cbf00 con 0x7fe5f400e9b0 2024-04-17T08:46:08.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.638+0000 7fe615e00640 1 --2- 172.21.15.152:0/1908988720 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5f400e9b0 0x7fe6180ae210 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe608024b40 tx=0x7fe60800bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:08.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.638+0000 7fe60ea00640 1 -- 172.21.15.152:0/1908988720 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6080b2040 con 0x7fe5f400e9b0 2024-04-17T08:46:08.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.638+0000 7fe60ea00640 1 -- 172.21.15.152:0/1908988720 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6080bb070 con 0x7fe5f400e9b0 2024-04-17T08:46:08.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.638+0000 7fe61d000640 1 -- 172.21.15.152:0/1908988720 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6180cc1e0 con 0x7fe5f400e9b0 2024-04-17T08:46:08.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.638+0000 7fe60ea00640 1 -- 172.21.15.152:0/1908988720 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe60800f040 con 0x7fe5f400e9b0 2024-04-17T08:46:08.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.638+0000 7fe61d000640 1 -- 172.21.15.152:0/1908988720 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6180cb430 con 0x7fe5f400e9b0 2024-04-17T08:46:08.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.638+0000 7fe60ea00640 1 -- 172.21.15.152:0/1908988720 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe6080b5070 con 0x7fe5f400e9b0 2024-04-17T08:46:08.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.638+0000 7fe60ea00640 1 -- 172.21.15.152:0/1908988720 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe6080c0780 con 0x7fe5f400e9b0 2024-04-17T08:46:08.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.638+0000 7fe61d000640 1 -- 172.21.15.152:0/1908988720 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe618068a30 con 0x7fe5f400e9b0 2024-04-17T08:46:08.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.654+0000 7fe60ea00640 1 -- 172.21.15.152:0/1908988720 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7fe608009bd0 con 0x7fe5f400e9b0 2024-04-17T08:46:08.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.718+0000 7fe61d000640 1 -- 172.21.15.152:0/1908988720 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fe6180c84f0 con 0x7fe5f400e9b0 2024-04-17T08:46:08.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.718+0000 7fe60ea00640 1 -- 172.21.15.152:0/1908988720 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fe6080163d0 con 0x7fe5f400e9b0 2024-04-17T08:46:08.722 INFO:teuthology.orchestra.run.smithi152.stderr:adjusted tunables profile to default 2024-04-17T08:46:08.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.722+0000 7fe61d000640 1 -- 172.21.15.152:0/1908988720 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5f400e9b0 msgr2=0x7fe6180ae210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:08.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.722+0000 7fe61d000640 1 --2- 172.21.15.152:0/1908988720 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5f400e9b0 0x7fe6180ae210 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe608024b40 tx=0x7fe60800bee0 comp rx=0 tx=0).stop 2024-04-17T08:46:08.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.722+0000 7fe61d000640 1 -- 172.21.15.152:0/1908988720 shutdown_connections 2024-04-17T08:46:08.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.722+0000 7fe61d000640 1 --2- 172.21.15.152:0/1908988720 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe618070470 0x7fe6180708d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:08.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.722+0000 7fe61d000640 1 --2- 172.21.15.152:0/1908988720 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe6180cafb0 0x7fe6181f78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:08.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.722+0000 7fe61d000640 1 --2- 172.21.15.152:0/1908988720 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5f400e9b0 0x7fe6180ae210 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:08.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.722+0000 7fe61d000640 1 -- 172.21.15.152:0/1908988720 >> 172.21.15.152:0/1908988720 conn(0x7fe6180d2350 msgr2=0x7fe6180d2730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:08.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.722+0000 7fe61d000640 1 -- 172.21.15.152:0/1908988720 shutdown_connections 2024-04-17T08:46:08.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:08.722+0000 7fe61d000640 1 -- 172.21.15.152:0/1908988720 wait complete. 2024-04-17T08:46:08.743 INFO:tasks.ceph:check_enable_crimson: False 2024-04-17T08:46:08.743 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-17T08:46:08.743 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-17T08:46:08.743 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-17T08:46:08.763 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-17T08:46:08.763 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-17T08:46:08.824 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-17T08:46:08.824 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-17T08:46:08.888 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-17T08:46:08.888 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-17T08:46:08.948 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-17T08:46:08.949 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-17T08:46:08.970 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-17T08:46:08.970 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-17T08:46:09.031 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-17T08:46:09.031 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-17T08:46:09.091 INFO:tasks.ceph.mgr.y.smithi152.stderr:2024-04-17T08:46:09.090+0000 7f9aa09b4180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-17T08:46:09.095 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-17T08:46:09.095 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-17T08:46:09.126 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-04-17T08:46:09.125+0000 7f4975269180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-17T08:46:09.146 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new 682f0192-187c-404e-bc7a-b6b4e23825e6 0 2024-04-17T08:46:09.297 INFO:tasks.ceph.mgr.y.smithi152.stderr:2024-04-17T08:46:09.294+0000 7f9aa09b4180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-17T08:46:09.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.321+0000 7fcd3f400640 1 Processor -- start 2024-04-17T08:46:09.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.321+0000 7fcd3f400640 1 -- start start 2024-04-17T08:46:09.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.325+0000 7fcd3f400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fcd38145ea0 0x7fcd380d0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:09.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.325+0000 7fcd3f400640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd380ccbb0 con 0x7fcd380d0790 2024-04-17T08:46:09.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.325+0000 7fcd3f400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd380cce90 con 0x7fcd38071790 2024-04-17T08:46:09.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.325+0000 7fcd3f400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fcd380cd170 con 0x7fcd38145ea0 2024-04-17T08:46:09.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.325+0000 7fcd3ca00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fcd38145ea0 0x7fcd380d0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:09.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.325+0000 7fcd3ca00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fcd38145ea0 0x7fcd380d0250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38016/0 (socket says 172.21.15.196:38016) 2024-04-17T08:46:09.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.325+0000 7fcd3ca00640 1 -- 172.21.15.196:0/4082326755 learned_addr learned my addr 172.21.15.196:0/4082326755 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-04-17T08:46:09.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.325+0000 7fcd3ca00640 1 -- 172.21.15.196:0/4082326755 >> v1:172.21.15.196:6789/0 conn(0x7fcd38071790 legacy=0x7fcd380cd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:09.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.325+0000 7fcd3ca00640 1 -- 172.21.15.196:0/4082326755 >> v1:172.21.15.152:6789/0 conn(0x7fcd380d0790 legacy=0x7fcd380c7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:09.325 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.325+0000 7fcd3ca00640 1 -- 172.21.15.196:0/4082326755 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd380cd450 con 0x7fcd38145ea0 2024-04-17T08:46:09.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.329+0000 7fcd3ca00640 1 --2- 172.21.15.196:0/4082326755 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcd38145ea0 0x7fcd380d0250 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c009870 tx=0x7fcd2c01c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88f58e0b3ead0835 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:09.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.329+0000 7fcd37400640 1 -- 172.21.15.196:0/4082326755 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c0b0070 con 0x7fcd38145ea0 2024-04-17T08:46:09.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.329+0000 7fcd37400640 1 -- 172.21.15.196:0/4082326755 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd2c0ab600 con 0x7fcd38145ea0 2024-04-17T08:46:09.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.329+0000 7fcd37400640 1 -- 172.21.15.196:0/4082326755 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c0ab9d0 con 0x7fcd38145ea0 2024-04-17T08:46:09.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.329+0000 7fcd3f400640 1 -- 172.21.15.196:0/4082326755 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcd38145ea0 msgr2=0x7fcd380d0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:09.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.329+0000 7fcd3f400640 1 --2- 172.21.15.196:0/4082326755 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcd38145ea0 0x7fcd380d0250 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c009870 tx=0x7fcd2c01c4d0 comp rx=0 tx=0).stop 2024-04-17T08:46:09.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.329+0000 7fcd3f400640 1 -- 172.21.15.196:0/4082326755 shutdown_connections 2024-04-17T08:46:09.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.329+0000 7fcd3f400640 1 --2- 172.21.15.196:0/4082326755 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcd38145ea0 0x7fcd380d0250 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:09.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.329+0000 7fcd3f400640 1 -- 172.21.15.196:0/4082326755 >> 172.21.15.196:0/4082326755 conn(0x7fcd380d2350 msgr2=0x7fcd380d2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:09.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.329+0000 7fcd3f400640 1 -- 172.21.15.196:0/4082326755 shutdown_connections 2024-04-17T08:46:09.329 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.329+0000 7fcd3f400640 1 -- 172.21.15.196:0/4082326755 wait complete. 2024-04-17T08:46:09.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.329+0000 7fcd3f400640 1 Processor -- start 2024-04-17T08:46:09.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.329+0000 7fcd3f400640 1 -- start start 2024-04-17T08:46:09.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.333+0000 7fcd3f400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcd38071790 0x7fcd38142570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:09.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.333+0000 7fcd3f400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcd380d0790 0x7fcd38144ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:09.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.333+0000 7fcd3f400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd38145ea0 0x7fcd3815bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:09.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.333+0000 7fcd3f400640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fcd380c7ac0 con 0x7fcd38145ea0 2024-04-17T08:46:09.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.333+0000 7fcd3f400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fcd380c7940 con 0x7fcd380d0790 2024-04-17T08:46:09.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.333+0000 7fcd3f400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fcd3816acb0 con 0x7fcd38071790 2024-04-17T08:46:09.333 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.333+0000 7fcd37e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcd380d0790 0x7fcd38144ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:09.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.333+0000 7fcd3ca00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcd38071790 0x7fcd38142570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:09.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.333+0000 7fcd37e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcd380d0790 0x7fcd38144ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38028/0 (socket says 172.21.15.196:38028) 2024-04-17T08:46:09.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.333+0000 7fcd37e00640 1 -- 172.21.15.196:0/3758877019 learned_addr learned my addr 172.21.15.196:0/3758877019 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-04-17T08:46:09.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.333+0000 7fcd3d400640 1 --2- 172.21.15.196:0/3758877019 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd38145ea0 0x7fcd3815bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:09.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.333+0000 7fcd37e00640 1 -- 172.21.15.196:0/3758877019 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcd38071790 msgr2=0x7fcd38142570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:09.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.333+0000 7fcd37e00640 1 --2- 172.21.15.196:0/3758877019 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcd38071790 0x7fcd38142570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:09.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.333+0000 7fcd37e00640 1 -- 172.21.15.196:0/3758877019 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd38145ea0 msgr2=0x7fcd3815bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:09.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.333+0000 7fcd37e00640 1 --2- 172.21.15.196:0/3758877019 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd38145ea0 0x7fcd3815bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:09.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.333+0000 7fcd37e00640 1 -- 172.21.15.196:0/3758877019 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd38142c70 con 0x7fcd380d0790 2024-04-17T08:46:09.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.333+0000 7fcd3ca00640 1 --2- 172.21.15.196:0/3758877019 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcd38071790 0x7fcd38142570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T08:46:09.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.333+0000 7fcd37e00640 1 --2- 172.21.15.196:0/3758877019 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcd380d0790 0x7fcd38144ab0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcd2400c450 tx=0x7fcd2400c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:09.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.333+0000 7fcd34c00640 1 -- 172.21.15.196:0/3758877019 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd24016020 con 0x7fcd380d0790 2024-04-17T08:46:09.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.333+0000 7fcd34c00640 1 -- 172.21.15.196:0/3758877019 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd240052d0 con 0x7fcd380d0790 2024-04-17T08:46:09.334 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.333+0000 7fcd3f400640 1 -- 172.21.15.196:0/3758877019 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd38142f50 con 0x7fcd380d0790 2024-04-17T08:46:09.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.333+0000 7fcd34c00640 1 -- 172.21.15.196:0/3758877019 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd24007260 con 0x7fcd380d0790 2024-04-17T08:46:09.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.333+0000 7fcd3f400640 1 -- 172.21.15.196:0/3758877019 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd3813f8d0 con 0x7fcd380d0790 2024-04-17T08:46:09.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.333+0000 7fcd34c00640 1 -- 172.21.15.196:0/3758877019 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcd240067e0 con 0x7fcd380d0790 2024-04-17T08:46:09.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.333+0000 7fcd34c00640 1 -- 172.21.15.196:0/3758877019 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fcd24012ca0 con 0x7fcd380d0790 2024-04-17T08:46:09.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.333+0000 7fcd3f400640 1 -- 172.21.15.196:0/3758877019 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd38068a30 con 0x7fcd380d0790 2024-04-17T08:46:09.337 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.337+0000 7fcd34c00640 1 -- 172.21.15.196:0/3758877019 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7fcd24020020 con 0x7fcd380d0790 2024-04-17T08:46:09.343 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-04-17T08:46:09.345+0000 7f4975269180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-17T08:46:09.405 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.405+0000 7fcd3f400640 1 -- 172.21.15.196:0/3758877019 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd new", "uuid": "682f0192-187c-404e-bc7a-b6b4e23825e6", "id": 0} v 0) -- 0x7fcd380b36c0 con 0x7fcd380d0790 2024-04-17T08:46:09.411 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.409+0000 7fcd34c00640 1 -- 172.21.15.196:0/3758877019 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "682f0192-187c-404e-bc7a-b6b4e23825e6", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fcd24005480 con 0x7fcd380d0790 2024-04-17T08:46:09.411 INFO:teuthology.orchestra.run.smithi196.stdout:0 2024-04-17T08:46:09.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.413+0000 7fcd3f400640 1 -- 172.21.15.196:0/3758877019 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcd380d0790 msgr2=0x7fcd38144ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:09.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.413+0000 7fcd3f400640 1 --2- 172.21.15.196:0/3758877019 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcd380d0790 0x7fcd38144ab0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcd2400c450 tx=0x7fcd2400c910 comp rx=0 tx=0).stop 2024-04-17T08:46:09.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.413+0000 7fcd3f400640 1 -- 172.21.15.196:0/3758877019 shutdown_connections 2024-04-17T08:46:09.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.413+0000 7fcd3f400640 1 --2- 172.21.15.196:0/3758877019 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd38145ea0 0x7fcd3815bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:09.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.413+0000 7fcd3f400640 1 --2- 172.21.15.196:0/3758877019 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcd380d0790 0x7fcd38144ab0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:09.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.413+0000 7fcd3f400640 1 --2- 172.21.15.196:0/3758877019 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcd38071790 0x7fcd38142570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:09.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.413+0000 7fcd3f400640 1 -- 172.21.15.196:0/3758877019 >> 172.21.15.196:0/3758877019 conn(0x7fcd380d2350 msgr2=0x7fcd380d0ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:09.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.413+0000 7fcd3f400640 1 -- 172.21.15.196:0/3758877019 shutdown_connections 2024-04-17T08:46:09.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.413+0000 7fcd3f400640 1 -- 172.21.15.196:0/3758877019 wait complete. 2024-04-17T08:46:09.431 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new f0fe8fef-60ec-4a39-83b6-2fa6a5adb0f1 1 2024-04-17T08:46:09.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.565+0000 7fb366a00640 1 Processor -- start 2024-04-17T08:46:09.566 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.565+0000 7fb366a00640 1 -- start start 2024-04-17T08:46:09.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.569+0000 7fb366a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fb3600c7230 0x7fb3600c76c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:09.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.569+0000 7fb366a00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb360071790 0x7fb360071c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:09.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.569+0000 7fb366a00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3600ccbb0 con 0x7fb360145ea0 2024-04-17T08:46:09.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.569+0000 7fb366a00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fb360072140 con 0x7fb360071790 2024-04-17T08:46:09.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.569+0000 7fb366a00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fb3600cce90 con 0x7fb3600c7230 2024-04-17T08:46:09.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.569+0000 7fb35f400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fb3600c7230 0x7fb3600c76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:09.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.569+0000 7fb35f400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fb3600c7230 0x7fb3600c76c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38040/0 (socket says 172.21.15.196:38040) 2024-04-17T08:46:09.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.569+0000 7fb35f400640 1 -- 172.21.15.196:0/1752743787 learned_addr learned my addr 172.21.15.196:0/1752743787 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-04-17T08:46:09.568 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.569+0000 7fb364a00640 1 --2- 172.21.15.196:0/1752743787 >> v2:172.21.15.152:3300/0 conn(0x7fb360071790 0x7fb360071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:09.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.569+0000 7fb364a00640 1 -- 172.21.15.196:0/1752743787 >> v2:172.21.15.196:3300/0 conn(0x7fb3600c7230 msgr2=0x7fb3600c76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:09.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.569+0000 7fb364a00640 1 --2- 172.21.15.196:0/1752743787 >> v2:172.21.15.196:3300/0 conn(0x7fb3600c7230 0x7fb3600c76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:09.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.569+0000 7fb364a00640 1 -- 172.21.15.196:0/1752743787 >> v1:172.21.15.196:6789/0 conn(0x7fb360145ea0 legacy=0x7fb3600d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:09.569 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.569+0000 7fb364a00640 1 -- 172.21.15.196:0/1752743787 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3600cd170 con 0x7fb360071790 2024-04-17T08:46:09.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.573+0000 7fb364a00640 1 --2- 172.21.15.196:0/1752743787 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb360071790 0x7fb360071c00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb3600c8c20 tx=0x7fb35801c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25a6b9b0b337a870 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:09.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.573+0000 7fb35ea00640 1 -- 172.21.15.196:0/1752743787 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3580b2070 con 0x7fb360071790 2024-04-17T08:46:09.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.573+0000 7fb35ea00640 1 -- 172.21.15.196:0/1752743787 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3580a5760 con 0x7fb360071790 2024-04-17T08:46:09.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.573+0000 7fb35ea00640 1 -- 172.21.15.196:0/1752743787 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3580a5b30 con 0x7fb360071790 2024-04-17T08:46:09.572 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.573+0000 7fb366a00640 1 -- 172.21.15.196:0/1752743787 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb360071790 msgr2=0x7fb360071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:09.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.573+0000 7fb366a00640 1 --2- 172.21.15.196:0/1752743787 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb360071790 0x7fb360071c00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb3600c8c20 tx=0x7fb35801c8a0 comp rx=0 tx=0).stop 2024-04-17T08:46:09.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.573+0000 7fb366a00640 1 -- 172.21.15.196:0/1752743787 shutdown_connections 2024-04-17T08:46:09.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.573+0000 7fb366a00640 1 --2- 172.21.15.196:0/1752743787 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb360071790 0x7fb360071c00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:09.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.573+0000 7fb366a00640 1 --2- 172.21.15.196:0/1752743787 >> v2:172.21.15.196:3300/0 conn(0x7fb3600c7230 0x7fb3600c76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:09.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.573+0000 7fb366a00640 1 -- 172.21.15.196:0/1752743787 >> 172.21.15.196:0/1752743787 conn(0x7fb3600d2350 msgr2=0x7fb3600d2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:09.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.573+0000 7fb366a00640 1 -- 172.21.15.196:0/1752743787 shutdown_connections 2024-04-17T08:46:09.573 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.573+0000 7fb366a00640 1 -- 172.21.15.196:0/1752743787 wait complete. 2024-04-17T08:46:09.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.573+0000 7fb366a00640 1 Processor -- start 2024-04-17T08:46:09.574 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.573+0000 7fb366a00640 1 -- start start 2024-04-17T08:46:09.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.573+0000 7fb366a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb360071790 0x7fb3600b16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:09.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.577+0000 7fb366a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3600c7230 0x7fb3601657d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:09.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.577+0000 7fb366a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb360145ea0 0x7fb3600c9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:09.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.577+0000 7fb366a00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb360169490 con 0x7fb3600c7230 2024-04-17T08:46:09.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.577+0000 7fb366a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb3600b2cd0 con 0x7fb360145ea0 2024-04-17T08:46:09.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.577+0000 7fb366a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fb360169610 con 0x7fb360071790 2024-04-17T08:46:09.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.577+0000 7fb35fe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb360071790 0x7fb3600b16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:09.576 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.577+0000 7fb364a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb360145ea0 0x7fb3600c9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:09.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.577+0000 7fb35fe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb360071790 0x7fb3600b16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.196:57044/0 (socket says 172.21.15.196:57044) 2024-04-17T08:46:09.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.577+0000 7fb35fe00640 1 -- 172.21.15.196:0/838092107 learned_addr learned my addr 172.21.15.196:0/838092107 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-04-17T08:46:09.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.577+0000 7fb35f400640 1 --2- 172.21.15.196:0/838092107 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3600c7230 0x7fb3601657d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:09.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.577+0000 7fb364a00640 1 -- 172.21.15.196:0/838092107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb360071790 msgr2=0x7fb3600b16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:09.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.577+0000 7fb364a00640 1 --2- 172.21.15.196:0/838092107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb360071790 0x7fb3600b16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:09.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.577+0000 7fb364a00640 1 -- 172.21.15.196:0/838092107 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3600c7230 msgr2=0x7fb3601657d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:09.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.577+0000 7fb364a00640 1 --2- 172.21.15.196:0/838092107 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3600c7230 0x7fb3601657d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:09.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.577+0000 7fb364a00640 1 -- 172.21.15.196:0/838092107 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3600b5b20 con 0x7fb360145ea0 2024-04-17T08:46:09.577 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.577+0000 7fb364a00640 1 --2- 172.21.15.196:0/838092107 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb360145ea0 0x7fb3600c9c30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb3580ac000 tx=0x7fb358019640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:09.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.577+0000 7fb357e00640 1 -- 172.21.15.196:0/838092107 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3580bb020 con 0x7fb360145ea0 2024-04-17T08:46:09.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.577+0000 7fb357e00640 1 -- 172.21.15.196:0/838092107 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3580ad440 con 0x7fb360145ea0 2024-04-17T08:46:09.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.577+0000 7fb357e00640 1 -- 172.21.15.196:0/838092107 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3580b2040 con 0x7fb360145ea0 2024-04-17T08:46:09.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.577+0000 7fb366a00640 1 -- 172.21.15.196:0/838092107 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3600b5dc0 con 0x7fb360145ea0 2024-04-17T08:46:09.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.577+0000 7fb366a00640 1 -- 172.21.15.196:0/838092107 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3600b6380 con 0x7fb360145ea0 2024-04-17T08:46:09.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.577+0000 7fb357e00640 1 -- 172.21.15.196:0/838092107 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb3580be020 con 0x7fb360145ea0 2024-04-17T08:46:09.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.577+0000 7fb357e00640 1 -- 172.21.15.196:0/838092107 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fb3580c0de0 con 0x7fb360145ea0 2024-04-17T08:46:09.578 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.577+0000 7fb366a00640 1 -- 172.21.15.196:0/838092107 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb360068a30 con 0x7fb360145ea0 2024-04-17T08:46:09.580 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.581+0000 7fb357e00640 1 -- 172.21.15.196:0/838092107 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7fb358016520 con 0x7fb360145ea0 2024-04-17T08:46:09.659 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.661+0000 7fb366a00640 1 -- 172.21.15.196:0/838092107 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f0fe8fef-60ec-4a39-83b6-2fa6a5adb0f1", "id": 1} v 0) -- 0x7fb3600b3070 con 0x7fb360145ea0 2024-04-17T08:46:09.666 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.665+0000 7fb357e00640 1 -- 172.21.15.196:0/838092107 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f0fe8fef-60ec-4a39-83b6-2fa6a5adb0f1", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fb3580c0410 con 0x7fb360145ea0 2024-04-17T08:46:09.666 INFO:teuthology.orchestra.run.smithi196.stdout:1 2024-04-17T08:46:09.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.665+0000 7fb366a00640 1 -- 172.21.15.196:0/838092107 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb360145ea0 msgr2=0x7fb3600c9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:09.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.665+0000 7fb366a00640 1 --2- 172.21.15.196:0/838092107 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb360145ea0 0x7fb3600c9c30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb3580ac000 tx=0x7fb358019640 comp rx=0 tx=0).stop 2024-04-17T08:46:09.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.665+0000 7fb366a00640 1 -- 172.21.15.196:0/838092107 shutdown_connections 2024-04-17T08:46:09.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.665+0000 7fb366a00640 1 --2- 172.21.15.196:0/838092107 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb360145ea0 0x7fb3600c9c30 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:09.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.665+0000 7fb366a00640 1 --2- 172.21.15.196:0/838092107 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3600c7230 0x7fb3601657d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:09.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.665+0000 7fb366a00640 1 --2- 172.21.15.196:0/838092107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb360071790 0x7fb3600b16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:09.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.665+0000 7fb366a00640 1 -- 172.21.15.196:0/838092107 >> 172.21.15.196:0/838092107 conn(0x7fb3600d2350 msgr2=0x7fb3600d2730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:09.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.665+0000 7fb366a00640 1 -- 172.21.15.196:0/838092107 shutdown_connections 2024-04-17T08:46:09.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.665+0000 7fb366a00640 1 -- 172.21.15.196:0/838092107 wait complete. 2024-04-17T08:46:09.686 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new 35f36d9c-5245-4431-a618-f4df0fa380ba 2 2024-04-17T08:46:09.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.821+0000 7fe924e00640 1 Processor -- start 2024-04-17T08:46:09.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.821+0000 7fe924e00640 1 -- start start 2024-04-17T08:46:09.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.821+0000 7fe924e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe92013f690 0x7fe92006d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:09.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.821+0000 7fe924e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fe92006d790 0x7fe9200cb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:09.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.821+0000 7fe924e00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fe9200cb6b0 0x7fe920141db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:09.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.821+0000 7fe924e00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fe92006dbf0 con 0x7fe9200cb6b0 2024-04-17T08:46:09.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.821+0000 7fe924e00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fe92013fa70 con 0x7fe92006d790 2024-04-17T08:46:09.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.821+0000 7fe924e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fe9200cbe30 con 0x7fe92013f690 2024-04-17T08:46:09.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.821+0000 7fe91de00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe92013f690 0x7fe92006d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:09.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.821+0000 7fe917e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fe92006d790 0x7fe9200cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:09.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.821+0000 7fe917e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fe92006d790 0x7fe9200cb170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38052/0 (socket says 172.21.15.196:38052) 2024-04-17T08:46:09.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.821+0000 7fe91de00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe92013f690 0x7fe92006d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.196:57046/0 (socket says 172.21.15.196:57046) 2024-04-17T08:46:09.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.821+0000 7fe917e00640 1 -- 172.21.15.196:0/1512046855 learned_addr learned my addr 172.21.15.196:0/1512046855 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-04-17T08:46:09.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.821+0000 7fe91e800640 1 --2- 172.21.15.196:0/1512046855 >> v2:172.21.15.152:3300/0 conn(0x7fe9200cb6b0 0x7fe920141db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:09.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.821+0000 7fe917e00640 1 -- 172.21.15.196:0/1512046855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe92013f690 msgr2=0x7fe92006d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:09.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.821+0000 7fe917e00640 1 --2- 172.21.15.196:0/1512046855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe92013f690 0x7fe92006d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:09.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.821+0000 7fe917e00640 1 -- 172.21.15.196:0/1512046855 >> v2:172.21.15.152:3300/0 conn(0x7fe9200cb6b0 msgr2=0x7fe920141db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:09.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.821+0000 7fe917e00640 1 --2- 172.21.15.196:0/1512046855 >> v2:172.21.15.152:3300/0 conn(0x7fe9200cb6b0 0x7fe920141db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:09.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.821+0000 7fe917e00640 1 -- 172.21.15.196:0/1512046855 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9200cc110 con 0x7fe92006d790 2024-04-17T08:46:09.824 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.821+0000 7fe91de00640 1 --2- 172.21.15.196:0/1512046855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe92013f690 0x7fe92006d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T08:46:09.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.825+0000 7fe917e00640 1 --2- 172.21.15.196:0/1512046855 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe92006d790 0x7fe9200cb170 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe920068630 tx=0x7fe90801c4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b6ec6d59dc766d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:09.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.829+0000 7fe91d400640 1 -- 172.21.15.196:0/1512046855 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9080aa610 con 0x7fe92006d790 2024-04-17T08:46:09.827 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.829+0000 7fe91d400640 1 -- 172.21.15.196:0/1512046855 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9080af070 con 0x7fe92006d790 2024-04-17T08:46:09.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.829+0000 7fe91d400640 1 -- 172.21.15.196:0/1512046855 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9080aa9d0 con 0x7fe92006d790 2024-04-17T08:46:09.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.829+0000 7fe924e00640 1 -- 172.21.15.196:0/1512046855 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe92006d790 msgr2=0x7fe9200cb170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:09.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.829+0000 7fe924e00640 1 --2- 172.21.15.196:0/1512046855 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe92006d790 0x7fe9200cb170 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe920068630 tx=0x7fe90801c4f0 comp rx=0 tx=0).stop 2024-04-17T08:46:09.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.829+0000 7fe924e00640 1 -- 172.21.15.196:0/1512046855 shutdown_connections 2024-04-17T08:46:09.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.829+0000 7fe924e00640 1 --2- 172.21.15.196:0/1512046855 >> v2:172.21.15.152:3300/0 conn(0x7fe9200cb6b0 0x7fe920141db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:09.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.829+0000 7fe924e00640 1 --2- 172.21.15.196:0/1512046855 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe92006d790 0x7fe9200cb170 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:09.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.829+0000 7fe924e00640 1 --2- 172.21.15.196:0/1512046855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe92013f690 0x7fe92006d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:09.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.829+0000 7fe924e00640 1 -- 172.21.15.196:0/1512046855 >> 172.21.15.196:0/1512046855 conn(0x7fe920072450 msgr2=0x7fe920072860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:09.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.829+0000 7fe924e00640 1 -- 172.21.15.196:0/1512046855 shutdown_connections 2024-04-17T08:46:09.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.829+0000 7fe924e00640 1 -- 172.21.15.196:0/1512046855 wait complete. 2024-04-17T08:46:09.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.829+0000 7fe924e00640 1 Processor -- start 2024-04-17T08:46:09.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.829+0000 7fe924e00640 1 -- start start 2024-04-17T08:46:09.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.829+0000 7fe924e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe92006d790 0x7fe9201648a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:09.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.829+0000 7fe924e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe9200cb6b0 0x7fe9200ce920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:09.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.829+0000 7fe924e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe92013f690 0x7fe920140ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:09.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.829+0000 7fe924e00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe920140270 con 0x7fe92006d790 2024-04-17T08:46:09.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.829+0000 7fe924e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe9200cbac0 con 0x7fe9200cb6b0 2024-04-17T08:46:09.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.829+0000 7fe924e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fe9201403f0 con 0x7fe92013f690 2024-04-17T08:46:09.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.829+0000 7fe91e800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe92013f690 0x7fe920140ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:09.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.829+0000 7fe917e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe9200cb6b0 0x7fe9200ce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:09.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.829+0000 7fe917e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe9200cb6b0 0x7fe9200ce920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38058/0 (socket says 172.21.15.196:38058) 2024-04-17T08:46:09.833 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.829+0000 7fe917e00640 1 -- 172.21.15.196:0/527881103 learned_addr learned my addr 172.21.15.196:0/527881103 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-04-17T08:46:09.833 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.833+0000 7fe91de00640 1 --2- 172.21.15.196:0/527881103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe92006d790 0x7fe9201648a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:09.833 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.833+0000 7fe917e00640 1 -- 172.21.15.196:0/527881103 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe92013f690 msgr2=0x7fe920140ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:09.833 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.833+0000 7fe917e00640 1 --2- 172.21.15.196:0/527881103 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe92013f690 0x7fe920140ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:09.833 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.833+0000 7fe917e00640 1 -- 172.21.15.196:0/527881103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe92006d790 msgr2=0x7fe9201648a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:09.833 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.833+0000 7fe917e00640 1 --2- 172.21.15.196:0/527881103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe92006d790 0x7fe9201648a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:09.833 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.833+0000 7fe917e00640 1 -- 172.21.15.196:0/527881103 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9200d0130 con 0x7fe9200cb6b0 2024-04-17T08:46:09.833 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.833+0000 7fe917e00640 1 --2- 172.21.15.196:0/527881103 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe9200cb6b0 0x7fe9200ce920 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe9080ac040 tx=0x7fe90801ad30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:09.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.833+0000 7fe916000640 1 -- 172.21.15.196:0/527881103 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9080bd3f0 con 0x7fe9200cb6b0 2024-04-17T08:46:09.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.833+0000 7fe916000640 1 -- 172.21.15.196:0/527881103 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9080bd590 con 0x7fe9200cb6b0 2024-04-17T08:46:09.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.833+0000 7fe924e00640 1 -- 172.21.15.196:0/527881103 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9200cf090 con 0x7fe9200cb6b0 2024-04-17T08:46:09.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.833+0000 7fe916000640 1 -- 172.21.15.196:0/527881103 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9080bd940 con 0x7fe9200cb6b0 2024-04-17T08:46:09.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.833+0000 7fe924e00640 1 -- 172.21.15.196:0/527881103 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9200cf650 con 0x7fe9200cb6b0 2024-04-17T08:46:09.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.833+0000 7fe916000640 1 -- 172.21.15.196:0/527881103 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe920142b00 con 0x7fe9200cb6b0 2024-04-17T08:46:09.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.833+0000 7fe916000640 1 -- 172.21.15.196:0/527881103 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fe9080b3810 con 0x7fe9200cb6b0 2024-04-17T08:46:09.834 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.833+0000 7fe924e00640 1 -- 172.21.15.196:0/527881103 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe920069140 con 0x7fe9200cb6b0 2024-04-17T08:46:09.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.837+0000 7fe916000640 1 -- 172.21.15.196:0/527881103 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7fe9080c3060 con 0x7fe9200cb6b0 2024-04-17T08:46:09.903 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.905+0000 7fe924e00640 1 -- 172.21.15.196:0/527881103 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd new", "uuid": "35f36d9c-5245-4431-a618-f4df0fa380ba", "id": 2} v 0) -- 0x7fe9200c8d30 con 0x7fe9200cb6b0 2024-04-17T08:46:09.908 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.909+0000 7fe916000640 1 -- 172.21.15.196:0/527881103 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "35f36d9c-5245-4431-a618-f4df0fa380ba", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fe9080a7070 con 0x7fe9200cb6b0 2024-04-17T08:46:09.908 INFO:teuthology.orchestra.run.smithi196.stdout:2 2024-04-17T08:46:09.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.909+0000 7fe924e00640 1 -- 172.21.15.196:0/527881103 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe9200cb6b0 msgr2=0x7fe9200ce920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:09.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.909+0000 7fe924e00640 1 --2- 172.21.15.196:0/527881103 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe9200cb6b0 0x7fe9200ce920 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe9080ac040 tx=0x7fe90801ad30 comp rx=0 tx=0).stop 2024-04-17T08:46:09.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.909+0000 7fe924e00640 1 -- 172.21.15.196:0/527881103 shutdown_connections 2024-04-17T08:46:09.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.909+0000 7fe924e00640 1 --2- 172.21.15.196:0/527881103 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe92013f690 0x7fe920140ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:09.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.909+0000 7fe924e00640 1 --2- 172.21.15.196:0/527881103 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe9200cb6b0 0x7fe9200ce920 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:09.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.909+0000 7fe924e00640 1 --2- 172.21.15.196:0/527881103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe92006d790 0x7fe9201648a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:09.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.909+0000 7fe924e00640 1 -- 172.21.15.196:0/527881103 >> 172.21.15.196:0/527881103 conn(0x7fe920072450 msgr2=0x7fe92006cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:09.910 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.909+0000 7fe924e00640 1 -- 172.21.15.196:0/527881103 shutdown_connections 2024-04-17T08:46:09.911 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:09.909+0000 7fe924e00640 1 -- 172.21.15.196:0/527881103 wait complete. 2024-04-17T08:46:09.912 INFO:tasks.ceph.mgr.y.smithi152.stderr:2024-04-17T08:46:09.910+0000 7f9aa09b4180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-17T08:46:09.929 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new 96e56ca5-15b4-4895-9b79-da2c92043159 3 2024-04-17T08:46:09.974 INFO:tasks.ceph.mgr.y.smithi152.stderr:2024-04-17T08:46:09.974+0000 7f9aa09b4180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-17T08:46:10.004 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-04-17T08:46:10.005+0000 7f4975269180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-17T08:46:10.034 INFO:tasks.ceph.mgr.y.smithi152.stderr:2024-04-17T08:46:10.034+0000 7f9aa09b4180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-17T08:46:10.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.065+0000 7fa20fe00640 1 Processor -- start 2024-04-17T08:46:10.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.065+0000 7fa20fe00640 1 -- start start 2024-04-17T08:46:10.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.065+0000 7fa20fe00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa208161f70 0x7fa2080b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:10.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.065+0000 7fa20fe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa20806ebf0 0x7fa2080d43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:10.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.065+0000 7fa20fe00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa208162350 con 0x7fa2080d4910 2024-04-17T08:46:10.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.065+0000 7fa20fe00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fa20806f3e0 con 0x7fa208161f70 2024-04-17T08:46:10.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.065+0000 7fa20fe00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fa2080d2260 con 0x7fa20806ebf0 2024-04-17T08:46:10.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.065+0000 7fa20d400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa208161f70 0x7fa2080b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:10.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.065+0000 7fa20ca00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa20806ebf0 0x7fa2080d43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:10.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.065+0000 7fa20d400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa208161f70 0x7fa2080b3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38068/0 (socket says 172.21.15.196:38068) 2024-04-17T08:46:10.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.065+0000 7fa20ca00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa20806ebf0 0x7fa2080d43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.196:57060/0 (socket says 172.21.15.196:57060) 2024-04-17T08:46:10.065 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.065+0000 7fa20d400640 1 -- 172.21.15.196:0/3311132821 learned_addr learned my addr 172.21.15.196:0/3311132821 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-04-17T08:46:10.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.065+0000 7fa20ca00640 1 -- 172.21.15.196:0/3311132821 >> v2:172.21.15.196:3300/0 conn(0x7fa208161f70 msgr2=0x7fa2080b3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:10.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.065+0000 7fa20ca00640 1 --2- 172.21.15.196:0/3311132821 >> v2:172.21.15.196:3300/0 conn(0x7fa208161f70 0x7fa2080b3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:10.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.065+0000 7fa20ca00640 1 -- 172.21.15.196:0/3311132821 >> v1:172.21.15.196:6789/0 conn(0x7fa2080d4910 legacy=0x7fa2080d1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:10.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.065+0000 7fa20ca00640 1 -- 172.21.15.196:0/3311132821 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2080d0790 con 0x7fa20806ebf0 2024-04-17T08:46:10.068 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.069+0000 7fa20ca00640 1 --2- 172.21.15.196:0/3311132821 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa20806ebf0 0x7fa2080d43d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa1f40097c0 tx=0x7fa1f401c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7050f8626683ef6d server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:10.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.069+0000 7fa207e00640 1 -- 172.21.15.196:0/3311132821 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f40b0070 con 0x7fa20806ebf0 2024-04-17T08:46:10.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.069+0000 7fa207e00640 1 -- 172.21.15.196:0/3311132821 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1f40ab600 con 0x7fa20806ebf0 2024-04-17T08:46:10.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.069+0000 7fa207e00640 1 -- 172.21.15.196:0/3311132821 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f40ab9d0 con 0x7fa20806ebf0 2024-04-17T08:46:10.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.069+0000 7fa20fe00640 1 -- 172.21.15.196:0/3311132821 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa20806ebf0 msgr2=0x7fa2080d43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:10.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.069+0000 7fa20fe00640 1 --2- 172.21.15.196:0/3311132821 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa20806ebf0 0x7fa2080d43d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa1f40097c0 tx=0x7fa1f401c380 comp rx=0 tx=0).stop 2024-04-17T08:46:10.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.069+0000 7fa20fe00640 1 -- 172.21.15.196:0/3311132821 shutdown_connections 2024-04-17T08:46:10.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.069+0000 7fa20fe00640 1 --2- 172.21.15.196:0/3311132821 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa20806ebf0 0x7fa2080d43d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:10.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.069+0000 7fa20fe00640 1 --2- 172.21.15.196:0/3311132821 >> v2:172.21.15.196:3300/0 conn(0x7fa208161f70 0x7fa2080b3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:10.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.069+0000 7fa20fe00640 1 -- 172.21.15.196:0/3311132821 >> 172.21.15.196:0/3311132821 conn(0x7fa2080b99b0 msgr2=0x7fa2080b7540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:10.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.069+0000 7fa20fe00640 1 -- 172.21.15.196:0/3311132821 shutdown_connections 2024-04-17T08:46:10.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.069+0000 7fa20fe00640 1 -- 172.21.15.196:0/3311132821 wait complete. 2024-04-17T08:46:10.070 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-04-17T08:46:10.069+0000 7f4975269180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-17T08:46:10.071 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.069+0000 7fa20fe00640 1 Processor -- start 2024-04-17T08:46:10.071 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.069+0000 7fa20fe00640 1 -- start start 2024-04-17T08:46:10.074 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.073+0000 7fa20fe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa20806ebf0 0x7fa2080b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:10.074 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.073+0000 7fa20fe00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2080d4910 0x7fa2080cabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:10.074 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.073+0000 7fa20fe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa208161f70 0x7fa208153040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:10.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.073+0000 7fa20fe00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa20816b600 con 0x7fa2080d4910 2024-04-17T08:46:10.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.073+0000 7fa20fe00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa2080d4d20 con 0x7fa20806ebf0 2024-04-17T08:46:10.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.073+0000 7fa20fe00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fa20816b780 con 0x7fa208161f70 2024-04-17T08:46:10.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.073+0000 7fa20d400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa20806ebf0 0x7fa2080b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:10.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.073+0000 7fa20d400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa20806ebf0 0x7fa2080b3ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38080/0 (socket says 172.21.15.196:38080) 2024-04-17T08:46:10.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.073+0000 7fa20d400640 1 -- 172.21.15.196:0/3668276698 learned_addr learned my addr 172.21.15.196:0/3668276698 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-04-17T08:46:10.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.073+0000 7fa20de00640 1 --2- 172.21.15.196:0/3668276698 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa208161f70 0x7fa208153040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:10.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.073+0000 7fa20ca00640 1 --2- 172.21.15.196:0/3668276698 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2080d4910 0x7fa2080cabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:10.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.073+0000 7fa20d400640 1 -- 172.21.15.196:0/3668276698 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa208161f70 msgr2=0x7fa208153040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:10.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.073+0000 7fa20d400640 1 --2- 172.21.15.196:0/3668276698 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa208161f70 0x7fa208153040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:10.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.073+0000 7fa20d400640 1 -- 172.21.15.196:0/3668276698 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2080d4910 msgr2=0x7fa2080cabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:10.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.073+0000 7fa20d400640 1 --2- 172.21.15.196:0/3668276698 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2080d4910 0x7fa2080cabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:10.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.073+0000 7fa20d400640 1 -- 172.21.15.196:0/3668276698 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa20806b9b0 con 0x7fa20806ebf0 2024-04-17T08:46:10.076 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.073+0000 7fa20d400640 1 --2- 172.21.15.196:0/3668276698 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa20806ebf0 0x7fa2080b3ad0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc00e850 tx=0x7fa1fc00ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:10.076 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.073+0000 7fa205600640 1 -- 172.21.15.196:0/3668276698 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc017070 con 0x7fa20806ebf0 2024-04-17T08:46:10.076 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.073+0000 7fa205600640 1 -- 172.21.15.196:0/3668276698 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1fc00c940 con 0x7fa20806ebf0 2024-04-17T08:46:10.076 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.073+0000 7fa205600640 1 -- 172.21.15.196:0/3668276698 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc00cd30 con 0x7fa20806ebf0 2024-04-17T08:46:10.076 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.073+0000 7fa20fe00640 1 -- 172.21.15.196:0/3668276698 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa20806bc90 con 0x7fa20806ebf0 2024-04-17T08:46:10.076 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.073+0000 7fa20fe00640 1 -- 172.21.15.196:0/3668276698 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa20806c250 con 0x7fa20806ebf0 2024-04-17T08:46:10.076 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.073+0000 7fa205600640 1 -- 172.21.15.196:0/3668276698 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa1fc01a070 con 0x7fa20806ebf0 2024-04-17T08:46:10.076 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.073+0000 7fa205600640 1 -- 172.21.15.196:0/3668276698 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fa1fc006020 con 0x7fa20806ebf0 2024-04-17T08:46:10.076 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.073+0000 7fa20fe00640 1 -- 172.21.15.196:0/3668276698 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa208068a30 con 0x7fa20806ebf0 2024-04-17T08:46:10.076 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.077+0000 7fa205600640 1 -- 172.21.15.196:0/3668276698 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7fa1fc006520 con 0x7fa20806ebf0 2024-04-17T08:46:10.123 INFO:tasks.ceph.mgr.y.smithi152.stderr:2024-04-17T08:46:10.122+0000 7f9aa09b4180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-17T08:46:10.133 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-04-17T08:46:10.133+0000 7f4975269180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-17T08:46:10.143 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.145+0000 7fa20fe00640 1 -- 172.21.15.196:0/3668276698 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd new", "uuid": "96e56ca5-15b4-4895-9b79-da2c92043159", "id": 3} v 0) -- 0x7fa20806e4e0 con 0x7fa20806ebf0 2024-04-17T08:46:10.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.145+0000 7fa205600640 1 -- 172.21.15.196:0/3668276698 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "96e56ca5-15b4-4895-9b79-da2c92043159", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fa1fc0067e0 con 0x7fa20806ebf0 2024-04-17T08:46:10.147 INFO:teuthology.orchestra.run.smithi196.stdout:3 2024-04-17T08:46:10.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.149+0000 7fa20fe00640 1 -- 172.21.15.196:0/3668276698 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa20806ebf0 msgr2=0x7fa2080b3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:10.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.149+0000 7fa20fe00640 1 --2- 172.21.15.196:0/3668276698 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa20806ebf0 0x7fa2080b3ad0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc00e850 tx=0x7fa1fc00ed10 comp rx=0 tx=0).stop 2024-04-17T08:46:10.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.149+0000 7fa20fe00640 1 -- 172.21.15.196:0/3668276698 shutdown_connections 2024-04-17T08:46:10.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.149+0000 7fa20fe00640 1 --2- 172.21.15.196:0/3668276698 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa208161f70 0x7fa208153040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:10.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.149+0000 7fa20fe00640 1 --2- 172.21.15.196:0/3668276698 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2080d4910 0x7fa2080cabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:10.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.149+0000 7fa20fe00640 1 --2- 172.21.15.196:0/3668276698 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa20806ebf0 0x7fa2080b3ad0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:10.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.149+0000 7fa20fe00640 1 -- 172.21.15.196:0/3668276698 >> 172.21.15.196:0/3668276698 conn(0x7fa2080b99b0 msgr2=0x7fa2080b2770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:10.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.149+0000 7fa20fe00640 1 -- 172.21.15.196:0/3668276698 shutdown_connections 2024-04-17T08:46:10.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.149+0000 7fa20fe00640 1 -- 172.21.15.196:0/3668276698 wait complete. 2024-04-17T08:46:10.167 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new f5aa10a4-9ff9-41fe-a5c9-15326f982cc8 4 2024-04-17T08:46:10.184 INFO:tasks.ceph.mgr.y.smithi152.stderr:2024-04-17T08:46:10.182+0000 7f9aa09b4180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-17T08:46:10.228 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-04-17T08:46:10.229+0000 7f4975269180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-17T08:46:10.271 INFO:tasks.ceph.mgr.y.smithi152.stderr:2024-04-17T08:46:10.270+0000 7f9aa09b4180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-17T08:46:10.290 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-04-17T08:46:10.289+0000 7f4975269180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-17T08:46:10.301 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.301+0000 7ffa08a00640 1 Processor -- start 2024-04-17T08:46:10.301 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.301+0000 7ffa08a00640 1 -- start start 2024-04-17T08:46:10.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.301+0000 7ffa08a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ffa040c7230 0x7ffa040c76c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:10.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.301+0000 7ffa08a00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ffa04071790 0x7ffa04071c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:10.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.301+0000 7ffa08a00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa040ccbb0 con 0x7ffa04145ea0 2024-04-17T08:46:10.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.301+0000 7ffa08a00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7ffa04072140 con 0x7ffa04071790 2024-04-17T08:46:10.304 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.301+0000 7ffa08a00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7ffa040cce90 con 0x7ffa040c7230 2024-04-17T08:46:10.304 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.301+0000 7ff9fbe00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ffa040c7230 0x7ffa040c76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:10.304 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.301+0000 7ff9fbe00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ffa040c7230 0x7ffa040c76c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38090/0 (socket says 172.21.15.196:38090) 2024-04-17T08:46:10.304 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.301+0000 7ff9fbe00640 1 -- 172.21.15.196:0/311642256 learned_addr learned my addr 172.21.15.196:0/311642256 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-04-17T08:46:10.304 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.301+0000 7ffa02800640 1 --2- 172.21.15.196:0/311642256 >> v2:172.21.15.152:3300/0 conn(0x7ffa04071790 0x7ffa04071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:10.304 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.305+0000 7ff9fbe00640 1 -- 172.21.15.196:0/311642256 >> v2:172.21.15.152:3300/0 conn(0x7ffa04071790 msgr2=0x7ffa04071c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:10.304 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.305+0000 7ff9fbe00640 1 --2- 172.21.15.196:0/311642256 >> v2:172.21.15.152:3300/0 conn(0x7ffa04071790 0x7ffa04071c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:10.304 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.305+0000 7ff9fbe00640 1 -- 172.21.15.196:0/311642256 >> v1:172.21.15.152:6789/0 conn(0x7ffa04145ea0 legacy=0x7ffa040d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:10.304 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.305+0000 7ff9fbe00640 1 -- 172.21.15.196:0/311642256 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa040cd170 con 0x7ffa040c7230 2024-04-17T08:46:10.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.305+0000 7ff9fbe00640 1 --2- 172.21.15.196:0/311642256 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffa040c7230 0x7ffa040c76c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ffa040c8c20 tx=0x7ff9ec01c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c81cdb559c9784f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:10.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.305+0000 7ffa01400640 1 -- 172.21.15.196:0/311642256 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec0b0070 con 0x7ffa040c7230 2024-04-17T08:46:10.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.305+0000 7ffa01400640 1 -- 172.21.15.196:0/311642256 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9ec0ab600 con 0x7ffa040c7230 2024-04-17T08:46:10.307 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.305+0000 7ffa01400640 1 -- 172.21.15.196:0/311642256 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec0ab9d0 con 0x7ffa040c7230 2024-04-17T08:46:10.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.305+0000 7ffa08a00640 1 -- 172.21.15.196:0/311642256 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffa040c7230 msgr2=0x7ffa040c76c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:10.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.305+0000 7ffa08a00640 1 --2- 172.21.15.196:0/311642256 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffa040c7230 0x7ffa040c76c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ffa040c8c20 tx=0x7ff9ec01c490 comp rx=0 tx=0).stop 2024-04-17T08:46:10.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.309+0000 7ffa08a00640 1 -- 172.21.15.196:0/311642256 shutdown_connections 2024-04-17T08:46:10.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.309+0000 7ffa08a00640 1 --2- 172.21.15.196:0/311642256 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffa040c7230 0x7ffa040c76c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:10.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.309+0000 7ffa08a00640 1 --2- 172.21.15.196:0/311642256 >> v2:172.21.15.152:3300/0 conn(0x7ffa04071790 0x7ffa04071c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:10.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.309+0000 7ffa08a00640 1 -- 172.21.15.196:0/311642256 >> 172.21.15.196:0/311642256 conn(0x7ffa040d2350 msgr2=0x7ffa040d2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:10.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.309+0000 7ffa08a00640 1 -- 172.21.15.196:0/311642256 shutdown_connections 2024-04-17T08:46:10.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.309+0000 7ffa08a00640 1 -- 172.21.15.196:0/311642256 wait complete. 2024-04-17T08:46:10.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.309+0000 7ffa08a00640 1 Processor -- start 2024-04-17T08:46:10.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.309+0000 7ffa08a00640 1 -- start start 2024-04-17T08:46:10.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.309+0000 7ffa08a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffa04071790 0x7ffa04143f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:10.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.309+0000 7ffa08a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffa040c7230 0x7ffa0406ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:10.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.309+0000 7ffa08a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa04145ea0 0x7ffa04142ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:10.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.309+0000 7ffa08a00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ffa04169490 con 0x7ffa04145ea0 2024-04-17T08:46:10.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.309+0000 7ffa08a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ffa040b2cd0 con 0x7ffa040c7230 2024-04-17T08:46:10.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.309+0000 7ffa08a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7ffa04169610 con 0x7ffa04071790 2024-04-17T08:46:10.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.309+0000 7ff9fbe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffa040c7230 0x7ffa0406ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:10.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.309+0000 7ff9fbe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffa040c7230 0x7ffa0406ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38100/0 (socket says 172.21.15.196:38100) 2024-04-17T08:46:10.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.309+0000 7ff9fbe00640 1 -- 172.21.15.196:0/1023148012 learned_addr learned my addr 172.21.15.196:0/1023148012 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-04-17T08:46:10.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.309+0000 7ffa01e00640 1 --2- 172.21.15.196:0/1023148012 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffa04071790 0x7ffa04143f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:10.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.309+0000 7ffa02800640 1 --2- 172.21.15.196:0/1023148012 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa04145ea0 0x7ffa04142ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:10.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.309+0000 7ff9fbe00640 1 -- 172.21.15.196:0/1023148012 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffa04071790 msgr2=0x7ffa04143f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:10.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.309+0000 7ff9fbe00640 1 --2- 172.21.15.196:0/1023148012 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffa04071790 0x7ffa04143f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:10.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.309+0000 7ff9fbe00640 1 -- 172.21.15.196:0/1023148012 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa04145ea0 msgr2=0x7ffa04142ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:10.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.309+0000 7ff9fbe00640 1 --2- 172.21.15.196:0/1023148012 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa04145ea0 0x7ffa04142ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:10.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.309+0000 7ff9fbe00640 1 -- 172.21.15.196:0/1023148012 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa0406d7c0 con 0x7ffa040c7230 2024-04-17T08:46:10.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.309+0000 7ffa01e00640 1 --2- 172.21.15.196:0/1023148012 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffa04071790 0x7ffa04143f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T08:46:10.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.309+0000 7ff9fbe00640 1 --2- 172.21.15.196:0/1023148012 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffa040c7230 0x7ffa0406ec60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec0190a0 tx=0x7ff9ec019230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:10.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.313+0000 7ff9fa000640 1 -- 172.21.15.196:0/1023148012 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec0b0040 con 0x7ffa040c7230 2024-04-17T08:46:10.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.313+0000 7ff9fa000640 1 -- 172.21.15.196:0/1023148012 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9ec0b4420 con 0x7ffa040c7230 2024-04-17T08:46:10.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.313+0000 7ff9fa000640 1 -- 172.21.15.196:0/1023148012 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec0b47f0 con 0x7ffa040c7230 2024-04-17T08:46:10.313 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.313+0000 7ffa08a00640 1 -- 172.21.15.196:0/1023148012 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa0406daa0 con 0x7ffa040c7230 2024-04-17T08:46:10.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.313+0000 7ffa08a00640 1 -- 172.21.15.196:0/1023148012 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa0406e060 con 0x7ffa040c7230 2024-04-17T08:46:10.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.313+0000 7ff9fa000640 1 -- 172.21.15.196:0/1023148012 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff9ec0b4990 con 0x7ffa040c7230 2024-04-17T08:46:10.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.313+0000 7ff9fa000640 1 -- 172.21.15.196:0/1023148012 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7ff9ec0b4c80 con 0x7ffa040c7230 2024-04-17T08:46:10.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.313+0000 7ffa08a00640 1 -- 172.21.15.196:0/1023148012 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa04068a30 con 0x7ffa040c7230 2024-04-17T08:46:10.314 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.313+0000 7ff9fa000640 1 -- 172.21.15.196:0/1023148012 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7ff9ec016110 con 0x7ffa040c7230 2024-04-17T08:46:10.335 INFO:tasks.ceph.mgr.y.smithi152.stderr:2024-04-17T08:46:10.334+0000 7f9aa09b4180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-17T08:46:10.384 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.385+0000 7ffa08a00640 1 -- 172.21.15.196:0/1023148012 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f5aa10a4-9ff9-41fe-a5c9-15326f982cc8", "id": 4} v 0) -- 0x7ffa0415fa40 con 0x7ffa040c7230 2024-04-17T08:46:10.384 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-04-17T08:46:10.385+0000 7f4975269180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-17T08:46:10.387 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.389+0000 7ff9fa000640 1 -- 172.21.15.196:0/1023148012 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f5aa10a4-9ff9-41fe-a5c9-15326f982cc8", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7ff9ec0bd400 con 0x7ffa040c7230 2024-04-17T08:46:10.388 INFO:teuthology.orchestra.run.smithi196.stdout:4 2024-04-17T08:46:10.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.389+0000 7ffa08a00640 1 -- 172.21.15.196:0/1023148012 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffa040c7230 msgr2=0x7ffa0406ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:10.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.389+0000 7ffa08a00640 1 --2- 172.21.15.196:0/1023148012 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffa040c7230 0x7ffa0406ec60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec0190a0 tx=0x7ff9ec019230 comp rx=0 tx=0).stop 2024-04-17T08:46:10.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.389+0000 7ffa08a00640 1 -- 172.21.15.196:0/1023148012 shutdown_connections 2024-04-17T08:46:10.390 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.389+0000 7ffa08a00640 1 --2- 172.21.15.196:0/1023148012 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa04145ea0 0x7ffa04142ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:10.390 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.389+0000 7ffa08a00640 1 --2- 172.21.15.196:0/1023148012 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffa040c7230 0x7ffa0406ec60 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:10.390 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.389+0000 7ffa08a00640 1 --2- 172.21.15.196:0/1023148012 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffa04071790 0x7ffa04143f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:10.390 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.389+0000 7ffa08a00640 1 -- 172.21.15.196:0/1023148012 >> 172.21.15.196:0/1023148012 conn(0x7ffa040d2350 msgr2=0x7ffa040d2730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:10.390 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.389+0000 7ffa08a00640 1 -- 172.21.15.196:0/1023148012 shutdown_connections 2024-04-17T08:46:10.390 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.389+0000 7ffa08a00640 1 -- 172.21.15.196:0/1023148012 wait complete. 2024-04-17T08:46:10.415 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new 42bab884-3476-47ae-ac65-935fa6e0f055 5 2024-04-17T08:46:10.460 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-04-17T08:46:10.461+0000 7f4975269180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-17T08:46:10.501 INFO:tasks.ceph.mgr.y.smithi152.stderr:2024-04-17T08:46:10.498+0000 7f9aa09b4180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-17T08:46:10.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.549+0000 7fd0c9200640 1 Processor -- start 2024-04-17T08:46:10.550 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.549+0000 7fd0c9200640 1 -- start start 2024-04-17T08:46:10.552 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.553+0000 7fd0c9200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fd0c40c7230 0x7fd0c40c76c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:10.552 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.553+0000 7fd0c9200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd0c4071790 0x7fd0c4071c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:10.552 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.553+0000 7fd0c9200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0c40ccbb0 con 0x7fd0c4145ea0 2024-04-17T08:46:10.552 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.553+0000 7fd0c9200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fd0c40cce90 con 0x7fd0c40c7230 2024-04-17T08:46:10.552 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.553+0000 7fd0c9200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fd0c40cd170 con 0x7fd0c4071790 2024-04-17T08:46:10.552 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.553+0000 7fd0c1400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fd0c40c7230 0x7fd0c40c76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:10.552 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.553+0000 7fd0c2800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd0c4071790 0x7fd0c4071c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:10.552 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.553+0000 7fd0c1400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fd0c40c7230 0x7fd0c40c76c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38106/0 (socket says 172.21.15.196:38106) 2024-04-17T08:46:10.552 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.553+0000 7fd0c2800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd0c4071790 0x7fd0c4071c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.196:57074/0 (socket says 172.21.15.196:57074) 2024-04-17T08:46:10.552 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.553+0000 7fd0c1400640 1 -- 172.21.15.196:0/3086139320 learned_addr learned my addr 172.21.15.196:0/3086139320 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-04-17T08:46:10.553 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.553+0000 7fd0c1400640 1 -- 172.21.15.196:0/3086139320 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd0c4071790 msgr2=0x7fd0c4071c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:10.553 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.553+0000 7fd0c1400640 1 --2- 172.21.15.196:0/3086139320 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd0c4071790 0x7fd0c4071c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:10.553 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.553+0000 7fd0c1400640 1 -- 172.21.15.196:0/3086139320 >> v1:172.21.15.196:6789/0 conn(0x7fd0c4145ea0 legacy=0x7fd0c40d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:10.553 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.553+0000 7fd0c1400640 1 -- 172.21.15.196:0/3086139320 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0c40cd450 con 0x7fd0c40c7230 2024-04-17T08:46:10.553 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.553+0000 7fd0c2800640 1 --2- 172.21.15.196:0/3086139320 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd0c4071790 0x7fd0c4071c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T08:46:10.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.553+0000 7fd0c1400640 1 --2- 172.21.15.196:0/3086139320 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd0c40c7230 0x7fd0c40c76c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0009870 tx=0x7fd0b001c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=742819269877b805 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:10.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.557+0000 7fd0c0a00640 1 -- 172.21.15.196:0/3086139320 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b00b2070 con 0x7fd0c40c7230 2024-04-17T08:46:10.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.557+0000 7fd0c0a00640 1 -- 172.21.15.196:0/3086139320 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0b00a9070 con 0x7fd0c40c7230 2024-04-17T08:46:10.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.557+0000 7fd0c0a00640 1 -- 172.21.15.196:0/3086139320 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b00ad880 con 0x7fd0c40c7230 2024-04-17T08:46:10.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.557+0000 7fd0c9200640 1 -- 172.21.15.196:0/3086139320 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd0c40c7230 msgr2=0x7fd0c40c76c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:10.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.557+0000 7fd0c9200640 1 --2- 172.21.15.196:0/3086139320 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd0c40c7230 0x7fd0c40c76c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0009870 tx=0x7fd0b001c560 comp rx=0 tx=0).stop 2024-04-17T08:46:10.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.557+0000 7fd0c9200640 1 -- 172.21.15.196:0/3086139320 shutdown_connections 2024-04-17T08:46:10.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.557+0000 7fd0c9200640 1 --2- 172.21.15.196:0/3086139320 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd0c4071790 0x7fd0c4071c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:10.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.557+0000 7fd0c9200640 1 --2- 172.21.15.196:0/3086139320 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd0c40c7230 0x7fd0c40c76c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:10.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.557+0000 7fd0c9200640 1 -- 172.21.15.196:0/3086139320 >> 172.21.15.196:0/3086139320 conn(0x7fd0c40d2350 msgr2=0x7fd0c40d2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:10.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.557+0000 7fd0c9200640 1 -- 172.21.15.196:0/3086139320 shutdown_connections 2024-04-17T08:46:10.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.557+0000 7fd0c9200640 1 -- 172.21.15.196:0/3086139320 wait complete. 2024-04-17T08:46:10.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.557+0000 7fd0c9200640 1 Processor -- start 2024-04-17T08:46:10.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.557+0000 7fd0c9200640 1 -- start start 2024-04-17T08:46:10.560 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.557+0000 7fd0c9200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd0c4071790 0x7fd0c4166420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:10.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.557+0000 7fd0c9200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0c40c7230 0x7fd0c40d1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:10.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.557+0000 7fd0c9200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd0c4145ea0 0x7fd0c415b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:10.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.557+0000 7fd0c9200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c4169610 con 0x7fd0c40c7230 2024-04-17T08:46:10.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.557+0000 7fd0c9200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c4169490 con 0x7fd0c4071790 2024-04-17T08:46:10.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.557+0000 7fd0c9200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fd0c4169790 con 0x7fd0c4145ea0 2024-04-17T08:46:10.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.557+0000 7fd0c1e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd0c4071790 0x7fd0c4166420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:10.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.557+0000 7fd0c2800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd0c4145ea0 0x7fd0c415b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:10.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.557+0000 7fd0c2800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd0c4145ea0 0x7fd0c415b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.196:57082/0 (socket says 172.21.15.196:57082) 2024-04-17T08:46:10.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.557+0000 7fd0c1e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd0c4071790 0x7fd0c4166420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38112/0 (socket says 172.21.15.196:38112) 2024-04-17T08:46:10.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.557+0000 7fd0c2800640 1 -- 172.21.15.196:0/1705020240 learned_addr learned my addr 172.21.15.196:0/1705020240 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-04-17T08:46:10.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.561+0000 7fd0c1400640 1 --2- 172.21.15.196:0/1705020240 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0c40c7230 0x7fd0c40d1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:10.561 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.561+0000 7fd0c2800640 1 -- 172.21.15.196:0/1705020240 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd0c4071790 msgr2=0x7fd0c4166420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:10.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.561+0000 7fd0c2800640 1 --2- 172.21.15.196:0/1705020240 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd0c4071790 0x7fd0c4166420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:10.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.561+0000 7fd0c2800640 1 -- 172.21.15.196:0/1705020240 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0c40c7230 msgr2=0x7fd0c40d1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:10.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.561+0000 7fd0c2800640 1 --2- 172.21.15.196:0/1705020240 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0c40c7230 0x7fd0c40d1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:10.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.561+0000 7fd0c2800640 1 -- 172.21.15.196:0/1705020240 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0c413f370 con 0x7fd0c4145ea0 2024-04-17T08:46:10.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.561+0000 7fd0c1e00640 1 --2- 172.21.15.196:0/1705020240 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd0c4071790 0x7fd0c4166420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T08:46:10.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.561+0000 7fd0c2800640 1 --2- 172.21.15.196:0/1705020240 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd0c4145ea0 0x7fd0c415b930 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc009f00 tx=0x7fd0bc00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:10.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.561+0000 7fd0ba000640 1 -- 172.21.15.196:0/1705020240 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0bc018030 con 0x7fd0c4145ea0 2024-04-17T08:46:10.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.561+0000 7fd0ba000640 1 -- 172.21.15.196:0/1705020240 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0bc00ce50 con 0x7fd0c4145ea0 2024-04-17T08:46:10.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.561+0000 7fd0c9200640 1 -- 172.21.15.196:0/1705020240 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0c4166c70 con 0x7fd0c4145ea0 2024-04-17T08:46:10.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.561+0000 7fd0ba000640 1 -- 172.21.15.196:0/1705020240 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0bc003bc0 con 0x7fd0c4145ea0 2024-04-17T08:46:10.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.561+0000 7fd0c9200640 1 -- 172.21.15.196:0/1705020240 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0c413eb70 con 0x7fd0c4145ea0 2024-04-17T08:46:10.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.561+0000 7fd0ba000640 1 -- 172.21.15.196:0/1705020240 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd0bc01b070 con 0x7fd0c4145ea0 2024-04-17T08:46:10.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.561+0000 7fd0ba000640 1 -- 172.21.15.196:0/1705020240 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fd0bc014a00 con 0x7fd0c4145ea0 2024-04-17T08:46:10.563 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.561+0000 7fd0c9200640 1 -- 172.21.15.196:0/1705020240 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0c4068a30 con 0x7fd0c4145ea0 2024-04-17T08:46:10.571 INFO:tasks.ceph.mgr.y.smithi152.stderr:2024-04-17T08:46:10.570+0000 7f9aa09b4180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-17T08:46:10.575 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.577+0000 7fd0ba000640 1 -- 172.21.15.196:0/1705020240 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7fd0bc022070 con 0x7fd0c4145ea0 2024-04-17T08:46:10.632 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-04-17T08:46:10.633+0000 7f4975269180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-17T08:46:10.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.641+0000 7fd0c9200640 1 -- 172.21.15.196:0/1705020240 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd new", "uuid": "42bab884-3476-47ae-ac65-935fa6e0f055", "id": 5} v 0) -- 0x7fd0c40b36c0 con 0x7fd0c4145ea0 2024-04-17T08:46:10.647 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.645+0000 7fd0ba000640 1 -- 172.21.15.196:0/1705020240 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "42bab884-3476-47ae-ac65-935fa6e0f055", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fd0bc010040 con 0x7fd0c4145ea0 2024-04-17T08:46:10.647 INFO:teuthology.orchestra.run.smithi196.stdout:5 2024-04-17T08:46:10.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.649+0000 7fd0c9200640 1 -- 172.21.15.196:0/1705020240 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd0c4145ea0 msgr2=0x7fd0c415b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:10.648 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.649+0000 7fd0c9200640 1 --2- 172.21.15.196:0/1705020240 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd0c4145ea0 0x7fd0c415b930 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc009f00 tx=0x7fd0bc00c490 comp rx=0 tx=0).stop 2024-04-17T08:46:10.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.649+0000 7fd0c9200640 1 -- 172.21.15.196:0/1705020240 shutdown_connections 2024-04-17T08:46:10.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.649+0000 7fd0c9200640 1 --2- 172.21.15.196:0/1705020240 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd0c4145ea0 0x7fd0c415b930 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:10.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.649+0000 7fd0c9200640 1 --2- 172.21.15.196:0/1705020240 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0c40c7230 0x7fd0c40d1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:10.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.649+0000 7fd0c9200640 1 --2- 172.21.15.196:0/1705020240 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd0c4071790 0x7fd0c4166420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:10.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.649+0000 7fd0c9200640 1 -- 172.21.15.196:0/1705020240 >> 172.21.15.196:0/1705020240 conn(0x7fd0c40d2350 msgr2=0x7fd0c415e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:10.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.649+0000 7fd0c9200640 1 -- 172.21.15.196:0/1705020240 shutdown_connections 2024-04-17T08:46:10.649 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.649+0000 7fd0c9200640 1 -- 172.21.15.196:0/1705020240 wait complete. 2024-04-17T08:46:10.667 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new 460b6167-f57b-4224-9c92-cfc9b80bbe99 6 2024-04-17T08:46:10.708 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-04-17T08:46:10.709+0000 7f4975269180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-17T08:46:10.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.801+0000 7f1cc7200640 1 Processor -- start 2024-04-17T08:46:10.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.801+0000 7f1cc7200640 1 -- start start 2024-04-17T08:46:10.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.801+0000 7f1cc7200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1cc815e710 0x7f1cc8162b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:10.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.801+0000 7f1cc7200640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f1cc806f610 0x7f1cc806c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:10.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.801+0000 7f1cc7200640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cc8163050 con 0x7f1cc806be80 2024-04-17T08:46:10.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.801+0000 7f1cc7200640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f1cc815faa0 con 0x7f1cc806f610 2024-04-17T08:46:10.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.801+0000 7f1cc7200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f1cc806c800 con 0x7f1cc815e710 2024-04-17T08:46:10.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.801+0000 7f1cc5e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1cc815e710 0x7f1cc8162b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:10.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.801+0000 7f1cc5e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1cc815e710 0x7f1cc8162b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.196:57086/0 (socket says 172.21.15.196:57086) 2024-04-17T08:46:10.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.801+0000 7f1cc5e00640 1 -- 172.21.15.196:0/3423743751 learned_addr learned my addr 172.21.15.196:0/3423743751 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-04-17T08:46:10.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.805+0000 7f1cc6800640 1 --2- 172.21.15.196:0/3423743751 >> v2:172.21.15.152:3300/0 conn(0x7f1cc806f610 0x7f1cc806c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:10.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.805+0000 7f1cc5e00640 1 -- 172.21.15.196:0/3423743751 >> v2:172.21.15.152:3300/0 conn(0x7f1cc806f610 msgr2=0x7f1cc806c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:10.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.805+0000 7f1cc5e00640 1 --2- 172.21.15.196:0/3423743751 >> v2:172.21.15.152:3300/0 conn(0x7f1cc806f610 0x7f1cc806c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:10.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.805+0000 7f1cc5e00640 1 -- 172.21.15.196:0/3423743751 >> v1:172.21.15.152:6789/0 conn(0x7f1cc806be80 legacy=0x7f1cc80b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:10.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.805+0000 7f1cc5e00640 1 -- 172.21.15.196:0/3423743751 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cc815ef20 con 0x7f1cc815e710 2024-04-17T08:46:10.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.805+0000 7f1cc6800640 1 --2- 172.21.15.196:0/3423743751 >> v2:172.21.15.152:3300/0 conn(0x7f1cc806f610 0x7f1cc806c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:46:10.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.805+0000 7f1cc5e00640 1 --2- 172.21.15.196:0/3423743751 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1cc815e710 0x7f1cc8162b10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8009870 tx=0x7f1cb801c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c2d9b6b7bb95b51 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:10.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.805+0000 7f1cc5400640 1 -- 172.21.15.196:0/3423743751 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb80ab650 con 0x7f1cc815e710 2024-04-17T08:46:10.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.805+0000 7f1cc5400640 1 -- 172.21.15.196:0/3423743751 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cb80b0070 con 0x7f1cc815e710 2024-04-17T08:46:10.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.805+0000 7f1cc5400640 1 -- 172.21.15.196:0/3423743751 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb80aba10 con 0x7f1cc815e710 2024-04-17T08:46:10.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.809+0000 7f1cc7200640 1 -- 172.21.15.196:0/3423743751 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1cc815e710 msgr2=0x7f1cc8162b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:10.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.809+0000 7f1cc7200640 1 --2- 172.21.15.196:0/3423743751 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1cc815e710 0x7f1cc8162b10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8009870 tx=0x7f1cb801c530 comp rx=0 tx=0).stop 2024-04-17T08:46:10.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.809+0000 7f1cc7200640 1 -- 172.21.15.196:0/3423743751 shutdown_connections 2024-04-17T08:46:10.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.809+0000 7f1cc7200640 1 --2- 172.21.15.196:0/3423743751 >> v2:172.21.15.152:3300/0 conn(0x7f1cc806f610 0x7f1cc806c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:10.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.809+0000 7f1cc7200640 1 --2- 172.21.15.196:0/3423743751 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1cc815e710 0x7f1cc8162b10 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:10.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.809+0000 7f1cc7200640 1 -- 172.21.15.196:0/3423743751 >> 172.21.15.196:0/3423743751 conn(0x7f1cc80d0890 msgr2=0x7f1cc80d0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:10.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.809+0000 7f1cc7200640 1 -- 172.21.15.196:0/3423743751 shutdown_connections 2024-04-17T08:46:10.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.809+0000 7f1cc7200640 1 -- 172.21.15.196:0/3423743751 wait complete. 2024-04-17T08:46:10.809 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.809+0000 7f1cc7200640 1 Processor -- start 2024-04-17T08:46:10.809 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.809+0000 7f1cc7200640 1 -- start start 2024-04-17T08:46:10.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.809+0000 7f1cc7200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1cc806be80 0x7f1cc8140310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:10.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.809+0000 7f1cc7200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1cc806f610 0x7f1cc814e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:10.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.809+0000 7f1cc7200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cc815e710 0x7f1cc814e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:10.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.809+0000 7f1cc7200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc815eaf0 con 0x7f1cc815e710 2024-04-17T08:46:10.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.809+0000 7f1cc7200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc806cc60 con 0x7f1cc806f610 2024-04-17T08:46:10.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.809+0000 7f1cc7200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f1cc815ec70 con 0x7f1cc806be80 2024-04-17T08:46:10.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.809+0000 7f1cc5e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1cc806be80 0x7f1cc8140310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:10.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.809+0000 7f1cbd400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1cc806f610 0x7f1cc814e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:10.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.809+0000 7f1cc6800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cc815e710 0x7f1cc814e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:10.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.809+0000 7f1cc5e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1cc806be80 0x7f1cc8140310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.196:57098/0 (socket says 172.21.15.196:57098) 2024-04-17T08:46:10.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.809+0000 7f1cc5e00640 1 -- 172.21.15.196:0/4224117887 learned_addr learned my addr 172.21.15.196:0/4224117887 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-04-17T08:46:10.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.809+0000 7f1cc5e00640 1 -- 172.21.15.196:0/4224117887 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1cc806f610 msgr2=0x7f1cc814e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:10.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.809+0000 7f1cc5e00640 1 --2- 172.21.15.196:0/4224117887 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1cc806f610 0x7f1cc814e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:10.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.809+0000 7f1cc5e00640 1 -- 172.21.15.196:0/4224117887 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cc815e710 msgr2=0x7f1cc814e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:10.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.809+0000 7f1cc5e00640 1 --2- 172.21.15.196:0/4224117887 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cc815e710 0x7f1cc814e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:10.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.809+0000 7f1cc5e00640 1 -- 172.21.15.196:0/4224117887 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cc81573c0 con 0x7f1cc806be80 2024-04-17T08:46:10.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.809+0000 7f1cc6800640 1 --2- 172.21.15.196:0/4224117887 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cc815e710 0x7f1cc814e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T08:46:10.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.809+0000 7f1cc5e00640 1 --2- 172.21.15.196:0/4224117887 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1cc806be80 0x7f1cc8140310 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1cb801abe0 tx=0x7f1cb801ad70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:10.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.813+0000 7f1cbea00640 1 -- 172.21.15.196:0/4224117887 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb80be5f0 con 0x7f1cc806be80 2024-04-17T08:46:10.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.813+0000 7f1cbea00640 1 -- 172.21.15.196:0/4224117887 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cb80be7b0 con 0x7f1cc806be80 2024-04-17T08:46:10.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.813+0000 7f1cc7200640 1 -- 172.21.15.196:0/4224117887 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cc8160f70 con 0x7f1cc806be80 2024-04-17T08:46:10.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.813+0000 7f1cbea00640 1 -- 172.21.15.196:0/4224117887 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb80beba0 con 0x7f1cc806be80 2024-04-17T08:46:10.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.813+0000 7f1cc7200640 1 -- 172.21.15.196:0/4224117887 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cc8156bc0 con 0x7f1cc806be80 2024-04-17T08:46:10.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.813+0000 7f1cbea00640 1 -- 172.21.15.196:0/4224117887 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1cb80b4780 con 0x7f1cc806be80 2024-04-17T08:46:10.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.813+0000 7f1cbea00640 1 -- 172.21.15.196:0/4224117887 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f1cb80c83e0 con 0x7f1cc806be80 2024-04-17T08:46:10.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.813+0000 7f1cc7200640 1 -- 172.21.15.196:0/4224117887 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cc8075be0 con 0x7f1cc806be80 2024-04-17T08:46:10.815 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.813+0000 7f1cbea00640 1 -- 172.21.15.196:0/4224117887 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7f1cb80c4060 con 0x7f1cc806be80 2024-04-17T08:46:10.882 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.881+0000 7f1cc7200640 1 -- 172.21.15.196:0/4224117887 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd new", "uuid": "460b6167-f57b-4224-9c92-cfc9b80bbe99", "id": 6} v 0) -- 0x7f1cc815a9c0 con 0x7f1cc806be80 2024-04-17T08:46:10.887 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.885+0000 7f1cbea00640 1 -- 172.21.15.196:0/4224117887 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "460b6167-f57b-4224-9c92-cfc9b80bbe99", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f1cb8016150 con 0x7f1cc806be80 2024-04-17T08:46:10.887 INFO:teuthology.orchestra.run.smithi196.stdout:6 2024-04-17T08:46:10.888 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.889+0000 7f1cc7200640 1 -- 172.21.15.196:0/4224117887 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1cc806be80 msgr2=0x7f1cc8140310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:10.888 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.889+0000 7f1cc7200640 1 --2- 172.21.15.196:0/4224117887 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1cc806be80 0x7f1cc8140310 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1cb801abe0 tx=0x7f1cb801ad70 comp rx=0 tx=0).stop 2024-04-17T08:46:10.888 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.889+0000 7f1cc7200640 1 -- 172.21.15.196:0/4224117887 shutdown_connections 2024-04-17T08:46:10.888 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.889+0000 7f1cc7200640 1 --2- 172.21.15.196:0/4224117887 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cc815e710 0x7f1cc814e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:10.888 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.889+0000 7f1cc7200640 1 --2- 172.21.15.196:0/4224117887 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1cc806f610 0x7f1cc814e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:10.888 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.889+0000 7f1cc7200640 1 --2- 172.21.15.196:0/4224117887 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1cc806be80 0x7f1cc8140310 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:10.888 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.889+0000 7f1cc7200640 1 -- 172.21.15.196:0/4224117887 >> 172.21.15.196:0/4224117887 conn(0x7f1cc80d0890 msgr2=0x7f1cc8150c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:10.888 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.889+0000 7f1cc7200640 1 -- 172.21.15.196:0/4224117887 shutdown_connections 2024-04-17T08:46:10.888 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:10.889+0000 7f1cc7200640 1 -- 172.21.15.196:0/4224117887 wait complete. 2024-04-17T08:46:10.906 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new d695643f-5e07-4e2a-a646-c06bd97b6650 7 2024-04-17T08:46:11.101 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.101+0000 7f8f41a00640 1 Processor -- start 2024-04-17T08:46:11.101 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.101+0000 7f8f41a00640 1 -- start start 2024-04-17T08:46:11.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.105+0000 7f8f41a00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f8f3c15a630 0x7f8f3c15aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:11.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.105+0000 7f8f41a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f8f3c0b1db0 0x7f8f3c0b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:11.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.105+0000 7f8f41a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8f3c06dfe0 0x7f8f3c06e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:11.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.105+0000 7f8f41000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8f3c06dfe0 0x7f8f3c06e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:11.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.105+0000 7f8f41000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8f3c06dfe0 0x7f8f3c06e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.196:57102/0 (socket says 172.21.15.196:57102) 2024-04-17T08:46:11.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.105+0000 7f8f41000640 1 -- 172.21.15.196:0/640584252 learned_addr learned my addr 172.21.15.196:0/640584252 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-04-17T08:46:11.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.105+0000 7f8f41a00640 1 -- 172.21.15.196:0/640584252 --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f8f3c0b2750 con 0x7f8f3c15a630 2024-04-17T08:46:11.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.105+0000 7f8f3be00640 1 --2- 172.21.15.196:0/640584252 >> v2:172.21.15.152:3300/0 conn(0x7f8f3c15a630 0x7f8f3c15aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:11.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.105+0000 7f8f41a00640 1 -- 172.21.15.196:0/640584252 --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f8f3c15af50 con 0x7f8f3c0b1db0 2024-04-17T08:46:11.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.105+0000 7f8f41a00640 1 -- 172.21.15.196:0/640584252 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f8f3c0adcb0 con 0x7f8f3c06dfe0 2024-04-17T08:46:11.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.105+0000 7f8f3b400640 1 --2- 172.21.15.196:0/640584252 >> v2:172.21.15.196:3300/0 conn(0x7f8f3c0b1db0 0x7f8f3c0b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:11.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.105+0000 7f8f41000640 1 -- 172.21.15.196:0/640584252 >> v2:172.21.15.196:3300/0 conn(0x7f8f3c0b1db0 msgr2=0x7f8f3c0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:11.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.105+0000 7f8f41000640 1 --2- 172.21.15.196:0/640584252 >> v2:172.21.15.196:3300/0 conn(0x7f8f3c0b1db0 0x7f8f3c0b2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:11.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.105+0000 7f8f41000640 1 -- 172.21.15.196:0/640584252 >> v2:172.21.15.152:3300/0 conn(0x7f8f3c15a630 msgr2=0x7f8f3c15aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:11.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.105+0000 7f8f41000640 1 --2- 172.21.15.196:0/640584252 >> v2:172.21.15.152:3300/0 conn(0x7f8f3c15a630 0x7f8f3c15aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:11.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.105+0000 7f8f41000640 1 -- 172.21.15.196:0/640584252 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f3c0adf90 con 0x7f8f3c06dfe0 2024-04-17T08:46:11.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.113+0000 7f8f41000640 1 --2- 172.21.15.196:0/640584252 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8f3c06dfe0 0x7f8f3c06e400 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c074140 tx=0x7f8f2801d4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9934afa03f56c67 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:11.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.113+0000 7f8f3aa00640 1 -- 172.21.15.196:0/640584252 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f280b1070 con 0x7f8f3c06dfe0 2024-04-17T08:46:11.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.113+0000 7f8f3aa00640 1 -- 172.21.15.196:0/640584252 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f28008be0 con 0x7f8f3c06dfe0 2024-04-17T08:46:11.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.113+0000 7f8f3aa00640 1 -- 172.21.15.196:0/640584252 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f2800a0d0 con 0x7f8f3c06dfe0 2024-04-17T08:46:11.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.113+0000 7f8f41a00640 1 -- 172.21.15.196:0/640584252 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8f3c06dfe0 msgr2=0x7f8f3c06e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:11.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.113+0000 7f8f41a00640 1 --2- 172.21.15.196:0/640584252 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8f3c06dfe0 0x7f8f3c06e400 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c074140 tx=0x7f8f2801d4a0 comp rx=0 tx=0).stop 2024-04-17T08:46:11.114 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.113+0000 7f8f41a00640 1 -- 172.21.15.196:0/640584252 shutdown_connections 2024-04-17T08:46:11.115 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.113+0000 7f8f41a00640 1 --2- 172.21.15.196:0/640584252 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8f3c06dfe0 0x7f8f3c06e400 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:11.115 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.113+0000 7f8f41a00640 1 --2- 172.21.15.196:0/640584252 >> v2:172.21.15.196:3300/0 conn(0x7f8f3c0b1db0 0x7f8f3c0b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:11.115 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.113+0000 7f8f41a00640 1 --2- 172.21.15.196:0/640584252 >> v2:172.21.15.152:3300/0 conn(0x7f8f3c15a630 0x7f8f3c15aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:11.115 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.113+0000 7f8f41a00640 1 -- 172.21.15.196:0/640584252 >> 172.21.15.196:0/640584252 conn(0x7f8f3c0b3220 msgr2=0x7f8f3c0b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:11.115 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.113+0000 7f8f41a00640 1 -- 172.21.15.196:0/640584252 shutdown_connections 2024-04-17T08:46:11.119 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.113+0000 7f8f41a00640 1 -- 172.21.15.196:0/640584252 wait complete. 2024-04-17T08:46:11.119 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.117+0000 7f8f41a00640 1 Processor -- start 2024-04-17T08:46:11.122 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.121+0000 7f8f41a00640 1 -- start start 2024-04-17T08:46:11.125 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.125+0000 7f8f41a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f3c06dfe0 0x7f8f3c099580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:11.125 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.125+0000 7f8f41a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8f3c0b1db0 0x7f8f3c154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:11.126 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.125+0000 7f8f3be00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f3c06dfe0 0x7f8f3c099580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:11.128 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.125+0000 7f8f41a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8f3c15a630 0x7f8f3c154d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:11.128 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.125+0000 7f8f41a00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8f3c06e940 con 0x7f8f3c06dfe0 2024-04-17T08:46:11.128 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.125+0000 7f8f41a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8f3c0af560 con 0x7f8f3c0b1db0 2024-04-17T08:46:11.128 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.125+0000 7f8f41a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f8f3c14bfe0 con 0x7f8f3c15a630 2024-04-17T08:46:11.128 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.125+0000 7f8f3be00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f3c06dfe0 0x7f8f3c099580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.196:46294/0 (socket says 172.21.15.196:46294) 2024-04-17T08:46:11.128 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.125+0000 7f8f3be00640 1 -- 172.21.15.196:0/3991545890 learned_addr learned my addr 172.21.15.196:0/3991545890 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-04-17T08:46:11.128 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.125+0000 7f8f3b400640 1 --2- 172.21.15.196:0/3991545890 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8f3c0b1db0 0x7f8f3c154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:11.128 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.125+0000 7f8f41000640 1 --2- 172.21.15.196:0/3991545890 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8f3c15a630 0x7f8f3c154d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:11.128 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.125+0000 7f8f3be00640 1 -- 172.21.15.196:0/3991545890 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8f3c15a630 msgr2=0x7f8f3c154d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:11.128 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.125+0000 7f8f3be00640 1 --2- 172.21.15.196:0/3991545890 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8f3c15a630 0x7f8f3c154d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:11.128 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.125+0000 7f8f3be00640 1 -- 172.21.15.196:0/3991545890 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8f3c0b1db0 msgr2=0x7f8f3c154850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:11.129 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.125+0000 7f8f3be00640 1 --2- 172.21.15.196:0/3991545890 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8f3c0b1db0 0x7f8f3c154850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:11.129 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.125+0000 7f8f3be00640 1 -- 172.21.15.196:0/3991545890 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f3c14d5f0 con 0x7f8f3c06dfe0 2024-04-17T08:46:11.129 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.129+0000 7f8f3be00640 1 --2- 172.21.15.196:0/3991545890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f3c06dfe0 0x7f8f3c099580 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8f34009f40 tx=0x7f8f3400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:11.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.129+0000 7f8f33e00640 1 -- 172.21.15.196:0/3991545890 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f34020070 con 0x7f8f3c06dfe0 2024-04-17T08:46:11.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.129+0000 7f8f33e00640 1 -- 172.21.15.196:0/3991545890 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f3400c8e0 con 0x7f8f3c06dfe0 2024-04-17T08:46:11.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.129+0000 7f8f33e00640 1 -- 172.21.15.196:0/3991545890 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f3400cc90 con 0x7f8f3c06dfe0 2024-04-17T08:46:11.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.129+0000 7f8f41a00640 1 -- 172.21.15.196:0/3991545890 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f3c14d8d0 con 0x7f8f3c06dfe0 2024-04-17T08:46:11.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.129+0000 7f8f41a00640 1 -- 172.21.15.196:0/3991545890 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f3c14de90 con 0x7f8f3c06dfe0 2024-04-17T08:46:11.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.129+0000 7f8f33e00640 1 -- 172.21.15.196:0/3991545890 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8f34023070 con 0x7f8f3c06dfe0 2024-04-17T08:46:11.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.129+0000 7f8f33e00640 1 -- 172.21.15.196:0/3991545890 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f8f34025c10 con 0x7f8f3c06dfe0 2024-04-17T08:46:11.131 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.129+0000 7f8f41a00640 1 -- 172.21.15.196:0/3991545890 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f3c075be0 con 0x7f8f3c06dfe0 2024-04-17T08:46:11.134 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.133+0000 7f8f33e00640 1 -- 172.21.15.196:0/3991545890 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7f8f3400ce30 con 0x7f8f3c06dfe0 2024-04-17T08:46:11.206 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.205+0000 7f8f41a00640 1 -- 172.21.15.196:0/3991545890 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d695643f-5e07-4e2a-a646-c06bd97b6650", "id": 7} v 0) -- 0x7f8f3c152140 con 0x7f8f3c06dfe0 2024-04-17T08:46:11.209 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.209+0000 7f8f33e00640 1 -- 172.21.15.196:0/3991545890 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d695643f-5e07-4e2a-a646-c06bd97b6650", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f8f34005ad0 con 0x7f8f3c06dfe0 2024-04-17T08:46:11.209 INFO:tasks.ceph.mgr.y.smithi152.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-17T08:46:11.209 INFO:tasks.ceph.mgr.y.smithi152.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-17T08:46:11.209 INFO:tasks.ceph.mgr.y.smithi152.stderr: from numpy import show_config as show_numpy_config 2024-04-17T08:46:11.209 INFO:teuthology.orchestra.run.smithi196.stdout:7 2024-04-17T08:46:11.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.209+0000 7f8f41a00640 1 -- 172.21.15.196:0/3991545890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f3c06dfe0 msgr2=0x7f8f3c099580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:11.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.209+0000 7f8f41a00640 1 --2- 172.21.15.196:0/3991545890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f3c06dfe0 0x7f8f3c099580 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8f34009f40 tx=0x7f8f3400ed30 comp rx=0 tx=0).stop 2024-04-17T08:46:11.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.209+0000 7f8f41a00640 1 -- 172.21.15.196:0/3991545890 shutdown_connections 2024-04-17T08:46:11.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.209+0000 7f8f41a00640 1 --2- 172.21.15.196:0/3991545890 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8f3c15a630 0x7f8f3c154d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:11.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.209+0000 7f8f41a00640 1 --2- 172.21.15.196:0/3991545890 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8f3c0b1db0 0x7f8f3c154850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:11.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.209+0000 7f8f41a00640 1 --2- 172.21.15.196:0/3991545890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f3c06dfe0 0x7f8f3c099580 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:11.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.209+0000 7f8f41a00640 1 -- 172.21.15.196:0/3991545890 >> 172.21.15.196:0/3991545890 conn(0x7f8f3c0b3220 msgr2=0x7f8f3c06bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:11.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.209+0000 7f8f41a00640 1 -- 172.21.15.196:0/3991545890 shutdown_connections 2024-04-17T08:46:11.211 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:46:11.209+0000 7f8f41a00640 1 -- 172.21.15.196:0/3991545890 wait complete. 2024-04-17T08:46:11.228 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-17T08:46:11.228 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-17T08:46:11.231 INFO:tasks.ceph.osd.0:Started 2024-04-17T08:46:11.232 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-17T08:46:11.232 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-17T08:46:11.237 INFO:tasks.ceph.osd.1:Started 2024-04-17T08:46:11.237 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-17T08:46:11.237 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-17T08:46:11.240 INFO:tasks.ceph.osd.2:Started 2024-04-17T08:46:11.240 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-17T08:46:11.240 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-17T08:46:11.243 INFO:tasks.ceph.osd.3:Started 2024-04-17T08:46:11.243 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-17T08:46:11.243 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-17T08:46:11.247 INFO:tasks.ceph.osd.4:Started 2024-04-17T08:46:11.247 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-17T08:46:11.247 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-17T08:46:11.251 INFO:tasks.ceph.osd.5:Started 2024-04-17T08:46:11.251 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-17T08:46:11.252 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-17T08:46:11.255 INFO:tasks.ceph.osd.6:Started 2024-04-17T08:46:11.255 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-17T08:46:11.255 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-17T08:46:11.259 INFO:tasks.ceph.osd.7:Started 2024-04-17T08:46:11.260 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T08:46:11.270 INFO:tasks.ceph.mgr.y.smithi152.stderr:2024-04-17T08:46:11.270+0000 7f9aa09b4180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-17T08:46:11.395 INFO:tasks.ceph.mgr.x.smithi196.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-17T08:46:11.395 INFO:tasks.ceph.mgr.x.smithi196.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-17T08:46:11.395 INFO:tasks.ceph.mgr.x.smithi196.stderr: from numpy import show_config as show_numpy_config 2024-04-17T08:46:11.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.434+0000 7f0bf9400640 1 Processor -- start 2024-04-17T08:46:11.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.434+0000 7f0bf9400640 1 -- start start 2024-04-17T08:46:11.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.438+0000 7f0bf9400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f0bf415f960 0x7f0bf4072d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:11.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.438+0000 7f0bf9400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0bf40b4f50 0x7f0bf4073250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:11.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.438+0000 7f0bf9400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bf40d0280 con 0x7f0bf415f580 2024-04-17T08:46:11.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.438+0000 7f0bf9400640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f0bf40d0560 con 0x7f0bf415f960 2024-04-17T08:46:11.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.438+0000 7f0bf9400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f0bf415c740 con 0x7f0bf40b4f50 2024-04-17T08:46:11.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.438+0000 7f0bf1e00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f0bf415f960 0x7f0bf4072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:11.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.438+0000 7f0bf1e00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f0bf415f960 0x7f0bf4072d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:45740/0 (socket says 172.21.15.152:45740) 2024-04-17T08:46:11.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.438+0000 7f0bf1e00640 1 -- 172.21.15.152:0/325778037 learned_addr learned my addr 172.21.15.152:0/325778037 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:11.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.438+0000 7f0bf3200640 1 --2- 172.21.15.152:0/325778037 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0bf40b4f50 0x7f0bf4073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:11.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.438+0000 7f0bf1e00640 1 -- 172.21.15.152:0/325778037 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0bf40b4f50 msgr2=0x7f0bf4073250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:11.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.438+0000 7f0bf1e00640 1 --2- 172.21.15.152:0/325778037 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0bf40b4f50 0x7f0bf4073250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:11.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.438+0000 7f0bf1e00640 1 -- 172.21.15.152:0/325778037 >> v1:172.21.15.196:6789/0 conn(0x7f0bf415f580 legacy=0x7f0bf40cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:11.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.438+0000 7f0bf1e00640 1 -- 172.21.15.152:0/325778037 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bf40b4470 con 0x7f0bf415f960 2024-04-17T08:46:11.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.442+0000 7f0bf1e00640 1 --2- 172.21.15.152:0/325778037 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0bf415f960 0x7f0bf4072d10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0bf40d06e0 tx=0x7f0be001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b6fb3dfb757138d server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:11.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.442+0000 7f0bf1400640 1 -- 172.21.15.152:0/325778037 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be00b2070 con 0x7f0bf415f960 2024-04-17T08:46:11.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.442+0000 7f0bf1400640 1 -- 172.21.15.152:0/325778037 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0be00ad640 con 0x7f0bf415f960 2024-04-17T08:46:11.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.442+0000 7f0bf1400640 1 -- 172.21.15.152:0/325778037 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be00ada10 con 0x7f0bf415f960 2024-04-17T08:46:11.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.442+0000 7f0bf9400640 1 -- 172.21.15.152:0/325778037 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0bf415f960 msgr2=0x7f0bf4072d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:11.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.442+0000 7f0bf9400640 1 --2- 172.21.15.152:0/325778037 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0bf415f960 0x7f0bf4072d10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0bf40d06e0 tx=0x7f0be001c480 comp rx=0 tx=0).stop 2024-04-17T08:46:11.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.442+0000 7f0bf9400640 1 -- 172.21.15.152:0/325778037 shutdown_connections 2024-04-17T08:46:11.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.442+0000 7f0bf9400640 1 --2- 172.21.15.152:0/325778037 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0bf40b4f50 0x7f0bf4073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:11.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.442+0000 7f0bf9400640 1 --2- 172.21.15.152:0/325778037 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0bf415f960 0x7f0bf4072d10 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:11.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.442+0000 7f0bf9400640 1 -- 172.21.15.152:0/325778037 >> 172.21.15.152:0/325778037 conn(0x7f0bf40b31c0 msgr2=0x7f0bf40b35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:11.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.442+0000 7f0bf9400640 1 -- 172.21.15.152:0/325778037 shutdown_connections 2024-04-17T08:46:11.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.442+0000 7f0bf9400640 1 -- 172.21.15.152:0/325778037 wait complete. 2024-04-17T08:46:11.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.442+0000 7f0bf9400640 1 Processor -- start 2024-04-17T08:46:11.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.442+0000 7f0bf9400640 1 -- start start 2024-04-17T08:46:11.446 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-04-17T08:46:11.445+0000 7f4975269180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-17T08:46:11.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.446+0000 7f0bf9400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0bf40b4f50 0x7f0bf4157d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:11.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.446+0000 7f0bf9400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0bf415f580 0x7f0bf4153ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:11.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.446+0000 7f0bf9400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0bf415f960 0x7f0bf41571b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:11.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.446+0000 7f0bf9400640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf40ce660 con 0x7f0bf415f960 2024-04-17T08:46:11.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.446+0000 7f0bf9400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf40ce4e0 con 0x7f0bf40b4f50 2024-04-17T08:46:11.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.446+0000 7f0bf9400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f0bf40ce7e0 con 0x7f0bf415f580 2024-04-17T08:46:11.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.446+0000 7f0bf3200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0bf415f960 0x7f0bf41571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:11.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.446+0000 7f0bf2800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0bf40b4f50 0x7f0bf4157d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:11.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.446+0000 7f0bf3200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0bf415f960 0x7f0bf41571b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:45752/0 (socket says 172.21.15.152:45752) 2024-04-17T08:46:11.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.446+0000 7f0bf3200640 1 -- 172.21.15.152:0/1741614734 learned_addr learned my addr 172.21.15.152:0/1741614734 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:11.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.446+0000 7f0bf1e00640 1 --2- 172.21.15.152:0/1741614734 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0bf415f580 0x7f0bf4153ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:11.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.446+0000 7f0bf3200640 1 -- 172.21.15.152:0/1741614734 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0bf415f580 msgr2=0x7f0bf4153ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:11.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.446+0000 7f0bf3200640 1 --2- 172.21.15.152:0/1741614734 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0bf415f580 0x7f0bf4153ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:11.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.446+0000 7f0bf3200640 1 -- 172.21.15.152:0/1741614734 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0bf40b4f50 msgr2=0x7f0bf4157d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:11.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.446+0000 7f0bf3200640 1 --2- 172.21.15.152:0/1741614734 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0bf40b4f50 0x7f0bf4157d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:11.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.446+0000 7f0bf3200640 1 -- 172.21.15.152:0/1741614734 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bf40b10b0 con 0x7f0bf415f960 2024-04-17T08:46:11.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.446+0000 7f0bf1e00640 1 --2- 172.21.15.152:0/1741614734 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0bf415f580 0x7f0bf4153ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T08:46:11.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.446+0000 7f0bf2800640 1 --2- 172.21.15.152:0/1741614734 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0bf40b4f50 0x7f0bf4157d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T08:46:11.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.446+0000 7f0bf3200640 1 --2- 172.21.15.152:0/1741614734 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0bf415f960 0x7f0bf41571b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0bec00efc0 tx=0x7f0bec00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:11.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.446+0000 7f0beaa00640 1 -- 172.21.15.152:0/1741614734 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bec018020 con 0x7f0bf415f960 2024-04-17T08:46:11.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.446+0000 7f0beaa00640 1 -- 172.21.15.152:0/1741614734 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bec014480 con 0x7f0bf415f960 2024-04-17T08:46:11.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.446+0000 7f0beaa00640 1 -- 172.21.15.152:0/1741614734 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bec014870 con 0x7f0bf415f960 2024-04-17T08:46:11.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.446+0000 7f0bf9400640 1 -- 172.21.15.152:0/1741614734 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bf40b1390 con 0x7f0bf415f960 2024-04-17T08:46:11.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.446+0000 7f0bf9400640 1 -- 172.21.15.152:0/1741614734 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bf40b1950 con 0x7f0bf415f960 2024-04-17T08:46:11.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.446+0000 7f0beaa00640 1 -- 172.21.15.152:0/1741614734 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0bec01b020 con 0x7f0bf415f960 2024-04-17T08:46:11.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.446+0000 7f0beaa00640 1 -- 172.21.15.152:0/1741614734 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f0bec014da0 con 0x7f0bf415f960 2024-04-17T08:46:11.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.446+0000 7f0bf9400640 1 -- 172.21.15.152:0/1741614734 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bf4068a30 con 0x7f0bf415f960 2024-04-17T08:46:11.451 INFO:tasks.ceph.mgr.y.smithi152.stderr:2024-04-17T08:46:11.450+0000 7f9aa09b4180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-17T08:46:11.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.450+0000 7f0beaa00640 1 -- 172.21.15.152:0/1741614734 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7f0bec022070 con 0x7f0bf415f960 2024-04-17T08:46:11.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.514+0000 7f0bf9400640 1 -- 172.21.15.152:0/1741614734 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0bf40cf830 con 0x7f0bf415f960 2024-04-17T08:46:11.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.518+0000 7f0beaa00640 1 -- 172.21.15.152:0/1741614734 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f0bec010040 con 0x7f0bf415f960 2024-04-17T08:46:11.518 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:46:11.518 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":10,"fsid":"ce68f82e-ec5f-4205-9fd5-bdfdf6ef31e2","created":"2024-04-17T08:46:08.353546+0000","modified":"2024-04-17T08:46:11.210050+0000","last_up_change":"0.000000","last_in_change":"2024-04-17T08:46:11.210050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"682f0192-187c-404e-bc7a-b6b4e23825e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f0fe8fef-60ec-4a39-83b6-2fa6a5adb0f1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"35f36d9c-5245-4431-a618-f4df0fa380ba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"96e56ca5-15b4-4895-9b79-da2c92043159","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f5aa10a4-9ff9-41fe-a5c9-15326f982cc8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"42bab884-3476-47ae-ac65-935fa6e0f055","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"460b6167-f57b-4224-9c92-cfc9b80bbe99","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d695643f-5e07-4e2a-a646-c06bd97b6650","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T08:46:11.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.518+0000 7f0bf9400640 1 -- 172.21.15.152:0/1741614734 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0bf415f960 msgr2=0x7f0bf41571b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:11.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.518+0000 7f0bf9400640 1 --2- 172.21.15.152:0/1741614734 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0bf415f960 0x7f0bf41571b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0bec00efc0 tx=0x7f0bec00c490 comp rx=0 tx=0).stop 2024-04-17T08:46:11.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.518+0000 7f0bf9400640 1 -- 172.21.15.152:0/1741614734 shutdown_connections 2024-04-17T08:46:11.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.518+0000 7f0bf9400640 1 --2- 172.21.15.152:0/1741614734 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0bf415f960 0x7f0bf41571b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:11.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.518+0000 7f0bf9400640 1 --2- 172.21.15.152:0/1741614734 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0bf415f580 0x7f0bf4153ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:11.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.518+0000 7f0bf9400640 1 --2- 172.21.15.152:0/1741614734 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0bf40b4f50 0x7f0bf4157d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:11.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.518+0000 7f0bf9400640 1 -- 172.21.15.152:0/1741614734 >> 172.21.15.152:0/1741614734 conn(0x7f0bf40b31c0 msgr2=0x7f0bf40b35a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:11.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.518+0000 7f0bf9400640 1 -- 172.21.15.152:0/1741614734 shutdown_connections 2024-04-17T08:46:11.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:11.518+0000 7f0bf9400640 1 -- 172.21.15.152:0/1741614734 wait complete. 2024-04-17T08:46:11.538 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-17T08:46:11.538 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-17T08:46:11.595 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-04-17T08:46:11.593+0000 7f4975269180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-17T08:46:11.639 INFO:tasks.ceph.mgr.y.smithi152.stderr:2024-04-17T08:46:11.638+0000 7f9aa09b4180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-17T08:46:11.711 INFO:tasks.ceph.mgr.y.smithi152.stderr:2024-04-17T08:46:11.710+0000 7f9aa09b4180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-17T08:46:11.762 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-04-17T08:46:11.761+0000 7f4975269180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-17T08:46:11.844 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-04-17T08:46:11.845+0000 7f4975269180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-17T08:46:11.860 INFO:tasks.ceph.mgr.y.smithi152.stderr:2024-04-17T08:46:11.858+0000 7f9aa09b4180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-17T08:46:11.889 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-04-17T08:46:11.889+0000 7fc8a0c8e7c0 -1 Falling back to public interface 2024-04-17T08:46:11.892 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-04-17T08:46:11.893+0000 7f2b4df437c0 -1 Falling back to public interface 2024-04-17T08:46:11.895 INFO:tasks.ceph.osd.1.smithi152.stderr:2024-04-17T08:46:11.894+0000 7fb5578957c0 -1 Falling back to public interface 2024-04-17T08:46:11.897 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-04-17T08:46:11.897+0000 7fc7d634e7c0 -1 Falling back to public interface 2024-04-17T08:46:11.915 INFO:tasks.ceph.osd.2.smithi152.stderr:2024-04-17T08:46:11.914+0000 7f98251317c0 -1 Falling back to public interface 2024-04-17T08:46:11.916 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-04-17T08:46:11.917+0000 7f54798a47c0 -1 Falling back to public interface 2024-04-17T08:46:11.931 INFO:tasks.ceph.osd.0.smithi152.stderr:2024-04-17T08:46:11.930+0000 7f2079c727c0 -1 Falling back to public interface 2024-04-17T08:46:11.931 INFO:tasks.ceph.osd.3.smithi152.stderr:2024-04-17T08:46:11.930+0000 7f2cce5a47c0 -1 Falling back to public interface 2024-04-17T08:46:12.000 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-04-17T08:46:12.001+0000 7f4975269180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-17T08:46:12.343 DEBUG:teuthology.orchestra.run.smithi152:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-17T08:46:12.472 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.470+0000 7ffac7c00640 1 Processor -- start 2024-04-17T08:46:12.472 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.470+0000 7ffac7c00640 1 -- start start 2024-04-17T08:46:12.473 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.470+0000 7ffac7c00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ffac015c2b0 0x7ffac015c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:12.473 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.470+0000 7ffac7c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffac00b7f50 0x7ffac00c8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:12.473 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.470+0000 7ffac7c00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffac00c8d00 con 0x7ffac00c82b0 2024-04-17T08:46:12.473 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.470+0000 7ffac7c00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7ffac015cdd0 con 0x7ffac015c2b0 2024-04-17T08:46:12.473 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.470+0000 7ffac7c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7ffac015d0b0 con 0x7ffac00b7f50 2024-04-17T08:46:12.474 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.470+0000 7ffac5200640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ffac015c2b0 0x7ffac015c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:12.474 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.470+0000 7ffac5200640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ffac015c2b0 0x7ffac015c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:45768/0 (socket says 172.21.15.152:45768) 2024-04-17T08:46:12.474 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.470+0000 7ffac5200640 1 -- 172.21.15.152:0/3933696391 learned_addr learned my addr 172.21.15.152:0/3933696391 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:12.474 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.470+0000 7ffabfe00640 1 --1- 172.21.15.152:0/3933696391 >> v1:172.21.15.152:6789/0 conn(0x7ffac00c82b0 0x7ffac00b7840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:42270/0 (socket says 172.21.15.152:42270) 2024-04-17T08:46:12.474 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.470+0000 7ffac5c00640 1 --2- 172.21.15.152:0/3933696391 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffac00b7f50 0x7ffac00c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:12.474 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.474+0000 7ffac5200640 1 -- 172.21.15.152:0/3933696391 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffac00b7f50 msgr2=0x7ffac00c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:12.475 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.474+0000 7ffac5200640 1 --2- 172.21.15.152:0/3933696391 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffac00b7f50 0x7ffac00c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:12.475 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.474+0000 7ffac5200640 1 -- 172.21.15.152:0/3933696391 >> v1:172.21.15.152:6789/0 conn(0x7ffac00c82b0 legacy=0x7ffac00b7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:12.475 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.474+0000 7ffac5200640 1 -- 172.21.15.152:0/3933696391 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffac015d390 con 0x7ffac015c2b0 2024-04-17T08:46:12.475 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.474+0000 7ffabf400640 1 -- 172.21.15.152:0/3933696391 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4146534026 0 0) 0x7ffac00c8d00 con 0x7ffac00c82b0 2024-04-17T08:46:12.477 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.474+0000 7ffac5200640 1 --2- 172.21.15.152:0/3933696391 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffac015c2b0 0x7ffac015c690 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ffab4009870 tx=0x7ffab401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e7226c076d4787f server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:12.477 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.474+0000 7ffabf400640 1 -- 172.21.15.152:0/3933696391 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab40b0070 con 0x7ffac015c2b0 2024-04-17T08:46:12.477 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.474+0000 7ffabf400640 1 -- 172.21.15.152:0/3933696391 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffab40ab600 con 0x7ffac015c2b0 2024-04-17T08:46:12.477 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.474+0000 7ffabf400640 1 -- 172.21.15.152:0/3933696391 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab40ab9d0 con 0x7ffac015c2b0 2024-04-17T08:46:12.478 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.474+0000 7ffac7c00640 1 -- 172.21.15.152:0/3933696391 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffac015c2b0 msgr2=0x7ffac015c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:12.478 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.474+0000 7ffac7c00640 1 --2- 172.21.15.152:0/3933696391 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffac015c2b0 0x7ffac015c690 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ffab4009870 tx=0x7ffab401c4d0 comp rx=0 tx=0).stop 2024-04-17T08:46:12.478 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.474+0000 7ffac7c00640 1 -- 172.21.15.152:0/3933696391 shutdown_connections 2024-04-17T08:46:12.478 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.478+0000 7ffac7c00640 1 --2- 172.21.15.152:0/3933696391 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffac00b7f50 0x7ffac00c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:12.478 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.478+0000 7ffac7c00640 1 --2- 172.21.15.152:0/3933696391 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffac015c2b0 0x7ffac015c690 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:12.478 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.478+0000 7ffac7c00640 1 -- 172.21.15.152:0/3933696391 >> 172.21.15.152:0/3933696391 conn(0x7ffac00cee80 msgr2=0x7ffac00cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:12.478 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.478+0000 7ffac7c00640 1 -- 172.21.15.152:0/3933696391 shutdown_connections 2024-04-17T08:46:12.478 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.478+0000 7ffac7c00640 1 -- 172.21.15.152:0/3933696391 wait complete. 2024-04-17T08:46:12.479 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.478+0000 7ffac7c00640 1 Processor -- start 2024-04-17T08:46:12.479 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.478+0000 7ffac7c00640 1 -- start start 2024-04-17T08:46:12.481 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.478+0000 7ffac7c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffac00b7f50 0x7ffac0146fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:12.481 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.478+0000 7ffac7c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffac00c82b0 0x7ffac0071a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:12.481 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.478+0000 7ffac7c00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffac015c2b0 0x7ffac0071f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:12.481 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.478+0000 7ffac7c00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ffac00b6c00 con 0x7ffac015c2b0 2024-04-17T08:46:12.482 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.478+0000 7ffac7c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ffac00b6a80 con 0x7ffac00c82b0 2024-04-17T08:46:12.482 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.478+0000 7ffac7c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7ffac00b6d80 con 0x7ffac00b7f50 2024-04-17T08:46:12.482 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.478+0000 7ffac5c00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffac015c2b0 0x7ffac0071f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:12.482 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.478+0000 7ffac5c00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffac015c2b0 0x7ffac0071f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:45772/0 (socket says 172.21.15.152:45772) 2024-04-17T08:46:12.482 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.478+0000 7ffac5c00640 1 -- 172.21.15.152:0/3971361386 learned_addr learned my addr 172.21.15.152:0/3971361386 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:12.482 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.478+0000 7ffac5200640 1 --2- 172.21.15.152:0/3971361386 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffac00b7f50 0x7ffac0146fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:12.482 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.478+0000 7ffabfe00640 1 --2- 172.21.15.152:0/3971361386 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffac00c82b0 0x7ffac0071a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:12.482 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.478+0000 7ffac5c00640 1 -- 172.21.15.152:0/3971361386 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffac00b7f50 msgr2=0x7ffac0146fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:12.482 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.478+0000 7ffac5c00640 1 --2- 172.21.15.152:0/3971361386 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffac00b7f50 0x7ffac0146fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:12.482 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.478+0000 7ffac5c00640 1 -- 172.21.15.152:0/3971361386 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffac00c82b0 msgr2=0x7ffac0071a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:12.482 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.478+0000 7ffac5c00640 1 --2- 172.21.15.152:0/3971361386 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffac00c82b0 0x7ffac0071a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:12.482 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.478+0000 7ffac5c00640 1 -- 172.21.15.152:0/3971361386 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffac0147620 con 0x7ffac015c2b0 2024-04-17T08:46:12.482 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.478+0000 7ffabfe00640 1 --2- 172.21.15.152:0/3971361386 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffac00c82b0 0x7ffac0071a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:46:12.483 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.478+0000 7ffac5c00640 1 --2- 172.21.15.152:0/3971361386 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffac015c2b0 0x7ffac0071f70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ffab800efc0 tx=0x7ffab800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:12.484 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.482+0000 7ffabcc00640 1 -- 172.21.15.152:0/3971361386 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab8018020 con 0x7ffac015c2b0 2024-04-17T08:46:12.484 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.482+0000 7ffabcc00640 1 -- 172.21.15.152:0/3971361386 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffab8014480 con 0x7ffac015c2b0 2024-04-17T08:46:12.484 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.482+0000 7ffabcc00640 1 -- 172.21.15.152:0/3971361386 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab8014870 con 0x7ffac015c2b0 2024-04-17T08:46:12.484 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.482+0000 7ffac7c00640 1 -- 172.21.15.152:0/3971361386 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffac0147900 con 0x7ffac015c2b0 2024-04-17T08:46:12.484 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.482+0000 7ffac7c00640 1 -- 172.21.15.152:0/3971361386 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffac0147ec0 con 0x7ffac015c2b0 2024-04-17T08:46:12.484 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.482+0000 7ffabcc00640 1 -- 172.21.15.152:0/3971361386 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ffab801b020 con 0x7ffac015c2b0 2024-04-17T08:46:12.484 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.482+0000 7ffabcc00640 1 -- 172.21.15.152:0/3971361386 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7ffab8014da0 con 0x7ffac015c2b0 2024-04-17T08:46:12.484 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.482+0000 7ffac7c00640 1 -- 172.21.15.152:0/3971361386 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffac00694e0 con 0x7ffac015c2b0 2024-04-17T08:46:12.485 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.482+0000 7ffabcc00640 1 -- 172.21.15.152:0/3971361386 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7ffab8022030 con 0x7ffac015c2b0 2024-04-17T08:46:12.542 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.542+0000 7ffac7c00640 1 -- 172.21.15.152:0/3971361386 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffac015bae0 con 0x7ffac015c2b0 2024-04-17T08:46:12.543 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.542+0000 7ffabcc00640 1 -- 172.21.15.152:0/3971361386 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7ffab8010040 con 0x7ffac015c2b0 2024-04-17T08:46:12.543 INFO:teuthology.misc.health.smithi152.stdout: 2024-04-17T08:46:12.543 INFO:teuthology.misc.health.smithi152.stdout:{"epoch":10,"fsid":"ce68f82e-ec5f-4205-9fd5-bdfdf6ef31e2","created":"2024-04-17T08:46:08.353546+0000","modified":"2024-04-17T08:46:11.210050+0000","last_up_change":"0.000000","last_in_change":"2024-04-17T08:46:11.210050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"682f0192-187c-404e-bc7a-b6b4e23825e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f0fe8fef-60ec-4a39-83b6-2fa6a5adb0f1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"35f36d9c-5245-4431-a618-f4df0fa380ba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"96e56ca5-15b4-4895-9b79-da2c92043159","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f5aa10a4-9ff9-41fe-a5c9-15326f982cc8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"42bab884-3476-47ae-ac65-935fa6e0f055","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"460b6167-f57b-4224-9c92-cfc9b80bbe99","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d695643f-5e07-4e2a-a646-c06bd97b6650","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T08:46:12.544 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.542+0000 7ffac7c00640 1 -- 172.21.15.152:0/3971361386 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffac015c2b0 msgr2=0x7ffac0071f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:12.544 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.542+0000 7ffac7c00640 1 --2- 172.21.15.152:0/3971361386 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffac015c2b0 0x7ffac0071f70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ffab800efc0 tx=0x7ffab800c490 comp rx=0 tx=0).stop 2024-04-17T08:46:12.544 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.542+0000 7ffac7c00640 1 -- 172.21.15.152:0/3971361386 shutdown_connections 2024-04-17T08:46:12.544 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.542+0000 7ffac7c00640 1 --2- 172.21.15.152:0/3971361386 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffac015c2b0 0x7ffac0071f70 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:12.544 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.542+0000 7ffac7c00640 1 --2- 172.21.15.152:0/3971361386 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffac00c82b0 0x7ffac0071a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:12.544 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.542+0000 7ffac7c00640 1 --2- 172.21.15.152:0/3971361386 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffac00b7f50 0x7ffac0146fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:12.544 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.542+0000 7ffac7c00640 1 -- 172.21.15.152:0/3971361386 >> 172.21.15.152:0/3971361386 conn(0x7ffac00cee80 msgr2=0x7ffac006f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:12.544 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.542+0000 7ffac7c00640 1 -- 172.21.15.152:0/3971361386 shutdown_connections 2024-04-17T08:46:12.545 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:12.542+0000 7ffac7c00640 1 -- 172.21.15.152:0/3971361386 wait complete. 2024-04-17T08:46:12.560 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-17T08:46:12.577 INFO:tasks.ceph.mgr.y.smithi152.stderr:2024-04-17T08:46:12.574+0000 7f9aa09b4180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-17T08:46:12.663 INFO:tasks.ceph.mgr.y.smithi152.stderr:2024-04-17T08:46:12.662+0000 7f9aa09b4180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-17T08:46:12.692 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-04-17T08:46:12.693+0000 7f4975269180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-17T08:46:12.781 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-04-17T08:46:12.781+0000 7f4975269180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-17T08:46:12.864 INFO:tasks.ceph.mgr.y.smithi152.stderr:2024-04-17T08:46:12.862+0000 7f9aa09b4180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-17T08:46:12.948 INFO:tasks.ceph.mgr.y.smithi152.stderr:2024-04-17T08:46:12.946+0000 7f9aa09b4180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-17T08:46:12.986 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-04-17T08:46:12.985+0000 7f4975269180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-17T08:46:13.071 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-04-17T08:46:13.069+0000 7f4975269180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-17T08:46:13.276 INFO:tasks.ceph.mgr.y.smithi152.stderr:2024-04-17T08:46:13.274+0000 7f9aa09b4180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-17T08:46:13.346 INFO:tasks.ceph.mgr.y.smithi152.stderr:2024-04-17T08:46:13.342+0000 7f9aa09b4180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-17T08:46:13.412 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-04-17T08:46:13.413+0000 7f4975269180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-17T08:46:13.483 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-04-17T08:46:13.481+0000 7f4975269180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-17T08:46:14.364 INFO:tasks.ceph.mgr.y.smithi152.stderr:2024-04-17T08:46:14.362+0000 7f9a46a00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-17T08:46:14.365 INFO:tasks.ceph.mgr.y.smithi152.stderr:2024-04-17T08:46:14.362+0000 7f9a46a00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-17T08:46:15.773 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-04-17T08:46:15.773+0000 7fc8a0c8e7c0 -1 osd.5 0 log_to_monitors true 2024-04-17T08:46:15.793 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-04-17T08:46:15.793+0000 7fc7d634e7c0 -1 osd.4 0 log_to_monitors true 2024-04-17T08:46:15.922 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-04-17T08:46:15.920+0000 7f54798a47c0 -1 osd.7 0 log_to_monitors true 2024-04-17T08:46:15.926 INFO:tasks.ceph.osd.1.smithi152.stderr:2024-04-17T08:46:15.926+0000 7fb5578957c0 -1 osd.1 0 log_to_monitors true 2024-04-17T08:46:15.931 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-04-17T08:46:15.928+0000 7f2b4df437c0 -1 osd.6 0 log_to_monitors true 2024-04-17T08:46:15.980 INFO:tasks.ceph.osd.3.smithi152.stderr:2024-04-17T08:46:15.978+0000 7f2cce5a47c0 -1 osd.3 0 log_to_monitors true 2024-04-17T08:46:16.242 INFO:tasks.ceph.osd.0.smithi152.stderr:2024-04-17T08:46:16.242+0000 7f2079c727c0 -1 osd.0 0 log_to_monitors true 2024-04-17T08:46:16.269 INFO:tasks.ceph.osd.2.smithi152.stderr:2024-04-17T08:46:16.266+0000 7f98251317c0 -1 osd.2 0 log_to_monitors true 2024-04-17T08:46:19.367 DEBUG:teuthology.orchestra.run.smithi152:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-17T08:46:19.574 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.574+0000 7f9065c00640 1 Processor -- start 2024-04-17T08:46:19.575 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.574+0000 7f9065c00640 1 -- start start 2024-04-17T08:46:19.576 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.574+0000 7f9065c00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f90600cccb0 0x7f90600cf450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:19.576 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.574+0000 7f9065c00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f90601600a0 0x7f906015d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:19.576 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.574+0000 7f9065c00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9060160530 con 0x7f90600cd090 2024-04-17T08:46:19.576 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.574+0000 7f9065c00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f90600b1d60 con 0x7f90600cccb0 2024-04-17T08:46:19.577 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.574+0000 7f9065c00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f90600b2020 con 0x7f90601600a0 2024-04-17T08:46:19.578 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.574+0000 7f905fe00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f90600cccb0 0x7f90600cf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:19.578 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.574+0000 7f9065200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f90601600a0 0x7f906015d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:19.578 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.574+0000 7f9065200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f90601600a0 0x7f906015d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.152:52098/0 (socket says 172.21.15.152:52098) 2024-04-17T08:46:19.578 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.574+0000 7f9065200640 1 -- 172.21.15.152:0/2740394112 learned_addr learned my addr 172.21.15.152:0/2740394112 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:19.578 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.574+0000 7f905fe00640 1 -- 172.21.15.152:0/2740394112 >> v2:172.21.15.196:3300/0 conn(0x7f90601600a0 msgr2=0x7f906015d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:19.578 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.574+0000 7f905fe00640 1 --2- 172.21.15.152:0/2740394112 >> v2:172.21.15.196:3300/0 conn(0x7f90601600a0 0x7f906015d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:19.578 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.574+0000 7f905fe00640 1 -- 172.21.15.152:0/2740394112 >> v1:172.21.15.196:6789/0 conn(0x7f90600cd090 legacy=0x7f90600b24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:19.578 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.574+0000 7f905fe00640 1 -- 172.21.15.152:0/2740394112 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90601607f0 con 0x7f90600cccb0 2024-04-17T08:46:19.583 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.582+0000 7f905fe00640 1 --2- 172.21.15.152:0/2740394112 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90600cccb0 0x7f90600cf450 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f90600cff50 tx=0x7f905001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e15aef2aacd06e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:19.588 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.586+0000 7f905ea00640 1 -- 172.21.15.152:0/2740394112 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90500b0070 con 0x7f90600cccb0 2024-04-17T08:46:19.588 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.586+0000 7f905ea00640 1 -- 172.21.15.152:0/2740394112 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90500ab600 con 0x7f90600cccb0 2024-04-17T08:46:19.588 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.586+0000 7f905ea00640 1 -- 172.21.15.152:0/2740394112 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90500ab9d0 con 0x7f90600cccb0 2024-04-17T08:46:19.589 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.586+0000 7f9065c00640 1 -- 172.21.15.152:0/2740394112 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90600cccb0 msgr2=0x7f90600cf450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:19.589 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.586+0000 7f9065c00640 1 --2- 172.21.15.152:0/2740394112 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90600cccb0 0x7f90600cf450 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f90600cff50 tx=0x7f905001c440 comp rx=0 tx=0).stop 2024-04-17T08:46:19.590 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.586+0000 7f9065c00640 1 -- 172.21.15.152:0/2740394112 shutdown_connections 2024-04-17T08:46:19.590 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.586+0000 7f9065c00640 1 --2- 172.21.15.152:0/2740394112 >> v2:172.21.15.196:3300/0 conn(0x7f90601600a0 0x7f906015d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:19.590 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.586+0000 7f9065c00640 1 --2- 172.21.15.152:0/2740394112 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90600cccb0 0x7f90600cf450 secure :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f90600cff50 tx=0x7f905001c440 comp rx=0 tx=0).stop 2024-04-17T08:46:19.590 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.586+0000 7f9065c00640 1 -- 172.21.15.152:0/2740394112 >> 172.21.15.152:0/2740394112 conn(0x7f906006c1f0 msgr2=0x7f90600b3f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:19.590 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.586+0000 7f9065c00640 1 -- 172.21.15.152:0/2740394112 shutdown_connections 2024-04-17T08:46:19.590 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.586+0000 7f9065c00640 1 -- 172.21.15.152:0/2740394112 wait complete. 2024-04-17T08:46:19.591 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.590+0000 7f9065c00640 1 Processor -- start 2024-04-17T08:46:19.592 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.590+0000 7f9065c00640 1 -- start start 2024-04-17T08:46:19.594 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.594+0000 7f9065c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90600cd090 0x7f9060154320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:19.594 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.594+0000 7f9065c00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90601600a0 0x7f90600c5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:19.595 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.594+0000 7f9065c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f90600c6470 0x7f90600b5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:19.596 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.594+0000 7f905fe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90600cd090 0x7f9060154320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:19.596 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.594+0000 7f905fe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90600cd090 0x7f9060154320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.152:48946/0 (socket says 172.21.15.152:48946) 2024-04-17T08:46:19.596 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.594+0000 7f9065c00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f906015d7d0 con 0x7f90601600a0 2024-04-17T08:46:19.596 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.594+0000 7f9065c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f906006f3e0 con 0x7f90600c6470 2024-04-17T08:46:19.596 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.594+0000 7f9065c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f906015d950 con 0x7f90600cd090 2024-04-17T08:46:19.596 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.594+0000 7f9065200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f90600c6470 0x7f90600b5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:19.596 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.594+0000 7f9065200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f90600c6470 0x7f90600b5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.152:52114/0 (socket says 172.21.15.152:52114) 2024-04-17T08:46:19.596 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.594+0000 7f9065200640 1 -- 172.21.15.152:0/3591271287 learned_addr learned my addr 172.21.15.152:0/3591271287 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:19.597 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.594+0000 7f905f400640 1 --2- 172.21.15.152:0/3591271287 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90601600a0 0x7f90600c5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:19.597 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.594+0000 7f905fe00640 1 -- 172.21.15.152:0/3591271287 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f90600c6470 msgr2=0x7f90600b5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:19.597 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.594+0000 7f905fe00640 1 --2- 172.21.15.152:0/3591271287 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f90600c6470 0x7f90600b5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:19.597 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.594+0000 7f905fe00640 1 -- 172.21.15.152:0/3591271287 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90601600a0 msgr2=0x7f90600c5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:19.597 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.594+0000 7f905fe00640 1 --2- 172.21.15.152:0/3591271287 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90601600a0 0x7f90600c5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:19.597 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.594+0000 7f905fe00640 1 -- 172.21.15.152:0/3591271287 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f906013e4f0 con 0x7f90600cd090 2024-04-17T08:46:19.598 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.594+0000 7f905fe00640 1 --2- 172.21.15.152:0/3591271287 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90600cd090 0x7f9060154320 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f90500ab000 tx=0x7f90500191e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:19.598 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.598+0000 7f9057e00640 1 -- 172.21.15.152:0/3591271287 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90500b0040 con 0x7f90600cd090 2024-04-17T08:46:19.598 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.598+0000 7f9057e00640 1 -- 172.21.15.152:0/3591271287 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90500bc070 con 0x7f90600cd090 2024-04-17T08:46:19.598 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.598+0000 7f9057e00640 1 -- 172.21.15.152:0/3591271287 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90500b56e0 con 0x7f90600cd090 2024-04-17T08:46:19.600 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.598+0000 7f9065c00640 1 -- 172.21.15.152:0/3591271287 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90600b6260 con 0x7f90600cd090 2024-04-17T08:46:19.600 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.598+0000 7f9065c00640 1 -- 172.21.15.152:0/3591271287 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f90600b6820 con 0x7f90600cd090 2024-04-17T08:46:19.603 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.598+0000 7f9065c00640 1 -- 172.21.15.152:0/3591271287 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90600c6880 con 0x7f90600cd090 2024-04-17T08:46:19.603 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.602+0000 7f9057e00640 1 -- 172.21.15.152:0/3591271287 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 4) ==== 87931+0+0 (secure 0 0 0) 0x7f90500b3070 con 0x7f90600cd090 2024-04-17T08:46:19.604 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.602+0000 7f9057e00640 1 --2- 172.21.15.152:0/3591271287 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f90400682f0 0x7f904006a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:19.605 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.602+0000 7f9057e00640 1 -- 172.21.15.152:0/3591271287 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7f905011f620 con 0x7f90600cd090 2024-04-17T08:46:19.605 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.602+0000 7f905f400640 1 --2- 172.21.15.152:0/3591271287 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f90400682f0 0x7f904006a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:19.606 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.606+0000 7f905f400640 1 --2- 172.21.15.152:0/3591271287 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f90400682f0 0x7f904006a7b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f906013e320 tx=0x7f904c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:19.617 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.614+0000 7f9057e00640 1 -- 172.21.15.152:0/3591271287 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f90600c6880 con 0x7f90600cd090 2024-04-17T08:46:19.701 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-04-17T08:46:19.696+0000 7f5475200640 -1 osd.7 0 waiting for initial osdmap 2024-04-17T08:46:19.706 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-04-17T08:46:19.704+0000 7fc89c600640 -1 osd.5 0 waiting for initial osdmap 2024-04-17T08:46:19.712 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-04-17T08:46:19.712+0000 7f2b48e00640 -1 osd.6 0 waiting for initial osdmap 2024-04-17T08:46:19.733 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-04-17T08:46:19.732+0000 7f546a800640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-17T08:46:19.737 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-04-17T08:46:19.736+0000 7fc7d1c00640 -1 osd.4 0 waiting for initial osdmap 2024-04-17T08:46:19.745 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-04-17T08:46:19.744+0000 7f2b3ee00640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-17T08:46:19.749 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-04-17T08:46:19.748+0000 7fc891c00640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-17T08:46:19.777 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-04-17T08:46:19.776+0000 7fc7c7200640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-17T08:46:19.784 INFO:tasks.ceph.osd.0.smithi152.stderr:2024-04-17T08:46:19.782+0000 7f2074c00640 -1 osd.0 0 waiting for initial osdmap 2024-04-17T08:46:19.805 INFO:tasks.ceph.osd.1.smithi152.stderr:2024-04-17T08:46:19.798+0000 7fb553200640 -1 osd.1 0 waiting for initial osdmap 2024-04-17T08:46:19.823 INFO:tasks.ceph.osd.0.smithi152.stderr:2024-04-17T08:46:19.822+0000 7f206ac00640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-17T08:46:19.840 INFO:tasks.ceph.osd.3.smithi152.stderr:2024-04-17T08:46:19.838+0000 7f2cc9400640 -1 osd.3 0 waiting for initial osdmap 2024-04-17T08:46:19.843 INFO:tasks.ceph.osd.1.smithi152.stderr:2024-04-17T08:46:19.842+0000 7fb548800640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-17T08:46:19.854 INFO:tasks.ceph.osd.2.smithi152.stderr:2024-04-17T08:46:19.854+0000 7f9820000640 -1 osd.2 0 waiting for initial osdmap 2024-04-17T08:46:19.863 INFO:tasks.ceph.osd.3.smithi152.stderr:2024-04-17T08:46:19.862+0000 7f2cbf400640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-17T08:46:19.891 INFO:tasks.ceph.osd.2.smithi152.stderr:2024-04-17T08:46:19.890+0000 7f9816000640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-17T08:46:19.899 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.898+0000 7f9065c00640 1 -- 172.21.15.152:0/3591271287 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9060069360 con 0x7f90600cd090 2024-04-17T08:46:19.901 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.898+0000 7f9057e00640 1 -- 172.21.15.152:0/3591271287 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7f90600c6880 con 0x7f90600cd090 2024-04-17T08:46:19.901 INFO:teuthology.misc.health.smithi152.stdout: 2024-04-17T08:46:19.901 INFO:teuthology.misc.health.smithi152.stdout:{"epoch":12,"fsid":"ce68f82e-ec5f-4205-9fd5-bdfdf6ef31e2","created":"2024-04-17T08:46:08.353546+0000","modified":"2024-04-17T08:46:17.383993+0000","last_up_change":"0.000000","last_in_change":"2024-04-17T08:46:11.210050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"682f0192-187c-404e-bc7a-b6b4e23825e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f0fe8fef-60ec-4a39-83b6-2fa6a5adb0f1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"35f36d9c-5245-4431-a618-f4df0fa380ba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"96e56ca5-15b4-4895-9b79-da2c92043159","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f5aa10a4-9ff9-41fe-a5c9-15326f982cc8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"42bab884-3476-47ae-ac65-935fa6e0f055","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"460b6167-f57b-4224-9c92-cfc9b80bbe99","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d695643f-5e07-4e2a-a646-c06bd97b6650","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T08:46:19.903 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.902+0000 7f9065c00640 1 -- 172.21.15.152:0/3591271287 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f90400682f0 msgr2=0x7f904006a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:19.903 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.902+0000 7f9065c00640 1 --2- 172.21.15.152:0/3591271287 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f90400682f0 0x7f904006a7b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f906013e320 tx=0x7f904c009040 comp rx=0 tx=0).stop 2024-04-17T08:46:19.903 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.902+0000 7f9065c00640 1 -- 172.21.15.152:0/3591271287 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90600cd090 msgr2=0x7f9060154320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:19.903 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.902+0000 7f9065c00640 1 --2- 172.21.15.152:0/3591271287 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90600cd090 0x7f9060154320 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f90500ab000 tx=0x7f90500191e0 comp rx=0 tx=0).stop 2024-04-17T08:46:19.903 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.902+0000 7f9065c00640 1 -- 172.21.15.152:0/3591271287 shutdown_connections 2024-04-17T08:46:19.903 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.902+0000 7f9065c00640 1 --2- 172.21.15.152:0/3591271287 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f90600c6470 0x7f90600b5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:19.903 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.902+0000 7f9065c00640 1 --2- 172.21.15.152:0/3591271287 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90601600a0 0x7f90600c5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:19.903 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.902+0000 7f9065c00640 1 --2- 172.21.15.152:0/3591271287 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f90400682f0 0x7f904006a7b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:19.903 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.902+0000 7f9065c00640 1 --2- 172.21.15.152:0/3591271287 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90600cd090 0x7f9060154320 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:19.903 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.902+0000 7f9065c00640 1 -- 172.21.15.152:0/3591271287 >> 172.21.15.152:0/3591271287 conn(0x7f906006c1f0 msgr2=0x7f906015a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:19.903 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.902+0000 7f9065c00640 1 -- 172.21.15.152:0/3591271287 shutdown_connections 2024-04-17T08:46:19.903 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:19.902+0000 7f9065c00640 1 -- 172.21.15.152:0/3591271287 wait complete. 2024-04-17T08:46:19.919 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-17T08:46:21.605 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T08:46:21.609 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T08:46:26.727 DEBUG:teuthology.orchestra.run.smithi152:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-17T08:46:26.862 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.862+0000 7f8879200640 1 Processor -- start 2024-04-17T08:46:26.862 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.862+0000 7f8879200640 1 -- start start 2024-04-17T08:46:26.864 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.862+0000 7f8879200640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f887415c590 0x7f88740cca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:26.864 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.862+0000 7f8879200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f88740ccf60 0x7f88740d0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:26.864 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.862+0000 7f8879200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f88740d0ab0 0x7f88740ce930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:26.864 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.862+0000 7f8879200640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f887415dd40 con 0x7f887415c590 2024-04-17T08:46:26.864 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.862+0000 7f8879200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f88740d12c0 con 0x7f88740d0ab0 2024-04-17T08:46:26.864 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.862+0000 7f8879200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f887406f5e0 con 0x7f88740ccf60 2024-04-17T08:46:26.864 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.862+0000 7f8873400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f887415c590 0x7f88740cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:26.864 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.862+0000 7f8873400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f887415c590 0x7f88740cca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54360/0 (socket says 172.21.15.152:54360) 2024-04-17T08:46:26.864 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.862+0000 7f8873400640 1 -- 172.21.15.152:0/1014427399 learned_addr learned my addr 172.21.15.152:0/1014427399 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:26.864 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.862+0000 7f8873e00640 1 --2- 172.21.15.152:0/1014427399 >> v2:172.21.15.196:3300/0 conn(0x7f88740d0ab0 0x7f88740ce930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:26.864 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.862+0000 7f8872a00640 1 --2- 172.21.15.152:0/1014427399 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f88740ccf60 0x7f88740d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:26.864 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.862+0000 7f8873400640 1 -- 172.21.15.152:0/1014427399 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f88740ccf60 msgr2=0x7f88740d0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:26.864 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.862+0000 7f8873400640 1 --2- 172.21.15.152:0/1014427399 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f88740ccf60 0x7f88740d0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:26.865 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.862+0000 7f8873400640 1 -- 172.21.15.152:0/1014427399 >> v2:172.21.15.196:3300/0 conn(0x7f88740d0ab0 msgr2=0x7f88740ce930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:26.865 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.862+0000 7f8873400640 1 --2- 172.21.15.152:0/1014427399 >> v2:172.21.15.196:3300/0 conn(0x7f88740d0ab0 0x7f88740ce930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:26.865 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.862+0000 7f8873400640 1 -- 172.21.15.152:0/1014427399 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f887406f8c0 con 0x7f887415c590 2024-04-17T08:46:26.867 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.866+0000 7f8873400640 1 --2- 172.21.15.152:0/1014427399 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f887415c590 0x7f88740cca20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f88740cd740 tx=0x7f886401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf90f94daf7e1e4d server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:26.868 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.866+0000 7f8872000640 1 -- 172.21.15.152:0/1014427399 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88640b1070 con 0x7f887415c590 2024-04-17T08:46:26.868 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.866+0000 7f8872000640 1 -- 172.21.15.152:0/1014427399 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88640ac630 con 0x7f887415c590 2024-04-17T08:46:26.868 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.866+0000 7f8872000640 1 -- 172.21.15.152:0/1014427399 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88640a8050 con 0x7f887415c590 2024-04-17T08:46:26.868 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.866+0000 7f8879200640 1 -- 172.21.15.152:0/1014427399 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f887415c590 msgr2=0x7f88740cca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:26.868 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.866+0000 7f8879200640 1 --2- 172.21.15.152:0/1014427399 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f887415c590 0x7f88740cca20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f88740cd740 tx=0x7f886401c520 comp rx=0 tx=0).stop 2024-04-17T08:46:26.868 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.866+0000 7f8879200640 1 -- 172.21.15.152:0/1014427399 shutdown_connections 2024-04-17T08:46:26.869 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.866+0000 7f8879200640 1 --2- 172.21.15.152:0/1014427399 >> v2:172.21.15.196:3300/0 conn(0x7f88740d0ab0 0x7f88740ce930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:26.869 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.866+0000 7f8879200640 1 --2- 172.21.15.152:0/1014427399 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f88740ccf60 0x7f88740d0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:26.869 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.866+0000 7f8879200640 1 --2- 172.21.15.152:0/1014427399 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f887415c590 0x7f88740cca20 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:26.869 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.866+0000 7f8879200640 1 -- 172.21.15.152:0/1014427399 >> 172.21.15.152:0/1014427399 conn(0x7f88740722e0 msgr2=0x7f88740b3fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:26.869 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.866+0000 7f8879200640 1 -- 172.21.15.152:0/1014427399 shutdown_connections 2024-04-17T08:46:26.870 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.866+0000 7f8879200640 1 -- 172.21.15.152:0/1014427399 wait complete. 2024-04-17T08:46:26.871 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.870+0000 7f8879200640 1 Processor -- start 2024-04-17T08:46:26.871 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.870+0000 7f8879200640 1 -- start start 2024-04-17T08:46:26.872 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.870+0000 7f8879200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f88740ccf60 0x7f88740ca950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:26.872 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.870+0000 7f8879200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f88740d0ab0 0x7f8874156e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:26.872 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.870+0000 7f8879200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f887415c590 0x7f88741573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:26.872 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.870+0000 7f8879200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f88740d1040 con 0x7f887415c590 2024-04-17T08:46:26.872 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.870+0000 7f8879200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f88740d0ec0 con 0x7f88740d0ab0 2024-04-17T08:46:26.872 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.870+0000 7f8879200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f88740703a0 con 0x7f88740ccf60 2024-04-17T08:46:26.872 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.870+0000 7f8873e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f887415c590 0x7f88741573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:26.872 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.870+0000 7f8873e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f887415c590 0x7f88741573c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54362/0 (socket says 172.21.15.152:54362) 2024-04-17T08:46:26.872 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.870+0000 7f8873e00640 1 -- 172.21.15.152:0/2381154161 learned_addr learned my addr 172.21.15.152:0/2381154161 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:26.872 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.870+0000 7f8872a00640 1 --2- 172.21.15.152:0/2381154161 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f88740d0ab0 0x7f8874156e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:26.872 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.870+0000 7f8873400640 1 --2- 172.21.15.152:0/2381154161 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f88740ccf60 0x7f88740ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:26.872 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.870+0000 7f8873e00640 1 -- 172.21.15.152:0/2381154161 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f88740ccf60 msgr2=0x7f88740ca950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:26.872 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.870+0000 7f8873e00640 1 --2- 172.21.15.152:0/2381154161 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f88740ccf60 0x7f88740ca950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:26.872 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.870+0000 7f8873e00640 1 -- 172.21.15.152:0/2381154161 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f88740d0ab0 msgr2=0x7f8874156e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:26.872 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.870+0000 7f8873e00640 1 --2- 172.21.15.152:0/2381154161 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f88740d0ab0 0x7f8874156e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:26.873 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.870+0000 7f8873e00640 1 -- 172.21.15.152:0/2381154161 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8874156c20 con 0x7f887415c590 2024-04-17T08:46:26.873 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.870+0000 7f8873e00640 1 --2- 172.21.15.152:0/2381154161 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f887415c590 0x7f88741573c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f886c007e70 tx=0x7f886c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:26.873 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.870+0000 7f886b400640 1 -- 172.21.15.152:0/2381154161 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f886c014620 con 0x7f887415c590 2024-04-17T08:46:26.873 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.870+0000 7f886b400640 1 -- 172.21.15.152:0/2381154161 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f886c019070 con 0x7f887415c590 2024-04-17T08:46:26.873 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.870+0000 7f886b400640 1 -- 172.21.15.152:0/2381154161 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f886c014a20 con 0x7f887415c590 2024-04-17T08:46:26.874 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.870+0000 7f8879200640 1 -- 172.21.15.152:0/2381154161 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88740c98b0 con 0x7f887415c590 2024-04-17T08:46:26.874 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.870+0000 7f8879200640 1 -- 172.21.15.152:0/2381154161 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88740c9e70 con 0x7f887415c590 2024-04-17T08:46:26.874 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.870+0000 7f8879200640 1 -- 172.21.15.152:0/2381154161 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8874069360 con 0x7f887415c590 2024-04-17T08:46:26.874 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.874+0000 7f886b400640 1 -- 172.21.15.152:0/2381154161 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f886c014bc0 con 0x7f887415c590 2024-04-17T08:46:26.875 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.874+0000 7f886b400640 1 --2- 172.21.15.152:0/2381154161 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8854068380 0x7f885406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:26.875 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.874+0000 7f886b400640 1 -- 172.21.15.152:0/2381154161 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f886c086e40 con 0x7f887415c590 2024-04-17T08:46:26.875 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.874+0000 7f8873400640 1 --2- 172.21.15.152:0/2381154161 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8854068380 0x7f885406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:26.875 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.874+0000 7f8873400640 1 --2- 172.21.15.152:0/2381154161 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8854068380 0x7f885406a840 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f88640ae000 tx=0x7f8864008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:26.879 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:26.878+0000 7f886b400640 1 -- 172.21.15.152:0/2381154161 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f886c0570f0 con 0x7f887415c590 2024-04-17T08:46:27.036 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:27.034+0000 7f8879200640 1 -- 172.21.15.152:0/2381154161 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f88740c8ae0 con 0x7f887415c590 2024-04-17T08:46:27.037 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:27.034+0000 7f886b400640 1 -- 172.21.15.152:0/2381154161 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12908 (secure 0 0 0) 0x7f886c05b3f0 con 0x7f887415c590 2024-04-17T08:46:27.037 INFO:teuthology.misc.health.smithi152.stdout: 2024-04-17T08:46:27.037 INFO:teuthology.misc.health.smithi152.stdout:{"epoch":16,"fsid":"ce68f82e-ec5f-4205-9fd5-bdfdf6ef31e2","created":"2024-04-17T08:46:08.353546+0000","modified":"2024-04-17T08:46:23.761360+0000","last_up_change":"2024-04-17T08:46:20.738799+0000","last_in_change":"2024-04-17T08:46:11.210050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T08:46:21.386856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"682f0192-187c-404e-bc7a-b6b4e23825e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6819","nonce":3603799291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6823","nonce":3603799291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6831","nonce":3603799291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6827","nonce":3603799291}]},"public_addr":"172.21.15.152:6819/3603799291","cluster_addr":"172.21.15.152:6823/3603799291","heartbeat_back_addr":"172.21.15.152:6831/3603799291","heartbeat_front_addr":"172.21.15.152:6827/3603799291","state":["exists","up"]},{"osd":1,"uuid":"f0fe8fef-60ec-4a39-83b6-2fa6a5adb0f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6801","nonce":4133383142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6803","nonce":4133383142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6807","nonce":4133383142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6805","nonce":4133383142}]},"public_addr":"172.21.15.152:6801/4133383142","cluster_addr":"172.21.15.152:6803/4133383142","heartbeat_back_addr":"172.21.15.152:6807/4133383142","heartbeat_front_addr":"172.21.15.152:6805/4133383142","state":["exists","up"]},{"osd":2,"uuid":"35f36d9c-5245-4431-a618-f4df0fa380ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6809","nonce":3826143898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6811","nonce":3826143898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6815","nonce":3826143898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6813","nonce":3826143898}]},"public_addr":"172.21.15.152:6809/3826143898","cluster_addr":"172.21.15.152:6811/3826143898","heartbeat_back_addr":"172.21.15.152:6815/3826143898","heartbeat_front_addr":"172.21.15.152:6813/3826143898","state":["exists","up"]},{"osd":3,"uuid":"96e56ca5-15b4-4895-9b79-da2c92043159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6818","nonce":165717826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6822","nonce":165717826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6830","nonce":165717826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6826","nonce":165717826}]},"public_addr":"172.21.15.152:6818/165717826","cluster_addr":"172.21.15.152:6822/165717826","heartbeat_back_addr":"172.21.15.152:6830/165717826","heartbeat_front_addr":"172.21.15.152:6826/165717826","state":["exists","up"]},{"osd":4,"uuid":"f5aa10a4-9ff9-41fe-a5c9-15326f982cc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6817","nonce":4080159297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6819","nonce":4080159297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6823","nonce":4080159297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6821","nonce":4080159297}]},"public_addr":"172.21.15.196:6817/4080159297","cluster_addr":"172.21.15.196:6819/4080159297","heartbeat_back_addr":"172.21.15.196:6823/4080159297","heartbeat_front_addr":"172.21.15.196:6821/4080159297","state":["exists","up"]},{"osd":5,"uuid":"42bab884-3476-47ae-ac65-935fa6e0f055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6801","nonce":3519444232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6803","nonce":3519444232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6807","nonce":3519444232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6805","nonce":3519444232}]},"public_addr":"172.21.15.196:6801/3519444232","cluster_addr":"172.21.15.196:6803/3519444232","heartbeat_back_addr":"172.21.15.196:6807/3519444232","heartbeat_front_addr":"172.21.15.196:6805/3519444232","state":["exists","up"]},{"osd":6,"uuid":"460b6167-f57b-4224-9c92-cfc9b80bbe99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6809","nonce":275739834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6811","nonce":275739834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6815","nonce":275739834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6813","nonce":275739834}]},"public_addr":"172.21.15.196:6809/275739834","cluster_addr":"172.21.15.196:6811/275739834","heartbeat_back_addr":"172.21.15.196:6815/275739834","heartbeat_front_addr":"172.21.15.196:6813/275739834","state":["exists","up"]},{"osd":7,"uuid":"d695643f-5e07-4e2a-a646-c06bd97b6650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6825","nonce":307626968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6827","nonce":307626968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6831","nonce":307626968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6829","nonce":307626968}]},"public_addr":"172.21.15.196:6825/307626968","cluster_addr":"172.21.15.196:6827/307626968","heartbeat_back_addr":"172.21.15.196:6831/307626968","heartbeat_front_addr":"172.21.15.196:6829/307626968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.293257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.964533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.248895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.010000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.832554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.743704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930171+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930962+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T08:46:27.039 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:27.038+0000 7f8879200640 1 -- 172.21.15.152:0/2381154161 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8854068380 msgr2=0x7f885406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:27.040 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:27.038+0000 7f8879200640 1 --2- 172.21.15.152:0/2381154161 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8854068380 0x7f885406a840 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f88640ae000 tx=0x7f8864008040 comp rx=0 tx=0).stop 2024-04-17T08:46:27.040 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:27.038+0000 7f8879200640 1 -- 172.21.15.152:0/2381154161 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f887415c590 msgr2=0x7f88741573c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:27.040 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:27.038+0000 7f8879200640 1 --2- 172.21.15.152:0/2381154161 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f887415c590 0x7f88741573c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f886c007e70 tx=0x7f886c00e4b0 comp rx=0 tx=0).stop 2024-04-17T08:46:27.040 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:27.038+0000 7f8879200640 1 -- 172.21.15.152:0/2381154161 shutdown_connections 2024-04-17T08:46:27.040 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:27.038+0000 7f8879200640 1 --2- 172.21.15.152:0/2381154161 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f887415c590 0x7f88741573c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:27.040 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:27.038+0000 7f8879200640 1 --2- 172.21.15.152:0/2381154161 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f88740d0ab0 0x7f8874156e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:27.040 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:27.038+0000 7f8879200640 1 --2- 172.21.15.152:0/2381154161 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8854068380 0x7f885406a840 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:27.040 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:27.038+0000 7f8879200640 1 --2- 172.21.15.152:0/2381154161 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f88740ccf60 0x7f88740ca950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:27.040 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:27.038+0000 7f8879200640 1 -- 172.21.15.152:0/2381154161 >> 172.21.15.152:0/2381154161 conn(0x7f88740722e0 msgr2=0x7f8874159c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:27.040 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:27.038+0000 7f8879200640 1 -- 172.21.15.152:0/2381154161 shutdown_connections 2024-04-17T08:46:27.040 INFO:teuthology.misc.health.smithi152.stderr:2024-04-17T08:46:27.038+0000 7f8879200640 1 -- 172.21.15.152:0/2381154161 wait complete. 2024-04-17T08:46:27.056 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-17T08:46:27.056 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-17T08:46:27.057 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-17T08:46:27.057 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-17T08:46:27.060 INFO:tasks.ceph.mds.a:Started 2024-04-17T08:46:27.060 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-17T08:46:27.060 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-17T08:46:27.063 INFO:tasks.ceph.mds.c:Started 2024-04-17T08:46:27.063 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-17T08:46:27.063 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-17T08:46:27.066 INFO:tasks.ceph.mds.b:Started 2024-04-17T08:46:27.067 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-17T08:46:27.067 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-17T08:46:27.070 INFO:tasks.ceph.mds.d:Started 2024-04-17T08:46:27.070 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-17T08:46:27.070 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T08:46:27.167 INFO:tasks.ceph.mds.a.smithi152.stdout:starting mds.a at 2024-04-17T08:46:27.167 INFO:tasks.ceph.mds.c.smithi152.stdout:starting mds.c at 2024-04-17T08:46:27.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.210+0000 7fec57400640 1 Processor -- start 2024-04-17T08:46:27.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.210+0000 7fec57400640 1 -- start start 2024-04-17T08:46:27.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.210+0000 7fec57400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fec50070950 0x7fec500b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:27.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.214+0000 7fec57400640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec500cea60 con 0x7fec5006b9b0 2024-04-17T08:46:27.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.214+0000 7fec57400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec500ced40 con 0x7fec50158fe0 2024-04-17T08:46:27.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.214+0000 7fec57400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fec500cf020 con 0x7fec50070950 2024-04-17T08:46:27.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.214+0000 7fec55400640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fec5006b9b0 0x7fec5006bdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:55068/0 (socket says 172.21.15.152:55068) 2024-04-17T08:46:27.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.214+0000 7fec55400640 1 -- 172.21.15.152:0/1668370804 learned_addr learned my addr 172.21.15.152:0/1668370804 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:46:27.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.214+0000 7fec4fe00640 1 --2- 172.21.15.152:0/1668370804 >> v2:172.21.15.196:3300/0 conn(0x7fec50070950 0x7fec500b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:27.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.214+0000 7fec4f400640 1 -- 172.21.15.152:0/1668370804 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1835530023 0 0) 0x7fec500cea60 con 0x7fec5006b9b0 2024-04-17T08:46:27.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.214+0000 7fec4f400640 1 -- 172.21.15.152:0/1668370804 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec34003530 con 0x7fec5006b9b0 2024-04-17T08:46:27.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.214+0000 7fec4f400640 1 -- 172.21.15.152:0/1668370804 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2730373970 0 0) 0x7fec34003530 con 0x7fec5006b9b0 2024-04-17T08:46:27.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.214+0000 7fec4f400640 1 -- 172.21.15.152:0/1668370804 >> v2:172.21.15.196:3300/0 conn(0x7fec50070950 msgr2=0x7fec500b3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:27.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.214+0000 7fec4f400640 1 --2- 172.21.15.152:0/1668370804 >> v2:172.21.15.196:3300/0 conn(0x7fec50070950 0x7fec500b3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:27.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.214+0000 7fec4f400640 1 -- 172.21.15.152:0/1668370804 >> v1:172.21.15.196:6789/0 conn(0x7fec50158fe0 legacy=0x7fec5015f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:27.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.214+0000 7fec4f400640 1 -- 172.21.15.152:0/1668370804 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec500cf300 con 0x7fec5006b9b0 2024-04-17T08:46:27.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.214+0000 7fec4f400640 1 -- 172.21.15.152:0/1668370804 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2973887244 0 0) 0x7fec48001a00 con 0x7fec5006b9b0 2024-04-17T08:46:27.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.214+0000 7fec4fe00640 1 --2- 172.21.15.152:0/1668370804 >> v2:172.21.15.196:3300/0 conn(0x7fec50070950 0x7fec500b3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T08:46:27.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.214+0000 7fec4f400640 1 -- 172.21.15.152:0/1668370804 >> v1:172.21.15.152:6789/0 conn(0x7fec5006b9b0 legacy=0x7fec5006bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:27.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.214+0000 7fec4f400640 1 --2- 172.21.15.152:0/1668370804 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec340039c0 0x7fec34003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:27.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.214+0000 7fec4f400640 1 --2- 172.21.15.152:0/1668370804 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec34004810 0x7fec34004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:27.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.214+0000 7fec4f400640 1 --2- 172.21.15.152:0/1668370804 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fec340051d0 0x7fec3400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:27.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.214+0000 7fec4f400640 1 -- 172.21.15.152:0/1668370804 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fec500cf020 con 0x7fec340039c0 2024-04-17T08:46:27.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.214+0000 7fec4f400640 1 -- 172.21.15.152:0/1668370804 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fec3400c070 con 0x7fec340051d0 2024-04-17T08:46:27.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.214+0000 7fec4f400640 1 -- 172.21.15.152:0/1668370804 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fec3400c270 con 0x7fec34004810 2024-04-17T08:46:27.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.214+0000 7fec54a00640 1 --2- 172.21.15.152:0/1668370804 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec340039c0 0x7fec34003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:27.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.214+0000 7fec55400640 1 --2- 172.21.15.152:0/1668370804 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fec340051d0 0x7fec3400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:27.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.214+0000 7fec4fe00640 1 --2- 172.21.15.152:0/1668370804 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec34004810 0x7fec34004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:27.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.214+0000 7fec54a00640 1 -- 172.21.15.152:0/1668370804 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec34004810 msgr2=0x7fec34004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:27.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.214+0000 7fec54a00640 1 --2- 172.21.15.152:0/1668370804 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec34004810 0x7fec34004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:27.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.214+0000 7fec54a00640 1 -- 172.21.15.152:0/1668370804 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fec340051d0 msgr2=0x7fec3400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:27.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.214+0000 7fec54a00640 1 --2- 172.21.15.152:0/1668370804 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fec340051d0 0x7fec3400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:27.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.214+0000 7fec54a00640 1 -- 172.21.15.152:0/1668370804 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec34003530 con 0x7fec340039c0 2024-04-17T08:46:27.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.214+0000 7fec55400640 1 -- 172.21.15.152:0/1668370804 reap_dead start 2024-04-17T08:46:27.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.218+0000 7fec54a00640 1 --2- 172.21.15.152:0/1668370804 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec340039c0 0x7fec34003de0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fec38001780 tx=0x7fec3801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54ad5575acd731eb server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:27.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.218+0000 7fec4f400640 1 -- 172.21.15.152:0/1668370804 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec380013a0 con 0x7fec340039c0 2024-04-17T08:46:27.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.218+0000 7fec4f400640 1 -- 172.21.15.152:0/1668370804 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec380052f0 con 0x7fec340039c0 2024-04-17T08:46:27.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.218+0000 7fec4f400640 1 -- 172.21.15.152:0/1668370804 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec380a4e60 con 0x7fec340039c0 2024-04-17T08:46:27.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.218+0000 7fec57400640 1 -- 172.21.15.152:0/1668370804 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec340039c0 msgr2=0x7fec34003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:27.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.218+0000 7fec57400640 1 --2- 172.21.15.152:0/1668370804 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec340039c0 0x7fec34003de0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fec38001780 tx=0x7fec3801c3d0 comp rx=0 tx=0).stop 2024-04-17T08:46:27.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.218+0000 7fec57400640 1 -- 172.21.15.152:0/1668370804 shutdown_connections 2024-04-17T08:46:27.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.218+0000 7fec57400640 1 --2- 172.21.15.152:0/1668370804 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec340039c0 0x7fec34003de0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:27.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.218+0000 7fec57400640 1 -- 172.21.15.152:0/1668370804 >> 172.21.15.152:0/1668370804 conn(0x7fec500cd540 msgr2=0x7fec500cd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:27.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.218+0000 7fec57400640 1 -- 172.21.15.152:0/1668370804 shutdown_connections 2024-04-17T08:46:27.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.218+0000 7fec57400640 1 -- 172.21.15.152:0/1668370804 wait complete. 2024-04-17T08:46:27.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.218+0000 7fec57400640 1 Processor -- start 2024-04-17T08:46:27.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.218+0000 7fec57400640 1 -- start start 2024-04-17T08:46:27.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.222+0000 7fec57400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec340039c0 0x7fec501474b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:27.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.222+0000 7fec57400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fec50155d60 0x7fec501561e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:27.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.222+0000 7fec57400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec501513f0 0x7fec50151870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:27.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.222+0000 7fec57400640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fec500cfc80 con 0x7fec501513f0 2024-04-17T08:46:27.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.222+0000 7fec57400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fec500cfb00 con 0x7fec50155d60 2024-04-17T08:46:27.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.222+0000 7fec57400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fec500cfe00 con 0x7fec340039c0 2024-04-17T08:46:27.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.222+0000 7fec55400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec501513f0 0x7fec50151870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:27.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.222+0000 7fec54a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec340039c0 0x7fec501474b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:27.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.222+0000 7fec54a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec340039c0 0x7fec501474b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.152:49046/0 (socket says 172.21.15.152:49046) 2024-04-17T08:46:27.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.222+0000 7fec54a00640 1 -- 172.21.15.152:0/2976403717 learned_addr learned my addr 172.21.15.152:0/2976403717 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:27.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.222+0000 7fec4fe00640 1 --2- 172.21.15.152:0/2976403717 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fec50155d60 0x7fec501561e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:27.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.222+0000 7fec54a00640 1 -- 172.21.15.152:0/2976403717 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fec50155d60 msgr2=0x7fec501561e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:27.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.222+0000 7fec54a00640 1 --2- 172.21.15.152:0/2976403717 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fec50155d60 0x7fec501561e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:27.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.222+0000 7fec54a00640 1 -- 172.21.15.152:0/2976403717 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec501513f0 msgr2=0x7fec50151870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:27.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.222+0000 7fec54a00640 1 --2- 172.21.15.152:0/2976403717 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec501513f0 0x7fec50151870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:27.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.222+0000 7fec54a00640 1 -- 172.21.15.152:0/2976403717 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec50152170 con 0x7fec340039c0 2024-04-17T08:46:27.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.222+0000 7fec55400640 1 --2- 172.21.15.152:0/2976403717 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec501513f0 0x7fec50151870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T08:46:27.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.222+0000 7fec54a00640 1 --2- 172.21.15.152:0/2976403717 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec340039c0 0x7fec501474b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fec38005040 tx=0x7fec34005840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:27.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.222+0000 7fec4cc00640 1 -- 172.21.15.152:0/2976403717 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec38007a40 con 0x7fec340039c0 2024-04-17T08:46:27.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.222+0000 7fec4cc00640 1 -- 172.21.15.152:0/2976403717 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec380ba070 con 0x7fec340039c0 2024-04-17T08:46:27.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.222+0000 7fec57400640 1 -- 172.21.15.152:0/2976403717 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec50152450 con 0x7fec340039c0 2024-04-17T08:46:27.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.222+0000 7fec4cc00640 1 -- 172.21.15.152:0/2976403717 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec380054a0 con 0x7fec340039c0 2024-04-17T08:46:27.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.222+0000 7fec57400640 1 -- 172.21.15.152:0/2976403717 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fec50152a10 con 0x7fec340039c0 2024-04-17T08:46:27.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.222+0000 7fec57400640 1 -- 172.21.15.152:0/2976403717 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec50068a30 con 0x7fec340039c0 2024-04-17T08:46:27.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.222+0000 7fec4cc00640 1 -- 172.21.15.152:0/2976403717 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fec38007030 con 0x7fec340039c0 2024-04-17T08:46:27.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.226+0000 7fec4cc00640 1 --2- 172.21.15.152:0/2976403717 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fec2c0683b0 0x7fec2c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:27.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.226+0000 7fec4cc00640 1 -- 172.21.15.152:0/2976403717 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fec38120340 con 0x7fec340039c0 2024-04-17T08:46:27.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.226+0000 7fec4fe00640 1 --2- 172.21.15.152:0/2976403717 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fec2c0683b0 0x7fec2c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:27.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.226+0000 7fec4fe00640 1 --2- 172.21.15.152:0/2976403717 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fec2c0683b0 0x7fec2c06a870 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fec50153230 tx=0x7fec40009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:27.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.230+0000 7fec4cc00640 1 -- 172.21.15.152:0/2976403717 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fec38016110 con 0x7fec340039c0 2024-04-17T08:46:27.299 INFO:tasks.ceph.mds.b.smithi196.stdout:starting mds.b at 2024-04-17T08:46:27.300 INFO:tasks.ceph.mds.d.smithi196.stdout:starting mds.d at 2024-04-17T08:46:27.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.386+0000 7fec57400640 1 -- 172.21.15.152:0/2976403717 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fec50074e80 con 0x7fec340039c0 2024-04-17T08:46:27.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.390+0000 7fec4cc00640 1 -- 172.21.15.152:0/2976403717 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12908 (secure 0 0 0) 0x7fec380f0560 con 0x7fec340039c0 2024-04-17T08:46:27.390 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:46:27.390 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":16,"fsid":"ce68f82e-ec5f-4205-9fd5-bdfdf6ef31e2","created":"2024-04-17T08:46:08.353546+0000","modified":"2024-04-17T08:46:23.761360+0000","last_up_change":"2024-04-17T08:46:20.738799+0000","last_in_change":"2024-04-17T08:46:11.210050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T08:46:21.386856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"682f0192-187c-404e-bc7a-b6b4e23825e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6819","nonce":3603799291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6823","nonce":3603799291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6831","nonce":3603799291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6827","nonce":3603799291}]},"public_addr":"172.21.15.152:6819/3603799291","cluster_addr":"172.21.15.152:6823/3603799291","heartbeat_back_addr":"172.21.15.152:6831/3603799291","heartbeat_front_addr":"172.21.15.152:6827/3603799291","state":["exists","up"]},{"osd":1,"uuid":"f0fe8fef-60ec-4a39-83b6-2fa6a5adb0f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6801","nonce":4133383142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6803","nonce":4133383142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6807","nonce":4133383142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6805","nonce":4133383142}]},"public_addr":"172.21.15.152:6801/4133383142","cluster_addr":"172.21.15.152:6803/4133383142","heartbeat_back_addr":"172.21.15.152:6807/4133383142","heartbeat_front_addr":"172.21.15.152:6805/4133383142","state":["exists","up"]},{"osd":2,"uuid":"35f36d9c-5245-4431-a618-f4df0fa380ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6809","nonce":3826143898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6811","nonce":3826143898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6815","nonce":3826143898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6813","nonce":3826143898}]},"public_addr":"172.21.15.152:6809/3826143898","cluster_addr":"172.21.15.152:6811/3826143898","heartbeat_back_addr":"172.21.15.152:6815/3826143898","heartbeat_front_addr":"172.21.15.152:6813/3826143898","state":["exists","up"]},{"osd":3,"uuid":"96e56ca5-15b4-4895-9b79-da2c92043159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6818","nonce":165717826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6822","nonce":165717826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6830","nonce":165717826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6826","nonce":165717826}]},"public_addr":"172.21.15.152:6818/165717826","cluster_addr":"172.21.15.152:6822/165717826","heartbeat_back_addr":"172.21.15.152:6830/165717826","heartbeat_front_addr":"172.21.15.152:6826/165717826","state":["exists","up"]},{"osd":4,"uuid":"f5aa10a4-9ff9-41fe-a5c9-15326f982cc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6817","nonce":4080159297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6819","nonce":4080159297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6823","nonce":4080159297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6821","nonce":4080159297}]},"public_addr":"172.21.15.196:6817/4080159297","cluster_addr":"172.21.15.196:6819/4080159297","heartbeat_back_addr":"172.21.15.196:6823/4080159297","heartbeat_front_addr":"172.21.15.196:6821/4080159297","state":["exists","up"]},{"osd":5,"uuid":"42bab884-3476-47ae-ac65-935fa6e0f055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6801","nonce":3519444232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6803","nonce":3519444232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6807","nonce":3519444232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6805","nonce":3519444232}]},"public_addr":"172.21.15.196:6801/3519444232","cluster_addr":"172.21.15.196:6803/3519444232","heartbeat_back_addr":"172.21.15.196:6807/3519444232","heartbeat_front_addr":"172.21.15.196:6805/3519444232","state":["exists","up"]},{"osd":6,"uuid":"460b6167-f57b-4224-9c92-cfc9b80bbe99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6809","nonce":275739834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6811","nonce":275739834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6815","nonce":275739834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6813","nonce":275739834}]},"public_addr":"172.21.15.196:6809/275739834","cluster_addr":"172.21.15.196:6811/275739834","heartbeat_back_addr":"172.21.15.196:6815/275739834","heartbeat_front_addr":"172.21.15.196:6813/275739834","state":["exists","up"]},{"osd":7,"uuid":"d695643f-5e07-4e2a-a646-c06bd97b6650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6825","nonce":307626968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6827","nonce":307626968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6831","nonce":307626968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6829","nonce":307626968}]},"public_addr":"172.21.15.196:6825/307626968","cluster_addr":"172.21.15.196:6827/307626968","heartbeat_back_addr":"172.21.15.196:6831/307626968","heartbeat_front_addr":"172.21.15.196:6829/307626968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.293257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.964533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.248895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.010000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.832554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.743704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930171+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930962+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T08:46:27.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.390+0000 7fec57400640 1 -- 172.21.15.152:0/2976403717 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fec2c0683b0 msgr2=0x7fec2c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:27.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.390+0000 7fec57400640 1 --2- 172.21.15.152:0/2976403717 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fec2c0683b0 0x7fec2c06a870 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fec50153230 tx=0x7fec40009190 comp rx=0 tx=0).stop 2024-04-17T08:46:27.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.390+0000 7fec57400640 1 -- 172.21.15.152:0/2976403717 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec340039c0 msgr2=0x7fec501474b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:27.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.390+0000 7fec57400640 1 --2- 172.21.15.152:0/2976403717 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec340039c0 0x7fec501474b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fec38005040 tx=0x7fec34005840 comp rx=0 tx=0).stop 2024-04-17T08:46:27.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.390+0000 7fec57400640 1 -- 172.21.15.152:0/2976403717 shutdown_connections 2024-04-17T08:46:27.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.390+0000 7fec57400640 1 --2- 172.21.15.152:0/2976403717 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec501513f0 0x7fec50151870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:27.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.390+0000 7fec57400640 1 --2- 172.21.15.152:0/2976403717 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fec50155d60 0x7fec501561e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:27.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.390+0000 7fec57400640 1 --2- 172.21.15.152:0/2976403717 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fec2c0683b0 0x7fec2c06a870 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:27.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.390+0000 7fec57400640 1 --2- 172.21.15.152:0/2976403717 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec340039c0 0x7fec501474b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:27.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.390+0000 7fec57400640 1 -- 172.21.15.152:0/2976403717 >> 172.21.15.152:0/2976403717 conn(0x7fec500cd540 msgr2=0x7fec500b4710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:27.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.390+0000 7fec57400640 1 -- 172.21.15.152:0/2976403717 shutdown_connections 2024-04-17T08:46:27.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.390+0000 7fec57400640 1 -- 172.21.15.152:0/2976403717 wait complete. 2024-04-17T08:46:27.411 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T08:46:21.386856+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-17T08:46:27.411 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T08:46:27.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.546+0000 7fa604a00640 1 Processor -- start 2024-04-17T08:46:27.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.546+0000 7fa604a00640 1 -- start start 2024-04-17T08:46:27.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.550+0000 7fa604a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa60015c170 0x7fa6000ad100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:27.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.550+0000 7fa604a00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa60015fe90 con 0x7fa6000af7d0 2024-04-17T08:46:27.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.550+0000 7fa604a00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa600160170 con 0x7fa6000d0810 2024-04-17T08:46:27.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.550+0000 7fa604a00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fa60006ff70 con 0x7fa60015c170 2024-04-17T08:46:27.551 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.550+0000 7fa5f6a00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fa6000af7d0 0x7fa6000d0100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:55080/0 (socket says 172.21.15.152:55080) 2024-04-17T08:46:27.551 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.550+0000 7fa5f6a00640 1 -- 172.21.15.152:0/1961544275 learned_addr learned my addr 172.21.15.152:0/1961544275 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:46:27.551 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.550+0000 7fa5ff400640 1 --2- 172.21.15.152:0/1961544275 >> v2:172.21.15.196:3300/0 conn(0x7fa60015c170 0x7fa6000ad100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:27.551 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.550+0000 7fa5fea00640 1 -- 172.21.15.152:0/1961544275 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 592727648 0 0) 0x7fa60015fe90 con 0x7fa6000af7d0 2024-04-17T08:46:27.551 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.550+0000 7fa5fea00640 1 -- 172.21.15.152:0/1961544275 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5e4003530 con 0x7fa6000af7d0 2024-04-17T08:46:27.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.550+0000 7fa5fea00640 1 -- 172.21.15.152:0/1961544275 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 398321368 0 0) 0x7fa600160170 con 0x7fa6000d0810 2024-04-17T08:46:27.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.550+0000 7fa5fea00640 1 -- 172.21.15.152:0/1961544275 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa60015fe90 con 0x7fa6000d0810 2024-04-17T08:46:27.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.550+0000 7fa5ff400640 1 -- 172.21.15.152:0/1961544275 >> v1:172.21.15.196:6789/0 conn(0x7fa6000d0810 legacy=0x7fa60006b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:27.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.550+0000 7fa5ff400640 1 -- 172.21.15.152:0/1961544275 >> v1:172.21.15.152:6789/0 conn(0x7fa6000af7d0 legacy=0x7fa6000d0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:27.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.550+0000 7fa5ff400640 1 -- 172.21.15.152:0/1961544275 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa600160450 con 0x7fa60015c170 2024-04-17T08:46:27.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.554+0000 7fa5ff400640 1 --2- 172.21.15.152:0/1961544275 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa60015c170 0x7fa6000ad100 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa5f00097c0 tx=0x7fa5f001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=250e812fa24d4f8a server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:27.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.554+0000 7fa5fea00640 1 -- 172.21.15.152:0/1961544275 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f00b0070 con 0x7fa60015c170 2024-04-17T08:46:27.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.554+0000 7fa5fea00640 1 -- 172.21.15.152:0/1961544275 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5f00ab600 con 0x7fa60015c170 2024-04-17T08:46:27.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.554+0000 7fa5fea00640 1 -- 172.21.15.152:0/1961544275 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f00ab9d0 con 0x7fa60015c170 2024-04-17T08:46:27.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.554+0000 7fa604a00640 1 -- 172.21.15.152:0/1961544275 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa60015c170 msgr2=0x7fa6000ad100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:27.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.554+0000 7fa604a00640 1 --2- 172.21.15.152:0/1961544275 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa60015c170 0x7fa6000ad100 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa5f00097c0 tx=0x7fa5f001c4a0 comp rx=0 tx=0).stop 2024-04-17T08:46:27.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.554+0000 7fa604a00640 1 -- 172.21.15.152:0/1961544275 shutdown_connections 2024-04-17T08:46:27.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.554+0000 7fa604a00640 1 --2- 172.21.15.152:0/1961544275 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa60015c170 0x7fa6000ad100 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:27.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.554+0000 7fa604a00640 1 -- 172.21.15.152:0/1961544275 >> 172.21.15.152:0/1961544275 conn(0x7fa6000b5280 msgr2=0x7fa6000b3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:27.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.554+0000 7fa604a00640 1 -- 172.21.15.152:0/1961544275 shutdown_connections 2024-04-17T08:46:27.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.554+0000 7fa604a00640 1 -- 172.21.15.152:0/1961544275 wait complete. 2024-04-17T08:46:27.556 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.554+0000 7fa604a00640 1 Processor -- start 2024-04-17T08:46:27.556 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.554+0000 7fa604a00640 1 -- start start 2024-04-17T08:46:27.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.554+0000 7fa604a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6000af7d0 0x7fa60014b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:27.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.554+0000 7fa604a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa6000d0810 0x7fa600099a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:27.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.554+0000 7fa604a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa60015c170 0x7fa6001486a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:27.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.554+0000 7fa604a00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa60016a320 con 0x7fa6000af7d0 2024-04-17T08:46:27.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.554+0000 7fa604a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa60016a1a0 con 0x7fa60015c170 2024-04-17T08:46:27.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.554+0000 7fa604a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fa60016a4a0 con 0x7fa6000d0810 2024-04-17T08:46:27.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.554+0000 7fa5ff400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6000af7d0 0x7fa60014b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:27.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.554+0000 7fa5ff400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6000af7d0 0x7fa60014b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54408/0 (socket says 172.21.15.152:54408) 2024-04-17T08:46:27.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.558+0000 7fa5ff400640 1 -- 172.21.15.152:0/1239351533 learned_addr learned my addr 172.21.15.152:0/1239351533 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:27.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.558+0000 7fa5f6a00640 1 --2- 172.21.15.152:0/1239351533 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa6000d0810 0x7fa600099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:27.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.558+0000 7fa5ffe00640 1 --2- 172.21.15.152:0/1239351533 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa60015c170 0x7fa6001486a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:27.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.558+0000 7fa5ff400640 1 -- 172.21.15.152:0/1239351533 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa6000d0810 msgr2=0x7fa600099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:27.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.558+0000 7fa5ff400640 1 --2- 172.21.15.152:0/1239351533 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa6000d0810 0x7fa600099a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:27.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.558+0000 7fa5ff400640 1 -- 172.21.15.152:0/1239351533 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa60015c170 msgr2=0x7fa6001486a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:27.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.558+0000 7fa5ff400640 1 --2- 172.21.15.152:0/1239351533 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa60015c170 0x7fa6001486a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:27.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.558+0000 7fa5ff400640 1 -- 172.21.15.152:0/1239351533 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa600148be0 con 0x7fa6000af7d0 2024-04-17T08:46:27.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.558+0000 7fa5ff400640 1 --2- 172.21.15.152:0/1239351533 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6000af7d0 0x7fa60014b320 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa5f00190b0 tx=0x7fa5f0019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:27.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.558+0000 7fa5f7e00640 1 -- 172.21.15.152:0/1239351533 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f00b8020 con 0x7fa6000af7d0 2024-04-17T08:46:27.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.558+0000 7fa5f7e00640 1 -- 172.21.15.152:0/1239351533 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5f00b4410 con 0x7fa6000af7d0 2024-04-17T08:46:27.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.558+0000 7fa604a00640 1 -- 172.21.15.152:0/1239351533 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa60009c470 con 0x7fa6000af7d0 2024-04-17T08:46:27.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.558+0000 7fa5f7e00640 1 -- 172.21.15.152:0/1239351533 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f00b0040 con 0x7fa6000af7d0 2024-04-17T08:46:27.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.558+0000 7fa604a00640 1 -- 172.21.15.152:0/1239351533 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa60009c710 con 0x7fa6000af7d0 2024-04-17T08:46:27.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.558+0000 7fa604a00640 1 -- 172.21.15.152:0/1239351533 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa600075be0 con 0x7fa6000af7d0 2024-04-17T08:46:27.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.558+0000 7fa5f7e00640 1 -- 172.21.15.152:0/1239351533 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa5f00bb020 con 0x7fa6000af7d0 2024-04-17T08:46:27.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.558+0000 7fa5f7e00640 1 --2- 172.21.15.152:0/1239351533 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fa5dc068380 0x7fa5dc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:27.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.558+0000 7fa5f7e00640 1 -- 172.21.15.152:0/1239351533 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fa5f011ffa0 con 0x7fa6000af7d0 2024-04-17T08:46:27.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.562+0000 7fa5f6a00640 1 --2- 172.21.15.152:0/1239351533 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fa5dc068380 0x7fa5dc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:27.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.562+0000 7fa5f6a00640 1 --2- 172.21.15.152:0/1239351533 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fa5dc068380 0x7fa5dc06a840 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa600099280 tx=0x7fa5e8007d80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:27.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.566+0000 7fa5f7e00640 1 -- 172.21.15.152:0/1239351533 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fa5f00c2030 con 0x7fa6000af7d0 2024-04-17T08:46:27.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.722+0000 7fa604a00640 1 -- 172.21.15.152:0/1239351533 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa6000af5b0 con 0x7fa6000af7d0 2024-04-17T08:46:27.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.722+0000 7fa5f7e00640 1 -- 172.21.15.152:0/1239351533 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7fa5f0016090 con 0x7fa6000af7d0 2024-04-17T08:46:27.723 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2024-04-17T08:46:27.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.722+0000 7fa604a00640 1 -- 172.21.15.152:0/1239351533 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fa5dc068380 msgr2=0x7fa5dc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:27.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.722+0000 7fa604a00640 1 --2- 172.21.15.152:0/1239351533 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fa5dc068380 0x7fa5dc06a840 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa600099280 tx=0x7fa5e8007d80 comp rx=0 tx=0).stop 2024-04-17T08:46:27.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.722+0000 7fa604a00640 1 -- 172.21.15.152:0/1239351533 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6000af7d0 msgr2=0x7fa60014b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:27.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.722+0000 7fa604a00640 1 --2- 172.21.15.152:0/1239351533 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6000af7d0 0x7fa60014b320 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa5f00190b0 tx=0x7fa5f0019240 comp rx=0 tx=0).stop 2024-04-17T08:46:27.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.722+0000 7fa604a00640 1 -- 172.21.15.152:0/1239351533 shutdown_connections 2024-04-17T08:46:27.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.722+0000 7fa604a00640 1 --2- 172.21.15.152:0/1239351533 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa60015c170 0x7fa6001486a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:27.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.722+0000 7fa604a00640 1 --2- 172.21.15.152:0/1239351533 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fa5dc068380 0x7fa5dc06a840 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:27.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.722+0000 7fa604a00640 1 --2- 172.21.15.152:0/1239351533 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa6000d0810 0x7fa600099a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:27.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.722+0000 7fa604a00640 1 --2- 172.21.15.152:0/1239351533 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6000af7d0 0x7fa60014b320 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:27.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.722+0000 7fa604a00640 1 -- 172.21.15.152:0/1239351533 >> 172.21.15.152:0/1239351533 conn(0x7fa6000b5280 msgr2=0x7fa60015c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:27.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.722+0000 7fa604a00640 1 -- 172.21.15.152:0/1239351533 shutdown_connections 2024-04-17T08:46:27.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.722+0000 7fa604a00640 1 -- 172.21.15.152:0/1239351533 wait complete. 2024-04-17T08:46:27.743 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T08:46:27.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.878+0000 7f2847a00640 1 Processor -- start 2024-04-17T08:46:27.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.878+0000 7f2847a00640 1 -- start start 2024-04-17T08:46:27.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.878+0000 7f2847a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f284015e820 0x7f28400d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:27.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.878+0000 7f2847a00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f28400b66a0 0x7f28400ae150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:27.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.878+0000 7f2847a00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28400ceea0 con 0x7f28400b0b10 2024-04-17T08:46:27.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.878+0000 7f2847a00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f28400cf1b0 con 0x7f28400b66a0 2024-04-17T08:46:27.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.878+0000 7f2847a00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f28400cf400 con 0x7f284015e820 2024-04-17T08:46:27.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.878+0000 7f2845a00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f28400b66a0 0x7f28400ae150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:27.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.878+0000 7f283fe00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f28400b0b10 0x7f28400b5f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:55084/0 (socket says 172.21.15.152:55084) 2024-04-17T08:46:27.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.878+0000 7f2845a00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f28400b66a0 0x7f28400ae150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54410/0 (socket says 172.21.15.152:54410) 2024-04-17T08:46:27.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.878+0000 7f283fe00640 1 -- 172.21.15.152:0/3972767254 learned_addr learned my addr 172.21.15.152:0/3972767254 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:46:27.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.878+0000 7f2845000640 1 --2- 172.21.15.152:0/3972767254 >> v2:172.21.15.196:3300/0 conn(0x7f284015e820 0x7f28400d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:27.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.878+0000 7f2845a00640 1 -- 172.21.15.152:0/3972767254 >> v2:172.21.15.196:3300/0 conn(0x7f284015e820 msgr2=0x7f28400d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:27.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.878+0000 7f2845a00640 1 --2- 172.21.15.152:0/3972767254 >> v2:172.21.15.196:3300/0 conn(0x7f284015e820 0x7f28400d04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:27.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.878+0000 7f2845a00640 1 -- 172.21.15.152:0/3972767254 >> v1:172.21.15.152:6789/0 conn(0x7f28400b0b10 legacy=0x7f28400b5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:27.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.878+0000 7f2845a00640 1 -- 172.21.15.152:0/3972767254 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28400cf6e0 con 0x7f28400b66a0 2024-04-17T08:46:27.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.882+0000 7f2845a00640 1 --2- 172.21.15.152:0/3972767254 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28400b66a0 0x7f28400ae150 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f284004ff40 tx=0x7f283801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d5a5f32fad86691 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:27.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.882+0000 7f283f400640 1 -- 172.21.15.152:0/3972767254 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28380b2070 con 0x7f28400b66a0 2024-04-17T08:46:27.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.882+0000 7f283f400640 1 -- 172.21.15.152:0/3972767254 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28380a58e0 con 0x7f28400b66a0 2024-04-17T08:46:27.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.882+0000 7f283f400640 1 -- 172.21.15.152:0/3972767254 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28380a5cb0 con 0x7f28400b66a0 2024-04-17T08:46:27.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.882+0000 7f2847a00640 1 -- 172.21.15.152:0/3972767254 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28400b66a0 msgr2=0x7f28400ae150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:27.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.882+0000 7f2847a00640 1 --2- 172.21.15.152:0/3972767254 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28400b66a0 0x7f28400ae150 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f284004ff40 tx=0x7f283801c930 comp rx=0 tx=0).stop 2024-04-17T08:46:27.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.882+0000 7f2847a00640 1 -- 172.21.15.152:0/3972767254 shutdown_connections 2024-04-17T08:46:27.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.882+0000 7f2847a00640 1 --2- 172.21.15.152:0/3972767254 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28400b66a0 0x7f28400ae150 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:27.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.882+0000 7f2847a00640 1 --2- 172.21.15.152:0/3972767254 >> v2:172.21.15.196:3300/0 conn(0x7f284015e820 0x7f28400d04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:27.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.882+0000 7f2847a00640 1 -- 172.21.15.152:0/3972767254 >> 172.21.15.152:0/3972767254 conn(0x7f28400cddb0 msgr2=0x7f28400ce1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:27.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.882+0000 7f2847a00640 1 -- 172.21.15.152:0/3972767254 shutdown_connections 2024-04-17T08:46:27.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.882+0000 7f2847a00640 1 -- 172.21.15.152:0/3972767254 wait complete. 2024-04-17T08:46:27.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.886+0000 7f2847a00640 1 Processor -- start 2024-04-17T08:46:27.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.886+0000 7f2847a00640 1 -- start start 2024-04-17T08:46:27.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.886+0000 7f2847a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28400b0b10 0x7f284006e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:27.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.886+0000 7f2847a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f28400b66a0 0x7f2840160310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:27.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.886+0000 7f2847a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f284015e820 0x7f284015f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:27.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.886+0000 7f2847a00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f28400d0b60 con 0x7f28400b0b10 2024-04-17T08:46:27.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.886+0000 7f2847a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f28400d09e0 con 0x7f28400b66a0 2024-04-17T08:46:27.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.886+0000 7f2847a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f28400aeaa0 con 0x7f284015e820 2024-04-17T08:46:27.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.886+0000 7f2845000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28400b0b10 0x7f284006e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:27.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.886+0000 7f2845000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28400b0b10 0x7f284006e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54412/0 (socket says 172.21.15.152:54412) 2024-04-17T08:46:27.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.886+0000 7f2845000640 1 -- 172.21.15.152:0/2570125332 learned_addr learned my addr 172.21.15.152:0/2570125332 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:27.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.886+0000 7f283fe00640 1 --2- 172.21.15.152:0/2570125332 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f28400b66a0 0x7f2840160310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:27.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.886+0000 7f2845a00640 1 --2- 172.21.15.152:0/2570125332 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f284015e820 0x7f284015f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:27.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.886+0000 7f2845000640 1 -- 172.21.15.152:0/2570125332 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f284015e820 msgr2=0x7f284015f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:27.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.886+0000 7f2845000640 1 --2- 172.21.15.152:0/2570125332 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f284015e820 0x7f284015f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:27.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.886+0000 7f2845000640 1 -- 172.21.15.152:0/2570125332 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f28400b66a0 msgr2=0x7f2840160310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:27.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.886+0000 7f2845000640 1 --2- 172.21.15.152:0/2570125332 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f28400b66a0 0x7f2840160310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:27.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.886+0000 7f2845000640 1 -- 172.21.15.152:0/2570125332 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2840160cf0 con 0x7f28400b0b10 2024-04-17T08:46:27.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.886+0000 7f2845000640 1 --2- 172.21.15.152:0/2570125332 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28400b0b10 0x7f284006e2d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f282800e870 tx=0x7f282800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:27.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.886+0000 7f283cc00640 1 -- 172.21.15.152:0/2570125332 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2828017070 con 0x7f28400b0b10 2024-04-17T08:46:27.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.886+0000 7f283cc00640 1 -- 172.21.15.152:0/2570125332 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f282800c940 con 0x7f28400b0b10 2024-04-17T08:46:27.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.886+0000 7f283cc00640 1 -- 172.21.15.152:0/2570125332 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f282800ccf0 con 0x7f28400b0b10 2024-04-17T08:46:27.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.886+0000 7f2847a00640 1 -- 172.21.15.152:0/2570125332 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f284006d7f0 con 0x7f28400b0b10 2024-04-17T08:46:27.893 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.886+0000 7f2847a00640 1 -- 172.21.15.152:0/2570125332 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f284006ddb0 con 0x7f28400b0b10 2024-04-17T08:46:27.893 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.886+0000 7f2847a00640 1 -- 172.21.15.152:0/2570125332 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f284006e870 con 0x7f28400b0b10 2024-04-17T08:46:27.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.890+0000 7f283cc00640 1 -- 172.21.15.152:0/2570125332 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f282801a070 con 0x7f28400b0b10 2024-04-17T08:46:27.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.890+0000 7f283cc00640 1 --2- 172.21.15.152:0/2570125332 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f281c0683b0 0x7f281c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:27.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.890+0000 7f283cc00640 1 -- 172.21.15.152:0/2570125332 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f2828086990 con 0x7f28400b0b10 2024-04-17T08:46:27.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.890+0000 7f283fe00640 1 --2- 172.21.15.152:0/2570125332 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f281c0683b0 0x7f281c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:27.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.890+0000 7f283fe00640 1 --2- 172.21.15.152:0/2570125332 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f281c0683b0 0x7f281c06a870 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f284015ba60 tx=0x7f2830009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:27.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:27.894+0000 7f283cc00640 1 -- 172.21.15.152:0/2570125332 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f2828057200 con 0x7f28400b0b10 2024-04-17T08:46:28.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:28.082+0000 7f2847a00640 1 -- 172.21.15.152:0/2570125332 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2840068a30 con 0x7f28400b0b10 2024-04-17T08:46:28.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:28.082+0000 7f283cc00640 1 -- 172.21.15.152:0/2570125332 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1395 (secure 0 0 0) 0x7f2828056b00 con 0x7f28400b0b10 2024-04-17T08:46:28.085 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:46:28.085 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/2491486613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2491486613},{"type":"v1","addr":"172.21.15.152:6836","nonce":2491486613}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-17T08:46:28.085 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 2 2024-04-17T08:46:28.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:28.086+0000 7f2847a00640 1 -- 172.21.15.152:0/2570125332 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f281c0683b0 msgr2=0x7f281c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:28.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:28.086+0000 7f2847a00640 1 --2- 172.21.15.152:0/2570125332 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f281c0683b0 0x7f281c06a870 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f284015ba60 tx=0x7f2830009040 comp rx=0 tx=0).stop 2024-04-17T08:46:28.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:28.086+0000 7f2847a00640 1 -- 172.21.15.152:0/2570125332 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28400b0b10 msgr2=0x7f284006e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:28.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:28.086+0000 7f2847a00640 1 --2- 172.21.15.152:0/2570125332 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28400b0b10 0x7f284006e2d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f282800e870 tx=0x7f282800ec70 comp rx=0 tx=0).stop 2024-04-17T08:46:28.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:28.086+0000 7f2847a00640 1 -- 172.21.15.152:0/2570125332 shutdown_connections 2024-04-17T08:46:28.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:28.086+0000 7f2847a00640 1 --2- 172.21.15.152:0/2570125332 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f281c0683b0 0x7f281c06a870 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:28.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:28.086+0000 7f2847a00640 1 --2- 172.21.15.152:0/2570125332 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f284015e820 0x7f284015f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:28.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:28.086+0000 7f2847a00640 1 --2- 172.21.15.152:0/2570125332 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f28400b66a0 0x7f2840160310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:28.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:28.086+0000 7f2847a00640 1 --2- 172.21.15.152:0/2570125332 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28400b0b10 0x7f284006e2d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:28.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:28.086+0000 7f2847a00640 1 -- 172.21.15.152:0/2570125332 >> 172.21.15.152:0/2570125332 conn(0x7f28400cddb0 msgr2=0x7f28401611a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:28.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:28.086+0000 7f2847a00640 1 -- 172.21.15.152:0/2570125332 shutdown_connections 2024-04-17T08:46:28.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:28.086+0000 7f2847a00640 1 -- 172.21.15.152:0/2570125332 wait complete. 2024-04-17T08:46:30.109 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T08:46:30.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.258+0000 7f7f1bc00640 1 Processor -- start 2024-04-17T08:46:30.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.258+0000 7f7f1bc00640 1 -- start start 2024-04-17T08:46:30.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.258+0000 7f7f1bc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7f1406f980 0x7f7f14072530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:30.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.258+0000 7f7f1bc00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f1415bfd0 con 0x7f7f140d0360 2024-04-17T08:46:30.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.258+0000 7f7f1bc00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f1415c260 con 0x7f7f140af670 2024-04-17T08:46:30.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.258+0000 7f7f1bc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f7f1415c820 con 0x7f7f1406f980 2024-04-17T08:46:30.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.258+0000 7f7f19c00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f7f140d0360 0x7f7f1406dc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:39740/0 (socket says 172.21.15.152:39740) 2024-04-17T08:46:30.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.258+0000 7f7f19c00640 1 -- 172.21.15.152:0/2621955688 learned_addr learned my addr 172.21.15.152:0/2621955688 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:46:30.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.258+0000 7f7f13e00640 1 --2- 172.21.15.152:0/2621955688 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7f1406f980 0x7f7f14072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:30.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.258+0000 7f7f13400640 1 -- 172.21.15.152:0/2621955688 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3960976516 0 0) 0x7f7f1415bfd0 con 0x7f7f140d0360 2024-04-17T08:46:30.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.258+0000 7f7f13400640 1 -- 172.21.15.152:0/2621955688 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ef8003530 con 0x7f7f140d0360 2024-04-17T08:46:30.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.262+0000 7f7f13400640 1 -- 172.21.15.152:0/2621955688 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2355426117 0 0) 0x7f7f1415c260 con 0x7f7f140af670 2024-04-17T08:46:30.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.262+0000 7f7f13400640 1 -- 172.21.15.152:0/2621955688 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f1415bfd0 con 0x7f7f140af670 2024-04-17T08:46:30.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.262+0000 7f7f13400640 1 -- 172.21.15.152:0/2621955688 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3775055299 0 0) 0x7f7ef8003530 con 0x7f7f140d0360 2024-04-17T08:46:30.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.262+0000 7f7f13400640 1 -- 172.21.15.152:0/2621955688 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7f1406f980 msgr2=0x7f7f14072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:30.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.262+0000 7f7f13400640 1 --2- 172.21.15.152:0/2621955688 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7f1406f980 0x7f7f14072530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:30.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.262+0000 7f7f13400640 1 -- 172.21.15.152:0/2621955688 >> v1:172.21.15.196:6789/0 conn(0x7f7f140af670 legacy=0x7f7f1415b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:30.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.262+0000 7f7f13400640 1 -- 172.21.15.152:0/2621955688 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f1415c540 con 0x7f7f140d0360 2024-04-17T08:46:30.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.262+0000 7f7f13400640 1 -- 172.21.15.152:0/2621955688 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2973887244 0 0) 0x7f7f0c001980 con 0x7f7f140d0360 2024-04-17T08:46:30.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.262+0000 7f7f13400640 1 -- 172.21.15.152:0/2621955688 >> v1:172.21.15.152:6789/0 conn(0x7f7f140d0360 legacy=0x7f7f1406dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:30.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.262+0000 7f7f13400640 1 --2- 172.21.15.152:0/2621955688 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7f1406f980 0x7f7ef8003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:30.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.262+0000 7f7f13400640 1 --2- 172.21.15.152:0/2621955688 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ef8004130 0x7f7ef8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:30.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.262+0000 7f7f13400640 1 --2- 172.21.15.152:0/2621955688 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ef8004d50 0x7f7ef80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:30.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.262+0000 7f7f13400640 1 -- 172.21.15.152:0/2621955688 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7f1415c820 con 0x7f7ef8004130 2024-04-17T08:46:30.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.262+0000 7f7f13400640 1 -- 172.21.15.152:0/2621955688 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef800bb90 con 0x7f7ef8004d50 2024-04-17T08:46:30.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.262+0000 7f7f13400640 1 -- 172.21.15.152:0/2621955688 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f7ef800bd90 con 0x7f7f1406f980 2024-04-17T08:46:30.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.262+0000 7f7f13e00640 1 --2- 172.21.15.152:0/2621955688 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ef8004130 0x7f7ef8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:30.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.262+0000 7f7f19c00640 1 --2- 172.21.15.152:0/2621955688 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ef8004d50 0x7f7ef80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:30.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.262+0000 7f7f19200640 1 --2- 172.21.15.152:0/2621955688 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7f1406f980 0x7f7ef8003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:30.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.262+0000 7f7f13e00640 1 -- 172.21.15.152:0/2621955688 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7f1406f980 msgr2=0x7f7ef8003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:30.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.262+0000 7f7f13e00640 1 --2- 172.21.15.152:0/2621955688 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7f1406f980 0x7f7ef8003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:30.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.262+0000 7f7f13e00640 1 -- 172.21.15.152:0/2621955688 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ef8004d50 msgr2=0x7f7ef80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:30.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.262+0000 7f7f13e00640 1 --2- 172.21.15.152:0/2621955688 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ef8004d50 0x7f7ef80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:30.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.262+0000 7f7f13e00640 1 -- 172.21.15.152:0/2621955688 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ef8003530 con 0x7f7ef8004130 2024-04-17T08:46:30.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.262+0000 7f7f13e00640 1 --2- 172.21.15.152:0/2621955688 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ef8004130 0x7f7ef8004810 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7efc009ab0 tx=0x7f7efc01ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4615963b4e1eec8a server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:30.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.266+0000 7f7f13400640 1 -- 172.21.15.152:0/2621955688 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7efc0b2070 con 0x7f7ef8004130 2024-04-17T08:46:30.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.266+0000 7f7f13400640 1 -- 172.21.15.152:0/2621955688 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7efc0a5610 con 0x7f7ef8004130 2024-04-17T08:46:30.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.266+0000 7f7f13400640 1 -- 172.21.15.152:0/2621955688 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7efc0096b0 con 0x7f7ef8004130 2024-04-17T08:46:30.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.266+0000 7f7f1bc00640 1 -- 172.21.15.152:0/2621955688 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ef8004130 msgr2=0x7f7ef8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:30.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.266+0000 7f7f1bc00640 1 --2- 172.21.15.152:0/2621955688 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ef8004130 0x7f7ef8004810 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7efc009ab0 tx=0x7f7efc01ca20 comp rx=0 tx=0).stop 2024-04-17T08:46:30.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.266+0000 7f7f19c00640 1 -- 172.21.15.152:0/2621955688 reap_dead start 2024-04-17T08:46:30.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.266+0000 7f7f1bc00640 1 -- 172.21.15.152:0/2621955688 shutdown_connections 2024-04-17T08:46:30.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.266+0000 7f7f1bc00640 1 -- 172.21.15.152:0/2621955688 >> 172.21.15.152:0/2621955688 conn(0x7f7f140b3350 msgr2=0x7f7f140b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:30.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.266+0000 7f7f1bc00640 1 -- 172.21.15.152:0/2621955688 shutdown_connections 2024-04-17T08:46:30.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.266+0000 7f7f1bc00640 1 -- 172.21.15.152:0/2621955688 wait complete. 2024-04-17T08:46:30.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.266+0000 7f7f1bc00640 1 Processor -- start 2024-04-17T08:46:30.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.266+0000 7f7f1bc00640 1 -- start start 2024-04-17T08:46:30.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.266+0000 7f7f1bc00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ef8004130 0x7f7f14149800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:30.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.266+0000 7f7f1bc00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f140adea0 0x7f7f141facc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:30.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.266+0000 7f7f1bc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7f141fb200 0x7f7f141fb690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:30.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.266+0000 7f7f1bc00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7f140d0b80 con 0x7f7f140adea0 2024-04-17T08:46:30.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.266+0000 7f7f1bc00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f7f1406b9b0 con 0x7f7ef8004130 2024-04-17T08:46:30.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.266+0000 7f7f1bc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f7f14156f70 con 0x7f7f141fb200 2024-04-17T08:46:30.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.266+0000 7f7f13e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f140adea0 0x7f7f141facc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:30.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.266+0000 7f7f13e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f140adea0 0x7f7f141facc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40764/0 (socket says 172.21.15.152:40764) 2024-04-17T08:46:30.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.266+0000 7f7f13e00640 1 -- 172.21.15.152:0/1964049419 learned_addr learned my addr 172.21.15.152:0/1964049419 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:30.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.266+0000 7f7f13e00640 1 -- 172.21.15.152:0/1964049419 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7f141fb200 msgr2=0x7f7f141fb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:30.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.266+0000 7f7f13e00640 1 --2- 172.21.15.152:0/1964049419 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7f141fb200 0x7f7f141fb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:30.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.266+0000 7f7f13e00640 1 -- 172.21.15.152:0/1964049419 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ef8004130 msgr2=0x7f7f14149800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:30.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.266+0000 7f7f13e00640 1 --2- 172.21.15.152:0/1964049419 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ef8004130 0x7f7f14149800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:30.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.266+0000 7f7f13e00640 1 -- 172.21.15.152:0/1964049419 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f14152c00 con 0x7f7f140adea0 2024-04-17T08:46:30.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.270+0000 7f7f13e00640 1 --2- 172.21.15.152:0/1964049419 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f140adea0 0x7f7f141facc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7efc0b0040 tx=0x7f7ef8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:30.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.270+0000 7f7f10c00640 1 -- 172.21.15.152:0/1964049419 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7efc0bc030 con 0x7f7f140adea0 2024-04-17T08:46:30.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.270+0000 7f7f10c00640 1 -- 172.21.15.152:0/1964049419 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7efc00f000 con 0x7f7f140adea0 2024-04-17T08:46:30.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.270+0000 7f7f10c00640 1 -- 172.21.15.152:0/1964049419 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7efc0b2040 con 0x7f7f140adea0 2024-04-17T08:46:30.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.270+0000 7f7f1bc00640 1 -- 172.21.15.152:0/1964049419 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f14152ee0 con 0x7f7f140adea0 2024-04-17T08:46:30.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.270+0000 7f7f1bc00640 1 -- 172.21.15.152:0/1964049419 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f141574a0 con 0x7f7f140adea0 2024-04-17T08:46:30.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.270+0000 7f7f1bc00640 1 -- 172.21.15.152:0/1964049419 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f14068a30 con 0x7f7f140adea0 2024-04-17T08:46:30.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.270+0000 7f7f10c00640 1 -- 172.21.15.152:0/1964049419 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7efc0bf070 con 0x7f7f140adea0 2024-04-17T08:46:30.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.270+0000 7f7f10c00640 1 --2- 172.21.15.152:0/1964049419 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f7ef00683b0 0x7f7ef006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:30.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.270+0000 7f7f10c00640 1 -- 172.21.15.152:0/1964049419 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f7efc1201e0 con 0x7f7f140adea0 2024-04-17T08:46:30.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.270+0000 7f7f19200640 1 --2- 172.21.15.152:0/1964049419 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f7ef00683b0 0x7f7ef006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:30.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.270+0000 7f7f19200640 1 --2- 172.21.15.152:0/1964049419 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f7ef00683b0 0x7f7ef006a870 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7f04001780 tx=0x7f7f04009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:30.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.274+0000 7f7f10c00640 1 -- 172.21.15.152:0/1964049419 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f7efc0c7020 con 0x7f7f140adea0 2024-04-17T08:46:30.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.466+0000 7f7f1bc00640 1 -- 172.21.15.152:0/1964049419 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7f140cf8c0 con 0x7f7f140adea0 2024-04-17T08:46:30.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.466+0000 7f7f10c00640 1 -- 172.21.15.152:0/1964049419 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3876 (secure 0 0 0) 0x7f7efc016760 con 0x7f7f140adea0 2024-04-17T08:46:30.469 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:46:30.469 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6834/2461981726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":2461981726},{"type":"v1","addr":"172.21.15.196:6834","nonce":2461981726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6835/3397289430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6833","nonce":3397289430},{"type":"v1","addr":"172.21.15.196:6835","nonce":3397289430}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/2491486613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2491486613},{"type":"v1","addr":"172.21.15.152:6836","nonce":2491486613}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/3890159871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":3890159871},{"type":"v1","addr":"172.21.15.152:6837","nonce":3890159871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-17T08:46:30.469 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 3 2024-04-17T08:46:30.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.470+0000 7f7f1bc00640 1 -- 172.21.15.152:0/1964049419 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f7ef00683b0 msgr2=0x7f7ef006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:30.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.470+0000 7f7f1bc00640 1 --2- 172.21.15.152:0/1964049419 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f7ef00683b0 0x7f7ef006a870 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7f04001780 tx=0x7f7f04009040 comp rx=0 tx=0).stop 2024-04-17T08:46:30.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.470+0000 7f7f1bc00640 1 -- 172.21.15.152:0/1964049419 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f140adea0 msgr2=0x7f7f141facc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:30.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.470+0000 7f7f1bc00640 1 --2- 172.21.15.152:0/1964049419 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f140adea0 0x7f7f141facc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7efc0b0040 tx=0x7f7ef8005840 comp rx=0 tx=0).stop 2024-04-17T08:46:30.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.470+0000 7f7f1bc00640 1 -- 172.21.15.152:0/1964049419 shutdown_connections 2024-04-17T08:46:30.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.470+0000 7f7f1bc00640 1 --2- 172.21.15.152:0/1964049419 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f7ef00683b0 0x7f7ef006a870 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:30.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.470+0000 7f7f1bc00640 1 --2- 172.21.15.152:0/1964049419 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7f141fb200 0x7f7f141fb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:30.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.470+0000 7f7f1bc00640 1 --2- 172.21.15.152:0/1964049419 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f140adea0 0x7f7f141facc0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:30.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.470+0000 7f7f1bc00640 1 --2- 172.21.15.152:0/1964049419 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ef8004130 0x7f7f14149800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:30.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.470+0000 7f7f1bc00640 1 -- 172.21.15.152:0/1964049419 >> 172.21.15.152:0/1964049419 conn(0x7f7f140b3350 msgr2=0x7f7f14072eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:30.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.470+0000 7f7f1bc00640 1 -- 172.21.15.152:0/1964049419 shutdown_connections 2024-04-17T08:46:30.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.470+0000 7f7f1bc00640 1 -- 172.21.15.152:0/1964049419 wait complete. 2024-04-17T08:46:30.491 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T08:46:30.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.622+0000 7ff88e800640 1 Processor -- start 2024-04-17T08:46:30.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.622+0000 7ff88e800640 1 -- start start 2024-04-17T08:46:30.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.626+0000 7ff88e800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ff8880af670 0x7ff88815b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:30.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.626+0000 7ff88e800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff8880d0360 0x7ff8880d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:30.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.626+0000 7ff88e800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff888072c40 con 0x7ff88806f980 2024-04-17T08:46:30.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.626+0000 7ff88e800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7ff88815c820 con 0x7ff8880af670 2024-04-17T08:46:30.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.626+0000 7ff88e800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7ff88815c260 con 0x7ff8880d0360 2024-04-17T08:46:30.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.626+0000 7ff887400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ff8880af670 0x7ff88815b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:30.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.626+0000 7ff887e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff8880d0360 0x7ff8880d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:30.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.626+0000 7ff887e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff8880d0360 0x7ff8880d07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.152:53294/0 (socket says 172.21.15.152:53294) 2024-04-17T08:46:30.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.626+0000 7ff887400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ff8880af670 0x7ff88815b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.152:55352/0 (socket says 172.21.15.152:55352) 2024-04-17T08:46:30.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.626+0000 7ff887e00640 1 -- 172.21.15.152:0/2620519315 learned_addr learned my addr 172.21.15.152:0/2620519315 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:30.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.626+0000 7ff887e00640 1 -- 172.21.15.152:0/2620519315 >> v2:172.21.15.196:3300/0 conn(0x7ff8880af670 msgr2=0x7ff88815b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:30.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.626+0000 7ff887e00640 1 --2- 172.21.15.152:0/2620519315 >> v2:172.21.15.196:3300/0 conn(0x7ff8880af670 0x7ff88815b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:30.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.626+0000 7ff886000640 1 -- 172.21.15.152:0/2620519315 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1982454324 0 0) 0x7ff888072c40 con 0x7ff88806f980 2024-04-17T08:46:30.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.626+0000 7ff887e00640 1 -- 172.21.15.152:0/2620519315 >> v1:172.21.15.196:6789/0 conn(0x7ff88806f980 legacy=0x7ff888072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:30.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.626+0000 7ff887e00640 1 -- 172.21.15.152:0/2620519315 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff88815c540 con 0x7ff8880d0360 2024-04-17T08:46:30.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.630+0000 7ff887e00640 1 --2- 172.21.15.152:0/2620519315 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff8880d0360 0x7ff8880d07f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff880009e50 tx=0x7ff88001c9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=180a232ba2ee0908 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:30.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.630+0000 7ff886000640 1 -- 172.21.15.152:0/2620519315 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8800a5750 con 0x7ff8880d0360 2024-04-17T08:46:30.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.630+0000 7ff886000640 1 -- 172.21.15.152:0/2620519315 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8800a58f0 con 0x7ff8880d0360 2024-04-17T08:46:30.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.630+0000 7ff886000640 1 -- 172.21.15.152:0/2620519315 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8800a5cc0 con 0x7ff8880d0360 2024-04-17T08:46:30.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.630+0000 7ff88e800640 1 -- 172.21.15.152:0/2620519315 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff8880d0360 msgr2=0x7ff8880d07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:30.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.630+0000 7ff88e800640 1 --2- 172.21.15.152:0/2620519315 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff8880d0360 0x7ff8880d07f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff880009e50 tx=0x7ff88001c9a0 comp rx=0 tx=0).stop 2024-04-17T08:46:30.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.630+0000 7ff88e800640 1 -- 172.21.15.152:0/2620519315 shutdown_connections 2024-04-17T08:46:30.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.630+0000 7ff88e800640 1 --2- 172.21.15.152:0/2620519315 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff8880d0360 0x7ff8880d07f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:30.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.630+0000 7ff88e800640 1 --2- 172.21.15.152:0/2620519315 >> v2:172.21.15.196:3300/0 conn(0x7ff8880af670 0x7ff88815b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:30.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.630+0000 7ff88e800640 1 -- 172.21.15.152:0/2620519315 >> 172.21.15.152:0/2620519315 conn(0x7ff8880b3350 msgr2=0x7ff8880b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:30.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.630+0000 7ff88e800640 1 -- 172.21.15.152:0/2620519315 shutdown_connections 2024-04-17T08:46:30.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.630+0000 7ff88e800640 1 -- 172.21.15.152:0/2620519315 wait complete. 2024-04-17T08:46:30.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.630+0000 7ff88e800640 1 Processor -- start 2024-04-17T08:46:30.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.630+0000 7ff88e800640 1 -- start start 2024-04-17T08:46:30.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.634+0000 7ff88e800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff88806f980 0x7ff8881fa180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:30.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.634+0000 7ff88e800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8880af670 0x7ff88815d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:30.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.634+0000 7ff88e800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff8880d0360 0x7ff88815dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:30.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.634+0000 7ff88e800640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff88815bf80 con 0x7ff8880af670 2024-04-17T08:46:30.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.634+0000 7ff88e800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff88815be00 con 0x7ff88806f980 2024-04-17T08:46:30.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.634+0000 7ff88e800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7ff88806b9b0 con 0x7ff8880d0360 2024-04-17T08:46:30.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.634+0000 7ff886a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8880af670 0x7ff88815d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:30.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.634+0000 7ff886a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8880af670 0x7ff88815d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40776/0 (socket says 172.21.15.152:40776) 2024-04-17T08:46:30.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.634+0000 7ff886a00640 1 -- 172.21.15.152:0/513672971 learned_addr learned my addr 172.21.15.152:0/513672971 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:30.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.634+0000 7ff887400640 1 --2- 172.21.15.152:0/513672971 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff88806f980 0x7ff8881fa180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:30.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.634+0000 7ff887e00640 1 --2- 172.21.15.152:0/513672971 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff8880d0360 0x7ff88815dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:30.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.634+0000 7ff886a00640 1 -- 172.21.15.152:0/513672971 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff8880d0360 msgr2=0x7ff88815dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:30.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.634+0000 7ff886a00640 1 --2- 172.21.15.152:0/513672971 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff8880d0360 0x7ff88815dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:30.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.634+0000 7ff886a00640 1 -- 172.21.15.152:0/513672971 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff88806f980 msgr2=0x7ff8881fa180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:30.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.634+0000 7ff886a00640 1 --2- 172.21.15.152:0/513672971 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff88806f980 0x7ff8881fa180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:30.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.634+0000 7ff886a00640 1 -- 172.21.15.152:0/513672971 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff888169100 con 0x7ff8880af670 2024-04-17T08:46:30.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.634+0000 7ff887e00640 1 --2- 172.21.15.152:0/513672971 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff8880d0360 0x7ff88815dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:46:30.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.634+0000 7ff886a00640 1 --2- 172.21.15.152:0/513672971 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8880af670 0x7ff88815d6e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff87400c520 tx=0x7ff87400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:30.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.634+0000 7ff87f400640 1 -- 172.21.15.152:0/513672971 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff874017070 con 0x7ff8880af670 2024-04-17T08:46:30.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.634+0000 7ff87f400640 1 -- 172.21.15.152:0/513672971 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff874003600 con 0x7ff8880af670 2024-04-17T08:46:30.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.634+0000 7ff88e800640 1 -- 172.21.15.152:0/513672971 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8881693e0 con 0x7ff8880af670 2024-04-17T08:46:30.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.634+0000 7ff87f400640 1 -- 172.21.15.152:0/513672971 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8740039f0 con 0x7ff8880af670 2024-04-17T08:46:30.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.634+0000 7ff88e800640 1 -- 172.21.15.152:0/513672971 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8881699a0 con 0x7ff8880af670 2024-04-17T08:46:30.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.634+0000 7ff88e800640 1 -- 172.21.15.152:0/513672971 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff888068a30 con 0x7ff8880af670 2024-04-17T08:46:30.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.638+0000 7ff87f400640 1 -- 172.21.15.152:0/513672971 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff87401a070 con 0x7ff8880af670 2024-04-17T08:46:30.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.638+0000 7ff87f400640 1 --2- 172.21.15.152:0/513672971 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7ff8680683b0 0x7ff86806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:30.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.638+0000 7ff87f400640 1 -- 172.21.15.152:0/513672971 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7ff874085a80 con 0x7ff8880af670 2024-04-17T08:46:30.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.638+0000 7ff887400640 1 --2- 172.21.15.152:0/513672971 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7ff8680683b0 0x7ff86806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:30.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.638+0000 7ff887400640 1 --2- 172.21.15.152:0/513672971 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7ff8680683b0 0x7ff86806a870 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff878009b60 tx=0x7ff878009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:30.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.642+0000 7ff87f400640 1 -- 172.21.15.152:0/513672971 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7ff874087e20 con 0x7ff8880af670 2024-04-17T08:46:30.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.798+0000 7ff88e800640 1 -- 172.21.15.152:0/513672971 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff8880cf4e0 con 0x7ff8880af670 2024-04-17T08:46:30.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.798+0000 7ff87f400640 1 -- 172.21.15.152:0/513672971 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12908 (secure 0 0 0) 0x7ff874055ca0 con 0x7ff8880af670 2024-04-17T08:46:30.801 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:46:30.801 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":16,"fsid":"ce68f82e-ec5f-4205-9fd5-bdfdf6ef31e2","created":"2024-04-17T08:46:08.353546+0000","modified":"2024-04-17T08:46:23.761360+0000","last_up_change":"2024-04-17T08:46:20.738799+0000","last_in_change":"2024-04-17T08:46:11.210050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T08:46:21.386856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"682f0192-187c-404e-bc7a-b6b4e23825e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6819","nonce":3603799291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6823","nonce":3603799291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6831","nonce":3603799291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6827","nonce":3603799291}]},"public_addr":"172.21.15.152:6819/3603799291","cluster_addr":"172.21.15.152:6823/3603799291","heartbeat_back_addr":"172.21.15.152:6831/3603799291","heartbeat_front_addr":"172.21.15.152:6827/3603799291","state":["exists","up"]},{"osd":1,"uuid":"f0fe8fef-60ec-4a39-83b6-2fa6a5adb0f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6801","nonce":4133383142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6803","nonce":4133383142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6807","nonce":4133383142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6805","nonce":4133383142}]},"public_addr":"172.21.15.152:6801/4133383142","cluster_addr":"172.21.15.152:6803/4133383142","heartbeat_back_addr":"172.21.15.152:6807/4133383142","heartbeat_front_addr":"172.21.15.152:6805/4133383142","state":["exists","up"]},{"osd":2,"uuid":"35f36d9c-5245-4431-a618-f4df0fa380ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6809","nonce":3826143898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6811","nonce":3826143898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6815","nonce":3826143898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6813","nonce":3826143898}]},"public_addr":"172.21.15.152:6809/3826143898","cluster_addr":"172.21.15.152:6811/3826143898","heartbeat_back_addr":"172.21.15.152:6815/3826143898","heartbeat_front_addr":"172.21.15.152:6813/3826143898","state":["exists","up"]},{"osd":3,"uuid":"96e56ca5-15b4-4895-9b79-da2c92043159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6818","nonce":165717826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6822","nonce":165717826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6830","nonce":165717826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6826","nonce":165717826}]},"public_addr":"172.21.15.152:6818/165717826","cluster_addr":"172.21.15.152:6822/165717826","heartbeat_back_addr":"172.21.15.152:6830/165717826","heartbeat_front_addr":"172.21.15.152:6826/165717826","state":["exists","up"]},{"osd":4,"uuid":"f5aa10a4-9ff9-41fe-a5c9-15326f982cc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6817","nonce":4080159297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6819","nonce":4080159297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6823","nonce":4080159297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6821","nonce":4080159297}]},"public_addr":"172.21.15.196:6817/4080159297","cluster_addr":"172.21.15.196:6819/4080159297","heartbeat_back_addr":"172.21.15.196:6823/4080159297","heartbeat_front_addr":"172.21.15.196:6821/4080159297","state":["exists","up"]},{"osd":5,"uuid":"42bab884-3476-47ae-ac65-935fa6e0f055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6801","nonce":3519444232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6803","nonce":3519444232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6807","nonce":3519444232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6805","nonce":3519444232}]},"public_addr":"172.21.15.196:6801/3519444232","cluster_addr":"172.21.15.196:6803/3519444232","heartbeat_back_addr":"172.21.15.196:6807/3519444232","heartbeat_front_addr":"172.21.15.196:6805/3519444232","state":["exists","up"]},{"osd":6,"uuid":"460b6167-f57b-4224-9c92-cfc9b80bbe99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6809","nonce":275739834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6811","nonce":275739834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6815","nonce":275739834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6813","nonce":275739834}]},"public_addr":"172.21.15.196:6809/275739834","cluster_addr":"172.21.15.196:6811/275739834","heartbeat_back_addr":"172.21.15.196:6815/275739834","heartbeat_front_addr":"172.21.15.196:6813/275739834","state":["exists","up"]},{"osd":7,"uuid":"d695643f-5e07-4e2a-a646-c06bd97b6650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6825","nonce":307626968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6827","nonce":307626968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6831","nonce":307626968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6829","nonce":307626968}]},"public_addr":"172.21.15.196:6825/307626968","cluster_addr":"172.21.15.196:6827/307626968","heartbeat_back_addr":"172.21.15.196:6831/307626968","heartbeat_front_addr":"172.21.15.196:6829/307626968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.293257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.964533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.248895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.010000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.832554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.743704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930171+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930962+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T08:46:30.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.802+0000 7ff88e800640 1 -- 172.21.15.152:0/513672971 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7ff8680683b0 msgr2=0x7ff86806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:30.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.802+0000 7ff88e800640 1 --2- 172.21.15.152:0/513672971 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7ff8680683b0 0x7ff86806a870 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff878009b60 tx=0x7ff878009190 comp rx=0 tx=0).stop 2024-04-17T08:46:30.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.802+0000 7ff88e800640 1 -- 172.21.15.152:0/513672971 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8880af670 msgr2=0x7ff88815d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:30.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.802+0000 7ff88e800640 1 --2- 172.21.15.152:0/513672971 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8880af670 0x7ff88815d6e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff87400c520 tx=0x7ff87400c9e0 comp rx=0 tx=0).stop 2024-04-17T08:46:30.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.802+0000 7ff88e800640 1 -- 172.21.15.152:0/513672971 shutdown_connections 2024-04-17T08:46:30.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.802+0000 7ff88e800640 1 --2- 172.21.15.152:0/513672971 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7ff8680683b0 0x7ff86806a870 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:30.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.802+0000 7ff88e800640 1 --2- 172.21.15.152:0/513672971 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff8880d0360 0x7ff88815dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:30.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.802+0000 7ff88e800640 1 --2- 172.21.15.152:0/513672971 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8880af670 0x7ff88815d6e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:30.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.802+0000 7ff88e800640 1 --2- 172.21.15.152:0/513672971 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff88806f980 0x7ff8881fa180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:30.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.802+0000 7ff88e800640 1 -- 172.21.15.152:0/513672971 >> 172.21.15.152:0/513672971 conn(0x7ff8880b3350 msgr2=0x7ff888164400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:30.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.802+0000 7ff88e800640 1 -- 172.21.15.152:0/513672971 shutdown_connections 2024-04-17T08:46:30.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.802+0000 7ff88e800640 1 -- 172.21.15.152:0/513672971 wait complete. 2024-04-17T08:46:30.822 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T08:46:21.386856+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-17T08:46:30.823 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T08:46:30.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.958+0000 7fbaaa800640 1 Processor -- start 2024-04-17T08:46:30.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.958+0000 7fbaaa800640 1 -- start start 2024-04-17T08:46:30.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.962+0000 7fbaaa800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fbaa4073020 0x7fbaa40d0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:30.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.962+0000 7fbaaa800640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fbaa406cac0 0x7fbaa406cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:30.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.962+0000 7fbaaa800640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaa406e3a0 con 0x7fbaa415b0f0 2024-04-17T08:46:30.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.962+0000 7fbaaa800640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fbaa40d0fc0 con 0x7fbaa406cac0 2024-04-17T08:46:30.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.962+0000 7fbaaa800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fbaa406e9a0 con 0x7fbaa4073020 2024-04-17T08:46:30.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.962+0000 7fbaa9400640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fbaa415b0f0 0x7fbaa40adc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:39742/0 (socket says 172.21.15.152:39742) 2024-04-17T08:46:30.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.962+0000 7fbaa9400640 1 -- 172.21.15.152:0/2388240195 learned_addr learned my addr 172.21.15.152:0/2388240195 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:46:30.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.962+0000 7fbaa9e00640 1 --2- 172.21.15.152:0/2388240195 >> v2:172.21.15.152:3300/0 conn(0x7fbaa406cac0 0x7fbaa406cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:30.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.962+0000 7fbaa8a00640 1 --2- 172.21.15.152:0/2388240195 >> v2:172.21.15.196:3300/0 conn(0x7fbaa4073020 0x7fbaa40d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:30.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.962+0000 7fbaa3e00640 1 -- 172.21.15.152:0/2388240195 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 547508461 0 0) 0x7fbaa406e3a0 con 0x7fbaa415b0f0 2024-04-17T08:46:30.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.962+0000 7fbaa3e00640 1 -- 172.21.15.152:0/2388240195 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba8c003530 con 0x7fbaa415b0f0 2024-04-17T08:46:30.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.962+0000 7fbaa9e00640 1 -- 172.21.15.152:0/2388240195 >> v2:172.21.15.196:3300/0 conn(0x7fbaa4073020 msgr2=0x7fbaa40d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:30.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.962+0000 7fbaa9e00640 1 --2- 172.21.15.152:0/2388240195 >> v2:172.21.15.196:3300/0 conn(0x7fbaa4073020 0x7fbaa40d0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:30.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.962+0000 7fbaa9e00640 1 -- 172.21.15.152:0/2388240195 >> v1:172.21.15.152:6789/0 conn(0x7fbaa415b0f0 legacy=0x7fbaa40adc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:30.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.962+0000 7fbaa9e00640 1 -- 172.21.15.152:0/2388240195 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaa40d0720 con 0x7fbaa406cac0 2024-04-17T08:46:30.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.962+0000 7fbaa8a00640 1 --2- 172.21.15.152:0/2388240195 >> v2:172.21.15.196:3300/0 conn(0x7fbaa4073020 0x7fbaa40d0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:46:30.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.966+0000 7fbaa9e00640 1 --2- 172.21.15.152:0/2388240195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbaa406cac0 0x7fbaa406cef0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbaa40b1db0 tx=0x7fba9c01c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb6489fb7daf58ca server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:30.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.966+0000 7fbaa3e00640 1 -- 172.21.15.152:0/2388240195 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba9c0b2070 con 0x7fbaa406cac0 2024-04-17T08:46:30.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.966+0000 7fbaa3e00640 1 -- 172.21.15.152:0/2388240195 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba9c0a5870 con 0x7fbaa406cac0 2024-04-17T08:46:30.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.966+0000 7fbaa3e00640 1 -- 172.21.15.152:0/2388240195 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba9c0a5c40 con 0x7fbaa406cac0 2024-04-17T08:46:30.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.966+0000 7fbaaa800640 1 -- 172.21.15.152:0/2388240195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbaa406cac0 msgr2=0x7fbaa406cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:30.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.966+0000 7fbaaa800640 1 --2- 172.21.15.152:0/2388240195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbaa406cac0 0x7fbaa406cef0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbaa40b1db0 tx=0x7fba9c01c8a0 comp rx=0 tx=0).stop 2024-04-17T08:46:30.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.966+0000 7fbaaa800640 1 -- 172.21.15.152:0/2388240195 shutdown_connections 2024-04-17T08:46:30.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.966+0000 7fbaaa800640 1 --2- 172.21.15.152:0/2388240195 >> v2:172.21.15.196:3300/0 conn(0x7fbaa4073020 0x7fbaa40d0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:30.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.966+0000 7fbaaa800640 1 --2- 172.21.15.152:0/2388240195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbaa406cac0 0x7fbaa406cef0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:30.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.966+0000 7fbaaa800640 1 -- 172.21.15.152:0/2388240195 >> 172.21.15.152:0/2388240195 conn(0x7fbaa40b5280 msgr2=0x7fbaa40b3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:30.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.966+0000 7fbaaa800640 1 -- 172.21.15.152:0/2388240195 shutdown_connections 2024-04-17T08:46:30.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.966+0000 7fbaaa800640 1 -- 172.21.15.152:0/2388240195 wait complete. 2024-04-17T08:46:30.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.966+0000 7fbaaa800640 1 Processor -- start 2024-04-17T08:46:30.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.966+0000 7fbaaa800640 1 -- start start 2024-04-17T08:46:30.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.966+0000 7fbaaa800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbaa406cac0 0x7fbaa4156e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:30.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.966+0000 7fbaaa800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbaa4073020 0x7fbaa4151b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:30.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.966+0000 7fbaaa800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbaa415b0f0 0x7fbaa4152060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:30.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.966+0000 7fbaaa800640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa40ae4a0 con 0x7fbaa406cac0 2024-04-17T08:46:30.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.966+0000 7fbaaa800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa40ae320 con 0x7fbaa415b0f0 2024-04-17T08:46:30.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.966+0000 7fbaaa800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fbaa41660c0 con 0x7fbaa4073020 2024-04-17T08:46:30.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.966+0000 7fbaa9400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbaa406cac0 0x7fbaa4156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:30.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.966+0000 7fbaa9400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbaa406cac0 0x7fbaa4156e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40788/0 (socket says 172.21.15.152:40788) 2024-04-17T08:46:30.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.966+0000 7fbaa9400640 1 -- 172.21.15.152:0/1525669971 learned_addr learned my addr 172.21.15.152:0/1525669971 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:30.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.970+0000 7fbaa9e00640 1 --2- 172.21.15.152:0/1525669971 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbaa415b0f0 0x7fbaa4152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:30.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.970+0000 7fbaa8a00640 1 --2- 172.21.15.152:0/1525669971 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbaa4073020 0x7fbaa4151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:30.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.970+0000 7fbaa9400640 1 -- 172.21.15.152:0/1525669971 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbaa4073020 msgr2=0x7fbaa4151b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:30.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.970+0000 7fbaa9400640 1 --2- 172.21.15.152:0/1525669971 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbaa4073020 0x7fbaa4151b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:30.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.970+0000 7fbaa9400640 1 -- 172.21.15.152:0/1525669971 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbaa415b0f0 msgr2=0x7fbaa4152060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:30.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.970+0000 7fbaa9400640 1 --2- 172.21.15.152:0/1525669971 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbaa415b0f0 0x7fbaa4152060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:30.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.970+0000 7fbaa9400640 1 -- 172.21.15.152:0/1525669971 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaa4159f70 con 0x7fbaa406cac0 2024-04-17T08:46:30.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.970+0000 7fbaa9400640 1 --2- 172.21.15.152:0/1525669971 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbaa406cac0 0x7fbaa4156e00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fba9800c3c0 tx=0x7fba9800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:30.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.970+0000 7fbaa1600640 1 -- 172.21.15.152:0/1525669971 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba98017070 con 0x7fbaa406cac0 2024-04-17T08:46:30.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.970+0000 7fbaa1600640 1 -- 172.21.15.152:0/1525669971 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba98005cf0 con 0x7fbaa406cac0 2024-04-17T08:46:30.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.970+0000 7fbaaa800640 1 -- 172.21.15.152:0/1525669971 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaa4157980 con 0x7fbaa406cac0 2024-04-17T08:46:30.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.970+0000 7fbaa1600640 1 -- 172.21.15.152:0/1525669971 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba980072f0 con 0x7fbaa406cac0 2024-04-17T08:46:30.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.970+0000 7fbaaa800640 1 -- 172.21.15.152:0/1525669971 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaa4157f40 con 0x7fbaa406cac0 2024-04-17T08:46:30.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.970+0000 7fbaaa800640 1 -- 172.21.15.152:0/1525669971 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaa4075be0 con 0x7fbaa406cac0 2024-04-17T08:46:30.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.970+0000 7fbaa1600640 1 -- 172.21.15.152:0/1525669971 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fba9801a070 con 0x7fbaa406cac0 2024-04-17T08:46:30.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.970+0000 7fbaa1600640 1 --2- 172.21.15.152:0/1525669971 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fba84068380 0x7fba8406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:30.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.970+0000 7fbaa1600640 1 -- 172.21.15.152:0/1525669971 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fba98085b40 con 0x7fbaa406cac0 2024-04-17T08:46:30.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.970+0000 7fbaa8a00640 1 --2- 172.21.15.152:0/1525669971 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fba84068380 0x7fba8406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:30.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.974+0000 7fbaa8a00640 1 --2- 172.21.15.152:0/1525669971 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fba84068380 0x7fba8406a840 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbaa40af130 tx=0x7fba90008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:30.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:30.974+0000 7fbaa1600640 1 -- 172.21.15.152:0/1525669971 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fba980563b0 con 0x7fbaa406cac0 2024-04-17T08:46:31.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.130+0000 7fbaaa800640 1 -- 172.21.15.152:0/1525669971 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbaa40728f0 con 0x7fbaa406cac0 2024-04-17T08:46:31.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.134+0000 7fbaa1600640 1 -- 172.21.15.152:0/1525669971 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7fba98055cb0 con 0x7fbaa406cac0 2024-04-17T08:46:31.134 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2024-04-17T08:46:31.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.134+0000 7fbaaa800640 1 -- 172.21.15.152:0/1525669971 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fba84068380 msgr2=0x7fba8406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:31.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.134+0000 7fbaaa800640 1 --2- 172.21.15.152:0/1525669971 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fba84068380 0x7fba8406a840 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbaa40af130 tx=0x7fba90008040 comp rx=0 tx=0).stop 2024-04-17T08:46:31.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.134+0000 7fbaaa800640 1 -- 172.21.15.152:0/1525669971 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbaa406cac0 msgr2=0x7fbaa4156e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:31.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.134+0000 7fbaaa800640 1 --2- 172.21.15.152:0/1525669971 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbaa406cac0 0x7fbaa4156e00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fba9800c3c0 tx=0x7fba9800c880 comp rx=0 tx=0).stop 2024-04-17T08:46:31.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.134+0000 7fbaaa800640 1 -- 172.21.15.152:0/1525669971 shutdown_connections 2024-04-17T08:46:31.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.134+0000 7fbaaa800640 1 --2- 172.21.15.152:0/1525669971 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbaa415b0f0 0x7fbaa4152060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:31.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.134+0000 7fbaaa800640 1 --2- 172.21.15.152:0/1525669971 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fba84068380 0x7fba8406a840 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:31.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.134+0000 7fbaaa800640 1 --2- 172.21.15.152:0/1525669971 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbaa4073020 0x7fbaa4151b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:31.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.134+0000 7fbaaa800640 1 --2- 172.21.15.152:0/1525669971 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbaa406cac0 0x7fbaa4156e00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:31.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.134+0000 7fbaaa800640 1 -- 172.21.15.152:0/1525669971 >> 172.21.15.152:0/1525669971 conn(0x7fbaa40b5280 msgr2=0x7fbaa415b840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:31.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.134+0000 7fbaaa800640 1 -- 172.21.15.152:0/1525669971 shutdown_connections 2024-04-17T08:46:31.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.134+0000 7fbaaa800640 1 -- 172.21.15.152:0/1525669971 wait complete. 2024-04-17T08:46:31.155 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-17T08:46:31.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.290+0000 7f066d600640 1 Processor -- start 2024-04-17T08:46:31.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.290+0000 7f066d600640 1 -- start start 2024-04-17T08:46:31.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.290+0000 7f066d600640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f066815a010 0x7f06680d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:31.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.290+0000 7f066d600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f066815d710 0x7f06680d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:31.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.290+0000 7f066d600640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0668160d20 con 0x7f0668160010 2024-04-17T08:46:31.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.290+0000 7f066d600640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f066815d280 con 0x7f066815a010 2024-04-17T08:46:31.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.290+0000 7f066d600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f066815c9d0 con 0x7f066815d710 2024-04-17T08:46:31.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.290+0000 7f0666a00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f066815a010 0x7f06680d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:31.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.290+0000 7f0667400640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f0668160010 0x7f0668160450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:39758/0 (socket says 172.21.15.152:39758) 2024-04-17T08:46:31.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.290+0000 7f0667400640 1 -- 172.21.15.152:0/1433040698 learned_addr learned my addr 172.21.15.152:0/1433040698 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:46:31.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.290+0000 7f0666000640 1 --2- 172.21.15.152:0/1433040698 >> v2:172.21.15.196:3300/0 conn(0x7f066815d710 0x7f06680d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:31.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.290+0000 7f0666a00640 1 -- 172.21.15.152:0/1433040698 >> v2:172.21.15.196:3300/0 conn(0x7f066815d710 msgr2=0x7f06680d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:31.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.290+0000 7f0666a00640 1 --2- 172.21.15.152:0/1433040698 >> v2:172.21.15.196:3300/0 conn(0x7f066815d710 0x7f06680d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:31.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.290+0000 7f0666a00640 1 -- 172.21.15.152:0/1433040698 >> v1:172.21.15.152:6789/0 conn(0x7f0668160010 legacy=0x7f0668160450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:31.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.290+0000 7f0666a00640 1 -- 172.21.15.152:0/1433040698 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f066815cc30 con 0x7f066815a010 2024-04-17T08:46:31.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.290+0000 7f0665600640 1 -- 172.21.15.152:0/1433040698 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3334111074 0 0) 0x7f0668160d20 con 0x7f0668160010 2024-04-17T08:46:31.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.294+0000 7f0666a00640 1 --2- 172.21.15.152:0/1433040698 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f066815a010 0x7f06680d0360 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f06680b1d10 tx=0x7f065801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39a30cc798ac8696 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:31.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.294+0000 7f0665600640 1 -- 172.21.15.152:0/1433040698 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06580b0070 con 0x7f066815a010 2024-04-17T08:46:31.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.294+0000 7f0665600640 1 -- 172.21.15.152:0/1433040698 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06580ab600 con 0x7f066815a010 2024-04-17T08:46:31.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.294+0000 7f0665600640 1 -- 172.21.15.152:0/1433040698 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06580ab9d0 con 0x7f066815a010 2024-04-17T08:46:31.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.294+0000 7f066d600640 1 -- 172.21.15.152:0/1433040698 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f066815a010 msgr2=0x7f06680d0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:31.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.294+0000 7f066d600640 1 --2- 172.21.15.152:0/1433040698 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f066815a010 0x7f06680d0360 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f06680b1d10 tx=0x7f065801c3f0 comp rx=0 tx=0).stop 2024-04-17T08:46:31.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.294+0000 7f066d600640 1 -- 172.21.15.152:0/1433040698 shutdown_connections 2024-04-17T08:46:31.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.294+0000 7f066d600640 1 --2- 172.21.15.152:0/1433040698 >> v2:172.21.15.196:3300/0 conn(0x7f066815d710 0x7f06680d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:31.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.294+0000 7f066d600640 1 --2- 172.21.15.152:0/1433040698 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f066815a010 0x7f06680d0360 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:31.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.294+0000 7f066d600640 1 -- 172.21.15.152:0/1433040698 >> 172.21.15.152:0/1433040698 conn(0x7f06680b3350 msgr2=0x7f06680b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:31.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.294+0000 7f066d600640 1 -- 172.21.15.152:0/1433040698 shutdown_connections 2024-04-17T08:46:31.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.294+0000 7f066d600640 1 -- 172.21.15.152:0/1433040698 wait complete. 2024-04-17T08:46:31.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.294+0000 7f066d600640 1 Processor -- start 2024-04-17T08:46:31.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.298+0000 7f066d600640 1 -- start start 2024-04-17T08:46:31.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.298+0000 7f066d600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f066815a010 0x7f066815b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:31.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.298+0000 7f066d600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f066815d710 0x7f0668149870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:31.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.298+0000 7f066d600640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0668160010 0x7f0668155ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:31.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.298+0000 7f066d600640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f066815e780 con 0x7f0668160010 2024-04-17T08:46:31.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.298+0000 7f066d600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f066815e600 con 0x7f066815d710 2024-04-17T08:46:31.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.298+0000 7f066d600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f066815e900 con 0x7f066815a010 2024-04-17T08:46:31.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.298+0000 7f0667400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0668160010 0x7f0668155ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:31.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.298+0000 7f0667400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0668160010 0x7f0668155ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40804/0 (socket says 172.21.15.152:40804) 2024-04-17T08:46:31.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.298+0000 7f0667400640 1 -- 172.21.15.152:0/3238439963 learned_addr learned my addr 172.21.15.152:0/3238439963 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:31.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.298+0000 7f0666a00640 1 --2- 172.21.15.152:0/3238439963 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f066815a010 0x7f066815b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:31.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.298+0000 7f0666000640 1 --2- 172.21.15.152:0/3238439963 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f066815d710 0x7f0668149870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:31.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.298+0000 7f0667400640 1 -- 172.21.15.152:0/3238439963 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f066815a010 msgr2=0x7f066815b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:31.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.298+0000 7f0667400640 1 --2- 172.21.15.152:0/3238439963 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f066815a010 0x7f066815b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:31.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.298+0000 7f0667400640 1 -- 172.21.15.152:0/3238439963 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f066815d710 msgr2=0x7f0668149870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:31.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.298+0000 7f0667400640 1 --2- 172.21.15.152:0/3238439963 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f066815d710 0x7f0668149870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:31.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.298+0000 7f0667400640 1 -- 172.21.15.152:0/3238439963 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f066815bab0 con 0x7f0668160010 2024-04-17T08:46:31.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.298+0000 7f0666a00640 1 --2- 172.21.15.152:0/3238439963 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f066815a010 0x7f066815b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:46:31.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.298+0000 7f0666000640 1 --2- 172.21.15.152:0/3238439963 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f066815d710 0x7f0668149870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:46:31.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.298+0000 7f0667400640 1 --2- 172.21.15.152:0/3238439963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0668160010 0x7f0668155ae0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f066000c730 tx=0x7f066000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:31.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.298+0000 7f065ea00640 1 -- 172.21.15.152:0/3238439963 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0660018070 con 0x7f0668160010 2024-04-17T08:46:31.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.298+0000 7f065ea00640 1 -- 172.21.15.152:0/3238439963 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f066000ce40 con 0x7f0668160010 2024-04-17T08:46:31.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.298+0000 7f066d600640 1 -- 172.21.15.152:0/3238439963 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f066815c010 con 0x7f0668160010 2024-04-17T08:46:31.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.298+0000 7f065ea00640 1 -- 172.21.15.152:0/3238439963 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f066000a860 con 0x7f0668160010 2024-04-17T08:46:31.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.298+0000 7f066d600640 1 -- 172.21.15.152:0/3238439963 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0668157ec0 con 0x7f0668160010 2024-04-17T08:46:31.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.298+0000 7f066d600640 1 -- 172.21.15.152:0/3238439963 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0668068a30 con 0x7f0668160010 2024-04-17T08:46:31.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.302+0000 7f065ea00640 1 -- 172.21.15.152:0/3238439963 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f066001b070 con 0x7f0668160010 2024-04-17T08:46:31.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.302+0000 7f065ea00640 1 --2- 172.21.15.152:0/3238439963 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0648068380 0x7f064806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:31.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.302+0000 7f065ea00640 1 -- 172.21.15.152:0/3238439963 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f0660085c20 con 0x7f0668160010 2024-04-17T08:46:31.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.302+0000 7f0666a00640 1 --2- 172.21.15.152:0/3238439963 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0648068380 0x7f064806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:31.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.302+0000 7f0666a00640 1 --2- 172.21.15.152:0/3238439963 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0648068380 0x7f064806a840 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f06580ad000 tx=0x7f0658008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:31.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.306+0000 7f065ea00640 1 -- 172.21.15.152:0/3238439963 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f066815bab0 con 0x7f0668160010 2024-04-17T08:46:31.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.466+0000 7f066d600640 1 -- 172.21.15.152:0/3238439963 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f066806d660 con 0x7f0668160010 2024-04-17T08:46:31.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.466+0000 7f065ea00640 1 -- 172.21.15.152:0/3238439963 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7f0660056520 con 0x7f0668160010 2024-04-17T08:46:31.468 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:46:31.468 INFO:teuthology.orchestra.run.smithi152.stdout:[ 2024-04-17T08:46:31.468 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-04-17T08:46:31.468 INFO:teuthology.orchestra.run.smithi152.stdout: "poolnum": 1, 2024-04-17T08:46:31.468 INFO:teuthology.orchestra.run.smithi152.stdout: "poolname": ".mgr" 2024-04-17T08:46:31.468 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-17T08:46:31.468 INFO:teuthology.orchestra.run.smithi152.stdout:] 2024-04-17T08:46:31.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.466+0000 7f066d600640 1 -- 172.21.15.152:0/3238439963 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0648068380 msgr2=0x7f064806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:31.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.466+0000 7f066d600640 1 --2- 172.21.15.152:0/3238439963 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0648068380 0x7f064806a840 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f06580ad000 tx=0x7f0658008040 comp rx=0 tx=0).stop 2024-04-17T08:46:31.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.466+0000 7f066d600640 1 -- 172.21.15.152:0/3238439963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0668160010 msgr2=0x7f0668155ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:31.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.466+0000 7f066d600640 1 --2- 172.21.15.152:0/3238439963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0668160010 0x7f0668155ae0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f066000c730 tx=0x7f066000cbf0 comp rx=0 tx=0).stop 2024-04-17T08:46:31.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.466+0000 7f066d600640 1 -- 172.21.15.152:0/3238439963 shutdown_connections 2024-04-17T08:46:31.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.466+0000 7f066d600640 1 --2- 172.21.15.152:0/3238439963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0668160010 0x7f0668155ae0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:31.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.466+0000 7f066d600640 1 --2- 172.21.15.152:0/3238439963 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f066815d710 0x7f0668149870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:31.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.466+0000 7f066d600640 1 --2- 172.21.15.152:0/3238439963 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0648068380 0x7f064806a840 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:31.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.466+0000 7f066d600640 1 --2- 172.21.15.152:0/3238439963 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f066815a010 0x7f066815b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:31.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.466+0000 7f066d600640 1 -- 172.21.15.152:0/3238439963 >> 172.21.15.152:0/3238439963 conn(0x7f06680b3350 msgr2=0x7f06680b1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:31.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.466+0000 7f066d600640 1 -- 172.21.15.152:0/3238439963 shutdown_connections 2024-04-17T08:46:31.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.470+0000 7f066d600640 1 -- 172.21.15.152:0/3238439963 wait complete. 2024-04-17T08:46:31.489 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-17T08:46:31.489 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-17T08:46:31.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.626+0000 7fb1a2800640 1 Processor -- start 2024-04-17T08:46:31.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.626+0000 7fb1a2800640 1 -- start start 2024-04-17T08:46:31.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.626+0000 7fb1a2800640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb19c06d960 0x7fb19c162d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:31.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.626+0000 7fb1a2800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb19c0ad870 0x7fb19c0ce920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:31.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.626+0000 7fb1a2800640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb19c073740 con 0x7fb19c0d04a0 2024-04-17T08:46:31.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.626+0000 7fb1a2800640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fb19c15f990 con 0x7fb19c06d960 2024-04-17T08:46:31.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.626+0000 7fb1a2800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fb19c0d0880 con 0x7fb19c0ad870 2024-04-17T08:46:31.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.626+0000 7fb192a00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb19c06d960 0x7fb19c162d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:31.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.626+0000 7fb19b400640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fb19c0d04a0 0x7fb19c06d250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:39770/0 (socket says 172.21.15.152:39770) 2024-04-17T08:46:31.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.626+0000 7fb19b400640 1 -- 172.21.15.152:0/1907230162 learned_addr learned my addr 172.21.15.152:0/1907230162 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:46:31.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.626+0000 7fb19be00640 1 --2- 172.21.15.152:0/1907230162 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb19c0ad870 0x7fb19c0ce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:31.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.626+0000 7fb192a00640 1 -- 172.21.15.152:0/1907230162 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb19c0ad870 msgr2=0x7fb19c0ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:31.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.626+0000 7fb192a00640 1 --2- 172.21.15.152:0/1907230162 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb19c0ad870 0x7fb19c0ce920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:31.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.626+0000 7fb192a00640 1 -- 172.21.15.152:0/1907230162 >> v1:172.21.15.152:6789/0 conn(0x7fb19c0d04a0 legacy=0x7fb19c06d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:31.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.626+0000 7fb192a00640 1 -- 172.21.15.152:0/1907230162 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb19c15f060 con 0x7fb19c06d960 2024-04-17T08:46:31.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.626+0000 7fb19aa00640 1 -- 172.21.15.152:0/1907230162 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 509229654 0 0) 0x7fb19c073740 con 0x7fb19c0d04a0 2024-04-17T08:46:31.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.630+0000 7fb192a00640 1 --2- 172.21.15.152:0/1907230162 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb19c06d960 0x7fb19c162d00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb1840097c0 tx=0x7fb18401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fa2665e9f554b19 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:31.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.630+0000 7fb19aa00640 1 -- 172.21.15.152:0/1907230162 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1840b2070 con 0x7fb19c06d960 2024-04-17T08:46:31.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.630+0000 7fb19aa00640 1 -- 172.21.15.152:0/1907230162 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1840ad640 con 0x7fb19c06d960 2024-04-17T08:46:31.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.630+0000 7fb19aa00640 1 -- 172.21.15.152:0/1907230162 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1840ada10 con 0x7fb19c06d960 2024-04-17T08:46:31.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.630+0000 7fb1a2800640 1 -- 172.21.15.152:0/1907230162 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb19c06d960 msgr2=0x7fb19c162d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:31.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.630+0000 7fb1a2800640 1 --2- 172.21.15.152:0/1907230162 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb19c06d960 0x7fb19c162d00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb1840097c0 tx=0x7fb18401c4a0 comp rx=0 tx=0).stop 2024-04-17T08:46:31.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.630+0000 7fb1a2800640 1 -- 172.21.15.152:0/1907230162 shutdown_connections 2024-04-17T08:46:31.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.630+0000 7fb1a2800640 1 --2- 172.21.15.152:0/1907230162 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb19c0ad870 0x7fb19c0ce920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:31.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.630+0000 7fb1a2800640 1 --2- 172.21.15.152:0/1907230162 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb19c06d960 0x7fb19c162d00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:31.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.630+0000 7fb1a2800640 1 -- 172.21.15.152:0/1907230162 >> 172.21.15.152:0/1907230162 conn(0x7fb19c072470 msgr2=0x7fb19c072880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:31.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.630+0000 7fb1a2800640 1 -- 172.21.15.152:0/1907230162 shutdown_connections 2024-04-17T08:46:31.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.630+0000 7fb1a2800640 1 -- 172.21.15.152:0/1907230162 wait complete. 2024-04-17T08:46:31.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.634+0000 7fb1a2800640 1 Processor -- start 2024-04-17T08:46:31.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.634+0000 7fb1a2800640 1 -- start start 2024-04-17T08:46:31.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.634+0000 7fb1a2800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb19c06d960 0x7fb19c14d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:31.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.634+0000 7fb1a2800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb19c0ad870 0x7fb19c0b14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:31.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.634+0000 7fb1a2800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb19c0d04a0 0x7fb19c14c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:31.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.634+0000 7fb1a2800640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb19c0cf7f0 con 0x7fb19c0ad870 2024-04-17T08:46:31.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.634+0000 7fb1a2800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb19c0cf670 con 0x7fb19c0d04a0 2024-04-17T08:46:31.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.634+0000 7fb1a2800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fb19c0cf970 con 0x7fb19c06d960 2024-04-17T08:46:31.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.634+0000 7fb192a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb19c0ad870 0x7fb19c0b14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:31.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.634+0000 7fb192a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb19c0ad870 0x7fb19c0b14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40828/0 (socket says 172.21.15.152:40828) 2024-04-17T08:46:31.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.634+0000 7fb192a00640 1 -- 172.21.15.152:0/2652628138 learned_addr learned my addr 172.21.15.152:0/2652628138 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:31.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.634+0000 7fb19b400640 1 --2- 172.21.15.152:0/2652628138 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb19c06d960 0x7fb19c14d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:31.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.634+0000 7fb19be00640 1 --2- 172.21.15.152:0/2652628138 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb19c0d04a0 0x7fb19c14c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:31.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.634+0000 7fb192a00640 1 -- 172.21.15.152:0/2652628138 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb19c06d960 msgr2=0x7fb19c14d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:31.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.634+0000 7fb192a00640 1 --2- 172.21.15.152:0/2652628138 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb19c06d960 0x7fb19c14d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:31.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.634+0000 7fb192a00640 1 -- 172.21.15.152:0/2652628138 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb19c0d04a0 msgr2=0x7fb19c14c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:31.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.634+0000 7fb192a00640 1 --2- 172.21.15.152:0/2652628138 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb19c0d04a0 0x7fb19c14c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:31.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.634+0000 7fb192a00640 1 -- 172.21.15.152:0/2652628138 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb19c14e1b0 con 0x7fb19c0ad870 2024-04-17T08:46:31.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.634+0000 7fb192a00640 1 --2- 172.21.15.152:0/2652628138 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb19c0ad870 0x7fb19c0b14a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb18401a0d0 tx=0x7fb184019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:31.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.634+0000 7fb193e00640 1 -- 172.21.15.152:0/2652628138 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1840b2040 con 0x7fb19c0ad870 2024-04-17T08:46:31.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.634+0000 7fb193e00640 1 -- 172.21.15.152:0/2652628138 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1840bd070 con 0x7fb19c0ad870 2024-04-17T08:46:31.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.634+0000 7fb1a2800640 1 -- 172.21.15.152:0/2652628138 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb19c14e490 con 0x7fb19c0ad870 2024-04-17T08:46:31.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.634+0000 7fb193e00640 1 -- 172.21.15.152:0/2652628138 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1840b6630 con 0x7fb19c0ad870 2024-04-17T08:46:31.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.634+0000 7fb1a2800640 1 -- 172.21.15.152:0/2652628138 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb19c14ea50 con 0x7fb19c0ad870 2024-04-17T08:46:31.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.638+0000 7fb1a2800640 1 -- 172.21.15.152:0/2652628138 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb19c068a30 con 0x7fb19c0ad870 2024-04-17T08:46:31.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.638+0000 7fb193e00640 1 -- 172.21.15.152:0/2652628138 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb1840b67d0 con 0x7fb19c0ad870 2024-04-17T08:46:31.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.638+0000 7fb193e00640 1 --2- 172.21.15.152:0/2652628138 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb178068380 0x7fb17806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:31.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.638+0000 7fb193e00640 1 -- 172.21.15.152:0/2652628138 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fb184120620 con 0x7fb19c0ad870 2024-04-17T08:46:31.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.638+0000 7fb19b400640 1 --2- 172.21.15.152:0/2652628138 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb178068380 0x7fb17806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:31.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.638+0000 7fb19b400640 1 --2- 172.21.15.152:0/2652628138 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb178068380 0x7fb17806a840 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb18c000f70 tx=0x7fb18c007b80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:31.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.642+0000 7fb193e00640 1 -- 172.21.15.152:0/2652628138 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fb184016090 con 0x7fb19c0ad870 2024-04-17T08:46:31.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:31.798+0000 7fb1a2800640 1 -- 172.21.15.152:0/2652628138 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fb19c06be90 con 0x7fb19c0ad870 2024-04-17T08:46:32.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.198+0000 7fb193e00640 1 -- 172.21.15.152:0/2652628138 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7fb1840f0e90 con 0x7fb19c0ad870 2024-04-17T08:46:32.199 INFO:teuthology.orchestra.run.smithi152.stderr:pool 'cephfs_metadata' created 2024-04-17T08:46:32.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.198+0000 7fb1a2800640 1 -- 172.21.15.152:0/2652628138 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb178068380 msgr2=0x7fb17806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:32.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.198+0000 7fb1a2800640 1 --2- 172.21.15.152:0/2652628138 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb178068380 0x7fb17806a840 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb18c000f70 tx=0x7fb18c007b80 comp rx=0 tx=0).stop 2024-04-17T08:46:32.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.198+0000 7fb1a2800640 1 -- 172.21.15.152:0/2652628138 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb19c0ad870 msgr2=0x7fb19c0b14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:32.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.198+0000 7fb1a2800640 1 --2- 172.21.15.152:0/2652628138 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb19c0ad870 0x7fb19c0b14a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb18401a0d0 tx=0x7fb184019240 comp rx=0 tx=0).stop 2024-04-17T08:46:32.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.198+0000 7fb1a2800640 1 -- 172.21.15.152:0/2652628138 shutdown_connections 2024-04-17T08:46:32.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.198+0000 7fb1a2800640 1 --2- 172.21.15.152:0/2652628138 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb19c0d04a0 0x7fb19c14c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:32.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.198+0000 7fb1a2800640 1 --2- 172.21.15.152:0/2652628138 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb19c0ad870 0x7fb19c0b14a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:32.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.198+0000 7fb1a2800640 1 --2- 172.21.15.152:0/2652628138 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb178068380 0x7fb17806a840 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:32.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.198+0000 7fb1a2800640 1 --2- 172.21.15.152:0/2652628138 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb19c06d960 0x7fb19c14d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:32.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.198+0000 7fb1a2800640 1 -- 172.21.15.152:0/2652628138 >> 172.21.15.152:0/2652628138 conn(0x7fb19c072470 msgr2=0x7fb19c1615b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:32.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.198+0000 7fb1a2800640 1 -- 172.21.15.152:0/2652628138 shutdown_connections 2024-04-17T08:46:32.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.198+0000 7fb1a2800640 1 -- 172.21.15.152:0/2652628138 wait complete. 2024-04-17T08:46:32.228 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-04-17T08:46:32.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.370+0000 7f8abb400640 1 Processor -- start 2024-04-17T08:46:32.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.370+0000 7f8abb400640 1 -- start start 2024-04-17T08:46:32.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.370+0000 7f8abb400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f8ab415a010 0x7f8ab40d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:32.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.370+0000 7f8abb400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f8ab415d710 0x7f8ab40d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:32.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.370+0000 7f8abb400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8ab4160010 0x7f8ab41604a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:32.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.370+0000 7f8abb400640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f8ab415d280 con 0x7f8ab415a010 2024-04-17T08:46:32.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.370+0000 7f8abb400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f8ab415c9d0 con 0x7f8ab415d710 2024-04-17T08:46:32.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.370+0000 7f8abb400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f8ab4160d20 con 0x7f8ab4160010 2024-04-17T08:46:32.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.370+0000 7f8ab8a00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f8ab415a010 0x7f8ab40d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:32.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.370+0000 7f8ab8a00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f8ab415a010 0x7f8ab40d0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40830/0 (socket says 172.21.15.152:40830) 2024-04-17T08:46:32.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.370+0000 7f8ab8a00640 1 -- 172.21.15.152:0/3538889950 learned_addr learned my addr 172.21.15.152:0/3538889950 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:32.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.370+0000 7f8ab9400640 1 --2- 172.21.15.152:0/3538889950 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8ab4160010 0x7f8ab41604a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:32.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.370+0000 7f8aabe00640 1 --2- 172.21.15.152:0/3538889950 >> v2:172.21.15.196:3300/0 conn(0x7f8ab415d710 0x7f8ab40d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:32.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.370+0000 7f8ab8a00640 1 -- 172.21.15.152:0/3538889950 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8ab4160010 msgr2=0x7f8ab41604a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:32.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.370+0000 7f8ab8a00640 1 --2- 172.21.15.152:0/3538889950 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8ab4160010 0x7f8ab41604a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:32.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.370+0000 7f8ab8a00640 1 -- 172.21.15.152:0/3538889950 >> v2:172.21.15.196:3300/0 conn(0x7f8ab415d710 msgr2=0x7f8ab40d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:32.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.370+0000 7f8ab8a00640 1 --2- 172.21.15.152:0/3538889950 >> v2:172.21.15.196:3300/0 conn(0x7f8ab415d710 0x7f8ab40d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:32.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.370+0000 7f8ab8a00640 1 -- 172.21.15.152:0/3538889950 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ab415cc30 con 0x7f8ab415a010 2024-04-17T08:46:32.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.374+0000 7f8ab8a00640 1 --2- 172.21.15.152:0/3538889950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ab415a010 0x7f8ab40d0360 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8ab40b1d10 tx=0x7f8aa401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=384cc4a30ed0fd2a server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:32.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.374+0000 7f8ab3e00640 1 -- 172.21.15.152:0/3538889950 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa40b0070 con 0x7f8ab415a010 2024-04-17T08:46:32.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.374+0000 7f8ab3e00640 1 -- 172.21.15.152:0/3538889950 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aa40ab600 con 0x7f8ab415a010 2024-04-17T08:46:32.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.374+0000 7f8ab3e00640 1 -- 172.21.15.152:0/3538889950 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa40ab9d0 con 0x7f8ab415a010 2024-04-17T08:46:32.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.374+0000 7f8abb400640 1 -- 172.21.15.152:0/3538889950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ab415a010 msgr2=0x7f8ab40d0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:32.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.374+0000 7f8abb400640 1 --2- 172.21.15.152:0/3538889950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ab415a010 0x7f8ab40d0360 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8ab40b1d10 tx=0x7f8aa401c490 comp rx=0 tx=0).stop 2024-04-17T08:46:32.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.374+0000 7f8abb400640 1 -- 172.21.15.152:0/3538889950 shutdown_connections 2024-04-17T08:46:32.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.374+0000 7f8abb400640 1 --2- 172.21.15.152:0/3538889950 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8ab4160010 0x7f8ab41604a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:32.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.374+0000 7f8abb400640 1 --2- 172.21.15.152:0/3538889950 >> v2:172.21.15.196:3300/0 conn(0x7f8ab415d710 0x7f8ab40d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:32.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.374+0000 7f8abb400640 1 --2- 172.21.15.152:0/3538889950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ab415a010 0x7f8ab40d0360 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:32.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.374+0000 7f8abb400640 1 -- 172.21.15.152:0/3538889950 >> 172.21.15.152:0/3538889950 conn(0x7f8ab40b3350 msgr2=0x7f8ab40b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:32.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.374+0000 7f8abb400640 1 -- 172.21.15.152:0/3538889950 shutdown_connections 2024-04-17T08:46:32.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.374+0000 7f8abb400640 1 -- 172.21.15.152:0/3538889950 wait complete. 2024-04-17T08:46:32.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.378+0000 7f8abb400640 1 Processor -- start 2024-04-17T08:46:32.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.378+0000 7f8abb400640 1 -- start start 2024-04-17T08:46:32.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.378+0000 7f8abb400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8ab415a010 0x7f8ab415ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:32.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.378+0000 7f8abb400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ab415d710 0x7f8ab4155040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:32.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.378+0000 7f8abb400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8ab4160010 0x7f8ab415b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:32.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.378+0000 7f8abb400640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab406c340 con 0x7f8ab415d710 2024-04-17T08:46:32.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.378+0000 7f8abb400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab406c1c0 con 0x7f8ab4160010 2024-04-17T08:46:32.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.378+0000 7f8abb400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f8ab406c4c0 con 0x7f8ab415a010 2024-04-17T08:46:32.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.378+0000 7f8aabe00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ab415d710 0x7f8ab4155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:32.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.378+0000 7f8aabe00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ab415d710 0x7f8ab4155040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40838/0 (socket says 172.21.15.152:40838) 2024-04-17T08:46:32.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.378+0000 7f8aabe00640 1 -- 172.21.15.152:0/1380647010 learned_addr learned my addr 172.21.15.152:0/1380647010 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:32.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.378+0000 7f8ab8a00640 1 --2- 172.21.15.152:0/1380647010 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8ab415a010 0x7f8ab415ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:32.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.378+0000 7f8ab9400640 1 --2- 172.21.15.152:0/1380647010 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8ab4160010 0x7f8ab415b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:32.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.378+0000 7f8aabe00640 1 -- 172.21.15.152:0/1380647010 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8ab415a010 msgr2=0x7f8ab415ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:32.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.378+0000 7f8aabe00640 1 --2- 172.21.15.152:0/1380647010 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8ab415a010 0x7f8ab415ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:32.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.378+0000 7f8aabe00640 1 -- 172.21.15.152:0/1380647010 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8ab4160010 msgr2=0x7f8ab415b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:32.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.378+0000 7f8aabe00640 1 --2- 172.21.15.152:0/1380647010 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8ab4160010 0x7f8ab415b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:32.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.378+0000 7f8aabe00640 1 -- 172.21.15.152:0/1380647010 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ab40b1600 con 0x7f8ab415d710 2024-04-17T08:46:32.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.378+0000 7f8aabe00640 1 --2- 172.21.15.152:0/1380647010 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ab415d710 0x7f8ab4155040 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c00d800 tx=0x7f8a9c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:32.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.378+0000 7f8ab1600640 1 -- 172.21.15.152:0/1380647010 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c00b6c0 con 0x7f8ab415d710 2024-04-17T08:46:32.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.378+0000 7f8ab1600640 1 -- 172.21.15.152:0/1380647010 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a9c019070 con 0x7f8ab415d710 2024-04-17T08:46:32.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.378+0000 7f8ab1600640 1 -- 172.21.15.152:0/1380647010 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c00ba60 con 0x7f8ab415d710 2024-04-17T08:46:32.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.378+0000 7f8abb400640 1 -- 172.21.15.152:0/1380647010 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ab40b18e0 con 0x7f8ab415d710 2024-04-17T08:46:32.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.378+0000 7f8abb400640 1 -- 172.21.15.152:0/1380647010 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ab415be30 con 0x7f8ab415d710 2024-04-17T08:46:32.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.378+0000 7f8abb400640 1 -- 172.21.15.152:0/1380647010 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ab4068a30 con 0x7f8ab415d710 2024-04-17T08:46:32.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.382+0000 7f8ab1600640 1 -- 172.21.15.152:0/1380647010 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8a9c00bc00 con 0x7f8ab415d710 2024-04-17T08:46:32.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.382+0000 7f8ab1600640 1 --2- 172.21.15.152:0/1380647010 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8a900683b0 0x7f8a9006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:32.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.382+0000 7f8ab1600640 1 -- 172.21.15.152:0/1380647010 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7f8a9c087550 con 0x7f8ab415d710 2024-04-17T08:46:32.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.382+0000 7f8ab8a00640 1 --2- 172.21.15.152:0/1380647010 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8a900683b0 0x7f8a9006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:32.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.382+0000 7f8ab8a00640 1 --2- 172.21.15.152:0/1380647010 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8a900683b0 0x7f8a9006a870 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8aa40ad000 tx=0x7f8aa4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:32.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.386+0000 7f8ab1600640 1 -- 172.21.15.152:0/1380647010 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f8a9c057810 con 0x7f8ab415d710 2024-04-17T08:46:32.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:32.542+0000 7f8abb400640 1 -- 172.21.15.152:0/1380647010 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f8ab40cfb20 con 0x7f8ab415d710 2024-04-17T08:46:33.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.202+0000 7f8ab1600640 1 -- 172.21.15.152:0/1380647010 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) ==== 171+0+0 (secure 0 0 0) 0x7f8a9c085e20 con 0x7f8ab415d710 2024-04-17T08:46:33.202 INFO:teuthology.orchestra.run.smithi152.stderr:pool 'cephfs_data' created 2024-04-17T08:46:33.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.206+0000 7f8abb400640 1 -- 172.21.15.152:0/1380647010 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8a900683b0 msgr2=0x7f8a9006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:33.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.206+0000 7f8abb400640 1 --2- 172.21.15.152:0/1380647010 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8a900683b0 0x7f8a9006a870 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8aa40ad000 tx=0x7f8aa4008040 comp rx=0 tx=0).stop 2024-04-17T08:46:33.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.206+0000 7f8abb400640 1 -- 172.21.15.152:0/1380647010 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ab415d710 msgr2=0x7f8ab4155040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:33.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.206+0000 7f8abb400640 1 --2- 172.21.15.152:0/1380647010 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ab415d710 0x7f8ab4155040 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c00d800 tx=0x7f8a9c00dcc0 comp rx=0 tx=0).stop 2024-04-17T08:46:33.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.206+0000 7f8abb400640 1 -- 172.21.15.152:0/1380647010 shutdown_connections 2024-04-17T08:46:33.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.206+0000 7f8abb400640 1 --2- 172.21.15.152:0/1380647010 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8ab4160010 0x7f8ab415b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:33.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.206+0000 7f8abb400640 1 --2- 172.21.15.152:0/1380647010 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ab415d710 0x7f8ab4155040 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:33.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.206+0000 7f8abb400640 1 --2- 172.21.15.152:0/1380647010 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8a900683b0 0x7f8a9006a870 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:33.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.206+0000 7f8abb400640 1 --2- 172.21.15.152:0/1380647010 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8ab415a010 0x7f8ab415ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:33.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.206+0000 7f8abb400640 1 -- 172.21.15.152:0/1380647010 >> 172.21.15.152:0/1380647010 conn(0x7f8ab40b3350 msgr2=0x7f8ab41548f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:33.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.210+0000 7f8abb400640 1 -- 172.21.15.152:0/1380647010 shutdown_connections 2024-04-17T08:46:33.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.218+0000 7f8abb400640 1 -- 172.21.15.152:0/1380647010 wait complete. 2024-04-17T08:46:33.254 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-17T08:46:33.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.394+0000 7fcc95a00640 1 Processor -- start 2024-04-17T08:46:33.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.394+0000 7fcc95a00640 1 -- start start 2024-04-17T08:46:33.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.394+0000 7fcc95a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcc9015a010 0x7fcc900d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:33.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.394+0000 7fcc95a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fcc90160720 0x7fcc900d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:33.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.394+0000 7fcc95a00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc90160d20 con 0x7fcc9015d710 2024-04-17T08:46:33.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.394+0000 7fcc95a00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fcc9015d280 con 0x7fcc90160720 2024-04-17T08:46:33.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.394+0000 7fcc95a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fcc9015c9d0 con 0x7fcc9015a010 2024-04-17T08:46:33.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.394+0000 7fcc87e00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fcc9015d710 0x7fcc90160010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:39786/0 (socket says 172.21.15.152:39786) 2024-04-17T08:46:33.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.394+0000 7fcc87e00640 1 -- 172.21.15.152:0/3187170406 learned_addr learned my addr 172.21.15.152:0/3187170406 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:46:33.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.394+0000 7fcc8ea00640 1 --2- 172.21.15.152:0/3187170406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcc9015a010 0x7fcc900d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:33.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.394+0000 7fcc8f400640 1 --2- 172.21.15.152:0/3187170406 >> v2:172.21.15.196:3300/0 conn(0x7fcc90160720 0x7fcc900d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:33.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.394+0000 7fcc8e000640 1 -- 172.21.15.152:0/3187170406 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 563708937 0 0) 0x7fcc90160d20 con 0x7fcc9015d710 2024-04-17T08:46:33.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.394+0000 7fcc8e000640 1 -- 172.21.15.152:0/3187170406 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc74003530 con 0x7fcc9015d710 2024-04-17T08:46:33.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.398+0000 7fcc8e000640 1 -- 172.21.15.152:0/3187170406 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4044974998 0 0) 0x7fcc74003530 con 0x7fcc9015d710 2024-04-17T08:46:33.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.398+0000 7fcc8e000640 1 -- 172.21.15.152:0/3187170406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcc9015a010 msgr2=0x7fcc900d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:33.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.398+0000 7fcc8e000640 1 --2- 172.21.15.152:0/3187170406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcc9015a010 0x7fcc900d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:33.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.398+0000 7fcc8e000640 1 -- 172.21.15.152:0/3187170406 >> v2:172.21.15.196:3300/0 conn(0x7fcc90160720 msgr2=0x7fcc900d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:33.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.398+0000 7fcc8e000640 1 --2- 172.21.15.152:0/3187170406 >> v2:172.21.15.196:3300/0 conn(0x7fcc90160720 0x7fcc900d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:33.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.398+0000 7fcc8e000640 1 -- 172.21.15.152:0/3187170406 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc9015cc30 con 0x7fcc9015d710 2024-04-17T08:46:33.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.398+0000 7fcc8e000640 1 -- 172.21.15.152:0/3187170406 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2973887244 0 0) 0x7fcc78001680 con 0x7fcc9015d710 2024-04-17T08:46:33.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.398+0000 7fcc8e000640 1 -- 172.21.15.152:0/3187170406 >> v1:172.21.15.152:6789/0 conn(0x7fcc9015d710 legacy=0x7fcc90160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:33.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.398+0000 7fcc8e000640 1 --2- 172.21.15.152:0/3187170406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcc9015a010 0x7fcc740039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:33.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.398+0000 7fcc8e000640 1 --2- 172.21.15.152:0/3187170406 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcc74003f40 0x7fcc74004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:33.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.398+0000 7fcc8e000640 1 --2- 172.21.15.152:0/3187170406 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcc74004d50 0x7fcc740051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:33.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.398+0000 7fcc8e000640 1 -- 172.21.15.152:0/3187170406 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fcc9015d280 con 0x7fcc74003f40 2024-04-17T08:46:33.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.398+0000 7fcc8e000640 1 -- 172.21.15.152:0/3187170406 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fcc9015c9d0 con 0x7fcc74004d50 2024-04-17T08:46:33.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.398+0000 7fcc8e000640 1 -- 172.21.15.152:0/3187170406 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fcc7400ba20 con 0x7fcc9015a010 2024-04-17T08:46:33.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.398+0000 7fcc87e00640 1 --2- 172.21.15.152:0/3187170406 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcc74003f40 0x7fcc74004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:33.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.398+0000 7fcc8ea00640 1 --2- 172.21.15.152:0/3187170406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcc9015a010 0x7fcc740039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:33.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.398+0000 7fcc8f400640 1 --2- 172.21.15.152:0/3187170406 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcc74004d50 0x7fcc740051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:33.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.398+0000 7fcc8ea00640 1 -- 172.21.15.152:0/3187170406 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcc74004d50 msgr2=0x7fcc740051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:33.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.398+0000 7fcc8ea00640 1 --2- 172.21.15.152:0/3187170406 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcc74004d50 0x7fcc740051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:33.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.398+0000 7fcc8ea00640 1 -- 172.21.15.152:0/3187170406 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcc74003f40 msgr2=0x7fcc74004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:33.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.398+0000 7fcc8ea00640 1 --2- 172.21.15.152:0/3187170406 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcc74003f40 0x7fcc74004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:33.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.398+0000 7fcc8ea00640 1 -- 172.21.15.152:0/3187170406 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc74003530 con 0x7fcc9015a010 2024-04-17T08:46:33.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.398+0000 7fcc87e00640 1 --2- 172.21.15.152:0/3187170406 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcc74003f40 0x7fcc74004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T08:46:33.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.398+0000 7fcc8ea00640 1 --2- 172.21.15.152:0/3187170406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcc9015a010 0x7fcc740039c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcc80009b10 tx=0x7fcc8001cab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c205ccc20d77cd96 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:33.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.402+0000 7fcc8e000640 1 -- 172.21.15.152:0/3187170406 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc800096b0 con 0x7fcc9015a010 2024-04-17T08:46:33.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.402+0000 7fcc8e000640 1 -- 172.21.15.152:0/3187170406 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc800a6490 con 0x7fcc9015a010 2024-04-17T08:46:33.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.402+0000 7fcc8e000640 1 -- 172.21.15.152:0/3187170406 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc800a6880 con 0x7fcc9015a010 2024-04-17T08:46:33.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.402+0000 7fcc95a00640 1 -- 172.21.15.152:0/3187170406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcc9015a010 msgr2=0x7fcc740039c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:33.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.402+0000 7fcc95a00640 1 --2- 172.21.15.152:0/3187170406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcc9015a010 0x7fcc740039c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcc80009b10 tx=0x7fcc8001cab0 comp rx=0 tx=0).stop 2024-04-17T08:46:33.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.402+0000 7fcc8f400640 1 -- 172.21.15.152:0/3187170406 reap_dead start 2024-04-17T08:46:33.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.402+0000 7fcc95a00640 1 -- 172.21.15.152:0/3187170406 shutdown_connections 2024-04-17T08:46:33.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.402+0000 7fcc95a00640 1 -- 172.21.15.152:0/3187170406 >> 172.21.15.152:0/3187170406 conn(0x7fcc900b3350 msgr2=0x7fcc900b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:33.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.402+0000 7fcc95a00640 1 -- 172.21.15.152:0/3187170406 shutdown_connections 2024-04-17T08:46:33.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.402+0000 7fcc95a00640 1 -- 172.21.15.152:0/3187170406 wait complete. 2024-04-17T08:46:33.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.402+0000 7fcc95a00640 1 Processor -- start 2024-04-17T08:46:33.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.402+0000 7fcc95a00640 1 -- start start 2024-04-17T08:46:33.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.402+0000 7fcc95a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcc9015a010 0x7fcc901f74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:33.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.402+0000 7fcc95a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcc9009db30 0x7fcc901f86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:33.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.402+0000 7fcc95a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcc901581a0 0x7fcc9015b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:33.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.402+0000 7fcc95a00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fcc9015e780 con 0x7fcc9009db30 2024-04-17T08:46:33.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.402+0000 7fcc95a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fcc9015e600 con 0x7fcc9015a010 2024-04-17T08:46:33.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.402+0000 7fcc95a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fcc9015e900 con 0x7fcc901581a0 2024-04-17T08:46:33.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.402+0000 7fcc87e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcc9009db30 0x7fcc901f86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:33.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.406+0000 7fcc87e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcc9009db30 0x7fcc901f86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40864/0 (socket says 172.21.15.152:40864) 2024-04-17T08:46:33.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.406+0000 7fcc87e00640 1 -- 172.21.15.152:0/83256633 learned_addr learned my addr 172.21.15.152:0/83256633 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:33.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.406+0000 7fcc8ea00640 1 --2- 172.21.15.152:0/83256633 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcc9015a010 0x7fcc901f74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:33.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.406+0000 7fcc8f400640 1 --2- 172.21.15.152:0/83256633 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcc901581a0 0x7fcc9015b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:33.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.406+0000 7fcc87e00640 1 -- 172.21.15.152:0/83256633 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcc901581a0 msgr2=0x7fcc9015b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:33.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.406+0000 7fcc87e00640 1 --2- 172.21.15.152:0/83256633 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcc901581a0 0x7fcc9015b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:33.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.406+0000 7fcc87e00640 1 -- 172.21.15.152:0/83256633 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcc9015a010 msgr2=0x7fcc901f74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:33.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.406+0000 7fcc87e00640 1 --2- 172.21.15.152:0/83256633 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcc9015a010 0x7fcc901f74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:33.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.406+0000 7fcc87e00640 1 -- 172.21.15.152:0/83256633 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc900cfd20 con 0x7fcc9009db30 2024-04-17T08:46:33.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.406+0000 7fcc8f400640 1 --2- 172.21.15.152:0/83256633 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcc901581a0 0x7fcc9015b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:46:33.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.406+0000 7fcc87e00640 1 --2- 172.21.15.152:0/83256633 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcc9009db30 0x7fcc901f86d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcc78007340 tx=0x7fcc78007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:33.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.406+0000 7fcc86a00640 1 -- 172.21.15.152:0/83256633 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc7800fa80 con 0x7fcc9009db30 2024-04-17T08:46:33.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.406+0000 7fcc86a00640 1 -- 172.21.15.152:0/83256633 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc78018070 con 0x7fcc9009db30 2024-04-17T08:46:33.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.406+0000 7fcc86a00640 1 -- 172.21.15.152:0/83256633 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc7800fe40 con 0x7fcc9009db30 2024-04-17T08:46:33.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.406+0000 7fcc95a00640 1 -- 172.21.15.152:0/83256633 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc901f8c10 con 0x7fcc9009db30 2024-04-17T08:46:33.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.406+0000 7fcc95a00640 1 -- 172.21.15.152:0/83256633 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc9006e190 con 0x7fcc9009db30 2024-04-17T08:46:33.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.406+0000 7fcc95a00640 1 -- 172.21.15.152:0/83256633 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc90068a30 con 0x7fcc9009db30 2024-04-17T08:46:33.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.406+0000 7fcc86a00640 1 -- 172.21.15.152:0/83256633 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcc7801d460 con 0x7fcc9009db30 2024-04-17T08:46:33.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.410+0000 7fcc86a00640 1 --2- 172.21.15.152:0/83256633 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fcc6c0683b0 0x7fcc6c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:33.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.410+0000 7fcc86a00640 1 -- 172.21.15.152:0/83256633 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7fcc780875d0 con 0x7fcc9009db30 2024-04-17T08:46:33.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.410+0000 7fcc8ea00640 1 --2- 172.21.15.152:0/83256633 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fcc6c0683b0 0x7fcc6c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:33.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.410+0000 7fcc8ea00640 1 --2- 172.21.15.152:0/83256633 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fcc6c0683b0 0x7fcc6c06a870 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcc800ad000 tx=0x7fcc800b2040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:33.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.414+0000 7fcc86a00640 1 -- 172.21.15.152:0/83256633 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fcc78057bd0 con 0x7fcc9009db30 2024-04-17T08:46:33.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:33.602+0000 7fcc95a00640 1 -- 172.21.15.152:0/83256633 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fcc9006d660 con 0x7fcc9009db30 2024-04-17T08:46:34.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.230+0000 7fcc86a00640 1 -- 172.21.15.152:0/83256633 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fcc780574d0 con 0x7fcc9009db30 2024-04-17T08:46:34.235 INFO:teuthology.orchestra.run.smithi152.stderr:new fs with metadata pool 2 and data pool 3 2024-04-17T08:46:34.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.238+0000 7fcc95a00640 1 -- 172.21.15.152:0/83256633 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fcc6c0683b0 msgr2=0x7fcc6c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:34.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.238+0000 7fcc95a00640 1 --2- 172.21.15.152:0/83256633 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fcc6c0683b0 0x7fcc6c06a870 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcc800ad000 tx=0x7fcc800b2040 comp rx=0 tx=0).stop 2024-04-17T08:46:34.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.238+0000 7fcc95a00640 1 -- 172.21.15.152:0/83256633 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcc9009db30 msgr2=0x7fcc901f86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:34.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.238+0000 7fcc95a00640 1 --2- 172.21.15.152:0/83256633 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcc9009db30 0x7fcc901f86d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcc78007340 tx=0x7fcc78007800 comp rx=0 tx=0).stop 2024-04-17T08:46:34.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.242+0000 7fcc95a00640 1 -- 172.21.15.152:0/83256633 shutdown_connections 2024-04-17T08:46:34.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.242+0000 7fcc95a00640 1 --2- 172.21.15.152:0/83256633 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fcc6c0683b0 0x7fcc6c06a870 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:34.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.242+0000 7fcc95a00640 1 --2- 172.21.15.152:0/83256633 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcc901581a0 0x7fcc9015b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:34.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.242+0000 7fcc95a00640 1 --2- 172.21.15.152:0/83256633 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcc9009db30 0x7fcc901f86d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:34.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.242+0000 7fcc95a00640 1 --2- 172.21.15.152:0/83256633 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcc9015a010 0x7fcc901f74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:34.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.242+0000 7fcc95a00640 1 -- 172.21.15.152:0/83256633 >> 172.21.15.152:0/83256633 conn(0x7fcc900b3350 msgr2=0x7fcc90071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:34.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.246+0000 7fcc95a00640 1 -- 172.21.15.152:0/83256633 shutdown_connections 2024-04-17T08:46:34.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.246+0000 7fcc95a00640 1 -- 172.21.15.152:0/83256633 wait complete. 2024-04-17T08:46:34.279 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-04-17T08:46:34.279 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-04-17T08:46:34.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.418+0000 7f4395200640 1 Processor -- start 2024-04-17T08:46:34.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.418+0000 7f4395200640 1 -- start start 2024-04-17T08:46:34.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.422+0000 7f4395200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f43900d0a70 0x7f4390160010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:34.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.422+0000 7f4395200640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4390160d20 con 0x7f439015d710 2024-04-17T08:46:34.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.422+0000 7f4395200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f439015cc30 con 0x7f439015a010 2024-04-17T08:46:34.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.422+0000 7f4395200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f439015d280 con 0x7f43900d0a70 2024-04-17T08:46:34.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.422+0000 7f438e800640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f439015d710 0x7f4390160550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:39800/0 (socket says 172.21.15.152:39800) 2024-04-17T08:46:34.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.422+0000 7f438e800640 1 -- 172.21.15.152:0/1447730659 learned_addr learned my addr 172.21.15.152:0/1447730659 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:46:34.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.422+0000 7f4385400640 1 --2- 172.21.15.152:0/1447730659 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f43900d0a70 0x7f4390160010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:34.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.422+0000 7f438d400640 1 -- 172.21.15.152:0/1447730659 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1052599085 0 0) 0x7f4390160d20 con 0x7f439015d710 2024-04-17T08:46:34.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.422+0000 7f438d400640 1 -- 172.21.15.152:0/1447730659 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4374003530 con 0x7f439015d710 2024-04-17T08:46:34.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.422+0000 7f438d400640 1 -- 172.21.15.152:0/1447730659 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4168061601 0 0) 0x7f439015cc30 con 0x7f439015a010 2024-04-17T08:46:34.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.422+0000 7f438d400640 1 -- 172.21.15.152:0/1447730659 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4390160d20 con 0x7f439015a010 2024-04-17T08:46:34.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.422+0000 7f4385400640 1 -- 172.21.15.152:0/1447730659 >> v1:172.21.15.196:6789/0 conn(0x7f439015a010 legacy=0x7f43900d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:34.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.422+0000 7f4385400640 1 -- 172.21.15.152:0/1447730659 >> v1:172.21.15.152:6789/0 conn(0x7f439015d710 legacy=0x7f4390160550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:34.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.422+0000 7f4385400640 1 -- 172.21.15.152:0/1447730659 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f439015cf10 con 0x7f43900d0a70 2024-04-17T08:46:34.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.426+0000 7f4385400640 1 --2- 172.21.15.152:0/1447730659 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f43900d0a70 0x7f4390160010 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f43780097f0 tx=0x7f437801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5c330a14c5128c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:34.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.426+0000 7f438d400640 1 -- 172.21.15.152:0/1447730659 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43780b0070 con 0x7f43900d0a70 2024-04-17T08:46:34.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.426+0000 7f438d400640 1 -- 172.21.15.152:0/1447730659 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43780ab600 con 0x7f43900d0a70 2024-04-17T08:46:34.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.426+0000 7f438d400640 1 -- 172.21.15.152:0/1447730659 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43780ab9b0 con 0x7f43900d0a70 2024-04-17T08:46:34.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.426+0000 7f4395200640 1 -- 172.21.15.152:0/1447730659 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f43900d0a70 msgr2=0x7f4390160010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:34.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.426+0000 7f4395200640 1 --2- 172.21.15.152:0/1447730659 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f43900d0a70 0x7f4390160010 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f43780097f0 tx=0x7f437801c450 comp rx=0 tx=0).stop 2024-04-17T08:46:34.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.426+0000 7f4395200640 1 -- 172.21.15.152:0/1447730659 shutdown_connections 2024-04-17T08:46:34.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.426+0000 7f4395200640 1 --2- 172.21.15.152:0/1447730659 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f43900d0a70 0x7f4390160010 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:34.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.426+0000 7f4395200640 1 -- 172.21.15.152:0/1447730659 >> 172.21.15.152:0/1447730659 conn(0x7f43900b3350 msgr2=0x7f43900b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:34.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.426+0000 7f4395200640 1 -- 172.21.15.152:0/1447730659 shutdown_connections 2024-04-17T08:46:34.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.426+0000 7f4395200640 1 -- 172.21.15.152:0/1447730659 wait complete. 2024-04-17T08:46:34.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.426+0000 7f4395200640 1 Processor -- start 2024-04-17T08:46:34.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.426+0000 7f4395200640 1 -- start start 2024-04-17T08:46:34.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.426+0000 7f4395200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f43900d0a70 0x7f4390099080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:34.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.426+0000 7f4395200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f439015a010 0x7f43901575b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:34.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.426+0000 7f4395200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f439015d710 0x7f4390157af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:34.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.426+0000 7f4395200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4390169f50 con 0x7f439015d710 2024-04-17T08:46:34.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.426+0000 7f4395200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4390169dd0 con 0x7f439015a010 2024-04-17T08:46:34.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.426+0000 7f4395200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f439016a0d0 con 0x7f43900d0a70 2024-04-17T08:46:34.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.426+0000 7f438e800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f439015d710 0x7f4390157af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:34.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.426+0000 7f438e800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f439015d710 0x7f4390157af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40872/0 (socket says 172.21.15.152:40872) 2024-04-17T08:46:34.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.430+0000 7f438e800640 1 -- 172.21.15.152:0/1098847728 learned_addr learned my addr 172.21.15.152:0/1098847728 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:34.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.430+0000 7f4385400640 1 --2- 172.21.15.152:0/1098847728 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f439015a010 0x7f43901575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:34.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.430+0000 7f438de00640 1 --2- 172.21.15.152:0/1098847728 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f43900d0a70 0x7f4390099080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:34.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.430+0000 7f438e800640 1 -- 172.21.15.152:0/1098847728 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f43900d0a70 msgr2=0x7f4390099080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:34.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.430+0000 7f438e800640 1 --2- 172.21.15.152:0/1098847728 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f43900d0a70 0x7f4390099080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:34.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.430+0000 7f438e800640 1 -- 172.21.15.152:0/1098847728 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f439015a010 msgr2=0x7f43901575b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:34.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.430+0000 7f438e800640 1 --2- 172.21.15.152:0/1098847728 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f439015a010 0x7f43901575b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:34.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.430+0000 7f438e800640 1 -- 172.21.15.152:0/1098847728 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f439014fbf0 con 0x7f439015d710 2024-04-17T08:46:34.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.430+0000 7f438e800640 1 --2- 172.21.15.152:0/1098847728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f439015d710 0x7f4390157af0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f438800ca80 tx=0x7f438800cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:34.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.430+0000 7f4386a00640 1 -- 172.21.15.152:0/1098847728 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4388017070 con 0x7f439015d710 2024-04-17T08:46:34.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.430+0000 7f4386a00640 1 -- 172.21.15.152:0/1098847728 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f438800abd0 con 0x7f439015d710 2024-04-17T08:46:34.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.430+0000 7f4395200640 1 -- 172.21.15.152:0/1098847728 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f439014fed0 con 0x7f439015d710 2024-04-17T08:46:34.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.430+0000 7f4386a00640 1 -- 172.21.15.152:0/1098847728 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4388012400 con 0x7f439015d710 2024-04-17T08:46:34.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.430+0000 7f4395200640 1 -- 172.21.15.152:0/1098847728 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4390150490 con 0x7f439015d710 2024-04-17T08:46:34.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.430+0000 7f4395200640 1 -- 172.21.15.152:0/1098847728 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4390068a30 con 0x7f439015d710 2024-04-17T08:46:34.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.430+0000 7f4386a00640 1 -- 172.21.15.152:0/1098847728 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f438801a070 con 0x7f439015d710 2024-04-17T08:46:34.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.430+0000 7f4386a00640 1 --2- 172.21.15.152:0/1098847728 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f436c068380 0x7f436c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:34.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.430+0000 7f4386a00640 1 -- 172.21.15.152:0/1098847728 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f4388086640 con 0x7f439015d710 2024-04-17T08:46:34.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.434+0000 7f438de00640 1 --2- 172.21.15.152:0/1098847728 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f436c068380 0x7f436c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:34.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.434+0000 7f438de00640 1 --2- 172.21.15.152:0/1098847728 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f436c068380 0x7f436c06a840 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f43800017c0 tx=0x7f4380009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:34.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.438+0000 7f4386a00640 1 -- 172.21.15.152:0/1098847728 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f43880565a0 con 0x7f439015d710 2024-04-17T08:46:34.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:34.602+0000 7f4395200640 1 -- 172.21.15.152:0/1098847728 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f439006d660 con 0x7f439015d710 2024-04-17T08:46:35.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.234+0000 7f4386a00640 1 -- 172.21.15.152:0/1098847728 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) ==== 157+0+0 (secure 0 0 0) 0x7f438805a8a0 con 0x7f439015d710 2024-04-17T08:46:35.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.238+0000 7f4395200640 1 -- 172.21.15.152:0/1098847728 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f436c068380 msgr2=0x7f436c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:35.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.238+0000 7f4395200640 1 --2- 172.21.15.152:0/1098847728 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f436c068380 0x7f436c06a840 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f43800017c0 tx=0x7f4380009040 comp rx=0 tx=0).stop 2024-04-17T08:46:35.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.238+0000 7f4395200640 1 -- 172.21.15.152:0/1098847728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f439015d710 msgr2=0x7f4390157af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:35.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.238+0000 7f4395200640 1 --2- 172.21.15.152:0/1098847728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f439015d710 0x7f4390157af0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f438800ca80 tx=0x7f438800cf40 comp rx=0 tx=0).stop 2024-04-17T08:46:35.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.238+0000 7f4395200640 1 -- 172.21.15.152:0/1098847728 shutdown_connections 2024-04-17T08:46:35.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.238+0000 7f4395200640 1 --2- 172.21.15.152:0/1098847728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f439015d710 0x7f4390157af0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:35.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.238+0000 7f4395200640 1 --2- 172.21.15.152:0/1098847728 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f439015a010 0x7f43901575b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:35.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.238+0000 7f4395200640 1 --2- 172.21.15.152:0/1098847728 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f436c068380 0x7f436c06a840 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:35.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.238+0000 7f4395200640 1 --2- 172.21.15.152:0/1098847728 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f43900d0a70 0x7f4390099080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:35.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.238+0000 7f4395200640 1 -- 172.21.15.152:0/1098847728 >> 172.21.15.152:0/1098847728 conn(0x7f43900b3350 msgr2=0x7f4390072850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:35.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.238+0000 7f4395200640 1 -- 172.21.15.152:0/1098847728 shutdown_connections 2024-04-17T08:46:35.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.238+0000 7f4395200640 1 -- 172.21.15.152:0/1098847728 wait complete. 2024-04-17T08:46:35.263 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-04-17T08:46:35.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.406+0000 7f562b800640 1 Processor -- start 2024-04-17T08:46:35.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.406+0000 7f562b800640 1 -- start start 2024-04-17T08:46:35.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.410+0000 7f562b800640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f56240cba80 0x7f56240b5320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:35.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.410+0000 7f562b800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f56240cbe60 0x7f56240cd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:35.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.410+0000 7f562b800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f5624160750 0x7f562415c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:35.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.410+0000 7f562b800640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f562415ffe0 con 0x7f56240cba80 2024-04-17T08:46:35.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.410+0000 7f562b800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f56240b59b0 con 0x7f5624160750 2024-04-17T08:46:35.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.410+0000 7f562b800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f56240b5c90 con 0x7f56240cbe60 2024-04-17T08:46:35.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.410+0000 7f5628e00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f56240cba80 0x7f56240b5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:35.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.410+0000 7f5628e00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f56240cba80 0x7f56240b5320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40884/0 (socket says 172.21.15.152:40884) 2024-04-17T08:46:35.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.410+0000 7f5628e00640 1 -- 172.21.15.152:0/663899478 learned_addr learned my addr 172.21.15.152:0/663899478 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:35.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.410+0000 7f561be00640 1 --2- 172.21.15.152:0/663899478 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f56240cbe60 0x7f56240cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:35.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.410+0000 7f5629800640 1 --2- 172.21.15.152:0/663899478 >> v2:172.21.15.196:3300/0 conn(0x7f5624160750 0x7f562415c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:35.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.410+0000 7f5628e00640 1 -- 172.21.15.152:0/663899478 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f56240cbe60 msgr2=0x7f56240cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:35.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.410+0000 7f5628e00640 1 --2- 172.21.15.152:0/663899478 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f56240cbe60 0x7f56240cd080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:35.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.410+0000 7f5628e00640 1 -- 172.21.15.152:0/663899478 >> v2:172.21.15.196:3300/0 conn(0x7f5624160750 msgr2=0x7f562415c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:35.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.410+0000 7f5628e00640 1 --2- 172.21.15.152:0/663899478 >> v2:172.21.15.196:3300/0 conn(0x7f5624160750 0x7f562415c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:35.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.410+0000 7f5628e00640 1 -- 172.21.15.152:0/663899478 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56240b5f70 con 0x7f56240cba80 2024-04-17T08:46:35.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.410+0000 7f561be00640 1 --2- 172.21.15.152:0/663899478 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f56240cbe60 0x7f56240cd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:46:35.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.410+0000 7f5629800640 1 --2- 172.21.15.152:0/663899478 >> v2:172.21.15.196:3300/0 conn(0x7f5624160750 0x7f562415c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:46:35.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.414+0000 7f5628e00640 1 --2- 172.21.15.152:0/663899478 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f56240cba80 0x7f56240b5320 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f562415a5c0 tx=0x7f561401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b0a2b574522e67 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:35.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.414+0000 7f5623e00640 1 -- 172.21.15.152:0/663899478 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56140b0070 con 0x7f56240cba80 2024-04-17T08:46:35.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.414+0000 7f5623e00640 1 -- 172.21.15.152:0/663899478 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56140ab600 con 0x7f56240cba80 2024-04-17T08:46:35.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.414+0000 7f5623e00640 1 -- 172.21.15.152:0/663899478 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56140ab9d0 con 0x7f56240cba80 2024-04-17T08:46:35.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.414+0000 7f562b800640 1 -- 172.21.15.152:0/663899478 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f56240cba80 msgr2=0x7f56240b5320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:35.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.414+0000 7f562b800640 1 --2- 172.21.15.152:0/663899478 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f56240cba80 0x7f56240b5320 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f562415a5c0 tx=0x7f561401c520 comp rx=0 tx=0).stop 2024-04-17T08:46:35.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.414+0000 7f562b800640 1 -- 172.21.15.152:0/663899478 shutdown_connections 2024-04-17T08:46:35.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.414+0000 7f562b800640 1 --2- 172.21.15.152:0/663899478 >> v2:172.21.15.196:3300/0 conn(0x7f5624160750 0x7f562415c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:35.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.414+0000 7f562b800640 1 --2- 172.21.15.152:0/663899478 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f56240cbe60 0x7f56240cd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:35.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.414+0000 7f562b800640 1 --2- 172.21.15.152:0/663899478 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f56240cba80 0x7f56240b5320 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:35.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.414+0000 7f562b800640 1 -- 172.21.15.152:0/663899478 >> 172.21.15.152:0/663899478 conn(0x7f56240b1e90 msgr2=0x7f56240b22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:35.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.414+0000 7f562b800640 1 -- 172.21.15.152:0/663899478 shutdown_connections 2024-04-17T08:46:35.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.414+0000 7f562b800640 1 -- 172.21.15.152:0/663899478 wait complete. 2024-04-17T08:46:35.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.414+0000 7f562b800640 1 Processor -- start 2024-04-17T08:46:35.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.414+0000 7f562b800640 1 -- start start 2024-04-17T08:46:35.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.414+0000 7f562b800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f56240cba80 0x7f5624141210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:35.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.414+0000 7f562b800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f56240cbe60 0x7f5624073870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:35.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.414+0000 7f562b800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5624160750 0x7f562415f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:35.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.414+0000 7f562b800640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f56240cc3c0 con 0x7f56240cba80 2024-04-17T08:46:35.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.414+0000 7f562b800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f56240cc240 con 0x7f5624160750 2024-04-17T08:46:35.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.414+0000 7f562b800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f56240cb020 con 0x7f56240cbe60 2024-04-17T08:46:35.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.418+0000 7f5628e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f56240cba80 0x7f5624141210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:35.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.418+0000 7f5628e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f56240cba80 0x7f5624141210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40892/0 (socket says 172.21.15.152:40892) 2024-04-17T08:46:35.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.418+0000 7f5628e00640 1 -- 172.21.15.152:0/3056408577 learned_addr learned my addr 172.21.15.152:0/3056408577 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:35.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.418+0000 7f5629800640 1 --2- 172.21.15.152:0/3056408577 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5624160750 0x7f562415f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:35.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.418+0000 7f561be00640 1 --2- 172.21.15.152:0/3056408577 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f56240cbe60 0x7f5624073870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:35.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.418+0000 7f5628e00640 1 -- 172.21.15.152:0/3056408577 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f56240cbe60 msgr2=0x7f5624073870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:35.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.418+0000 7f5628e00640 1 --2- 172.21.15.152:0/3056408577 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f56240cbe60 0x7f5624073870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:35.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.418+0000 7f5628e00640 1 -- 172.21.15.152:0/3056408577 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5624160750 msgr2=0x7f562415f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:35.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.418+0000 7f5628e00640 1 --2- 172.21.15.152:0/3056408577 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5624160750 0x7f562415f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:35.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.418+0000 7f5628e00640 1 -- 172.21.15.152:0/3056408577 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f562414fe00 con 0x7f56240cba80 2024-04-17T08:46:35.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.418+0000 7f5629800640 1 --2- 172.21.15.152:0/3056408577 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5624160750 0x7f562415f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:46:35.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.418+0000 7f561be00640 1 --2- 172.21.15.152:0/3056408577 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f56240cbe60 0x7f5624073870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:46:35.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.418+0000 7f5628e00640 1 --2- 172.21.15.152:0/3056408577 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f56240cba80 0x7f5624141210 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f561401cdc0 tx=0x7f561401ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:35.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.418+0000 7f5621600640 1 -- 172.21.15.152:0/3056408577 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56140b0040 con 0x7f56240cba80 2024-04-17T08:46:35.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.418+0000 7f5621600640 1 -- 172.21.15.152:0/3056408577 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56140bc070 con 0x7f56240cba80 2024-04-17T08:46:35.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.418+0000 7f5621600640 1 -- 172.21.15.152:0/3056408577 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56140b6660 con 0x7f56240cba80 2024-04-17T08:46:35.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.418+0000 7f562b800640 1 -- 172.21.15.152:0/3056408577 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56241500e0 con 0x7f56240cba80 2024-04-17T08:46:35.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.418+0000 7f562b800640 1 -- 172.21.15.152:0/3056408577 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56241506a0 con 0x7f56240cba80 2024-04-17T08:46:35.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.418+0000 7f562b800640 1 -- 172.21.15.152:0/3056408577 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5624068a30 con 0x7f56240cba80 2024-04-17T08:46:35.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.418+0000 7f5621600640 1 -- 172.21.15.152:0/3056408577 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f56140b6800 con 0x7f56240cba80 2024-04-17T08:46:35.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.418+0000 7f5621600640 1 --2- 172.21.15.152:0/3056408577 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5600068380 0x7f560006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:35.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.422+0000 7f5621600640 1 -- 172.21.15.152:0/3056408577 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 6007+0+0 (secure 0 0 0) 0x7f5614120f50 con 0x7f56240cba80 2024-04-17T08:46:35.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.422+0000 7f561be00640 1 --2- 172.21.15.152:0/3056408577 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5600068380 0x7f560006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:35.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.422+0000 7f561be00640 1 --2- 172.21.15.152:0/3056408577 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5600068380 0x7f560006a840 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5624150dc0 tx=0x7f560c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:35.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.426+0000 7f5621600640 1 -- 172.21.15.152:0/3056408577 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f5614016110 con 0x7f56240cba80 2024-04-17T08:46:35.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:35.578+0000 7f562b800640 1 -- 172.21.15.152:0/3056408577 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f562406c0c0 con 0x7f56240cba80 2024-04-17T08:46:37.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.250+0000 7f5621600640 1 -- 172.21.15.152:0/3056408577 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) ==== 228+0+0 (secure 0 0 0) 0x7f56140f1340 con 0x7f56240cba80 2024-04-17T08:46:37.251 INFO:teuthology.orchestra.run.smithi152.stderr:pool 'cephfs_data_ec' created 2024-04-17T08:46:37.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.254+0000 7f562b800640 1 -- 172.21.15.152:0/3056408577 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5600068380 msgr2=0x7f560006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:37.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.254+0000 7f562b800640 1 --2- 172.21.15.152:0/3056408577 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5600068380 0x7f560006a840 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5624150dc0 tx=0x7f560c008040 comp rx=0 tx=0).stop 2024-04-17T08:46:37.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.254+0000 7f562b800640 1 -- 172.21.15.152:0/3056408577 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f56240cba80 msgr2=0x7f5624141210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:37.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.254+0000 7f562b800640 1 --2- 172.21.15.152:0/3056408577 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f56240cba80 0x7f5624141210 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f561401cdc0 tx=0x7f561401ad60 comp rx=0 tx=0).stop 2024-04-17T08:46:37.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.254+0000 7f562b800640 1 -- 172.21.15.152:0/3056408577 shutdown_connections 2024-04-17T08:46:37.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.254+0000 7f562b800640 1 --2- 172.21.15.152:0/3056408577 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5624160750 0x7f562415f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:37.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.254+0000 7f562b800640 1 --2- 172.21.15.152:0/3056408577 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5600068380 0x7f560006a840 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:37.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.254+0000 7f562b800640 1 --2- 172.21.15.152:0/3056408577 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f56240cbe60 0x7f5624073870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:37.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.254+0000 7f562b800640 1 --2- 172.21.15.152:0/3056408577 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f56240cba80 0x7f5624141210 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:37.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.254+0000 7f562b800640 1 -- 172.21.15.152:0/3056408577 >> 172.21.15.152:0/3056408577 conn(0x7f56240b1e90 msgr2=0x7f5624154390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:37.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.254+0000 7f562b800640 1 -- 172.21.15.152:0/3056408577 shutdown_connections 2024-04-17T08:46:37.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.254+0000 7f562b800640 1 -- 172.21.15.152:0/3056408577 wait complete. 2024-04-17T08:46:37.288 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-04-17T08:46:37.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.430+0000 7f8e5e000640 1 Processor -- start 2024-04-17T08:46:37.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.430+0000 7f8e5e000640 1 -- start start 2024-04-17T08:46:37.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.430+0000 7f8e5e000640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f8e58148190 0x7f8e580b3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:37.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.430+0000 7f8e5e000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f8e580b52e0 0x7f8e5806e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:37.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.430+0000 7f8e5e000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8e580b4740 0x7f8e580b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:37.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.430+0000 7f8e5e000640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f8e58148570 con 0x7f8e58148190 2024-04-17T08:46:37.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.430+0000 7f8e5e000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f8e580aebe0 con 0x7f8e580b52e0 2024-04-17T08:46:37.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.430+0000 7f8e5e000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f8e5806bae0 con 0x7f8e580b4740 2024-04-17T08:46:37.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.430+0000 7f8e57400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f8e58148190 0x7f8e580b3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:37.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.430+0000 7f8e57400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f8e58148190 0x7f8e580b3d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40896/0 (socket says 172.21.15.152:40896) 2024-04-17T08:46:37.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.430+0000 7f8e57400640 1 -- 172.21.15.152:0/4249913482 learned_addr learned my addr 172.21.15.152:0/4249913482 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:37.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.430+0000 7f8e4ea00640 1 --2- 172.21.15.152:0/4249913482 >> v2:172.21.15.196:3300/0 conn(0x7f8e580b52e0 0x7f8e5806e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:37.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.430+0000 7f8e57e00640 1 --2- 172.21.15.152:0/4249913482 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8e580b4740 0x7f8e580b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:37.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.430+0000 7f8e57400640 1 -- 172.21.15.152:0/4249913482 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8e580b4740 msgr2=0x7f8e580b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:37.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.430+0000 7f8e57400640 1 --2- 172.21.15.152:0/4249913482 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8e580b4740 0x7f8e580b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:37.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.430+0000 7f8e57400640 1 -- 172.21.15.152:0/4249913482 >> v2:172.21.15.196:3300/0 conn(0x7f8e580b52e0 msgr2=0x7f8e5806e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:37.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.430+0000 7f8e57400640 1 --2- 172.21.15.152:0/4249913482 >> v2:172.21.15.196:3300/0 conn(0x7f8e580b52e0 0x7f8e5806e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:37.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.430+0000 7f8e57400640 1 -- 172.21.15.152:0/4249913482 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e5806bdc0 con 0x7f8e58148190 2024-04-17T08:46:37.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.430+0000 7f8e4ea00640 1 --2- 172.21.15.152:0/4249913482 >> v2:172.21.15.196:3300/0 conn(0x7f8e580b52e0 0x7f8e5806e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:46:37.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.434+0000 7f8e57400640 1 --2- 172.21.15.152:0/4249913482 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e58148190 0x7f8e580b3d70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8e580d1670 tx=0x7f8e4801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85bf8ec0af6e19e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:37.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.434+0000 7f8e56a00640 1 -- 172.21.15.152:0/4249913482 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e480b0070 con 0x7f8e58148190 2024-04-17T08:46:37.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.434+0000 7f8e56a00640 1 -- 172.21.15.152:0/4249913482 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e480ab600 con 0x7f8e58148190 2024-04-17T08:46:37.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.434+0000 7f8e56a00640 1 -- 172.21.15.152:0/4249913482 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e480ab9d0 con 0x7f8e58148190 2024-04-17T08:46:37.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.434+0000 7f8e5e000640 1 -- 172.21.15.152:0/4249913482 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e58148190 msgr2=0x7f8e580b3d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:37.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.434+0000 7f8e5e000640 1 --2- 172.21.15.152:0/4249913482 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e58148190 0x7f8e580b3d70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8e580d1670 tx=0x7f8e4801c490 comp rx=0 tx=0).stop 2024-04-17T08:46:37.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.434+0000 7f8e5e000640 1 -- 172.21.15.152:0/4249913482 shutdown_connections 2024-04-17T08:46:37.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.434+0000 7f8e5e000640 1 --2- 172.21.15.152:0/4249913482 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8e580b4740 0x7f8e580b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:37.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.434+0000 7f8e5e000640 1 --2- 172.21.15.152:0/4249913482 >> v2:172.21.15.196:3300/0 conn(0x7f8e580b52e0 0x7f8e5806e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:37.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.434+0000 7f8e5e000640 1 --2- 172.21.15.152:0/4249913482 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e58148190 0x7f8e580b3d70 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:37.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.434+0000 7f8e5e000640 1 -- 172.21.15.152:0/4249913482 >> 172.21.15.152:0/4249913482 conn(0x7f8e580d0570 msgr2=0x7f8e580d0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:37.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.434+0000 7f8e5e000640 1 -- 172.21.15.152:0/4249913482 shutdown_connections 2024-04-17T08:46:37.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.434+0000 7f8e5e000640 1 -- 172.21.15.152:0/4249913482 wait complete. 2024-04-17T08:46:37.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.438+0000 7f8e5e000640 1 Processor -- start 2024-04-17T08:46:37.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.438+0000 7f8e5e000640 1 -- start start 2024-04-17T08:46:37.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.438+0000 7f8e5e000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8e580b4740 0x7f8e58163e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:37.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.438+0000 7f8e5e000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e580b52e0 0x7f8e58164350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:37.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.438+0000 7f8e5e000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8e58148190 0x7f8e58164890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:37.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.438+0000 7f8e5e000640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8e5806cf50 con 0x7f8e580b52e0 2024-04-17T08:46:37.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.438+0000 7f8e5e000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8e5806cdd0 con 0x7f8e580b4740 2024-04-17T08:46:37.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.438+0000 7f8e5e000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f8e5806d0d0 con 0x7f8e58148190 2024-04-17T08:46:37.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.438+0000 7f8e4ea00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e580b52e0 0x7f8e58164350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:37.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.438+0000 7f8e4ea00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e580b52e0 0x7f8e58164350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40906/0 (socket says 172.21.15.152:40906) 2024-04-17T08:46:37.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.438+0000 7f8e4ea00640 1 -- 172.21.15.152:0/1718763624 learned_addr learned my addr 172.21.15.152:0/1718763624 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:37.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.438+0000 7f8e57400640 1 --2- 172.21.15.152:0/1718763624 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8e580b4740 0x7f8e58163e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:37.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.438+0000 7f8e57e00640 1 --2- 172.21.15.152:0/1718763624 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8e58148190 0x7f8e58164890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:37.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.438+0000 7f8e4ea00640 1 -- 172.21.15.152:0/1718763624 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8e58148190 msgr2=0x7f8e58164890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:37.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.438+0000 7f8e4ea00640 1 --2- 172.21.15.152:0/1718763624 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8e58148190 0x7f8e58164890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:37.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.438+0000 7f8e4ea00640 1 -- 172.21.15.152:0/1718763624 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8e580b4740 msgr2=0x7f8e58163e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:37.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.438+0000 7f8e4ea00640 1 --2- 172.21.15.152:0/1718763624 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8e580b4740 0x7f8e58163e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:37.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.438+0000 7f8e4ea00640 1 -- 172.21.15.152:0/1718763624 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e58162d50 con 0x7f8e580b52e0 2024-04-17T08:46:37.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.438+0000 7f8e57e00640 1 --2- 172.21.15.152:0/1718763624 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8e58148190 0x7f8e58164890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:46:37.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.438+0000 7f8e4ea00640 1 --2- 172.21.15.152:0/1718763624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e580b52e0 0x7f8e58164350 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8e4000e810 tx=0x7f8e4000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:37.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.438+0000 7f8e4fe00640 1 -- 172.21.15.152:0/1718763624 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e40017070 con 0x7f8e580b52e0 2024-04-17T08:46:37.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.438+0000 7f8e4fe00640 1 -- 172.21.15.152:0/1718763624 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e4000c8d0 con 0x7f8e580b52e0 2024-04-17T08:46:37.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.438+0000 7f8e4fe00640 1 -- 172.21.15.152:0/1718763624 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e4000f040 con 0x7f8e580b52e0 2024-04-17T08:46:37.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.438+0000 7f8e5e000640 1 -- 172.21.15.152:0/1718763624 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e58166d60 con 0x7f8e580b52e0 2024-04-17T08:46:37.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.438+0000 7f8e5e000640 1 -- 172.21.15.152:0/1718763624 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e58167320 con 0x7f8e580b52e0 2024-04-17T08:46:37.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.438+0000 7f8e5e000640 1 -- 172.21.15.152:0/1718763624 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e58068a30 con 0x7f8e580b52e0 2024-04-17T08:46:37.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.442+0000 7f8e4fe00640 1 -- 172.21.15.152:0/1718763624 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8e4001a070 con 0x7f8e580b52e0 2024-04-17T08:46:37.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.442+0000 7f8e4fe00640 1 --2- 172.21.15.152:0/1718763624 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8e34068380 0x7f8e3406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:37.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.442+0000 7f8e4fe00640 1 -- 172.21.15.152:0/1718763624 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6500+0+0 (secure 0 0 0) 0x7f8e40086890 con 0x7f8e580b52e0 2024-04-17T08:46:37.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.442+0000 7f8e57400640 1 --2- 172.21.15.152:0/1718763624 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8e34068380 0x7f8e3406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:37.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.442+0000 7f8e57400640 1 --2- 172.21.15.152:0/1718763624 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8e34068380 0x7f8e3406a840 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8e480ad000 tx=0x7f8e480a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:37.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.446+0000 7f8e4fe00640 1 -- 172.21.15.152:0/1718763624 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f8e400564d0 con 0x7f8e580b52e0 2024-04-17T08:46:37.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:37.602+0000 7f8e5e000640 1 -- 172.21.15.152:0/1718763624 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f8e58144f10 con 0x7f8e580b52e0 2024-04-17T08:46:38.187 INFO:tasks.ceph.mds.c.smithi152.stderr:2024-04-17T08:46:38.186+0000 7f6556600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-17T08:46:38.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.254+0000 7f8e4fe00640 1 -- 172.21.15.152:0/1718763624 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) ==== 169+0+0 (secure 0 0 0) 0x7f8e40084e20 con 0x7f8e580b52e0 2024-04-17T08:46:38.257 INFO:teuthology.orchestra.run.smithi152.stderr:set pool 4 allow_ec_overwrites to true 2024-04-17T08:46:38.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.262+0000 7f8e5e000640 1 -- 172.21.15.152:0/1718763624 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8e34068380 msgr2=0x7f8e3406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:38.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.262+0000 7f8e5e000640 1 --2- 172.21.15.152:0/1718763624 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8e34068380 0x7f8e3406a840 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8e480ad000 tx=0x7f8e480a6000 comp rx=0 tx=0).stop 2024-04-17T08:46:38.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.262+0000 7f8e5e000640 1 -- 172.21.15.152:0/1718763624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e580b52e0 msgr2=0x7f8e58164350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:38.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.262+0000 7f8e5e000640 1 --2- 172.21.15.152:0/1718763624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e580b52e0 0x7f8e58164350 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8e4000e810 tx=0x7f8e4000ecd0 comp rx=0 tx=0).stop 2024-04-17T08:46:38.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.262+0000 7f8e5e000640 1 -- 172.21.15.152:0/1718763624 shutdown_connections 2024-04-17T08:46:38.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.262+0000 7f8e5e000640 1 --2- 172.21.15.152:0/1718763624 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8e34068380 0x7f8e3406a840 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:38.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.262+0000 7f8e5e000640 1 --2- 172.21.15.152:0/1718763624 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8e58148190 0x7f8e58164890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:38.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.262+0000 7f8e5e000640 1 --2- 172.21.15.152:0/1718763624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e580b52e0 0x7f8e58164350 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:38.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.262+0000 7f8e5e000640 1 --2- 172.21.15.152:0/1718763624 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8e580b4740 0x7f8e58163e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:38.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.262+0000 7f8e5e000640 1 -- 172.21.15.152:0/1718763624 >> 172.21.15.152:0/1718763624 conn(0x7f8e580d0570 msgr2=0x7f8e580b0260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:38.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.266+0000 7f8e5e000640 1 -- 172.21.15.152:0/1718763624 shutdown_connections 2024-04-17T08:46:38.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.270+0000 7f8e5e000640 1 -- 172.21.15.152:0/1718763624 wait complete. 2024-04-17T08:46:38.303 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-04-17T08:46:38.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.442+0000 7f931f200640 1 Processor -- start 2024-04-17T08:46:38.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.442+0000 7f931f200640 1 -- start start 2024-04-17T08:46:38.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.442+0000 7f931f200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93180d07c0 0x7f93180adae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:38.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.442+0000 7f931f200640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f931806e6b0 con 0x7f9318161b70 2024-04-17T08:46:38.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.442+0000 7f931f200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f931806e990 con 0x7f93180d0360 2024-04-17T08:46:38.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.442+0000 7f931f200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f9318161f50 con 0x7f93180d07c0 2024-04-17T08:46:38.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.442+0000 7f9317e00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f9318161b70 0x7f931806dc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:56764/0 (socket says 172.21.15.152:56764) 2024-04-17T08:46:38.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.442+0000 7f9317e00640 1 -- 172.21.15.152:0/3370050288 learned_addr learned my addr 172.21.15.152:0/3370050288 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:46:38.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.442+0000 7f931d200640 1 --2- 172.21.15.152:0/3370050288 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93180d07c0 0x7f93180adae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:38.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.442+0000 7f9317400640 1 -- 172.21.15.152:0/3370050288 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1769976659 0 0) 0x7f931806e6b0 con 0x7f9318161b70 2024-04-17T08:46:38.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.442+0000 7f9317400640 1 -- 172.21.15.152:0/3370050288 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92fc003530 con 0x7f9318161b70 2024-04-17T08:46:38.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.442+0000 7f9317400640 1 -- 172.21.15.152:0/3370050288 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2560449187 0 0) 0x7f931806e990 con 0x7f93180d0360 2024-04-17T08:46:38.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.442+0000 7f9317400640 1 -- 172.21.15.152:0/3370050288 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f931806e6b0 con 0x7f93180d0360 2024-04-17T08:46:38.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.442+0000 7f9317400640 1 -- 172.21.15.152:0/3370050288 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3650870103 0 0) 0x7f92fc003530 con 0x7f9318161b70 2024-04-17T08:46:38.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.442+0000 7f9317400640 1 -- 172.21.15.152:0/3370050288 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93180d07c0 msgr2=0x7f93180adae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:38.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.442+0000 7f9317400640 1 --2- 172.21.15.152:0/3370050288 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93180d07c0 0x7f93180adae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:38.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.442+0000 7f9317400640 1 -- 172.21.15.152:0/3370050288 >> v1:172.21.15.196:6789/0 conn(0x7f93180d0360 legacy=0x7f93180ad3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:38.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.442+0000 7f9317400640 1 -- 172.21.15.152:0/3370050288 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f931806ec70 con 0x7f9318161b70 2024-04-17T08:46:38.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.442+0000 7f9317400640 1 -- 172.21.15.152:0/3370050288 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2973887244 0 0) 0x7f9308001680 con 0x7f9318161b70 2024-04-17T08:46:38.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.442+0000 7f9317400640 1 -- 172.21.15.152:0/3370050288 >> v1:172.21.15.152:6789/0 conn(0x7f9318161b70 legacy=0x7f931806dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:38.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.442+0000 7f9317400640 1 --2- 172.21.15.152:0/3370050288 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93180d07c0 0x7f92fc003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:38.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.442+0000 7f9317400640 1 --2- 172.21.15.152:0/3370050288 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f92fc0040e0 0x7f92fc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:38.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.442+0000 7f9317400640 1 --2- 172.21.15.152:0/3370050288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92fc004d50 0x7f92fc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:38.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.442+0000 7f9317400640 1 -- 172.21.15.152:0/3370050288 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9318161f50 con 0x7f92fc004d50 2024-04-17T08:46:38.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.442+0000 7f9317400640 1 -- 172.21.15.152:0/3370050288 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f92fc00bb60 con 0x7f92fc0040e0 2024-04-17T08:46:38.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.442+0000 7f9317400640 1 -- 172.21.15.152:0/3370050288 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f92fc00bd30 con 0x7f93180d07c0 2024-04-17T08:46:38.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.442+0000 7f931d200640 1 --2- 172.21.15.152:0/3370050288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92fc004d50 0x7f92fc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:38.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.442+0000 7f9317e00640 1 --2- 172.21.15.152:0/3370050288 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93180d07c0 0x7f92fc003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:38.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.442+0000 7f930f400640 1 --2- 172.21.15.152:0/3370050288 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f92fc0040e0 0x7f92fc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:38.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.442+0000 7f931d200640 1 -- 172.21.15.152:0/3370050288 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93180d07c0 msgr2=0x7f92fc003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:38.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.442+0000 7f931d200640 1 --2- 172.21.15.152:0/3370050288 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93180d07c0 0x7f92fc003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:38.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.442+0000 7f931d200640 1 -- 172.21.15.152:0/3370050288 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f92fc0040e0 msgr2=0x7f92fc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:38.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.442+0000 7f931d200640 1 --2- 172.21.15.152:0/3370050288 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f92fc0040e0 0x7f92fc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:38.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.442+0000 7f931d200640 1 -- 172.21.15.152:0/3370050288 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92fc003530 con 0x7f92fc004d50 2024-04-17T08:46:38.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.446+0000 7f931d200640 1 --2- 172.21.15.152:0/3370050288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92fc004d50 0x7f92fc0051d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9310009fc0 tx=0x7f931001cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66d16c8563131f27 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:38.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.446+0000 7f9317400640 1 -- 172.21.15.152:0/3370050288 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93100b2070 con 0x7f92fc004d50 2024-04-17T08:46:38.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.446+0000 7f9317400640 1 -- 172.21.15.152:0/3370050288 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93100a5c90 con 0x7f92fc004d50 2024-04-17T08:46:38.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.446+0000 7f9317400640 1 -- 172.21.15.152:0/3370050288 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9310009c10 con 0x7f92fc004d50 2024-04-17T08:46:38.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.446+0000 7f931f200640 1 -- 172.21.15.152:0/3370050288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92fc004d50 msgr2=0x7f92fc0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:38.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.446+0000 7f931f200640 1 --2- 172.21.15.152:0/3370050288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92fc004d50 0x7f92fc0051d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9310009fc0 tx=0x7f931001cc80 comp rx=0 tx=0).stop 2024-04-17T08:46:38.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.446+0000 7f931d200640 1 -- 172.21.15.152:0/3370050288 reap_dead start 2024-04-17T08:46:38.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.446+0000 7f931f200640 1 -- 172.21.15.152:0/3370050288 shutdown_connections 2024-04-17T08:46:38.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.446+0000 7f931f200640 1 -- 172.21.15.152:0/3370050288 >> 172.21.15.152:0/3370050288 conn(0x7f93180b3350 msgr2=0x7f93180b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:38.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.446+0000 7f931f200640 1 -- 172.21.15.152:0/3370050288 shutdown_connections 2024-04-17T08:46:38.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.446+0000 7f931f200640 1 -- 172.21.15.152:0/3370050288 wait complete. 2024-04-17T08:46:38.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.450+0000 7f931f200640 1 Processor -- start 2024-04-17T08:46:38.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.450+0000 7f931f200640 1 -- start start 2024-04-17T08:46:38.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.450+0000 7f931f200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f92fc004d50 0x7f93180aff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:38.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.450+0000 7f931f200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f931815c9b0 0x7f931815ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:38.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.450+0000 7f931f200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f931815ce30 0x7f931815b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:38.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.450+0000 7f931f200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f93180d0c10 con 0x7f931815c9b0 2024-04-17T08:46:38.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.450+0000 7f931f200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f931806f230 con 0x7f92fc004d50 2024-04-17T08:46:38.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.450+0000 7f931f200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f931806e370 con 0x7f931815ce30 2024-04-17T08:46:38.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.450+0000 7f930f400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f931815c9b0 0x7f931815ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:38.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.450+0000 7f930f400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f931815c9b0 0x7f931815ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35452/0 (socket says 172.21.15.152:35452) 2024-04-17T08:46:38.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.450+0000 7f930f400640 1 -- 172.21.15.152:0/2933561408 learned_addr learned my addr 172.21.15.152:0/2933561408 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:38.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.450+0000 7f9317e00640 1 --2- 172.21.15.152:0/2933561408 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f92fc004d50 0x7f93180aff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:38.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.450+0000 7f931d200640 1 --2- 172.21.15.152:0/2933561408 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f931815ce30 0x7f931815b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:38.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.450+0000 7f930f400640 1 -- 172.21.15.152:0/2933561408 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f931815ce30 msgr2=0x7f931815b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:38.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.450+0000 7f930f400640 1 --2- 172.21.15.152:0/2933561408 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f931815ce30 0x7f931815b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:38.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.450+0000 7f930f400640 1 -- 172.21.15.152:0/2933561408 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f92fc004d50 msgr2=0x7f93180aff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:38.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.450+0000 7f930f400640 1 --2- 172.21.15.152:0/2933561408 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f92fc004d50 0x7f93180aff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:38.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.450+0000 7f930f400640 1 -- 172.21.15.152:0/2933561408 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9318158480 con 0x7f931815c9b0 2024-04-17T08:46:38.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.450+0000 7f930f400640 1 --2- 172.21.15.152:0/2933561408 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f931815c9b0 0x7f931815ada0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9300012860 tx=0x7f9300012d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:38.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.450+0000 7f9314c00640 1 -- 172.21.15.152:0/2933561408 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9300010bd0 con 0x7f931815c9b0 2024-04-17T08:46:38.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.450+0000 7f9314c00640 1 -- 172.21.15.152:0/2933561408 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f930001b070 con 0x7f931815c9b0 2024-04-17T08:46:38.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.450+0000 7f9314c00640 1 -- 172.21.15.152:0/2933561408 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9300016480 con 0x7f931815c9b0 2024-04-17T08:46:38.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.450+0000 7f931f200640 1 -- 172.21.15.152:0/2933561408 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f931815b910 con 0x7f931815c9b0 2024-04-17T08:46:38.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.450+0000 7f931f200640 1 -- 172.21.15.152:0/2933561408 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f931815bed0 con 0x7f931815c9b0 2024-04-17T08:46:38.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.454+0000 7f931f200640 1 -- 172.21.15.152:0/2933561408 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9318068a30 con 0x7f931815c9b0 2024-04-17T08:46:38.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.454+0000 7f9314c00640 1 -- 172.21.15.152:0/2933561408 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9300016620 con 0x7f931815c9b0 2024-04-17T08:46:38.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.454+0000 7f9314c00640 1 --2- 172.21.15.152:0/2933561408 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f92f4068380 0x7f92f406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:38.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.454+0000 7f9314c00640 1 -- 172.21.15.152:0/2933561408 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7f930008a530 con 0x7f931815c9b0 2024-04-17T08:46:38.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.454+0000 7f9317e00640 1 --2- 172.21.15.152:0/2933561408 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f92f4068380 0x7f92f406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:38.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.454+0000 7f9317e00640 1 --2- 172.21.15.152:0/2933561408 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f92f4068380 0x7f92f406a840 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9308001ec0 tx=0x7f9308001e50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:38.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.458+0000 7f9314c00640 1 -- 172.21.15.152:0/2933561408 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f930005a0e0 con 0x7f931815c9b0 2024-04-17T08:46:38.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:38.654+0000 7f931f200640 1 -- 172.21.15.152:0/2933561408 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f9318160320 con 0x7f931815c9b0 2024-04-17T08:46:39.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.262+0000 7f9314c00640 1 -- 172.21.15.152:0/2933561408 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) ==== 137+0+0 (secure 0 0 0) 0x7f930005e3e0 con 0x7f931815c9b0 2024-04-17T08:46:39.265 INFO:teuthology.orchestra.run.smithi152.stderr:added data pool 4 to fsmap 2024-04-17T08:46:39.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.266+0000 7f931f200640 1 -- 172.21.15.152:0/2933561408 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f92f4068380 msgr2=0x7f92f406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:39.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.266+0000 7f931f200640 1 --2- 172.21.15.152:0/2933561408 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f92f4068380 0x7f92f406a840 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9308001ec0 tx=0x7f9308001e50 comp rx=0 tx=0).stop 2024-04-17T08:46:39.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.266+0000 7f931f200640 1 -- 172.21.15.152:0/2933561408 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f931815c9b0 msgr2=0x7f931815ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:39.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.266+0000 7f931f200640 1 --2- 172.21.15.152:0/2933561408 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f931815c9b0 0x7f931815ada0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9300012860 tx=0x7f9300012d20 comp rx=0 tx=0).stop 2024-04-17T08:46:39.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.266+0000 7f931f200640 1 -- 172.21.15.152:0/2933561408 shutdown_connections 2024-04-17T08:46:39.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.266+0000 7f931f200640 1 --2- 172.21.15.152:0/2933561408 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f92f4068380 0x7f92f406a840 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:39.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.266+0000 7f931f200640 1 --2- 172.21.15.152:0/2933561408 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f931815ce30 0x7f931815b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:39.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.266+0000 7f931f200640 1 --2- 172.21.15.152:0/2933561408 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f931815c9b0 0x7f931815ada0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:39.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.266+0000 7f931f200640 1 --2- 172.21.15.152:0/2933561408 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f92fc004d50 0x7f93180aff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:39.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.266+0000 7f931f200640 1 -- 172.21.15.152:0/2933561408 >> 172.21.15.152:0/2933561408 conn(0x7f93180b3350 msgr2=0x7f931806cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:39.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.266+0000 7f931f200640 1 -- 172.21.15.152:0/2933561408 shutdown_connections 2024-04-17T08:46:39.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.266+0000 7f931f200640 1 -- 172.21.15.152:0/2933561408 wait complete. 2024-04-17T08:46:39.288 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T08:46:39.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.422+0000 7f87a5600640 1 Processor -- start 2024-04-17T08:46:39.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.422+0000 7f87a5600640 1 -- start start 2024-04-17T08:46:39.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.426+0000 7f87a5600640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f87a015a010 0x7f87a00d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:39.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.426+0000 7f87a5600640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87a0160d20 con 0x7f87a015d710 2024-04-17T08:46:39.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.426+0000 7f87a5600640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87a015cc30 con 0x7f87a0160720 2024-04-17T08:46:39.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.426+0000 7f87a5600640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f87a015d280 con 0x7f87a015a010 2024-04-17T08:46:39.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.426+0000 7f879ea00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f87a015a010 0x7f87a00d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:39.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.426+0000 7f8796000640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f87a015d710 0x7f87a0160010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:56766/0 (socket says 172.21.15.152:56766) 2024-04-17T08:46:39.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.426+0000 7f8796000640 1 -- 172.21.15.152:0/2952745835 learned_addr learned my addr 172.21.15.152:0/2952745835 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:46:39.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.426+0000 7f879ea00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f87a015a010 0x7f87a00d0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35468/0 (socket says 172.21.15.152:35468) 2024-04-17T08:46:39.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.426+0000 7f879ea00640 1 -- 172.21.15.152:0/2952745835 >> v1:172.21.15.196:6789/0 conn(0x7f87a0160720 legacy=0x7f87a015dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:39.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.426+0000 7f879ea00640 1 -- 172.21.15.152:0/2952745835 >> v1:172.21.15.152:6789/0 conn(0x7f87a015d710 legacy=0x7f87a0160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:39.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.426+0000 7f879e000640 1 -- 172.21.15.152:0/2952745835 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4012932028 0 0) 0x7f87a0160d20 con 0x7f87a015d710 2024-04-17T08:46:39.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.426+0000 7f879ea00640 1 -- 172.21.15.152:0/2952745835 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87a015cf10 con 0x7f87a015a010 2024-04-17T08:46:39.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.430+0000 7f879ea00640 1 --2- 172.21.15.152:0/2952745835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87a015a010 0x7f87a00d0360 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f87a015d400 tx=0x7f879001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=138ae3b5b8ac4a4f server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:39.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.430+0000 7f879e000640 1 -- 172.21.15.152:0/2952745835 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87900b0070 con 0x7f87a015a010 2024-04-17T08:46:39.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.430+0000 7f879e000640 1 -- 172.21.15.152:0/2952745835 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87900ab600 con 0x7f87a015a010 2024-04-17T08:46:39.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.430+0000 7f879e000640 1 -- 172.21.15.152:0/2952745835 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87900ab9d0 con 0x7f87a015a010 2024-04-17T08:46:39.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.430+0000 7f87a5600640 1 -- 172.21.15.152:0/2952745835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87a015a010 msgr2=0x7f87a00d0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:39.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.430+0000 7f87a5600640 1 --2- 172.21.15.152:0/2952745835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87a015a010 0x7f87a00d0360 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f87a015d400 tx=0x7f879001c3d0 comp rx=0 tx=0).stop 2024-04-17T08:46:39.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.430+0000 7f87a5600640 1 -- 172.21.15.152:0/2952745835 shutdown_connections 2024-04-17T08:46:39.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.430+0000 7f87a5600640 1 --2- 172.21.15.152:0/2952745835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87a015a010 0x7f87a00d0360 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:39.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.430+0000 7f87a5600640 1 -- 172.21.15.152:0/2952745835 >> 172.21.15.152:0/2952745835 conn(0x7f87a00b3350 msgr2=0x7f87a00b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:39.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.430+0000 7f87a5600640 1 -- 172.21.15.152:0/2952745835 shutdown_connections 2024-04-17T08:46:39.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.430+0000 7f87a5600640 1 -- 172.21.15.152:0/2952745835 wait complete. 2024-04-17T08:46:39.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.430+0000 7f87a5600640 1 Processor -- start 2024-04-17T08:46:39.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.430+0000 7f87a5600640 1 -- start start 2024-04-17T08:46:39.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.434+0000 7f87a5600640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87a015a010 0x7f87a00c9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:39.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.434+0000 7f87a5600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f87a015d710 0x7f87a00cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:39.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.434+0000 7f87a5600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f87a0160720 0x7f87a00caee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:39.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.434+0000 7f87a5600640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f87a00d0cb0 con 0x7f87a015a010 2024-04-17T08:46:39.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.434+0000 7f87a5600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f87a015c9d0 con 0x7f87a015d710 2024-04-17T08:46:39.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.434+0000 7f87a5600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f87a016a5d0 con 0x7f87a0160720 2024-04-17T08:46:39.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.434+0000 7f879ea00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87a015a010 0x7f87a00c9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:39.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.434+0000 7f879ea00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87a015a010 0x7f87a00c9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35472/0 (socket says 172.21.15.152:35472) 2024-04-17T08:46:39.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.434+0000 7f879ea00640 1 -- 172.21.15.152:0/4279497109 learned_addr learned my addr 172.21.15.152:0/4279497109 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:39.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.434+0000 7f8796000640 1 --2- 172.21.15.152:0/4279497109 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f87a015d710 0x7f87a00cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:39.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.434+0000 7f879f400640 1 --2- 172.21.15.152:0/4279497109 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f87a0160720 0x7f87a00caee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:39.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.434+0000 7f879ea00640 1 -- 172.21.15.152:0/4279497109 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f87a0160720 msgr2=0x7f87a00caee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:39.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.434+0000 7f879ea00640 1 --2- 172.21.15.152:0/4279497109 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f87a0160720 0x7f87a00caee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:39.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.434+0000 7f879ea00640 1 -- 172.21.15.152:0/4279497109 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f87a015d710 msgr2=0x7f87a00cfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:39.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.434+0000 7f879ea00640 1 --2- 172.21.15.152:0/4279497109 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f87a015d710 0x7f87a00cfa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:39.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.434+0000 7f879ea00640 1 -- 172.21.15.152:0/4279497109 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87a00cb420 con 0x7f87a015a010 2024-04-17T08:46:39.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.434+0000 7f879f400640 1 --2- 172.21.15.152:0/4279497109 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f87a0160720 0x7f87a00caee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:46:39.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.434+0000 7f879ea00640 1 --2- 172.21.15.152:0/4279497109 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87a015a010 0x7f87a00c9860 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f879001a000 tx=0x7f879001ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:39.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.434+0000 7f8797400640 1 -- 172.21.15.152:0/4279497109 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87900bb070 con 0x7f87a015a010 2024-04-17T08:46:39.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.434+0000 7f8797400640 1 -- 172.21.15.152:0/4279497109 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8790004220 con 0x7f87a015a010 2024-04-17T08:46:39.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.434+0000 7f8797400640 1 -- 172.21.15.152:0/4279497109 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87900b0040 con 0x7f87a015a010 2024-04-17T08:46:39.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.434+0000 7f87a5600640 1 -- 172.21.15.152:0/4279497109 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87a00c9e40 con 0x7f87a015a010 2024-04-17T08:46:39.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.434+0000 7f87a5600640 1 -- 172.21.15.152:0/4279497109 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87a00ca400 con 0x7f87a015a010 2024-04-17T08:46:39.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.434+0000 7f87a5600640 1 -- 172.21.15.152:0/4279497109 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87a006cf90 con 0x7f87a015a010 2024-04-17T08:46:39.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.434+0000 7f8797400640 1 -- 172.21.15.152:0/4279497109 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8790003620 con 0x7f87a015a010 2024-04-17T08:46:39.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.438+0000 7f8797400640 1 --2- 172.21.15.152:0/4279497109 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f877c068380 0x7f877c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:39.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.438+0000 7f8797400640 1 -- 172.21.15.152:0/4279497109 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f87901214e0 con 0x7f87a015a010 2024-04-17T08:46:39.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.438+0000 7f8796000640 1 --2- 172.21.15.152:0/4279497109 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f877c068380 0x7f877c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:39.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.438+0000 7f8796000640 1 --2- 172.21.15.152:0/4279497109 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f877c068380 0x7f877c06a840 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f87a0168380 tx=0x7f8788007d60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:39.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.442+0000 7f8797400640 1 -- 172.21.15.152:0/4279497109 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f8790016050 con 0x7f87a015a010 2024-04-17T08:46:39.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.630+0000 7f87a5600640 1 -- 172.21.15.152:0/4279497109 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f87a0068a30 con 0x7f87a015a010 2024-04-17T08:46:39.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.630+0000 7f8797400640 1 -- 172.21.15.152:0/4279497109 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5207 (secure 0 0 0) 0x7f87900f16c0 con 0x7f87a015a010 2024-04-17T08:46:39.634 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:46:39.634 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6834/2461981726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":2461981726},{"type":"v1","addr":"172.21.15.196:6834","nonce":2461981726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6835/3397289430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6833","nonce":3397289430},{"type":"v1","addr":"172.21.15.196:6835","nonce":3397289430}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/2491486613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2491486613},{"type":"v1","addr":"172.21.15.152:6836","nonce":2491486613}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-17T08:46:33.607720+0000","modified":"2024-04-17T08:46:38.660032+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6837/3890159871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":3890159871},{"type":"v1","addr":"172.21.15.152:6837","nonce":3890159871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-04-17T08:46:39.634 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 7 2024-04-17T08:46:39.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.634+0000 7f87a5600640 1 -- 172.21.15.152:0/4279497109 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f877c068380 msgr2=0x7f877c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:39.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.634+0000 7f87a5600640 1 --2- 172.21.15.152:0/4279497109 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f877c068380 0x7f877c06a840 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f87a0168380 tx=0x7f8788007d60 comp rx=0 tx=0).stop 2024-04-17T08:46:39.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.634+0000 7f87a5600640 1 -- 172.21.15.152:0/4279497109 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87a015a010 msgr2=0x7f87a00c9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:39.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.634+0000 7f87a5600640 1 --2- 172.21.15.152:0/4279497109 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87a015a010 0x7f87a00c9860 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f879001a000 tx=0x7f879001ac10 comp rx=0 tx=0).stop 2024-04-17T08:46:39.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.634+0000 7f87a5600640 1 -- 172.21.15.152:0/4279497109 shutdown_connections 2024-04-17T08:46:39.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.634+0000 7f87a5600640 1 --2- 172.21.15.152:0/4279497109 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f877c068380 0x7f877c06a840 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:39.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.634+0000 7f87a5600640 1 --2- 172.21.15.152:0/4279497109 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f87a0160720 0x7f87a00caee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:39.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.634+0000 7f87a5600640 1 --2- 172.21.15.152:0/4279497109 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f87a015d710 0x7f87a00cfa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:39.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.634+0000 7f87a5600640 1 --2- 172.21.15.152:0/4279497109 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87a015a010 0x7f87a00c9860 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:39.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.634+0000 7f87a5600640 1 -- 172.21.15.152:0/4279497109 >> 172.21.15.152:0/4279497109 conn(0x7f87a00b3350 msgr2=0x7f87a00b1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:39.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.634+0000 7f87a5600640 1 -- 172.21.15.152:0/4279497109 shutdown_connections 2024-04-17T08:46:39.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.634+0000 7f87a5600640 1 -- 172.21.15.152:0/4279497109 wait complete. 2024-04-17T08:46:39.654 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T08:46:39.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.786+0000 7fb808400640 1 Processor -- start 2024-04-17T08:46:39.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.786+0000 7fb808400640 1 -- start start 2024-04-17T08:46:39.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.786+0000 7fb808400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb80006f980 0x7fb800072530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:39.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.790+0000 7fb808400640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb80015bfd0 con 0x7fb8000af670 2024-04-17T08:46:39.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.790+0000 7fb808400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb80015c260 con 0x7fb8000d0360 2024-04-17T08:46:39.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.790+0000 7fb808400640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fb80015c820 con 0x7fb80006f980 2024-04-17T08:46:39.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.790+0000 7fb805000640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb80006f980 0x7fb800072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:39.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.790+0000 7fb805a00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fb8000af670 0x7fb80015b8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:56776/0 (socket says 172.21.15.152:56776) 2024-04-17T08:46:39.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.790+0000 7fb805000640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb80006f980 0x7fb800072530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35486/0 (socket says 172.21.15.152:35486) 2024-04-17T08:46:39.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.790+0000 7fb805a00640 1 -- 172.21.15.152:0/2320252259 learned_addr learned my addr 172.21.15.152:0/2320252259 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:46:39.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.790+0000 7fb805000640 1 -- 172.21.15.152:0/2320252259 >> v1:172.21.15.196:6789/0 conn(0x7fb8000d0360 legacy=0x7fb80006dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:39.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.790+0000 7fb805000640 1 -- 172.21.15.152:0/2320252259 >> v1:172.21.15.152:6789/0 conn(0x7fb8000af670 legacy=0x7fb80015b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:39.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.790+0000 7fb805000640 1 -- 172.21.15.152:0/2320252259 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb80015c540 con 0x7fb80006f980 2024-04-17T08:46:39.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.790+0000 7fb7ffe00640 1 -- 172.21.15.152:0/2320252259 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1167936244 0 0) 0x7fb80015bfd0 con 0x7fb8000af670 2024-04-17T08:46:39.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.790+0000 7fb805000640 1 --2- 172.21.15.152:0/2320252259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb80006f980 0x7fb800072530 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec0097c0 tx=0x7fb7ec01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed46de505a433a4b server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:39.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.790+0000 7fb7ffe00640 1 -- 172.21.15.152:0/2320252259 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec0b1070 con 0x7fb80006f980 2024-04-17T08:46:39.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.790+0000 7fb7ffe00640 1 -- 172.21.15.152:0/2320252259 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7ec0ac600 con 0x7fb80006f980 2024-04-17T08:46:39.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.790+0000 7fb7ffe00640 1 -- 172.21.15.152:0/2320252259 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec0ac9d0 con 0x7fb80006f980 2024-04-17T08:46:39.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.794+0000 7fb808400640 1 -- 172.21.15.152:0/2320252259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb80006f980 msgr2=0x7fb800072530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:39.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.794+0000 7fb808400640 1 --2- 172.21.15.152:0/2320252259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb80006f980 0x7fb800072530 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec0097c0 tx=0x7fb7ec01c3a0 comp rx=0 tx=0).stop 2024-04-17T08:46:39.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.794+0000 7fb808400640 1 -- 172.21.15.152:0/2320252259 shutdown_connections 2024-04-17T08:46:39.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.794+0000 7fb808400640 1 --2- 172.21.15.152:0/2320252259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb80006f980 0x7fb800072530 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:39.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.794+0000 7fb808400640 1 -- 172.21.15.152:0/2320252259 >> 172.21.15.152:0/2320252259 conn(0x7fb8000b3350 msgr2=0x7fb8000b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:39.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.794+0000 7fb808400640 1 -- 172.21.15.152:0/2320252259 shutdown_connections 2024-04-17T08:46:39.795 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.794+0000 7fb808400640 1 -- 172.21.15.152:0/2320252259 wait complete. 2024-04-17T08:46:39.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.794+0000 7fb808400640 1 Processor -- start 2024-04-17T08:46:39.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.794+0000 7fb808400640 1 -- start start 2024-04-17T08:46:39.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.794+0000 7fb808400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb80006f980 0x7fb800147430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:39.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.794+0000 7fb808400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb8000af670 0x7fb8001598a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:39.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.794+0000 7fb808400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb8000d0360 0x7fb800159de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:39.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.794+0000 7fb808400640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb800072a70 con 0x7fb80006f980 2024-04-17T08:46:39.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.794+0000 7fb808400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb8000d0bc0 con 0x7fb8000af670 2024-04-17T08:46:39.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.794+0000 7fb808400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fb800072bf0 con 0x7fb8000d0360 2024-04-17T08:46:39.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.794+0000 7fb805a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb80006f980 0x7fb800147430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:39.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.794+0000 7fb805a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb80006f980 0x7fb800147430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35498/0 (socket says 172.21.15.152:35498) 2024-04-17T08:46:39.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.794+0000 7fb805a00640 1 -- 172.21.15.152:0/2629031184 learned_addr learned my addr 172.21.15.152:0/2629031184 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:39.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.794+0000 7fb805000640 1 --2- 172.21.15.152:0/2629031184 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb8000af670 0x7fb8001598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:39.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.794+0000 7fb806400640 1 --2- 172.21.15.152:0/2629031184 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb8000d0360 0x7fb800159de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:39.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.794+0000 7fb805a00640 1 -- 172.21.15.152:0/2629031184 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb8000d0360 msgr2=0x7fb800159de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:39.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.794+0000 7fb805a00640 1 --2- 172.21.15.152:0/2629031184 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb8000d0360 0x7fb800159de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:39.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.794+0000 7fb805a00640 1 -- 172.21.15.152:0/2629031184 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb8000af670 msgr2=0x7fb8001598a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:39.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.794+0000 7fb805a00640 1 --2- 172.21.15.152:0/2629031184 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb8000af670 0x7fb8001598a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:39.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.798+0000 7fb805a00640 1 -- 172.21.15.152:0/2629031184 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8000b1460 con 0x7fb80006f980 2024-04-17T08:46:39.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.798+0000 7fb805a00640 1 --2- 172.21.15.152:0/2629031184 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb80006f980 0x7fb800147430 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb7f40011f0 tx=0x7fb7f400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:39.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.798+0000 7fb7fd600640 1 -- 172.21.15.152:0/2629031184 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f4018070 con 0x7fb80006f980 2024-04-17T08:46:39.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.798+0000 7fb7fd600640 1 -- 172.21.15.152:0/2629031184 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7f40074e0 con 0x7fb80006f980 2024-04-17T08:46:39.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.798+0000 7fb7fd600640 1 -- 172.21.15.152:0/2629031184 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f4004a10 con 0x7fb80006f980 2024-04-17T08:46:39.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.798+0000 7fb808400640 1 -- 172.21.15.152:0/2629031184 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8000b1700 con 0x7fb80006f980 2024-04-17T08:46:39.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.798+0000 7fb808400640 1 -- 172.21.15.152:0/2629031184 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8000b1cc0 con 0x7fb80006f980 2024-04-17T08:46:39.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.798+0000 7fb808400640 1 -- 172.21.15.152:0/2629031184 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb800068a30 con 0x7fb80006f980 2024-04-17T08:46:39.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.798+0000 7fb7fd600640 1 -- 172.21.15.152:0/2629031184 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb7f4004bb0 con 0x7fb80006f980 2024-04-17T08:46:39.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.798+0000 7fb7fd600640 1 --2- 172.21.15.152:0/2629031184 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb7e0068380 0x7fb7e006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:39.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.798+0000 7fb7fd600640 1 -- 172.21.15.152:0/2629031184 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb7f4085ff0 con 0x7fb80006f980 2024-04-17T08:46:39.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.798+0000 7fb805000640 1 --2- 172.21.15.152:0/2629031184 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb7e0068380 0x7fb7e006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:39.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.802+0000 7fb805000640 1 --2- 172.21.15.152:0/2629031184 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb7e0068380 0x7fb7e006a840 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec0ae000 tx=0x7fb7ec0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:39.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.802+0000 7fb7fd600640 1 -- 172.21.15.152:0/2629031184 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fb7f4055c50 con 0x7fb80006f980 2024-04-17T08:46:39.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.962+0000 7fb808400640 1 -- 172.21.15.152:0/2629031184 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb8000725d0 con 0x7fb80006f980 2024-04-17T08:46:39.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.962+0000 7fb7fd600640 1 -- 172.21.15.152:0/2629031184 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7fb7f4059f50 con 0x7fb80006f980 2024-04-17T08:46:39.965 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:46:39.965 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":24,"fsid":"ce68f82e-ec5f-4205-9fd5-bdfdf6ef31e2","created":"2024-04-17T08:46:08.353546+0000","modified":"2024-04-17T08:46:38.659862+0000","last_up_change":"2024-04-17T08:46:20.738799+0000","last_in_change":"2024-04-17T08:46:11.210050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T08:46:21.386856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T08:46:31.812460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T08:46:32.555559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T08:46:36.258078+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"682f0192-187c-404e-bc7a-b6b4e23825e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6819","nonce":3603799291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6823","nonce":3603799291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6831","nonce":3603799291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6827","nonce":3603799291}]},"public_addr":"172.21.15.152:6819/3603799291","cluster_addr":"172.21.15.152:6823/3603799291","heartbeat_back_addr":"172.21.15.152:6831/3603799291","heartbeat_front_addr":"172.21.15.152:6827/3603799291","state":["exists","up"]},{"osd":1,"uuid":"f0fe8fef-60ec-4a39-83b6-2fa6a5adb0f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6801","nonce":4133383142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6803","nonce":4133383142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6807","nonce":4133383142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6805","nonce":4133383142}]},"public_addr":"172.21.15.152:6801/4133383142","cluster_addr":"172.21.15.152:6803/4133383142","heartbeat_back_addr":"172.21.15.152:6807/4133383142","heartbeat_front_addr":"172.21.15.152:6805/4133383142","state":["exists","up"]},{"osd":2,"uuid":"35f36d9c-5245-4431-a618-f4df0fa380ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6809","nonce":3826143898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6811","nonce":3826143898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6815","nonce":3826143898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6813","nonce":3826143898}]},"public_addr":"172.21.15.152:6809/3826143898","cluster_addr":"172.21.15.152:6811/3826143898","heartbeat_back_addr":"172.21.15.152:6815/3826143898","heartbeat_front_addr":"172.21.15.152:6813/3826143898","state":["exists","up"]},{"osd":3,"uuid":"96e56ca5-15b4-4895-9b79-da2c92043159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6818","nonce":165717826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6822","nonce":165717826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6830","nonce":165717826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6826","nonce":165717826}]},"public_addr":"172.21.15.152:6818/165717826","cluster_addr":"172.21.15.152:6822/165717826","heartbeat_back_addr":"172.21.15.152:6830/165717826","heartbeat_front_addr":"172.21.15.152:6826/165717826","state":["exists","up"]},{"osd":4,"uuid":"f5aa10a4-9ff9-41fe-a5c9-15326f982cc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6817","nonce":4080159297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6819","nonce":4080159297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6823","nonce":4080159297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6821","nonce":4080159297}]},"public_addr":"172.21.15.196:6817/4080159297","cluster_addr":"172.21.15.196:6819/4080159297","heartbeat_back_addr":"172.21.15.196:6823/4080159297","heartbeat_front_addr":"172.21.15.196:6821/4080159297","state":["exists","up"]},{"osd":5,"uuid":"42bab884-3476-47ae-ac65-935fa6e0f055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6801","nonce":3519444232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6803","nonce":3519444232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6807","nonce":3519444232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6805","nonce":3519444232}]},"public_addr":"172.21.15.196:6801/3519444232","cluster_addr":"172.21.15.196:6803/3519444232","heartbeat_back_addr":"172.21.15.196:6807/3519444232","heartbeat_front_addr":"172.21.15.196:6805/3519444232","state":["exists","up"]},{"osd":6,"uuid":"460b6167-f57b-4224-9c92-cfc9b80bbe99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6809","nonce":275739834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6811","nonce":275739834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6815","nonce":275739834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6813","nonce":275739834}]},"public_addr":"172.21.15.196:6809/275739834","cluster_addr":"172.21.15.196:6811/275739834","heartbeat_back_addr":"172.21.15.196:6815/275739834","heartbeat_front_addr":"172.21.15.196:6813/275739834","state":["exists","up"]},{"osd":7,"uuid":"d695643f-5e07-4e2a-a646-c06bd97b6650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6825","nonce":307626968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6827","nonce":307626968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6831","nonce":307626968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6829","nonce":307626968}]},"public_addr":"172.21.15.196:6825/307626968","cluster_addr":"172.21.15.196:6827/307626968","heartbeat_back_addr":"172.21.15.196:6831/307626968","heartbeat_front_addr":"172.21.15.196:6829/307626968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.293257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.964533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.248895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.010000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.832554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.743704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930171+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930962+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T08:46:39.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.966+0000 7fb808400640 1 -- 172.21.15.152:0/2629031184 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb7e0068380 msgr2=0x7fb7e006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:39.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.966+0000 7fb808400640 1 --2- 172.21.15.152:0/2629031184 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb7e0068380 0x7fb7e006a840 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec0ae000 tx=0x7fb7ec0a7000 comp rx=0 tx=0).stop 2024-04-17T08:46:39.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.966+0000 7fb808400640 1 -- 172.21.15.152:0/2629031184 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb80006f980 msgr2=0x7fb800147430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:39.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.966+0000 7fb808400640 1 --2- 172.21.15.152:0/2629031184 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb80006f980 0x7fb800147430 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb7f40011f0 tx=0x7fb7f400c9b0 comp rx=0 tx=0).stop 2024-04-17T08:46:39.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.966+0000 7fb808400640 1 -- 172.21.15.152:0/2629031184 shutdown_connections 2024-04-17T08:46:39.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.966+0000 7fb808400640 1 --2- 172.21.15.152:0/2629031184 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb7e0068380 0x7fb7e006a840 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:39.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.966+0000 7fb808400640 1 --2- 172.21.15.152:0/2629031184 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb8000d0360 0x7fb800159de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:39.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.966+0000 7fb808400640 1 --2- 172.21.15.152:0/2629031184 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb8000af670 0x7fb8001598a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:39.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.966+0000 7fb808400640 1 --2- 172.21.15.152:0/2629031184 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb80006f980 0x7fb800147430 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:39.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.966+0000 7fb808400640 1 -- 172.21.15.152:0/2629031184 >> 172.21.15.152:0/2629031184 conn(0x7fb8000b3350 msgr2=0x7fb8000731d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:39.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.966+0000 7fb808400640 1 -- 172.21.15.152:0/2629031184 shutdown_connections 2024-04-17T08:46:39.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:39.966+0000 7fb808400640 1 -- 172.21.15.152:0/2629031184 wait complete. 2024-04-17T08:46:39.986 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T08:46:40.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.118+0000 7f53b4e00640 1 Processor -- start 2024-04-17T08:46:40.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.118+0000 7f53b4e00640 1 -- start start 2024-04-17T08:46:40.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.122+0000 7f53b4e00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f53b015a010 0x7f53b00d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:40.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.122+0000 7f53b4e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f53b015d710 0x7f53b00d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:40.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.122+0000 7f53b4e00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53b0160d20 con 0x7f53b0160010 2024-04-17T08:46:40.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.122+0000 7f53b4e00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f53b015d280 con 0x7f53b015a010 2024-04-17T08:46:40.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.122+0000 7f53b4e00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f53b015c9d0 con 0x7f53b015d710 2024-04-17T08:46:40.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.122+0000 7f53ade00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f53b015a010 0x7f53b00d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:40.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.122+0000 7f53ade00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f53b015a010 0x7f53b00d0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35510/0 (socket says 172.21.15.152:35510) 2024-04-17T08:46:40.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.122+0000 7f53ade00640 1 -- 172.21.15.152:0/1222379371 learned_addr learned my addr 172.21.15.152:0/1222379371 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:40.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.122+0000 7f53a5400640 1 --2- 172.21.15.152:0/1222379371 >> v2:172.21.15.196:3300/0 conn(0x7f53b015d710 0x7f53b00d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:40.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.122+0000 7f53ade00640 1 -- 172.21.15.152:0/1222379371 >> v2:172.21.15.196:3300/0 conn(0x7f53b015d710 msgr2=0x7f53b00d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:40.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.122+0000 7f53ade00640 1 --2- 172.21.15.152:0/1222379371 >> v2:172.21.15.196:3300/0 conn(0x7f53b015d710 0x7f53b00d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:40.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.122+0000 7f53ade00640 1 -- 172.21.15.152:0/1222379371 >> v1:172.21.15.196:6789/0 conn(0x7f53b0160010 legacy=0x7f53b0160450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:40.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.122+0000 7f53ade00640 1 -- 172.21.15.152:0/1222379371 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53b015cc30 con 0x7f53b015a010 2024-04-17T08:46:40.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.126+0000 7f53ade00640 1 --2- 172.21.15.152:0/1222379371 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53b015a010 0x7f53b00d0360 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f53b00b1d10 tx=0x7f53a001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40fb41f8db648495 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:40.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.126+0000 7f53ad400640 1 -- 172.21.15.152:0/1222379371 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a00b2070 con 0x7f53b015a010 2024-04-17T08:46:40.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.126+0000 7f53ad400640 1 -- 172.21.15.152:0/1222379371 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53a00a9070 con 0x7f53b015a010 2024-04-17T08:46:40.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.126+0000 7f53ad400640 1 -- 172.21.15.152:0/1222379371 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a00ad880 con 0x7f53b015a010 2024-04-17T08:46:40.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.126+0000 7f53b4e00640 1 -- 172.21.15.152:0/1222379371 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53b015a010 msgr2=0x7f53b00d0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:40.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.126+0000 7f53b4e00640 1 --2- 172.21.15.152:0/1222379371 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53b015a010 0x7f53b00d0360 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f53b00b1d10 tx=0x7f53a001c450 comp rx=0 tx=0).stop 2024-04-17T08:46:40.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.126+0000 7f53b4e00640 1 -- 172.21.15.152:0/1222379371 shutdown_connections 2024-04-17T08:46:40.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.126+0000 7f53b4e00640 1 --2- 172.21.15.152:0/1222379371 >> v2:172.21.15.196:3300/0 conn(0x7f53b015d710 0x7f53b00d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:40.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.126+0000 7f53b4e00640 1 --2- 172.21.15.152:0/1222379371 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53b015a010 0x7f53b00d0360 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:40.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.126+0000 7f53b4e00640 1 -- 172.21.15.152:0/1222379371 >> 172.21.15.152:0/1222379371 conn(0x7f53b00b3350 msgr2=0x7f53b00b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:40.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.126+0000 7f53b4e00640 1 -- 172.21.15.152:0/1222379371 shutdown_connections 2024-04-17T08:46:40.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.126+0000 7f53b4e00640 1 -- 172.21.15.152:0/1222379371 wait complete. 2024-04-17T08:46:40.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.126+0000 7f53b4e00640 1 Processor -- start 2024-04-17T08:46:40.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.126+0000 7f53b4e00640 1 -- start start 2024-04-17T08:46:40.131 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.130+0000 7f53b4e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53b015a010 0x7f53b0098300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:40.131 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.130+0000 7f53b4e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53b015d710 0x7f53b014fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:40.131 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.130+0000 7f53b4e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53b0160010 0x7f53b01583b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:40.131 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.130+0000 7f53b4e00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f53b015e780 con 0x7f53b015d710 2024-04-17T08:46:40.131 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.130+0000 7f53b4e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f53b015e600 con 0x7f53b0160010 2024-04-17T08:46:40.131 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.130+0000 7f53b4e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f53b015e900 con 0x7f53b015a010 2024-04-17T08:46:40.131 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.130+0000 7f53a5400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53b015d710 0x7f53b014fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:40.131 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.130+0000 7f53a5400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53b015d710 0x7f53b014fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35520/0 (socket says 172.21.15.152:35520) 2024-04-17T08:46:40.131 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.130+0000 7f53a5400640 1 -- 172.21.15.152:0/4156207911 learned_addr learned my addr 172.21.15.152:0/4156207911 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:40.131 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.130+0000 7f53ade00640 1 --2- 172.21.15.152:0/4156207911 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53b015a010 0x7f53b0098300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:40.131 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.130+0000 7f53ae800640 1 --2- 172.21.15.152:0/4156207911 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53b0160010 0x7f53b01583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:40.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.130+0000 7f53a5400640 1 -- 172.21.15.152:0/4156207911 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53b015a010 msgr2=0x7f53b0098300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:40.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.130+0000 7f53a5400640 1 --2- 172.21.15.152:0/4156207911 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53b015a010 0x7f53b0098300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:40.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.130+0000 7f53a5400640 1 -- 172.21.15.152:0/4156207911 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53b0160010 msgr2=0x7f53b01583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:40.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.130+0000 7f53a5400640 1 --2- 172.21.15.152:0/4156207911 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53b0160010 0x7f53b01583b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:40.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.130+0000 7f53a5400640 1 -- 172.21.15.152:0/4156207911 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53b00988e0 con 0x7f53b015d710 2024-04-17T08:46:40.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.130+0000 7f53a5400640 1 --2- 172.21.15.152:0/4156207911 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53b015d710 0x7f53b014fb90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5398007ef0 tx=0x7f539800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:40.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.130+0000 7f53a6a00640 1 -- 172.21.15.152:0/4156207911 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5398014620 con 0x7f53b015d710 2024-04-17T08:46:40.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.130+0000 7f53a6a00640 1 -- 172.21.15.152:0/4156207911 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5398019070 con 0x7f53b015d710 2024-04-17T08:46:40.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.130+0000 7f53a6a00640 1 -- 172.21.15.152:0/4156207911 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5398014a00 con 0x7f53b015d710 2024-04-17T08:46:40.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.130+0000 7f53b4e00640 1 -- 172.21.15.152:0/4156207911 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53b0098bc0 con 0x7f53b015d710 2024-04-17T08:46:40.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.130+0000 7f53b4e00640 1 -- 172.21.15.152:0/4156207911 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53b0099180 con 0x7f53b015d710 2024-04-17T08:46:40.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.130+0000 7f53b4e00640 1 -- 172.21.15.152:0/4156207911 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53b0068a30 con 0x7f53b015d710 2024-04-17T08:46:40.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.130+0000 7f53a6a00640 1 -- 172.21.15.152:0/4156207911 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5398014ba0 con 0x7f53b015d710 2024-04-17T08:46:40.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.130+0000 7f53a6a00640 1 --2- 172.21.15.152:0/4156207911 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f538c068380 0x7f538c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:40.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.134+0000 7f53a6a00640 1 -- 172.21.15.152:0/4156207911 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f5398087680 con 0x7f53b015d710 2024-04-17T08:46:40.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.134+0000 7f53ade00640 1 --2- 172.21.15.152:0/4156207911 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f538c068380 0x7f538c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:40.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.134+0000 7f53ade00640 1 --2- 172.21.15.152:0/4156207911 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f538c068380 0x7f538c06a840 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f53a00af000 tx=0x7f53a00a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:40.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.134+0000 7f53a6a00640 1 -- 172.21.15.152:0/4156207911 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f53980578f0 con 0x7f53b015d710 2024-04-17T08:46:40.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.298+0000 7f53b4e00640 1 -- 172.21.15.152:0/4156207911 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f53b006d660 con 0x7f53b015d710 2024-04-17T08:46:40.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.298+0000 7f53a6a00640 1 -- 172.21.15.152:0/4156207911 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7f53980571f0 con 0x7f53b015d710 2024-04-17T08:46:40.301 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:46:40.301 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":24,"fsid":"ce68f82e-ec5f-4205-9fd5-bdfdf6ef31e2","created":"2024-04-17T08:46:08.353546+0000","modified":"2024-04-17T08:46:38.659862+0000","last_up_change":"2024-04-17T08:46:20.738799+0000","last_in_change":"2024-04-17T08:46:11.210050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T08:46:21.386856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T08:46:31.812460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T08:46:32.555559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T08:46:36.258078+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"682f0192-187c-404e-bc7a-b6b4e23825e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6819","nonce":3603799291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6823","nonce":3603799291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6831","nonce":3603799291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6827","nonce":3603799291}]},"public_addr":"172.21.15.152:6819/3603799291","cluster_addr":"172.21.15.152:6823/3603799291","heartbeat_back_addr":"172.21.15.152:6831/3603799291","heartbeat_front_addr":"172.21.15.152:6827/3603799291","state":["exists","up"]},{"osd":1,"uuid":"f0fe8fef-60ec-4a39-83b6-2fa6a5adb0f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6801","nonce":4133383142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6803","nonce":4133383142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6807","nonce":4133383142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6805","nonce":4133383142}]},"public_addr":"172.21.15.152:6801/4133383142","cluster_addr":"172.21.15.152:6803/4133383142","heartbeat_back_addr":"172.21.15.152:6807/4133383142","heartbeat_front_addr":"172.21.15.152:6805/4133383142","state":["exists","up"]},{"osd":2,"uuid":"35f36d9c-5245-4431-a618-f4df0fa380ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6809","nonce":3826143898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6811","nonce":3826143898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6815","nonce":3826143898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6813","nonce":3826143898}]},"public_addr":"172.21.15.152:6809/3826143898","cluster_addr":"172.21.15.152:6811/3826143898","heartbeat_back_addr":"172.21.15.152:6815/3826143898","heartbeat_front_addr":"172.21.15.152:6813/3826143898","state":["exists","up"]},{"osd":3,"uuid":"96e56ca5-15b4-4895-9b79-da2c92043159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6818","nonce":165717826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6822","nonce":165717826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6830","nonce":165717826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6826","nonce":165717826}]},"public_addr":"172.21.15.152:6818/165717826","cluster_addr":"172.21.15.152:6822/165717826","heartbeat_back_addr":"172.21.15.152:6830/165717826","heartbeat_front_addr":"172.21.15.152:6826/165717826","state":["exists","up"]},{"osd":4,"uuid":"f5aa10a4-9ff9-41fe-a5c9-15326f982cc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6817","nonce":4080159297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6819","nonce":4080159297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6823","nonce":4080159297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6821","nonce":4080159297}]},"public_addr":"172.21.15.196:6817/4080159297","cluster_addr":"172.21.15.196:6819/4080159297","heartbeat_back_addr":"172.21.15.196:6823/4080159297","heartbeat_front_addr":"172.21.15.196:6821/4080159297","state":["exists","up"]},{"osd":5,"uuid":"42bab884-3476-47ae-ac65-935fa6e0f055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6801","nonce":3519444232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6803","nonce":3519444232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6807","nonce":3519444232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6805","nonce":3519444232}]},"public_addr":"172.21.15.196:6801/3519444232","cluster_addr":"172.21.15.196:6803/3519444232","heartbeat_back_addr":"172.21.15.196:6807/3519444232","heartbeat_front_addr":"172.21.15.196:6805/3519444232","state":["exists","up"]},{"osd":6,"uuid":"460b6167-f57b-4224-9c92-cfc9b80bbe99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6809","nonce":275739834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6811","nonce":275739834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6815","nonce":275739834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6813","nonce":275739834}]},"public_addr":"172.21.15.196:6809/275739834","cluster_addr":"172.21.15.196:6811/275739834","heartbeat_back_addr":"172.21.15.196:6815/275739834","heartbeat_front_addr":"172.21.15.196:6813/275739834","state":["exists","up"]},{"osd":7,"uuid":"d695643f-5e07-4e2a-a646-c06bd97b6650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6825","nonce":307626968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6827","nonce":307626968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6831","nonce":307626968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6829","nonce":307626968}]},"public_addr":"172.21.15.196:6825/307626968","cluster_addr":"172.21.15.196:6827/307626968","heartbeat_back_addr":"172.21.15.196:6831/307626968","heartbeat_front_addr":"172.21.15.196:6829/307626968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.293257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.964533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.248895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.010000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.832554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.743704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930171+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930962+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T08:46:40.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.302+0000 7f53b4e00640 1 -- 172.21.15.152:0/4156207911 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f538c068380 msgr2=0x7f538c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:40.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.302+0000 7f53b4e00640 1 --2- 172.21.15.152:0/4156207911 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f538c068380 0x7f538c06a840 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f53a00af000 tx=0x7f53a00a7000 comp rx=0 tx=0).stop 2024-04-17T08:46:40.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.302+0000 7f53b4e00640 1 -- 172.21.15.152:0/4156207911 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53b015d710 msgr2=0x7f53b014fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:40.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.302+0000 7f53b4e00640 1 --2- 172.21.15.152:0/4156207911 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53b015d710 0x7f53b014fb90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5398007ef0 tx=0x7f539800e4b0 comp rx=0 tx=0).stop 2024-04-17T08:46:40.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.302+0000 7f53b4e00640 1 -- 172.21.15.152:0/4156207911 shutdown_connections 2024-04-17T08:46:40.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.302+0000 7f53b4e00640 1 --2- 172.21.15.152:0/4156207911 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53b0160010 0x7f53b01583b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:40.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.302+0000 7f53b4e00640 1 --2- 172.21.15.152:0/4156207911 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53b015d710 0x7f53b014fb90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:40.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.302+0000 7f53b4e00640 1 --2- 172.21.15.152:0/4156207911 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f538c068380 0x7f538c06a840 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:40.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.302+0000 7f53b4e00640 1 --2- 172.21.15.152:0/4156207911 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53b015a010 0x7f53b0098300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:40.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.302+0000 7f53b4e00640 1 -- 172.21.15.152:0/4156207911 >> 172.21.15.152:0/4156207911 conn(0x7f53b00b3350 msgr2=0x7f53b0072d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:40.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.302+0000 7f53b4e00640 1 -- 172.21.15.152:0/4156207911 shutdown_connections 2024-04-17T08:46:40.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.302+0000 7f53b4e00640 1 -- 172.21.15.152:0/4156207911 wait complete. 2024-04-17T08:46:40.336 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T08:46:40.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.470+0000 7fbcc9e00640 1 Processor -- start 2024-04-17T08:46:40.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.470+0000 7fbcc9e00640 1 -- start start 2024-04-17T08:46:40.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.470+0000 7fbcc9e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fbcc4147690 0x7fbcc41622e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:40.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.470+0000 7fbcc9e00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fbcc4071ea0 0x7fbcc406da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:40.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.470+0000 7fbcc9e00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcc4162820 con 0x7fbcc4147a90 2024-04-17T08:46:40.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.470+0000 7fbcc9e00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fbcc4162aa0 con 0x7fbcc4071ea0 2024-04-17T08:46:40.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.470+0000 7fbcc9e00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fbcc4162d80 con 0x7fbcc4147690 2024-04-17T08:46:40.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.470+0000 7fbcc3400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fbcc4071ea0 0x7fbcc406da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:40.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.470+0000 7fbcc2000640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fbcc4147a90 0x7fbcc4071790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:56790/0 (socket says 172.21.15.152:56790) 2024-04-17T08:46:40.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.470+0000 7fbcc2000640 1 -- 172.21.15.152:0/3432953448 learned_addr learned my addr 172.21.15.152:0/3432953448 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:46:40.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.470+0000 7fbcc3400640 1 --2- 172.21.15.152:0/3432953448 >> v2:172.21.15.152:3300/0 conn(0x7fbcc4071ea0 0x7fbcc406da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35524/0 (socket says 172.21.15.152:35524) 2024-04-17T08:46:40.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.470+0000 7fbcc2a00640 1 --2- 172.21.15.152:0/3432953448 >> v2:172.21.15.196:3300/0 conn(0x7fbcc4147690 0x7fbcc41622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:40.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.470+0000 7fbcc3400640 1 -- 172.21.15.152:0/3432953448 >> v2:172.21.15.196:3300/0 conn(0x7fbcc4147690 msgr2=0x7fbcc41622e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:40.474 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.470+0000 7fbcc3400640 1 --2- 172.21.15.152:0/3432953448 >> v2:172.21.15.196:3300/0 conn(0x7fbcc4147690 0x7fbcc41622e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:40.474 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.470+0000 7fbcc3400640 1 -- 172.21.15.152:0/3432953448 >> v1:172.21.15.152:6789/0 conn(0x7fbcc4147a90 legacy=0x7fbcc4071790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:40.474 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.470+0000 7fbcc3400640 1 -- 172.21.15.152:0/3432953448 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcc4163060 con 0x7fbcc4071ea0 2024-04-17T08:46:40.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.474+0000 7fbcc3400640 1 --2- 172.21.15.152:0/3432953448 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbcc4071ea0 0x7fbcc406da80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbcc40b31f0 tx=0x7fbcbc01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e80ed722ac75013 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:40.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.474+0000 7fbcc1600640 1 -- 172.21.15.152:0/3432953448 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc0b2070 con 0x7fbcc4071ea0 2024-04-17T08:46:40.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.474+0000 7fbcc1600640 1 -- 172.21.15.152:0/3432953448 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcbc0a57f0 con 0x7fbcc4071ea0 2024-04-17T08:46:40.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.474+0000 7fbcc1600640 1 -- 172.21.15.152:0/3432953448 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc0a5bc0 con 0x7fbcc4071ea0 2024-04-17T08:46:40.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.474+0000 7fbcc9e00640 1 -- 172.21.15.152:0/3432953448 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbcc4071ea0 msgr2=0x7fbcc406da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:40.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.474+0000 7fbcc9e00640 1 --2- 172.21.15.152:0/3432953448 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbcc4071ea0 0x7fbcc406da80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbcc40b31f0 tx=0x7fbcbc01c930 comp rx=0 tx=0).stop 2024-04-17T08:46:40.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.474+0000 7fbcc9e00640 1 -- 172.21.15.152:0/3432953448 shutdown_connections 2024-04-17T08:46:40.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.474+0000 7fbcc9e00640 1 --2- 172.21.15.152:0/3432953448 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbcc4071ea0 0x7fbcc406da80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:40.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.474+0000 7fbcc9e00640 1 --2- 172.21.15.152:0/3432953448 >> v2:172.21.15.196:3300/0 conn(0x7fbcc4147690 0x7fbcc41622e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:40.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.474+0000 7fbcc9e00640 1 -- 172.21.15.152:0/3432953448 >> 172.21.15.152:0/3432953448 conn(0x7fbcc40d2350 msgr2=0x7fbcc40d2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:40.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.474+0000 7fbcc9e00640 1 -- 172.21.15.152:0/3432953448 shutdown_connections 2024-04-17T08:46:40.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.474+0000 7fbcc9e00640 1 -- 172.21.15.152:0/3432953448 wait complete. 2024-04-17T08:46:40.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.478+0000 7fbcc9e00640 1 Processor -- start 2024-04-17T08:46:40.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.478+0000 7fbcc9e00640 1 -- start start 2024-04-17T08:46:40.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.478+0000 7fbcc9e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbcc4071ea0 0x7fbcc40cf670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:40.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.478+0000 7fbcc9e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbcc4147690 0x7fbcc41f77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:40.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.478+0000 7fbcc9e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbcc4147a90 0x7fbcc415c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:40.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.478+0000 7fbcc9e00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc406eb60 con 0x7fbcc4147a90 2024-04-17T08:46:40.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.478+0000 7fbcc9e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc406e9e0 con 0x7fbcc4071ea0 2024-04-17T08:46:40.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.478+0000 7fbcc9e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fbcc406ece0 con 0x7fbcc4147690 2024-04-17T08:46:40.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.478+0000 7fbcc3400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbcc4147a90 0x7fbcc415c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:40.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.478+0000 7fbcc3400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbcc4147a90 0x7fbcc415c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35534/0 (socket says 172.21.15.152:35534) 2024-04-17T08:46:40.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.478+0000 7fbcc3400640 1 -- 172.21.15.152:0/2291161245 learned_addr learned my addr 172.21.15.152:0/2291161245 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:40.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.478+0000 7fbcc2000640 1 --2- 172.21.15.152:0/2291161245 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbcc4147690 0x7fbcc41f77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:40.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.478+0000 7fbcc2a00640 1 --2- 172.21.15.152:0/2291161245 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbcc4071ea0 0x7fbcc40cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:40.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.478+0000 7fbcc3400640 1 -- 172.21.15.152:0/2291161245 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbcc4147690 msgr2=0x7fbcc41f77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:40.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.478+0000 7fbcc3400640 1 --2- 172.21.15.152:0/2291161245 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbcc4147690 0x7fbcc41f77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:40.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.478+0000 7fbcc3400640 1 -- 172.21.15.152:0/2291161245 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbcc4071ea0 msgr2=0x7fbcc40cf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:40.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.478+0000 7fbcc3400640 1 --2- 172.21.15.152:0/2291161245 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbcc4071ea0 0x7fbcc40cf670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:40.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.478+0000 7fbcc3400640 1 -- 172.21.15.152:0/2291161245 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcc41f7e60 con 0x7fbcc4147a90 2024-04-17T08:46:40.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.478+0000 7fbcc3400640 1 --2- 172.21.15.152:0/2291161245 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbcc4147a90 0x7fbcc415c680 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc0b0040 tx=0x7fbcbc0196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:40.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.478+0000 7fbcbb400640 1 -- 172.21.15.152:0/2291161245 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc0b2050 con 0x7fbcc4147a90 2024-04-17T08:46:40.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.478+0000 7fbcbb400640 1 -- 172.21.15.152:0/2291161245 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcbc0be070 con 0x7fbcc4147a90 2024-04-17T08:46:40.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.478+0000 7fbcbb400640 1 -- 172.21.15.152:0/2291161245 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc009450 con 0x7fbcc4147a90 2024-04-17T08:46:40.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.478+0000 7fbcc9e00640 1 -- 172.21.15.152:0/2291161245 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcc41f8140 con 0x7fbcc4147a90 2024-04-17T08:46:40.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.478+0000 7fbcc9e00640 1 -- 172.21.15.152:0/2291161245 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcc41f8700 con 0x7fbcc4147a90 2024-04-17T08:46:40.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.482+0000 7fbcc9e00640 1 -- 172.21.15.152:0/2291161245 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcc4068a30 con 0x7fbcc4147a90 2024-04-17T08:46:40.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.482+0000 7fbcbb400640 1 -- 172.21.15.152:0/2291161245 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbcbc0adc40 con 0x7fbcc4147a90 2024-04-17T08:46:40.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.482+0000 7fbcbb400640 1 --2- 172.21.15.152:0/2291161245 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fbca40683b0 0x7fbca406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:40.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.482+0000 7fbcbb400640 1 -- 172.21.15.152:0/2291161245 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fbcbc1218e0 con 0x7fbcc4147a90 2024-04-17T08:46:40.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.482+0000 7fbcc2a00640 1 --2- 172.21.15.152:0/2291161245 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fbca40683b0 0x7fbca406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:40.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.482+0000 7fbcc2a00640 1 --2- 172.21.15.152:0/2291161245 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fbca40683b0 0x7fbca406a870 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4009b60 tx=0x7fbcb4009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:40.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.486+0000 7fbcbb400640 1 -- 172.21.15.152:0/2291161245 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fbcbc0c7020 con 0x7fbcc4147a90 2024-04-17T08:46:40.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.678+0000 7fbcc9e00640 1 -- 172.21.15.152:0/2291161245 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbcc40b3690 con 0x7fbcc4147a90 2024-04-17T08:46:40.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.678+0000 7fbcbb400640 1 -- 172.21.15.152:0/2291161245 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5207 (secure 0 0 0) 0x7fbcbc016520 con 0x7fbcc4147a90 2024-04-17T08:46:40.679 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:46:40.679 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6834/2461981726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":2461981726},{"type":"v1","addr":"172.21.15.196:6834","nonce":2461981726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6835/3397289430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6833","nonce":3397289430},{"type":"v1","addr":"172.21.15.196:6835","nonce":3397289430}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/2491486613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2491486613},{"type":"v1","addr":"172.21.15.152:6836","nonce":2491486613}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-17T08:46:33.607720+0000","modified":"2024-04-17T08:46:38.660032+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6837/3890159871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":3890159871},{"type":"v1","addr":"172.21.15.152:6837","nonce":3890159871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-04-17T08:46:40.679 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 7 2024-04-17T08:46:40.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.678+0000 7fbcc9e00640 1 -- 172.21.15.152:0/2291161245 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fbca40683b0 msgr2=0x7fbca406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:40.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.678+0000 7fbcc9e00640 1 --2- 172.21.15.152:0/2291161245 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fbca40683b0 0x7fbca406a870 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4009b60 tx=0x7fbcb4009190 comp rx=0 tx=0).stop 2024-04-17T08:46:40.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.678+0000 7fbcc9e00640 1 -- 172.21.15.152:0/2291161245 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbcc4147a90 msgr2=0x7fbcc415c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:40.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.678+0000 7fbcc9e00640 1 --2- 172.21.15.152:0/2291161245 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbcc4147a90 0x7fbcc415c680 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc0b0040 tx=0x7fbcbc0196d0 comp rx=0 tx=0).stop 2024-04-17T08:46:40.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.678+0000 7fbcc9e00640 1 -- 172.21.15.152:0/2291161245 shutdown_connections 2024-04-17T08:46:40.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.678+0000 7fbcc9e00640 1 --2- 172.21.15.152:0/2291161245 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbcc4147a90 0x7fbcc415c680 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:40.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.678+0000 7fbcc9e00640 1 --2- 172.21.15.152:0/2291161245 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fbca40683b0 0x7fbca406a870 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:40.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.678+0000 7fbcc9e00640 1 --2- 172.21.15.152:0/2291161245 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbcc4147690 0x7fbcc41f77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:40.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.678+0000 7fbcc9e00640 1 --2- 172.21.15.152:0/2291161245 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbcc4071ea0 0x7fbcc40cf670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:40.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.678+0000 7fbcc9e00640 1 -- 172.21.15.152:0/2291161245 >> 172.21.15.152:0/2291161245 conn(0x7fbcc40d2350 msgr2=0x7fbcc413b140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:40.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.678+0000 7fbcc9e00640 1 -- 172.21.15.152:0/2291161245 shutdown_connections 2024-04-17T08:46:40.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.678+0000 7fbcc9e00640 1 -- 172.21.15.152:0/2291161245 wait complete. 2024-04-17T08:46:40.700 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T08:46:40.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.834+0000 7faf40000640 1 Processor -- start 2024-04-17T08:46:40.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.834+0000 7faf40000640 1 -- start start 2024-04-17T08:46:40.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.834+0000 7faf40000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7faf3806f980 0x7faf38072530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:40.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.834+0000 7faf40000640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7faf380d0360 0x7faf380d07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:40.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.834+0000 7faf40000640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf3815bfd0 con 0x7faf380af670 2024-04-17T08:46:40.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.834+0000 7faf40000640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7faf380d0cf0 con 0x7faf380d0360 2024-04-17T08:46:40.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.834+0000 7faf40000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7faf3815c820 con 0x7faf3806f980 2024-04-17T08:46:40.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.834+0000 7faf3d600640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7faf380af670 0x7faf3815b8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:56804/0 (socket says 172.21.15.152:56804) 2024-04-17T08:46:40.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.834+0000 7faf3d600640 1 -- 172.21.15.152:0/3819599497 learned_addr learned my addr 172.21.15.152:0/3819599497 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:46:40.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.834+0000 7faf3e000640 1 --2- 172.21.15.152:0/3819599497 >> v2:172.21.15.152:3300/0 conn(0x7faf380d0360 0x7faf380d07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:40.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.834+0000 7faf3cc00640 1 --2- 172.21.15.152:0/3819599497 >> v2:172.21.15.196:3300/0 conn(0x7faf3806f980 0x7faf38072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:40.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.834+0000 7faf3e000640 1 -- 172.21.15.152:0/3819599497 >> v2:172.21.15.196:3300/0 conn(0x7faf3806f980 msgr2=0x7faf38072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:40.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.834+0000 7faf3e000640 1 --2- 172.21.15.152:0/3819599497 >> v2:172.21.15.196:3300/0 conn(0x7faf3806f980 0x7faf38072530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:40.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.834+0000 7faf3e000640 1 -- 172.21.15.152:0/3819599497 >> v1:172.21.15.152:6789/0 conn(0x7faf380af670 legacy=0x7faf3815b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:40.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.834+0000 7faf3e000640 1 -- 172.21.15.152:0/3819599497 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf3815c260 con 0x7faf380d0360 2024-04-17T08:46:40.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.834+0000 7faf37e00640 1 -- 172.21.15.152:0/3819599497 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1989782667 0 0) 0x7faf3815bfd0 con 0x7faf380af670 2024-04-17T08:46:40.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.838+0000 7faf3e000640 1 --2- 172.21.15.152:0/3819599497 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf380d0360 0x7faf380d07b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7faf380b41d0 tx=0x7faf3001c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a42c3b401726d17 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:40.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.838+0000 7faf37e00640 1 -- 172.21.15.152:0/3819599497 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf300b2070 con 0x7faf380d0360 2024-04-17T08:46:40.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.838+0000 7faf37e00640 1 -- 172.21.15.152:0/3819599497 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf300a5930 con 0x7faf380d0360 2024-04-17T08:46:40.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.838+0000 7faf37e00640 1 -- 172.21.15.152:0/3819599497 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf300a5d00 con 0x7faf380d0360 2024-04-17T08:46:40.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.838+0000 7faf40000640 1 -- 172.21.15.152:0/3819599497 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf380d0360 msgr2=0x7faf380d07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:40.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.838+0000 7faf40000640 1 --2- 172.21.15.152:0/3819599497 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf380d0360 0x7faf380d07b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7faf380b41d0 tx=0x7faf3001c870 comp rx=0 tx=0).stop 2024-04-17T08:46:40.841 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.838+0000 7faf40000640 1 -- 172.21.15.152:0/3819599497 shutdown_connections 2024-04-17T08:46:40.841 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.838+0000 7faf40000640 1 --2- 172.21.15.152:0/3819599497 >> v2:172.21.15.196:3300/0 conn(0x7faf3806f980 0x7faf38072530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:40.841 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.838+0000 7faf40000640 1 --2- 172.21.15.152:0/3819599497 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf380d0360 0x7faf380d07b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:40.841 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.838+0000 7faf40000640 1 -- 172.21.15.152:0/3819599497 >> 172.21.15.152:0/3819599497 conn(0x7faf380b3350 msgr2=0x7faf380b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:40.841 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.838+0000 7faf40000640 1 -- 172.21.15.152:0/3819599497 shutdown_connections 2024-04-17T08:46:40.841 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.838+0000 7faf40000640 1 -- 172.21.15.152:0/3819599497 wait complete. 2024-04-17T08:46:40.842 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.842+0000 7faf40000640 1 Processor -- start 2024-04-17T08:46:40.842 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.842+0000 7faf40000640 1 -- start start 2024-04-17T08:46:40.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.842+0000 7faf40000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faf3806f980 0x7faf38155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:40.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.842+0000 7faf40000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf380af670 0x7faf38156a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:40.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.842+0000 7faf40000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf380d0360 0x7faf38156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:40.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.842+0000 7faf40000640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7faf38072a70 con 0x7faf380d0360 2024-04-17T08:46:40.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.842+0000 7faf40000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7faf380afa50 con 0x7faf3806f980 2024-04-17T08:46:40.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.842+0000 7faf40000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7faf38072bf0 con 0x7faf380af670 2024-04-17T08:46:40.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.842+0000 7faf3e000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf380d0360 0x7faf38156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:40.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.842+0000 7faf3e000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf380d0360 0x7faf38156fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35552/0 (socket says 172.21.15.152:35552) 2024-04-17T08:46:40.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.842+0000 7faf3e000640 1 -- 172.21.15.152:0/1067270803 learned_addr learned my addr 172.21.15.152:0/1067270803 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:40.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.842+0000 7faf3cc00640 1 --2- 172.21.15.152:0/1067270803 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf380af670 0x7faf38156a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:40.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.842+0000 7faf3d600640 1 --2- 172.21.15.152:0/1067270803 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faf3806f980 0x7faf38155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:40.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.842+0000 7faf3e000640 1 -- 172.21.15.152:0/1067270803 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf380af670 msgr2=0x7faf38156a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:40.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.842+0000 7faf3e000640 1 --2- 172.21.15.152:0/1067270803 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf380af670 0x7faf38156a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:40.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.842+0000 7faf3e000640 1 -- 172.21.15.152:0/1067270803 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faf3806f980 msgr2=0x7faf38155070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:40.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.842+0000 7faf3e000640 1 --2- 172.21.15.152:0/1067270803 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faf3806f980 0x7faf38155070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:40.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.842+0000 7faf3e000640 1 -- 172.21.15.152:0/1067270803 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf38153fd0 con 0x7faf380d0360 2024-04-17T08:46:40.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.842+0000 7faf3e000640 1 --2- 172.21.15.152:0/1067270803 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf380d0360 0x7faf38156fa0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7faf3001a4a0 tx=0x7faf30019610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:40.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.842+0000 7faf35600640 1 -- 172.21.15.152:0/1067270803 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf300b2050 con 0x7faf380d0360 2024-04-17T08:46:40.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.842+0000 7faf35600640 1 -- 172.21.15.152:0/1067270803 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf300be070 con 0x7faf380d0360 2024-04-17T08:46:40.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.842+0000 7faf40000640 1 -- 172.21.15.152:0/1067270803 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf381542b0 con 0x7faf380d0360 2024-04-17T08:46:40.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.842+0000 7faf35600640 1 -- 172.21.15.152:0/1067270803 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf300ada90 con 0x7faf380d0360 2024-04-17T08:46:40.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.842+0000 7faf40000640 1 -- 172.21.15.152:0/1067270803 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf38154870 con 0x7faf380d0360 2024-04-17T08:46:40.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.842+0000 7faf40000640 1 -- 172.21.15.152:0/1067270803 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf38068a30 con 0x7faf380d0360 2024-04-17T08:46:40.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.846+0000 7faf35600640 1 -- 172.21.15.152:0/1067270803 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7faf300adc30 con 0x7faf380d0360 2024-04-17T08:46:40.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.846+0000 7faf35600640 1 --2- 172.21.15.152:0/1067270803 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7faf18068380 0x7faf1806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:40.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.846+0000 7faf35600640 1 -- 172.21.15.152:0/1067270803 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7faf30121e20 con 0x7faf380d0360 2024-04-17T08:46:40.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.846+0000 7faf3d600640 1 --2- 172.21.15.152:0/1067270803 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7faf18068380 0x7faf1806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:40.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.846+0000 7faf3d600640 1 --2- 172.21.15.152:0/1067270803 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7faf18068380 0x7faf1806a840 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faf2c007fd0 tx=0x7faf2c007d60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:40.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:40.850+0000 7faf35600640 1 -- 172.21.15.152:0/1067270803 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7faf30016520 con 0x7faf380d0360 2024-04-17T08:46:41.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.006+0000 7faf40000640 1 -- 172.21.15.152:0/1067270803 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faf38074e80 con 0x7faf380d0360 2024-04-17T08:46:41.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.006+0000 7faf35600640 1 -- 172.21.15.152:0/1067270803 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7faf300f19b0 con 0x7faf380d0360 2024-04-17T08:46:41.010 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:46:41.010 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":24,"fsid":"ce68f82e-ec5f-4205-9fd5-bdfdf6ef31e2","created":"2024-04-17T08:46:08.353546+0000","modified":"2024-04-17T08:46:38.659862+0000","last_up_change":"2024-04-17T08:46:20.738799+0000","last_in_change":"2024-04-17T08:46:11.210050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T08:46:21.386856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T08:46:31.812460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T08:46:32.555559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T08:46:36.258078+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"682f0192-187c-404e-bc7a-b6b4e23825e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6819","nonce":3603799291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6823","nonce":3603799291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6831","nonce":3603799291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6827","nonce":3603799291}]},"public_addr":"172.21.15.152:6819/3603799291","cluster_addr":"172.21.15.152:6823/3603799291","heartbeat_back_addr":"172.21.15.152:6831/3603799291","heartbeat_front_addr":"172.21.15.152:6827/3603799291","state":["exists","up"]},{"osd":1,"uuid":"f0fe8fef-60ec-4a39-83b6-2fa6a5adb0f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6801","nonce":4133383142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6803","nonce":4133383142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6807","nonce":4133383142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6805","nonce":4133383142}]},"public_addr":"172.21.15.152:6801/4133383142","cluster_addr":"172.21.15.152:6803/4133383142","heartbeat_back_addr":"172.21.15.152:6807/4133383142","heartbeat_front_addr":"172.21.15.152:6805/4133383142","state":["exists","up"]},{"osd":2,"uuid":"35f36d9c-5245-4431-a618-f4df0fa380ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6809","nonce":3826143898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6811","nonce":3826143898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6815","nonce":3826143898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6813","nonce":3826143898}]},"public_addr":"172.21.15.152:6809/3826143898","cluster_addr":"172.21.15.152:6811/3826143898","heartbeat_back_addr":"172.21.15.152:6815/3826143898","heartbeat_front_addr":"172.21.15.152:6813/3826143898","state":["exists","up"]},{"osd":3,"uuid":"96e56ca5-15b4-4895-9b79-da2c92043159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6818","nonce":165717826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6822","nonce":165717826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6830","nonce":165717826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6826","nonce":165717826}]},"public_addr":"172.21.15.152:6818/165717826","cluster_addr":"172.21.15.152:6822/165717826","heartbeat_back_addr":"172.21.15.152:6830/165717826","heartbeat_front_addr":"172.21.15.152:6826/165717826","state":["exists","up"]},{"osd":4,"uuid":"f5aa10a4-9ff9-41fe-a5c9-15326f982cc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6817","nonce":4080159297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6819","nonce":4080159297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6823","nonce":4080159297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6821","nonce":4080159297}]},"public_addr":"172.21.15.196:6817/4080159297","cluster_addr":"172.21.15.196:6819/4080159297","heartbeat_back_addr":"172.21.15.196:6823/4080159297","heartbeat_front_addr":"172.21.15.196:6821/4080159297","state":["exists","up"]},{"osd":5,"uuid":"42bab884-3476-47ae-ac65-935fa6e0f055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6801","nonce":3519444232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6803","nonce":3519444232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6807","nonce":3519444232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6805","nonce":3519444232}]},"public_addr":"172.21.15.196:6801/3519444232","cluster_addr":"172.21.15.196:6803/3519444232","heartbeat_back_addr":"172.21.15.196:6807/3519444232","heartbeat_front_addr":"172.21.15.196:6805/3519444232","state":["exists","up"]},{"osd":6,"uuid":"460b6167-f57b-4224-9c92-cfc9b80bbe99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6809","nonce":275739834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6811","nonce":275739834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6815","nonce":275739834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6813","nonce":275739834}]},"public_addr":"172.21.15.196:6809/275739834","cluster_addr":"172.21.15.196:6811/275739834","heartbeat_back_addr":"172.21.15.196:6815/275739834","heartbeat_front_addr":"172.21.15.196:6813/275739834","state":["exists","up"]},{"osd":7,"uuid":"d695643f-5e07-4e2a-a646-c06bd97b6650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6825","nonce":307626968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6827","nonce":307626968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6831","nonce":307626968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6829","nonce":307626968}]},"public_addr":"172.21.15.196:6825/307626968","cluster_addr":"172.21.15.196:6827/307626968","heartbeat_back_addr":"172.21.15.196:6831/307626968","heartbeat_front_addr":"172.21.15.196:6829/307626968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.293257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.964533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.248895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.010000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.832554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.743704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930171+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930962+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T08:46:41.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.010+0000 7faf40000640 1 -- 172.21.15.152:0/1067270803 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7faf18068380 msgr2=0x7faf1806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:41.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.010+0000 7faf40000640 1 --2- 172.21.15.152:0/1067270803 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7faf18068380 0x7faf1806a840 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faf2c007fd0 tx=0x7faf2c007d60 comp rx=0 tx=0).stop 2024-04-17T08:46:41.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.010+0000 7faf40000640 1 -- 172.21.15.152:0/1067270803 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf380d0360 msgr2=0x7faf38156fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:41.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.010+0000 7faf40000640 1 --2- 172.21.15.152:0/1067270803 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf380d0360 0x7faf38156fa0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7faf3001a4a0 tx=0x7faf30019610 comp rx=0 tx=0).stop 2024-04-17T08:46:41.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.010+0000 7faf40000640 1 -- 172.21.15.152:0/1067270803 shutdown_connections 2024-04-17T08:46:41.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.010+0000 7faf40000640 1 --2- 172.21.15.152:0/1067270803 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf380d0360 0x7faf38156fa0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:41.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.010+0000 7faf40000640 1 --2- 172.21.15.152:0/1067270803 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7faf18068380 0x7faf1806a840 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:41.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.010+0000 7faf40000640 1 --2- 172.21.15.152:0/1067270803 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf380af670 0x7faf38156a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:41.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.010+0000 7faf40000640 1 --2- 172.21.15.152:0/1067270803 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faf3806f980 0x7faf38155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:41.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.010+0000 7faf40000640 1 -- 172.21.15.152:0/1067270803 >> 172.21.15.152:0/1067270803 conn(0x7faf380b3350 msgr2=0x7faf3806b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:41.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.010+0000 7faf40000640 1 -- 172.21.15.152:0/1067270803 shutdown_connections 2024-04-17T08:46:41.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.010+0000 7faf40000640 1 -- 172.21.15.152:0/1067270803 wait complete. 2024-04-17T08:46:41.433 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-17T08:46:33.607720+0000', 'modified': '2024-04-17T08:46:38.660032+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'snap_rstat': True, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4278}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4278': {'gid': 4278, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.152:6837/3890159871', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6835', 'nonce': 3890159871}, {'type': 'v1', 'addr': '172.21.15.152:6837', 'nonce': 3890159871}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4278, 'qdb_cluster': [4278]} 2024-04-17T08:46:41.433 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-17T08:46:41.433 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-17T08:46:41.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.570+0000 7f0ded400640 1 Processor -- start 2024-04-17T08:46:41.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.570+0000 7f0ded400640 1 -- start start 2024-04-17T08:46:41.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.570+0000 7f0ded400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f0de815a010 0x7f0de80d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:41.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.570+0000 7f0ded400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0de8160720 0x7f0de80d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:41.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.570+0000 7f0ded400640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0de8160d20 con 0x7f0de815d710 2024-04-17T08:46:41.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.570+0000 7f0ded400640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f0de815d280 con 0x7f0de815a010 2024-04-17T08:46:41.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.570+0000 7f0ded400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f0de815c9d0 con 0x7f0de8160720 2024-04-17T08:46:41.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.570+0000 7f0de6800640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f0de815a010 0x7f0de80d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:41.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.570+0000 7f0ddde00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f0de815d710 0x7f0de8160010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:56808/0 (socket says 172.21.15.152:56808) 2024-04-17T08:46:41.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.570+0000 7f0ddde00640 1 -- 172.21.15.152:0/1766910351 learned_addr learned my addr 172.21.15.152:0/1766910351 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:46:41.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.570+0000 7f0de7200640 1 --2- 172.21.15.152:0/1766910351 >> v2:172.21.15.196:3300/0 conn(0x7f0de8160720 0x7f0de80d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:41.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.570+0000 7f0de6800640 1 -- 172.21.15.152:0/1766910351 >> v2:172.21.15.196:3300/0 conn(0x7f0de8160720 msgr2=0x7f0de80d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:41.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.570+0000 7f0de6800640 1 --2- 172.21.15.152:0/1766910351 >> v2:172.21.15.196:3300/0 conn(0x7f0de8160720 0x7f0de80d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:41.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.570+0000 7f0de6800640 1 -- 172.21.15.152:0/1766910351 >> v1:172.21.15.152:6789/0 conn(0x7f0de815d710 legacy=0x7f0de8160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:41.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.570+0000 7f0de6800640 1 -- 172.21.15.152:0/1766910351 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0de815cc30 con 0x7f0de815a010 2024-04-17T08:46:41.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.570+0000 7f0de5e00640 1 -- 172.21.15.152:0/1766910351 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3917842833 0 0) 0x7f0de8160d20 con 0x7f0de815d710 2024-04-17T08:46:41.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.574+0000 7f0de6800640 1 --2- 172.21.15.152:0/1766910351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0de815a010 0x7f0de80d0360 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0de80b41a0 tx=0x7f0dd801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b7114bacc4e5bc server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:41.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.574+0000 7f0de5e00640 1 -- 172.21.15.152:0/1766910351 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dd80b0070 con 0x7f0de815a010 2024-04-17T08:46:41.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.574+0000 7f0de5e00640 1 -- 172.21.15.152:0/1766910351 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dd80ab600 con 0x7f0de815a010 2024-04-17T08:46:41.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.574+0000 7f0de5e00640 1 -- 172.21.15.152:0/1766910351 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dd80ab9d0 con 0x7f0de815a010 2024-04-17T08:46:41.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.574+0000 7f0ded400640 1 -- 172.21.15.152:0/1766910351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0de815a010 msgr2=0x7f0de80d0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:41.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.574+0000 7f0ded400640 1 --2- 172.21.15.152:0/1766910351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0de815a010 0x7f0de80d0360 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0de80b41a0 tx=0x7f0dd801c3f0 comp rx=0 tx=0).stop 2024-04-17T08:46:41.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.574+0000 7f0ded400640 1 -- 172.21.15.152:0/1766910351 shutdown_connections 2024-04-17T08:46:41.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.574+0000 7f0ded400640 1 --2- 172.21.15.152:0/1766910351 >> v2:172.21.15.196:3300/0 conn(0x7f0de8160720 0x7f0de80d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:41.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.574+0000 7f0ded400640 1 --2- 172.21.15.152:0/1766910351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0de815a010 0x7f0de80d0360 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:41.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.574+0000 7f0ded400640 1 -- 172.21.15.152:0/1766910351 >> 172.21.15.152:0/1766910351 conn(0x7f0de80b3350 msgr2=0x7f0de80b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:41.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.574+0000 7f0ded400640 1 -- 172.21.15.152:0/1766910351 shutdown_connections 2024-04-17T08:46:41.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.574+0000 7f0ded400640 1 -- 172.21.15.152:0/1766910351 wait complete. 2024-04-17T08:46:41.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.574+0000 7f0ded400640 1 Processor -- start 2024-04-17T08:46:41.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.574+0000 7f0ded400640 1 -- start start 2024-04-17T08:46:41.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.578+0000 7f0ded400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0de815a010 0x7f0de8098d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:41.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.578+0000 7f0ded400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0de815d710 0x7f0de8099700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:41.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.578+0000 7f0ded400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0de8160720 0x7f0de8151400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:41.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.578+0000 7f0ded400640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0de815e780 con 0x7f0de815d710 2024-04-17T08:46:41.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.578+0000 7f0ded400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0de815e600 con 0x7f0de8160720 2024-04-17T08:46:41.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.578+0000 7f0ded400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f0de815e900 con 0x7f0de815a010 2024-04-17T08:46:41.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.578+0000 7f0ddde00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0de815d710 0x7f0de8099700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:41.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.578+0000 7f0ddde00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0de815d710 0x7f0de8099700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35560/0 (socket says 172.21.15.152:35560) 2024-04-17T08:46:41.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.578+0000 7f0ddde00640 1 -- 172.21.15.152:0/4291735174 learned_addr learned my addr 172.21.15.152:0/4291735174 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:41.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.578+0000 7f0de6800640 1 --2- 172.21.15.152:0/4291735174 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0de815a010 0x7f0de8098d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:41.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.578+0000 7f0de7200640 1 --2- 172.21.15.152:0/4291735174 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0de8160720 0x7f0de8151400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:41.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.578+0000 7f0ddde00640 1 -- 172.21.15.152:0/4291735174 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0de815a010 msgr2=0x7f0de8098d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:41.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.578+0000 7f0ddde00640 1 --2- 172.21.15.152:0/4291735174 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0de815a010 0x7f0de8098d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:41.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.578+0000 7f0ddde00640 1 -- 172.21.15.152:0/4291735174 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0de8160720 msgr2=0x7f0de8151400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:41.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.578+0000 7f0ddde00640 1 --2- 172.21.15.152:0/4291735174 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0de8160720 0x7f0de8151400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:41.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.578+0000 7f0ddde00640 1 -- 172.21.15.152:0/4291735174 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0de80992c0 con 0x7f0de815d710 2024-04-17T08:46:41.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.578+0000 7f0ddde00640 1 --2- 172.21.15.152:0/4291735174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0de815d710 0x7f0de8099700 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0dd0001570 tx=0x7f0dd000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:41.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.578+0000 7f0ddf400640 1 -- 172.21.15.152:0/4291735174 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dd0018070 con 0x7f0de815d710 2024-04-17T08:46:41.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.578+0000 7f0ddf400640 1 -- 172.21.15.152:0/4291735174 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dd000a640 con 0x7f0de815d710 2024-04-17T08:46:41.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.578+0000 7f0ddf400640 1 -- 172.21.15.152:0/4291735174 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dd000aa30 con 0x7f0de815d710 2024-04-17T08:46:41.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.578+0000 7f0ded400640 1 -- 172.21.15.152:0/4291735174 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0de8158ae0 con 0x7f0de815d710 2024-04-17T08:46:41.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.578+0000 7f0ded400640 1 -- 172.21.15.152:0/4291735174 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0de80ced80 con 0x7f0de815d710 2024-04-17T08:46:41.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.582+0000 7f0ddf400640 1 -- 172.21.15.152:0/4291735174 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0dd000abd0 con 0x7f0de815d710 2024-04-17T08:46:41.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.582+0000 7f0ddf400640 1 --2- 172.21.15.152:0/4291735174 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0dc4068380 0x7f0dc406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:41.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.582+0000 7f0ddf400640 1 -- 172.21.15.152:0/4291735174 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0dd0086370 con 0x7f0de815d710 2024-04-17T08:46:41.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.582+0000 7f0de6800640 1 --2- 172.21.15.152:0/4291735174 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0dc4068380 0x7f0dc406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:41.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.582+0000 7f0df08e6000 1 Processor -- start 2024-04-17T08:46:41.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.582+0000 7f0df08e6000 1 -- start start 2024-04-17T08:46:41.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.582+0000 7f0de6800640 1 --2- 172.21.15.152:0/4291735174 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0dc4068380 0x7f0dc406a840 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0dd80ad000 tx=0x7f0dd8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:41.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.582+0000 7f0df08e6000 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579e557fbc0 0x5579e557ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:41.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.582+0000 7f0df08e6000 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5579e5585f20 0x5579e5586300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:41.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.582+0000 7f0df08e6000 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5579e5586840 0x5579e55c9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:41.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.582+0000 7f0df08e6000 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5579e53c94d0 con 0x5579e557fbc0 2024-04-17T08:46:41.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.582+0000 7f0df08e6000 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5579e5363bf0 con 0x5579e5586840 2024-04-17T08:46:41.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.582+0000 7f0df08e6000 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x5579e53c5490 con 0x5579e5585f20 2024-04-17T08:46:41.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.582+0000 7f0de6800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579e557fbc0 0x5579e557ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:41.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.582+0000 7f0de6800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579e557fbc0 0x5579e557ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35574/0 (socket says 172.21.15.152:35574) 2024-04-17T08:46:41.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.582+0000 7f0de6800640 1 -- 172.21.15.152:0/1624641981 learned_addr learned my addr 172.21.15.152:0/1624641981 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:41.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.582+0000 7f0de7200640 1 --2- 172.21.15.152:0/1624641981 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5579e5586840 0x5579e55c9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:41.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.582+0000 7f0ddde00640 1 --2- 172.21.15.152:0/1624641981 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5579e5585f20 0x5579e5586300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:41.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.582+0000 7f0de6800640 1 -- 172.21.15.152:0/1624641981 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5579e5585f20 msgr2=0x5579e5586300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:41.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.582+0000 7f0de6800640 1 --2- 172.21.15.152:0/1624641981 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5579e5585f20 0x5579e5586300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:41.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.582+0000 7f0de6800640 1 -- 172.21.15.152:0/1624641981 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5579e5586840 msgr2=0x5579e55c9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:41.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.582+0000 7f0de6800640 1 --2- 172.21.15.152:0/1624641981 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5579e5586840 0x5579e55c9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:41.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.582+0000 7f0de6800640 1 -- 172.21.15.152:0/1624641981 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579e534fe80 con 0x5579e557fbc0 2024-04-17T08:46:41.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.582+0000 7f0de7200640 1 --2- 172.21.15.152:0/1624641981 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5579e5586840 0x5579e55c9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:46:41.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.582+0000 7f0de6800640 1 --2- 172.21.15.152:0/1624641981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579e557fbc0 0x5579e557ffa0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0dd8097dd0 tx=0x7f0dd8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27c74166761d99 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:41.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.582+0000 7f0dd7400640 1 -- 172.21.15.152:0/1624641981 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dd80b0040 con 0x5579e557fbc0 2024-04-17T08:46:41.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.582+0000 7f0dd7400640 1 -- 172.21.15.152:0/1624641981 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dd80c5070 con 0x5579e557fbc0 2024-04-17T08:46:41.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.582+0000 7f0dd7400640 1 -- 172.21.15.152:0/1624641981 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dd80b6860 con 0x5579e557fbc0 2024-04-17T08:46:41.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.586+0000 7f0df08e6000 1 -- 172.21.15.152:0/1624641981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579e557fbc0 msgr2=0x5579e557ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:41.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.586+0000 7f0df08e6000 1 --2- 172.21.15.152:0/1624641981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579e557fbc0 0x5579e557ffa0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0dd8097dd0 tx=0x7f0dd8004740 comp rx=0 tx=0).stop 2024-04-17T08:46:41.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.586+0000 7f0df08e6000 1 -- 172.21.15.152:0/1624641981 shutdown_connections 2024-04-17T08:46:41.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.586+0000 7f0df08e6000 1 --2- 172.21.15.152:0/1624641981 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5579e5586840 0x5579e55c9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:41.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.586+0000 7f0df08e6000 1 --2- 172.21.15.152:0/1624641981 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5579e5585f20 0x5579e5586300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:41.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.586+0000 7f0df08e6000 1 --2- 172.21.15.152:0/1624641981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579e557fbc0 0x5579e557ffa0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:41.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.586+0000 7f0df08e6000 1 -- 172.21.15.152:0/1624641981 >> 172.21.15.152:0/1624641981 conn(0x5579e5581470 msgr2=0x5579e557a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:41.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.586+0000 7f0df08e6000 1 -- 172.21.15.152:0/1624641981 shutdown_connections 2024-04-17T08:46:41.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.586+0000 7f0df08e6000 1 -- 172.21.15.152:0/1624641981 wait complete. 2024-04-17T08:46:41.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.586+0000 7f0df08e6000 1 -- start start 2024-04-17T08:46:41.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.586+0000 7f0df08e6000 1 Processor -- start 2024-04-17T08:46:41.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.586+0000 7f0df08e6000 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5579e557fbc0 0x5579e55cfa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:41.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.586+0000 7f0df08e6000 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5579e5585f20 0x5579e55cff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:41.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.586+0000 7f0df08e6000 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579e5586840 0x5579e558a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:41.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.586+0000 7f0df08e6000 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5579e5386a60 con 0x5579e5586840 2024-04-17T08:46:41.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.586+0000 7f0df08e6000 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5579e536de80 con 0x5579e557fbc0 2024-04-17T08:46:41.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.586+0000 7f0df08e6000 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x5579e5384cf0 con 0x5579e5585f20 2024-04-17T08:46:41.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.586+0000 7f0df08e6000 10 client.0 _ll_register_callbacks cb 0x5579e5566a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-17T08:46:41.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.586+0000 7f0de7200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579e5586840 0x5579e558a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:41.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.586+0000 7f0de7200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579e5586840 0x5579e558a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35578/0 (socket says 172.21.15.152:35578) 2024-04-17T08:46:41.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.586+0000 7f0de7200640 1 -- 172.21.15.152:0/367224468 learned_addr learned my addr 172.21.15.152:0/367224468 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:41.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.586+0000 7f0de6800640 1 --2- 172.21.15.152:0/367224468 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5579e557fbc0 0x5579e55cfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:41.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.586+0000 7f0ddde00640 1 --2- 172.21.15.152:0/367224468 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5579e5585f20 0x5579e55cff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:41.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.586+0000 7f0de7200640 1 -- 172.21.15.152:0/367224468 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5579e5585f20 msgr2=0x5579e55cff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:41.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.586+0000 7f0de7200640 1 --2- 172.21.15.152:0/367224468 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5579e5585f20 0x5579e55cff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:41.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.586+0000 7f0de7200640 1 -- 172.21.15.152:0/367224468 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5579e557fbc0 msgr2=0x5579e55cfa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:41.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.586+0000 7f0de7200640 1 --2- 172.21.15.152:0/367224468 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5579e557fbc0 0x5579e55cfa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:41.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.586+0000 7f0de7200640 1 -- 172.21.15.152:0/367224468 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579e5363e40 con 0x5579e5586840 2024-04-17T08:46:41.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.586+0000 7f0de7200640 1 --2- 172.21.15.152:0/367224468 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579e5586840 0x5579e558a470 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0de0012630 tx=0x7f0de0012af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=222f37a20b1ea131 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:41.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.586+0000 7f0dcbe00640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-04-17T08:46:41.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.586+0000 7f0dcbe00640 1 -- 172.21.15.152:0/367224468 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de001b070 con 0x5579e5586840 2024-04-17T08:46:41.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.586+0000 7f0dcbe00640 1 -- 172.21.15.152:0/367224468 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0de0014680 con 0x5579e5586840 2024-04-17T08:46:41.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.586+0000 7f0df08e6000 1 -- 172.21.15.152:0/367224468 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0dd80c5070 con 0x5579e5586840 2024-04-17T08:46:41.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.586+0000 7f0dcbe00640 1 -- 172.21.15.152:0/367224468 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f0de0026050 con 0x5579e5586840 2024-04-17T08:46:41.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.586+0000 7f0df08e6000 10 client.4440 fetch_fsmap learned FSMap version 7 2024-04-17T08:46:41.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.586+0000 7f0df08e6000 1 -- 172.21.15.152:0/367224468 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x5579e5394e00 con 0x5579e5586840 2024-04-17T08:46:41.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.590+0000 7f0dcbe00640 1 -- 172.21.15.152:0/367224468 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dd80c5070 con 0x5579e5586840 2024-04-17T08:46:41.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.590+0000 7f0dcbe00640 1 -- 172.21.15.152:0/367224468 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 7) ==== 3503+0+0 (secure 0 0 0) 0x7f0de0029020 con 0x5579e5586840 2024-04-17T08:46:41.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.590+0000 7f0df08e6000 10 client.4440 fetch_fsmap finished waiting for FSMap version 7 2024-04-17T08:46:41.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.590+0000 7f0df08e6000 10 client.4440 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-17T08:46:41.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.590+0000 7f0df08e6000 20 client.4440 populate_metadata read hostname 'smithi152' 2024-04-17T08:46:41.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.590+0000 7f0df08e6000 1 --2- 172.21.15.152:0/367224468 >> [v2:172.21.15.152:6835/3890159871,v1:172.21.15.152:6837/3890159871] conn(0x5579e558b210 0x5579e558b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:41.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.590+0000 7f0df08e6000 4 client.4440 mds_command: new command op to 4278 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-17T08:46:41.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.590+0000 7f0df08e6000 1 -- 172.21.15.152:0/367224468 --> [v2:172.21.15.152:6835/3890159871,v1:172.21.15.152:6837/3890159871] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5579e5362bc0 con 0x5579e558b210 2024-04-17T08:46:41.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.590+0000 7f0de6800640 1 --2- 172.21.15.152:0/367224468 >> [v2:172.21.15.152:6835/3890159871,v1:172.21.15.152:6837/3890159871] conn(0x5579e558b210 0x5579e558b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:41.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.590+0000 7f0de6800640 1 --2- 172.21.15.152:0/367224468 >> [v2:172.21.15.152:6835/3890159871,v1:172.21.15.152:6837/3890159871] conn(0x5579e558b210 0x5579e558b5f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=545327e0ed730722 server_cookie=3a53e10e486a38d2 in_seq=0 out_seq=0 2024-04-17T08:46:41.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.590+0000 7f0dcbe00640 10 client.4440 ms_handle_connect on v2:172.21.15.152:6835/3890159871 2024-04-17T08:46:41.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.590+0000 7f0dcbe00640 1 -- 172.21.15.152:0/367224468 <== mds.0 v2:172.21.15.152:6835/3890159871 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5579e5362bc0 con 0x5579e558b210 2024-04-17T08:46:41.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.590+0000 7f0dcbe00640 10 client.4440 handle_command_reply: tid=0 2024-04-17T08:46:41.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.590+0000 7f0df08e6000 1 client.4440 shutdown 2024-04-17T08:46:41.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.590+0000 7f0df08e6000 1 -- 172.21.15.152:0/367224468 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579e5586840 msgr2=0x5579e558a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:41.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.590+0000 7f0df08e6000 1 --2- 172.21.15.152:0/367224468 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579e5586840 0x5579e558a470 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0de0012630 tx=0x7f0de0012af0 comp rx=0 tx=0).stop 2024-04-17T08:46:41.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.590+0000 7f0df08e6000 1 -- 172.21.15.152:0/367224468 shutdown_connections 2024-04-17T08:46:41.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.590+0000 7f0df08e6000 1 --2- 172.21.15.152:0/367224468 >> [v2:172.21.15.152:6835/3890159871,v1:172.21.15.152:6837/3890159871] conn(0x5579e558b210 0x5579e558b5f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:41.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.590+0000 7f0df08e6000 1 --2- 172.21.15.152:0/367224468 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579e5586840 0x5579e558a470 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:41.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.590+0000 7f0df08e6000 1 --2- 172.21.15.152:0/367224468 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5579e5585f20 0x5579e55cff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:41.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.590+0000 7f0dcbe00640 0 client.4440 ms_handle_reset on v2:172.21.15.152:6835/3890159871 2024-04-17T08:46:41.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.590+0000 7f0df08e6000 1 --2- 172.21.15.152:0/367224468 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5579e557fbc0 0x5579e55cfa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:41.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.590+0000 7f0df08e6000 1 -- 172.21.15.152:0/367224468 >> 172.21.15.152:0/367224468 conn(0x5579e5581470 msgr2=0x5579e5579800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:41.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.590+0000 7f0df08e6000 1 -- 172.21.15.152:0/367224468 shutdown_connections 2024-04-17T08:46:41.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.590+0000 7f0df08e6000 1 -- 172.21.15.152:0/367224468 wait complete. 2024-04-17T08:46:41.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.590+0000 7f0df08e6000 20 client.4440 trim_cache size 0 max 16384 2024-04-17T08:46:41.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.610+0000 7f0df08e6000 1 Processor -- start 2024-04-17T08:46:41.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.610+0000 7f0df08e6000 1 -- start start 2024-04-17T08:46:41.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.610+0000 7f0df08e6000 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5579e557fbc0 0x5579e5579800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:41.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.610+0000 7f0df08e6000 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5579e5585f20 0x5579e5579d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:41.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.610+0000 7f0df08e6000 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579e5586840 0x5579e557a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:41.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.610+0000 7f0df08e6000 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0de81ffa20 con 0x5579e5586840 2024-04-17T08:46:41.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.610+0000 7f0df08e6000 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0de806f780 con 0x5579e557fbc0 2024-04-17T08:46:41.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.610+0000 7f0df08e6000 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f0de81ff520 con 0x5579e5585f20 2024-04-17T08:46:41.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.610+0000 7f0de7200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579e5586840 0x5579e557a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:41.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.610+0000 7f0de7200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579e5586840 0x5579e557a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35590/0 (socket says 172.21.15.152:35590) 2024-04-17T08:46:41.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.610+0000 7f0de7200640 1 -- 172.21.15.152:0/2039742300 learned_addr learned my addr 172.21.15.152:0/2039742300 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:41.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.610+0000 7f0ddde00640 1 --2- 172.21.15.152:0/2039742300 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5579e5585f20 0x5579e5579d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:41.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.610+0000 7f0de6800640 1 --2- 172.21.15.152:0/2039742300 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5579e557fbc0 0x5579e5579800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:41.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.610+0000 7f0de7200640 1 -- 172.21.15.152:0/2039742300 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5579e5585f20 msgr2=0x5579e5579d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:41.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.610+0000 7f0de7200640 1 --2- 172.21.15.152:0/2039742300 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5579e5585f20 0x5579e5579d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:41.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.610+0000 7f0de7200640 1 -- 172.21.15.152:0/2039742300 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5579e557fbc0 msgr2=0x5579e5579800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:41.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.610+0000 7f0de7200640 1 --2- 172.21.15.152:0/2039742300 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5579e557fbc0 0x5579e5579800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:41.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.610+0000 7f0de7200640 1 -- 172.21.15.152:0/2039742300 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579e5586670 con 0x5579e5586840 2024-04-17T08:46:41.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.610+0000 7f0ddde00640 1 --2- 172.21.15.152:0/2039742300 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5579e5585f20 0x5579e5579d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:46:41.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.610+0000 7f0de7200640 1 --2- 172.21.15.152:0/2039742300 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579e5586840 0x5579e557a280 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0de0000c10 tx=0x7f0de0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93926e2396b263ad server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:41.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.610+0000 7f0dd6a00640 1 -- 172.21.15.152:0/2039742300 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de001b070 con 0x5579e5586840 2024-04-17T08:46:41.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.610+0000 7f0dd6a00640 1 -- 172.21.15.152:0/2039742300 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0de0000e50 con 0x5579e5586840 2024-04-17T08:46:41.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.610+0000 7f0dd6a00640 1 -- 172.21.15.152:0/2039742300 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de0007d40 con 0x5579e5586840 2024-04-17T08:46:41.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.610+0000 7f0df08e6000 1 -- 172.21.15.152:0/2039742300 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579e5586840 msgr2=0x5579e557a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:41.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.610+0000 7f0df08e6000 1 --2- 172.21.15.152:0/2039742300 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579e5586840 0x5579e557a280 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0de0000c10 tx=0x7f0de0018000 comp rx=0 tx=0).stop 2024-04-17T08:46:41.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.610+0000 7f0df08e6000 1 -- 172.21.15.152:0/2039742300 shutdown_connections 2024-04-17T08:46:41.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.610+0000 7f0df08e6000 1 --2- 172.21.15.152:0/2039742300 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579e5586840 0x5579e557a280 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:41.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.610+0000 7f0df08e6000 1 --2- 172.21.15.152:0/2039742300 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5579e5585f20 0x5579e5579d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:41.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.610+0000 7f0df08e6000 1 --2- 172.21.15.152:0/2039742300 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5579e557fbc0 0x5579e5579800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:41.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.610+0000 7f0df08e6000 1 -- 172.21.15.152:0/2039742300 >> 172.21.15.152:0/2039742300 conn(0x5579e5581470 msgr2=0x5579e5587e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:41.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.610+0000 7f0df08e6000 1 -- 172.21.15.152:0/2039742300 shutdown_connections 2024-04-17T08:46:41.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.610+0000 7f0df08e6000 1 -- 172.21.15.152:0/2039742300 wait complete. 2024-04-17T08:46:41.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.610+0000 7f0df08e6000 1 -- start start 2024-04-17T08:46:41.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.610+0000 7f0df08e6000 1 Processor -- start 2024-04-17T08:46:41.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.614+0000 7f0df08e6000 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5579e557fbc0 0x5579e55ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:41.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.614+0000 7f0df08e6000 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5579e5585f20 0x5579e55d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:41.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.614+0000 7f0df08e6000 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579e5586840 0x5579e55d2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:41.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.614+0000 7f0df08e6000 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5579e53cdb00 con 0x5579e5586840 2024-04-17T08:46:41.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.614+0000 7f0df08e6000 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5579e53c87e0 con 0x5579e5585f20 2024-04-17T08:46:41.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.614+0000 7f0df08e6000 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x5579e53d66e0 con 0x5579e557fbc0 2024-04-17T08:46:41.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.614+0000 7f0df08e6000 10 client.0 _ll_register_callbacks cb 0x7f0de00074c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-17T08:46:41.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.614+0000 7f0de7200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579e5586840 0x5579e55d2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:41.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.614+0000 7f0de7200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579e5586840 0x5579e55d2e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35598/0 (socket says 172.21.15.152:35598) 2024-04-17T08:46:41.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.614+0000 7f0de7200640 1 -- 172.21.15.152:0/2738315424 learned_addr learned my addr 172.21.15.152:0/2738315424 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:41.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.614+0000 7f0ddde00640 1 --2- 172.21.15.152:0/2738315424 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5579e5585f20 0x5579e55d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:41.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.614+0000 7f0de6800640 1 --2- 172.21.15.152:0/2738315424 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5579e557fbc0 0x5579e55ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:41.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.614+0000 7f0de7200640 1 -- 172.21.15.152:0/2738315424 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5579e557fbc0 msgr2=0x5579e55ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:41.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.614+0000 7f0de7200640 1 --2- 172.21.15.152:0/2738315424 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5579e557fbc0 0x5579e55ceb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:41.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.614+0000 7f0de7200640 1 -- 172.21.15.152:0/2738315424 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5579e5585f20 msgr2=0x5579e55d28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:41.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.614+0000 7f0de7200640 1 --2- 172.21.15.152:0/2738315424 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5579e5585f20 0x5579e55d28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:41.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.614+0000 7f0de7200640 1 -- 172.21.15.152:0/2738315424 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579e544ad30 con 0x5579e5586840 2024-04-17T08:46:41.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.614+0000 7f0de6800640 1 --2- 172.21.15.152:0/2738315424 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5579e557fbc0 0x5579e55ceb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:46:41.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.614+0000 7f0ddde00640 1 --2- 172.21.15.152:0/2738315424 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5579e5585f20 0x5579e55d28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:46:41.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.614+0000 7f0de7200640 1 --2- 172.21.15.152:0/2738315424 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579e5586840 0x5579e55d2e10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0de002c040 tx=0x7f0de00046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b56d33a45300e257 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:41.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.614+0000 7f0dcbe00640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-04-17T08:46:41.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.614+0000 7f0dcbe00640 1 -- 172.21.15.152:0/2738315424 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de001b040 con 0x5579e5586840 2024-04-17T08:46:41.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.614+0000 7f0df08e6000 1 -- 172.21.15.152:0/2738315424 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0de0000e50 con 0x5579e5586840 2024-04-17T08:46:41.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.614+0000 7f0dcbe00640 1 -- 172.21.15.152:0/2738315424 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0de0004040 con 0x5579e5586840 2024-04-17T08:46:41.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.614+0000 7f0dcbe00640 1 -- 172.21.15.152:0/2738315424 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f0de003f050 con 0x5579e5586840 2024-04-17T08:46:41.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.614+0000 7f0df08e6000 10 client.4446 fetch_fsmap learned FSMap version 7 2024-04-17T08:46:41.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.614+0000 7f0df08e6000 1 -- 172.21.15.152:0/2738315424 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x5579e535b7c0 con 0x5579e5586840 2024-04-17T08:46:41.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.614+0000 7f0dcbe00640 1 -- 172.21.15.152:0/2738315424 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0de0000e50 con 0x5579e5586840 2024-04-17T08:46:41.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.614+0000 7f0dcbe00640 1 -- 172.21.15.152:0/2738315424 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 7) ==== 3503+0+0 (secure 0 0 0) 0x7f0de0042020 con 0x5579e5586840 2024-04-17T08:46:41.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.614+0000 7f0df08e6000 10 client.4446 fetch_fsmap finished waiting for FSMap version 7 2024-04-17T08:46:41.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.614+0000 7f0df08e6000 10 client.4446 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-17T08:46:41.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.614+0000 7f0df08e6000 20 client.4446 populate_metadata read hostname 'smithi152' 2024-04-17T08:46:41.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.614+0000 7f0df08e6000 1 --2- 172.21.15.152:0/2738315424 >> [v2:172.21.15.152:6835/3890159871,v1:172.21.15.152:6837/3890159871] conn(0x5579e5638a50 0x5579e5638e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:41.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.614+0000 7f0df08e6000 4 client.4446 mds_command: new command op to 4278 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-17T08:46:41.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.614+0000 7f0df08e6000 1 -- 172.21.15.152:0/2738315424 --> [v2:172.21.15.152:6835/3890159871,v1:172.21.15.152:6837/3890159871] -- command(tid 0: {"prefix": "status"}) -- 0x5579e53d6ef0 con 0x5579e5638a50 2024-04-17T08:46:41.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.614+0000 7f0de6800640 1 --2- 172.21.15.152:0/2738315424 >> [v2:172.21.15.152:6835/3890159871,v1:172.21.15.152:6837/3890159871] conn(0x5579e5638a50 0x5579e5638e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:41.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.614+0000 7f0de6800640 1 --2- 172.21.15.152:0/2738315424 >> [v2:172.21.15.152:6835/3890159871,v1:172.21.15.152:6837/3890159871] conn(0x5579e5638a50 0x5579e5638e30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86b72c14ac839127 server_cookie=2a774b9dd22e22e2 in_seq=0 out_seq=0 2024-04-17T08:46:41.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.614+0000 7f0dcbe00640 10 client.4446 ms_handle_connect on v2:172.21.15.152:6835/3890159871 2024-04-17T08:46:41.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.614+0000 7f0dcbe00640 1 -- 172.21.15.152:0/2738315424 <== mds.0 v2:172.21.15.152:6835/3890159871 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x5579e53d6ef0 con 0x5579e5638a50 2024-04-17T08:46:41.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.614+0000 7f0dcbe00640 10 client.4446 handle_command_reply: tid=0 2024-04-17T08:46:41.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.614+0000 7f0df08e6000 1 client.4446 shutdown 2024-04-17T08:46:41.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.614+0000 7f0df08e6000 1 -- 172.21.15.152:0/2738315424 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579e5586840 msgr2=0x5579e55d2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:41.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.614+0000 7f0df08e6000 1 --2- 172.21.15.152:0/2738315424 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579e5586840 0x5579e55d2e10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0de002c040 tx=0x7f0de00046d0 comp rx=0 tx=0).stop 2024-04-17T08:46:41.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.614+0000 7f0df08e6000 1 -- 172.21.15.152:0/2738315424 shutdown_connections 2024-04-17T08:46:41.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.614+0000 7f0df08e6000 1 --2- 172.21.15.152:0/2738315424 >> [v2:172.21.15.152:6835/3890159871,v1:172.21.15.152:6837/3890159871] conn(0x5579e5638a50 0x5579e5638e30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:41.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.614+0000 7f0df08e6000 1 --2- 172.21.15.152:0/2738315424 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5579e5586840 0x5579e55d2e10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:41.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.614+0000 7f0df08e6000 1 --2- 172.21.15.152:0/2738315424 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5579e5585f20 0x5579e55d28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:41.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.614+0000 7f0dcbe00640 0 client.4446 ms_handle_reset on v2:172.21.15.152:6835/3890159871 2024-04-17T08:46:41.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.614+0000 7f0df08e6000 1 --2- 172.21.15.152:0/2738315424 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5579e557fbc0 0x5579e55ceb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:41.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.614+0000 7f0df08e6000 1 -- 172.21.15.152:0/2738315424 >> 172.21.15.152:0/2738315424 conn(0x5579e5581470 msgr2=0x5579e55debe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:41.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.618+0000 7f0df08e6000 1 -- 172.21.15.152:0/2738315424 shutdown_connections 2024-04-17T08:46:41.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.618+0000 7f0df08e6000 1 -- 172.21.15.152:0/2738315424 wait complete. 2024-04-17T08:46:41.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.618+0000 7f0df08e6000 20 client.4446 trim_cache size 0 max 16384 2024-04-17T08:46:41.621 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-17T08:46:41.622 INFO:teuthology.orchestra.run.smithi152.stdout: "cluster_fsid": "ce68f82e-ec5f-4205-9fd5-bdfdf6ef31e2", 2024-04-17T08:46:41.622 INFO:teuthology.orchestra.run.smithi152.stdout: "whoami": 0, 2024-04-17T08:46:41.622 INFO:teuthology.orchestra.run.smithi152.stdout: "id": 4278, 2024-04-17T08:46:41.622 INFO:teuthology.orchestra.run.smithi152.stdout: "want_state": "up:active", 2024-04-17T08:46:41.622 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "up:active", 2024-04-17T08:46:41.622 INFO:teuthology.orchestra.run.smithi152.stdout: "fs_name": "cephfs", 2024-04-17T08:46:41.622 INFO:teuthology.orchestra.run.smithi152.stdout: "rank_uptime": 7.3837418289999999, 2024-04-17T08:46:41.622 INFO:teuthology.orchestra.run.smithi152.stdout: "mdsmap_epoch": 7, 2024-04-17T08:46:41.622 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_epoch": 24, 2024-04-17T08:46:41.622 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_epoch_barrier": 24, 2024-04-17T08:46:41.622 INFO:teuthology.orchestra.run.smithi152.stdout: "uptime": 14.447045574000001 2024-04-17T08:46:41.622 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-17T08:46:41.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.618+0000 7f0ded400640 1 -- 172.21.15.152:0/4291735174 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0dc4068380 msgr2=0x7f0dc406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:41.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.618+0000 7f0ded400640 1 --2- 172.21.15.152:0/4291735174 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0dc4068380 0x7f0dc406a840 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0dd80ad000 tx=0x7f0dd8008040 comp rx=0 tx=0).stop 2024-04-17T08:46:41.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.618+0000 7f0ded400640 1 -- 172.21.15.152:0/4291735174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0de815d710 msgr2=0x7f0de8099700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:41.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.618+0000 7f0ded400640 1 --2- 172.21.15.152:0/4291735174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0de815d710 0x7f0de8099700 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0dd0001570 tx=0x7f0dd000cc60 comp rx=0 tx=0).stop 2024-04-17T08:46:41.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.618+0000 7f0ded400640 1 -- 172.21.15.152:0/4291735174 shutdown_connections 2024-04-17T08:46:41.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.618+0000 7f0ded400640 1 --2- 172.21.15.152:0/4291735174 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0de8160720 0x7f0de8151400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:41.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.618+0000 7f0ded400640 1 --2- 172.21.15.152:0/4291735174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0de815d710 0x7f0de8099700 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:41.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.618+0000 7f0ded400640 1 --2- 172.21.15.152:0/4291735174 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0dc4068380 0x7f0dc406a840 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:41.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.618+0000 7f0ded400640 1 --2- 172.21.15.152:0/4291735174 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0de815a010 0x7f0de8098d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:41.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.618+0000 7f0ded400640 1 -- 172.21.15.152:0/4291735174 >> 172.21.15.152:0/4291735174 conn(0x7f0de80b3350 msgr2=0x7f0de81526d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:41.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.618+0000 7f0ded400640 1 -- 172.21.15.152:0/4291735174 shutdown_connections 2024-04-17T08:46:41.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.618+0000 7f0ded400640 1 -- 172.21.15.152:0/4291735174 wait complete. 2024-04-17T08:46:41.637 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-17T08:46:41.637 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-17T08:46:41.637 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-17T08:46:41.773 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.770+0000 7f7a16600640 1 Processor -- start 2024-04-17T08:46:41.773 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.770+0000 7f7a16600640 1 -- start start 2024-04-17T08:46:41.774 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.774+0000 7f7a16600640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7a100af670 0x7f7a1015b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:41.774 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.774+0000 7f7a16600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f7a100d0360 0x7f7a100d07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:41.774 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.774+0000 7f7a16600640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a10072c40 con 0x7f7a1006f980 2024-04-17T08:46:41.774 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.774+0000 7f7a16600640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f7a100d0cf0 con 0x7f7a100af670 2024-04-17T08:46:41.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.774+0000 7f7a16600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f7a1015c820 con 0x7f7a100d0360 2024-04-17T08:46:41.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.774+0000 7f7a0f400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7a100af670 0x7f7a1015b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:41.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.774+0000 7f7a0f400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7a100af670 0x7f7a1015b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35604/0 (socket says 172.21.15.152:35604) 2024-04-17T08:46:41.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.774+0000 7f7a0f400640 1 -- 172.21.15.152:0/1854505066 learned_addr learned my addr 172.21.15.152:0/1854505066 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:41.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.774+0000 7f7a0fe00640 1 --2- 172.21.15.152:0/1854505066 >> v2:172.21.15.196:3300/0 conn(0x7f7a100d0360 0x7f7a100d07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:41.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.774+0000 7f7a0f400640 1 -- 172.21.15.152:0/1854505066 >> v2:172.21.15.196:3300/0 conn(0x7f7a100d0360 msgr2=0x7f7a100d07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:41.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.774+0000 7f7a0f400640 1 --2- 172.21.15.152:0/1854505066 >> v2:172.21.15.196:3300/0 conn(0x7f7a100d0360 0x7f7a100d07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:41.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.774+0000 7f7a0f400640 1 -- 172.21.15.152:0/1854505066 >> v1:172.21.15.152:6789/0 conn(0x7f7a1006f980 legacy=0x7f7a10072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:41.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.774+0000 7f7a0f400640 1 -- 172.21.15.152:0/1854505066 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a1015c260 con 0x7f7a100af670 2024-04-17T08:46:41.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.774+0000 7f7a0e000640 1 -- 172.21.15.152:0/1854505066 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2291203240 0 0) 0x7f7a10072c40 con 0x7f7a1006f980 2024-04-17T08:46:41.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.774+0000 7f7a0f400640 1 --2- 172.21.15.152:0/1854505066 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a100af670 0x7f7a1015b8c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7a1006d680 tx=0x7f7a0001eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b831d0dfbc4bcae1 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:41.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.774+0000 7f7a0e000640 1 -- 172.21.15.152:0/1854505066 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a000b4070 con 0x7f7a100af670 2024-04-17T08:46:41.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.778+0000 7f7a0e000640 1 -- 172.21.15.152:0/1854505066 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a000a7c00 con 0x7f7a100af670 2024-04-17T08:46:41.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.778+0000 7f7a0e000640 1 -- 172.21.15.152:0/1854505066 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a000af440 con 0x7f7a100af670 2024-04-17T08:46:41.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.778+0000 7f7a16600640 1 -- 172.21.15.152:0/1854505066 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a100af670 msgr2=0x7f7a1015b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:41.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.778+0000 7f7a16600640 1 --2- 172.21.15.152:0/1854505066 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a100af670 0x7f7a1015b8c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7a1006d680 tx=0x7f7a0001eb30 comp rx=0 tx=0).stop 2024-04-17T08:46:41.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.778+0000 7f7a16600640 1 -- 172.21.15.152:0/1854505066 shutdown_connections 2024-04-17T08:46:41.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.778+0000 7f7a16600640 1 --2- 172.21.15.152:0/1854505066 >> v2:172.21.15.196:3300/0 conn(0x7f7a100d0360 0x7f7a100d07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:41.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.778+0000 7f7a16600640 1 --2- 172.21.15.152:0/1854505066 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a100af670 0x7f7a1015b8c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:41.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.778+0000 7f7a16600640 1 -- 172.21.15.152:0/1854505066 >> 172.21.15.152:0/1854505066 conn(0x7f7a100b3350 msgr2=0x7f7a100b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:41.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.778+0000 7f7a16600640 1 -- 172.21.15.152:0/1854505066 shutdown_connections 2024-04-17T08:46:41.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.778+0000 7f7a16600640 1 -- 172.21.15.152:0/1854505066 wait complete. 2024-04-17T08:46:41.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.778+0000 7f7a16600640 1 Processor -- start 2024-04-17T08:46:41.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.778+0000 7f7a16600640 1 -- start start 2024-04-17T08:46:41.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.778+0000 7f7a16600640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a1006f980 0x7f7a1014c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:41.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.778+0000 7f7a16600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7a100af670 0x7f7a10155f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:41.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.778+0000 7f7a16600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7a100d0360 0x7f7a100ae650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:41.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.778+0000 7f7a16600640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7a1015be00 con 0x7f7a1006f980 2024-04-17T08:46:41.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.778+0000 7f7a16600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f7a100afa50 con 0x7f7a100af670 2024-04-17T08:46:41.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.778+0000 7f7a16600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f7a1015bf80 con 0x7f7a100d0360 2024-04-17T08:46:41.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.778+0000 7f7a0f400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a1006f980 0x7f7a1014c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:41.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.778+0000 7f7a0f400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a1006f980 0x7f7a1014c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35620/0 (socket says 172.21.15.152:35620) 2024-04-17T08:46:41.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.778+0000 7f7a0f400640 1 -- 172.21.15.152:0/1327175198 learned_addr learned my addr 172.21.15.152:0/1327175198 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:41.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.778+0000 7f7a0f400640 1 -- 172.21.15.152:0/1327175198 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7a100d0360 msgr2=0x7f7a100ae650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:41.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.778+0000 7f7a0f400640 1 --2- 172.21.15.152:0/1327175198 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7a100d0360 0x7f7a100ae650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:41.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.778+0000 7f7a0f400640 1 -- 172.21.15.152:0/1327175198 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7a100af670 msgr2=0x7f7a10155f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:41.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.778+0000 7f7a0f400640 1 --2- 172.21.15.152:0/1327175198 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7a100af670 0x7f7a10155f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:41.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.778+0000 7f7a0f400640 1 -- 172.21.15.152:0/1327175198 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a100af190 con 0x7f7a1006f980 2024-04-17T08:46:41.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.782+0000 7f7a0f400640 1 --2- 172.21.15.152:0/1327175198 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a1006f980 0x7f7a1014c010 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7a0001b740 tx=0x7f7a0001b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:41.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.782+0000 7f7a07400640 1 -- 172.21.15.152:0/1327175198 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a000b4070 con 0x7f7a1006f980 2024-04-17T08:46:41.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.782+0000 7f7a07400640 1 -- 172.21.15.152:0/1327175198 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a000b6070 con 0x7f7a1006f980 2024-04-17T08:46:41.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.782+0000 7f7a07400640 1 -- 172.21.15.152:0/1327175198 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a000bb470 con 0x7f7a1006f980 2024-04-17T08:46:41.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.782+0000 7f7a16600640 1 -- 172.21.15.152:0/1327175198 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a1014c550 con 0x7f7a1006f980 2024-04-17T08:46:41.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.782+0000 7f7a16600640 1 -- 172.21.15.152:0/1327175198 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a1014eb30 con 0x7f7a1006f980 2024-04-17T08:46:41.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.782+0000 7f7a16600640 1 -- 172.21.15.152:0/1327175198 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a10068a30 con 0x7f7a1006f980 2024-04-17T08:46:41.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.782+0000 7f7a07400640 1 -- 172.21.15.152:0/1327175198 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7a000bb630 con 0x7f7a1006f980 2024-04-17T08:46:41.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.782+0000 7f7a07400640 1 --2- 172.21.15.152:0/1327175198 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f79f00683b0 0x7f79f006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:41.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.782+0000 7f7a07400640 1 -- 172.21.15.152:0/1327175198 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f7a00121400 con 0x7f7a1006f980 2024-04-17T08:46:41.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.782+0000 7f7a0ea00640 1 --2- 172.21.15.152:0/1327175198 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f79f00683b0 0x7f79f006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:41.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.786+0000 7f7a0ea00640 1 --2- 172.21.15.152:0/1327175198 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f79f00683b0 0x7f79f006a870 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f79fc007fd0 tx=0x7f79fc007920 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:41.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.786+0000 7f7a07400640 1 -- 172.21.15.152:0/1327175198 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f7a000187e0 con 0x7f7a1006f980 2024-04-17T08:46:41.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.978+0000 7f7a16600640 1 -- 172.21.15.152:0/1327175198 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7a10156460 con 0x7f7a1006f980 2024-04-17T08:46:41.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.978+0000 7f7a07400640 1 -- 172.21.15.152:0/1327175198 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+88 (secure 0 0 0) 0x7f7a000f1670 con 0x7f7a1006f980 2024-04-17T08:46:41.982 INFO:teuthology.orchestra.run.smithi152.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-17T08:46:41.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.982+0000 7f7a16600640 1 -- 172.21.15.152:0/1327175198 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f79f00683b0 msgr2=0x7f79f006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:41.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.982+0000 7f7a16600640 1 --2- 172.21.15.152:0/1327175198 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f79f00683b0 0x7f79f006a870 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f79fc007fd0 tx=0x7f79fc007920 comp rx=0 tx=0).stop 2024-04-17T08:46:41.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.982+0000 7f7a16600640 1 -- 172.21.15.152:0/1327175198 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a1006f980 msgr2=0x7f7a1014c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:41.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.982+0000 7f7a16600640 1 --2- 172.21.15.152:0/1327175198 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a1006f980 0x7f7a1014c010 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7a0001b740 tx=0x7f7a0001b8d0 comp rx=0 tx=0).stop 2024-04-17T08:46:41.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.982+0000 7f7a16600640 1 -- 172.21.15.152:0/1327175198 shutdown_connections 2024-04-17T08:46:41.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.982+0000 7f7a16600640 1 --2- 172.21.15.152:0/1327175198 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f79f00683b0 0x7f79f006a870 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:41.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.982+0000 7f7a16600640 1 --2- 172.21.15.152:0/1327175198 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7a100d0360 0x7f7a100ae650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:41.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.982+0000 7f7a16600640 1 --2- 172.21.15.152:0/1327175198 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7a100af670 0x7f7a10155f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:41.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.982+0000 7f7a16600640 1 --2- 172.21.15.152:0/1327175198 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a1006f980 0x7f7a1014c010 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:41.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.982+0000 7f7a16600640 1 -- 172.21.15.152:0/1327175198 >> 172.21.15.152:0/1327175198 conn(0x7f7a100b3350 msgr2=0x7f7a1015daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:41.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.982+0000 7f7a16600640 1 -- 172.21.15.152:0/1327175198 shutdown_connections 2024-04-17T08:46:41.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:41.982+0000 7f7a16600640 1 -- 172.21.15.152:0/1327175198 wait complete. 2024-04-17T08:46:42.002 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-17T08:46:42.002 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-17T08:46:42.002 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi152.front.sepia.ceph.com 2024-04-17T08:46:42.002 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-04-17T08:46:42.002 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-17T08:46:42.002 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-17T08:46:42.002 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-17T08:46:42.002 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-17T08:46:42.002 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-04-17T08:46:42.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:46:42.003 DEBUG:teuthology.orchestra.run.smithi152:> ip addr 2024-04-17T08:46:42.012 INFO:teuthology.orchestra.run.smithi152.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-17T08:46:42.012 INFO:teuthology.orchestra.run.smithi152.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-17T08:46:42.012 INFO:teuthology.orchestra.run.smithi152.stdout: inet 127.0.0.1/8 scope host lo 2024-04-17T08:46:42.012 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-04-17T08:46:42.012 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 ::1/128 scope host 2024-04-17T08:46:42.012 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-04-17T08:46:42.012 INFO:teuthology.orchestra.run.smithi152.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-17T08:46:42.012 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:da:6c:44 brd ff:ff:ff:ff:ff:ff 2024-04-17T08:46:42.012 INFO:teuthology.orchestra.run.smithi152.stdout: altname enp7s0f0 2024-04-17T08:46:42.012 INFO:teuthology.orchestra.run.smithi152.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-17T08:46:42.012 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:da:6c:45 brd ff:ff:ff:ff:ff:ff 2024-04-17T08:46:42.013 INFO:teuthology.orchestra.run.smithi152.stdout: altname enp7s0f1 2024-04-17T08:46:42.013 INFO:teuthology.orchestra.run.smithi152.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-17T08:46:42.013 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:88:6d:e2 brd ff:ff:ff:ff:ff:ff 2024-04-17T08:46:42.013 INFO:teuthology.orchestra.run.smithi152.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-17T08:46:42.013 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:88:6d:e3 brd ff:ff:ff:ff:ff:ff 2024-04-17T08:46:42.013 INFO:teuthology.orchestra.run.smithi152.stdout: inet 172.21.15.152/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-17T08:46:42.013 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft 42433sec preferred_lft 42433sec 2024-04-17T08:46:42.013 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 fe80::ec4:7aff:fe88:6de3/64 scope link 2024-04-17T08:46:42.013 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-04-17T08:46:42.013 INFO:teuthology.orchestra.run.smithi152.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-17T08:46:42.013 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 02:42:bf:a8:e8:00 brd ff:ff:ff:ff:ff:ff 2024-04-17T08:46:42.013 INFO:teuthology.orchestra.run.smithi152.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-17T08:46:42.013 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-04-17T08:46:42.014 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-17T08:46:42.014 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T08:46:42.014 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2024-04-17T08:46:42.014 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link add name ceph-brx type bridge 2024-04-17T08:46:42.014 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip addr flush dev ceph-brx 2024-04-17T08:46:42.014 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link set ceph-brx up 2024-04-17T08:46:42.014 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-17T08:46:42.014 DEBUG:teuthology.orchestra.run.smithi152:> ') 2024-04-17T08:46:42.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T08:46:42.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T08:46:42.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:46:42.171 DEBUG:teuthology.orchestra.run.smithi152:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-17T08:46:42.236 INFO:teuthology.orchestra.run.smithi152.stdout:1 2024-04-17T08:46:42.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:46:42.238 DEBUG:teuthology.orchestra.run.smithi152:> route 2024-04-17T08:46:42.311 INFO:teuthology.orchestra.run.smithi152.stdout:Kernel IP routing table 2024-04-17T08:46:42.311 INFO:teuthology.orchestra.run.smithi152.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-17T08:46:42.311 INFO:teuthology.orchestra.run.smithi152.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-17T08:46:42.311 INFO:teuthology.orchestra.run.smithi152.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-17T08:46:42.311 INFO:teuthology.orchestra.run.smithi152.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-17T08:46:42.312 INFO:teuthology.orchestra.run.smithi152.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-17T08:46:42.312 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-17T08:46:42.312 INFO:teuthology.orchestra.run.smithi152.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-17T08:46:42.312 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-17T08:46:42.312 INFO:teuthology.orchestra.run.smithi152.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-17T08:46:42.312 INFO:teuthology.orchestra.run.smithi152.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-17T08:46:42.312 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T08:46:42.312 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2024-04-17T08:46:42.312 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-17T08:46:42.312 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-17T08:46:42.313 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-17T08:46:42.313 DEBUG:teuthology.orchestra.run.smithi152:> ') 2024-04-17T08:46:42.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T08:46:42.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T08:46:42.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:46:42.446 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list 2024-04-17T08:46:42.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:46:42.498 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list-id 2024-04-17T08:46:42.554 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T08:46:42.554 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2024-04-17T08:46:42.554 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-17T08:46:42.554 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-04-17T08:46:42.554 DEBUG:teuthology.orchestra.run.smithi152:> ') 2024-04-17T08:46:42.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T08:46:42.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T08:46:42.679 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-04-17T08:46:42.679 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T08:46:42.679 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2024-04-17T08:46:42.679 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-04-17T08:46:42.680 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-17T08:46:42.680 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-04-17T08:46:42.680 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-04-17T08:46:42.680 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-04-17T08:46:42.680 DEBUG:teuthology.orchestra.run.smithi152:> ') 2024-04-17T08:46:42.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T08:46:42.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T08:46:42.852 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T08:46:42.852 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2024-04-17T08:46:42.852 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link set brx.0 up 2024-04-17T08:46:42.853 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link set dev brx.0 master ceph-brx 2024-04-17T08:46:42.853 DEBUG:teuthology.orchestra.run.smithi152:> ') 2024-04-17T08:46:42.943 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T08:46:42.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T08:46:42.980 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-04-17T08:46:42.980 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-17T08:46:42.980 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-04-17T08:46:42.989 INFO:teuthology.orchestra.run.smithi152.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-04-17T08:46:42.989 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-17T08:46:42.989 DEBUG:teuthology.orchestra.run.smithi152:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-04-17T08:46:43.041 DEBUG:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2024-04-17T08:46:43.105 DEBUG:teuthology.orchestra.run.smithi152:> cat /proc/self/mounts | awk '{print $2}' 2024-04-17T08:46:43.158 INFO:teuthology.orchestra.run.smithi152.stdout:/sys 2024-04-17T08:46:43.158 INFO:teuthology.orchestra.run.smithi152.stdout:/proc 2024-04-17T08:46:43.159 INFO:teuthology.orchestra.run.smithi152.stdout:/dev 2024-04-17T08:46:43.159 INFO:teuthology.orchestra.run.smithi152.stdout:/dev/pts 2024-04-17T08:46:43.159 INFO:teuthology.orchestra.run.smithi152.stdout:/run 2024-04-17T08:46:43.159 INFO:teuthology.orchestra.run.smithi152.stdout:/ 2024-04-17T08:46:43.159 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/kernel/security 2024-04-17T08:46:43.159 INFO:teuthology.orchestra.run.smithi152.stdout:/dev/shm 2024-04-17T08:46:43.159 INFO:teuthology.orchestra.run.smithi152.stdout:/run/lock 2024-04-17T08:46:43.159 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/cgroup 2024-04-17T08:46:43.159 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/pstore 2024-04-17T08:46:43.159 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/bpf 2024-04-17T08:46:43.159 INFO:teuthology.orchestra.run.smithi152.stdout:/proc/sys/fs/binfmt_misc 2024-04-17T08:46:43.159 INFO:teuthology.orchestra.run.smithi152.stdout:/dev/hugepages 2024-04-17T08:46:43.159 INFO:teuthology.orchestra.run.smithi152.stdout:/dev/mqueue 2024-04-17T08:46:43.159 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/kernel/debug 2024-04-17T08:46:43.160 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/kernel/tracing 2024-04-17T08:46:43.160 INFO:teuthology.orchestra.run.smithi152.stdout:/proc/fs/nfsd 2024-04-17T08:46:43.160 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/fuse/connections 2024-04-17T08:46:43.160 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/kernel/config 2024-04-17T08:46:43.160 INFO:teuthology.orchestra.run.smithi152.stdout:/run/credentials/systemd-sysusers.service 2024-04-17T08:46:43.160 INFO:teuthology.orchestra.run.smithi152.stdout:/run/rpc_pipefs 2024-04-17T08:46:43.160 INFO:teuthology.orchestra.run.smithi152.stdout:/run/user/1000 2024-04-17T08:46:43.160 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph 2024-04-17T08:46:43.160 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph/osd/ceph-0 2024-04-17T08:46:43.160 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph/osd/ceph-1 2024-04-17T08:46:43.160 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph/osd/ceph-2 2024-04-17T08:46:43.160 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph/osd/ceph-3 2024-04-17T08:46:43.160 INFO:teuthology.orchestra.run.smithi152.stdout:/run/netns 2024-04-17T08:46:43.160 INFO:teuthology.orchestra.run.smithi152.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-17T08:46:43.160 INFO:teuthology.orchestra.run.smithi152.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-17T08:46:43.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:46:43.161 DEBUG:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2024-04-17T08:46:43.213 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-17T08:46:43.213 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-04-17T08:46:43.264 DEBUG:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2024-04-17T08:46:43.284 DEBUG:teuthology.orchestra.run.smithi152:> cat /proc/self/mounts | awk '{print $2}' 2024-04-17T08:46:43.339 INFO:teuthology.orchestra.run.smithi152.stdout:/sys 2024-04-17T08:46:43.339 INFO:teuthology.orchestra.run.smithi152.stdout:/proc 2024-04-17T08:46:43.339 INFO:teuthology.orchestra.run.smithi152.stdout:/dev 2024-04-17T08:46:43.339 INFO:teuthology.orchestra.run.smithi152.stdout:/dev/pts 2024-04-17T08:46:43.339 INFO:teuthology.orchestra.run.smithi152.stdout:/run 2024-04-17T08:46:43.339 INFO:teuthology.orchestra.run.smithi152.stdout:/ 2024-04-17T08:46:43.340 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/kernel/security 2024-04-17T08:46:43.340 INFO:teuthology.orchestra.run.smithi152.stdout:/dev/shm 2024-04-17T08:46:43.340 INFO:teuthology.orchestra.run.smithi152.stdout:/run/lock 2024-04-17T08:46:43.340 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/cgroup 2024-04-17T08:46:43.340 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/pstore 2024-04-17T08:46:43.340 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/bpf 2024-04-17T08:46:43.340 INFO:teuthology.orchestra.run.smithi152.stdout:/proc/sys/fs/binfmt_misc 2024-04-17T08:46:43.340 INFO:teuthology.orchestra.run.smithi152.stdout:/dev/hugepages 2024-04-17T08:46:43.340 INFO:teuthology.orchestra.run.smithi152.stdout:/dev/mqueue 2024-04-17T08:46:43.340 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/kernel/debug 2024-04-17T08:46:43.340 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/kernel/tracing 2024-04-17T08:46:43.340 INFO:teuthology.orchestra.run.smithi152.stdout:/proc/fs/nfsd 2024-04-17T08:46:43.340 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/fuse/connections 2024-04-17T08:46:43.341 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/kernel/config 2024-04-17T08:46:43.341 INFO:teuthology.orchestra.run.smithi152.stdout:/run/credentials/systemd-sysusers.service 2024-04-17T08:46:43.341 INFO:teuthology.orchestra.run.smithi152.stdout:/run/rpc_pipefs 2024-04-17T08:46:43.341 INFO:teuthology.orchestra.run.smithi152.stdout:/run/user/1000 2024-04-17T08:46:43.341 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph 2024-04-17T08:46:43.341 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph/osd/ceph-0 2024-04-17T08:46:43.341 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph/osd/ceph-1 2024-04-17T08:46:43.341 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph/osd/ceph-2 2024-04-17T08:46:43.341 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph/osd/ceph-3 2024-04-17T08:46:43.341 INFO:teuthology.orchestra.run.smithi152.stdout:/run/netns 2024-04-17T08:46:43.341 INFO:teuthology.orchestra.run.smithi152.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-17T08:46:43.341 INFO:teuthology.orchestra.run.smithi152.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-17T08:46:43.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:46:43.342 DEBUG:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2024-04-17T08:46:43.360 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi152.stderr:2024-04-17T08:46:43.358+0000 7f63fe094580 -1 init, newargv = 0x5622e43f3690 newargc=15 2024-04-17T08:46:43.360 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi152.stderr:ceph-fuse[34092]: starting ceph client 2024-04-17T08:46:43.370 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi152.stderr:ceph-fuse[34092]: starting fuse 2024-04-17T08:46:44.470 DEBUG:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2024-04-17T08:46:44.493 DEBUG:teuthology.orchestra.run.smithi152:> cat /proc/self/mounts | awk '{print $2}' 2024-04-17T08:46:44.547 INFO:teuthology.orchestra.run.smithi152.stdout:/sys 2024-04-17T08:46:44.547 INFO:teuthology.orchestra.run.smithi152.stdout:/proc 2024-04-17T08:46:44.547 INFO:teuthology.orchestra.run.smithi152.stdout:/dev 2024-04-17T08:46:44.547 INFO:teuthology.orchestra.run.smithi152.stdout:/dev/pts 2024-04-17T08:46:44.547 INFO:teuthology.orchestra.run.smithi152.stdout:/run 2024-04-17T08:46:44.548 INFO:teuthology.orchestra.run.smithi152.stdout:/ 2024-04-17T08:46:44.548 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/kernel/security 2024-04-17T08:46:44.548 INFO:teuthology.orchestra.run.smithi152.stdout:/dev/shm 2024-04-17T08:46:44.548 INFO:teuthology.orchestra.run.smithi152.stdout:/run/lock 2024-04-17T08:46:44.548 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/cgroup 2024-04-17T08:46:44.548 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/pstore 2024-04-17T08:46:44.548 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/bpf 2024-04-17T08:46:44.548 INFO:teuthology.orchestra.run.smithi152.stdout:/proc/sys/fs/binfmt_misc 2024-04-17T08:46:44.548 INFO:teuthology.orchestra.run.smithi152.stdout:/dev/hugepages 2024-04-17T08:46:44.548 INFO:teuthology.orchestra.run.smithi152.stdout:/dev/mqueue 2024-04-17T08:46:44.548 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/kernel/debug 2024-04-17T08:46:44.548 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/kernel/tracing 2024-04-17T08:46:44.548 INFO:teuthology.orchestra.run.smithi152.stdout:/proc/fs/nfsd 2024-04-17T08:46:44.548 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/fuse/connections 2024-04-17T08:46:44.548 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/kernel/config 2024-04-17T08:46:44.548 INFO:teuthology.orchestra.run.smithi152.stdout:/run/credentials/systemd-sysusers.service 2024-04-17T08:46:44.549 INFO:teuthology.orchestra.run.smithi152.stdout:/run/rpc_pipefs 2024-04-17T08:46:44.549 INFO:teuthology.orchestra.run.smithi152.stdout:/run/user/1000 2024-04-17T08:46:44.549 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph 2024-04-17T08:46:44.549 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph/osd/ceph-0 2024-04-17T08:46:44.549 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph/osd/ceph-1 2024-04-17T08:46:44.549 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph/osd/ceph-2 2024-04-17T08:46:44.549 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph/osd/ceph-3 2024-04-17T08:46:44.549 INFO:teuthology.orchestra.run.smithi152.stdout:/run/netns 2024-04-17T08:46:44.549 INFO:teuthology.orchestra.run.smithi152.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-17T08:46:44.549 INFO:teuthology.orchestra.run.smithi152.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-17T08:46:44.549 INFO:teuthology.orchestra.run.smithi152.stdout:/home/ubuntu/cephtest/mnt.admin 2024-04-17T08:46:44.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:46:44.550 DEBUG:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2024-04-17T08:46:44.601 INFO:teuthology.orchestra.run.smithi152.stdout:44 2024-04-17T08:46:44.602 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-04-17T08:46:44.602 DEBUG:teuthology.orchestra.run.smithi152:> sudo stdin-killer -- python3 -c ' 2024-04-17T08:46:44.602 DEBUG:teuthology.orchestra.run.smithi152:> import glob 2024-04-17T08:46:44.602 DEBUG:teuthology.orchestra.run.smithi152:> import re 2024-04-17T08:46:44.602 DEBUG:teuthology.orchestra.run.smithi152:> import os 2024-04-17T08:46:44.602 DEBUG:teuthology.orchestra.run.smithi152:> import subprocess 2024-04-17T08:46:44.602 DEBUG:teuthology.orchestra.run.smithi152:> 2024-04-17T08:46:44.602 DEBUG:teuthology.orchestra.run.smithi152:> def _find_admin_socket(client_name): 2024-04-17T08:46:44.602 DEBUG:teuthology.orchestra.run.smithi152:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-04-17T08:46:44.602 DEBUG:teuthology.orchestra.run.smithi152:> files = glob.glob(asok_path) 2024-04-17T08:46:44.602 DEBUG:teuthology.orchestra.run.smithi152:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-04-17T08:46:44.602 DEBUG:teuthology.orchestra.run.smithi152:> 2024-04-17T08:46:44.603 DEBUG:teuthology.orchestra.run.smithi152:> # Given a non-glob path, it better be there 2024-04-17T08:46:44.603 DEBUG:teuthology.orchestra.run.smithi152:> if "*" not in asok_path: 2024-04-17T08:46:44.603 DEBUG:teuthology.orchestra.run.smithi152:> assert(len(files) == 1) 2024-04-17T08:46:44.603 DEBUG:teuthology.orchestra.run.smithi152:> return files[0] 2024-04-17T08:46:44.603 DEBUG:teuthology.orchestra.run.smithi152:> 2024-04-17T08:46:44.603 DEBUG:teuthology.orchestra.run.smithi152:> for f in files: 2024-04-17T08:46:44.603 DEBUG:teuthology.orchestra.run.smithi152:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-17T08:46:44.603 DEBUG:teuthology.orchestra.run.smithi152:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-17T08:46:44.603 DEBUG:teuthology.orchestra.run.smithi152:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-17T08:46:44.603 DEBUG:teuthology.orchestra.run.smithi152:> contents = proc_f.read() 2024-04-17T08:46:44.603 DEBUG:teuthology.orchestra.run.smithi152:> if mountpoint in contents: 2024-04-17T08:46:44.603 DEBUG:teuthology.orchestra.run.smithi152:> return f 2024-04-17T08:46:44.603 DEBUG:teuthology.orchestra.run.smithi152:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-17T08:46:44.603 DEBUG:teuthology.orchestra.run.smithi152:> 2024-04-17T08:46:44.603 DEBUG:teuthology.orchestra.run.smithi152:> print(_find_admin_socket("client.admin")) 2024-04-17T08:46:44.603 DEBUG:teuthology.orchestra.run.smithi152:> ' 2024-04-17T08:46:44.732 INFO:teuthology.orchestra.run.smithi152.stdout:/var/run/ceph/ceph-client.admin.34092.asok 2024-04-17T08:46:44.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T08:46:44.745 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.34092.asok 2024-04-17T08:46:44.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:46:44.745 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.34092.asok status 2024-04-17T08:46:44.912 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-17T08:46:44.913 INFO:teuthology.orchestra.run.smithi152.stdout: "metadata": { 2024-04-17T08:46:44.913 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_sha1": "a8c84f5997950fd7d008204839253291d52e6eda", 2024-04-17T08:46:44.913 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_version": "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)", 2024-04-17T08:46:44.913 INFO:teuthology.orchestra.run.smithi152.stdout: "entity_id": "admin", 2024-04-17T08:46:44.913 INFO:teuthology.orchestra.run.smithi152.stdout: "hostname": "smithi152", 2024-04-17T08:46:44.913 INFO:teuthology.orchestra.run.smithi152.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-04-17T08:46:44.913 INFO:teuthology.orchestra.run.smithi152.stdout: "pid": "34092", 2024-04-17T08:46:44.913 INFO:teuthology.orchestra.run.smithi152.stdout: "root": "/" 2024-04-17T08:46:44.913 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-17T08:46:44.913 INFO:teuthology.orchestra.run.smithi152.stdout: "dentry_count": 0, 2024-04-17T08:46:44.913 INFO:teuthology.orchestra.run.smithi152.stdout: "dentry_pinned_count": 0, 2024-04-17T08:46:44.913 INFO:teuthology.orchestra.run.smithi152.stdout: "id": 4461, 2024-04-17T08:46:44.914 INFO:teuthology.orchestra.run.smithi152.stdout: "inst": { 2024-04-17T08:46:44.914 INFO:teuthology.orchestra.run.smithi152.stdout: "name": { 2024-04-17T08:46:44.914 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "client", 2024-04-17T08:46:44.914 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 4461 2024-04-17T08:46:44.914 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-17T08:46:44.914 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": { 2024-04-17T08:46:44.914 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2024-04-17T08:46:44.914 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "192.168.0.1:0", 2024-04-17T08:46:44.914 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 1555542563 2024-04-17T08:46:44.914 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-17T08:46:44.914 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-17T08:46:44.914 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": { 2024-04-17T08:46:44.914 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2024-04-17T08:46:44.915 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "192.168.0.1:0", 2024-04-17T08:46:44.915 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 1555542563 2024-04-17T08:46:44.915 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-17T08:46:44.915 INFO:teuthology.orchestra.run.smithi152.stdout: "inst_str": "client.4461 192.168.0.1:0/1555542563", 2024-04-17T08:46:44.915 INFO:teuthology.orchestra.run.smithi152.stdout: "addr_str": "192.168.0.1:0/1555542563", 2024-04-17T08:46:44.915 INFO:teuthology.orchestra.run.smithi152.stdout: "inode_count": 1, 2024-04-17T08:46:44.915 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_epoch": 7, 2024-04-17T08:46:44.915 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_epoch": 24, 2024-04-17T08:46:44.915 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_epoch_barrier": 0, 2024-04-17T08:46:44.915 INFO:teuthology.orchestra.run.smithi152.stdout: "blocklisted": false, 2024-04-17T08:46:44.915 INFO:teuthology.orchestra.run.smithi152.stdout: "fs_name": "cephfs" 2024-04-17T08:46:44.915 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-17T08:46:44.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:46:44.927 DEBUG:teuthology.orchestra.run.smithi152:> stat --file-system '--printf=%T 2024-04-17T08:46:44.927 DEBUG:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-04-17T08:46:44.936 INFO:teuthology.orchestra.run.smithi152.stdout:fuseblk 2024-04-17T08:46:44.936 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-04-17T08:46:44.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:46:44.937 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-04-17T08:46:44.997 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-04-17T08:46:45.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-17T08:46:45.124 INFO:teuthology.orchestra.run.smithi152.stdout:# file: . 2024-04-17T08:46:45.125 INFO:teuthology.orchestra.run.smithi152.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-04-17T08:46:45.125 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:46:45.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T08:46:45.131 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-17T08:46:45.131 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-17T08:46:45.140 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T08:46:45.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.314+0000 7f3646600640 1 Processor -- start 2024-04-17T08:46:45.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.314+0000 7f3646600640 1 -- start start 2024-04-17T08:46:45.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.314+0000 7f3646600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f364006f980 0x7f3640072530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:45.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.314+0000 7f3646600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f36400d0360 0x7f36400d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:45.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.314+0000 7f3646600640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f364015bfd0 con 0x7f36400af670 2024-04-17T08:46:45.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.314+0000 7f3646600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f364015c820 con 0x7f364006f980 2024-04-17T08:46:45.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.314+0000 7f3646600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f364015c260 con 0x7f36400d0360 2024-04-17T08:46:45.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.314+0000 7f363f400640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f36400af670 0x7f364015b8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:56824/0 (socket says 172.21.15.152:56824) 2024-04-17T08:46:45.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.314+0000 7f363f400640 1 -- 172.21.15.152:0/2380363020 learned_addr learned my addr 172.21.15.152:0/2380363020 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:46:45.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.318+0000 7f363fe00640 1 --2- 172.21.15.152:0/2380363020 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f36400d0360 0x7f36400d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:45.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.318+0000 7f363ea00640 1 --2- 172.21.15.152:0/2380363020 >> v2:172.21.15.196:3300/0 conn(0x7f364006f980 0x7f3640072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:45.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.318+0000 7f363e000640 1 -- 172.21.15.152:0/2380363020 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2192766701 0 0) 0x7f364015bfd0 con 0x7f36400af670 2024-04-17T08:46:45.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.318+0000 7f363e000640 1 -- 172.21.15.152:0/2380363020 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3624005740 con 0x7f36400af670 2024-04-17T08:46:45.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.318+0000 7f363e000640 1 -- 172.21.15.152:0/2380363020 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 33362257 0 0) 0x7f3624005740 con 0x7f36400af670 2024-04-17T08:46:45.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.318+0000 7f363e000640 1 -- 172.21.15.152:0/2380363020 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f36400d0360 msgr2=0x7f36400d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:45.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.318+0000 7f363e000640 1 --2- 172.21.15.152:0/2380363020 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f36400d0360 0x7f36400d07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:45.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.318+0000 7f363e000640 1 -- 172.21.15.152:0/2380363020 >> v2:172.21.15.196:3300/0 conn(0x7f364006f980 msgr2=0x7f3640072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:45.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.318+0000 7f363e000640 1 --2- 172.21.15.152:0/2380363020 >> v2:172.21.15.196:3300/0 conn(0x7f364006f980 0x7f3640072530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:45.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.318+0000 7f363e000640 1 -- 172.21.15.152:0/2380363020 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f364015c540 con 0x7f36400af670 2024-04-17T08:46:45.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.318+0000 7f363e000640 1 -- 172.21.15.152:0/2380363020 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2973887244 0 0) 0x7f3630001680 con 0x7f36400af670 2024-04-17T08:46:45.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.318+0000 7f363e000640 1 -- 172.21.15.152:0/2380363020 >> v1:172.21.15.152:6789/0 conn(0x7f36400af670 legacy=0x7f364015b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:45.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.318+0000 7f363e000640 1 --2- 172.21.15.152:0/2380363020 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f36400d0360 0x7f3624005bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:45.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.318+0000 7f363e000640 1 --2- 172.21.15.152:0/2380363020 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3624006150 0x7f3624006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:45.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.318+0000 7f363e000640 1 --2- 172.21.15.152:0/2380363020 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3624006f60 0x7f36240073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:45.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.318+0000 7f363e000640 1 -- 172.21.15.152:0/2380363020 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f364015c820 con 0x7f3624006150 2024-04-17T08:46:45.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.318+0000 7f363e000640 1 -- 172.21.15.152:0/2380363020 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f364015c260 con 0x7f3624006f60 2024-04-17T08:46:45.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.318+0000 7f363e000640 1 -- 172.21.15.152:0/2380363020 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f362400dc30 con 0x7f36400d0360 2024-04-17T08:46:45.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.318+0000 7f363ea00640 1 --2- 172.21.15.152:0/2380363020 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3624006150 0x7f3624006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:45.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.318+0000 7f363f400640 1 --2- 172.21.15.152:0/2380363020 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f36400d0360 0x7f3624005bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:45.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.318+0000 7f363fe00640 1 --2- 172.21.15.152:0/2380363020 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3624006f60 0x7f36240073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:45.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.318+0000 7f363ea00640 1 -- 172.21.15.152:0/2380363020 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f36400d0360 msgr2=0x7f3624005bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:45.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.318+0000 7f363ea00640 1 --2- 172.21.15.152:0/2380363020 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f36400d0360 0x7f3624005bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:45.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.318+0000 7f363ea00640 1 -- 172.21.15.152:0/2380363020 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3624006f60 msgr2=0x7f36240073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:45.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.318+0000 7f363ea00640 1 --2- 172.21.15.152:0/2380363020 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3624006f60 0x7f36240073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:45.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.318+0000 7f363ea00640 1 -- 172.21.15.152:0/2380363020 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3624005740 con 0x7f3624006150 2024-04-17T08:46:45.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.322+0000 7f363ea00640 1 --2- 172.21.15.152:0/2380363020 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3624006150 0x7f3624006a20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f362c009ae0 tx=0x7f362c01ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=691e4b53e34f765a server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:45.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.322+0000 7f363e000640 1 -- 172.21.15.152:0/2380363020 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f362c0b2070 con 0x7f3624006150 2024-04-17T08:46:45.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.322+0000 7f363e000640 1 -- 172.21.15.152:0/2380363020 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f362c0a5610 con 0x7f3624006150 2024-04-17T08:46:45.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.322+0000 7f363e000640 1 -- 172.21.15.152:0/2380363020 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f362c0096b0 con 0x7f3624006150 2024-04-17T08:46:45.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.322+0000 7f3646600640 1 -- 172.21.15.152:0/2380363020 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3624006150 msgr2=0x7f3624006a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:45.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.322+0000 7f3646600640 1 --2- 172.21.15.152:0/2380363020 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3624006150 0x7f3624006a20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f362c009ae0 tx=0x7f362c01ca40 comp rx=0 tx=0).stop 2024-04-17T08:46:45.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.322+0000 7f363fe00640 1 -- 172.21.15.152:0/2380363020 reap_dead start 2024-04-17T08:46:45.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.322+0000 7f3646600640 1 -- 172.21.15.152:0/2380363020 shutdown_connections 2024-04-17T08:46:45.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.322+0000 7f3646600640 1 -- 172.21.15.152:0/2380363020 >> 172.21.15.152:0/2380363020 conn(0x7f36400b3350 msgr2=0x7f36400b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:45.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.322+0000 7f3646600640 1 -- 172.21.15.152:0/2380363020 shutdown_connections 2024-04-17T08:46:45.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.322+0000 7f3646600640 1 -- 172.21.15.152:0/2380363020 wait complete. 2024-04-17T08:46:45.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.322+0000 7f3646600640 1 Processor -- start 2024-04-17T08:46:45.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.322+0000 7f3646600640 1 -- start start 2024-04-17T08:46:45.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.322+0000 7f3646600640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3624006150 0x7f36400998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:45.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.322+0000 7f3646600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f36400b2940 0x7f3640151700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:45.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.322+0000 7f3646600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3640151c40 0x7f364014f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:45.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.322+0000 7f3646600640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f36400d0cd0 con 0x7f3624006150 2024-04-17T08:46:45.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.322+0000 7f3646600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f36400d0b50 con 0x7f3640151c40 2024-04-17T08:46:45.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.322+0000 7f3646600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f3640072a70 con 0x7f36400b2940 2024-04-17T08:46:45.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.326+0000 7f363f400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3624006150 0x7f36400998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:45.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.326+0000 7f363f400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3624006150 0x7f36400998b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35648/0 (socket says 172.21.15.152:35648) 2024-04-17T08:46:45.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.326+0000 7f363f400640 1 -- 172.21.15.152:0/717608490 learned_addr learned my addr 172.21.15.152:0/717608490 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:45.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.326+0000 7f363ea00640 1 --2- 172.21.15.152:0/717608490 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f36400b2940 0x7f3640151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:45.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.326+0000 7f363fe00640 1 --2- 172.21.15.152:0/717608490 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3640151c40 0x7f364014f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:45.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.326+0000 7f363f400640 1 -- 172.21.15.152:0/717608490 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f36400b2940 msgr2=0x7f3640151700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:45.328 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.326+0000 7f363f400640 1 --2- 172.21.15.152:0/717608490 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f36400b2940 0x7f3640151700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:45.328 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.326+0000 7f363f400640 1 -- 172.21.15.152:0/717608490 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3640151c40 msgr2=0x7f364014f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:45.328 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.326+0000 7f363f400640 1 --2- 172.21.15.152:0/717608490 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3640151c40 0x7f364014f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:45.328 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.326+0000 7f363f400640 1 -- 172.21.15.152:0/717608490 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36400b18a0 con 0x7f3624006150 2024-04-17T08:46:45.328 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.326+0000 7f363f400640 1 --2- 172.21.15.152:0/717608490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3624006150 0x7f36400998b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3630004f60 tx=0x7f3630004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:45.328 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.326+0000 7f3637400640 1 -- 172.21.15.152:0/717608490 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f363000f730 con 0x7f3624006150 2024-04-17T08:46:45.328 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.326+0000 7f3637400640 1 -- 172.21.15.152:0/717608490 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3630018070 con 0x7f3624006150 2024-04-17T08:46:45.328 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.326+0000 7f3637400640 1 -- 172.21.15.152:0/717608490 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f363000fb30 con 0x7f3624006150 2024-04-17T08:46:45.328 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.326+0000 7f3646600640 1 -- 172.21.15.152:0/717608490 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36400b1b80 con 0x7f3624006150 2024-04-17T08:46:45.328 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.326+0000 7f3646600640 1 -- 172.21.15.152:0/717608490 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36400b2140 con 0x7f3624006150 2024-04-17T08:46:45.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.326+0000 7f3646600640 1 -- 172.21.15.152:0/717608490 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3640068a30 con 0x7f3624006150 2024-04-17T08:46:45.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.326+0000 7f3637400640 1 -- 172.21.15.152:0/717608490 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f363000fcd0 con 0x7f3624006150 2024-04-17T08:46:45.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.330+0000 7f3637400640 1 --2- 172.21.15.152:0/717608490 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3620068380 0x7f362006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:45.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.330+0000 7f3637400640 1 -- 172.21.15.152:0/717608490 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f3630086d00 con 0x7f3624006150 2024-04-17T08:46:45.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.330+0000 7f363ea00640 1 --2- 172.21.15.152:0/717608490 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3620068380 0x7f362006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:45.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.330+0000 7f363ea00640 1 --2- 172.21.15.152:0/717608490 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3620068380 0x7f362006a840 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f362c0af000 tx=0x7f362c0046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:45.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.334+0000 7f3637400640 1 -- 172.21.15.152:0/717608490 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f3630056ee0 con 0x7f3624006150 2024-04-17T08:46:45.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.494+0000 7f3646600640 1 -- 172.21.15.152:0/717608490 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f36400b3800 con 0x7f3624006150 2024-04-17T08:46:45.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.494+0000 7f3637400640 1 -- 172.21.15.152:0/717608490 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7f36300567e0 con 0x7f3624006150 2024-04-17T08:46:45.497 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:46:45.497 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":24,"fsid":"ce68f82e-ec5f-4205-9fd5-bdfdf6ef31e2","created":"2024-04-17T08:46:08.353546+0000","modified":"2024-04-17T08:46:38.659862+0000","last_up_change":"2024-04-17T08:46:20.738799+0000","last_in_change":"2024-04-17T08:46:11.210050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T08:46:21.386856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T08:46:31.812460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T08:46:32.555559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T08:46:36.258078+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"682f0192-187c-404e-bc7a-b6b4e23825e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6819","nonce":3603799291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6823","nonce":3603799291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6831","nonce":3603799291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6827","nonce":3603799291}]},"public_addr":"172.21.15.152:6819/3603799291","cluster_addr":"172.21.15.152:6823/3603799291","heartbeat_back_addr":"172.21.15.152:6831/3603799291","heartbeat_front_addr":"172.21.15.152:6827/3603799291","state":["exists","up"]},{"osd":1,"uuid":"f0fe8fef-60ec-4a39-83b6-2fa6a5adb0f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6801","nonce":4133383142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6803","nonce":4133383142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6807","nonce":4133383142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6805","nonce":4133383142}]},"public_addr":"172.21.15.152:6801/4133383142","cluster_addr":"172.21.15.152:6803/4133383142","heartbeat_back_addr":"172.21.15.152:6807/4133383142","heartbeat_front_addr":"172.21.15.152:6805/4133383142","state":["exists","up"]},{"osd":2,"uuid":"35f36d9c-5245-4431-a618-f4df0fa380ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6809","nonce":3826143898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6811","nonce":3826143898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6815","nonce":3826143898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6813","nonce":3826143898}]},"public_addr":"172.21.15.152:6809/3826143898","cluster_addr":"172.21.15.152:6811/3826143898","heartbeat_back_addr":"172.21.15.152:6815/3826143898","heartbeat_front_addr":"172.21.15.152:6813/3826143898","state":["exists","up"]},{"osd":3,"uuid":"96e56ca5-15b4-4895-9b79-da2c92043159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6818","nonce":165717826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6822","nonce":165717826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6830","nonce":165717826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6826","nonce":165717826}]},"public_addr":"172.21.15.152:6818/165717826","cluster_addr":"172.21.15.152:6822/165717826","heartbeat_back_addr":"172.21.15.152:6830/165717826","heartbeat_front_addr":"172.21.15.152:6826/165717826","state":["exists","up"]},{"osd":4,"uuid":"f5aa10a4-9ff9-41fe-a5c9-15326f982cc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6817","nonce":4080159297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6819","nonce":4080159297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6823","nonce":4080159297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6821","nonce":4080159297}]},"public_addr":"172.21.15.196:6817/4080159297","cluster_addr":"172.21.15.196:6819/4080159297","heartbeat_back_addr":"172.21.15.196:6823/4080159297","heartbeat_front_addr":"172.21.15.196:6821/4080159297","state":["exists","up"]},{"osd":5,"uuid":"42bab884-3476-47ae-ac65-935fa6e0f055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6801","nonce":3519444232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6803","nonce":3519444232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6807","nonce":3519444232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6805","nonce":3519444232}]},"public_addr":"172.21.15.196:6801/3519444232","cluster_addr":"172.21.15.196:6803/3519444232","heartbeat_back_addr":"172.21.15.196:6807/3519444232","heartbeat_front_addr":"172.21.15.196:6805/3519444232","state":["exists","up"]},{"osd":6,"uuid":"460b6167-f57b-4224-9c92-cfc9b80bbe99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6809","nonce":275739834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6811","nonce":275739834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6815","nonce":275739834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6813","nonce":275739834}]},"public_addr":"172.21.15.196:6809/275739834","cluster_addr":"172.21.15.196:6811/275739834","heartbeat_back_addr":"172.21.15.196:6815/275739834","heartbeat_front_addr":"172.21.15.196:6813/275739834","state":["exists","up"]},{"osd":7,"uuid":"d695643f-5e07-4e2a-a646-c06bd97b6650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6825","nonce":307626968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6827","nonce":307626968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6831","nonce":307626968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6829","nonce":307626968}]},"public_addr":"172.21.15.196:6825/307626968","cluster_addr":"172.21.15.196:6827/307626968","heartbeat_back_addr":"172.21.15.196:6831/307626968","heartbeat_front_addr":"172.21.15.196:6829/307626968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.293257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.964533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.248895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.010000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.832554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.743704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930171+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930962+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T08:46:45.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.498+0000 7f3646600640 1 -- 172.21.15.152:0/717608490 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3620068380 msgr2=0x7f362006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:45.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.498+0000 7f3646600640 1 --2- 172.21.15.152:0/717608490 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3620068380 0x7f362006a840 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f362c0af000 tx=0x7f362c0046d0 comp rx=0 tx=0).stop 2024-04-17T08:46:45.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.498+0000 7f3646600640 1 -- 172.21.15.152:0/717608490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3624006150 msgr2=0x7f36400998b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:45.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.498+0000 7f3646600640 1 --2- 172.21.15.152:0/717608490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3624006150 0x7f36400998b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3630004f60 tx=0x7f3630004f90 comp rx=0 tx=0).stop 2024-04-17T08:46:45.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.498+0000 7f3646600640 1 -- 172.21.15.152:0/717608490 shutdown_connections 2024-04-17T08:46:45.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.498+0000 7f3646600640 1 --2- 172.21.15.152:0/717608490 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3640151c40 0x7f364014f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:45.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.498+0000 7f3646600640 1 --2- 172.21.15.152:0/717608490 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3620068380 0x7f362006a840 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:45.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.498+0000 7f3646600640 1 --2- 172.21.15.152:0/717608490 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f36400b2940 0x7f3640151700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:45.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.498+0000 7f3646600640 1 --2- 172.21.15.152:0/717608490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3624006150 0x7f36400998b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:45.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.498+0000 7f3646600640 1 -- 172.21.15.152:0/717608490 >> 172.21.15.152:0/717608490 conn(0x7f36400b3350 msgr2=0x7f364015b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:45.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.498+0000 7f3646600640 1 -- 172.21.15.152:0/717608490 shutdown_connections 2024-04-17T08:46:45.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.498+0000 7f3646600640 1 -- 172.21.15.152:0/717608490 wait complete. 2024-04-17T08:46:45.519 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T08:46:21.386856+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-17T08:46:31.812460+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-17T08:46:32.555559+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-17T08:46:36.258078+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-17T08:46:45.519 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T08:46:45.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.654+0000 7fd24ae00640 1 Processor -- start 2024-04-17T08:46:45.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.654+0000 7fd24ae00640 1 -- start start 2024-04-17T08:46:45.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.658+0000 7fd24ae00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd24406f980 0x7fd244072530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:45.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.658+0000 7fd24ae00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fd2440d0360 0x7fd2440d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:45.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.658+0000 7fd24ae00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd24415bfd0 con 0x7fd2440af670 2024-04-17T08:46:45.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.658+0000 7fd24ae00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fd24415c820 con 0x7fd2440d0360 2024-04-17T08:46:45.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.658+0000 7fd24ae00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fd24415c260 con 0x7fd24406f980 2024-04-17T08:46:45.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.658+0000 7fd243e00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fd2440af670 0x7fd24415b8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:56836/0 (socket says 172.21.15.152:56836) 2024-04-17T08:46:45.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.658+0000 7fd243e00640 1 -- 172.21.15.152:0/1307120866 learned_addr learned my addr 172.21.15.152:0/1307120866 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:46:45.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.658+0000 7fd248e00640 1 --2- 172.21.15.152:0/1307120866 >> v2:172.21.15.196:3300/0 conn(0x7fd2440d0360 0x7fd2440d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:45.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.658+0000 7fd243400640 1 --2- 172.21.15.152:0/1307120866 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd24406f980 0x7fd244072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:45.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.658+0000 7fd242a00640 1 -- 172.21.15.152:0/1307120866 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3560732264 0 0) 0x7fd24415bfd0 con 0x7fd2440af670 2024-04-17T08:46:45.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.658+0000 7fd242a00640 1 -- 172.21.15.152:0/1307120866 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd228005740 con 0x7fd2440af670 2024-04-17T08:46:45.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.658+0000 7fd243400640 1 -- 172.21.15.152:0/1307120866 >> v2:172.21.15.196:3300/0 conn(0x7fd2440d0360 msgr2=0x7fd2440d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:45.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.658+0000 7fd243400640 1 --2- 172.21.15.152:0/1307120866 >> v2:172.21.15.196:3300/0 conn(0x7fd2440d0360 0x7fd2440d07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:45.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.658+0000 7fd243400640 1 -- 172.21.15.152:0/1307120866 >> v1:172.21.15.152:6789/0 conn(0x7fd2440af670 legacy=0x7fd24415b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:45.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.658+0000 7fd243400640 1 -- 172.21.15.152:0/1307120866 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd24415c540 con 0x7fd24406f980 2024-04-17T08:46:45.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.662+0000 7fd243400640 1 --2- 172.21.15.152:0/1307120866 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd24406f980 0x7fd244072530 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd2300097c0 tx=0x7fd23001c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64711bc2e9e83cfe server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:45.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.662+0000 7fd242a00640 1 -- 172.21.15.152:0/1307120866 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2300b0070 con 0x7fd24406f980 2024-04-17T08:46:45.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.662+0000 7fd242a00640 1 -- 172.21.15.152:0/1307120866 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2300ab600 con 0x7fd24406f980 2024-04-17T08:46:45.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.662+0000 7fd242a00640 1 -- 172.21.15.152:0/1307120866 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2300ab9d0 con 0x7fd24406f980 2024-04-17T08:46:45.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.662+0000 7fd24ae00640 1 -- 172.21.15.152:0/1307120866 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd24406f980 msgr2=0x7fd244072530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:45.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.662+0000 7fd24ae00640 1 --2- 172.21.15.152:0/1307120866 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd24406f980 0x7fd244072530 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd2300097c0 tx=0x7fd23001c410 comp rx=0 tx=0).stop 2024-04-17T08:46:45.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.662+0000 7fd24ae00640 1 -- 172.21.15.152:0/1307120866 shutdown_connections 2024-04-17T08:46:45.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.662+0000 7fd24ae00640 1 --2- 172.21.15.152:0/1307120866 >> v2:172.21.15.196:3300/0 conn(0x7fd2440d0360 0x7fd2440d07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:45.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.662+0000 7fd24ae00640 1 --2- 172.21.15.152:0/1307120866 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd24406f980 0x7fd244072530 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:45.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.662+0000 7fd24ae00640 1 -- 172.21.15.152:0/1307120866 >> 172.21.15.152:0/1307120866 conn(0x7fd2440b3350 msgr2=0x7fd2440b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:45.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.662+0000 7fd24ae00640 1 -- 172.21.15.152:0/1307120866 shutdown_connections 2024-04-17T08:46:45.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.662+0000 7fd24ae00640 1 -- 172.21.15.152:0/1307120866 wait complete. 2024-04-17T08:46:45.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.666+0000 7fd24ae00640 1 Processor -- start 2024-04-17T08:46:45.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.666+0000 7fd24ae00640 1 -- start start 2024-04-17T08:46:45.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.666+0000 7fd24ae00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd24406f980 0x7fd24414d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:45.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.666+0000 7fd24ae00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd2440af670 0x7fd244149290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:45.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.666+0000 7fd24ae00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd2440d0360 0x7fd244155700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:45.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.666+0000 7fd24ae00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd244072bf0 con 0x7fd2440d0360 2024-04-17T08:46:45.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.666+0000 7fd24ae00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd244072a70 con 0x7fd2440af670 2024-04-17T08:46:45.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.666+0000 7fd24ae00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fd24406b9b0 con 0x7fd24406f980 2024-04-17T08:46:45.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.666+0000 7fd248e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd2440d0360 0x7fd244155700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:45.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.666+0000 7fd248e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd2440d0360 0x7fd244155700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35660/0 (socket says 172.21.15.152:35660) 2024-04-17T08:46:45.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.666+0000 7fd248e00640 1 -- 172.21.15.152:0/3844258391 learned_addr learned my addr 172.21.15.152:0/3844258391 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:45.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.666+0000 7fd243e00640 1 --2- 172.21.15.152:0/3844258391 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd24406f980 0x7fd24414d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:45.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.666+0000 7fd243400640 1 --2- 172.21.15.152:0/3844258391 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd2440af670 0x7fd244149290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:45.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.666+0000 7fd248e00640 1 -- 172.21.15.152:0/3844258391 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd24406f980 msgr2=0x7fd24414d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:45.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.666+0000 7fd248e00640 1 --2- 172.21.15.152:0/3844258391 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd24406f980 0x7fd24414d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:45.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.666+0000 7fd248e00640 1 -- 172.21.15.152:0/3844258391 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd2440af670 msgr2=0x7fd244149290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:45.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.666+0000 7fd248e00640 1 --2- 172.21.15.152:0/3844258391 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd2440af670 0x7fd244149290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:45.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.666+0000 7fd248e00640 1 -- 172.21.15.152:0/3844258391 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd24414dae0 con 0x7fd2440d0360 2024-04-17T08:46:45.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.666+0000 7fd243e00640 1 --2- 172.21.15.152:0/3844258391 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd24406f980 0x7fd24414d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:46:45.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.666+0000 7fd248e00640 1 --2- 172.21.15.152:0/3844258391 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd2440d0360 0x7fd244155700 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd23c00efc0 tx=0x7fd23c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:45.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.666+0000 7fd23be00640 1 -- 172.21.15.152:0/3844258391 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd23c018020 con 0x7fd2440d0360 2024-04-17T08:46:45.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.666+0000 7fd23be00640 1 -- 172.21.15.152:0/3844258391 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd23c014480 con 0x7fd2440d0360 2024-04-17T08:46:45.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.666+0000 7fd24ae00640 1 -- 172.21.15.152:0/3844258391 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd24414ddc0 con 0x7fd2440d0360 2024-04-17T08:46:45.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.666+0000 7fd23be00640 1 -- 172.21.15.152:0/3844258391 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd23c014870 con 0x7fd2440d0360 2024-04-17T08:46:45.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.666+0000 7fd24ae00640 1 -- 172.21.15.152:0/3844258391 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2441548c0 con 0x7fd2440d0360 2024-04-17T08:46:45.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.670+0000 7fd24ae00640 1 -- 172.21.15.152:0/3844258391 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd24415fde0 con 0x7fd2440d0360 2024-04-17T08:46:45.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.670+0000 7fd23be00640 1 -- 172.21.15.152:0/3844258391 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd23c01b020 con 0x7fd2440d0360 2024-04-17T08:46:45.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.670+0000 7fd23be00640 1 --2- 172.21.15.152:0/3844258391 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fd224068380 0x7fd22406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:45.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.670+0000 7fd23be00640 1 -- 172.21.15.152:0/3844258391 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd23c0877c0 con 0x7fd2440d0360 2024-04-17T08:46:45.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.670+0000 7fd243e00640 1 --2- 172.21.15.152:0/3844258391 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fd224068380 0x7fd22406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:45.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.670+0000 7fd243e00640 1 --2- 172.21.15.152:0/3844258391 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fd224068380 0x7fd22406a840 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd234005890 tx=0x7fd234009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:45.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.674+0000 7fd23be00640 1 -- 172.21.15.152:0/3844258391 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fd23c022070 con 0x7fd2440d0360 2024-04-17T08:46:45.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.830+0000 7fd24ae00640 1 -- 172.21.15.152:0/3844258391 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd244068a30 con 0x7fd2440d0360 2024-04-17T08:46:45.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.830+0000 7fd23be00640 1 -- 172.21.15.152:0/3844258391 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7fd23c010040 con 0x7fd2440d0360 2024-04-17T08:46:45.832 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2024-04-17T08:46:45.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.830+0000 7fd24ae00640 1 -- 172.21.15.152:0/3844258391 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fd224068380 msgr2=0x7fd22406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:45.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.830+0000 7fd24ae00640 1 --2- 172.21.15.152:0/3844258391 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fd224068380 0x7fd22406a840 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd234005890 tx=0x7fd234009040 comp rx=0 tx=0).stop 2024-04-17T08:46:45.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.830+0000 7fd24ae00640 1 -- 172.21.15.152:0/3844258391 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd2440d0360 msgr2=0x7fd244155700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:45.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.830+0000 7fd24ae00640 1 --2- 172.21.15.152:0/3844258391 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd2440d0360 0x7fd244155700 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd23c00efc0 tx=0x7fd23c00c490 comp rx=0 tx=0).stop 2024-04-17T08:46:45.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.830+0000 7fd24ae00640 1 -- 172.21.15.152:0/3844258391 shutdown_connections 2024-04-17T08:46:45.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.830+0000 7fd24ae00640 1 --2- 172.21.15.152:0/3844258391 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd2440d0360 0x7fd244155700 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:45.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.830+0000 7fd24ae00640 1 --2- 172.21.15.152:0/3844258391 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd2440af670 0x7fd244149290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:45.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.830+0000 7fd24ae00640 1 --2- 172.21.15.152:0/3844258391 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fd224068380 0x7fd22406a840 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:45.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.830+0000 7fd24ae00640 1 --2- 172.21.15.152:0/3844258391 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd24406f980 0x7fd24414d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:45.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.830+0000 7fd24ae00640 1 -- 172.21.15.152:0/3844258391 >> 172.21.15.152:0/3844258391 conn(0x7fd2440b3350 msgr2=0x7fd244073140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:45.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.834+0000 7fd24ae00640 1 -- 172.21.15.152:0/3844258391 shutdown_connections 2024-04-17T08:46:45.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.834+0000 7fd24ae00640 1 -- 172.21.15.152:0/3844258391 wait complete. 2024-04-17T08:46:45.852 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-17T08:46:45.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.990+0000 7f2344e00640 1 Processor -- start 2024-04-17T08:46:45.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.990+0000 7f2344e00640 1 -- start start 2024-04-17T08:46:45.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.990+0000 7f2344e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2340158fe0 0x7f234015f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:45.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.990+0000 7f2344e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f2340070950 0x7f23400b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:45.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.990+0000 7f2344e00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f234015fcf0 con 0x7f234006b9b0 2024-04-17T08:46:45.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.990+0000 7f2344e00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f23400cea60 con 0x7f2340070950 2024-04-17T08:46:45.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.990+0000 7f2344e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f23400ced40 con 0x7f2340158fe0 2024-04-17T08:46:45.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.990+0000 7f233e800640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f234006b9b0 0x7f234006bdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:56840/0 (socket says 172.21.15.152:56840) 2024-04-17T08:46:45.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.990+0000 7f233e800640 1 -- 172.21.15.152:0/2726416851 learned_addr learned my addr 172.21.15.152:0/2726416851 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:46:45.993 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.990+0000 7f233de00640 1 --2- 172.21.15.152:0/2726416851 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2340158fe0 0x7f234015f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:45.993 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.990+0000 7f2335400640 1 --2- 172.21.15.152:0/2726416851 >> v2:172.21.15.196:3300/0 conn(0x7f2340070950 0x7f23400b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:45.994 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.990+0000 7f233d400640 1 -- 172.21.15.152:0/2726416851 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3164082263 0 0) 0x7f234015fcf0 con 0x7f234006b9b0 2024-04-17T08:46:45.994 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.990+0000 7f233d400640 1 -- 172.21.15.152:0/2726416851 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2324003530 con 0x7f234006b9b0 2024-04-17T08:46:45.994 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.990+0000 7f233d400640 1 -- 172.21.15.152:0/2726416851 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 165491162 0 0) 0x7f2324003530 con 0x7f234006b9b0 2024-04-17T08:46:45.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.990+0000 7f233d400640 1 -- 172.21.15.152:0/2726416851 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2340158fe0 msgr2=0x7f234015f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:45.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.990+0000 7f233d400640 1 --2- 172.21.15.152:0/2726416851 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2340158fe0 0x7f234015f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:45.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.990+0000 7f233d400640 1 -- 172.21.15.152:0/2726416851 >> v2:172.21.15.196:3300/0 conn(0x7f2340070950 msgr2=0x7f23400b3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:45.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.990+0000 7f233d400640 1 --2- 172.21.15.152:0/2726416851 >> v2:172.21.15.196:3300/0 conn(0x7f2340070950 0x7f23400b3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:45.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.990+0000 7f233d400640 1 -- 172.21.15.152:0/2726416851 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23400cf020 con 0x7f234006b9b0 2024-04-17T08:46:45.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.990+0000 7f233d400640 1 -- 172.21.15.152:0/2726416851 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2973887244 0 0) 0x7f2338001a20 con 0x7f234006b9b0 2024-04-17T08:46:45.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.990+0000 7f233d400640 1 -- 172.21.15.152:0/2726416851 >> v1:172.21.15.152:6789/0 conn(0x7f234006b9b0 legacy=0x7f234006bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:45.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.990+0000 7f233d400640 1 --2- 172.21.15.152:0/2726416851 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f23240039c0 0x7f2324003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:45.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.990+0000 7f233d400640 1 --2- 172.21.15.152:0/2726416851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2324004810 0x7f2324004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:45.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.990+0000 7f233d400640 1 --2- 172.21.15.152:0/2726416851 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2340158fe0 0x7f23240051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:45.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.990+0000 7f233d400640 1 -- 172.21.15.152:0/2726416851 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f23400cea60 con 0x7f2324004810 2024-04-17T08:46:45.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.990+0000 7f233d400640 1 -- 172.21.15.152:0/2726416851 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f23400ced40 con 0x7f23240039c0 2024-04-17T08:46:45.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.990+0000 7f233d400640 1 -- 172.21.15.152:0/2726416851 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f232400b9d0 con 0x7f2340158fe0 2024-04-17T08:46:45.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.990+0000 7f2335400640 1 --2- 172.21.15.152:0/2726416851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2324004810 0x7f2324004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:45.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.990+0000 7f233de00640 1 --2- 172.21.15.152:0/2726416851 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f23240039c0 0x7f2324003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:45.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.990+0000 7f233e800640 1 --2- 172.21.15.152:0/2726416851 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2340158fe0 0x7f23240051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:45.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.990+0000 7f2335400640 1 -- 172.21.15.152:0/2726416851 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2340158fe0 msgr2=0x7f23240051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:45.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.990+0000 7f2335400640 1 --2- 172.21.15.152:0/2726416851 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2340158fe0 0x7f23240051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:45.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.994+0000 7f2335400640 1 -- 172.21.15.152:0/2726416851 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f23240039c0 msgr2=0x7f2324003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:45.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.994+0000 7f2335400640 1 --2- 172.21.15.152:0/2726416851 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f23240039c0 0x7f2324003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:45.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.994+0000 7f2335400640 1 -- 172.21.15.152:0/2726416851 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2324003530 con 0x7f2324004810 2024-04-17T08:46:45.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.994+0000 7f2335400640 1 --2- 172.21.15.152:0/2726416851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2324004810 0x7f2324004c90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2328009ae0 tx=0x7f232801cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acc38e6802692077 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:45.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.994+0000 7f233d400640 1 -- 172.21.15.152:0/2726416851 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23280b2070 con 0x7f2324004810 2024-04-17T08:46:45.998 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.994+0000 7f233d400640 1 -- 172.21.15.152:0/2726416851 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23280a55c0 con 0x7f2324004810 2024-04-17T08:46:45.998 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.994+0000 7f233d400640 1 -- 172.21.15.152:0/2726416851 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23280096b0 con 0x7f2324004810 2024-04-17T08:46:45.998 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.994+0000 7f2344e00640 1 -- 172.21.15.152:0/2726416851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2324004810 msgr2=0x7f2324004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:45.998 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.994+0000 7f2344e00640 1 --2- 172.21.15.152:0/2726416851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2324004810 0x7f2324004c90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2328009ae0 tx=0x7f232801cab0 comp rx=0 tx=0).stop 2024-04-17T08:46:45.998 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.994+0000 7f233e800640 1 -- 172.21.15.152:0/2726416851 reap_dead start 2024-04-17T08:46:45.998 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.994+0000 7f2344e00640 1 -- 172.21.15.152:0/2726416851 shutdown_connections 2024-04-17T08:46:45.998 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.994+0000 7f2344e00640 1 -- 172.21.15.152:0/2726416851 >> 172.21.15.152:0/2726416851 conn(0x7f23400cd540 msgr2=0x7f23400cd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:45.998 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.994+0000 7f2344e00640 1 -- 172.21.15.152:0/2726416851 shutdown_connections 2024-04-17T08:46:45.998 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.994+0000 7f2344e00640 1 -- 172.21.15.152:0/2726416851 wait complete. 2024-04-17T08:46:45.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.998+0000 7f2344e00640 1 Processor -- start 2024-04-17T08:46:45.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.998+0000 7f2344e00640 1 -- start start 2024-04-17T08:46:46.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.998+0000 7f2344e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2324004810 0x7f2340157700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:46.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.998+0000 7f2344e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f234015ce90 0x7f23400cbc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:46.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.998+0000 7f2344e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f23400cc160 0x7f23401f71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:46.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.998+0000 7f2344e00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f23400b4440 con 0x7f234015ce90 2024-04-17T08:46:46.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.998+0000 7f2344e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f23400cf5e0 con 0x7f2324004810 2024-04-17T08:46:46.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.998+0000 7f2344e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f23400b45c0 con 0x7f23400cc160 2024-04-17T08:46:46.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.998+0000 7f2335400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f234015ce90 0x7f23400cbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:46.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.998+0000 7f2335400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f234015ce90 0x7f23400cbc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35678/0 (socket says 172.21.15.152:35678) 2024-04-17T08:46:46.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.998+0000 7f2335400640 1 -- 172.21.15.152:0/1870473150 learned_addr learned my addr 172.21.15.152:0/1870473150 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:46.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.998+0000 7f2335400640 1 -- 172.21.15.152:0/1870473150 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f23400cc160 msgr2=0x7f23401f71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:46.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.998+0000 7f2335400640 1 --2- 172.21.15.152:0/1870473150 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f23400cc160 0x7f23401f71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:46.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.998+0000 7f2335400640 1 -- 172.21.15.152:0/1870473150 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2324004810 msgr2=0x7f2340157700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:46.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.998+0000 7f2335400640 1 --2- 172.21.15.152:0/1870473150 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2324004810 0x7f2340157700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:46.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.998+0000 7f2335400640 1 -- 172.21.15.152:0/1870473150 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f234015e120 con 0x7f234015ce90 2024-04-17T08:46:46.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.998+0000 7f2335400640 1 --2- 172.21.15.152:0/1870473150 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f234015ce90 0x7f23400cbc20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2328009ae0 tx=0x7f2324005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:46.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.998+0000 7f2336a00640 1 -- 172.21.15.152:0/1870473150 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23280bc030 con 0x7f234015ce90 2024-04-17T08:46:46.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.998+0000 7f2336a00640 1 -- 172.21.15.152:0/1870473150 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f232800f000 con 0x7f234015ce90 2024-04-17T08:46:46.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.998+0000 7f2336a00640 1 -- 172.21.15.152:0/1870473150 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23280b2040 con 0x7f234015ce90 2024-04-17T08:46:46.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:45.998+0000 7f2344e00640 1 -- 172.21.15.152:0/1870473150 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f234015e400 con 0x7f234015ce90 2024-04-17T08:46:46.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.002+0000 7f2344e00640 1 -- 172.21.15.152:0/1870473150 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f234015a470 con 0x7f234015ce90 2024-04-17T08:46:46.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.002+0000 7f2344e00640 1 -- 172.21.15.152:0/1870473150 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2340068a30 con 0x7f234015ce90 2024-04-17T08:46:46.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.002+0000 7f2336a00640 1 -- 172.21.15.152:0/1870473150 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f23280bf070 con 0x7f234015ce90 2024-04-17T08:46:46.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.002+0000 7f2336a00640 1 --2- 172.21.15.152:0/1870473150 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f231c0683b0 0x7f231c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:46.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.002+0000 7f2336a00640 1 -- 172.21.15.152:0/1870473150 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2328120710 con 0x7f234015ce90 2024-04-17T08:46:46.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.002+0000 7f233de00640 1 --2- 172.21.15.152:0/1870473150 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f231c0683b0 0x7f231c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:46.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.006+0000 7f233de00640 1 --2- 172.21.15.152:0/1870473150 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f231c0683b0 0x7f231c06a870 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2330009980 tx=0x7f2330009d80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:46.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.006+0000 7f2336a00640 1 -- 172.21.15.152:0/1870473150 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f23280167c0 con 0x7f234015ce90 2024-04-17T08:46:46.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.162+0000 7f2344e00640 1 -- 172.21.15.152:0/1870473150 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f234015c260 con 0x7f234015ce90 2024-04-17T08:46:46.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.162+0000 7f2336a00640 1 -- 172.21.15.152:0/1870473150 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7f23280f0330 con 0x7f234015ce90 2024-04-17T08:46:46.166 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-04-17T08:46:46.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.166+0000 7f2344e00640 1 -- 172.21.15.152:0/1870473150 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f231c0683b0 msgr2=0x7f231c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:46.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.166+0000 7f2344e00640 1 --2- 172.21.15.152:0/1870473150 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f231c0683b0 0x7f231c06a870 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2330009980 tx=0x7f2330009d80 comp rx=0 tx=0).stop 2024-04-17T08:46:46.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.166+0000 7f2344e00640 1 -- 172.21.15.152:0/1870473150 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f234015ce90 msgr2=0x7f23400cbc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:46.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.166+0000 7f2344e00640 1 --2- 172.21.15.152:0/1870473150 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f234015ce90 0x7f23400cbc20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2328009ae0 tx=0x7f2324005840 comp rx=0 tx=0).stop 2024-04-17T08:46:46.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.166+0000 7f2344e00640 1 -- 172.21.15.152:0/1870473150 shutdown_connections 2024-04-17T08:46:46.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.166+0000 7f2344e00640 1 --2- 172.21.15.152:0/1870473150 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f231c0683b0 0x7f231c06a870 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:46.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.166+0000 7f2344e00640 1 --2- 172.21.15.152:0/1870473150 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f23400cc160 0x7f23401f71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:46.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.166+0000 7f2344e00640 1 --2- 172.21.15.152:0/1870473150 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f234015ce90 0x7f23400cbc20 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:46.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.166+0000 7f2344e00640 1 --2- 172.21.15.152:0/1870473150 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2324004810 0x7f2340157700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:46.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.166+0000 7f2344e00640 1 -- 172.21.15.152:0/1870473150 >> 172.21.15.152:0/1870473150 conn(0x7f23400cd540 msgr2=0x7f23400b5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:46.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.166+0000 7f2344e00640 1 -- 172.21.15.152:0/1870473150 shutdown_connections 2024-04-17T08:46:46.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.166+0000 7f2344e00640 1 -- 172.21.15.152:0/1870473150 wait complete. 2024-04-17T08:46:46.186 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-17T08:46:46.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.326+0000 7f82b2a00640 1 Processor -- start 2024-04-17T08:46:46.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.326+0000 7f82b2a00640 1 -- start start 2024-04-17T08:46:46.328 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.326+0000 7f82b2a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82ac0af670 0x7f82ac15b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:46.328 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.326+0000 7f82b2a00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f82ac06f980 0x7f82ac072530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:46.328 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.326+0000 7f82b2a00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82ac15c260 con 0x7f82ac0d0360 2024-04-17T08:46:46.328 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.326+0000 7f82b2a00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f82ac15c820 con 0x7f82ac06f980 2024-04-17T08:46:46.328 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.326+0000 7f82b2a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f82ac15c540 con 0x7f82ac0af670 2024-04-17T08:46:46.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.326+0000 7f82ab400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f82ac06f980 0x7f82ac072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:46.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.326+0000 7f82b0a00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f82ac0d0360 0x7f82ac06dc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:56844/0 (socket says 172.21.15.152:56844) 2024-04-17T08:46:46.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.326+0000 7f82ab400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f82ac06f980 0x7f82ac072530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35682/0 (socket says 172.21.15.152:35682) 2024-04-17T08:46:46.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.326+0000 7f82b0a00640 1 -- 172.21.15.152:0/3828460924 learned_addr learned my addr 172.21.15.152:0/3828460924 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:46:46.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.326+0000 7f82abe00640 1 --2- 172.21.15.152:0/3828460924 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82ac0af670 0x7f82ac15b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:46.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.326+0000 7f82ab400640 1 -- 172.21.15.152:0/3828460924 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82ac0af670 msgr2=0x7f82ac15b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:46.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.326+0000 7f82ab400640 1 --2- 172.21.15.152:0/3828460924 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82ac0af670 0x7f82ac15b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:46.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.326+0000 7f82ab400640 1 -- 172.21.15.152:0/3828460924 >> v1:172.21.15.152:6789/0 conn(0x7f82ac0d0360 legacy=0x7f82ac06dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:46.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.326+0000 7f82ab400640 1 -- 172.21.15.152:0/3828460924 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82ac071d30 con 0x7f82ac06f980 2024-04-17T08:46:46.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.330+0000 7f82ab400640 1 --2- 172.21.15.152:0/3828460924 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82ac06f980 0x7f82ac072530 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f82980097c0 tx=0x7f829801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c99b363ab3ac85e server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:46.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.330+0000 7f82aaa00640 1 -- 172.21.15.152:0/3828460924 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82980b0070 con 0x7f82ac06f980 2024-04-17T08:46:46.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.330+0000 7f82aaa00640 1 -- 172.21.15.152:0/3828460924 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82980ab600 con 0x7f82ac06f980 2024-04-17T08:46:46.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.330+0000 7f82aaa00640 1 -- 172.21.15.152:0/3828460924 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82980ab9d0 con 0x7f82ac06f980 2024-04-17T08:46:46.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.330+0000 7f82b2a00640 1 -- 172.21.15.152:0/3828460924 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82ac06f980 msgr2=0x7f82ac072530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:46.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.330+0000 7f82b2a00640 1 --2- 172.21.15.152:0/3828460924 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82ac06f980 0x7f82ac072530 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f82980097c0 tx=0x7f829801c3e0 comp rx=0 tx=0).stop 2024-04-17T08:46:46.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.330+0000 7f82b2a00640 1 -- 172.21.15.152:0/3828460924 shutdown_connections 2024-04-17T08:46:46.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.330+0000 7f82b2a00640 1 --2- 172.21.15.152:0/3828460924 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82ac06f980 0x7f82ac072530 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:46.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.330+0000 7f82b2a00640 1 --2- 172.21.15.152:0/3828460924 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82ac0af670 0x7f82ac15b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:46.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.330+0000 7f82b2a00640 1 -- 172.21.15.152:0/3828460924 >> 172.21.15.152:0/3828460924 conn(0x7f82ac0b3350 msgr2=0x7f82ac0b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:46.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.330+0000 7f82b2a00640 1 -- 172.21.15.152:0/3828460924 shutdown_connections 2024-04-17T08:46:46.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.330+0000 7f82b2a00640 1 -- 172.21.15.152:0/3828460924 wait complete. 2024-04-17T08:46:46.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.334+0000 7f82b2a00640 1 Processor -- start 2024-04-17T08:46:46.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.334+0000 7f82b2a00640 1 -- start start 2024-04-17T08:46:46.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.334+0000 7f82b2a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82ac06f980 0x7f82ac1579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:46.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.334+0000 7f82b2a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f82ac0af670 0x7f82ac0b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:46.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.334+0000 7f82b2a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82ac0d0360 0x7f82ac0b2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:46.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.334+0000 7f82b2a00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f82ac15bf80 con 0x7f82ac06f980 2024-04-17T08:46:46.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.334+0000 7f82b2a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f82ac15be00 con 0x7f82ac0af670 2024-04-17T08:46:46.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.334+0000 7f82b2a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f82ac072a70 con 0x7f82ac0d0360 2024-04-17T08:46:46.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.334+0000 7f82abe00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82ac06f980 0x7f82ac1579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:46.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.334+0000 7f82abe00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82ac06f980 0x7f82ac1579f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35698/0 (socket says 172.21.15.152:35698) 2024-04-17T08:46:46.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.334+0000 7f82abe00640 1 -- 172.21.15.152:0/1553272039 learned_addr learned my addr 172.21.15.152:0/1553272039 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:46.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.334+0000 7f82abe00640 1 -- 172.21.15.152:0/1553272039 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82ac0d0360 msgr2=0x7f82ac0b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:46.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.334+0000 7f82abe00640 1 --2- 172.21.15.152:0/1553272039 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82ac0d0360 0x7f82ac0b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:46.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.334+0000 7f82abe00640 1 -- 172.21.15.152:0/1553272039 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f82ac0af670 msgr2=0x7f82ac0b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:46.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.334+0000 7f82abe00640 1 --2- 172.21.15.152:0/1553272039 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f82ac0af670 0x7f82ac0b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:46.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.334+0000 7f82abe00640 1 -- 172.21.15.152:0/1553272039 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82ac0b2640 con 0x7f82ac06f980 2024-04-17T08:46:46.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.334+0000 7f82abe00640 1 --2- 172.21.15.152:0/1553272039 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82ac06f980 0x7f82ac1579f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f829c00d830 tx=0x7f829c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:46.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.334+0000 7f82a3e00640 1 -- 172.21.15.152:0/1553272039 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f829c00b6c0 con 0x7f82ac06f980 2024-04-17T08:46:46.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.334+0000 7f82a3e00640 1 -- 172.21.15.152:0/1553272039 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f829c019070 con 0x7f82ac06f980 2024-04-17T08:46:46.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.334+0000 7f82b2a00640 1 -- 172.21.15.152:0/1553272039 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82ac0b2920 con 0x7f82ac06f980 2024-04-17T08:46:46.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.334+0000 7f82a3e00640 1 -- 172.21.15.152:0/1553272039 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f829c00ba80 con 0x7f82ac06f980 2024-04-17T08:46:46.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.334+0000 7f82b2a00640 1 -- 172.21.15.152:0/1553272039 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82ac1542c0 con 0x7f82ac06f980 2024-04-17T08:46:46.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.334+0000 7f82b2a00640 1 -- 172.21.15.152:0/1553272039 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82ac068a30 con 0x7f82ac06f980 2024-04-17T08:46:46.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.338+0000 7f82a3e00640 1 -- 172.21.15.152:0/1553272039 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f829c01e460 con 0x7f82ac06f980 2024-04-17T08:46:46.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.338+0000 7f82a3e00640 1 --2- 172.21.15.152:0/1553272039 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f828c0683b0 0x7f828c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:46.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.338+0000 7f82a3e00640 1 -- 172.21.15.152:0/1553272039 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f829c0874e0 con 0x7f82ac06f980 2024-04-17T08:46:46.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.338+0000 7f82ab400640 1 --2- 172.21.15.152:0/1553272039 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f828c0683b0 0x7f828c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:46.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.338+0000 7f82ab400640 1 --2- 172.21.15.152:0/1553272039 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f828c0683b0 0x7f828c06a870 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f82980ad000 tx=0x7f8298008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:46.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.342+0000 7f82a3e00640 1 -- 172.21.15.152:0/1553272039 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f829c0576c0 con 0x7f82ac06f980 2024-04-17T08:46:46.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.502+0000 7f82b2a00640 1 -- 172.21.15.152:0/1553272039 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f82ac074e80 con 0x7f82ac06f980 2024-04-17T08:46:46.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.502+0000 7f82a3e00640 1 -- 172.21.15.152:0/1553272039 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7f829c056fc0 con 0x7f82ac06f980 2024-04-17T08:46:46.502 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 64 2024-04-17T08:46:46.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.502+0000 7f82b2a00640 1 -- 172.21.15.152:0/1553272039 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f828c0683b0 msgr2=0x7f828c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:46.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.502+0000 7f82b2a00640 1 --2- 172.21.15.152:0/1553272039 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f828c0683b0 0x7f828c06a870 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f82980ad000 tx=0x7f8298008040 comp rx=0 tx=0).stop 2024-04-17T08:46:46.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.502+0000 7f82b2a00640 1 -- 172.21.15.152:0/1553272039 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82ac06f980 msgr2=0x7f82ac1579f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:46.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.502+0000 7f82b2a00640 1 --2- 172.21.15.152:0/1553272039 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82ac06f980 0x7f82ac1579f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f829c00d830 tx=0x7f829c00dcf0 comp rx=0 tx=0).stop 2024-04-17T08:46:46.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.502+0000 7f82b2a00640 1 -- 172.21.15.152:0/1553272039 shutdown_connections 2024-04-17T08:46:46.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.502+0000 7f82b2a00640 1 --2- 172.21.15.152:0/1553272039 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f828c0683b0 0x7f828c06a870 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:46.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.502+0000 7f82b2a00640 1 --2- 172.21.15.152:0/1553272039 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82ac0d0360 0x7f82ac0b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:46.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.502+0000 7f82b2a00640 1 --2- 172.21.15.152:0/1553272039 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f82ac0af670 0x7f82ac0b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:46.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.502+0000 7f82b2a00640 1 --2- 172.21.15.152:0/1553272039 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82ac06f980 0x7f82ac1579f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:46.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.502+0000 7f82b2a00640 1 -- 172.21.15.152:0/1553272039 >> 172.21.15.152:0/1553272039 conn(0x7f82ac0b3350 msgr2=0x7f82ac165620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:46.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.502+0000 7f82b2a00640 1 -- 172.21.15.152:0/1553272039 shutdown_connections 2024-04-17T08:46:46.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.502+0000 7f82b2a00640 1 -- 172.21.15.152:0/1553272039 wait complete. 2024-04-17T08:46:46.526 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-17T08:46:46.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.662+0000 7f9dc8200640 1 Processor -- start 2024-04-17T08:46:46.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.662+0000 7f9dc8200640 1 -- start start 2024-04-17T08:46:46.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.662+0000 7f9dc8200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f9dc00cff90 0x7f9dc00d0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:46.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.662+0000 7f9dc8200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9dc00ccdd0 0x7f9dc00cd260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:46.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.662+0000 7f9dc8200640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dc00c7bc0 con 0x7f9dc015a030 2024-04-17T08:46:46.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.662+0000 7f9dc8200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f9dc015a410 con 0x7f9dc00cff90 2024-04-17T08:46:46.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.662+0000 7f9dc8200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f9dc00c7e70 con 0x7f9dc00ccdd0 2024-04-17T08:46:46.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.662+0000 7f9dc5800640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f9dc015a030 0x7f9dc00c74b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:56850/0 (socket says 172.21.15.152:56850) 2024-04-17T08:46:46.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.662+0000 7f9dc5800640 1 -- 172.21.15.152:0/3910210075 learned_addr learned my addr 172.21.15.152:0/3910210075 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:46:46.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.662+0000 7f9dc4e00640 1 --2- 172.21.15.152:0/3910210075 >> v2:172.21.15.196:3300/0 conn(0x7f9dc00cff90 0x7f9dc00d0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:46.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.662+0000 7f9dc6200640 1 --2- 172.21.15.152:0/3910210075 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9dc00ccdd0 0x7f9dc00cd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:46.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.662+0000 7f9dbfe00640 1 -- 172.21.15.152:0/3910210075 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3784516654 0 0) 0x7f9dc00c7bc0 con 0x7f9dc015a030 2024-04-17T08:46:46.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.662+0000 7f9dbfe00640 1 -- 172.21.15.152:0/3910210075 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9da8003530 con 0x7f9dc015a030 2024-04-17T08:46:46.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.662+0000 7f9dbfe00640 1 -- 172.21.15.152:0/3910210075 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 859118935 0 0) 0x7f9da8003530 con 0x7f9dc015a030 2024-04-17T08:46:46.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.662+0000 7f9dbfe00640 1 -- 172.21.15.152:0/3910210075 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9dc00ccdd0 msgr2=0x7f9dc00cd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:46.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.662+0000 7f9dbfe00640 1 --2- 172.21.15.152:0/3910210075 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9dc00ccdd0 0x7f9dc00cd260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:46.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.662+0000 7f9dbfe00640 1 -- 172.21.15.152:0/3910210075 >> v2:172.21.15.196:3300/0 conn(0x7f9dc00cff90 msgr2=0x7f9dc00d0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:46.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.662+0000 7f9dbfe00640 1 --2- 172.21.15.152:0/3910210075 >> v2:172.21.15.196:3300/0 conn(0x7f9dc00cff90 0x7f9dc00d0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:46.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.662+0000 7f9dbfe00640 1 -- 172.21.15.152:0/3910210075 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dc00c8150 con 0x7f9dc015a030 2024-04-17T08:46:46.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.662+0000 7f9dbfe00640 1 -- 172.21.15.152:0/3910210075 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2973887244 0 0) 0x7f9db4001a00 con 0x7f9dc015a030 2024-04-17T08:46:46.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.662+0000 7f9dbfe00640 1 -- 172.21.15.152:0/3910210075 >> v1:172.21.15.152:6789/0 conn(0x7f9dc015a030 legacy=0x7f9dc00c74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:46.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.662+0000 7f9dbfe00640 1 --2- 172.21.15.152:0/3910210075 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9dc00ccdd0 0x7f9da80039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:46.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.662+0000 7f9dbfe00640 1 --2- 172.21.15.152:0/3910210075 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9da8003f40 0x7f9da8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:46.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.662+0000 7f9dbfe00640 1 --2- 172.21.15.152:0/3910210075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9da8004d50 0x7f9da80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:46.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.666+0000 7f9dbfe00640 1 -- 172.21.15.152:0/3910210075 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc015a410 con 0x7f9da8004d50 2024-04-17T08:46:46.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.666+0000 7f9dbfe00640 1 -- 172.21.15.152:0/3910210075 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc00c7e70 con 0x7f9da8003f40 2024-04-17T08:46:46.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.666+0000 7f9dbfe00640 1 -- 172.21.15.152:0/3910210075 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f9da800ba20 con 0x7f9dc00ccdd0 2024-04-17T08:46:46.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.666+0000 7f9dc6200640 1 --2- 172.21.15.152:0/3910210075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9da8004d50 0x7f9da80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:46.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.666+0000 7f9dc5800640 1 --2- 172.21.15.152:0/3910210075 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9dc00ccdd0 0x7f9da80039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:46.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.666+0000 7f9dc4e00640 1 --2- 172.21.15.152:0/3910210075 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9da8003f40 0x7f9da8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:46.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.666+0000 7f9dc6200640 1 -- 172.21.15.152:0/3910210075 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9dc00ccdd0 msgr2=0x7f9da80039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:46.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.666+0000 7f9dc6200640 1 --2- 172.21.15.152:0/3910210075 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9dc00ccdd0 0x7f9da80039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:46.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.666+0000 7f9dc6200640 1 -- 172.21.15.152:0/3910210075 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9da8003f40 msgr2=0x7f9da8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:46.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.666+0000 7f9dc6200640 1 --2- 172.21.15.152:0/3910210075 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9da8003f40 0x7f9da8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:46.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.666+0000 7f9dc6200640 1 -- 172.21.15.152:0/3910210075 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9da8003530 con 0x7f9da8004d50 2024-04-17T08:46:46.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.666+0000 7f9dc6200640 1 --2- 172.21.15.152:0/3910210075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9da8004d50 0x7f9da80051d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9db8009b10 tx=0x7f9db801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae5adf8a66ab3d92 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:46.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.666+0000 7f9dbfe00640 1 -- 172.21.15.152:0/3910210075 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db80b2070 con 0x7f9da8004d50 2024-04-17T08:46:46.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.666+0000 7f9dbfe00640 1 -- 172.21.15.152:0/3910210075 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9db80a5660 con 0x7f9da8004d50 2024-04-17T08:46:46.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.666+0000 7f9dbfe00640 1 -- 172.21.15.152:0/3910210075 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db80096b0 con 0x7f9da8004d50 2024-04-17T08:46:46.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.670+0000 7f9dc8200640 1 -- 172.21.15.152:0/3910210075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9da8004d50 msgr2=0x7f9da80051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:46.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.670+0000 7f9dc8200640 1 --2- 172.21.15.152:0/3910210075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9da8004d50 0x7f9da80051d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9db8009b10 tx=0x7f9db801ca70 comp rx=0 tx=0).stop 2024-04-17T08:46:46.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.670+0000 7f9dc6200640 1 -- 172.21.15.152:0/3910210075 reap_dead start 2024-04-17T08:46:46.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.670+0000 7f9dc8200640 1 -- 172.21.15.152:0/3910210075 shutdown_connections 2024-04-17T08:46:46.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.670+0000 7f9dc8200640 1 -- 172.21.15.152:0/3910210075 >> 172.21.15.152:0/3910210075 conn(0x7f9dc00cee40 msgr2=0x7f9dc00cf220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:46.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.670+0000 7f9dc8200640 1 -- 172.21.15.152:0/3910210075 shutdown_connections 2024-04-17T08:46:46.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.670+0000 7f9dc8200640 1 -- 172.21.15.152:0/3910210075 wait complete. 2024-04-17T08:46:46.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.670+0000 7f9dc8200640 1 Processor -- start 2024-04-17T08:46:46.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.670+0000 7f9dc8200640 1 -- start start 2024-04-17T08:46:46.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.670+0000 7f9dc8200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9da8004d50 0x7f9dc00b5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:46.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.670+0000 7f9dc8200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9dc00b2d80 0x7f9dc015ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:46.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.670+0000 7f9dc8200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9dc0154850 0x7f9dc0154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:46.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.670+0000 7f9dc8200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc015cbc0 con 0x7f9da8004d50 2024-04-17T08:46:46.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.670+0000 7f9dc8200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc00c8710 con 0x7f9dc0154850 2024-04-17T08:46:46.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.670+0000 7f9dc8200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f9dc015cd40 con 0x7f9dc00b2d80 2024-04-17T08:46:46.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.670+0000 7f9dc5800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9da8004d50 0x7f9dc00b5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:46.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.670+0000 7f9dc5800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9da8004d50 0x7f9dc00b5a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35716/0 (socket says 172.21.15.152:35716) 2024-04-17T08:46:46.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.670+0000 7f9dc5800640 1 -- 172.21.15.152:0/2130659259 learned_addr learned my addr 172.21.15.152:0/2130659259 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:46.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.670+0000 7f9dc4e00640 1 --2- 172.21.15.152:0/2130659259 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9dc00b2d80 0x7f9dc015ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:46.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.670+0000 7f9dc6200640 1 --2- 172.21.15.152:0/2130659259 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9dc0154850 0x7f9dc0154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:46.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.670+0000 7f9dc5800640 1 -- 172.21.15.152:0/2130659259 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9dc00b2d80 msgr2=0x7f9dc015ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:46.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.670+0000 7f9dc5800640 1 --2- 172.21.15.152:0/2130659259 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9dc00b2d80 0x7f9dc015ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:46.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.670+0000 7f9dc5800640 1 -- 172.21.15.152:0/2130659259 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9dc0154850 msgr2=0x7f9dc0154cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:46.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.670+0000 7f9dc5800640 1 --2- 172.21.15.152:0/2130659259 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9dc0154850 0x7f9dc0154cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:46.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.670+0000 7f9dc5800640 1 -- 172.21.15.152:0/2130659259 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dc01f7ba0 con 0x7f9da8004d50 2024-04-17T08:46:46.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.670+0000 7f9dc4e00640 1 --2- 172.21.15.152:0/2130659259 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9dc00b2d80 0x7f9dc015ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:46:46.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.670+0000 7f9dc6200640 1 --2- 172.21.15.152:0/2130659259 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9dc0154850 0x7f9dc0154cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:46:46.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.674+0000 7f9dc5800640 1 --2- 172.21.15.152:0/2130659259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9da8004d50 0x7f9dc00b5a80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9db4007a00 tx=0x7f9db40115c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:46.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.674+0000 7f9dbd600640 1 -- 172.21.15.152:0/2130659259 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db401c070 con 0x7f9da8004d50 2024-04-17T08:46:46.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.674+0000 7f9dbd600640 1 -- 172.21.15.152:0/2130659259 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9db4004db0 con 0x7f9da8004d50 2024-04-17T08:46:46.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.674+0000 7f9dc8200640 1 -- 172.21.15.152:0/2130659259 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dc01f7e80 con 0x7f9da8004d50 2024-04-17T08:46:46.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.674+0000 7f9dbd600640 1 -- 172.21.15.152:0/2130659259 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db4010040 con 0x7f9da8004d50 2024-04-17T08:46:46.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.674+0000 7f9dc8200640 1 -- 172.21.15.152:0/2130659259 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dc01f8440 con 0x7f9da8004d50 2024-04-17T08:46:46.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.674+0000 7f9dc8200640 1 -- 172.21.15.152:0/2130659259 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dc0068a30 con 0x7f9da8004d50 2024-04-17T08:46:46.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.674+0000 7f9dbd600640 1 -- 172.21.15.152:0/2130659259 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9db401f070 con 0x7f9da8004d50 2024-04-17T08:46:46.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.674+0000 7f9dbd600640 1 --2- 172.21.15.152:0/2130659259 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9da0068380 0x7f9da006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:46.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.674+0000 7f9dbd600640 1 -- 172.21.15.152:0/2130659259 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9db408a210 con 0x7f9da8004d50 2024-04-17T08:46:46.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.674+0000 7f9dc4e00640 1 --2- 172.21.15.152:0/2130659259 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9da0068380 0x7f9da006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:46.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.678+0000 7f9dc4e00640 1 --2- 172.21.15.152:0/2130659259 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9da0068380 0x7f9da006a840 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9dc00b82b0 tx=0x7f9dac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:46.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.678+0000 7f9dbd600640 1 -- 172.21.15.152:0/2130659259 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f9db405a480 con 0x7f9da8004d50 2024-04-17T08:46:46.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.838+0000 7f9dc8200640 1 -- 172.21.15.152:0/2130659259 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f9dc015d8f0 con 0x7f9da8004d50 2024-04-17T08:46:46.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.838+0000 7f9dbd600640 1 -- 172.21.15.152:0/2130659259 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) ==== 103+0+11 (secure 0 0 0) 0x7f9db4059d80 con 0x7f9da8004d50 2024-04-17T08:46:46.840 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-04-17T08:46:46.842 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.838+0000 7f9dc8200640 1 -- 172.21.15.152:0/2130659259 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9da0068380 msgr2=0x7f9da006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:46.842 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.838+0000 7f9dc8200640 1 --2- 172.21.15.152:0/2130659259 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9da0068380 0x7f9da006a840 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9dc00b82b0 tx=0x7f9dac008040 comp rx=0 tx=0).stop 2024-04-17T08:46:46.842 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.842+0000 7f9dc8200640 1 -- 172.21.15.152:0/2130659259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9da8004d50 msgr2=0x7f9dc00b5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:46.842 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.842+0000 7f9dc8200640 1 --2- 172.21.15.152:0/2130659259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9da8004d50 0x7f9dc00b5a80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9db4007a00 tx=0x7f9db40115c0 comp rx=0 tx=0).stop 2024-04-17T08:46:46.842 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.842+0000 7f9dc8200640 1 -- 172.21.15.152:0/2130659259 shutdown_connections 2024-04-17T08:46:46.842 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.842+0000 7f9dc8200640 1 --2- 172.21.15.152:0/2130659259 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9dc0154850 0x7f9dc0154cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:46.842 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.842+0000 7f9dc8200640 1 --2- 172.21.15.152:0/2130659259 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9da0068380 0x7f9da006a840 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:46.842 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.842+0000 7f9dc8200640 1 --2- 172.21.15.152:0/2130659259 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9dc00b2d80 0x7f9dc015ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:46.842 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.842+0000 7f9dc8200640 1 --2- 172.21.15.152:0/2130659259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9da8004d50 0x7f9dc00b5a80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:46.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.842+0000 7f9dc8200640 1 -- 172.21.15.152:0/2130659259 >> 172.21.15.152:0/2130659259 conn(0x7f9dc00cee40 msgr2=0x7f9dc015a590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:46.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.842+0000 7f9dc8200640 1 -- 172.21.15.152:0/2130659259 shutdown_connections 2024-04-17T08:46:46.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.842+0000 7f9dc8200640 1 -- 172.21.15.152:0/2130659259 wait complete. 2024-04-17T08:46:46.861 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-17T08:46:46.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.994+0000 7f3af5e00640 1 Processor -- start 2024-04-17T08:46:46.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.994+0000 7f3af5e00640 1 -- start start 2024-04-17T08:46:46.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.994+0000 7f3af5e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f3af00d0a70 0x7f3af0160010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:46.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.994+0000 7f3af5e00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3af0160d20 con 0x7f3af015a010 2024-04-17T08:46:46.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.994+0000 7f3af5e00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3af015cc30 con 0x7f3af015d710 2024-04-17T08:46:46.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.994+0000 7f3af5e00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f3af015d280 con 0x7f3af00d0a70 2024-04-17T08:46:46.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.994+0000 7f3aeea00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f3af015a010 0x7f3af00d0360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:56854/0 (socket says 172.21.15.152:56854) 2024-04-17T08:46:46.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.994+0000 7f3aeea00640 1 -- 172.21.15.152:0/240951581 learned_addr learned my addr 172.21.15.152:0/240951581 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:46:46.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.994+0000 7f3aee000640 1 --2- 172.21.15.152:0/240951581 >> v2:172.21.15.196:3300/0 conn(0x7f3af00d0a70 0x7f3af0160010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:46.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.994+0000 7f3aed600640 1 -- 172.21.15.152:0/240951581 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2545792690 0 0) 0x7f3af0160d20 con 0x7f3af015a010 2024-04-17T08:46:46.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.994+0000 7f3aed600640 1 -- 172.21.15.152:0/240951581 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ad4003530 con 0x7f3af015a010 2024-04-17T08:46:46.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.998+0000 7f3aed600640 1 -- 172.21.15.152:0/240951581 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2802180991 0 0) 0x7f3ad4003530 con 0x7f3af015a010 2024-04-17T08:46:46.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.998+0000 7f3aed600640 1 -- 172.21.15.152:0/240951581 >> v2:172.21.15.196:3300/0 conn(0x7f3af00d0a70 msgr2=0x7f3af0160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:46.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.998+0000 7f3aed600640 1 --2- 172.21.15.152:0/240951581 >> v2:172.21.15.196:3300/0 conn(0x7f3af00d0a70 0x7f3af0160010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:46.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.998+0000 7f3aed600640 1 -- 172.21.15.152:0/240951581 >> v1:172.21.15.196:6789/0 conn(0x7f3af015d710 legacy=0x7f3af0160550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:46.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.998+0000 7f3aed600640 1 -- 172.21.15.152:0/240951581 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3af015cf10 con 0x7f3af015a010 2024-04-17T08:46:46.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.998+0000 7f3aed600640 1 -- 172.21.15.152:0/240951581 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2973887244 0 0) 0x7f3ae0001a00 con 0x7f3af015a010 2024-04-17T08:46:46.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.998+0000 7f3aed600640 1 -- 172.21.15.152:0/240951581 >> v1:172.21.15.152:6789/0 conn(0x7f3af015a010 legacy=0x7f3af00d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:47.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.998+0000 7f3aed600640 1 --2- 172.21.15.152:0/240951581 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ad40039c0 0x7f3ad4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:47.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.998+0000 7f3aed600640 1 --2- 172.21.15.152:0/240951581 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3ad4004810 0x7f3ad4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:47.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.998+0000 7f3aed600640 1 --2- 172.21.15.152:0/240951581 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3ad40051d0 0x7f3ad400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:47.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.998+0000 7f3aed600640 1 -- 172.21.15.152:0/240951581 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3af015d280 con 0x7f3ad40039c0 2024-04-17T08:46:47.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.998+0000 7f3aed600640 1 -- 172.21.15.152:0/240951581 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad400c170 con 0x7f3ad40051d0 2024-04-17T08:46:47.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.998+0000 7f3aed600640 1 -- 172.21.15.152:0/240951581 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f3ad400c370 con 0x7f3ad4004810 2024-04-17T08:46:47.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.998+0000 7f3aeea00640 1 --2- 172.21.15.152:0/240951581 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ad40039c0 0x7f3ad4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:47.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.998+0000 7f3aee000640 1 --2- 172.21.15.152:0/240951581 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3ad4004810 0x7f3ad4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:47.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.998+0000 7f3aef400640 1 --2- 172.21.15.152:0/240951581 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3ad40051d0 0x7f3ad400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:47.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.998+0000 7f3aeea00640 1 -- 172.21.15.152:0/240951581 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3ad4004810 msgr2=0x7f3ad4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:47.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.998+0000 7f3aeea00640 1 --2- 172.21.15.152:0/240951581 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3ad4004810 0x7f3ad4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:47.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.998+0000 7f3aeea00640 1 -- 172.21.15.152:0/240951581 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3ad40051d0 msgr2=0x7f3ad400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:47.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.998+0000 7f3aeea00640 1 --2- 172.21.15.152:0/240951581 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3ad40051d0 0x7f3ad400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:47.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.998+0000 7f3aeea00640 1 -- 172.21.15.152:0/240951581 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ad4003530 con 0x7f3ad40039c0 2024-04-17T08:46:47.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.998+0000 7f3aef400640 1 -- 172.21.15.152:0/240951581 reap_dead start 2024-04-17T08:46:47.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.998+0000 7f3aeea00640 1 --2- 172.21.15.152:0/240951581 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ad40039c0 0x7f3ad4003de0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3ae000a840 tx=0x7f3ae001d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76eaeac2960b25f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:47.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.998+0000 7f3aed600640 1 -- 172.21.15.152:0/240951581 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae000a460 con 0x7f3ad40039c0 2024-04-17T08:46:47.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:46.998+0000 7f3aed600640 1 -- 172.21.15.152:0/240951581 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ae00ad650 con 0x7f3ad40039c0 2024-04-17T08:46:47.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.002+0000 7f3aed600640 1 -- 172.21.15.152:0/240951581 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae00ada80 con 0x7f3ad40039c0 2024-04-17T08:46:47.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.002+0000 7f3af5e00640 1 -- 172.21.15.152:0/240951581 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ad40039c0 msgr2=0x7f3ad4003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:47.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.002+0000 7f3af5e00640 1 --2- 172.21.15.152:0/240951581 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ad40039c0 0x7f3ad4003de0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3ae000a840 tx=0x7f3ae001d360 comp rx=0 tx=0).stop 2024-04-17T08:46:47.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.002+0000 7f3af5e00640 1 -- 172.21.15.152:0/240951581 shutdown_connections 2024-04-17T08:46:47.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.002+0000 7f3af5e00640 1 --2- 172.21.15.152:0/240951581 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ad40039c0 0x7f3ad4003de0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:47.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.002+0000 7f3af5e00640 1 -- 172.21.15.152:0/240951581 >> 172.21.15.152:0/240951581 conn(0x7f3af00b3350 msgr2=0x7f3af00b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:47.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.002+0000 7f3af5e00640 1 -- 172.21.15.152:0/240951581 shutdown_connections 2024-04-17T08:46:47.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.002+0000 7f3af5e00640 1 -- 172.21.15.152:0/240951581 wait complete. 2024-04-17T08:46:47.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.002+0000 7f3af5e00640 1 Processor -- start 2024-04-17T08:46:47.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.002+0000 7f3af5e00640 1 -- start start 2024-04-17T08:46:47.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.002+0000 7f3af5e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3ad40039c0 0x7f3af0155280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:47.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.002+0000 7f3af5e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3af01557c0 0x7f3af0151210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:47.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.002+0000 7f3af5e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3af0154910 0x7f3af00b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:47.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.002+0000 7f3af5e00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3af006b9b0 con 0x7f3af01557c0 2024-04-17T08:46:47.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.002+0000 7f3af5e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f3af0160a30 con 0x7f3af0154910 2024-04-17T08:46:47.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.002+0000 7f3af5e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f3af006bb30 con 0x7f3ad40039c0 2024-04-17T08:46:47.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.002+0000 7f3aee000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3af01557c0 0x7f3af0151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:47.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.002+0000 7f3aee000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3af01557c0 0x7f3af0151210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35732/0 (socket says 172.21.15.152:35732) 2024-04-17T08:46:47.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.002+0000 7f3aee000640 1 -- 172.21.15.152:0/369449784 learned_addr learned my addr 172.21.15.152:0/369449784 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:47.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.002+0000 7f3aef400640 1 --2- 172.21.15.152:0/369449784 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3af0154910 0x7f3af00b11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:47.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.002+0000 7f3aeea00640 1 --2- 172.21.15.152:0/369449784 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3ad40039c0 0x7f3af0155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:47.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.006+0000 7f3aee000640 1 -- 172.21.15.152:0/369449784 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3ad40039c0 msgr2=0x7f3af0155280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:47.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.006+0000 7f3aee000640 1 --2- 172.21.15.152:0/369449784 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3ad40039c0 0x7f3af0155280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:47.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.006+0000 7f3aee000640 1 -- 172.21.15.152:0/369449784 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3af0154910 msgr2=0x7f3af00b11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:47.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.006+0000 7f3aee000640 1 --2- 172.21.15.152:0/369449784 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3af0154910 0x7f3af00b11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:47.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.006+0000 7f3aee000640 1 -- 172.21.15.152:0/369449784 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3af00b01a0 con 0x7f3af01557c0 2024-04-17T08:46:47.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.006+0000 7f3aee000640 1 --2- 172.21.15.152:0/369449784 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3af01557c0 0x7f3af0151210 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3adc011930 tx=0x7f3adc011df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:47.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.006+0000 7f3ae7400640 1 -- 172.21.15.152:0/369449784 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3adc019070 con 0x7f3af01557c0 2024-04-17T08:46:47.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.006+0000 7f3ae7400640 1 -- 172.21.15.152:0/369449784 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3adc004240 con 0x7f3af01557c0 2024-04-17T08:46:47.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.006+0000 7f3af5e00640 1 -- 172.21.15.152:0/369449784 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3af00b0420 con 0x7f3af01557c0 2024-04-17T08:46:47.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.006+0000 7f3ae7400640 1 -- 172.21.15.152:0/369449784 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3adc0095b0 con 0x7f3af01557c0 2024-04-17T08:46:47.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.006+0000 7f3af5e00640 1 -- 172.21.15.152:0/369449784 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3af00b09e0 con 0x7f3af01557c0 2024-04-17T08:46:47.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.006+0000 7f3af5e00640 1 -- 172.21.15.152:0/369449784 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3af0068a30 con 0x7f3af01557c0 2024-04-17T08:46:47.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.006+0000 7f3ae7400640 1 -- 172.21.15.152:0/369449784 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3adc01c070 con 0x7f3af01557c0 2024-04-17T08:46:47.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.010+0000 7f3ae7400640 1 --2- 172.21.15.152:0/369449784 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3ad0068380 0x7f3ad006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:47.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.010+0000 7f3ae7400640 1 -- 172.21.15.152:0/369449784 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f3adc0873a0 con 0x7f3af01557c0 2024-04-17T08:46:47.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.010+0000 7f3aeea00640 1 --2- 172.21.15.152:0/369449784 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3ad0068380 0x7f3ad006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:47.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.010+0000 7f3aeea00640 1 --2- 172.21.15.152:0/369449784 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3ad0068380 0x7f3ad006a840 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3ae00ad000 tx=0x7f3af015ce00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:47.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.014+0000 7f3ae7400640 1 -- 172.21.15.152:0/369449784 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f3af00b01a0 con 0x7f3af01557c0 2024-04-17T08:46:47.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.186+0000 7f3af5e00640 1 -- 172.21.15.152:0/369449784 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3af015bdc0 con 0x7f3af01557c0 2024-04-17T08:46:47.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.186+0000 7f3ae7400640 1 -- 172.21.15.152:0/369449784 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f3adc056f30 con 0x7f3af01557c0 2024-04-17T08:46:47.186 INFO:teuthology.orchestra.run.smithi152.stderr:listed 0 entries 2024-04-17T08:46:47.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.186+0000 7f3af5e00640 1 -- 172.21.15.152:0/369449784 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3ad0068380 msgr2=0x7f3ad006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:47.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.186+0000 7f3af5e00640 1 --2- 172.21.15.152:0/369449784 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3ad0068380 0x7f3ad006a840 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3ae00ad000 tx=0x7f3af015ce00 comp rx=0 tx=0).stop 2024-04-17T08:46:47.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.186+0000 7f3af5e00640 1 -- 172.21.15.152:0/369449784 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3af01557c0 msgr2=0x7f3af0151210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:47.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.186+0000 7f3af5e00640 1 --2- 172.21.15.152:0/369449784 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3af01557c0 0x7f3af0151210 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3adc011930 tx=0x7f3adc011df0 comp rx=0 tx=0).stop 2024-04-17T08:46:47.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.186+0000 7f3af5e00640 1 -- 172.21.15.152:0/369449784 shutdown_connections 2024-04-17T08:46:47.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.186+0000 7f3af5e00640 1 --2- 172.21.15.152:0/369449784 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3af0154910 0x7f3af00b11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:47.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.186+0000 7f3af5e00640 1 --2- 172.21.15.152:0/369449784 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3af01557c0 0x7f3af0151210 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:47.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.186+0000 7f3af5e00640 1 --2- 172.21.15.152:0/369449784 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3ad0068380 0x7f3ad006a840 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:47.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.186+0000 7f3af5e00640 1 --2- 172.21.15.152:0/369449784 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3ad40039c0 0x7f3af0155280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:47.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.186+0000 7f3af5e00640 1 -- 172.21.15.152:0/369449784 >> 172.21.15.152:0/369449784 conn(0x7f3af00b3350 msgr2=0x7f3af015f140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:47.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.186+0000 7f3af5e00640 1 -- 172.21.15.152:0/369449784 shutdown_connections 2024-04-17T08:46:47.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.186+0000 7f3af5e00640 1 -- 172.21.15.152:0/369449784 wait complete. 2024-04-17T08:46:47.208 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-17T08:46:47.208 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-17T08:46:47.217 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T08:46:47.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.390+0000 7fbb62800640 1 Processor -- start 2024-04-17T08:46:47.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.390+0000 7fbb62800640 1 -- start start 2024-04-17T08:46:47.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.390+0000 7fbb62800640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fbb5c15a010 0x7fbb5c0d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:47.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.390+0000 7fbb62800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fbb5c160720 0x7fbb5c0d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:47.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.390+0000 7fbb62800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb5c160d20 con 0x7fbb5c15d710 2024-04-17T08:46:47.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.390+0000 7fbb62800640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fbb5c15d280 con 0x7fbb5c15a010 2024-04-17T08:46:47.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.390+0000 7fbb62800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fbb5c15c9d0 con 0x7fbb5c160720 2024-04-17T08:46:47.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.394+0000 7fbb5b400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fbb5c15a010 0x7fbb5c0d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:47.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.394+0000 7fbb5b400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fbb5c15a010 0x7fbb5c0d0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35742/0 (socket says 172.21.15.152:35742) 2024-04-17T08:46:47.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.394+0000 7fbb5b400640 1 -- 172.21.15.152:0/3211679661 learned_addr learned my addr 172.21.15.152:0/3211679661 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:47.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.394+0000 7fbb5be00640 1 --2- 172.21.15.152:0/3211679661 >> v2:172.21.15.196:3300/0 conn(0x7fbb5c160720 0x7fbb5c0d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:47.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.394+0000 7fbb5b400640 1 -- 172.21.15.152:0/3211679661 >> v2:172.21.15.196:3300/0 conn(0x7fbb5c160720 msgr2=0x7fbb5c0d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:47.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.394+0000 7fbb5b400640 1 --2- 172.21.15.152:0/3211679661 >> v2:172.21.15.196:3300/0 conn(0x7fbb5c160720 0x7fbb5c0d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:47.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.394+0000 7fbb5b400640 1 -- 172.21.15.152:0/3211679661 >> v1:172.21.15.196:6789/0 conn(0x7fbb5c15d710 legacy=0x7fbb5c160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:47.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.394+0000 7fbb5b400640 1 -- 172.21.15.152:0/3211679661 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb5c15cc30 con 0x7fbb5c15a010 2024-04-17T08:46:47.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.394+0000 7fbb5be00640 1 --2- 172.21.15.152:0/3211679661 >> v2:172.21.15.196:3300/0 conn(0x7fbb5c160720 0x7fbb5c0d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:46:47.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.394+0000 7fbb5b400640 1 --2- 172.21.15.152:0/3211679661 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb5c15a010 0x7fbb5c0d0360 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c0b41a0 tx=0x7fbb4c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81c3cfc4b5edecf3 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:47.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.394+0000 7fbb5aa00640 1 -- 172.21.15.152:0/3211679661 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c0b1070 con 0x7fbb5c15a010 2024-04-17T08:46:47.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.394+0000 7fbb5aa00640 1 -- 172.21.15.152:0/3211679661 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb4c0ac600 con 0x7fbb5c15a010 2024-04-17T08:46:47.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.394+0000 7fbb5aa00640 1 -- 172.21.15.152:0/3211679661 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c0ac9d0 con 0x7fbb5c15a010 2024-04-17T08:46:47.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.398+0000 7fbb62800640 1 -- 172.21.15.152:0/3211679661 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb5c15a010 msgr2=0x7fbb5c0d0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:47.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.398+0000 7fbb62800640 1 --2- 172.21.15.152:0/3211679661 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb5c15a010 0x7fbb5c0d0360 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c0b41a0 tx=0x7fbb4c01c490 comp rx=0 tx=0).stop 2024-04-17T08:46:47.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.398+0000 7fbb62800640 1 -- 172.21.15.152:0/3211679661 shutdown_connections 2024-04-17T08:46:47.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.398+0000 7fbb62800640 1 --2- 172.21.15.152:0/3211679661 >> v2:172.21.15.196:3300/0 conn(0x7fbb5c160720 0x7fbb5c0d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:47.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.398+0000 7fbb62800640 1 --2- 172.21.15.152:0/3211679661 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb5c15a010 0x7fbb5c0d0360 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:47.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.398+0000 7fbb62800640 1 -- 172.21.15.152:0/3211679661 >> 172.21.15.152:0/3211679661 conn(0x7fbb5c0b3350 msgr2=0x7fbb5c0b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:47.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.398+0000 7fbb62800640 1 -- 172.21.15.152:0/3211679661 shutdown_connections 2024-04-17T08:46:47.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.398+0000 7fbb62800640 1 -- 172.21.15.152:0/3211679661 wait complete. 2024-04-17T08:46:47.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.398+0000 7fbb62800640 1 Processor -- start 2024-04-17T08:46:47.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.398+0000 7fbb62800640 1 -- start start 2024-04-17T08:46:47.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.398+0000 7fbb62800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb5c15a010 0x7fbb5c099520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:47.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.398+0000 7fbb62800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbb5c15d710 0x7fbb5c099a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:47.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.398+0000 7fbb62800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb5c160720 0x7fbb5c153ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:47.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.398+0000 7fbb62800640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5c15e780 con 0x7fbb5c15a010 2024-04-17T08:46:47.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.398+0000 7fbb62800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5c15e600 con 0x7fbb5c15d710 2024-04-17T08:46:47.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.398+0000 7fbb62800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fbb5c15e900 con 0x7fbb5c160720 2024-04-17T08:46:47.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.398+0000 7fbb5b400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb5c15a010 0x7fbb5c099520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:47.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.398+0000 7fbb5b400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb5c15a010 0x7fbb5c099520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35746/0 (socket says 172.21.15.152:35746) 2024-04-17T08:46:47.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.398+0000 7fbb5b400640 1 -- 172.21.15.152:0/1081275546 learned_addr learned my addr 172.21.15.152:0/1081275546 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:47.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.398+0000 7fbb5b400640 1 -- 172.21.15.152:0/1081275546 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb5c160720 msgr2=0x7fbb5c153ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:47.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.398+0000 7fbb5b400640 1 --2- 172.21.15.152:0/1081275546 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb5c160720 0x7fbb5c153ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:47.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.398+0000 7fbb5b400640 1 -- 172.21.15.152:0/1081275546 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbb5c15d710 msgr2=0x7fbb5c099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:47.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.398+0000 7fbb5b400640 1 --2- 172.21.15.152:0/1081275546 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbb5c15d710 0x7fbb5c099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:47.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.398+0000 7fbb5b400640 1 -- 172.21.15.152:0/1081275546 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb5c166990 con 0x7fbb5c15a010 2024-04-17T08:46:47.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.402+0000 7fbb5b400640 1 --2- 172.21.15.152:0/1081275546 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb5c15a010 0x7fbb5c099520 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c0190a0 tx=0x7fbb4c01acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:47.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.402+0000 7fbb53e00640 1 -- 172.21.15.152:0/1081275546 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c0bb020 con 0x7fbb5c15a010 2024-04-17T08:46:47.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.402+0000 7fbb53e00640 1 -- 172.21.15.152:0/1081275546 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb4c0b7620 con 0x7fbb5c15a010 2024-04-17T08:46:47.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.402+0000 7fbb53e00640 1 -- 172.21.15.152:0/1081275546 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c0b1040 con 0x7fbb5c15a010 2024-04-17T08:46:47.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.402+0000 7fbb62800640 1 -- 172.21.15.152:0/1081275546 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb5c06f580 con 0x7fbb5c15a010 2024-04-17T08:46:47.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.402+0000 7fbb62800640 1 -- 172.21.15.152:0/1081275546 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb5c1564b0 con 0x7fbb5c15a010 2024-04-17T08:46:47.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.402+0000 7fbb62800640 1 -- 172.21.15.152:0/1081275546 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb5c068a30 con 0x7fbb5c15a010 2024-04-17T08:46:47.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.402+0000 7fbb53e00640 1 -- 172.21.15.152:0/1081275546 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbb4c0be020 con 0x7fbb5c15a010 2024-04-17T08:46:47.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.402+0000 7fbb53e00640 1 --2- 172.21.15.152:0/1081275546 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fbb38068380 0x7fbb3806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:47.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.402+0000 7fbb53e00640 1 -- 172.21.15.152:0/1081275546 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fbb4c120c40 con 0x7fbb5c15a010 2024-04-17T08:46:47.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.402+0000 7fbb52a00640 1 --2- 172.21.15.152:0/1081275546 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fbb38068380 0x7fbb3806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:47.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.406+0000 7fbb52a00640 1 --2- 172.21.15.152:0/1081275546 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fbb38068380 0x7fbb3806a840 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbb44000f70 tx=0x7fbb440079e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:47.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.406+0000 7fbb53e00640 1 -- 172.21.15.152:0/1081275546 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fbb4c0c5070 con 0x7fbb5c15a010 2024-04-17T08:46:47.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.566+0000 7fbb62800640 1 -- 172.21.15.152:0/1081275546 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbb5c069330 con 0x7fbb5c15a010 2024-04-17T08:46:47.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.570+0000 7fbb53e00640 1 -- 172.21.15.152:0/1081275546 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7fbb4c016110 con 0x7fbb5c15a010 2024-04-17T08:46:47.570 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:46:47.570 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":24,"fsid":"ce68f82e-ec5f-4205-9fd5-bdfdf6ef31e2","created":"2024-04-17T08:46:08.353546+0000","modified":"2024-04-17T08:46:38.659862+0000","last_up_change":"2024-04-17T08:46:20.738799+0000","last_in_change":"2024-04-17T08:46:11.210050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T08:46:21.386856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T08:46:31.812460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T08:46:32.555559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T08:46:36.258078+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"682f0192-187c-404e-bc7a-b6b4e23825e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6819","nonce":3603799291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6823","nonce":3603799291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6831","nonce":3603799291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6827","nonce":3603799291}]},"public_addr":"172.21.15.152:6819/3603799291","cluster_addr":"172.21.15.152:6823/3603799291","heartbeat_back_addr":"172.21.15.152:6831/3603799291","heartbeat_front_addr":"172.21.15.152:6827/3603799291","state":["exists","up"]},{"osd":1,"uuid":"f0fe8fef-60ec-4a39-83b6-2fa6a5adb0f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6801","nonce":4133383142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6803","nonce":4133383142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6807","nonce":4133383142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6805","nonce":4133383142}]},"public_addr":"172.21.15.152:6801/4133383142","cluster_addr":"172.21.15.152:6803/4133383142","heartbeat_back_addr":"172.21.15.152:6807/4133383142","heartbeat_front_addr":"172.21.15.152:6805/4133383142","state":["exists","up"]},{"osd":2,"uuid":"35f36d9c-5245-4431-a618-f4df0fa380ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6809","nonce":3826143898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6811","nonce":3826143898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6815","nonce":3826143898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6813","nonce":3826143898}]},"public_addr":"172.21.15.152:6809/3826143898","cluster_addr":"172.21.15.152:6811/3826143898","heartbeat_back_addr":"172.21.15.152:6815/3826143898","heartbeat_front_addr":"172.21.15.152:6813/3826143898","state":["exists","up"]},{"osd":3,"uuid":"96e56ca5-15b4-4895-9b79-da2c92043159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6818","nonce":165717826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6822","nonce":165717826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6830","nonce":165717826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6826","nonce":165717826}]},"public_addr":"172.21.15.152:6818/165717826","cluster_addr":"172.21.15.152:6822/165717826","heartbeat_back_addr":"172.21.15.152:6830/165717826","heartbeat_front_addr":"172.21.15.152:6826/165717826","state":["exists","up"]},{"osd":4,"uuid":"f5aa10a4-9ff9-41fe-a5c9-15326f982cc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6817","nonce":4080159297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6819","nonce":4080159297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6823","nonce":4080159297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6821","nonce":4080159297}]},"public_addr":"172.21.15.196:6817/4080159297","cluster_addr":"172.21.15.196:6819/4080159297","heartbeat_back_addr":"172.21.15.196:6823/4080159297","heartbeat_front_addr":"172.21.15.196:6821/4080159297","state":["exists","up"]},{"osd":5,"uuid":"42bab884-3476-47ae-ac65-935fa6e0f055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6801","nonce":3519444232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6803","nonce":3519444232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6807","nonce":3519444232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6805","nonce":3519444232}]},"public_addr":"172.21.15.196:6801/3519444232","cluster_addr":"172.21.15.196:6803/3519444232","heartbeat_back_addr":"172.21.15.196:6807/3519444232","heartbeat_front_addr":"172.21.15.196:6805/3519444232","state":["exists","up"]},{"osd":6,"uuid":"460b6167-f57b-4224-9c92-cfc9b80bbe99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6809","nonce":275739834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6811","nonce":275739834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6815","nonce":275739834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6813","nonce":275739834}]},"public_addr":"172.21.15.196:6809/275739834","cluster_addr":"172.21.15.196:6811/275739834","heartbeat_back_addr":"172.21.15.196:6815/275739834","heartbeat_front_addr":"172.21.15.196:6813/275739834","state":["exists","up"]},{"osd":7,"uuid":"d695643f-5e07-4e2a-a646-c06bd97b6650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6825","nonce":307626968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6827","nonce":307626968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6831","nonce":307626968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6829","nonce":307626968}]},"public_addr":"172.21.15.196:6825/307626968","cluster_addr":"172.21.15.196:6827/307626968","heartbeat_back_addr":"172.21.15.196:6831/307626968","heartbeat_front_addr":"172.21.15.196:6829/307626968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.293257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.964533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.248895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.010000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.832554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.743704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930171+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930962+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T08:46:47.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.570+0000 7fbb62800640 1 -- 172.21.15.152:0/1081275546 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fbb38068380 msgr2=0x7fbb3806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:47.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.570+0000 7fbb62800640 1 --2- 172.21.15.152:0/1081275546 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fbb38068380 0x7fbb3806a840 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbb44000f70 tx=0x7fbb440079e0 comp rx=0 tx=0).stop 2024-04-17T08:46:47.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.570+0000 7fbb62800640 1 -- 172.21.15.152:0/1081275546 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb5c15a010 msgr2=0x7fbb5c099520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:47.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.570+0000 7fbb62800640 1 --2- 172.21.15.152:0/1081275546 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb5c15a010 0x7fbb5c099520 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c0190a0 tx=0x7fbb4c01acd0 comp rx=0 tx=0).stop 2024-04-17T08:46:47.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.570+0000 7fbb62800640 1 -- 172.21.15.152:0/1081275546 shutdown_connections 2024-04-17T08:46:47.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.570+0000 7fbb62800640 1 --2- 172.21.15.152:0/1081275546 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fbb38068380 0x7fbb3806a840 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:47.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.570+0000 7fbb62800640 1 --2- 172.21.15.152:0/1081275546 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb5c160720 0x7fbb5c153ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:47.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.570+0000 7fbb62800640 1 --2- 172.21.15.152:0/1081275546 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbb5c15d710 0x7fbb5c099a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:47.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.570+0000 7fbb62800640 1 --2- 172.21.15.152:0/1081275546 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb5c15a010 0x7fbb5c099520 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:47.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.570+0000 7fbb62800640 1 -- 172.21.15.152:0/1081275546 >> 172.21.15.152:0/1081275546 conn(0x7fbb5c0b3350 msgr2=0x7fbb5c15f380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:47.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.570+0000 7fbb62800640 1 -- 172.21.15.152:0/1081275546 shutdown_connections 2024-04-17T08:46:47.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.570+0000 7fbb62800640 1 -- 172.21.15.152:0/1081275546 wait complete. 2024-04-17T08:46:47.591 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T08:46:21.386856+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-17T08:46:31.812460+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-17T08:46:32.555559+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-17T08:46:36.258078+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-17T08:46:47.592 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T08:46:47.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.726+0000 7ff5dfc00640 1 Processor -- start 2024-04-17T08:46:47.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.726+0000 7ff5dfc00640 1 -- start start 2024-04-17T08:46:47.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.730+0000 7ff5dfc00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ff5d80d0360 0x7ff5d80d07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:47.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.730+0000 7ff5dfc00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff5d80ad3d0 0x7ff5d80ad820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:47.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.730+0000 7ff5dfc00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5d806e6b0 con 0x7ff5d8161b70 2024-04-17T08:46:47.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.730+0000 7ff5dfc00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7ff5d80d0d00 con 0x7ff5d80ad3d0 2024-04-17T08:46:47.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.730+0000 7ff5dfc00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7ff5d8161f50 con 0x7ff5d80d0360 2024-04-17T08:46:47.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.730+0000 7ff5ddc00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff5d80ad3d0 0x7ff5d80ad820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:47.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.730+0000 7ff5ddc00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff5d80ad3d0 0x7ff5d80ad820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35758/0 (socket says 172.21.15.152:35758) 2024-04-17T08:46:47.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.730+0000 7ff5ddc00640 1 -- 172.21.15.152:0/1637809525 learned_addr learned my addr 172.21.15.152:0/1637809525 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:47.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.730+0000 7ff5d7e00640 1 --2- 172.21.15.152:0/1637809525 >> v2:172.21.15.196:3300/0 conn(0x7ff5d80d0360 0x7ff5d80d07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:47.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.730+0000 7ff5ddc00640 1 -- 172.21.15.152:0/1637809525 >> v2:172.21.15.196:3300/0 conn(0x7ff5d80d0360 msgr2=0x7ff5d80d07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:47.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.730+0000 7ff5ddc00640 1 --2- 172.21.15.152:0/1637809525 >> v2:172.21.15.196:3300/0 conn(0x7ff5d80d0360 0x7ff5d80d07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:47.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.730+0000 7ff5ddc00640 1 -- 172.21.15.152:0/1637809525 >> v1:172.21.15.196:6789/0 conn(0x7ff5d8161b70 legacy=0x7ff5d806dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:47.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.730+0000 7ff5ddc00640 1 -- 172.21.15.152:0/1637809525 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5d806e990 con 0x7ff5d80ad3d0 2024-04-17T08:46:47.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.734+0000 7ff5ddc00640 1 --2- 172.21.15.152:0/1637809525 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5d80ad3d0 0x7ff5d80ad820 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff5d80d0eb0 tx=0x7ff5d001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e137653272cf8f9a server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:47.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.734+0000 7ff5d7400640 1 -- 172.21.15.152:0/1637809525 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d00a5710 con 0x7ff5d80ad3d0 2024-04-17T08:46:47.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.734+0000 7ff5d7400640 1 -- 172.21.15.152:0/1637809525 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5d00a58b0 con 0x7ff5d80ad3d0 2024-04-17T08:46:47.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.734+0000 7ff5d7400640 1 -- 172.21.15.152:0/1637809525 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d00a5c80 con 0x7ff5d80ad3d0 2024-04-17T08:46:47.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.734+0000 7ff5dfc00640 1 -- 172.21.15.152:0/1637809525 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5d80ad3d0 msgr2=0x7ff5d80ad820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:47.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.734+0000 7ff5dfc00640 1 --2- 172.21.15.152:0/1637809525 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5d80ad3d0 0x7ff5d80ad820 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff5d80d0eb0 tx=0x7ff5d001c960 comp rx=0 tx=0).stop 2024-04-17T08:46:47.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.734+0000 7ff5dfc00640 1 -- 172.21.15.152:0/1637809525 shutdown_connections 2024-04-17T08:46:47.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.734+0000 7ff5dfc00640 1 --2- 172.21.15.152:0/1637809525 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5d80ad3d0 0x7ff5d80ad820 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:47.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.734+0000 7ff5dfc00640 1 --2- 172.21.15.152:0/1637809525 >> v2:172.21.15.196:3300/0 conn(0x7ff5d80d0360 0x7ff5d80d07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:47.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.734+0000 7ff5dfc00640 1 -- 172.21.15.152:0/1637809525 >> 172.21.15.152:0/1637809525 conn(0x7ff5d80b3350 msgr2=0x7ff5d80b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:47.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.734+0000 7ff5dfc00640 1 -- 172.21.15.152:0/1637809525 shutdown_connections 2024-04-17T08:46:47.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.734+0000 7ff5dfc00640 1 -- 172.21.15.152:0/1637809525 wait complete. 2024-04-17T08:46:47.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.734+0000 7ff5dfc00640 1 Processor -- start 2024-04-17T08:46:47.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.734+0000 7ff5dfc00640 1 -- start start 2024-04-17T08:46:47.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.734+0000 7ff5dfc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5d80ad3d0 0x7ff5d814aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:47.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.734+0000 7ff5dfc00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5d80d0360 0x7ff5d814b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:47.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.734+0000 7ff5dfc00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5d8161b70 0x7ff5d814bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:47.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.734+0000 7ff5dfc00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d8071ef0 con 0x7ff5d8161b70 2024-04-17T08:46:47.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.734+0000 7ff5dfc00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d8071d70 con 0x7ff5d80d0360 2024-04-17T08:46:47.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.734+0000 7ff5dfc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7ff5d816b1c0 con 0x7ff5d80ad3d0 2024-04-17T08:46:47.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.734+0000 7ff5ddc00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5d8161b70 0x7ff5d814bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:47.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.734+0000 7ff5ddc00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5d8161b70 0x7ff5d814bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35770/0 (socket says 172.21.15.152:35770) 2024-04-17T08:46:47.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.734+0000 7ff5ddc00640 1 -- 172.21.15.152:0/1884266993 learned_addr learned my addr 172.21.15.152:0/1884266993 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:47.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.734+0000 7ff5dd200640 1 --2- 172.21.15.152:0/1884266993 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5d80ad3d0 0x7ff5d814aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:47.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.734+0000 7ff5d7e00640 1 --2- 172.21.15.152:0/1884266993 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5d80d0360 0x7ff5d814b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:47.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.738+0000 7ff5ddc00640 1 -- 172.21.15.152:0/1884266993 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5d80ad3d0 msgr2=0x7ff5d814aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:47.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.738+0000 7ff5ddc00640 1 --2- 172.21.15.152:0/1884266993 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5d80ad3d0 0x7ff5d814aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:47.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.738+0000 7ff5ddc00640 1 -- 172.21.15.152:0/1884266993 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5d80d0360 msgr2=0x7ff5d814b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:47.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.738+0000 7ff5ddc00640 1 --2- 172.21.15.152:0/1884266993 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5d80d0360 0x7ff5d814b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:47.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.738+0000 7ff5ddc00640 1 -- 172.21.15.152:0/1884266993 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5d814cb00 con 0x7ff5d8161b70 2024-04-17T08:46:47.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.738+0000 7ff5ddc00640 1 --2- 172.21.15.152:0/1884266993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5d8161b70 0x7ff5d814bd00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff5d00af040 tx=0x7ff5d0019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:47.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.738+0000 7ff5d4c00640 1 -- 172.21.15.152:0/1884266993 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d00bc020 con 0x7ff5d8161b70 2024-04-17T08:46:47.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.738+0000 7ff5d4c00640 1 -- 172.21.15.152:0/1884266993 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5d00b8670 con 0x7ff5d8161b70 2024-04-17T08:46:47.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.738+0000 7ff5dfc00640 1 -- 172.21.15.152:0/1884266993 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5d815bdd0 con 0x7ff5d8161b70 2024-04-17T08:46:47.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.738+0000 7ff5d4c00640 1 -- 172.21.15.152:0/1884266993 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d0009510 con 0x7ff5d8161b70 2024-04-17T08:46:47.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.738+0000 7ff5dfc00640 1 -- 172.21.15.152:0/1884266993 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5d815c390 con 0x7ff5d8161b70 2024-04-17T08:46:47.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.738+0000 7ff5dfc00640 1 -- 172.21.15.152:0/1884266993 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5d8068a30 con 0x7ff5d8161b70 2024-04-17T08:46:47.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.738+0000 7ff5d4c00640 1 -- 172.21.15.152:0/1884266993 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff5d00bf020 con 0x7ff5d8161b70 2024-04-17T08:46:47.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.738+0000 7ff5d4c00640 1 --2- 172.21.15.152:0/1884266993 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7ff5b8068380 0x7ff5b806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:47.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.738+0000 7ff5d4c00640 1 -- 172.21.15.152:0/1884266993 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff5d0121bb0 con 0x7ff5d8161b70 2024-04-17T08:46:47.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.738+0000 7ff5dd200640 1 --2- 172.21.15.152:0/1884266993 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7ff5b8068380 0x7ff5b806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:47.742 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.742+0000 7ff5dd200640 1 --2- 172.21.15.152:0/1884266993 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7ff5b8068380 0x7ff5b806a840 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff5c8001810 tx=0x7ff5c8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:47.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.742+0000 7ff5d4c00640 1 -- 172.21.15.152:0/1884266993 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7ff5d00c6030 con 0x7ff5d8161b70 2024-04-17T08:46:47.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.902+0000 7ff5dfc00640 1 -- 172.21.15.152:0/1884266993 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff5d8069140 con 0x7ff5d8161b70 2024-04-17T08:46:47.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.902+0000 7ff5d4c00640 1 -- 172.21.15.152:0/1884266993 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7ff5d814cb00 con 0x7ff5d8161b70 2024-04-17T08:46:47.902 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2024-04-17T08:46:47.904 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.902+0000 7ff5dfc00640 1 -- 172.21.15.152:0/1884266993 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7ff5b8068380 msgr2=0x7ff5b806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:47.904 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.902+0000 7ff5dfc00640 1 --2- 172.21.15.152:0/1884266993 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7ff5b8068380 0x7ff5b806a840 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff5c8001810 tx=0x7ff5c8009040 comp rx=0 tx=0).stop 2024-04-17T08:46:47.904 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.902+0000 7ff5dfc00640 1 -- 172.21.15.152:0/1884266993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5d8161b70 msgr2=0x7ff5d814bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:47.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.902+0000 7ff5dfc00640 1 --2- 172.21.15.152:0/1884266993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5d8161b70 0x7ff5d814bd00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff5d00af040 tx=0x7ff5d0019700 comp rx=0 tx=0).stop 2024-04-17T08:46:47.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.902+0000 7ff5dfc00640 1 -- 172.21.15.152:0/1884266993 shutdown_connections 2024-04-17T08:46:47.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.902+0000 7ff5dfc00640 1 --2- 172.21.15.152:0/1884266993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5d8161b70 0x7ff5d814bd00 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:47.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.902+0000 7ff5dfc00640 1 --2- 172.21.15.152:0/1884266993 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5d80d0360 0x7ff5d814b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:47.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.902+0000 7ff5dfc00640 1 --2- 172.21.15.152:0/1884266993 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7ff5b8068380 0x7ff5b806a840 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:47.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.902+0000 7ff5dfc00640 1 --2- 172.21.15.152:0/1884266993 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5d80ad3d0 0x7ff5d814aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:47.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.902+0000 7ff5dfc00640 1 -- 172.21.15.152:0/1884266993 >> 172.21.15.152:0/1884266993 conn(0x7ff5d80b3350 msgr2=0x7ff5d815cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:47.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.902+0000 7ff5dfc00640 1 -- 172.21.15.152:0/1884266993 shutdown_connections 2024-04-17T08:46:47.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:47.902+0000 7ff5dfc00640 1 -- 172.21.15.152:0/1884266993 wait complete. 2024-04-17T08:46:47.925 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-17T08:46:48.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.062+0000 7f2fcb200640 1 Processor -- start 2024-04-17T08:46:48.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.062+0000 7f2fcb200640 1 -- start start 2024-04-17T08:46:48.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.062+0000 7f2fcb200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f2fc40c7230 0x7f2fc40c76c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:48.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.062+0000 7f2fcb200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2fc4071790 0x7f2fc4071c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:48.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.062+0000 7f2fcb200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fc40ccbb0 con 0x7f2fc4145ea0 2024-04-17T08:46:48.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.062+0000 7f2fcb200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f2fc40cce90 con 0x7f2fc40c7230 2024-04-17T08:46:48.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.062+0000 7f2fcb200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f2fc40cd170 con 0x7f2fc4071790 2024-04-17T08:46:48.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.062+0000 7f2fc9200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2fc4071790 0x7f2fc4071c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:48.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.066+0000 7f2fc3e00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f2fc4145ea0 0x7f2fc40d0250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.152:60958/0 (socket says 172.21.15.152:60958) 2024-04-17T08:46:48.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.066+0000 7f2fc3e00640 1 -- 172.21.15.152:0/2964333970 learned_addr learned my addr 172.21.15.152:0/2964333970 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:46:48.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.066+0000 7f2fbb400640 1 --2- 172.21.15.152:0/2964333970 >> v2:172.21.15.196:3300/0 conn(0x7f2fc40c7230 0x7f2fc40c76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:48.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.066+0000 7f2fc9200640 1 -- 172.21.15.152:0/2964333970 >> v2:172.21.15.196:3300/0 conn(0x7f2fc40c7230 msgr2=0x7f2fc40c76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:48.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.066+0000 7f2fc9200640 1 --2- 172.21.15.152:0/2964333970 >> v2:172.21.15.196:3300/0 conn(0x7f2fc40c7230 0x7f2fc40c76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:48.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.066+0000 7f2fc9200640 1 -- 172.21.15.152:0/2964333970 >> v1:172.21.15.196:6789/0 conn(0x7f2fc4145ea0 legacy=0x7f2fc40d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:48.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.066+0000 7f2fc9200640 1 -- 172.21.15.152:0/2964333970 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fc40cd450 con 0x7f2fc4071790 2024-04-17T08:46:48.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.066+0000 7f2fc3400640 1 -- 172.21.15.152:0/2964333970 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3710954459 0 0) 0x7f2fc40ccbb0 con 0x7f2fc4145ea0 2024-04-17T08:46:48.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.066+0000 7f2fc9200640 1 --2- 172.21.15.152:0/2964333970 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2fc4071790 0x7f2fc4071c20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc0097c0 tx=0x7f2fbc01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7387744135a6de2f server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:48.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.066+0000 7f2fc3400640 1 -- 172.21.15.152:0/2964333970 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc0b0070 con 0x7f2fc4071790 2024-04-17T08:46:48.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.066+0000 7f2fc3400640 1 -- 172.21.15.152:0/2964333970 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fbc0ab600 con 0x7f2fc4071790 2024-04-17T08:46:48.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.066+0000 7f2fc3400640 1 -- 172.21.15.152:0/2964333970 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc0ab9d0 con 0x7f2fc4071790 2024-04-17T08:46:48.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.070+0000 7f2fcb200640 1 -- 172.21.15.152:0/2964333970 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2fc4071790 msgr2=0x7f2fc4071c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:48.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.070+0000 7f2fcb200640 1 --2- 172.21.15.152:0/2964333970 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2fc4071790 0x7f2fc4071c20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc0097c0 tx=0x7f2fbc01c4a0 comp rx=0 tx=0).stop 2024-04-17T08:46:48.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.070+0000 7f2fcb200640 1 -- 172.21.15.152:0/2964333970 shutdown_connections 2024-04-17T08:46:48.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.070+0000 7f2fcb200640 1 --2- 172.21.15.152:0/2964333970 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2fc4071790 0x7f2fc4071c20 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:48.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.070+0000 7f2fcb200640 1 --2- 172.21.15.152:0/2964333970 >> v2:172.21.15.196:3300/0 conn(0x7f2fc40c7230 0x7f2fc40c76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:48.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.070+0000 7f2fcb200640 1 -- 172.21.15.152:0/2964333970 >> 172.21.15.152:0/2964333970 conn(0x7f2fc40d2350 msgr2=0x7f2fc40d2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:48.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.070+0000 7f2fcb200640 1 -- 172.21.15.152:0/2964333970 shutdown_connections 2024-04-17T08:46:48.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.070+0000 7f2fcb200640 1 -- 172.21.15.152:0/2964333970 wait complete. 2024-04-17T08:46:48.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.070+0000 7f2fcb200640 1 Processor -- start 2024-04-17T08:46:48.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.070+0000 7f2fcb200640 1 -- start start 2024-04-17T08:46:48.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.070+0000 7f2fcb200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2fc4071790 0x7f2fc4143f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:48.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.070+0000 7f2fcb200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2fc40c7230 0x7f2fc415bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:48.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.070+0000 7f2fcb200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fc4145ea0 0x7f2fc415c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:48.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.070+0000 7f2fcb200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc4169610 con 0x7f2fc4145ea0 2024-04-17T08:46:48.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.070+0000 7f2fcb200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc4169490 con 0x7f2fc40c7230 2024-04-17T08:46:48.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.070+0000 7f2fcb200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f2fc4169790 con 0x7f2fc4071790 2024-04-17T08:46:48.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.070+0000 7f2fc9200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fc4145ea0 0x7f2fc415c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:48.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.070+0000 7f2fc9200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fc4145ea0 0x7f2fc415c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35780/0 (socket says 172.21.15.152:35780) 2024-04-17T08:46:48.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.070+0000 7f2fc9200640 1 -- 172.21.15.152:0/443014516 learned_addr learned my addr 172.21.15.152:0/443014516 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:48.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.070+0000 7f2fc3e00640 1 --2- 172.21.15.152:0/443014516 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2fc4071790 0x7f2fc4143f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:48.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.070+0000 7f2fbb400640 1 --2- 172.21.15.152:0/443014516 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2fc40c7230 0x7f2fc415bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:48.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.070+0000 7f2fc9200640 1 -- 172.21.15.152:0/443014516 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2fc4071790 msgr2=0x7f2fc4143f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:48.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.070+0000 7f2fc9200640 1 --2- 172.21.15.152:0/443014516 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2fc4071790 0x7f2fc4143f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:48.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.070+0000 7f2fc9200640 1 -- 172.21.15.152:0/443014516 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2fc40c7230 msgr2=0x7f2fc415bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:48.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.070+0000 7f2fc9200640 1 --2- 172.21.15.152:0/443014516 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2fc40c7230 0x7f2fc415bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:48.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.070+0000 7f2fc9200640 1 -- 172.21.15.152:0/443014516 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fc406d3f0 con 0x7f2fc4145ea0 2024-04-17T08:46:48.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.070+0000 7f2fbb400640 1 --2- 172.21.15.152:0/443014516 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2fc40c7230 0x7f2fc415bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:46:48.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.074+0000 7f2fc9200640 1 --2- 172.21.15.152:0/443014516 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fc4145ea0 0x7f2fc415c1a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc01ab50 tx=0x7f2fbc01ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:48.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.074+0000 7f2fc0c00640 1 -- 172.21.15.152:0/443014516 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc0b0050 con 0x7f2fc4145ea0 2024-04-17T08:46:48.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.074+0000 7f2fc0c00640 1 -- 172.21.15.152:0/443014516 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fbc0bc070 con 0x7f2fc4145ea0 2024-04-17T08:46:48.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.074+0000 7f2fcb200640 1 -- 172.21.15.152:0/443014516 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fc406d690 con 0x7f2fc4145ea0 2024-04-17T08:46:48.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.074+0000 7f2fc0c00640 1 -- 172.21.15.152:0/443014516 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc006e20 con 0x7f2fc4145ea0 2024-04-17T08:46:48.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.074+0000 7f2fcb200640 1 -- 172.21.15.152:0/443014516 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fc406dc50 con 0x7f2fc4145ea0 2024-04-17T08:46:48.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.074+0000 7f2fcb200640 1 -- 172.21.15.152:0/443014516 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fc4068a30 con 0x7f2fc4145ea0 2024-04-17T08:46:48.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.074+0000 7f2fc0c00640 1 -- 172.21.15.152:0/443014516 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2fbc0b5830 con 0x7f2fc4145ea0 2024-04-17T08:46:48.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.074+0000 7f2fc0c00640 1 --2- 172.21.15.152:0/443014516 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f2fa00683b0 0x7f2fa006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:48.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.074+0000 7f2fc0c00640 1 -- 172.21.15.152:0/443014516 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2fbc1213f0 con 0x7f2fc4145ea0 2024-04-17T08:46:48.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.074+0000 7f2fc3e00640 1 --2- 172.21.15.152:0/443014516 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f2fa00683b0 0x7f2fa006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:48.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.078+0000 7f2fc3e00640 1 --2- 172.21.15.152:0/443014516 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f2fa00683b0 0x7f2fa006a870 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2fb40012f0 tx=0x7f2fb4001690 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:48.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.078+0000 7f2fc0c00640 1 -- 172.21.15.152:0/443014516 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f2fbc016090 con 0x7f2fc4145ea0 2024-04-17T08:46:48.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.242+0000 7f2fcb200640 1 -- 172.21.15.152:0/443014516 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2fc40b36c0 con 0x7f2fc4145ea0 2024-04-17T08:46:48.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.246+0000 7f2fc0c00640 1 -- 172.21.15.152:0/443014516 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7f2fbc0f15d0 con 0x7f2fc4145ea0 2024-04-17T08:46:48.246 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-04-17T08:46:48.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.246+0000 7f2fcb200640 1 -- 172.21.15.152:0/443014516 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f2fa00683b0 msgr2=0x7f2fa006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:48.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.246+0000 7f2fcb200640 1 --2- 172.21.15.152:0/443014516 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f2fa00683b0 0x7f2fa006a870 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2fb40012f0 tx=0x7f2fb4001690 comp rx=0 tx=0).stop 2024-04-17T08:46:48.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.246+0000 7f2fcb200640 1 -- 172.21.15.152:0/443014516 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fc4145ea0 msgr2=0x7f2fc415c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:48.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.246+0000 7f2fcb200640 1 --2- 172.21.15.152:0/443014516 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fc4145ea0 0x7f2fc415c1a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc01ab50 tx=0x7f2fbc01ace0 comp rx=0 tx=0).stop 2024-04-17T08:46:48.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.246+0000 7f2fcb200640 1 -- 172.21.15.152:0/443014516 shutdown_connections 2024-04-17T08:46:48.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.246+0000 7f2fcb200640 1 --2- 172.21.15.152:0/443014516 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fc4145ea0 0x7f2fc415c1a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:48.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.246+0000 7f2fcb200640 1 --2- 172.21.15.152:0/443014516 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2fc40c7230 0x7f2fc415bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:48.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.246+0000 7f2fcb200640 1 --2- 172.21.15.152:0/443014516 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f2fa00683b0 0x7f2fa006a870 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:48.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.246+0000 7f2fcb200640 1 --2- 172.21.15.152:0/443014516 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2fc4071790 0x7f2fc4143f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:48.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.246+0000 7f2fcb200640 1 -- 172.21.15.152:0/443014516 >> 172.21.15.152:0/443014516 conn(0x7f2fc40d2350 msgr2=0x7f2fc41419a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:48.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.246+0000 7f2fcb200640 1 -- 172.21.15.152:0/443014516 shutdown_connections 2024-04-17T08:46:48.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.246+0000 7f2fcb200640 1 -- 172.21.15.152:0/443014516 wait complete. 2024-04-17T08:46:48.267 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-17T08:46:48.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.406+0000 7f9ecca00640 1 Processor -- start 2024-04-17T08:46:48.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.406+0000 7f9ecca00640 1 -- start start 2024-04-17T08:46:48.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.406+0000 7f9ecca00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ec815a010 0x7f9ec80d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:48.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.406+0000 7f9ecca00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f9ec815d710 0x7f9ec80d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:48.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.406+0000 7f9ecca00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f9ec8160010 0x7f9ec8160480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:48.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.406+0000 7f9ecca00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f9ec815d280 con 0x7f9ec815d710 2024-04-17T08:46:48.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.406+0000 7f9ecca00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f9ec815c9d0 con 0x7f9ec8160010 2024-04-17T08:46:48.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.406+0000 7f9ecca00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f9ec8160d20 con 0x7f9ec815a010 2024-04-17T08:46:48.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.406+0000 7f9ebd400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f9ec815d710 0x7f9ec80d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:48.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.406+0000 7f9ebd400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f9ec815d710 0x7f9ec80d08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56650/0 (socket says 172.21.15.152:56650) 2024-04-17T08:46:48.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.406+0000 7f9ebd400640 1 -- 172.21.15.152:0/3493534120 learned_addr learned my addr 172.21.15.152:0/3493534120 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:48.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.406+0000 7f9ec5e00640 1 --2- 172.21.15.152:0/3493534120 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ec815a010 0x7f9ec80d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:48.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.406+0000 7f9ebd400640 1 -- 172.21.15.152:0/3493534120 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ec815a010 msgr2=0x7f9ec80d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:48.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.406+0000 7f9ebd400640 1 --2- 172.21.15.152:0/3493534120 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ec815a010 0x7f9ec80d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:48.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.406+0000 7f9ebd400640 1 -- 172.21.15.152:0/3493534120 >> v2:172.21.15.196:3300/0 conn(0x7f9ec8160010 msgr2=0x7f9ec8160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:48.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.406+0000 7f9ec6800640 1 --2- 172.21.15.152:0/3493534120 >> v2:172.21.15.196:3300/0 conn(0x7f9ec8160010 0x7f9ec8160480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:48.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.406+0000 7f9ebd400640 1 --2- 172.21.15.152:0/3493534120 >> v2:172.21.15.196:3300/0 conn(0x7f9ec8160010 0x7f9ec8160480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:48.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.406+0000 7f9ebd400640 1 -- 172.21.15.152:0/3493534120 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ec815cc30 con 0x7f9ec815d710 2024-04-17T08:46:48.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.406+0000 7f9ec5e00640 1 --2- 172.21.15.152:0/3493534120 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ec815a010 0x7f9ec80d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:46:48.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.406+0000 7f9ec6800640 1 --2- 172.21.15.152:0/3493534120 >> v2:172.21.15.196:3300/0 conn(0x7f9ec8160010 0x7f9ec8160480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:46:48.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.410+0000 7f9ebd400640 1 --2- 172.21.15.152:0/3493534120 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9ec815d710 0x7f9ec80d08a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9ec80b1d10 tx=0x7f9eb001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=277d32837b0a9051 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:48.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.410+0000 7f9ec5400640 1 -- 172.21.15.152:0/3493534120 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb00b0070 con 0x7f9ec815d710 2024-04-17T08:46:48.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.410+0000 7f9ec5400640 1 -- 172.21.15.152:0/3493534120 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9eb00ab600 con 0x7f9ec815d710 2024-04-17T08:46:48.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.410+0000 7f9ec5400640 1 -- 172.21.15.152:0/3493534120 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb00ab9d0 con 0x7f9ec815d710 2024-04-17T08:46:48.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.410+0000 7f9ecca00640 1 -- 172.21.15.152:0/3493534120 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9ec815d710 msgr2=0x7f9ec80d08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:48.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.410+0000 7f9ecca00640 1 --2- 172.21.15.152:0/3493534120 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9ec815d710 0x7f9ec80d08a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9ec80b1d10 tx=0x7f9eb001c490 comp rx=0 tx=0).stop 2024-04-17T08:46:48.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.410+0000 7f9ecca00640 1 -- 172.21.15.152:0/3493534120 shutdown_connections 2024-04-17T08:46:48.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.410+0000 7f9ecca00640 1 --2- 172.21.15.152:0/3493534120 >> v2:172.21.15.196:3300/0 conn(0x7f9ec8160010 0x7f9ec8160480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:48.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.410+0000 7f9ecca00640 1 --2- 172.21.15.152:0/3493534120 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9ec815d710 0x7f9ec80d08a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:48.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.410+0000 7f9ecca00640 1 --2- 172.21.15.152:0/3493534120 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ec815a010 0x7f9ec80d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:48.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.410+0000 7f9ecca00640 1 -- 172.21.15.152:0/3493534120 >> 172.21.15.152:0/3493534120 conn(0x7f9ec80b3350 msgr2=0x7f9ec80b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:48.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.410+0000 7f9ecca00640 1 -- 172.21.15.152:0/3493534120 shutdown_connections 2024-04-17T08:46:48.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.410+0000 7f9ecca00640 1 -- 172.21.15.152:0/3493534120 wait complete. 2024-04-17T08:46:48.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.414+0000 7f9ecca00640 1 Processor -- start 2024-04-17T08:46:48.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.414+0000 7f9ecca00640 1 -- start start 2024-04-17T08:46:48.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.414+0000 7f9ecca00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ec815a010 0x7f9ec81586c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:48.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.414+0000 7f9ecca00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9ec815d710 0x7f9ec80994b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:48.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.414+0000 7f9ecca00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9ec8160010 0x7f9ec80cd820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:48.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.414+0000 7f9ecca00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec806c340 con 0x7f9ec815d710 2024-04-17T08:46:48.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.414+0000 7f9ecca00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec806c1c0 con 0x7f9ec8160010 2024-04-17T08:46:48.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.414+0000 7f9ecca00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f9ec806c4c0 con 0x7f9ec815a010 2024-04-17T08:46:48.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.414+0000 7f9ebd400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9ec815d710 0x7f9ec80994b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:48.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.414+0000 7f9ebd400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9ec815d710 0x7f9ec80994b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56664/0 (socket says 172.21.15.152:56664) 2024-04-17T08:46:48.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.414+0000 7f9ebd400640 1 -- 172.21.15.152:0/541717192 learned_addr learned my addr 172.21.15.152:0/541717192 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:48.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.414+0000 7f9ec5e00640 1 --2- 172.21.15.152:0/541717192 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ec815a010 0x7f9ec81586c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:48.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.414+0000 7f9ec6800640 1 --2- 172.21.15.152:0/541717192 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9ec8160010 0x7f9ec80cd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:48.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.414+0000 7f9ebd400640 1 -- 172.21.15.152:0/541717192 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ec815a010 msgr2=0x7f9ec81586c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:48.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.414+0000 7f9ebd400640 1 --2- 172.21.15.152:0/541717192 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ec815a010 0x7f9ec81586c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:48.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.414+0000 7f9ebd400640 1 -- 172.21.15.152:0/541717192 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9ec8160010 msgr2=0x7f9ec80cd820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:48.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.414+0000 7f9ebd400640 1 --2- 172.21.15.152:0/541717192 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9ec8160010 0x7f9ec80cd820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:48.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.414+0000 7f9ebd400640 1 -- 172.21.15.152:0/541717192 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ec8072720 con 0x7f9ec815d710 2024-04-17T08:46:48.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.414+0000 7f9ec5e00640 1 --2- 172.21.15.152:0/541717192 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ec815a010 0x7f9ec81586c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:46:48.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.414+0000 7f9ebd400640 1 --2- 172.21.15.152:0/541717192 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9ec815d710 0x7f9ec80994b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9eb001ab40 tx=0x7f9eb0019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:48.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.414+0000 7f9ebea00640 1 -- 172.21.15.152:0/541717192 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb00b0040 con 0x7f9ec815d710 2024-04-17T08:46:48.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.414+0000 7f9ebea00640 1 -- 172.21.15.152:0/541717192 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9eb00b9070 con 0x7f9ec815d710 2024-04-17T08:46:48.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.414+0000 7f9ecca00640 1 -- 172.21.15.152:0/541717192 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ec806fbd0 con 0x7f9ec815d710 2024-04-17T08:46:48.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.414+0000 7f9ebea00640 1 -- 172.21.15.152:0/541717192 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb00b4880 con 0x7f9ec815d710 2024-04-17T08:46:48.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.414+0000 7f9ecca00640 1 -- 172.21.15.152:0/541717192 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ec81547b0 con 0x7f9ec815d710 2024-04-17T08:46:48.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.414+0000 7f9ecca00640 1 -- 172.21.15.152:0/541717192 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ec81549f0 con 0x7f9ec815d710 2024-04-17T08:46:48.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.418+0000 7f9ebea00640 1 -- 172.21.15.152:0/541717192 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9eb00ab4c0 con 0x7f9ec815d710 2024-04-17T08:46:48.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.418+0000 7f9ebea00640 1 --2- 172.21.15.152:0/541717192 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9ea4068380 0x7f9ea406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:48.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.418+0000 7f9ebea00640 1 -- 172.21.15.152:0/541717192 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9eb0120ba0 con 0x7f9ec815d710 2024-04-17T08:46:48.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.418+0000 7f9ec5e00640 1 --2- 172.21.15.152:0/541717192 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9ea4068380 0x7f9ea406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:48.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.418+0000 7f9ec5e00640 1 --2- 172.21.15.152:0/541717192 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9ea4068380 0x7f9ea406a840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9eb8006fd0 tx=0x7f9eb8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:48.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.422+0000 7f9ebea00640 1 -- 172.21.15.152:0/541717192 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f9ec81549f0 con 0x7f9ec815d710 2024-04-17T08:46:48.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.578+0000 7f9ecca00640 1 -- 172.21.15.152:0/541717192 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f9ec8068a30 con 0x7f9ec815d710 2024-04-17T08:46:48.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.578+0000 7f9ebea00640 1 -- 172.21.15.152:0/541717192 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7f9eb0016110 con 0x7f9ec815d710 2024-04-17T08:46:48.581 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 64 2024-04-17T08:46:48.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.582+0000 7f9ecca00640 1 -- 172.21.15.152:0/541717192 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9ea4068380 msgr2=0x7f9ea406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:48.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.582+0000 7f9ecca00640 1 --2- 172.21.15.152:0/541717192 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9ea4068380 0x7f9ea406a840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9eb8006fd0 tx=0x7f9eb8008040 comp rx=0 tx=0).stop 2024-04-17T08:46:48.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.582+0000 7f9ecca00640 1 -- 172.21.15.152:0/541717192 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9ec815d710 msgr2=0x7f9ec80994b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:48.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.582+0000 7f9ecca00640 1 --2- 172.21.15.152:0/541717192 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9ec815d710 0x7f9ec80994b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9eb001ab40 tx=0x7f9eb0019230 comp rx=0 tx=0).stop 2024-04-17T08:46:48.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.582+0000 7f9ecca00640 1 -- 172.21.15.152:0/541717192 shutdown_connections 2024-04-17T08:46:48.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.582+0000 7f9ecca00640 1 --2- 172.21.15.152:0/541717192 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9ec8160010 0x7f9ec80cd820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:48.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.582+0000 7f9ecca00640 1 --2- 172.21.15.152:0/541717192 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9ec815d710 0x7f9ec80994b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:48.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.582+0000 7f9ecca00640 1 --2- 172.21.15.152:0/541717192 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9ea4068380 0x7f9ea406a840 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:48.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.582+0000 7f9ecca00640 1 --2- 172.21.15.152:0/541717192 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ec815a010 0x7f9ec81586c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:48.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.582+0000 7f9ecca00640 1 -- 172.21.15.152:0/541717192 >> 172.21.15.152:0/541717192 conn(0x7f9ec80b3350 msgr2=0x7f9ec80aeeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:48.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.582+0000 7f9ecca00640 1 -- 172.21.15.152:0/541717192 shutdown_connections 2024-04-17T08:46:48.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.582+0000 7f9ecca00640 1 -- 172.21.15.152:0/541717192 wait complete. 2024-04-17T08:46:48.602 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-17T08:46:48.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.738+0000 7efcfee00640 1 Processor -- start 2024-04-17T08:46:48.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.738+0000 7efcfee00640 1 -- start start 2024-04-17T08:46:48.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.738+0000 7efcfee00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7efcf806f980 0x7efcf8072530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:48.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.738+0000 7efcfee00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcf815bfd0 con 0x7efcf80af670 2024-04-17T08:46:48.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.738+0000 7efcfee00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcf815c260 con 0x7efcf80d0360 2024-04-17T08:46:48.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.738+0000 7efcfee00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7efcf815c820 con 0x7efcf806f980 2024-04-17T08:46:48.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.738+0000 7efcf7e00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7efcf80af670 0x7efcf815b8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:42794/0 (socket says 172.21.15.152:42794) 2024-04-17T08:46:48.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.738+0000 7efcf7e00640 1 -- 172.21.15.152:0/1871904090 learned_addr learned my addr 172.21.15.152:0/1871904090 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:46:48.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.738+0000 7efcf7400640 1 -- 172.21.15.152:0/1871904090 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2500097991 0 0) 0x7efcf815bfd0 con 0x7efcf80af670 2024-04-17T08:46:48.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.742+0000 7efcf7400640 1 -- 172.21.15.152:0/1871904090 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efcdc005740 con 0x7efcf80af670 2024-04-17T08:46:48.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.742+0000 7efcef400640 1 --2- 172.21.15.152:0/1871904090 >> v2:172.21.15.196:3300/0 conn(0x7efcf806f980 0x7efcf8072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:48.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.742+0000 7efcf7400640 1 -- 172.21.15.152:0/1871904090 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1293054516 0 0) 0x7efcdc005740 con 0x7efcf80af670 2024-04-17T08:46:48.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.742+0000 7efcf7400640 1 -- 172.21.15.152:0/1871904090 >> v2:172.21.15.196:3300/0 conn(0x7efcf806f980 msgr2=0x7efcf8072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:48.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.742+0000 7efcf7400640 1 --2- 172.21.15.152:0/1871904090 >> v2:172.21.15.196:3300/0 conn(0x7efcf806f980 0x7efcf8072530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:48.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.742+0000 7efcf7400640 1 -- 172.21.15.152:0/1871904090 >> v1:172.21.15.196:6789/0 conn(0x7efcf80d0360 legacy=0x7efcf806dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:48.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.742+0000 7efcf7400640 1 -- 172.21.15.152:0/1871904090 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcf815c540 con 0x7efcf80af670 2024-04-17T08:46:48.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.742+0000 7efcf7400640 1 -- 172.21.15.152:0/1871904090 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2973887244 0 0) 0x7efce8001a00 con 0x7efcf80af670 2024-04-17T08:46:48.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.742+0000 7efcf7400640 1 -- 172.21.15.152:0/1871904090 >> v1:172.21.15.152:6789/0 conn(0x7efcf80af670 legacy=0x7efcf815b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:48.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.742+0000 7efcf7400640 1 --2- 172.21.15.152:0/1871904090 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efcdc005bd0 0x7efcdc005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:48.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.742+0000 7efcf7400640 1 --2- 172.21.15.152:0/1871904090 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efcdc006a20 0x7efcdc006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:48.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.742+0000 7efcf7400640 1 --2- 172.21.15.152:0/1871904090 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efcdc007500 0x7efcdc00dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:48.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.742+0000 7efcf7400640 1 -- 172.21.15.152:0/1871904090 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7efcf815c820 con 0x7efcdc005bd0 2024-04-17T08:46:48.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.742+0000 7efcf7400640 1 -- 172.21.15.152:0/1871904090 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7efcdc00e3d0 con 0x7efcdc007500 2024-04-17T08:46:48.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.742+0000 7efcf7400640 1 -- 172.21.15.152:0/1871904090 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7efcdc00e5d0 con 0x7efcdc006a20 2024-04-17T08:46:48.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.742+0000 7efcf7e00640 1 --2- 172.21.15.152:0/1871904090 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efcdc005bd0 0x7efcdc005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:48.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.742+0000 7efcef400640 1 --2- 172.21.15.152:0/1871904090 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efcdc006a20 0x7efcdc006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:48.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.742+0000 7efcfce00640 1 --2- 172.21.15.152:0/1871904090 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efcdc007500 0x7efcdc00dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:48.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.742+0000 7efcf7e00640 1 -- 172.21.15.152:0/1871904090 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efcdc006a20 msgr2=0x7efcdc006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:48.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.742+0000 7efcf7e00640 1 --2- 172.21.15.152:0/1871904090 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efcdc006a20 0x7efcdc006ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:48.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.742+0000 7efcf7e00640 1 -- 172.21.15.152:0/1871904090 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efcdc007500 msgr2=0x7efcdc00dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:48.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.742+0000 7efcf7e00640 1 --2- 172.21.15.152:0/1871904090 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efcdc007500 0x7efcdc00dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:48.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.742+0000 7efcf7e00640 1 -- 172.21.15.152:0/1871904090 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcdc005740 con 0x7efcdc005bd0 2024-04-17T08:46:48.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.742+0000 7efcef400640 1 --2- 172.21.15.152:0/1871904090 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efcdc006a20 0x7efcdc006ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:46:48.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.742+0000 7efcfce00640 1 --2- 172.21.15.152:0/1871904090 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efcdc007500 0x7efcdc00dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:46:48.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.742+0000 7efcfce00640 1 -- 172.21.15.152:0/1871904090 reap_dead start 2024-04-17T08:46:48.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.742+0000 7efcf7e00640 1 --2- 172.21.15.152:0/1871904090 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efcdc005bd0 0x7efcdc005ff0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7efce800a830 tx=0x7efce801d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=806f8468b1000efe server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:48.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.746+0000 7efcf7400640 1 -- 172.21.15.152:0/1871904090 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce800a480 con 0x7efcdc005bd0 2024-04-17T08:46:48.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.746+0000 7efcf7400640 1 -- 172.21.15.152:0/1871904090 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efce80ad630 con 0x7efcdc005bd0 2024-04-17T08:46:48.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.746+0000 7efcf7400640 1 -- 172.21.15.152:0/1871904090 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce80ada80 con 0x7efcdc005bd0 2024-04-17T08:46:48.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.746+0000 7efcfee00640 1 -- 172.21.15.152:0/1871904090 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efcdc005bd0 msgr2=0x7efcdc005ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:48.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.746+0000 7efcfee00640 1 --2- 172.21.15.152:0/1871904090 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efcdc005bd0 0x7efcdc005ff0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7efce800a830 tx=0x7efce801d330 comp rx=0 tx=0).stop 2024-04-17T08:46:48.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.746+0000 7efcfee00640 1 -- 172.21.15.152:0/1871904090 shutdown_connections 2024-04-17T08:46:48.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.746+0000 7efcfee00640 1 --2- 172.21.15.152:0/1871904090 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efcdc005bd0 0x7efcdc005ff0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:48.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.746+0000 7efcfee00640 1 -- 172.21.15.152:0/1871904090 >> 172.21.15.152:0/1871904090 conn(0x7efcf80b3350 msgr2=0x7efcf80b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:48.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.746+0000 7efcfee00640 1 -- 172.21.15.152:0/1871904090 shutdown_connections 2024-04-17T08:46:48.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.746+0000 7efcfee00640 1 -- 172.21.15.152:0/1871904090 wait complete. 2024-04-17T08:46:48.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.746+0000 7efcfee00640 1 Processor -- start 2024-04-17T08:46:48.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.746+0000 7efcfee00640 1 -- start start 2024-04-17T08:46:48.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.746+0000 7efcfee00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efcdc005bd0 0x7efcf8152f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:48.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.746+0000 7efcfee00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efcf81565d0 0x7efcf809a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:48.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.746+0000 7efcfee00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efcf8156a50 0x7efcf809a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:48.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.746+0000 7efcfee00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7efcf815be50 con 0x7efcf8156a50 2024-04-17T08:46:48.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.746+0000 7efcfee00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7efcf815bcd0 con 0x7efcdc005bd0 2024-04-17T08:46:48.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.746+0000 7efcfee00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7efcf80d0b80 con 0x7efcf81565d0 2024-04-17T08:46:48.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.746+0000 7efcfce00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efcf8156a50 0x7efcf809a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:48.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.746+0000 7efcf7e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efcdc005bd0 0x7efcf8152f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:48.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.746+0000 7efcef400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efcf81565d0 0x7efcf809a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:48.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.746+0000 7efcf7e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efcdc005bd0 0x7efcf8152f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.152:32960/0 (socket says 172.21.15.152:32960) 2024-04-17T08:46:48.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.746+0000 7efcf7e00640 1 -- 172.21.15.152:0/1617942573 learned_addr learned my addr 172.21.15.152:0/1617942573 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:48.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.750+0000 7efcfce00640 1 -- 172.21.15.152:0/1617942573 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efcf81565d0 msgr2=0x7efcf809a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:48.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.750+0000 7efcfce00640 1 --2- 172.21.15.152:0/1617942573 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efcf81565d0 0x7efcf809a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:48.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.750+0000 7efcfce00640 1 -- 172.21.15.152:0/1617942573 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efcdc005bd0 msgr2=0x7efcf8152f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:48.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.750+0000 7efcfce00640 1 --2- 172.21.15.152:0/1617942573 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efcdc005bd0 0x7efcf8152f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:48.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.750+0000 7efcfce00640 1 -- 172.21.15.152:0/1617942573 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcf81f84b0 con 0x7efcf8156a50 2024-04-17T08:46:48.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.750+0000 7efcf7e00640 1 --2- 172.21.15.152:0/1617942573 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efcdc005bd0 0x7efcf8152f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T08:46:48.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.750+0000 7efcfce00640 1 --2- 172.21.15.152:0/1617942573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efcf8156a50 0x7efcf809a6b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7efcf815ee20 tx=0x7efcf000e820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:48.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.750+0000 7efcf4c00640 1 -- 172.21.15.152:0/1617942573 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf0019070 con 0x7efcf8156a50 2024-04-17T08:46:48.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.750+0000 7efcf4c00640 1 -- 172.21.15.152:0/1617942573 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcf00052e0 con 0x7efcf8156a50 2024-04-17T08:46:48.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.750+0000 7efcfee00640 1 -- 172.21.15.152:0/1617942573 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcf81534b0 con 0x7efcf8156a50 2024-04-17T08:46:48.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.750+0000 7efcf4c00640 1 -- 172.21.15.152:0/1617942573 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf0003840 con 0x7efcf8156a50 2024-04-17T08:46:48.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.750+0000 7efcfee00640 1 -- 172.21.15.152:0/1617942573 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcf81574b0 con 0x7efcf8156a50 2024-04-17T08:46:48.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.750+0000 7efcfee00640 1 -- 172.21.15.152:0/1617942573 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcf8068a30 con 0x7efcf8156a50 2024-04-17T08:46:48.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.750+0000 7efcf4c00640 1 -- 172.21.15.152:0/1617942573 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efcf001c070 con 0x7efcf8156a50 2024-04-17T08:46:48.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.750+0000 7efcf4c00640 1 --2- 172.21.15.152:0/1617942573 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7efcd40683b0 0x7efcd406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:48.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.750+0000 7efcf4c00640 1 -- 172.21.15.152:0/1617942573 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7efcf0085fe0 con 0x7efcf8156a50 2024-04-17T08:46:48.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.754+0000 7efcf7e00640 1 --2- 172.21.15.152:0/1617942573 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7efcd40683b0 0x7efcd406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:48.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.754+0000 7efcf7e00640 1 --2- 172.21.15.152:0/1617942573 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7efcd40683b0 0x7efcd406a870 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efce8001570 tx=0x7efce80a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:48.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.754+0000 7efcf4c00640 1 -- 172.21.15.152:0/1617942573 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7efcf0055bb0 con 0x7efcf8156a50 2024-04-17T08:46:48.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.910+0000 7efcfee00640 1 -- 172.21.15.152:0/1617942573 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7efcf8156f20 con 0x7efcf8156a50 2024-04-17T08:46:48.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.910+0000 7efcf4c00640 1 -- 172.21.15.152:0/1617942573 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) ==== 103+0+11 (secure 0 0 0) 0x7efcf0059eb0 con 0x7efcf8156a50 2024-04-17T08:46:48.914 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-04-17T08:46:48.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.914+0000 7efcfee00640 1 -- 172.21.15.152:0/1617942573 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7efcd40683b0 msgr2=0x7efcd406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:48.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.914+0000 7efcfee00640 1 --2- 172.21.15.152:0/1617942573 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7efcd40683b0 0x7efcd406a870 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efce8001570 tx=0x7efce80a7000 comp rx=0 tx=0).stop 2024-04-17T08:46:48.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.914+0000 7efcfee00640 1 -- 172.21.15.152:0/1617942573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efcf8156a50 msgr2=0x7efcf809a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:48.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.914+0000 7efcfee00640 1 --2- 172.21.15.152:0/1617942573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efcf8156a50 0x7efcf809a6b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7efcf815ee20 tx=0x7efcf000e820 comp rx=0 tx=0).stop 2024-04-17T08:46:48.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.914+0000 7efcfee00640 1 -- 172.21.15.152:0/1617942573 shutdown_connections 2024-04-17T08:46:48.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.914+0000 7efcfee00640 1 --2- 172.21.15.152:0/1617942573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efcf8156a50 0x7efcf809a6b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:48.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.914+0000 7efcfee00640 1 --2- 172.21.15.152:0/1617942573 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7efcd40683b0 0x7efcd406a870 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:48.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.914+0000 7efcfee00640 1 --2- 172.21.15.152:0/1617942573 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efcf81565d0 0x7efcf809a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:48.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.914+0000 7efcfee00640 1 --2- 172.21.15.152:0/1617942573 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efcdc005bd0 0x7efcf8152f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:48.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.914+0000 7efcfee00640 1 -- 172.21.15.152:0/1617942573 >> 172.21.15.152:0/1617942573 conn(0x7efcf80b3350 msgr2=0x7efcf806c070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:48.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.914+0000 7efcfee00640 1 -- 172.21.15.152:0/1617942573 shutdown_connections 2024-04-17T08:46:48.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:48.914+0000 7efcfee00640 1 -- 172.21.15.152:0/1617942573 wait complete. 2024-04-17T08:46:48.935 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-17T08:46:49.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.070+0000 7f030a800640 1 Processor -- start 2024-04-17T08:46:49.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.070+0000 7f030a800640 1 -- start start 2024-04-17T08:46:49.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.070+0000 7f030a800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0304145ea0 0x7f03040d0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:49.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.070+0000 7f030a800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0304071790 0x7f0304071be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:49.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.070+0000 7f030a800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03040ccbb0 con 0x7f03040d0790 2024-04-17T08:46:49.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.070+0000 7f030a800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f0304072120 con 0x7f0304145ea0 2024-04-17T08:46:49.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.070+0000 7f030a800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f03040cce90 con 0x7f0304071790 2024-04-17T08:46:49.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.070+0000 7f0303400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0304145ea0 0x7f03040d0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:49.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.070+0000 7f0303e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0304071790 0x7f0304071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:49.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.070+0000 7f0302a00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f03040d0790 0x7f03040c7230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.152:35900/0 (socket says 172.21.15.152:35900) 2024-04-17T08:46:49.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.070+0000 7f0302a00640 1 -- 172.21.15.152:0/323672571 learned_addr learned my addr 172.21.15.152:0/323672571 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:46:49.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.070+0000 7f0303400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0304145ea0 0x7f03040d0250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.152:32974/0 (socket says 172.21.15.152:32974) 2024-04-17T08:46:49.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.070+0000 7f0303400640 1 -- 172.21.15.152:0/323672571 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0304071790 msgr2=0x7f0304071be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:49.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.070+0000 7f0303400640 1 --2- 172.21.15.152:0/323672571 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0304071790 0x7f0304071be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:49.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.070+0000 7f0303400640 1 -- 172.21.15.152:0/323672571 >> v1:172.21.15.196:6789/0 conn(0x7f03040d0790 legacy=0x7f03040c7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:49.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.070+0000 7f0303400640 1 -- 172.21.15.152:0/323672571 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03040cd170 con 0x7f0304145ea0 2024-04-17T08:46:49.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.070+0000 7f0302000640 1 -- 172.21.15.152:0/323672571 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1423806003 0 0) 0x7f03040ccbb0 con 0x7f03040d0790 2024-04-17T08:46:49.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.074+0000 7f0303400640 1 --2- 172.21.15.152:0/323672571 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0304145ea0 0x7f03040d0250 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f02f4009d90 tx=0x7f02f401c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6a086bccf5d26b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:49.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.074+0000 7f0302000640 1 -- 172.21.15.152:0/323672571 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f40b2070 con 0x7f0304145ea0 2024-04-17T08:46:49.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.074+0000 7f0302000640 1 -- 172.21.15.152:0/323672571 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02f40a5830 con 0x7f0304145ea0 2024-04-17T08:46:49.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.074+0000 7f0302000640 1 -- 172.21.15.152:0/323672571 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f40a5c00 con 0x7f0304145ea0 2024-04-17T08:46:49.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.074+0000 7f030a800640 1 -- 172.21.15.152:0/323672571 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0304145ea0 msgr2=0x7f03040d0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:49.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.074+0000 7f030a800640 1 --2- 172.21.15.152:0/323672571 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0304145ea0 0x7f03040d0250 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f02f4009d90 tx=0x7f02f401c970 comp rx=0 tx=0).stop 2024-04-17T08:46:49.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.074+0000 7f030a800640 1 -- 172.21.15.152:0/323672571 shutdown_connections 2024-04-17T08:46:49.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.074+0000 7f030a800640 1 --2- 172.21.15.152:0/323672571 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0304071790 0x7f0304071be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:49.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.074+0000 7f030a800640 1 --2- 172.21.15.152:0/323672571 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0304145ea0 0x7f03040d0250 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:49.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.074+0000 7f030a800640 1 -- 172.21.15.152:0/323672571 >> 172.21.15.152:0/323672571 conn(0x7f03040d2350 msgr2=0x7f03040d2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:49.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.074+0000 7f030a800640 1 -- 172.21.15.152:0/323672571 shutdown_connections 2024-04-17T08:46:49.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.078+0000 7f030a800640 1 -- 172.21.15.152:0/323672571 wait complete. 2024-04-17T08:46:49.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.078+0000 7f030a800640 1 Processor -- start 2024-04-17T08:46:49.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.078+0000 7f030a800640 1 -- start start 2024-04-17T08:46:49.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.078+0000 7f030a800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0304071790 0x7f03040d0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:49.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.078+0000 7f030a800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f03040d0790 0x7f0304166760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:49.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.078+0000 7f030a800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0304145ea0 0x7f0304166ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:49.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.078+0000 7f030a800640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f03040c7ac0 con 0x7f0304071790 2024-04-17T08:46:49.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.078+0000 7f030a800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f03040c7940 con 0x7f03040d0790 2024-04-17T08:46:49.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.078+0000 7f030a800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f0304169490 con 0x7f0304145ea0 2024-04-17T08:46:49.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.078+0000 7f0303400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0304071790 0x7f03040d0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:49.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.078+0000 7f0303400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0304071790 0x7f03040d0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56674/0 (socket says 172.21.15.152:56674) 2024-04-17T08:46:49.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.078+0000 7f0303400640 1 -- 172.21.15.152:0/885256592 learned_addr learned my addr 172.21.15.152:0/885256592 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:49.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.078+0000 7f0302a00640 1 --2- 172.21.15.152:0/885256592 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f03040d0790 0x7f0304166760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:49.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.078+0000 7f0303e00640 1 --2- 172.21.15.152:0/885256592 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0304145ea0 0x7f0304166ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:49.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.078+0000 7f0303400640 1 -- 172.21.15.152:0/885256592 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0304145ea0 msgr2=0x7f0304166ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:49.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.078+0000 7f0303400640 1 --2- 172.21.15.152:0/885256592 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0304145ea0 0x7f0304166ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:49.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.078+0000 7f0303400640 1 -- 172.21.15.152:0/885256592 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f03040d0790 msgr2=0x7f0304166760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:49.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.078+0000 7f0303400640 1 --2- 172.21.15.152:0/885256592 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f03040d0790 0x7f0304166760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:49.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.078+0000 7f0303400640 1 -- 172.21.15.152:0/885256592 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03041671e0 con 0x7f0304071790 2024-04-17T08:46:49.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.078+0000 7f0302a00640 1 --2- 172.21.15.152:0/885256592 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f03040d0790 0x7f0304166760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:46:49.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.078+0000 7f0303400640 1 --2- 172.21.15.152:0/885256592 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0304071790 0x7f03040d0d90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f02f4009d90 tx=0x7f02f4019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:49.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.078+0000 7f02fb400640 1 -- 172.21.15.152:0/885256592 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f40bd030 con 0x7f0304071790 2024-04-17T08:46:49.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.078+0000 7f02fb400640 1 -- 172.21.15.152:0/885256592 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02f40a5630 con 0x7f0304071790 2024-04-17T08:46:49.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.078+0000 7f030a800640 1 -- 172.21.15.152:0/885256592 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f030406f3c0 con 0x7f0304071790 2024-04-17T08:46:49.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.078+0000 7f02fb400640 1 -- 172.21.15.152:0/885256592 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f40b2040 con 0x7f0304071790 2024-04-17T08:46:49.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.082+0000 7f030a800640 1 -- 172.21.15.152:0/885256592 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f030406e600 con 0x7f0304071790 2024-04-17T08:46:49.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.082+0000 7f030a800640 1 -- 172.21.15.152:0/885256592 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0304068a30 con 0x7f0304071790 2024-04-17T08:46:49.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.082+0000 7f02fb400640 1 -- 172.21.15.152:0/885256592 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f02f40c0070 con 0x7f0304071790 2024-04-17T08:46:49.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.082+0000 7f02fb400640 1 --2- 172.21.15.152:0/885256592 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f02e0068380 0x7f02e006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:49.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.082+0000 7f02fb400640 1 -- 172.21.15.152:0/885256592 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f02f4121680 con 0x7f0304071790 2024-04-17T08:46:49.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.082+0000 7f0302a00640 1 --2- 172.21.15.152:0/885256592 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f02e0068380 0x7f02e006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:49.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.082+0000 7f0302a00640 1 --2- 172.21.15.152:0/885256592 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f02e0068380 0x7f02e006a840 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f02ec007fd0 tx=0x7f02ec007c20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:49.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.086+0000 7f02fb400640 1 -- 172.21.15.152:0/885256592 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f02f4016560 con 0x7f0304071790 2024-04-17T08:46:49.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.258+0000 7f030a800640 1 -- 172.21.15.152:0/885256592 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f030415f2a0 con 0x7f0304071790 2024-04-17T08:46:49.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.258+0000 7f02fb400640 1 -- 172.21.15.152:0/885256592 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f02f40f18f0 con 0x7f0304071790 2024-04-17T08:46:49.260 INFO:teuthology.orchestra.run.smithi152.stderr:listed 0 entries 2024-04-17T08:46:49.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.258+0000 7f030a800640 1 -- 172.21.15.152:0/885256592 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f02e0068380 msgr2=0x7f02e006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:49.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.258+0000 7f030a800640 1 --2- 172.21.15.152:0/885256592 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f02e0068380 0x7f02e006a840 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f02ec007fd0 tx=0x7f02ec007c20 comp rx=0 tx=0).stop 2024-04-17T08:46:49.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.258+0000 7f030a800640 1 -- 172.21.15.152:0/885256592 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0304071790 msgr2=0x7f03040d0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:49.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.258+0000 7f030a800640 1 --2- 172.21.15.152:0/885256592 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0304071790 0x7f03040d0d90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f02f4009d90 tx=0x7f02f4019710 comp rx=0 tx=0).stop 2024-04-17T08:46:49.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.262+0000 7f030a800640 1 -- 172.21.15.152:0/885256592 shutdown_connections 2024-04-17T08:46:49.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.262+0000 7f030a800640 1 --2- 172.21.15.152:0/885256592 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f02e0068380 0x7f02e006a840 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:49.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.262+0000 7f030a800640 1 --2- 172.21.15.152:0/885256592 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0304145ea0 0x7f0304166ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:49.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.262+0000 7f030a800640 1 --2- 172.21.15.152:0/885256592 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f03040d0790 0x7f0304166760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:49.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.262+0000 7f030a800640 1 --2- 172.21.15.152:0/885256592 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0304071790 0x7f03040d0d90 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:49.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.262+0000 7f030a800640 1 -- 172.21.15.152:0/885256592 >> 172.21.15.152:0/885256592 conn(0x7f03040d2350 msgr2=0x7f03040d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:49.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.262+0000 7f030a800640 1 -- 172.21.15.152:0/885256592 shutdown_connections 2024-04-17T08:46:49.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:49.262+0000 7f030a800640 1 -- 172.21.15.152:0/885256592 wait complete. 2024-04-17T08:46:49.282 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi152.front.sepia.ceph.com... 2024-04-17T08:46:49.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:46:49.283 DEBUG:teuthology.orchestra.run.smithi152:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-04-17T08:46:49.403 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi152.stderr:ceph-fuse[34092]: fuse finished with error 0 and tester_r 0 2024-04-17T08:46:49.408 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T08:46:51.702 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T08:46:51.706 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T08:46:55.509 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi152.front.sepia.ceph.com 2024-04-17T08:46:55.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:46:55.510 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-04-17T08:46:55.536 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T08:46:55.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.718+0000 7f012be00640 1 Processor -- start 2024-04-17T08:46:55.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.718+0000 7f012be00640 1 -- start start 2024-04-17T08:46:55.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.722+0000 7f012be00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f012c15c5a0 0x7f012c073650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:55.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.722+0000 7f012be00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f012c06fb40 0x7f012c071ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:55.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.722+0000 7f012be00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f012c06c610 con 0x7f012c073b90 2024-04-17T08:46:55.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.722+0000 7f012be00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f012c06c3c0 con 0x7f012c06fb40 2024-04-17T08:46:55.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.722+0000 7f012be00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f012c06c8f0 con 0x7f012c15c5a0 2024-04-17T08:46:55.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.722+0000 7f012b400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f012c06fb40 0x7f012c071ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:55.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.722+0000 7f012b400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f012c06fb40 0x7f012c071ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56680/0 (socket says 172.21.15.152:56680) 2024-04-17T08:46:55.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.722+0000 7f012b400640 1 -- 172.21.15.152:0/594425726 learned_addr learned my addr 172.21.15.152:0/594425726 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:55.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.722+0000 7f012a000640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f012c073b90 0x7f012c06f430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:42804/0 (socket says 172.21.15.152:42804) 2024-04-17T08:46:55.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.722+0000 7f012aa00640 1 --2- 172.21.15.152:0/594425726 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f012c15c5a0 0x7f012c073650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:55.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.722+0000 7f012b400640 1 -- 172.21.15.152:0/594425726 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f012c15c5a0 msgr2=0x7f012c073650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:55.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.722+0000 7f012b400640 1 --2- 172.21.15.152:0/594425726 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f012c15c5a0 0x7f012c073650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:55.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.722+0000 7f012b400640 1 -- 172.21.15.152:0/594425726 >> v1:172.21.15.152:6789/0 conn(0x7f012c073b90 legacy=0x7f012c06f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:55.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.722+0000 7f012b400640 1 -- 172.21.15.152:0/594425726 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f012c06cbd0 con 0x7f012c06fb40 2024-04-17T08:46:55.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.726+0000 7f012b400640 1 --2- 172.21.15.152:0/594425726 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f012c06fb40 0x7f012c071ce0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0124009e50 tx=0x7f012401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d47a0fbfe15cc1e server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:55.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.726+0000 7f0129600640 1 -- 172.21.15.152:0/594425726 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01240a5810 con 0x7f012c06fb40 2024-04-17T08:46:55.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.726+0000 7f0129600640 1 -- 172.21.15.152:0/594425726 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01240a59b0 con 0x7f012c06fb40 2024-04-17T08:46:55.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.726+0000 7f0129600640 1 -- 172.21.15.152:0/594425726 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01240a5d80 con 0x7f012c06fb40 2024-04-17T08:46:55.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.726+0000 7f012be00640 1 -- 172.21.15.152:0/594425726 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f012c06fb40 msgr2=0x7f012c071ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:55.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.726+0000 7f012be00640 1 --2- 172.21.15.152:0/594425726 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f012c06fb40 0x7f012c071ce0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0124009e50 tx=0x7f012401ca30 comp rx=0 tx=0).stop 2024-04-17T08:46:55.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.726+0000 7f012be00640 1 -- 172.21.15.152:0/594425726 shutdown_connections 2024-04-17T08:46:55.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.726+0000 7f012be00640 1 --2- 172.21.15.152:0/594425726 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f012c06fb40 0x7f012c071ce0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:55.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.726+0000 7f012be00640 1 --2- 172.21.15.152:0/594425726 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f012c15c5a0 0x7f012c073650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:55.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.726+0000 7f012be00640 1 -- 172.21.15.152:0/594425726 >> 172.21.15.152:0/594425726 conn(0x7f012c0d0050 msgr2=0x7f012c0d0460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:55.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.726+0000 7f012be00640 1 -- 172.21.15.152:0/594425726 shutdown_connections 2024-04-17T08:46:55.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.726+0000 7f012be00640 1 -- 172.21.15.152:0/594425726 wait complete. 2024-04-17T08:46:55.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.726+0000 7f012be00640 1 Processor -- start 2024-04-17T08:46:55.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.726+0000 7f012be00640 1 -- start start 2024-04-17T08:46:55.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.730+0000 7f012be00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f012c06fb40 0x7f012c15f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:55.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.730+0000 7f012be00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f012c073b90 0x7f012c156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:55.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.730+0000 7f012be00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f012c15c5a0 0x7f012c09d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:55.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.730+0000 7f012be00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f012c072dc0 con 0x7f012c073b90 2024-04-17T08:46:55.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.730+0000 7f012be00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f012c072c40 con 0x7f012c06fb40 2024-04-17T08:46:55.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.730+0000 7f012be00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f012c072f40 con 0x7f012c15c5a0 2024-04-17T08:46:55.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.730+0000 7f012a000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f012c073b90 0x7f012c156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:55.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.730+0000 7f012a000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f012c073b90 0x7f012c156c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56684/0 (socket says 172.21.15.152:56684) 2024-04-17T08:46:55.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.730+0000 7f012a000640 1 -- 172.21.15.152:0/1415606876 learned_addr learned my addr 172.21.15.152:0/1415606876 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:55.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.730+0000 7f012b400640 1 --2- 172.21.15.152:0/1415606876 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f012c15c5a0 0x7f012c09d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:55.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.730+0000 7f012aa00640 1 --2- 172.21.15.152:0/1415606876 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f012c06fb40 0x7f012c15f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:55.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.730+0000 7f012a000640 1 -- 172.21.15.152:0/1415606876 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f012c15c5a0 msgr2=0x7f012c09d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:55.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.730+0000 7f012a000640 1 --2- 172.21.15.152:0/1415606876 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f012c15c5a0 0x7f012c09d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:55.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.730+0000 7f012a000640 1 -- 172.21.15.152:0/1415606876 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f012c06fb40 msgr2=0x7f012c15f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:55.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.730+0000 7f012a000640 1 --2- 172.21.15.152:0/1415606876 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f012c06fb40 0x7f012c15f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:55.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.730+0000 7f012a000640 1 -- 172.21.15.152:0/1415606876 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f012c157150 con 0x7f012c073b90 2024-04-17T08:46:55.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.730+0000 7f012a000640 1 --2- 172.21.15.152:0/1415606876 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f012c073b90 0x7f012c156c10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f011800c420 tx=0x7f011800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:55.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.730+0000 7f0122a00640 1 -- 172.21.15.152:0/1415606876 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01180074e0 con 0x7f012c073b90 2024-04-17T08:46:55.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.730+0000 7f0122a00640 1 -- 172.21.15.152:0/1415606876 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01180076a0 con 0x7f012c073b90 2024-04-17T08:46:55.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.730+0000 7f012be00640 1 -- 172.21.15.152:0/1415606876 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f012c09d8d0 con 0x7f012c073b90 2024-04-17T08:46:55.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.730+0000 7f0122a00640 1 -- 172.21.15.152:0/1415606876 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0118004a30 con 0x7f012c073b90 2024-04-17T08:46:55.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.730+0000 7f012be00640 1 -- 172.21.15.152:0/1415606876 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f012c15e9a0 con 0x7f012c073b90 2024-04-17T08:46:55.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.730+0000 7f012be00640 1 -- 172.21.15.152:0/1415606876 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f012c075c10 con 0x7f012c073b90 2024-04-17T08:46:55.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.730+0000 7f0122a00640 1 -- 172.21.15.152:0/1415606876 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f011801a020 con 0x7f012c073b90 2024-04-17T08:46:55.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.734+0000 7f0122a00640 1 --2- 172.21.15.152:0/1415606876 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f010c068380 0x7f010c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:55.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.734+0000 7f0122a00640 1 -- 172.21.15.152:0/1415606876 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0118086540 con 0x7f012c073b90 2024-04-17T08:46:55.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.734+0000 7f012aa00640 1 --2- 172.21.15.152:0/1415606876 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f010c068380 0x7f010c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:55.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.734+0000 7f012aa00640 1 --2- 172.21.15.152:0/1415606876 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f010c068380 0x7f010c06a840 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f012c157f80 tx=0x7f011c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:55.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.738+0000 7f0122a00640 1 -- 172.21.15.152:0/1415606876 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f01180567b0 con 0x7f012c073b90 2024-04-17T08:46:55.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.894+0000 7f012be00640 1 -- 172.21.15.152:0/1415606876 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f012c0d0e80 con 0x7f012c073b90 2024-04-17T08:46:55.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.894+0000 7f0122a00640 1 -- 172.21.15.152:0/1415606876 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7f01180560b0 con 0x7f012c073b90 2024-04-17T08:46:55.896 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:46:55.897 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":24,"fsid":"ce68f82e-ec5f-4205-9fd5-bdfdf6ef31e2","created":"2024-04-17T08:46:08.353546+0000","modified":"2024-04-17T08:46:38.659862+0000","last_up_change":"2024-04-17T08:46:20.738799+0000","last_in_change":"2024-04-17T08:46:11.210050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T08:46:21.386856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T08:46:31.812460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T08:46:32.555559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T08:46:36.258078+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"682f0192-187c-404e-bc7a-b6b4e23825e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6819","nonce":3603799291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6823","nonce":3603799291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6831","nonce":3603799291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6827","nonce":3603799291}]},"public_addr":"172.21.15.152:6819/3603799291","cluster_addr":"172.21.15.152:6823/3603799291","heartbeat_back_addr":"172.21.15.152:6831/3603799291","heartbeat_front_addr":"172.21.15.152:6827/3603799291","state":["exists","up"]},{"osd":1,"uuid":"f0fe8fef-60ec-4a39-83b6-2fa6a5adb0f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6801","nonce":4133383142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6803","nonce":4133383142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6807","nonce":4133383142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6805","nonce":4133383142}]},"public_addr":"172.21.15.152:6801/4133383142","cluster_addr":"172.21.15.152:6803/4133383142","heartbeat_back_addr":"172.21.15.152:6807/4133383142","heartbeat_front_addr":"172.21.15.152:6805/4133383142","state":["exists","up"]},{"osd":2,"uuid":"35f36d9c-5245-4431-a618-f4df0fa380ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6809","nonce":3826143898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6811","nonce":3826143898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6815","nonce":3826143898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6813","nonce":3826143898}]},"public_addr":"172.21.15.152:6809/3826143898","cluster_addr":"172.21.15.152:6811/3826143898","heartbeat_back_addr":"172.21.15.152:6815/3826143898","heartbeat_front_addr":"172.21.15.152:6813/3826143898","state":["exists","up"]},{"osd":3,"uuid":"96e56ca5-15b4-4895-9b79-da2c92043159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6818","nonce":165717826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6822","nonce":165717826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6830","nonce":165717826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6826","nonce":165717826}]},"public_addr":"172.21.15.152:6818/165717826","cluster_addr":"172.21.15.152:6822/165717826","heartbeat_back_addr":"172.21.15.152:6830/165717826","heartbeat_front_addr":"172.21.15.152:6826/165717826","state":["exists","up"]},{"osd":4,"uuid":"f5aa10a4-9ff9-41fe-a5c9-15326f982cc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6817","nonce":4080159297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6819","nonce":4080159297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6823","nonce":4080159297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6821","nonce":4080159297}]},"public_addr":"172.21.15.196:6817/4080159297","cluster_addr":"172.21.15.196:6819/4080159297","heartbeat_back_addr":"172.21.15.196:6823/4080159297","heartbeat_front_addr":"172.21.15.196:6821/4080159297","state":["exists","up"]},{"osd":5,"uuid":"42bab884-3476-47ae-ac65-935fa6e0f055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6801","nonce":3519444232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6803","nonce":3519444232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6807","nonce":3519444232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6805","nonce":3519444232}]},"public_addr":"172.21.15.196:6801/3519444232","cluster_addr":"172.21.15.196:6803/3519444232","heartbeat_back_addr":"172.21.15.196:6807/3519444232","heartbeat_front_addr":"172.21.15.196:6805/3519444232","state":["exists","up"]},{"osd":6,"uuid":"460b6167-f57b-4224-9c92-cfc9b80bbe99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6809","nonce":275739834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6811","nonce":275739834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6815","nonce":275739834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6813","nonce":275739834}]},"public_addr":"172.21.15.196:6809/275739834","cluster_addr":"172.21.15.196:6811/275739834","heartbeat_back_addr":"172.21.15.196:6815/275739834","heartbeat_front_addr":"172.21.15.196:6813/275739834","state":["exists","up"]},{"osd":7,"uuid":"d695643f-5e07-4e2a-a646-c06bd97b6650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6825","nonce":307626968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6827","nonce":307626968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6831","nonce":307626968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6829","nonce":307626968}]},"public_addr":"172.21.15.196:6825/307626968","cluster_addr":"172.21.15.196:6827/307626968","heartbeat_back_addr":"172.21.15.196:6831/307626968","heartbeat_front_addr":"172.21.15.196:6829/307626968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.293257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.964533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.248895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.010000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.832554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.743704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930171+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930962+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T08:46:55.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.898+0000 7f012be00640 1 -- 172.21.15.152:0/1415606876 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f010c068380 msgr2=0x7f010c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:55.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.898+0000 7f012be00640 1 --2- 172.21.15.152:0/1415606876 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f010c068380 0x7f010c06a840 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f012c157f80 tx=0x7f011c008040 comp rx=0 tx=0).stop 2024-04-17T08:46:55.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.898+0000 7f012be00640 1 -- 172.21.15.152:0/1415606876 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f012c073b90 msgr2=0x7f012c156c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:55.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.898+0000 7f012be00640 1 --2- 172.21.15.152:0/1415606876 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f012c073b90 0x7f012c156c10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f011800c420 tx=0x7f011800c8e0 comp rx=0 tx=0).stop 2024-04-17T08:46:55.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.898+0000 7f012be00640 1 -- 172.21.15.152:0/1415606876 shutdown_connections 2024-04-17T08:46:55.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.898+0000 7f012be00640 1 --2- 172.21.15.152:0/1415606876 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f010c068380 0x7f010c06a840 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:55.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.898+0000 7f012be00640 1 --2- 172.21.15.152:0/1415606876 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f012c15c5a0 0x7f012c09d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:55.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.898+0000 7f012be00640 1 --2- 172.21.15.152:0/1415606876 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f012c073b90 0x7f012c156c10 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:55.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.898+0000 7f012be00640 1 --2- 172.21.15.152:0/1415606876 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f012c06fb40 0x7f012c15f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:55.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.898+0000 7f012be00640 1 -- 172.21.15.152:0/1415606876 >> 172.21.15.152:0/1415606876 conn(0x7f012c0d0050 msgr2=0x7f012c0d0430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:55.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.898+0000 7f012be00640 1 -- 172.21.15.152:0/1415606876 shutdown_connections 2024-04-17T08:46:55.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:55.898+0000 7f012be00640 1 -- 172.21.15.152:0/1415606876 wait complete. 2024-04-17T08:46:55.918 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T08:46:56.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.054+0000 7fad4d000640 1 Processor -- start 2024-04-17T08:46:56.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.054+0000 7fad4d000640 1 -- start start 2024-04-17T08:46:56.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.054+0000 7fad4d000640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fad480d0a70 0x7fad48160010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:56.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.054+0000 7fad4d000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fad4815d710 0x7fad48160550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:56.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.054+0000 7fad4d000640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad48160a90 con 0x7fad4815a010 2024-04-17T08:46:56.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.054+0000 7fad4d000640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fad4815d280 con 0x7fad480d0a70 2024-04-17T08:46:56.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.054+0000 7fad4d000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fad4815c9d0 con 0x7fad4815d710 2024-04-17T08:46:56.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.054+0000 7fad45400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fad480d0a70 0x7fad48160010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:56.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.054+0000 7fad45e00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fad4815a010 0x7fad480d0360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:42808/0 (socket says 172.21.15.152:42808) 2024-04-17T08:46:56.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.054+0000 7fad45e00640 1 -- 172.21.15.152:0/740451939 learned_addr learned my addr 172.21.15.152:0/740451939 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:46:56.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.054+0000 7fad46800640 1 --2- 172.21.15.152:0/740451939 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fad4815d710 0x7fad48160550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:56.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.054+0000 7fad45400640 1 -- 172.21.15.152:0/740451939 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fad4815d710 msgr2=0x7fad48160550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:56.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.054+0000 7fad45400640 1 --2- 172.21.15.152:0/740451939 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fad4815d710 0x7fad48160550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:56.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.054+0000 7fad45400640 1 -- 172.21.15.152:0/740451939 >> v1:172.21.15.152:6789/0 conn(0x7fad4815a010 legacy=0x7fad480d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:56.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.054+0000 7fad45400640 1 -- 172.21.15.152:0/740451939 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad48160d20 con 0x7fad480d0a70 2024-04-17T08:46:56.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.054+0000 7fad44a00640 1 -- 172.21.15.152:0/740451939 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1654914780 0 0) 0x7fad48160a90 con 0x7fad4815a010 2024-04-17T08:46:56.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.054+0000 7fad46800640 1 --2- 172.21.15.152:0/740451939 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fad4815d710 0x7fad48160550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:46:56.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.058+0000 7fad45400640 1 --2- 172.21.15.152:0/740451939 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad480d0a70 0x7fad48160010 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fad4815d400 tx=0x7fad3401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c33c16772ee0bc26 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:56.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.058+0000 7fad44a00640 1 -- 172.21.15.152:0/740451939 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad340b0070 con 0x7fad480d0a70 2024-04-17T08:46:56.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.058+0000 7fad44a00640 1 -- 172.21.15.152:0/740451939 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad340ab600 con 0x7fad480d0a70 2024-04-17T08:46:56.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.058+0000 7fad44a00640 1 -- 172.21.15.152:0/740451939 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad340ab9d0 con 0x7fad480d0a70 2024-04-17T08:46:56.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.058+0000 7fad4d000640 1 -- 172.21.15.152:0/740451939 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad480d0a70 msgr2=0x7fad48160010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:56.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.058+0000 7fad4d000640 1 --2- 172.21.15.152:0/740451939 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad480d0a70 0x7fad48160010 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fad4815d400 tx=0x7fad3401c410 comp rx=0 tx=0).stop 2024-04-17T08:46:56.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.058+0000 7fad4d000640 1 -- 172.21.15.152:0/740451939 shutdown_connections 2024-04-17T08:46:56.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.058+0000 7fad4d000640 1 --2- 172.21.15.152:0/740451939 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fad4815d710 0x7fad48160550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:56.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.058+0000 7fad4d000640 1 --2- 172.21.15.152:0/740451939 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad480d0a70 0x7fad48160010 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:56.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.058+0000 7fad4d000640 1 -- 172.21.15.152:0/740451939 >> 172.21.15.152:0/740451939 conn(0x7fad480b3350 msgr2=0x7fad480b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:56.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.058+0000 7fad4d000640 1 -- 172.21.15.152:0/740451939 shutdown_connections 2024-04-17T08:46:56.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.058+0000 7fad4d000640 1 -- 172.21.15.152:0/740451939 wait complete. 2024-04-17T08:46:56.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.058+0000 7fad4d000640 1 Processor -- start 2024-04-17T08:46:56.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.058+0000 7fad4d000640 1 -- start start 2024-04-17T08:46:56.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.062+0000 7fad4d000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fad480d0a70 0x7fad481571e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:56.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.062+0000 7fad4d000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fad4815a010 0x7fad4814eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:56.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.062+0000 7fad4d000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad4815d710 0x7fad4814a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:56.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.062+0000 7fad4d000640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fad4815e570 con 0x7fad4815d710 2024-04-17T08:46:56.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.062+0000 7fad4d000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fad4815e3f0 con 0x7fad4815a010 2024-04-17T08:46:56.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.062+0000 7fad4d000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fad4815e6f0 con 0x7fad480d0a70 2024-04-17T08:46:56.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.062+0000 7fad46800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad4815d710 0x7fad4814a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:56.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.062+0000 7fad46800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad4815d710 0x7fad4814a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56706/0 (socket says 172.21.15.152:56706) 2024-04-17T08:46:56.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.062+0000 7fad46800640 1 -- 172.21.15.152:0/1114055938 learned_addr learned my addr 172.21.15.152:0/1114055938 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:56.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.062+0000 7fad45400640 1 --2- 172.21.15.152:0/1114055938 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fad4815a010 0x7fad4814eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:56.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.062+0000 7fad45e00640 1 --2- 172.21.15.152:0/1114055938 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fad480d0a70 0x7fad481571e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:56.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.062+0000 7fad46800640 1 -- 172.21.15.152:0/1114055938 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fad480d0a70 msgr2=0x7fad481571e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:56.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.062+0000 7fad46800640 1 --2- 172.21.15.152:0/1114055938 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fad480d0a70 0x7fad481571e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:56.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.062+0000 7fad46800640 1 -- 172.21.15.152:0/1114055938 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fad4815a010 msgr2=0x7fad4814eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:56.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.062+0000 7fad46800640 1 --2- 172.21.15.152:0/1114055938 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fad4815a010 0x7fad4814eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:56.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.062+0000 7fad46800640 1 -- 172.21.15.152:0/1114055938 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad4814f530 con 0x7fad4815d710 2024-04-17T08:46:56.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.062+0000 7fad46800640 1 --2- 172.21.15.152:0/1114055938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad4815d710 0x7fad4814a290 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fad4000c7f0 tx=0x7fad4000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:56.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.062+0000 7fad3e000640 1 -- 172.21.15.152:0/1114055938 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad40015020 con 0x7fad4815d710 2024-04-17T08:46:56.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.062+0000 7fad3e000640 1 -- 172.21.15.152:0/1114055938 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad40004250 con 0x7fad4815d710 2024-04-17T08:46:56.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.062+0000 7fad3e000640 1 -- 172.21.15.152:0/1114055938 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad40003620 con 0x7fad4815d710 2024-04-17T08:46:56.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.062+0000 7fad4d000640 1 -- 172.21.15.152:0/1114055938 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad4814f810 con 0x7fad4815d710 2024-04-17T08:46:56.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.062+0000 7fad4d000640 1 -- 172.21.15.152:0/1114055938 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad4814fdd0 con 0x7fad4815d710 2024-04-17T08:46:56.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.062+0000 7fad4d000640 1 -- 172.21.15.152:0/1114055938 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad48068a30 con 0x7fad4815d710 2024-04-17T08:46:56.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.062+0000 7fad3e000640 1 -- 172.21.15.152:0/1114055938 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fad40018020 con 0x7fad4815d710 2024-04-17T08:46:56.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.066+0000 7fad3e000640 1 --2- 172.21.15.152:0/1114055938 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fad28068380 0x7fad2806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:56.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.066+0000 7fad3e000640 1 -- 172.21.15.152:0/1114055938 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fad40086c20 con 0x7fad4815d710 2024-04-17T08:46:56.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.066+0000 7fad45e00640 1 --2- 172.21.15.152:0/1114055938 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fad28068380 0x7fad2806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:56.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.066+0000 7fad45e00640 1 --2- 172.21.15.152:0/1114055938 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fad28068380 0x7fad2806a840 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fad38007fd0 tx=0x7fad38007ee0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:56.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.070+0000 7fad3e000640 1 -- 172.21.15.152:0/1114055938 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fad4001f030 con 0x7fad4815d710 2024-04-17T08:46:56.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.226+0000 7fad4d000640 1 -- 172.21.15.152:0/1114055938 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fad4806d660 con 0x7fad4815d710 2024-04-17T08:46:56.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.226+0000 7fad3e000640 1 -- 172.21.15.152:0/1114055938 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7fad40056ea0 con 0x7fad4815d710 2024-04-17T08:46:56.228 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:46:56.229 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":24,"fsid":"ce68f82e-ec5f-4205-9fd5-bdfdf6ef31e2","created":"2024-04-17T08:46:08.353546+0000","modified":"2024-04-17T08:46:38.659862+0000","last_up_change":"2024-04-17T08:46:20.738799+0000","last_in_change":"2024-04-17T08:46:11.210050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T08:46:21.386856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T08:46:31.812460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T08:46:32.555559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T08:46:36.258078+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"682f0192-187c-404e-bc7a-b6b4e23825e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6819","nonce":3603799291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6823","nonce":3603799291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6831","nonce":3603799291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6827","nonce":3603799291}]},"public_addr":"172.21.15.152:6819/3603799291","cluster_addr":"172.21.15.152:6823/3603799291","heartbeat_back_addr":"172.21.15.152:6831/3603799291","heartbeat_front_addr":"172.21.15.152:6827/3603799291","state":["exists","up"]},{"osd":1,"uuid":"f0fe8fef-60ec-4a39-83b6-2fa6a5adb0f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6801","nonce":4133383142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6803","nonce":4133383142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6807","nonce":4133383142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6805","nonce":4133383142}]},"public_addr":"172.21.15.152:6801/4133383142","cluster_addr":"172.21.15.152:6803/4133383142","heartbeat_back_addr":"172.21.15.152:6807/4133383142","heartbeat_front_addr":"172.21.15.152:6805/4133383142","state":["exists","up"]},{"osd":2,"uuid":"35f36d9c-5245-4431-a618-f4df0fa380ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6809","nonce":3826143898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6811","nonce":3826143898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6815","nonce":3826143898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6813","nonce":3826143898}]},"public_addr":"172.21.15.152:6809/3826143898","cluster_addr":"172.21.15.152:6811/3826143898","heartbeat_back_addr":"172.21.15.152:6815/3826143898","heartbeat_front_addr":"172.21.15.152:6813/3826143898","state":["exists","up"]},{"osd":3,"uuid":"96e56ca5-15b4-4895-9b79-da2c92043159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6818","nonce":165717826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6822","nonce":165717826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6830","nonce":165717826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6826","nonce":165717826}]},"public_addr":"172.21.15.152:6818/165717826","cluster_addr":"172.21.15.152:6822/165717826","heartbeat_back_addr":"172.21.15.152:6830/165717826","heartbeat_front_addr":"172.21.15.152:6826/165717826","state":["exists","up"]},{"osd":4,"uuid":"f5aa10a4-9ff9-41fe-a5c9-15326f982cc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6817","nonce":4080159297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6819","nonce":4080159297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6823","nonce":4080159297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6821","nonce":4080159297}]},"public_addr":"172.21.15.196:6817/4080159297","cluster_addr":"172.21.15.196:6819/4080159297","heartbeat_back_addr":"172.21.15.196:6823/4080159297","heartbeat_front_addr":"172.21.15.196:6821/4080159297","state":["exists","up"]},{"osd":5,"uuid":"42bab884-3476-47ae-ac65-935fa6e0f055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6801","nonce":3519444232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6803","nonce":3519444232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6807","nonce":3519444232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6805","nonce":3519444232}]},"public_addr":"172.21.15.196:6801/3519444232","cluster_addr":"172.21.15.196:6803/3519444232","heartbeat_back_addr":"172.21.15.196:6807/3519444232","heartbeat_front_addr":"172.21.15.196:6805/3519444232","state":["exists","up"]},{"osd":6,"uuid":"460b6167-f57b-4224-9c92-cfc9b80bbe99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6809","nonce":275739834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6811","nonce":275739834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6815","nonce":275739834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6813","nonce":275739834}]},"public_addr":"172.21.15.196:6809/275739834","cluster_addr":"172.21.15.196:6811/275739834","heartbeat_back_addr":"172.21.15.196:6815/275739834","heartbeat_front_addr":"172.21.15.196:6813/275739834","state":["exists","up"]},{"osd":7,"uuid":"d695643f-5e07-4e2a-a646-c06bd97b6650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6825","nonce":307626968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6827","nonce":307626968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6831","nonce":307626968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6829","nonce":307626968}]},"public_addr":"172.21.15.196:6825/307626968","cluster_addr":"172.21.15.196:6827/307626968","heartbeat_back_addr":"172.21.15.196:6831/307626968","heartbeat_front_addr":"172.21.15.196:6829/307626968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.293257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.964533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.248895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.010000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.832554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.743704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930171+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930962+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T08:46:56.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.230+0000 7fad4d000640 1 -- 172.21.15.152:0/1114055938 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fad28068380 msgr2=0x7fad2806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:56.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.230+0000 7fad4d000640 1 --2- 172.21.15.152:0/1114055938 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fad28068380 0x7fad2806a840 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fad38007fd0 tx=0x7fad38007ee0 comp rx=0 tx=0).stop 2024-04-17T08:46:56.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.230+0000 7fad4d000640 1 -- 172.21.15.152:0/1114055938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad4815d710 msgr2=0x7fad4814a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:56.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.230+0000 7fad4d000640 1 --2- 172.21.15.152:0/1114055938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad4815d710 0x7fad4814a290 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fad4000c7f0 tx=0x7fad4000ccb0 comp rx=0 tx=0).stop 2024-04-17T08:46:56.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.230+0000 7fad4d000640 1 -- 172.21.15.152:0/1114055938 shutdown_connections 2024-04-17T08:46:56.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.230+0000 7fad4d000640 1 --2- 172.21.15.152:0/1114055938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad4815d710 0x7fad4814a290 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:56.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.230+0000 7fad4d000640 1 --2- 172.21.15.152:0/1114055938 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fad4815a010 0x7fad4814eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:56.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.230+0000 7fad4d000640 1 --2- 172.21.15.152:0/1114055938 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fad28068380 0x7fad2806a840 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:56.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.230+0000 7fad4d000640 1 --2- 172.21.15.152:0/1114055938 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fad480d0a70 0x7fad481571e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:56.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.230+0000 7fad4d000640 1 -- 172.21.15.152:0/1114055938 >> 172.21.15.152:0/1114055938 conn(0x7fad480b3350 msgr2=0x7fad4815ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:56.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.230+0000 7fad4d000640 1 -- 172.21.15.152:0/1114055938 shutdown_connections 2024-04-17T08:46:56.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.230+0000 7fad4d000640 1 -- 172.21.15.152:0/1114055938 wait complete. 2024-04-17T08:46:56.250 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-17T08:46:56.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.386+0000 7f44f6400640 1 Processor -- start 2024-04-17T08:46:56.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.386+0000 7f44f6400640 1 -- start start 2024-04-17T08:46:56.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.390+0000 7f44f6400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f44f015a010 0x7f44f00d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:56.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.390+0000 7f44f6400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f44f015d710 0x7f44f00d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:56.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.390+0000 7f44f6400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44f0160d20 con 0x7f44f0160010 2024-04-17T08:46:56.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.390+0000 7f44f6400640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f44f015d280 con 0x7f44f015d710 2024-04-17T08:46:56.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.390+0000 7f44f6400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f44f015c9d0 con 0x7f44f015a010 2024-04-17T08:46:56.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.390+0000 7f44eea00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f44f015d710 0x7f44f00d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:56.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.390+0000 7f44eea00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f44f015d710 0x7f44f00d08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56722/0 (socket says 172.21.15.152:56722) 2024-04-17T08:46:56.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.390+0000 7f44eea00640 1 -- 172.21.15.152:0/2959335210 learned_addr learned my addr 172.21.15.152:0/2959335210 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:56.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.390+0000 7f44ef400640 1 --2- 172.21.15.152:0/2959335210 >> v2:172.21.15.196:3300/0 conn(0x7f44f015a010 0x7f44f00d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:56.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.390+0000 7f44eea00640 1 -- 172.21.15.152:0/2959335210 >> v2:172.21.15.196:3300/0 conn(0x7f44f015a010 msgr2=0x7f44f00d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:56.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.390+0000 7f44eea00640 1 --2- 172.21.15.152:0/2959335210 >> v2:172.21.15.196:3300/0 conn(0x7f44f015a010 0x7f44f00d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:56.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.390+0000 7f44eea00640 1 -- 172.21.15.152:0/2959335210 >> v1:172.21.15.196:6789/0 conn(0x7f44f0160010 legacy=0x7f44f0160450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:56.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.390+0000 7f44eea00640 1 -- 172.21.15.152:0/2959335210 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44f015cc30 con 0x7f44f015d710 2024-04-17T08:46:56.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.390+0000 7f44ef400640 1 --2- 172.21.15.152:0/2959335210 >> v2:172.21.15.196:3300/0 conn(0x7f44f015a010 0x7f44f00d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:46:56.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.394+0000 7f44eea00640 1 --2- 172.21.15.152:0/2959335210 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44f015d710 0x7f44f00d08a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f44f006d9d0 tx=0x7f44dc01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ee24e271b6aea61 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:56.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.394+0000 7f44ee000640 1 -- 172.21.15.152:0/2959335210 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44dc0b1070 con 0x7f44f015d710 2024-04-17T08:46:56.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.394+0000 7f44ee000640 1 -- 172.21.15.152:0/2959335210 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44dc0ac600 con 0x7f44f015d710 2024-04-17T08:46:56.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.394+0000 7f44ee000640 1 -- 172.21.15.152:0/2959335210 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44dc0ac9d0 con 0x7f44f015d710 2024-04-17T08:46:56.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.394+0000 7f44f6400640 1 -- 172.21.15.152:0/2959335210 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44f015d710 msgr2=0x7f44f00d08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:56.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.394+0000 7f44f6400640 1 --2- 172.21.15.152:0/2959335210 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44f015d710 0x7f44f00d08a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f44f006d9d0 tx=0x7f44dc01c490 comp rx=0 tx=0).stop 2024-04-17T08:46:56.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.394+0000 7f44f6400640 1 -- 172.21.15.152:0/2959335210 shutdown_connections 2024-04-17T08:46:56.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.394+0000 7f44f6400640 1 --2- 172.21.15.152:0/2959335210 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44f015d710 0x7f44f00d08a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:56.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.394+0000 7f44f6400640 1 --2- 172.21.15.152:0/2959335210 >> v2:172.21.15.196:3300/0 conn(0x7f44f015a010 0x7f44f00d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:56.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.394+0000 7f44f6400640 1 -- 172.21.15.152:0/2959335210 >> 172.21.15.152:0/2959335210 conn(0x7f44f00b3350 msgr2=0x7f44f00b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:56.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.394+0000 7f44f6400640 1 -- 172.21.15.152:0/2959335210 shutdown_connections 2024-04-17T08:46:56.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.394+0000 7f44f6400640 1 -- 172.21.15.152:0/2959335210 wait complete. 2024-04-17T08:46:56.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.394+0000 7f44f6400640 1 Processor -- start 2024-04-17T08:46:56.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.394+0000 7f44f6400640 1 -- start start 2024-04-17T08:46:56.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.394+0000 7f44f6400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44f015a010 0x7f44f0152500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:56.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.394+0000 7f44f6400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44f015d710 0x7f44f01540e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:56.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.398+0000 7f44f6400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44f0160010 0x7f44f0155b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:56.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.398+0000 7f44f6400640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f44f015e780 con 0x7f44f015a010 2024-04-17T08:46:56.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.398+0000 7f44f6400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f44f015e600 con 0x7f44f0160010 2024-04-17T08:46:56.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.398+0000 7f44f6400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f44f015e900 con 0x7f44f015d710 2024-04-17T08:46:56.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.398+0000 7f44ef400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44f015a010 0x7f44f0152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:56.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.398+0000 7f44ef400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44f015a010 0x7f44f0152500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56728/0 (socket says 172.21.15.152:56728) 2024-04-17T08:46:56.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.398+0000 7f44ef400640 1 -- 172.21.15.152:0/2843151683 learned_addr learned my addr 172.21.15.152:0/2843151683 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:56.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.398+0000 7f44eea00640 1 --2- 172.21.15.152:0/2843151683 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44f015d710 0x7f44f01540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:56.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.398+0000 7f44efe00640 1 --2- 172.21.15.152:0/2843151683 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44f0160010 0x7f44f0155b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:56.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.398+0000 7f44ef400640 1 -- 172.21.15.152:0/2843151683 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44f015d710 msgr2=0x7f44f01540e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:56.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.398+0000 7f44ef400640 1 --2- 172.21.15.152:0/2843151683 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44f015d710 0x7f44f01540e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:56.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.398+0000 7f44ef400640 1 -- 172.21.15.152:0/2843151683 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44f0160010 msgr2=0x7f44f0155b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:56.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.398+0000 7f44ef400640 1 --2- 172.21.15.152:0/2843151683 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44f0160010 0x7f44f0155b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:56.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.398+0000 7f44ef400640 1 -- 172.21.15.152:0/2843151683 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44f006dfd0 con 0x7f44f015a010 2024-04-17T08:46:56.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.398+0000 7f44ef400640 1 --2- 172.21.15.152:0/2843151683 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44f015a010 0x7f44f0152500 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f44e0009fc0 tx=0x7f44e000d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:56.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.398+0000 7f44e7400640 1 -- 172.21.15.152:0/2843151683 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e001a070 con 0x7f44f015a010 2024-04-17T08:46:56.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.398+0000 7f44e7400640 1 -- 172.21.15.152:0/2843151683 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44e0003ba0 con 0x7f44f015a010 2024-04-17T08:46:56.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.398+0000 7f44e7400640 1 -- 172.21.15.152:0/2843151683 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e0004030 con 0x7f44f015a010 2024-04-17T08:46:56.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.398+0000 7f44f6400640 1 -- 172.21.15.152:0/2843151683 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44f006e2b0 con 0x7f44f015a010 2024-04-17T08:46:56.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.398+0000 7f44f6400640 1 -- 172.21.15.152:0/2843151683 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44f006e870 con 0x7f44f015a010 2024-04-17T08:46:56.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.398+0000 7f44f6400640 1 -- 172.21.15.152:0/2843151683 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44f0068a30 con 0x7f44f015a010 2024-04-17T08:46:56.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.398+0000 7f44e7400640 1 -- 172.21.15.152:0/2843151683 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f44e001d070 con 0x7f44f015a010 2024-04-17T08:46:56.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.402+0000 7f44e7400640 1 --2- 172.21.15.152:0/2843151683 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f44d0068380 0x7f44d006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:56.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.402+0000 7f44e7400640 1 -- 172.21.15.152:0/2843151683 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f44e0086f80 con 0x7f44f015a010 2024-04-17T08:46:56.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.402+0000 7f44eea00640 1 --2- 172.21.15.152:0/2843151683 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f44d0068380 0x7f44d006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:56.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.402+0000 7f44eea00640 1 --2- 172.21.15.152:0/2843151683 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f44d0068380 0x7f44d006a840 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f44dc0ae000 tx=0x7f44dc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:56.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.406+0000 7f44e7400640 1 -- 172.21.15.152:0/2843151683 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f44e0010070 con 0x7f44f015a010 2024-04-17T08:46:56.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:56.594+0000 7f44f6400640 1 -- 172.21.15.152:0/2843151683 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f44f006d660 con 0x7f44f015a010 2024-04-17T08:46:57.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.450+0000 7f44e7400640 1 -- 172.21.15.152:0/2843151683 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) ==== 118+0+0 (secure 0 0 0) 0x7f44e0056ba0 con 0x7f44f015a010 2024-04-17T08:46:57.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.454+0000 7f44f6400640 1 -- 172.21.15.152:0/2843151683 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f44d0068380 msgr2=0x7f44d006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:57.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.454+0000 7f44f6400640 1 --2- 172.21.15.152:0/2843151683 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f44d0068380 0x7f44d006a840 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f44dc0ae000 tx=0x7f44dc008040 comp rx=0 tx=0).stop 2024-04-17T08:46:57.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.454+0000 7f44f6400640 1 -- 172.21.15.152:0/2843151683 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44f015a010 msgr2=0x7f44f0152500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:57.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.454+0000 7f44f6400640 1 --2- 172.21.15.152:0/2843151683 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44f015a010 0x7f44f0152500 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f44e0009fc0 tx=0x7f44e000d560 comp rx=0 tx=0).stop 2024-04-17T08:46:57.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.454+0000 7f44f6400640 1 -- 172.21.15.152:0/2843151683 shutdown_connections 2024-04-17T08:46:57.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.454+0000 7f44f6400640 1 --2- 172.21.15.152:0/2843151683 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44f0160010 0x7f44f0155b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:57.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.454+0000 7f44f6400640 1 --2- 172.21.15.152:0/2843151683 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f44d0068380 0x7f44d006a840 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:57.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.454+0000 7f44f6400640 1 --2- 172.21.15.152:0/2843151683 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44f015d710 0x7f44f01540e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:57.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.454+0000 7f44f6400640 1 --2- 172.21.15.152:0/2843151683 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44f015a010 0x7f44f0152500 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:57.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.454+0000 7f44f6400640 1 -- 172.21.15.152:0/2843151683 >> 172.21.15.152:0/2843151683 conn(0x7f44f00b3350 msgr2=0x7f44f00cf540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:57.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.454+0000 7f44f6400640 1 -- 172.21.15.152:0/2843151683 shutdown_connections 2024-04-17T08:46:57.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.454+0000 7f44f6400640 1 -- 172.21.15.152:0/2843151683 wait complete. 2024-04-17T08:46:57.478 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-04-17T08:46:57.478 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-17T08:46:57.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.618+0000 7fdf0de00640 1 Processor -- start 2024-04-17T08:46:57.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.618+0000 7fdf0de00640 1 -- start start 2024-04-17T08:46:57.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.618+0000 7fdf0de00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fdf0815d710 0x7fdf08160720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:57.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.618+0000 7fdf0de00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf08160d20 con 0x7fdf080d0a70 2024-04-17T08:46:57.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.618+0000 7fdf0de00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf0815cc30 con 0x7fdf0815a010 2024-04-17T08:46:57.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.618+0000 7fdf0de00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fdf0815d280 con 0x7fdf0815d710 2024-04-17T08:46:57.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.618+0000 7fdefe000640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fdf080d0a70 0x7fdf08160010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:42822/0 (socket says 172.21.15.152:42822) 2024-04-17T08:46:57.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.618+0000 7fdefe000640 1 -- 172.21.15.152:0/3608068492 learned_addr learned my addr 172.21.15.152:0/3608068492 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:46:57.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.618+0000 7fdf07400640 1 --2- 172.21.15.152:0/3608068492 >> v2:172.21.15.196:3300/0 conn(0x7fdf0815d710 0x7fdf08160720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:57.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.618+0000 7fdf06000640 1 -- 172.21.15.152:0/3608068492 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2686162628 0 0) 0x7fdf08160d20 con 0x7fdf080d0a70 2024-04-17T08:46:57.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.618+0000 7fdf06000640 1 -- 172.21.15.152:0/3608068492 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdeec003530 con 0x7fdf080d0a70 2024-04-17T08:46:57.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.618+0000 7fdf07400640 1 -- 172.21.15.152:0/3608068492 >> v1:172.21.15.196:6789/0 conn(0x7fdf0815a010 legacy=0x7fdf080d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:57.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.618+0000 7fdf06000640 1 -- 172.21.15.152:0/3608068492 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3463707463 0 0) 0x7fdf0815cc30 con 0x7fdf0815a010 2024-04-17T08:46:57.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.618+0000 7fdf07400640 1 -- 172.21.15.152:0/3608068492 >> v1:172.21.15.152:6789/0 conn(0x7fdf080d0a70 legacy=0x7fdf08160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:57.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.618+0000 7fdf07400640 1 -- 172.21.15.152:0/3608068492 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf0815cf10 con 0x7fdf0815d710 2024-04-17T08:46:57.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.622+0000 7fdf07400640 1 --2- 172.21.15.152:0/3608068492 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdf0815d710 0x7fdf08160720 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdf000097c0 tx=0x7fdf0001c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6999b42f2da3d726 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:57.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.622+0000 7fdf06000640 1 -- 172.21.15.152:0/3608068492 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf000b0070 con 0x7fdf0815d710 2024-04-17T08:46:57.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.622+0000 7fdf06000640 1 -- 172.21.15.152:0/3608068492 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf000ab600 con 0x7fdf0815d710 2024-04-17T08:46:57.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.622+0000 7fdf06000640 1 -- 172.21.15.152:0/3608068492 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf000ab9d0 con 0x7fdf0815d710 2024-04-17T08:46:57.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.622+0000 7fdf0de00640 1 -- 172.21.15.152:0/3608068492 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdf0815d710 msgr2=0x7fdf08160720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:57.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.622+0000 7fdf0de00640 1 --2- 172.21.15.152:0/3608068492 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdf0815d710 0x7fdf08160720 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdf000097c0 tx=0x7fdf0001c410 comp rx=0 tx=0).stop 2024-04-17T08:46:57.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.622+0000 7fdf0de00640 1 -- 172.21.15.152:0/3608068492 shutdown_connections 2024-04-17T08:46:57.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.622+0000 7fdf0de00640 1 --2- 172.21.15.152:0/3608068492 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdf0815d710 0x7fdf08160720 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:57.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.622+0000 7fdf0de00640 1 -- 172.21.15.152:0/3608068492 >> 172.21.15.152:0/3608068492 conn(0x7fdf080b3350 msgr2=0x7fdf080b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:57.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.622+0000 7fdf0de00640 1 -- 172.21.15.152:0/3608068492 shutdown_connections 2024-04-17T08:46:57.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.622+0000 7fdf0de00640 1 -- 172.21.15.152:0/3608068492 wait complete. 2024-04-17T08:46:57.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.626+0000 7fdf0de00640 1 Processor -- start 2024-04-17T08:46:57.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.626+0000 7fdf0de00640 1 -- start start 2024-04-17T08:46:57.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.626+0000 7fdf0de00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdf080d0a70 0x7fdf081666e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:57.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.626+0000 7fdf0de00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdf0815a010 0x7fdf08147920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:57.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.626+0000 7fdf0de00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf0815d710 0x7fdf08147e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:57.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.626+0000 7fdf0de00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdf08169f50 con 0x7fdf0815d710 2024-04-17T08:46:57.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.626+0000 7fdf0de00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fdf08169dd0 con 0x7fdf0815a010 2024-04-17T08:46:57.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.626+0000 7fdf0de00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fdf0816a0d0 con 0x7fdf080d0a70 2024-04-17T08:46:57.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.626+0000 7fdf07400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf0815d710 0x7fdf08147e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:57.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.626+0000 7fdf07400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf0815d710 0x7fdf08147e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56744/0 (socket says 172.21.15.152:56744) 2024-04-17T08:46:57.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.626+0000 7fdf07400640 1 -- 172.21.15.152:0/2432222169 learned_addr learned my addr 172.21.15.152:0/2432222169 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:57.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.626+0000 7fdefe000640 1 --2- 172.21.15.152:0/2432222169 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdf0815a010 0x7fdf08147920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:57.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.626+0000 7fdf06a00640 1 --2- 172.21.15.152:0/2432222169 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdf080d0a70 0x7fdf081666e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:57.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.626+0000 7fdf07400640 1 -- 172.21.15.152:0/2432222169 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdf080d0a70 msgr2=0x7fdf081666e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:57.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.626+0000 7fdf07400640 1 --2- 172.21.15.152:0/2432222169 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdf080d0a70 0x7fdf081666e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:57.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.626+0000 7fdf07400640 1 -- 172.21.15.152:0/2432222169 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdf0815a010 msgr2=0x7fdf08147920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:57.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.626+0000 7fdf07400640 1 --2- 172.21.15.152:0/2432222169 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdf0815a010 0x7fdf08147920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:57.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.626+0000 7fdf07400640 1 -- 172.21.15.152:0/2432222169 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf0815ef50 con 0x7fdf0815d710 2024-04-17T08:46:57.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.626+0000 7fdefe000640 1 --2- 172.21.15.152:0/2432222169 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdf0815a010 0x7fdf08147920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:46:57.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.626+0000 7fdf07400640 1 --2- 172.21.15.152:0/2432222169 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf0815d710 0x7fdf08147e60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdf000ae040 tx=0x7fdf0001ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:57.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.626+0000 7fdeffe00640 1 -- 172.21.15.152:0/2432222169 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf000bb020 con 0x7fdf0815d710 2024-04-17T08:46:57.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.626+0000 7fdeffe00640 1 -- 172.21.15.152:0/2432222169 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf000b1040 con 0x7fdf0815d710 2024-04-17T08:46:57.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.626+0000 7fdf0de00640 1 -- 172.21.15.152:0/2432222169 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf0815f230 con 0x7fdf0815d710 2024-04-17T08:46:57.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.626+0000 7fdeffe00640 1 -- 172.21.15.152:0/2432222169 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf000b0050 con 0x7fdf0815d710 2024-04-17T08:46:57.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.626+0000 7fdf0de00640 1 -- 172.21.15.152:0/2432222169 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf0815f7f0 con 0x7fdf0815d710 2024-04-17T08:46:57.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.630+0000 7fdf0de00640 1 -- 172.21.15.152:0/2432222169 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf08068a30 con 0x7fdf0815d710 2024-04-17T08:46:57.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.630+0000 7fdeffe00640 1 -- 172.21.15.152:0/2432222169 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdf000be070 con 0x7fdf0815d710 2024-04-17T08:46:57.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.630+0000 7fdeffe00640 1 --2- 172.21.15.152:0/2432222169 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fdee4068380 0x7fdee406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:57.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.630+0000 7fdeffe00640 1 -- 172.21.15.152:0/2432222169 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fdf00120440 con 0x7fdf0815d710 2024-04-17T08:46:57.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.630+0000 7fdf06a00640 1 --2- 172.21.15.152:0/2432222169 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fdee4068380 0x7fdee406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:57.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.630+0000 7fdf06a00640 1 --2- 172.21.15.152:0/2432222169 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fdee4068380 0x7fdee406a840 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdef80012f0 tx=0x7fdef8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:57.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.634+0000 7fdeffe00640 1 -- 172.21.15.152:0/2432222169 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fdf00016090 con 0x7fdf0815d710 2024-04-17T08:46:57.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:57.826+0000 7fdf0de00640 1 -- 172.21.15.152:0/2432222169 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fdf0806d660 con 0x7fdf0815d710 2024-04-17T08:46:58.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.454+0000 7fdeffe00640 1 -- 172.21.15.152:0/2432222169 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) ==== 122+0+0 (secure 0 0 0) 0x7fdf000f06b0 con 0x7fdf0815d710 2024-04-17T08:46:58.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.458+0000 7fdf0de00640 1 -- 172.21.15.152:0/2432222169 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fdee4068380 msgr2=0x7fdee406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:58.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.458+0000 7fdf0de00640 1 --2- 172.21.15.152:0/2432222169 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fdee4068380 0x7fdee406a840 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdef80012f0 tx=0x7fdef8009040 comp rx=0 tx=0).stop 2024-04-17T08:46:58.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.458+0000 7fdf0de00640 1 -- 172.21.15.152:0/2432222169 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf0815d710 msgr2=0x7fdf08147e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:58.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.458+0000 7fdf0de00640 1 --2- 172.21.15.152:0/2432222169 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf0815d710 0x7fdf08147e60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdf000ae040 tx=0x7fdf0001ac50 comp rx=0 tx=0).stop 2024-04-17T08:46:58.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.458+0000 7fdf0de00640 1 -- 172.21.15.152:0/2432222169 shutdown_connections 2024-04-17T08:46:58.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.458+0000 7fdf0de00640 1 --2- 172.21.15.152:0/2432222169 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf0815d710 0x7fdf08147e60 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:58.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.458+0000 7fdf0de00640 1 --2- 172.21.15.152:0/2432222169 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdf0815a010 0x7fdf08147920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:58.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.458+0000 7fdf0de00640 1 --2- 172.21.15.152:0/2432222169 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fdee4068380 0x7fdee406a840 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:58.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.458+0000 7fdf0de00640 1 --2- 172.21.15.152:0/2432222169 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdf080d0a70 0x7fdf081666e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:58.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.458+0000 7fdf0de00640 1 -- 172.21.15.152:0/2432222169 >> 172.21.15.152:0/2432222169 conn(0x7fdf080b3350 msgr2=0x7fdf0815b180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:58.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.458+0000 7fdf0de00640 1 -- 172.21.15.152:0/2432222169 shutdown_connections 2024-04-17T08:46:58.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.458+0000 7fdf0de00640 1 -- 172.21.15.152:0/2432222169 wait complete. 2024-04-17T08:46:58.481 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-17T08:46:58.481 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T08:46:58.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.618+0000 7f1bbf200640 1 Processor -- start 2024-04-17T08:46:58.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.618+0000 7f1bbf200640 1 -- start start 2024-04-17T08:46:58.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.618+0000 7f1bbf200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f1bc00cf6e0 0x7f1bc00d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:58.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.618+0000 7f1bbf200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1bc00cc920 0x7f1bc00ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:58.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.618+0000 7f1bbf200640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bc00b54a0 con 0x7f1bc00cf300 2024-04-17T08:46:58.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.618+0000 7f1bbf200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f1bc00d01d0 con 0x7f1bc00cf6e0 2024-04-17T08:46:58.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.618+0000 7f1bbf200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f1bc00b5780 con 0x7f1bc00cc920 2024-04-17T08:46:58.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.618+0000 7f1bbde00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f1bc00cf300 0x7f1bc015f6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:58334/0 (socket says 172.21.15.152:58334) 2024-04-17T08:46:58.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.618+0000 7f1bbde00640 1 -- 172.21.15.152:0/564988792 learned_addr learned my addr 172.21.15.152:0/564988792 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:46:58.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.618+0000 7f1bbd400640 1 --2- 172.21.15.152:0/564988792 >> v2:172.21.15.196:3300/0 conn(0x7f1bc00cf6e0 0x7f1bc00d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:58.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.618+0000 7f1bbe800640 1 --2- 172.21.15.152:0/564988792 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1bc00cc920 0x7f1bc00ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:58.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.618+0000 7f1bbca00640 1 -- 172.21.15.152:0/564988792 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1154190525 0 0) 0x7f1bc00b54a0 con 0x7f1bc00cf300 2024-04-17T08:46:58.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.618+0000 7f1bbca00640 1 -- 172.21.15.152:0/564988792 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ba4003530 con 0x7f1bc00cf300 2024-04-17T08:46:58.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.618+0000 7f1bbca00640 1 -- 172.21.15.152:0/564988792 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2949321074 0 0) 0x7f1ba4003530 con 0x7f1bc00cf300 2024-04-17T08:46:58.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.618+0000 7f1bbca00640 1 -- 172.21.15.152:0/564988792 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1bc00cc920 msgr2=0x7f1bc00ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:58.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.618+0000 7f1bbca00640 1 --2- 172.21.15.152:0/564988792 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1bc00cc920 0x7f1bc00ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:58.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.618+0000 7f1bbca00640 1 -- 172.21.15.152:0/564988792 >> v2:172.21.15.196:3300/0 conn(0x7f1bc00cf6e0 msgr2=0x7f1bc00d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:58.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.618+0000 7f1bbca00640 1 --2- 172.21.15.152:0/564988792 >> v2:172.21.15.196:3300/0 conn(0x7f1bc00cf6e0 0x7f1bc00d0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:58.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.618+0000 7f1bbca00640 1 -- 172.21.15.152:0/564988792 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bc00d0420 con 0x7f1bc00cf300 2024-04-17T08:46:58.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.618+0000 7f1bbca00640 1 -- 172.21.15.152:0/564988792 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2973887244 0 0) 0x7f1bb0001680 con 0x7f1bc00cf300 2024-04-17T08:46:58.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.618+0000 7f1bbca00640 1 -- 172.21.15.152:0/564988792 >> v1:172.21.15.152:6789/0 conn(0x7f1bc00cf300 legacy=0x7f1bc015f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:58.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.618+0000 7f1bbca00640 1 --2- 172.21.15.152:0/564988792 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1ba40039c0 0x7f1ba4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:58.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.618+0000 7f1bbca00640 1 --2- 172.21.15.152:0/564988792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ba4004810 0x7f1ba4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:58.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.618+0000 7f1bbca00640 1 --2- 172.21.15.152:0/564988792 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1bc00cc920 0x7f1ba40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:58.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.618+0000 7f1bbca00640 1 -- 172.21.15.152:0/564988792 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc00d01d0 con 0x7f1ba4004810 2024-04-17T08:46:58.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.618+0000 7f1bbca00640 1 -- 172.21.15.152:0/564988792 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc00b5780 con 0x7f1ba40039c0 2024-04-17T08:46:58.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.618+0000 7f1bbca00640 1 -- 172.21.15.152:0/564988792 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f1ba400b9d0 con 0x7f1bc00cc920 2024-04-17T08:46:58.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.618+0000 7f1bbd400640 1 --2- 172.21.15.152:0/564988792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ba4004810 0x7f1ba4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:58.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.618+0000 7f1bbe800640 1 --2- 172.21.15.152:0/564988792 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1bc00cc920 0x7f1ba40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:58.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.618+0000 7f1bbde00640 1 --2- 172.21.15.152:0/564988792 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1ba40039c0 0x7f1ba4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:58.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.618+0000 7f1bbd400640 1 -- 172.21.15.152:0/564988792 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1bc00cc920 msgr2=0x7f1ba40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:58.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.618+0000 7f1bbd400640 1 --2- 172.21.15.152:0/564988792 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1bc00cc920 0x7f1ba40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:58.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.618+0000 7f1bbd400640 1 -- 172.21.15.152:0/564988792 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1ba40039c0 msgr2=0x7f1ba4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:58.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.618+0000 7f1bbd400640 1 --2- 172.21.15.152:0/564988792 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1ba40039c0 0x7f1ba4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:58.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.618+0000 7f1bbd400640 1 -- 172.21.15.152:0/564988792 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ba4003530 con 0x7f1ba4004810 2024-04-17T08:46:58.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.622+0000 7f1bbd400640 1 --2- 172.21.15.152:0/564988792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ba4004810 0x7f1ba4004c90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1bac009b10 tx=0x7f1bac01cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5d3b436046d1505 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:58.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.622+0000 7f1bbca00640 1 -- 172.21.15.152:0/564988792 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bac0096b0 con 0x7f1ba4004810 2024-04-17T08:46:58.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.622+0000 7f1bbca00640 1 -- 172.21.15.152:0/564988792 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bac0a6460 con 0x7f1ba4004810 2024-04-17T08:46:58.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.622+0000 7f1bbca00640 1 -- 172.21.15.152:0/564988792 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bac0a6850 con 0x7f1ba4004810 2024-04-17T08:46:58.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.622+0000 7f1bbf200640 1 -- 172.21.15.152:0/564988792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ba4004810 msgr2=0x7f1ba4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:58.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.622+0000 7f1bbf200640 1 --2- 172.21.15.152:0/564988792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ba4004810 0x7f1ba4004c90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1bac009b10 tx=0x7f1bac01cab0 comp rx=0 tx=0).stop 2024-04-17T08:46:58.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.622+0000 7f1bbe800640 1 -- 172.21.15.152:0/564988792 reap_dead start 2024-04-17T08:46:58.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.622+0000 7f1bbf200640 1 -- 172.21.15.152:0/564988792 shutdown_connections 2024-04-17T08:46:58.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.622+0000 7f1bbf200640 1 -- 172.21.15.152:0/564988792 >> 172.21.15.152:0/564988792 conn(0x7f1bc00b3e40 msgr2=0x7f1bc00b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:58.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.622+0000 7f1bbf200640 1 -- 172.21.15.152:0/564988792 shutdown_connections 2024-04-17T08:46:58.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.622+0000 7f1bbf200640 1 -- 172.21.15.152:0/564988792 wait complete. 2024-04-17T08:46:58.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.626+0000 7f1bbf200640 1 Processor -- start 2024-04-17T08:46:58.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.626+0000 7f1bbf200640 1 -- start start 2024-04-17T08:46:58.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.626+0000 7f1bbf200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ba4004810 0x7f1bc0157f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:58.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.626+0000 7f1bbf200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1bc00c65d0 0x7f1bc00c6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:58.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.626+0000 7f1bbf200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1bc00ca2c0 0x7f1bc00ca740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:58.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.626+0000 7f1bbf200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc00cd140 con 0x7f1ba4004810 2024-04-17T08:46:58.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.626+0000 7f1bbf200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc00d1140 con 0x7f1bc00ca2c0 2024-04-17T08:46:58.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.626+0000 7f1bbf200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f1bc00cbb90 con 0x7f1bc00c65d0 2024-04-17T08:46:58.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.626+0000 7f1bbde00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ba4004810 0x7f1bc0157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:58.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.626+0000 7f1bbde00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ba4004810 0x7f1bc0157f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46546/0 (socket says 172.21.15.152:46546) 2024-04-17T08:46:58.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.626+0000 7f1bbde00640 1 -- 172.21.15.152:0/3087471608 learned_addr learned my addr 172.21.15.152:0/3087471608 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:58.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.626+0000 7f1bbd400640 1 --2- 172.21.15.152:0/3087471608 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1bc00c65d0 0x7f1bc00c6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:58.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.626+0000 7f1bbe800640 1 --2- 172.21.15.152:0/3087471608 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1bc00ca2c0 0x7f1bc00ca740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:58.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.626+0000 7f1bbde00640 1 -- 172.21.15.152:0/3087471608 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1bc00c65d0 msgr2=0x7f1bc00c6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:58.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.626+0000 7f1bbde00640 1 --2- 172.21.15.152:0/3087471608 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1bc00c65d0 0x7f1bc00c6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:58.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.626+0000 7f1bbde00640 1 -- 172.21.15.152:0/3087471608 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1bc00ca2c0 msgr2=0x7f1bc00ca740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:58.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.626+0000 7f1bbde00640 1 --2- 172.21.15.152:0/3087471608 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1bc00ca2c0 0x7f1bc00ca740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:58.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.626+0000 7f1bbde00640 1 -- 172.21.15.152:0/3087471608 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bc00b3bd0 con 0x7f1ba4004810 2024-04-17T08:46:58.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.626+0000 7f1bbe800640 1 --2- 172.21.15.152:0/3087471608 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1bc00ca2c0 0x7f1bc00ca740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:46:58.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.626+0000 7f1bbde00640 1 --2- 172.21.15.152:0/3087471608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ba4004810 0x7f1bc0157f50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1bb000e7f0 tx=0x7f1bb000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:58.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.626+0000 7f1bb6000640 1 -- 172.21.15.152:0/3087471608 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb000c870 con 0x7f1ba4004810 2024-04-17T08:46:58.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.626+0000 7f1bb6000640 1 -- 172.21.15.152:0/3087471608 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bb0018070 con 0x7f1ba4004810 2024-04-17T08:46:58.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.626+0000 7f1bbf200640 1 -- 172.21.15.152:0/3087471608 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bc00caf80 con 0x7f1ba4004810 2024-04-17T08:46:58.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.626+0000 7f1bb6000640 1 -- 172.21.15.152:0/3087471608 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb000cc50 con 0x7f1ba4004810 2024-04-17T08:46:58.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.626+0000 7f1bbf200640 1 -- 172.21.15.152:0/3087471608 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bc00cb540 con 0x7f1ba4004810 2024-04-17T08:46:58.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.630+0000 7f1bbf200640 1 -- 172.21.15.152:0/3087471608 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bc0075c10 con 0x7f1ba4004810 2024-04-17T08:46:58.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.630+0000 7f1bb6000640 1 -- 172.21.15.152:0/3087471608 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1bb001d460 con 0x7f1ba4004810 2024-04-17T08:46:58.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.630+0000 7f1bb6000640 1 --2- 172.21.15.152:0/3087471608 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1ba0068380 0x7f1ba006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:58.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.630+0000 7f1bb6000640 1 -- 172.21.15.152:0/3087471608 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f1bb0086ac0 con 0x7f1ba4004810 2024-04-17T08:46:58.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.630+0000 7f1bbd400640 1 --2- 172.21.15.152:0/3087471608 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1ba0068380 0x7f1ba006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:58.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.630+0000 7f1bbd400640 1 --2- 172.21.15.152:0/3087471608 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1ba0068380 0x7f1ba006a840 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1bac0ad000 tx=0x7f1bac0b2040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:58.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.634+0000 7f1bb6000640 1 -- 172.21.15.152:0/3087471608 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f1bb0056d30 con 0x7f1ba4004810 2024-04-17T08:46:58.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.826+0000 7f1bbf200640 1 -- 172.21.15.152:0/3087471608 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1bc00d1910 con 0x7f1ba4004810 2024-04-17T08:46:58.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.826+0000 7f1bb6000640 1 -- 172.21.15.152:0/3087471608 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5207 (secure 0 0 0) 0x7f1bb0056630 con 0x7f1ba4004810 2024-04-17T08:46:58.828 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:46:58.828 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6834/2461981726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":2461981726},{"type":"v1","addr":"172.21.15.196:6834","nonce":2461981726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6835/3397289430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6833","nonce":3397289430},{"type":"v1","addr":"172.21.15.196:6835","nonce":3397289430}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/2491486613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2491486613},{"type":"v1","addr":"172.21.15.152:6836","nonce":2491486613}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-17T08:46:33.607720+0000","modified":"2024-04-17T08:46:57.830153+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6837/3890159871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":3890159871},{"type":"v1","addr":"172.21.15.152:6837","nonce":3890159871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-04-17T08:46:58.828 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 9 2024-04-17T08:46:58.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.826+0000 7f1bbf200640 1 -- 172.21.15.152:0/3087471608 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1ba0068380 msgr2=0x7f1ba006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:58.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.826+0000 7f1bbf200640 1 --2- 172.21.15.152:0/3087471608 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1ba0068380 0x7f1ba006a840 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1bac0ad000 tx=0x7f1bac0b2040 comp rx=0 tx=0).stop 2024-04-17T08:46:58.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.826+0000 7f1bbf200640 1 -- 172.21.15.152:0/3087471608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ba4004810 msgr2=0x7f1bc0157f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:58.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.826+0000 7f1bbf200640 1 --2- 172.21.15.152:0/3087471608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ba4004810 0x7f1bc0157f50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1bb000e7f0 tx=0x7f1bb000ecb0 comp rx=0 tx=0).stop 2024-04-17T08:46:58.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.830+0000 7f1bbf200640 1 -- 172.21.15.152:0/3087471608 shutdown_connections 2024-04-17T08:46:58.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.830+0000 7f1bbf200640 1 --2- 172.21.15.152:0/3087471608 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1bc00ca2c0 0x7f1bc00ca740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:58.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.830+0000 7f1bbf200640 1 --2- 172.21.15.152:0/3087471608 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1ba0068380 0x7f1ba006a840 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:58.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.830+0000 7f1bbf200640 1 --2- 172.21.15.152:0/3087471608 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1bc00c65d0 0x7f1bc00c6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:58.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.830+0000 7f1bbf200640 1 --2- 172.21.15.152:0/3087471608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ba4004810 0x7f1bc0157f50 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:58.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.830+0000 7f1bbf200640 1 -- 172.21.15.152:0/3087471608 >> 172.21.15.152:0/3087471608 conn(0x7f1bc00b3e40 msgr2=0x7f1bc0154480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:58.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.830+0000 7f1bbf200640 1 -- 172.21.15.152:0/3087471608 shutdown_connections 2024-04-17T08:46:58.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.830+0000 7f1bbf200640 1 -- 172.21.15.152:0/3087471608 wait complete. 2024-04-17T08:46:58.850 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T08:46:58.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.982+0000 7fbb89c00640 1 Processor -- start 2024-04-17T08:46:58.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.982+0000 7fbb89c00640 1 -- start start 2024-04-17T08:46:58.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.986+0000 7fbb89c00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fbb840d0a70 0x7fbb84160010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:58.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.986+0000 7fbb89c00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fbb8415d710 0x7fbb84160550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:58.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.986+0000 7fbb89c00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb84160a90 con 0x7fbb8415a010 2024-04-17T08:46:58.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.986+0000 7fbb89c00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fbb8415d280 con 0x7fbb8415d710 2024-04-17T08:46:58.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.986+0000 7fbb89c00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fbb8415c9d0 con 0x7fbb840d0a70 2024-04-17T08:46:58.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.986+0000 7fbb83400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fbb8415d710 0x7fbb84160550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:58.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.986+0000 7fbb83400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fbb8415d710 0x7fbb84160550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46550/0 (socket says 172.21.15.152:46550) 2024-04-17T08:46:58.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.986+0000 7fbb83400640 1 -- 172.21.15.152:0/1843093261 learned_addr learned my addr 172.21.15.152:0/1843093261 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:58.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.986+0000 7fbb82a00640 1 --1- 172.21.15.152:0/1843093261 >> v1:172.21.15.152:6789/0 conn(0x7fbb8415a010 0x7fbb840d0360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:58348/0 (socket says 172.21.15.152:58348) 2024-04-17T08:46:58.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.986+0000 7fbb7a000640 1 --2- 172.21.15.152:0/1843093261 >> v2:172.21.15.196:3300/0 conn(0x7fbb840d0a70 0x7fbb84160010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:58.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.986+0000 7fbb83400640 1 -- 172.21.15.152:0/1843093261 >> v2:172.21.15.196:3300/0 conn(0x7fbb840d0a70 msgr2=0x7fbb84160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:58.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.986+0000 7fbb83400640 1 --2- 172.21.15.152:0/1843093261 >> v2:172.21.15.196:3300/0 conn(0x7fbb840d0a70 0x7fbb84160010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:58.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.986+0000 7fbb83400640 1 -- 172.21.15.152:0/1843093261 >> v1:172.21.15.152:6789/0 conn(0x7fbb8415a010 legacy=0x7fbb840d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:58.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.986+0000 7fbb83400640 1 -- 172.21.15.152:0/1843093261 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb84160d20 con 0x7fbb8415d710 2024-04-17T08:46:58.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.986+0000 7fbb7a000640 1 --2- 172.21.15.152:0/1843093261 >> v2:172.21.15.196:3300/0 conn(0x7fbb840d0a70 0x7fbb84160010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:46:58.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.990+0000 7fbb83400640 1 --2- 172.21.15.152:0/1843093261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb8415d710 0x7fbb84160550 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbb840b41d0 tx=0x7fbb7c01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=338dfaec8e72460b server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:58.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.990+0000 7fbb82000640 1 -- 172.21.15.152:0/1843093261 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c0a5710 con 0x7fbb8415d710 2024-04-17T08:46:58.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.990+0000 7fbb82000640 1 -- 172.21.15.152:0/1843093261 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb7c0a58b0 con 0x7fbb8415d710 2024-04-17T08:46:58.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.990+0000 7fbb82000640 1 -- 172.21.15.152:0/1843093261 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c0a5c80 con 0x7fbb8415d710 2024-04-17T08:46:58.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.990+0000 7fbb89c00640 1 -- 172.21.15.152:0/1843093261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb8415d710 msgr2=0x7fbb84160550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:58.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.990+0000 7fbb89c00640 1 --2- 172.21.15.152:0/1843093261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb8415d710 0x7fbb84160550 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbb840b41d0 tx=0x7fbb7c01c960 comp rx=0 tx=0).stop 2024-04-17T08:46:58.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.990+0000 7fbb89c00640 1 -- 172.21.15.152:0/1843093261 shutdown_connections 2024-04-17T08:46:58.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.990+0000 7fbb89c00640 1 --2- 172.21.15.152:0/1843093261 >> v2:172.21.15.196:3300/0 conn(0x7fbb840d0a70 0x7fbb84160010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:58.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.990+0000 7fbb89c00640 1 --2- 172.21.15.152:0/1843093261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb8415d710 0x7fbb84160550 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:58.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.990+0000 7fbb89c00640 1 -- 172.21.15.152:0/1843093261 >> 172.21.15.152:0/1843093261 conn(0x7fbb840b3350 msgr2=0x7fbb840b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:58.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.990+0000 7fbb89c00640 1 -- 172.21.15.152:0/1843093261 shutdown_connections 2024-04-17T08:46:58.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.990+0000 7fbb89c00640 1 -- 172.21.15.152:0/1843093261 wait complete. 2024-04-17T08:46:58.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.990+0000 7fbb89c00640 1 Processor -- start 2024-04-17T08:46:58.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.990+0000 7fbb89c00640 1 -- start start 2024-04-17T08:46:58.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.990+0000 7fbb89c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbb840d0a70 0x7fbb840cc930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:58.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.990+0000 7fbb89c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb8415a010 0x7fbb8415b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:58.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.990+0000 7fbb89c00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb8415d710 0x7fbb8415bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:58.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.990+0000 7fbb89c00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbb8415e570 con 0x7fbb8415d710 2024-04-17T08:46:58.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.990+0000 7fbb89c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fbb8415e3f0 con 0x7fbb840d0a70 2024-04-17T08:46:58.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.990+0000 7fbb89c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fbb8415e6f0 con 0x7fbb8415a010 2024-04-17T08:46:58.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.990+0000 7fbb83400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb8415d710 0x7fbb8415bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:58.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.990+0000 7fbb83400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb8415d710 0x7fbb8415bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46566/0 (socket says 172.21.15.152:46566) 2024-04-17T08:46:58.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.994+0000 7fbb83400640 1 -- 172.21.15.152:0/3822021688 learned_addr learned my addr 172.21.15.152:0/3822021688 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:58.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.994+0000 7fbb82a00640 1 --2- 172.21.15.152:0/3822021688 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbb840d0a70 0x7fbb840cc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:58.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.994+0000 7fbb7a000640 1 --2- 172.21.15.152:0/3822021688 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb8415a010 0x7fbb8415b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:58.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.994+0000 7fbb83400640 1 -- 172.21.15.152:0/3822021688 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb8415a010 msgr2=0x7fbb8415b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:58.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.994+0000 7fbb83400640 1 --2- 172.21.15.152:0/3822021688 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb8415a010 0x7fbb8415b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:58.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.994+0000 7fbb83400640 1 -- 172.21.15.152:0/3822021688 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbb840d0a70 msgr2=0x7fbb840cc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:58.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.994+0000 7fbb83400640 1 --2- 172.21.15.152:0/3822021688 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbb840d0a70 0x7fbb840cc930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:58.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.994+0000 7fbb83400640 1 -- 172.21.15.152:0/3822021688 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb840cdcd0 con 0x7fbb8415d710 2024-04-17T08:46:58.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.994+0000 7fbb83400640 1 --2- 172.21.15.152:0/3822021688 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb8415d710 0x7fbb8415bcc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c019570 tx=0x7fbb7c019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:58.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.994+0000 7fbb7b400640 1 -- 172.21.15.152:0/3822021688 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c0bc020 con 0x7fbb8415d710 2024-04-17T08:46:58.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.994+0000 7fbb7b400640 1 -- 172.21.15.152:0/3822021688 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb7c0b8670 con 0x7fbb8415d710 2024-04-17T08:46:58.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.994+0000 7fbb89c00640 1 -- 172.21.15.152:0/3822021688 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb840cd430 con 0x7fbb8415d710 2024-04-17T08:46:58.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.994+0000 7fbb7b400640 1 -- 172.21.15.152:0/3822021688 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c009510 con 0x7fbb8415d710 2024-04-17T08:46:58.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.994+0000 7fbb89c00640 1 -- 172.21.15.152:0/3822021688 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb840cd9f0 con 0x7fbb8415d710 2024-04-17T08:46:58.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.994+0000 7fbb89c00640 1 -- 172.21.15.152:0/3822021688 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb84068a30 con 0x7fbb8415d710 2024-04-17T08:46:58.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.994+0000 7fbb7b400640 1 -- 172.21.15.152:0/3822021688 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbb7c0bf020 con 0x7fbb8415d710 2024-04-17T08:46:58.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.994+0000 7fbb7b400640 1 --2- 172.21.15.152:0/3822021688 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fbb60068380 0x7fbb6006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:58.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.994+0000 7fbb7b400640 1 -- 172.21.15.152:0/3822021688 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fbb7c121ed0 con 0x7fbb8415d710 2024-04-17T08:46:58.998 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.994+0000 7fbb82a00640 1 --2- 172.21.15.152:0/3822021688 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fbb60068380 0x7fbb6006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:58.998 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.998+0000 7fbb82a00640 1 --2- 172.21.15.152:0/3822021688 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fbb60068380 0x7fbb6006a840 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbb8415f570 tx=0x7fbb74007cf0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:59.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:58.998+0000 7fbb7b400640 1 -- 172.21.15.152:0/3822021688 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fbb7c0c6030 con 0x7fbb8415d710 2024-04-17T08:46:59.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.158+0000 7fbb89c00640 1 -- 172.21.15.152:0/3822021688 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbb840b3940 con 0x7fbb8415d710 2024-04-17T08:46:59.160 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.158+0000 7fbb7b400640 1 -- 172.21.15.152:0/3822021688 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7fbb7c0165e0 con 0x7fbb8415d710 2024-04-17T08:46:59.160 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:46:59.161 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":24,"fsid":"ce68f82e-ec5f-4205-9fd5-bdfdf6ef31e2","created":"2024-04-17T08:46:08.353546+0000","modified":"2024-04-17T08:46:38.659862+0000","last_up_change":"2024-04-17T08:46:20.738799+0000","last_in_change":"2024-04-17T08:46:11.210050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T08:46:21.386856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T08:46:31.812460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T08:46:32.555559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T08:46:36.258078+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"682f0192-187c-404e-bc7a-b6b4e23825e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6819","nonce":3603799291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6823","nonce":3603799291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6831","nonce":3603799291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6827","nonce":3603799291}]},"public_addr":"172.21.15.152:6819/3603799291","cluster_addr":"172.21.15.152:6823/3603799291","heartbeat_back_addr":"172.21.15.152:6831/3603799291","heartbeat_front_addr":"172.21.15.152:6827/3603799291","state":["exists","up"]},{"osd":1,"uuid":"f0fe8fef-60ec-4a39-83b6-2fa6a5adb0f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6801","nonce":4133383142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6803","nonce":4133383142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6807","nonce":4133383142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6805","nonce":4133383142}]},"public_addr":"172.21.15.152:6801/4133383142","cluster_addr":"172.21.15.152:6803/4133383142","heartbeat_back_addr":"172.21.15.152:6807/4133383142","heartbeat_front_addr":"172.21.15.152:6805/4133383142","state":["exists","up"]},{"osd":2,"uuid":"35f36d9c-5245-4431-a618-f4df0fa380ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6809","nonce":3826143898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6811","nonce":3826143898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6815","nonce":3826143898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6813","nonce":3826143898}]},"public_addr":"172.21.15.152:6809/3826143898","cluster_addr":"172.21.15.152:6811/3826143898","heartbeat_back_addr":"172.21.15.152:6815/3826143898","heartbeat_front_addr":"172.21.15.152:6813/3826143898","state":["exists","up"]},{"osd":3,"uuid":"96e56ca5-15b4-4895-9b79-da2c92043159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6818","nonce":165717826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6822","nonce":165717826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6830","nonce":165717826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6826","nonce":165717826}]},"public_addr":"172.21.15.152:6818/165717826","cluster_addr":"172.21.15.152:6822/165717826","heartbeat_back_addr":"172.21.15.152:6830/165717826","heartbeat_front_addr":"172.21.15.152:6826/165717826","state":["exists","up"]},{"osd":4,"uuid":"f5aa10a4-9ff9-41fe-a5c9-15326f982cc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6817","nonce":4080159297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6819","nonce":4080159297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6823","nonce":4080159297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6821","nonce":4080159297}]},"public_addr":"172.21.15.196:6817/4080159297","cluster_addr":"172.21.15.196:6819/4080159297","heartbeat_back_addr":"172.21.15.196:6823/4080159297","heartbeat_front_addr":"172.21.15.196:6821/4080159297","state":["exists","up"]},{"osd":5,"uuid":"42bab884-3476-47ae-ac65-935fa6e0f055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6801","nonce":3519444232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6803","nonce":3519444232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6807","nonce":3519444232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6805","nonce":3519444232}]},"public_addr":"172.21.15.196:6801/3519444232","cluster_addr":"172.21.15.196:6803/3519444232","heartbeat_back_addr":"172.21.15.196:6807/3519444232","heartbeat_front_addr":"172.21.15.196:6805/3519444232","state":["exists","up"]},{"osd":6,"uuid":"460b6167-f57b-4224-9c92-cfc9b80bbe99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6809","nonce":275739834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6811","nonce":275739834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6815","nonce":275739834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6813","nonce":275739834}]},"public_addr":"172.21.15.196:6809/275739834","cluster_addr":"172.21.15.196:6811/275739834","heartbeat_back_addr":"172.21.15.196:6815/275739834","heartbeat_front_addr":"172.21.15.196:6813/275739834","state":["exists","up"]},{"osd":7,"uuid":"d695643f-5e07-4e2a-a646-c06bd97b6650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6825","nonce":307626968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6827","nonce":307626968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6831","nonce":307626968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6829","nonce":307626968}]},"public_addr":"172.21.15.196:6825/307626968","cluster_addr":"172.21.15.196:6827/307626968","heartbeat_back_addr":"172.21.15.196:6831/307626968","heartbeat_front_addr":"172.21.15.196:6829/307626968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.293257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.964533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.248895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.010000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.832554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.743704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930171+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930962+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T08:46:59.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.162+0000 7fbb89c00640 1 -- 172.21.15.152:0/3822021688 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fbb60068380 msgr2=0x7fbb6006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:59.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.162+0000 7fbb89c00640 1 --2- 172.21.15.152:0/3822021688 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fbb60068380 0x7fbb6006a840 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbb8415f570 tx=0x7fbb74007cf0 comp rx=0 tx=0).stop 2024-04-17T08:46:59.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.162+0000 7fbb89c00640 1 -- 172.21.15.152:0/3822021688 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb8415d710 msgr2=0x7fbb8415bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:59.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.162+0000 7fbb89c00640 1 --2- 172.21.15.152:0/3822021688 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb8415d710 0x7fbb8415bcc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c019570 tx=0x7fbb7c019700 comp rx=0 tx=0).stop 2024-04-17T08:46:59.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.162+0000 7fbb89c00640 1 -- 172.21.15.152:0/3822021688 shutdown_connections 2024-04-17T08:46:59.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.162+0000 7fbb89c00640 1 --2- 172.21.15.152:0/3822021688 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb8415d710 0x7fbb8415bcc0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:59.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.162+0000 7fbb89c00640 1 --2- 172.21.15.152:0/3822021688 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fbb60068380 0x7fbb6006a840 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:59.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.162+0000 7fbb89c00640 1 --2- 172.21.15.152:0/3822021688 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb8415a010 0x7fbb8415b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:59.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.162+0000 7fbb89c00640 1 --2- 172.21.15.152:0/3822021688 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbb840d0a70 0x7fbb840cc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:59.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.162+0000 7fbb89c00640 1 -- 172.21.15.152:0/3822021688 >> 172.21.15.152:0/3822021688 conn(0x7fbb840b3350 msgr2=0x7fbb84071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:59.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.162+0000 7fbb89c00640 1 -- 172.21.15.152:0/3822021688 shutdown_connections 2024-04-17T08:46:59.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.162+0000 7fbb89c00640 1 -- 172.21.15.152:0/3822021688 wait complete. 2024-04-17T08:46:59.182 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-17T08:46:59.182 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T08:46:59.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.318+0000 7f1f67a00640 1 Processor -- start 2024-04-17T08:46:59.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.318+0000 7f1f67a00640 1 -- start start 2024-04-17T08:46:59.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.318+0000 7f1f67a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f1f60145f50 0x7f1f600b0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:59.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.318+0000 7f1f67a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f60160690 0x7f1f600cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:59.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.318+0000 7f1f67a00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f6006fc50 con 0x7f1f6006f750 2024-04-17T08:46:59.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.318+0000 7f1f67a00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f1f600d0460 con 0x7f1f60145f50 2024-04-17T08:46:59.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.318+0000 7f1f67a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f1f600cfb30 con 0x7f1f60160690 2024-04-17T08:46:59.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.318+0000 7f1f5fe00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f1f6006f750 0x7f1f6015ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:58350/0 (socket says 172.21.15.152:58350) 2024-04-17T08:46:59.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.318+0000 7f1f5fe00640 1 -- 172.21.15.152:0/2193713783 learned_addr learned my addr 172.21.15.152:0/2193713783 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:46:59.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.318+0000 7f1f65000640 1 --2- 172.21.15.152:0/2193713783 >> v2:172.21.15.196:3300/0 conn(0x7f1f60145f50 0x7f1f600b0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:59.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.318+0000 7f1f65a00640 1 --2- 172.21.15.152:0/2193713783 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f60160690 0x7f1f600cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:59.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.318+0000 7f1f5f400640 1 -- 172.21.15.152:0/2193713783 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2109584893 0 0) 0x7f1f6006fc50 con 0x7f1f6006f750 2024-04-17T08:46:59.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.318+0000 7f1f5f400640 1 -- 172.21.15.152:0/2193713783 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f44003530 con 0x7f1f6006f750 2024-04-17T08:46:59.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.318+0000 7f1f65a00640 1 -- 172.21.15.152:0/2193713783 >> v2:172.21.15.196:3300/0 conn(0x7f1f60145f50 msgr2=0x7f1f600b0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:46:59.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.318+0000 7f1f65a00640 1 --2- 172.21.15.152:0/2193713783 >> v2:172.21.15.196:3300/0 conn(0x7f1f60145f50 0x7f1f600b0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:59.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.318+0000 7f1f65a00640 1 -- 172.21.15.152:0/2193713783 >> v1:172.21.15.152:6789/0 conn(0x7f1f6006f750 legacy=0x7f1f6015ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:59.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.318+0000 7f1f65a00640 1 -- 172.21.15.152:0/2193713783 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f600cfe10 con 0x7f1f60160690 2024-04-17T08:46:59.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.322+0000 7f1f65a00640 1 --2- 172.21.15.152:0/2193713783 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f60160690 0x7f1f600cdc60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1f58009d90 tx=0x7f1f5801c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca49f1d5d0238833 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:59.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.322+0000 7f1f5f400640 1 -- 172.21.15.152:0/2193713783 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f580b2070 con 0x7f1f60160690 2024-04-17T08:46:59.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.322+0000 7f1f5f400640 1 -- 172.21.15.152:0/2193713783 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f580a5a20 con 0x7f1f60160690 2024-04-17T08:46:59.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.322+0000 7f1f5f400640 1 -- 172.21.15.152:0/2193713783 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f580a5df0 con 0x7f1f60160690 2024-04-17T08:46:59.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.322+0000 7f1f67a00640 1 -- 172.21.15.152:0/2193713783 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f60160690 msgr2=0x7f1f600cdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:59.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.322+0000 7f1f67a00640 1 --2- 172.21.15.152:0/2193713783 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f60160690 0x7f1f600cdc60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1f58009d90 tx=0x7f1f5801c940 comp rx=0 tx=0).stop 2024-04-17T08:46:59.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.322+0000 7f1f67a00640 1 -- 172.21.15.152:0/2193713783 shutdown_connections 2024-04-17T08:46:59.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.322+0000 7f1f67a00640 1 --2- 172.21.15.152:0/2193713783 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f60160690 0x7f1f600cdc60 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:59.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.322+0000 7f1f67a00640 1 --2- 172.21.15.152:0/2193713783 >> v2:172.21.15.196:3300/0 conn(0x7f1f60145f50 0x7f1f600b0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:59.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.322+0000 7f1f67a00640 1 -- 172.21.15.152:0/2193713783 >> 172.21.15.152:0/2193713783 conn(0x7f1f600703f0 msgr2=0x7f1f600707d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:59.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.322+0000 7f1f67a00640 1 -- 172.21.15.152:0/2193713783 shutdown_connections 2024-04-17T08:46:59.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.322+0000 7f1f67a00640 1 -- 172.21.15.152:0/2193713783 wait complete. 2024-04-17T08:46:59.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.326+0000 7f1f67a00640 1 Processor -- start 2024-04-17T08:46:59.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.326+0000 7f1f67a00640 1 -- start start 2024-04-17T08:46:59.328 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.326+0000 7f1f67a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f6006f750 0x7f1f6015b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:59.328 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.326+0000 7f1f67a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f60145f50 0x7f1f60141870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:59.328 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.326+0000 7f1f67a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f60160690 0x7f1f600b1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:59.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.326+0000 7f1f67a00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1f601696b0 con 0x7f1f6006f750 2024-04-17T08:46:59.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.326+0000 7f1f67a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1f60169530 con 0x7f1f60160690 2024-04-17T08:46:59.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.326+0000 7f1f67a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f1f60169830 con 0x7f1f60145f50 2024-04-17T08:46:59.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.326+0000 7f1f65000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f6006f750 0x7f1f6015b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:59.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.326+0000 7f1f65000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f6006f750 0x7f1f6015b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46572/0 (socket says 172.21.15.152:46572) 2024-04-17T08:46:59.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.326+0000 7f1f65000640 1 -- 172.21.15.152:0/539763540 learned_addr learned my addr 172.21.15.152:0/539763540 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:59.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.326+0000 7f1f5fe00640 1 --2- 172.21.15.152:0/539763540 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f60145f50 0x7f1f60141870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:59.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.326+0000 7f1f65a00640 1 --2- 172.21.15.152:0/539763540 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f60160690 0x7f1f600b1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:59.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.326+0000 7f1f65000640 1 -- 172.21.15.152:0/539763540 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f60145f50 msgr2=0x7f1f60141870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:59.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.326+0000 7f1f65000640 1 --2- 172.21.15.152:0/539763540 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f60145f50 0x7f1f60141870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:59.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.326+0000 7f1f65000640 1 -- 172.21.15.152:0/539763540 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f60160690 msgr2=0x7f1f600b1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:59.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.326+0000 7f1f65000640 1 --2- 172.21.15.152:0/539763540 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f60160690 0x7f1f600b1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:59.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.326+0000 7f1f65000640 1 -- 172.21.15.152:0/539763540 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f6013cf90 con 0x7f1f6006f750 2024-04-17T08:46:59.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.326+0000 7f1f65000640 1 --2- 172.21.15.152:0/539763540 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f6006f750 0x7f1f6015b520 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1f5000e930 tx=0x7f1f5000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:59.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.326+0000 7f1f5cc00640 1 -- 172.21.15.152:0/539763540 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f50017070 con 0x7f1f6006f750 2024-04-17T08:46:59.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.326+0000 7f1f5cc00640 1 -- 172.21.15.152:0/539763540 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f5000ca00 con 0x7f1f6006f750 2024-04-17T08:46:59.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.326+0000 7f1f5cc00640 1 -- 172.21.15.152:0/539763540 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f5000cdb0 con 0x7f1f6006f750 2024-04-17T08:46:59.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.326+0000 7f1f67a00640 1 -- 172.21.15.152:0/539763540 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f6013d270 con 0x7f1f6006f750 2024-04-17T08:46:59.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.326+0000 7f1f67a00640 1 -- 172.21.15.152:0/539763540 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f60141070 con 0x7f1f6006f750 2024-04-17T08:46:59.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.330+0000 7f1f67a00640 1 -- 172.21.15.152:0/539763540 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f60068a30 con 0x7f1f6006f750 2024-04-17T08:46:59.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.330+0000 7f1f5cc00640 1 -- 172.21.15.152:0/539763540 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1f5001a070 con 0x7f1f6006f750 2024-04-17T08:46:59.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.330+0000 7f1f5cc00640 1 --2- 172.21.15.152:0/539763540 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1f40068380 0x7f1f4006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:59.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.330+0000 7f1f5cc00640 1 -- 172.21.15.152:0/539763540 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f1f500870c0 con 0x7f1f6006f750 2024-04-17T08:46:59.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.330+0000 7f1f5fe00640 1 --2- 172.21.15.152:0/539763540 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1f40068380 0x7f1f4006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:59.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.330+0000 7f1f5fe00640 1 --2- 172.21.15.152:0/539763540 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1f40068380 0x7f1f4006a840 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1f6013e650 tx=0x7f1f4c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:59.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.334+0000 7f1f5cc00640 1 -- 172.21.15.152:0/539763540 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f1f500573f0 con 0x7f1f6006f750 2024-04-17T08:46:59.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.490+0000 7f1f67a00640 1 -- 172.21.15.152:0/539763540 --> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1f600712d0 con 0x7f1f40068380 2024-04-17T08:46:59.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.498+0000 7f1f5cc00640 1 -- 172.21.15.152:0/539763540 <== mgr.4104 v2:172.21.15.152:6832/3078522445 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332537 (secure 0 0 0) 0x7f1f600712d0 con 0x7f1f40068380 2024-04-17T08:46:59.505 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:46:59.508 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2024-04-17T08:46:59.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.506+0000 7f1f67a00640 1 -- 172.21.15.152:0/539763540 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1f40068380 msgr2=0x7f1f4006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:59.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.506+0000 7f1f67a00640 1 --2- 172.21.15.152:0/539763540 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1f40068380 0x7f1f4006a840 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1f6013e650 tx=0x7f1f4c009040 comp rx=0 tx=0).stop 2024-04-17T08:46:59.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.506+0000 7f1f67a00640 1 -- 172.21.15.152:0/539763540 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f6006f750 msgr2=0x7f1f6015b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:59.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.506+0000 7f1f67a00640 1 --2- 172.21.15.152:0/539763540 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f6006f750 0x7f1f6015b520 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1f5000e930 tx=0x7f1f5000edf0 comp rx=0 tx=0).stop 2024-04-17T08:46:59.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.506+0000 7f1f67a00640 1 -- 172.21.15.152:0/539763540 shutdown_connections 2024-04-17T08:46:59.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.506+0000 7f1f67a00640 1 --2- 172.21.15.152:0/539763540 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f60160690 0x7f1f600b1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:59.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.506+0000 7f1f67a00640 1 --2- 172.21.15.152:0/539763540 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1f40068380 0x7f1f4006a840 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:59.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.506+0000 7f1f67a00640 1 --2- 172.21.15.152:0/539763540 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f60145f50 0x7f1f60141870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:59.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.506+0000 7f1f67a00640 1 --2- 172.21.15.152:0/539763540 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f6006f750 0x7f1f6015b520 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:59.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.506+0000 7f1f67a00640 1 -- 172.21.15.152:0/539763540 >> 172.21.15.152:0/539763540 conn(0x7f1f600703f0 msgr2=0x7f1f6015fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:59.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.506+0000 7f1f67a00640 1 -- 172.21.15.152:0/539763540 shutdown_connections 2024-04-17T08:46:59.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.506+0000 7f1f67a00640 1 -- 172.21.15.152:0/539763540 wait complete. 2024-04-17T08:46:59.525 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-04-17T08:46:59.368734+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219388,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755332,"statfs":{"total":773094113280,"available":772869459968,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003748"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582361+0000","last_change":"2024-04-17T08:46:33.235434+0000","last_active":"2024-04-17T08:46:39.582361+0000","last_peered":"2024-04-17T08:46:39.582361+0000","last_clean":"2024-04-17T08:46:39.582361+0000","last_became_active":"2024-04-17T08:46:33.235164+0000","last_became_peered":"2024-04-17T08:46:33.235164+0000","last_unstale":"2024-04-17T08:46:39.582361+0000","last_undegraded":"2024-04-17T08:46:39.582361+0000","last_fullsized":"2024-04-17T08:46:39.582361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:22:07.958599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583648+0000","last_change":"2024-04-17T08:46:34.245833+0000","last_active":"2024-04-17T08:46:39.583648+0000","last_peered":"2024-04-17T08:46:39.583648+0000","last_clean":"2024-04-17T08:46:39.583648+0000","last_became_active":"2024-04-17T08:46:34.245456+0000","last_became_peered":"2024-04-17T08:46:34.245456+0000","last_unstale":"2024-04-17T08:46:39.583648+0000","last_undegraded":"2024-04-17T08:46:39.583648+0000","last_fullsized":"2024-04-17T08:46:39.583648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:11:40.376111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582185+0000","last_change":"2024-04-17T08:46:38.514450+0000","last_active":"2024-04-17T08:46:39.582185+0000","last_peered":"2024-04-17T08:46:39.582185+0000","last_clean":"2024-04-17T08:46:39.582185+0000","last_became_active":"2024-04-17T08:46:38.514041+0000","last_became_peered":"2024-04-17T08:46:38.514041+0000","last_unstale":"2024-04-17T08:46:39.582185+0000","last_undegraded":"2024-04-17T08:46:39.582185+0000","last_fullsized":"2024-04-17T08:46:39.582185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:00:35.685592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583737+0000","last_change":"2024-04-17T08:46:33.233688+0000","last_active":"2024-04-17T08:46:39.583737+0000","last_peered":"2024-04-17T08:46:39.583737+0000","last_clean":"2024-04-17T08:46:39.583737+0000","last_became_active":"2024-04-17T08:46:33.233377+0000","last_became_peered":"2024-04-17T08:46:33.233377+0000","last_unstale":"2024-04-17T08:46:39.583737+0000","last_undegraded":"2024-04-17T08:46:39.583737+0000","last_fullsized":"2024-04-17T08:46:39.583737+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:25:21.370859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582078+0000","last_change":"2024-04-17T08:46:34.255775+0000","last_active":"2024-04-17T08:46:39.582078+0000","last_peered":"2024-04-17T08:46:39.582078+0000","last_clean":"2024-04-17T08:46:39.582078+0000","last_became_active":"2024-04-17T08:46:34.255196+0000","last_became_peered":"2024-04-17T08:46:34.255196+0000","last_unstale":"2024-04-17T08:46:39.582078+0000","last_undegraded":"2024-04-17T08:46:39.582078+0000","last_fullsized":"2024-04-17T08:46:39.582078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:33:41.705987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.265703+0000","last_change":"2024-04-17T08:46:38.285336+0000","last_active":"2024-04-17T08:46:39.265703+0000","last_peered":"2024-04-17T08:46:39.265703+0000","last_clean":"2024-04-17T08:46:39.265703+0000","last_became_active":"2024-04-17T08:46:38.284905+0000","last_became_peered":"2024-04-17T08:46:38.284905+0000","last_unstale":"2024-04-17T08:46:39.265703+0000","last_undegraded":"2024-04-17T08:46:39.265703+0000","last_fullsized":"2024-04-17T08:46:39.265703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:33:14.972491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583533+0000","last_change":"2024-04-17T08:46:33.239191+0000","last_active":"2024-04-17T08:46:39.583533+0000","last_peered":"2024-04-17T08:46:39.583533+0000","last_clean":"2024-04-17T08:46:39.583533+0000","last_became_active":"2024-04-17T08:46:33.238959+0000","last_became_peered":"2024-04-17T08:46:33.238959+0000","last_unstale":"2024-04-17T08:46:39.583533+0000","last_undegraded":"2024-04-17T08:46:39.583533+0000","last_fullsized":"2024-04-17T08:46:39.583533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:45:46.167023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.266216+0000","last_change":"2024-04-17T08:46:34.251441+0000","last_active":"2024-04-17T08:46:39.266216+0000","last_peered":"2024-04-17T08:46:39.266216+0000","last_clean":"2024-04-17T08:46:39.266216+0000","last_became_active":"2024-04-17T08:46:34.251121+0000","last_became_peered":"2024-04-17T08:46:34.251121+0000","last_unstale":"2024-04-17T08:46:39.266216+0000","last_undegraded":"2024-04-17T08:46:39.266216+0000","last_fullsized":"2024-04-17T08:46:39.266216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:38:02.038788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.266419+0000","last_change":"2024-04-17T08:46:38.286397+0000","last_active":"2024-04-17T08:46:39.266419+0000","last_peered":"2024-04-17T08:46:39.266419+0000","last_clean":"2024-04-17T08:46:39.266419+0000","last_became_active":"2024-04-17T08:46:38.285683+0000","last_became_peered":"2024-04-17T08:46:38.285683+0000","last_unstale":"2024-04-17T08:46:39.266419+0000","last_undegraded":"2024-04-17T08:46:39.266419+0000","last_fullsized":"2024-04-17T08:46:39.266419+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:11:44.421115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583517+0000","last_change":"2024-04-17T08:46:33.241157+0000","last_active":"2024-04-17T08:46:39.583517+0000","last_peered":"2024-04-17T08:46:39.583517+0000","last_clean":"2024-04-17T08:46:39.583517+0000","last_became_active":"2024-04-17T08:46:33.236275+0000","last_became_peered":"2024-04-17T08:46:33.236275+0000","last_unstale":"2024-04-17T08:46:39.583517+0000","last_undegraded":"2024-04-17T08:46:39.583517+0000","last_fullsized":"2024-04-17T08:46:39.583517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:22:14.260721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.267730+0000","last_change":"2024-04-17T08:46:34.250653+0000","last_active":"2024-04-17T08:46:39.267730+0000","last_peered":"2024-04-17T08:46:39.267730+0000","last_clean":"2024-04-17T08:46:39.267730+0000","last_became_active":"2024-04-17T08:46:34.250401+0000","last_became_peered":"2024-04-17T08:46:34.250401+0000","last_unstale":"2024-04-17T08:46:39.267730+0000","last_undegraded":"2024-04-17T08:46:39.267730+0000","last_fullsized":"2024-04-17T08:46:39.267730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:58:55.513935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.266327+0000","last_change":"2024-04-17T08:46:38.282885+0000","last_active":"2024-04-17T08:46:39.266327+0000","last_peered":"2024-04-17T08:46:39.266327+0000","last_clean":"2024-04-17T08:46:39.266327+0000","last_became_active":"2024-04-17T08:46:38.282482+0000","last_became_peered":"2024-04-17T08:46:38.282482+0000","last_unstale":"2024-04-17T08:46:39.266327+0000","last_undegraded":"2024-04-17T08:46:39.266327+0000","last_fullsized":"2024-04-17T08:46:39.266327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:13:54.574905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582137+0000","last_change":"2024-04-17T08:46:34.243339+0000","last_active":"2024-04-17T08:46:39.582137+0000","last_peered":"2024-04-17T08:46:39.582137+0000","last_clean":"2024-04-17T08:46:39.582137+0000","last_became_active":"2024-04-17T08:46:34.243019+0000","last_became_peered":"2024-04-17T08:46:34.243019+0000","last_unstale":"2024-04-17T08:46:39.582137+0000","last_undegraded":"2024-04-17T08:46:39.582137+0000","last_fullsized":"2024-04-17T08:46:39.582137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:02:18.996319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583062+0000","last_change":"2024-04-17T08:46:33.236268+0000","last_active":"2024-04-17T08:46:39.583062+0000","last_peered":"2024-04-17T08:46:39.583062+0000","last_clean":"2024-04-17T08:46:39.583062+0000","last_became_active":"2024-04-17T08:46:33.235432+0000","last_became_peered":"2024-04-17T08:46:33.235432+0000","last_unstale":"2024-04-17T08:46:39.583062+0000","last_undegraded":"2024-04-17T08:46:39.583062+0000","last_fullsized":"2024-04-17T08:46:39.583062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:30:42.762461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.267184+0000","last_change":"2024-04-17T08:46:38.291945+0000","last_active":"2024-04-17T08:46:39.267184+0000","last_peered":"2024-04-17T08:46:39.267184+0000","last_clean":"2024-04-17T08:46:39.267184+0000","last_became_active":"2024-04-17T08:46:38.291516+0000","last_became_peered":"2024-04-17T08:46:38.291516+0000","last_unstale":"2024-04-17T08:46:39.267184+0000","last_undegraded":"2024-04-17T08:46:39.267184+0000","last_fullsized":"2024-04-17T08:46:39.267184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:38:06.083792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582509+0000","last_change":"2024-04-17T08:46:34.244135+0000","last_active":"2024-04-17T08:46:39.582509+0000","last_peered":"2024-04-17T08:46:39.582509+0000","last_clean":"2024-04-17T08:46:39.582509+0000","last_became_active":"2024-04-17T08:46:34.236180+0000","last_became_peered":"2024-04-17T08:46:34.236180+0000","last_unstale":"2024-04-17T08:46:39.582509+0000","last_undegraded":"2024-04-17T08:46:39.582509+0000","last_fullsized":"2024-04-17T08:46:39.582509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:33:10.927487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581609+0000","last_change":"2024-04-17T08:46:33.231027+0000","last_active":"2024-04-17T08:46:39.581609+0000","last_peered":"2024-04-17T08:46:39.581609+0000","last_clean":"2024-04-17T08:46:39.581609+0000","last_became_active":"2024-04-17T08:46:33.230663+0000","last_became_peered":"2024-04-17T08:46:33.230663+0000","last_unstale":"2024-04-17T08:46:39.581609+0000","last_undegraded":"2024-04-17T08:46:39.581609+0000","last_fullsized":"2024-04-17T08:46:39.581609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:20:19.185830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.266822+0000","last_change":"2024-04-17T08:46:38.292349+0000","last_active":"2024-04-17T08:46:39.266822+0000","last_peered":"2024-04-17T08:46:39.266822+0000","last_clean":"2024-04-17T08:46:39.266822+0000","last_became_active":"2024-04-17T08:46:38.291572+0000","last_became_peered":"2024-04-17T08:46:38.291572+0000","last_unstale":"2024-04-17T08:46:39.266822+0000","last_undegraded":"2024-04-17T08:46:39.266822+0000","last_fullsized":"2024-04-17T08:46:39.266822+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:10:14.650704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582076+0000","last_change":"2024-04-17T08:46:34.238266+0000","last_active":"2024-04-17T08:46:39.582076+0000","last_peered":"2024-04-17T08:46:39.582076+0000","last_clean":"2024-04-17T08:46:39.582076+0000","last_became_active":"2024-04-17T08:46:34.237968+0000","last_became_peered":"2024-04-17T08:46:34.237968+0000","last_unstale":"2024-04-17T08:46:39.582076+0000","last_undegraded":"2024-04-17T08:46:39.582076+0000","last_fullsized":"2024-04-17T08:46:39.582076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:33:41.705987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581246+0000","last_change":"2024-04-17T08:46:33.228954+0000","last_active":"2024-04-17T08:46:39.581246+0000","last_peered":"2024-04-17T08:46:39.581246+0000","last_clean":"2024-04-17T08:46:39.581246+0000","last_became_active":"2024-04-17T08:46:33.228638+0000","last_became_peered":"2024-04-17T08:46:33.228638+0000","last_unstale":"2024-04-17T08:46:39.581246+0000","last_undegraded":"2024-04-17T08:46:39.581246+0000","last_fullsized":"2024-04-17T08:46:39.581246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:55:39.562141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583149+0000","last_change":"2024-04-17T08:46:38.514583+0000","last_active":"2024-04-17T08:46:39.583149+0000","last_peered":"2024-04-17T08:46:39.583149+0000","last_clean":"2024-04-17T08:46:39.583149+0000","last_became_active":"2024-04-17T08:46:38.514225+0000","last_became_peered":"2024-04-17T08:46:38.514225+0000","last_unstale":"2024-04-17T08:46:39.583149+0000","last_undegraded":"2024-04-17T08:46:39.583149+0000","last_fullsized":"2024-04-17T08:46:39.583149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:34:35.322841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.267337+0000","last_change":"2024-04-17T08:46:34.241177+0000","last_active":"2024-04-17T08:46:39.267337+0000","last_peered":"2024-04-17T08:46:39.267337+0000","last_clean":"2024-04-17T08:46:39.267337+0000","last_became_active":"2024-04-17T08:46:34.240927+0000","last_became_peered":"2024-04-17T08:46:34.240927+0000","last_unstale":"2024-04-17T08:46:39.267337+0000","last_undegraded":"2024-04-17T08:46:39.267337+0000","last_fullsized":"2024-04-17T08:46:39.267337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:55:03.760867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583141+0000","last_change":"2024-04-17T08:46:33.240692+0000","last_active":"2024-04-17T08:46:39.583141+0000","last_peered":"2024-04-17T08:46:39.583141+0000","last_clean":"2024-04-17T08:46:39.583141+0000","last_became_active":"2024-04-17T08:46:33.240411+0000","last_became_peered":"2024-04-17T08:46:33.240411+0000","last_unstale":"2024-04-17T08:46:39.583141+0000","last_undegraded":"2024-04-17T08:46:39.583141+0000","last_fullsized":"2024-04-17T08:46:39.583141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:55:02.754402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.267455+0000","last_change":"2024-04-17T08:46:38.292332+0000","last_active":"2024-04-17T08:46:39.267455+0000","last_peered":"2024-04-17T08:46:39.267455+0000","last_clean":"2024-04-17T08:46:39.267455+0000","last_became_active":"2024-04-17T08:46:38.291458+0000","last_became_peered":"2024-04-17T08:46:38.291458+0000","last_unstale":"2024-04-17T08:46:39.267455+0000","last_undegraded":"2024-04-17T08:46:39.267455+0000","last_fullsized":"2024-04-17T08:46:39.267455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:58:59.558939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582715+0000","last_change":"2024-04-17T08:46:34.240195+0000","last_active":"2024-04-17T08:46:39.582715+0000","last_peered":"2024-04-17T08:46:39.582715+0000","last_clean":"2024-04-17T08:46:39.582715+0000","last_became_active":"2024-04-17T08:46:34.239873+0000","last_became_peered":"2024-04-17T08:46:34.239873+0000","last_unstale":"2024-04-17T08:46:39.582715+0000","last_undegraded":"2024-04-17T08:46:39.582715+0000","last_fullsized":"2024-04-17T08:46:39.582715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:02:18.996319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583776+0000","last_change":"2024-04-17T08:46:33.238292+0000","last_active":"2024-04-17T08:46:39.583776+0000","last_peered":"2024-04-17T08:46:39.583776+0000","last_clean":"2024-04-17T08:46:39.583776+0000","last_became_active":"2024-04-17T08:46:33.237934+0000","last_became_peered":"2024-04-17T08:46:33.237934+0000","last_unstale":"2024-04-17T08:46:39.583776+0000","last_undegraded":"2024-04-17T08:46:39.583776+0000","last_fullsized":"2024-04-17T08:46:39.583776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:22:14.260721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.267275+0000","last_change":"2024-04-17T08:46:38.510638+0000","last_active":"2024-04-17T08:46:39.267275+0000","last_peered":"2024-04-17T08:46:39.267275+0000","last_clean":"2024-04-17T08:46:39.267275+0000","last_became_active":"2024-04-17T08:46:38.510233+0000","last_became_peered":"2024-04-17T08:46:38.510233+0000","last_unstale":"2024-04-17T08:46:39.267275+0000","last_undegraded":"2024-04-17T08:46:39.267275+0000","last_fullsized":"2024-04-17T08:46:39.267275+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:34:25.965169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.584015+0000","last_change":"2024-04-17T08:46:34.252802+0000","last_active":"2024-04-17T08:46:39.584015+0000","last_peered":"2024-04-17T08:46:39.584015+0000","last_clean":"2024-04-17T08:46:39.584015+0000","last_became_active":"2024-04-17T08:46:34.252503+0000","last_became_peered":"2024-04-17T08:46:34.252503+0000","last_unstale":"2024-04-17T08:46:39.584015+0000","last_undegraded":"2024-04-17T08:46:39.584015+0000","last_fullsized":"2024-04-17T08:46:39.584015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:10:10.605700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583273+0000","last_change":"2024-04-17T08:46:33.235073+0000","last_active":"2024-04-17T08:46:39.583273+0000","last_peered":"2024-04-17T08:46:39.583273+0000","last_clean":"2024-04-17T08:46:39.583273+0000","last_became_active":"2024-04-17T08:46:33.234765+0000","last_became_peered":"2024-04-17T08:46:33.234765+0000","last_unstale":"2024-04-17T08:46:39.583273+0000","last_undegraded":"2024-04-17T08:46:39.583273+0000","last_fullsized":"2024-04-17T08:46:39.583273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:18:08.779923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.580688+0000","last_change":"2024-04-17T08:46:38.513389+0000","last_active":"2024-04-17T08:46:39.580688+0000","last_peered":"2024-04-17T08:46:39.580688+0000","last_clean":"2024-04-17T08:46:39.580688+0000","last_became_active":"2024-04-17T08:46:38.512983+0000","last_became_peered":"2024-04-17T08:46:38.512983+0000","last_unstale":"2024-04-17T08:46:39.580688+0000","last_undegraded":"2024-04-17T08:46:39.580688+0000","last_fullsized":"2024-04-17T08:46:39.580688+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:33:35.245363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581949+0000","last_change":"2024-04-17T08:46:34.244956+0000","last_active":"2024-04-17T08:46:39.581949+0000","last_peered":"2024-04-17T08:46:39.581949+0000","last_clean":"2024-04-17T08:46:39.581949+0000","last_became_active":"2024-04-17T08:46:34.244612+0000","last_became_peered":"2024-04-17T08:46:34.244612+0000","last_unstale":"2024-04-17T08:46:39.581949+0000","last_undegraded":"2024-04-17T08:46:39.581949+0000","last_fullsized":"2024-04-17T08:46:39.581949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:33:41.705987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583727+0000","last_change":"2024-04-17T08:46:33.240546+0000","last_active":"2024-04-17T08:46:39.583727+0000","last_peered":"2024-04-17T08:46:39.583727+0000","last_clean":"2024-04-17T08:46:39.583727+0000","last_became_active":"2024-04-17T08:46:33.240225+0000","last_became_peered":"2024-04-17T08:46:33.240225+0000","last_unstale":"2024-04-17T08:46:39.583727+0000","last_undegraded":"2024-04-17T08:46:39.583727+0000","last_fullsized":"2024-04-17T08:46:39.583727+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:39.361759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581144+0000","last_change":"2024-04-17T08:46:38.509788+0000","last_active":"2024-04-17T08:46:39.581144+0000","last_peered":"2024-04-17T08:46:39.581144+0000","last_clean":"2024-04-17T08:46:39.581144+0000","last_became_active":"2024-04-17T08:46:38.509392+0000","last_became_peered":"2024-04-17T08:46:38.509392+0000","last_unstale":"2024-04-17T08:46:39.581144+0000","last_undegraded":"2024-04-17T08:46:39.581144+0000","last_fullsized":"2024-04-17T08:46:39.581144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:58:59.558939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.267877+0000","last_change":"2024-04-17T08:46:34.250149+0000","last_active":"2024-04-17T08:46:39.267877+0000","last_peered":"2024-04-17T08:46:39.267877+0000","last_clean":"2024-04-17T08:46:39.267877+0000","last_became_active":"2024-04-17T08:46:34.249852+0000","last_became_peered":"2024-04-17T08:46:34.249852+0000","last_unstale":"2024-04-17T08:46:39.267877+0000","last_undegraded":"2024-04-17T08:46:39.267877+0000","last_fullsized":"2024-04-17T08:46:39.267877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:44:51.934889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582032+0000","last_change":"2024-04-17T08:46:33.230892+0000","last_active":"2024-04-17T08:46:39.582032+0000","last_peered":"2024-04-17T08:46:39.582032+0000","last_clean":"2024-04-17T08:46:39.582032+0000","last_became_active":"2024-04-17T08:46:33.230624+0000","last_became_peered":"2024-04-17T08:46:33.230624+0000","last_unstale":"2024-04-17T08:46:39.582032+0000","last_undegraded":"2024-04-17T08:46:39.582032+0000","last_fullsized":"2024-04-17T08:46:39.582032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:16:35.663647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581361+0000","last_change":"2024-04-17T08:46:38.291956+0000","last_active":"2024-04-17T08:46:39.581361+0000","last_peered":"2024-04-17T08:46:39.581361+0000","last_clean":"2024-04-17T08:46:39.581361+0000","last_became_active":"2024-04-17T08:46:38.291609+0000","last_became_peered":"2024-04-17T08:46:38.291609+0000","last_unstale":"2024-04-17T08:46:39.581361+0000","last_undegraded":"2024-04-17T08:46:39.581361+0000","last_fullsized":"2024-04-17T08:46:39.581361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:58:59.558939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.266827+0000","last_change":"2024-04-17T08:46:34.241919+0000","last_active":"2024-04-17T08:46:39.266827+0000","last_peered":"2024-04-17T08:46:39.266827+0000","last_clean":"2024-04-17T08:46:39.266827+0000","last_became_active":"2024-04-17T08:46:34.241745+0000","last_became_peered":"2024-04-17T08:46:34.241745+0000","last_unstale":"2024-04-17T08:46:39.266827+0000","last_undegraded":"2024-04-17T08:46:39.266827+0000","last_fullsized":"2024-04-17T08:46:39.266827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:20:20.192296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.265896+0000","last_change":"2024-04-17T08:46:33.223261+0000","last_active":"2024-04-17T08:46:39.265896+0000","last_peered":"2024-04-17T08:46:39.265896+0000","last_clean":"2024-04-17T08:46:39.265896+0000","last_became_active":"2024-04-17T08:46:33.222852+0000","last_became_peered":"2024-04-17T08:46:33.222852+0000","last_unstale":"2024-04-17T08:46:39.265896+0000","last_undegraded":"2024-04-17T08:46:39.265896+0000","last_fullsized":"2024-04-17T08:46:39.265896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:55:02.754402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581903+0000","last_change":"2024-04-17T08:46:38.291195+0000","last_active":"2024-04-17T08:46:39.581903+0000","last_peered":"2024-04-17T08:46:39.581903+0000","last_clean":"2024-04-17T08:46:39.581903+0000","last_became_active":"2024-04-17T08:46:38.290701+0000","last_became_peered":"2024-04-17T08:46:38.290701+0000","last_unstale":"2024-04-17T08:46:39.581903+0000","last_undegraded":"2024-04-17T08:46:39.581903+0000","last_fullsized":"2024-04-17T08:46:39.581903+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:54:46.069200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.580846+0000","last_change":"2024-04-17T08:46:34.243134+0000","last_active":"2024-04-17T08:46:39.580846+0000","last_peered":"2024-04-17T08:46:39.580846+0000","last_clean":"2024-04-17T08:46:39.580846+0000","last_became_active":"2024-04-17T08:46:34.242856+0000","last_became_peered":"2024-04-17T08:46:34.242856+0000","last_unstale":"2024-04-17T08:46:39.580846+0000","last_undegraded":"2024-04-17T08:46:39.580846+0000","last_fullsized":"2024-04-17T08:46:39.580846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:02:18.996319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.263200+0000","last_change":"2024-04-17T08:46:33.233832+0000","last_active":"2024-04-17T08:46:39.263200+0000","last_peered":"2024-04-17T08:46:39.263200+0000","last_clean":"2024-04-17T08:46:39.263200+0000","last_became_active":"2024-04-17T08:46:33.233591+0000","last_became_peered":"2024-04-17T08:46:33.233591+0000","last_unstale":"2024-04-17T08:46:39.263200+0000","last_undegraded":"2024-04-17T08:46:39.263200+0000","last_fullsized":"2024-04-17T08:46:39.263200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:16:35.663647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583229+0000","last_change":"2024-04-17T08:46:38.286653+0000","last_active":"2024-04-17T08:46:39.583229+0000","last_peered":"2024-04-17T08:46:39.583229+0000","last_clean":"2024-04-17T08:46:39.583229+0000","last_became_active":"2024-04-17T08:46:38.285745+0000","last_became_peered":"2024-04-17T08:46:38.285745+0000","last_unstale":"2024-04-17T08:46:39.583229+0000","last_undegraded":"2024-04-17T08:46:39.583229+0000","last_fullsized":"2024-04-17T08:46:39.583229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:30:32.216661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581290+0000","last_change":"2024-04-17T08:46:34.247813+0000","last_active":"2024-04-17T08:46:39.581290+0000","last_peered":"2024-04-17T08:46:39.581290+0000","last_clean":"2024-04-17T08:46:39.581290+0000","last_became_active":"2024-04-17T08:46:34.247520+0000","last_became_peered":"2024-04-17T08:46:34.247520+0000","last_unstale":"2024-04-17T08:46:39.581290+0000","last_undegraded":"2024-04-17T08:46:39.581290+0000","last_fullsized":"2024-04-17T08:46:39.581290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:31:20.501824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583142+0000","last_change":"2024-04-17T08:46:33.238907+0000","last_active":"2024-04-17T08:46:39.583142+0000","last_peered":"2024-04-17T08:46:39.583142+0000","last_clean":"2024-04-17T08:46:39.583142+0000","last_became_active":"2024-04-17T08:46:33.238615+0000","last_became_peered":"2024-04-17T08:46:33.238615+0000","last_unstale":"2024-04-17T08:46:39.583142+0000","last_undegraded":"2024-04-17T08:46:39.583142+0000","last_fullsized":"2024-04-17T08:46:39.583142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:18:08.779923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582573+0000","last_change":"2024-04-17T08:46:38.509796+0000","last_active":"2024-04-17T08:46:39.582573+0000","last_peered":"2024-04-17T08:46:39.582573+0000","last_clean":"2024-04-17T08:46:39.582573+0000","last_became_active":"2024-04-17T08:46:38.509416+0000","last_became_peered":"2024-04-17T08:46:38.509416+0000","last_unstale":"2024-04-17T08:46:39.582573+0000","last_undegraded":"2024-04-17T08:46:39.582573+0000","last_fullsized":"2024-04-17T08:46:39.582573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:30:32.216661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582207+0000","last_change":"2024-04-17T08:46:34.255520+0000","last_active":"2024-04-17T08:46:39.582207+0000","last_peered":"2024-04-17T08:46:39.582207+0000","last_clean":"2024-04-17T08:46:39.582207+0000","last_became_active":"2024-04-17T08:46:34.255053+0000","last_became_peered":"2024-04-17T08:46:34.255053+0000","last_unstale":"2024-04-17T08:46:39.582207+0000","last_undegraded":"2024-04-17T08:46:39.582207+0000","last_fullsized":"2024-04-17T08:46:39.582207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:49:50.654842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.265863+0000","last_change":"2024-04-17T08:46:33.217828+0000","last_active":"2024-04-17T08:46:39.265863+0000","last_peered":"2024-04-17T08:46:39.265863+0000","last_clean":"2024-04-17T08:46:39.265863+0000","last_became_active":"2024-04-17T08:46:33.217484+0000","last_became_peered":"2024-04-17T08:46:33.217484+0000","last_unstale":"2024-04-17T08:46:39.265863+0000","last_undegraded":"2024-04-17T08:46:39.265863+0000","last_fullsized":"2024-04-17T08:46:39.265863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:55:39.562141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":177,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583272+0000","last_change":"2024-04-17T08:46:22.807988+0000","last_active":"2024-04-17T08:46:39.583272+0000","last_peered":"2024-04-17T08:46:39.583272+0000","last_clean":"2024-04-17T08:46:39.583272+0000","last_became_active":"2024-04-17T08:46:22.806843+0000","last_became_peered":"2024-04-17T08:46:22.806843+0000","last_unstale":"2024-04-17T08:46:39.583272+0000","last_undegraded":"2024-04-17T08:46:39.583272+0000","last_fullsized":"2024-04-17T08:46:39.583272+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:21.741557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:21.741557+0000","last_clean_scrub_stamp":"2024-04-17T08:46:21.741557+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:28:38.254696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583294+0000","last_change":"2024-04-17T08:46:38.515691+0000","last_active":"2024-04-17T08:46:39.583294+0000","last_peered":"2024-04-17T08:46:39.583294+0000","last_clean":"2024-04-17T08:46:39.583294+0000","last_became_active":"2024-04-17T08:46:38.515336+0000","last_became_peered":"2024-04-17T08:46:38.515336+0000","last_unstale":"2024-04-17T08:46:39.583294+0000","last_undegraded":"2024-04-17T08:46:39.583294+0000","last_fullsized":"2024-04-17T08:46:39.583294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:34:25.965169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583364+0000","last_change":"2024-04-17T08:46:34.261227+0000","last_active":"2024-04-17T08:46:39.583364+0000","last_peered":"2024-04-17T08:46:39.583364+0000","last_clean":"2024-04-17T08:46:39.583364+0000","last_became_active":"2024-04-17T08:46:34.260463+0000","last_became_peered":"2024-04-17T08:46:34.260463+0000","last_unstale":"2024-04-17T08:46:39.583364+0000","last_undegraded":"2024-04-17T08:46:39.583364+0000","last_fullsized":"2024-04-17T08:46:39.583364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:38:02.038788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.263511+0000","last_change":"2024-04-17T08:46:33.231431+0000","last_active":"2024-04-17T08:46:39.263511+0000","last_peered":"2024-04-17T08:46:39.263511+0000","last_clean":"2024-04-17T08:46:39.263511+0000","last_became_active":"2024-04-17T08:46:33.227785+0000","last_became_peered":"2024-04-17T08:46:33.227785+0000","last_unstale":"2024-04-17T08:46:39.263511+0000","last_undegraded":"2024-04-17T08:46:39.263511+0000","last_fullsized":"2024-04-17T08:46:39.263511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:25:21.370859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582182+0000","last_change":"2024-04-17T08:46:38.514411+0000","last_active":"2024-04-17T08:46:39.582182+0000","last_peered":"2024-04-17T08:46:39.582182+0000","last_clean":"2024-04-17T08:46:39.582182+0000","last_became_active":"2024-04-17T08:46:38.512337+0000","last_became_peered":"2024-04-17T08:46:38.512337+0000","last_unstale":"2024-04-17T08:46:39.582182+0000","last_undegraded":"2024-04-17T08:46:39.582182+0000","last_fullsized":"2024-04-17T08:46:39.582182+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:38:06.083792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.267341+0000","last_change":"2024-04-17T08:46:34.253572+0000","last_active":"2024-04-17T08:46:39.267341+0000","last_peered":"2024-04-17T08:46:39.267341+0000","last_clean":"2024-04-17T08:46:39.267341+0000","last_became_active":"2024-04-17T08:46:34.253185+0000","last_became_peered":"2024-04-17T08:46:34.253185+0000","last_unstale":"2024-04-17T08:46:39.267341+0000","last_undegraded":"2024-04-17T08:46:39.267341+0000","last_fullsized":"2024-04-17T08:46:39.267341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:34:21.920165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582953+0000","last_change":"2024-04-17T08:46:33.224543+0000","last_active":"2024-04-17T08:46:39.582953+0000","last_peered":"2024-04-17T08:46:39.582953+0000","last_clean":"2024-04-17T08:46:39.582953+0000","last_became_active":"2024-04-17T08:46:33.224234+0000","last_became_peered":"2024-04-17T08:46:33.224234+0000","last_unstale":"2024-04-17T08:46:39.582953+0000","last_undegraded":"2024-04-17T08:46:39.582953+0000","last_fullsized":"2024-04-17T08:46:39.582953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:30:42.762461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581393+0000","last_change":"2024-04-17T08:46:38.289173+0000","last_active":"2024-04-17T08:46:39.581393+0000","last_peered":"2024-04-17T08:46:39.581393+0000","last_clean":"2024-04-17T08:46:39.581393+0000","last_became_active":"2024-04-17T08:46:38.288767+0000","last_became_peered":"2024-04-17T08:46:38.288767+0000","last_unstale":"2024-04-17T08:46:39.581393+0000","last_undegraded":"2024-04-17T08:46:39.581393+0000","last_fullsized":"2024-04-17T08:46:39.581393+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:44:55.979892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583968+0000","last_change":"2024-04-17T08:46:34.255234+0000","last_active":"2024-04-17T08:46:39.583968+0000","last_peered":"2024-04-17T08:46:39.583968+0000","last_clean":"2024-04-17T08:46:39.583968+0000","last_became_active":"2024-04-17T08:46:34.254849+0000","last_became_peered":"2024-04-17T08:46:34.254849+0000","last_unstale":"2024-04-17T08:46:39.583968+0000","last_undegraded":"2024-04-17T08:46:39.583968+0000","last_fullsized":"2024-04-17T08:46:39.583968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:33:31.200359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.263578+0000","last_change":"2024-04-17T08:46:33.236511+0000","last_active":"2024-04-17T08:46:39.263578+0000","last_peered":"2024-04-17T08:46:39.263578+0000","last_clean":"2024-04-17T08:46:39.263578+0000","last_became_active":"2024-04-17T08:46:33.236059+0000","last_became_peered":"2024-04-17T08:46:33.236059+0000","last_unstale":"2024-04-17T08:46:39.263578+0000","last_undegraded":"2024-04-17T08:46:39.263578+0000","last_fullsized":"2024-04-17T08:46:39.263578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:55:39.562141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.265271+0000","last_change":"2024-04-17T08:46:38.511281+0000","last_active":"2024-04-17T08:46:39.265271+0000","last_peered":"2024-04-17T08:46:39.265271+0000","last_clean":"2024-04-17T08:46:39.265271+0000","last_became_active":"2024-04-17T08:46:38.510068+0000","last_became_peered":"2024-04-17T08:46:38.510068+0000","last_unstale":"2024-04-17T08:46:39.265271+0000","last_undegraded":"2024-04-17T08:46:39.265271+0000","last_fullsized":"2024-04-17T08:46:39.265271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:00:35.685592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.584095+0000","last_change":"2024-04-17T08:46:34.249995+0000","last_active":"2024-04-17T08:46:39.584095+0000","last_peered":"2024-04-17T08:46:39.584095+0000","last_clean":"2024-04-17T08:46:39.584095+0000","last_became_active":"2024-04-17T08:46:34.249729+0000","last_became_peered":"2024-04-17T08:46:34.249729+0000","last_unstale":"2024-04-17T08:46:39.584095+0000","last_undegraded":"2024-04-17T08:46:39.584095+0000","last_fullsized":"2024-04-17T08:46:39.584095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:16:39.000776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.267069+0000","last_change":"2024-04-17T08:46:33.231993+0000","last_active":"2024-04-17T08:46:39.267069+0000","last_peered":"2024-04-17T08:46:39.267069+0000","last_clean":"2024-04-17T08:46:39.267069+0000","last_became_active":"2024-04-17T08:46:33.231265+0000","last_became_peered":"2024-04-17T08:46:33.231265+0000","last_unstale":"2024-04-17T08:46:39.267069+0000","last_undegraded":"2024-04-17T08:46:39.267069+0000","last_fullsized":"2024-04-17T08:46:39.267069+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:53:22.090817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.266950+0000","last_change":"2024-04-17T08:46:38.284999+0000","last_active":"2024-04-17T08:46:39.266950+0000","last_peered":"2024-04-17T08:46:39.266950+0000","last_clean":"2024-04-17T08:46:39.266950+0000","last_became_active":"2024-04-17T08:46:38.284570+0000","last_became_peered":"2024-04-17T08:46:38.284570+0000","last_unstale":"2024-04-17T08:46:39.266950+0000","last_undegraded":"2024-04-17T08:46:39.266950+0000","last_fullsized":"2024-04-17T08:46:39.266950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:16:43.045780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582901+0000","last_change":"2024-04-17T08:46:34.255136+0000","last_active":"2024-04-17T08:46:39.582901+0000","last_peered":"2024-04-17T08:46:39.582901+0000","last_clean":"2024-04-17T08:46:39.582901+0000","last_became_active":"2024-04-17T08:46:34.254805+0000","last_became_peered":"2024-04-17T08:46:34.254805+0000","last_unstale":"2024-04-17T08:46:39.582901+0000","last_undegraded":"2024-04-17T08:46:39.582901+0000","last_fullsized":"2024-04-17T08:46:39.582901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:44:51.934889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.263098+0000","last_change":"2024-04-17T08:46:33.221884+0000","last_active":"2024-04-17T08:46:39.263098+0000","last_peered":"2024-04-17T08:46:39.263098+0000","last_clean":"2024-04-17T08:46:39.263098+0000","last_became_active":"2024-04-17T08:46:33.220945+0000","last_became_peered":"2024-04-17T08:46:33.220945+0000","last_unstale":"2024-04-17T08:46:39.263098+0000","last_undegraded":"2024-04-17T08:46:39.263098+0000","last_fullsized":"2024-04-17T08:46:39.263098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:32:08.431466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582440+0000","last_change":"2024-04-17T08:46:38.292234+0000","last_active":"2024-04-17T08:46:39.582440+0000","last_peered":"2024-04-17T08:46:39.582440+0000","last_clean":"2024-04-17T08:46:39.582440+0000","last_became_active":"2024-04-17T08:46:38.291831+0000","last_became_peered":"2024-04-17T08:46:38.291831+0000","last_unstale":"2024-04-17T08:46:39.582440+0000","last_undegraded":"2024-04-17T08:46:39.582440+0000","last_fullsized":"2024-04-17T08:46:39.582440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:34:35.322841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582128+0000","last_change":"2024-04-17T08:46:34.238104+0000","last_active":"2024-04-17T08:46:39.582128+0000","last_peered":"2024-04-17T08:46:39.582128+0000","last_clean":"2024-04-17T08:46:39.582128+0000","last_became_active":"2024-04-17T08:46:34.237741+0000","last_became_peered":"2024-04-17T08:46:34.237741+0000","last_unstale":"2024-04-17T08:46:39.582128+0000","last_undegraded":"2024-04-17T08:46:39.582128+0000","last_fullsized":"2024-04-17T08:46:39.582128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:12:09.665391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582338+0000","last_change":"2024-04-17T08:46:33.227055+0000","last_active":"2024-04-17T08:46:39.582338+0000","last_peered":"2024-04-17T08:46:39.582338+0000","last_clean":"2024-04-17T08:46:39.582338+0000","last_became_active":"2024-04-17T08:46:33.226787+0000","last_became_peered":"2024-04-17T08:46:33.226787+0000","last_unstale":"2024-04-17T08:46:39.582338+0000","last_undegraded":"2024-04-17T08:46:39.582338+0000","last_fullsized":"2024-04-17T08:46:39.582338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:25:21.370859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583895+0000","last_change":"2024-04-17T08:46:38.514388+0000","last_active":"2024-04-17T08:46:39.583895+0000","last_peered":"2024-04-17T08:46:39.583895+0000","last_clean":"2024-04-17T08:46:39.583895+0000","last_became_active":"2024-04-17T08:46:38.514047+0000","last_became_peered":"2024-04-17T08:46:38.514047+0000","last_unstale":"2024-04-17T08:46:39.583895+0000","last_undegraded":"2024-04-17T08:46:39.583895+0000","last_fullsized":"2024-04-17T08:46:39.583895+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:43:04.302500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583016+0000","last_change":"2024-04-17T08:46:34.249520+0000","last_active":"2024-04-17T08:46:39.583016+0000","last_peered":"2024-04-17T08:46:39.583016+0000","last_clean":"2024-04-17T08:46:39.583016+0000","last_became_active":"2024-04-17T08:46:34.249225+0000","last_became_peered":"2024-04-17T08:46:34.249225+0000","last_unstale":"2024-04-17T08:46:39.583016+0000","last_undegraded":"2024-04-17T08:46:39.583016+0000","last_fullsized":"2024-04-17T08:46:39.583016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:54:42.024196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.265861+0000","last_change":"2024-04-17T08:46:33.236864+0000","last_active":"2024-04-17T08:46:39.265861+0000","last_peered":"2024-04-17T08:46:39.265861+0000","last_clean":"2024-04-17T08:46:39.265861+0000","last_became_active":"2024-04-17T08:46:33.236095+0000","last_became_peered":"2024-04-17T08:46:33.236095+0000","last_unstale":"2024-04-17T08:46:39.265861+0000","last_undegraded":"2024-04-17T08:46:39.265861+0000","last_fullsized":"2024-04-17T08:46:39.265861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:20:19.185830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582486+0000","last_change":"2024-04-17T08:46:38.509818+0000","last_active":"2024-04-17T08:46:39.582486+0000","last_peered":"2024-04-17T08:46:39.582486+0000","last_clean":"2024-04-17T08:46:39.582486+0000","last_became_active":"2024-04-17T08:46:38.509380+0000","last_became_peered":"2024-04-17T08:46:38.509380+0000","last_unstale":"2024-04-17T08:46:39.582486+0000","last_undegraded":"2024-04-17T08:46:39.582486+0000","last_fullsized":"2024-04-17T08:46:39.582486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:52:13.249971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581564+0000","last_change":"2024-04-17T08:46:34.248655+0000","last_active":"2024-04-17T08:46:39.581564+0000","last_peered":"2024-04-17T08:46:39.581564+0000","last_clean":"2024-04-17T08:46:39.581564+0000","last_became_active":"2024-04-17T08:46:34.247990+0000","last_became_peered":"2024-04-17T08:46:34.247990+0000","last_unstale":"2024-04-17T08:46:39.581564+0000","last_undegraded":"2024-04-17T08:46:39.581564+0000","last_fullsized":"2024-04-17T08:46:39.581564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:37:26.964605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581610+0000","last_change":"2024-04-17T08:46:33.225329+0000","last_active":"2024-04-17T08:46:39.581610+0000","last_peered":"2024-04-17T08:46:39.581610+0000","last_clean":"2024-04-17T08:46:39.581610+0000","last_became_active":"2024-04-17T08:46:33.225006+0000","last_became_peered":"2024-04-17T08:46:33.225006+0000","last_unstale":"2024-04-17T08:46:39.581610+0000","last_undegraded":"2024-04-17T08:46:39.581610+0000","last_fullsized":"2024-04-17T08:46:39.581610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:06:52.298728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.267811+0000","last_change":"2024-04-17T08:46:38.512665+0000","last_active":"2024-04-17T08:46:39.267811+0000","last_peered":"2024-04-17T08:46:39.267811+0000","last_clean":"2024-04-17T08:46:39.267811+0000","last_became_active":"2024-04-17T08:46:38.511018+0000","last_became_peered":"2024-04-17T08:46:38.511018+0000","last_unstale":"2024-04-17T08:46:39.267811+0000","last_undegraded":"2024-04-17T08:46:39.267811+0000","last_fullsized":"2024-04-17T08:46:39.267811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:07:22.236476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583254+0000","last_change":"2024-04-17T08:46:34.253169+0000","last_active":"2024-04-17T08:46:39.583254+0000","last_peered":"2024-04-17T08:46:39.583254+0000","last_clean":"2024-04-17T08:46:39.583254+0000","last_became_active":"2024-04-17T08:46:34.252781+0000","last_became_peered":"2024-04-17T08:46:34.252781+0000","last_unstale":"2024-04-17T08:46:39.583254+0000","last_undegraded":"2024-04-17T08:46:39.583254+0000","last_fullsized":"2024-04-17T08:46:39.583254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:58:55.513935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'10","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:49.408874+0000","last_change":"2024-04-17T08:46:33.238253+0000","last_active":"2024-04-17T08:46:49.408874+0000","last_peered":"2024-04-17T08:46:49.408874+0000","last_clean":"2024-04-17T08:46:49.408874+0000","last_became_active":"2024-04-17T08:46:33.237894+0000","last_became_peered":"2024-04-17T08:46:33.237894+0000","last_unstale":"2024-04-17T08:46:49.408874+0000","last_undegraded":"2024-04-17T08:46:49.408874+0000","last_fullsized":"2024-04-17T08:46:49.408874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:16:35.663647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581576+0000","last_change":"2024-04-17T08:46:38.292629+0000","last_active":"2024-04-17T08:46:39.581576+0000","last_peered":"2024-04-17T08:46:39.581576+0000","last_clean":"2024-04-17T08:46:39.581576+0000","last_became_active":"2024-04-17T08:46:38.292238+0000","last_became_peered":"2024-04-17T08:46:38.292238+0000","last_unstale":"2024-04-17T08:46:39.581576+0000","last_undegraded":"2024-04-17T08:46:39.581576+0000","last_fullsized":"2024-04-17T08:46:39.581576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:44:55.979892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.267104+0000","last_change":"2024-04-17T08:46:34.247592+0000","last_active":"2024-04-17T08:46:39.267104+0000","last_peered":"2024-04-17T08:46:39.267104+0000","last_clean":"2024-04-17T08:46:39.267104+0000","last_became_active":"2024-04-17T08:46:34.247307+0000","last_became_peered":"2024-04-17T08:46:34.247307+0000","last_unstale":"2024-04-17T08:46:39.267104+0000","last_undegraded":"2024-04-17T08:46:39.267104+0000","last_fullsized":"2024-04-17T08:46:39.267104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:22:15.267186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582951+0000","last_change":"2024-04-17T08:46:33.226914+0000","last_active":"2024-04-17T08:46:39.582951+0000","last_peered":"2024-04-17T08:46:39.582951+0000","last_clean":"2024-04-17T08:46:39.582951+0000","last_became_active":"2024-04-17T08:46:33.226607+0000","last_became_peered":"2024-04-17T08:46:33.226607+0000","last_unstale":"2024-04-17T08:46:39.582951+0000","last_undegraded":"2024-04-17T08:46:39.582951+0000","last_fullsized":"2024-04-17T08:46:39.582951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:22:14.260721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.266708+0000","last_change":"2024-04-17T08:46:38.286086+0000","last_active":"2024-04-17T08:46:39.266708+0000","last_peered":"2024-04-17T08:46:39.266708+0000","last_clean":"2024-04-17T08:46:39.266708+0000","last_became_active":"2024-04-17T08:46:38.285105+0000","last_became_peered":"2024-04-17T08:46:38.285105+0000","last_unstale":"2024-04-17T08:46:39.266708+0000","last_undegraded":"2024-04-17T08:46:39.266708+0000","last_fullsized":"2024-04-17T08:46:39.266708+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:13:14.354152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582237+0000","last_change":"2024-04-17T08:46:34.255537+0000","last_active":"2024-04-17T08:46:39.582237+0000","last_peered":"2024-04-17T08:46:39.582237+0000","last_clean":"2024-04-17T08:46:39.582237+0000","last_became_active":"2024-04-17T08:46:34.254801+0000","last_became_peered":"2024-04-17T08:46:34.254801+0000","last_unstale":"2024-04-17T08:46:39.582237+0000","last_undegraded":"2024-04-17T08:46:39.582237+0000","last_fullsized":"2024-04-17T08:46:39.582237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:13:50.529902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.267835+0000","last_change":"2024-04-17T08:46:33.233506+0000","last_active":"2024-04-17T08:46:39.267835+0000","last_peered":"2024-04-17T08:46:39.267835+0000","last_clean":"2024-04-17T08:46:39.267835+0000","last_became_active":"2024-04-17T08:46:33.233232+0000","last_became_peered":"2024-04-17T08:46:33.233232+0000","last_unstale":"2024-04-17T08:46:39.267835+0000","last_undegraded":"2024-04-17T08:46:39.267835+0000","last_fullsized":"2024-04-17T08:46:39.267835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:16:35.663647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581800+0000","last_change":"2024-04-17T08:46:38.279439+0000","last_active":"2024-04-17T08:46:39.581800+0000","last_peered":"2024-04-17T08:46:39.581800+0000","last_clean":"2024-04-17T08:46:39.581800+0000","last_became_active":"2024-04-17T08:46:38.278889+0000","last_became_peered":"2024-04-17T08:46:38.278889+0000","last_unstale":"2024-04-17T08:46:39.581800+0000","last_undegraded":"2024-04-17T08:46:39.581800+0000","last_fullsized":"2024-04-17T08:46:39.581800+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:43:42.690286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.267666+0000","last_change":"2024-04-17T08:46:34.259801+0000","last_active":"2024-04-17T08:46:39.267666+0000","last_peered":"2024-04-17T08:46:39.267666+0000","last_clean":"2024-04-17T08:46:39.267666+0000","last_became_active":"2024-04-17T08:46:34.259498+0000","last_became_peered":"2024-04-17T08:46:34.259498+0000","last_unstale":"2024-04-17T08:46:39.267666+0000","last_undegraded":"2024-04-17T08:46:39.267666+0000","last_fullsized":"2024-04-17T08:46:39.267666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:54:42.024196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583657+0000","last_change":"2024-04-17T08:46:33.235837+0000","last_active":"2024-04-17T08:46:39.583657+0000","last_peered":"2024-04-17T08:46:39.583657+0000","last_clean":"2024-04-17T08:46:39.583657+0000","last_became_active":"2024-04-17T08:46:33.235456+0000","last_became_peered":"2024-04-17T08:46:33.235456+0000","last_unstale":"2024-04-17T08:46:39.583657+0000","last_undegraded":"2024-04-17T08:46:39.583657+0000","last_fullsized":"2024-04-17T08:46:39.583657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:18:08.779923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582353+0000","last_change":"2024-04-17T08:46:38.509993+0000","last_active":"2024-04-17T08:46:39.582353+0000","last_peered":"2024-04-17T08:46:39.582353+0000","last_clean":"2024-04-17T08:46:39.582353+0000","last_became_active":"2024-04-17T08:46:38.509510+0000","last_became_peered":"2024-04-17T08:46:38.509510+0000","last_unstale":"2024-04-17T08:46:39.582353+0000","last_undegraded":"2024-04-17T08:46:39.582353+0000","last_fullsized":"2024-04-17T08:46:39.582353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:07:22.236476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582291+0000","last_change":"2024-04-17T08:46:38.510357+0000","last_active":"2024-04-17T08:46:39.582291+0000","last_peered":"2024-04-17T08:46:39.582291+0000","last_clean":"2024-04-17T08:46:39.582291+0000","last_became_active":"2024-04-17T08:46:38.509996+0000","last_became_peered":"2024-04-17T08:46:38.509996+0000","last_unstale":"2024-04-17T08:46:39.582291+0000","last_undegraded":"2024-04-17T08:46:39.582291+0000","last_fullsized":"2024-04-17T08:46:39.582291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:54:46.069200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581341+0000","last_change":"2024-04-17T08:46:34.238153+0000","last_active":"2024-04-17T08:46:39.581341+0000","last_peered":"2024-04-17T08:46:39.581341+0000","last_clean":"2024-04-17T08:46:39.581341+0000","last_became_active":"2024-04-17T08:46:34.237904+0000","last_became_peered":"2024-04-17T08:46:34.237904+0000","last_unstale":"2024-04-17T08:46:39.581341+0000","last_undegraded":"2024-04-17T08:46:39.581341+0000","last_fullsized":"2024-04-17T08:46:39.581341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:13:50.529902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.265341+0000","last_change":"2024-04-17T08:46:33.219586+0000","last_active":"2024-04-17T08:46:39.265341+0000","last_peered":"2024-04-17T08:46:39.265341+0000","last_clean":"2024-04-17T08:46:39.265341+0000","last_became_active":"2024-04-17T08:46:33.219227+0000","last_became_peered":"2024-04-17T08:46:33.219227+0000","last_unstale":"2024-04-17T08:46:39.265341+0000","last_undegraded":"2024-04-17T08:46:39.265341+0000","last_fullsized":"2024-04-17T08:46:39.265341+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:18:08.779923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583582+0000","last_change":"2024-04-17T08:46:38.287983+0000","last_active":"2024-04-17T08:46:39.583582+0000","last_peered":"2024-04-17T08:46:39.583582+0000","last_clean":"2024-04-17T08:46:39.583582+0000","last_became_active":"2024-04-17T08:46:38.287651+0000","last_became_peered":"2024-04-17T08:46:38.287651+0000","last_unstale":"2024-04-17T08:46:39.583582+0000","last_undegraded":"2024-04-17T08:46:39.583582+0000","last_fullsized":"2024-04-17T08:46:39.583582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:58:59.558939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581971+0000","last_change":"2024-04-17T08:46:34.237638+0000","last_active":"2024-04-17T08:46:39.581971+0000","last_peered":"2024-04-17T08:46:39.581971+0000","last_clean":"2024-04-17T08:46:39.581971+0000","last_became_active":"2024-04-17T08:46:34.237276+0000","last_became_peered":"2024-04-17T08:46:34.237276+0000","last_unstale":"2024-04-17T08:46:39.581971+0000","last_undegraded":"2024-04-17T08:46:39.581971+0000","last_fullsized":"2024-04-17T08:46:39.581971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:02:18.996319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582616+0000","last_change":"2024-04-17T08:46:33.230158+0000","last_active":"2024-04-17T08:46:39.582616+0000","last_peered":"2024-04-17T08:46:39.582616+0000","last_clean":"2024-04-17T08:46:39.582616+0000","last_became_active":"2024-04-17T08:46:33.229871+0000","last_became_peered":"2024-04-17T08:46:33.229871+0000","last_unstale":"2024-04-17T08:46:39.582616+0000","last_undegraded":"2024-04-17T08:46:39.582616+0000","last_fullsized":"2024-04-17T08:46:39.582616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:32:08.431466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582487+0000","last_change":"2024-04-17T08:46:33.228412+0000","last_active":"2024-04-17T08:46:39.582487+0000","last_peered":"2024-04-17T08:46:39.582487+0000","last_clean":"2024-04-17T08:46:39.582487+0000","last_became_active":"2024-04-17T08:46:33.228163+0000","last_became_peered":"2024-04-17T08:46:33.228163+0000","last_unstale":"2024-04-17T08:46:39.582487+0000","last_undegraded":"2024-04-17T08:46:39.582487+0000","last_fullsized":"2024-04-17T08:46:39.582487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:55:39.562141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581525+0000","last_change":"2024-04-17T08:46:34.248503+0000","last_active":"2024-04-17T08:46:39.581525+0000","last_peered":"2024-04-17T08:46:39.581525+0000","last_clean":"2024-04-17T08:46:39.581525+0000","last_became_active":"2024-04-17T08:46:34.247808+0000","last_became_peered":"2024-04-17T08:46:34.247808+0000","last_unstale":"2024-04-17T08:46:39.581525+0000","last_undegraded":"2024-04-17T08:46:39.581525+0000","last_fullsized":"2024-04-17T08:46:39.581525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:33:10.927487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.263496+0000","last_change":"2024-04-17T08:46:38.291370+0000","last_active":"2024-04-17T08:46:39.263496+0000","last_peered":"2024-04-17T08:46:39.263496+0000","last_clean":"2024-04-17T08:46:39.263496+0000","last_became_active":"2024-04-17T08:46:38.290866+0000","last_became_peered":"2024-04-17T08:46:38.290866+0000","last_unstale":"2024-04-17T08:46:39.263496+0000","last_undegraded":"2024-04-17T08:46:39.263496+0000","last_fullsized":"2024-04-17T08:46:39.263496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:44.413228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582559+0000","last_change":"2024-04-17T08:46:33.239929+0000","last_active":"2024-04-17T08:46:39.582559+0000","last_peered":"2024-04-17T08:46:39.582559+0000","last_clean":"2024-04-17T08:46:39.582559+0000","last_became_active":"2024-04-17T08:46:33.239619+0000","last_became_peered":"2024-04-17T08:46:33.239619+0000","last_unstale":"2024-04-17T08:46:39.582559+0000","last_undegraded":"2024-04-17T08:46:39.582559+0000","last_fullsized":"2024-04-17T08:46:39.582559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:22:07.958599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.266472+0000","last_change":"2024-04-17T08:46:34.237105+0000","last_active":"2024-04-17T08:46:39.266472+0000","last_peered":"2024-04-17T08:46:39.266472+0000","last_clean":"2024-04-17T08:46:39.266472+0000","last_became_active":"2024-04-17T08:46:34.236792+0000","last_became_peered":"2024-04-17T08:46:34.236792+0000","last_unstale":"2024-04-17T08:46:39.266472+0000","last_undegraded":"2024-04-17T08:46:39.266472+0000","last_fullsized":"2024-04-17T08:46:39.266472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:16:36.670112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583657+0000","last_change":"2024-04-17T08:46:38.287775+0000","last_active":"2024-04-17T08:46:39.583657+0000","last_peered":"2024-04-17T08:46:39.583657+0000","last_clean":"2024-04-17T08:46:39.583657+0000","last_became_active":"2024-04-17T08:46:38.287403+0000","last_became_peered":"2024-04-17T08:46:38.287403+0000","last_unstale":"2024-04-17T08:46:39.583657+0000","last_undegraded":"2024-04-17T08:46:39.583657+0000","last_fullsized":"2024-04-17T08:46:39.583657+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:32:12.270818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582001+0000","last_change":"2024-04-17T08:46:34.238359+0000","last_active":"2024-04-17T08:46:39.582001+0000","last_peered":"2024-04-17T08:46:39.582001+0000","last_clean":"2024-04-17T08:46:39.582001+0000","last_became_active":"2024-04-17T08:46:34.237809+0000","last_became_peered":"2024-04-17T08:46:34.237809+0000","last_unstale":"2024-04-17T08:46:39.582001+0000","last_undegraded":"2024-04-17T08:46:39.582001+0000","last_fullsized":"2024-04-17T08:46:39.582001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:17:38.605512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.263186+0000","last_change":"2024-04-17T08:46:34.251080+0000","last_active":"2024-04-17T08:46:39.263186+0000","last_peered":"2024-04-17T08:46:39.263186+0000","last_clean":"2024-04-17T08:46:39.263186+0000","last_became_active":"2024-04-17T08:46:34.250660+0000","last_became_peered":"2024-04-17T08:46:34.250660+0000","last_unstale":"2024-04-17T08:46:39.263186+0000","last_undegraded":"2024-04-17T08:46:39.263186+0000","last_fullsized":"2024-04-17T08:46:39.263186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:18:09.786388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.265791+0000","last_change":"2024-04-17T08:46:34.255117+0000","last_active":"2024-04-17T08:46:39.265791+0000","last_peered":"2024-04-17T08:46:39.265791+0000","last_clean":"2024-04-17T08:46:39.265791+0000","last_became_active":"2024-04-17T08:46:34.251710+0000","last_became_peered":"2024-04-17T08:46:34.251710+0000","last_unstale":"2024-04-17T08:46:39.265791+0000","last_undegraded":"2024-04-17T08:46:39.265791+0000","last_fullsized":"2024-04-17T08:46:39.265791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:10:10.605700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581443+0000","last_change":"2024-04-17T08:46:34.241337+0000","last_active":"2024-04-17T08:46:39.581443+0000","last_peered":"2024-04-17T08:46:39.581443+0000","last_clean":"2024-04-17T08:46:39.581443+0000","last_became_active":"2024-04-17T08:46:34.241042+0000","last_became_peered":"2024-04-17T08:46:34.241042+0000","last_unstale":"2024-04-17T08:46:39.581443+0000","last_undegraded":"2024-04-17T08:46:39.581443+0000","last_fullsized":"2024-04-17T08:46:39.581443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:49:50.654842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582703+0000","last_change":"2024-04-17T08:46:34.245617+0000","last_active":"2024-04-17T08:46:39.582703+0000","last_peered":"2024-04-17T08:46:39.582703+0000","last_clean":"2024-04-17T08:46:39.582703+0000","last_became_active":"2024-04-17T08:46:34.245271+0000","last_became_peered":"2024-04-17T08:46:34.245271+0000","last_unstale":"2024-04-17T08:46:39.582703+0000","last_undegraded":"2024-04-17T08:46:39.582703+0000","last_fullsized":"2024-04-17T08:46:39.582703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:13:50.529902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582834+0000","last_change":"2024-04-17T08:46:34.239456+0000","last_active":"2024-04-17T08:46:39.582834+0000","last_peered":"2024-04-17T08:46:39.582834+0000","last_clean":"2024-04-17T08:46:39.582834+0000","last_became_active":"2024-04-17T08:46:34.239162+0000","last_became_peered":"2024-04-17T08:46:34.239162+0000","last_unstale":"2024-04-17T08:46:39.582834+0000","last_undegraded":"2024-04-17T08:46:39.582834+0000","last_fullsized":"2024-04-17T08:46:39.582834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:49:50.654842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583417+0000","last_change":"2024-04-17T08:46:34.246242+0000","last_active":"2024-04-17T08:46:39.583417+0000","last_peered":"2024-04-17T08:46:39.583417+0000","last_clean":"2024-04-17T08:46:39.583417+0000","last_became_active":"2024-04-17T08:46:34.245994+0000","last_became_peered":"2024-04-17T08:46:34.245994+0000","last_unstale":"2024-04-17T08:46:39.583417+0000","last_undegraded":"2024-04-17T08:46:39.583417+0000","last_fullsized":"2024-04-17T08:46:39.583417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:13:50.529902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583939+0000","last_change":"2024-04-17T08:46:34.245854+0000","last_active":"2024-04-17T08:46:39.583939+0000","last_peered":"2024-04-17T08:46:39.583939+0000","last_clean":"2024-04-17T08:46:39.583939+0000","last_became_active":"2024-04-17T08:46:34.245381+0000","last_became_peered":"2024-04-17T08:46:34.245381+0000","last_unstale":"2024-04-17T08:46:39.583939+0000","last_undegraded":"2024-04-17T08:46:39.583939+0000","last_fullsized":"2024-04-17T08:46:39.583939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:13:10.309148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.265310+0000","last_change":"2024-04-17T08:46:34.249141+0000","last_active":"2024-04-17T08:46:39.265310+0000","last_peered":"2024-04-17T08:46:39.265310+0000","last_clean":"2024-04-17T08:46:39.265310+0000","last_became_active":"2024-04-17T08:46:34.248632+0000","last_became_peered":"2024-04-17T08:46:34.248632+0000","last_unstale":"2024-04-17T08:46:39.265310+0000","last_undegraded":"2024-04-17T08:46:39.265310+0000","last_fullsized":"2024-04-17T08:46:39.265310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:13:50.529902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582465+0000","last_change":"2024-04-17T08:46:34.247025+0000","last_active":"2024-04-17T08:46:39.582465+0000","last_peered":"2024-04-17T08:46:39.582465+0000","last_clean":"2024-04-17T08:46:39.582465+0000","last_became_active":"2024-04-17T08:46:34.246769+0000","last_became_peered":"2024-04-17T08:46:34.246769+0000","last_unstale":"2024-04-17T08:46:39.582465+0000","last_undegraded":"2024-04-17T08:46:39.582465+0000","last_fullsized":"2024-04-17T08:46:39.582465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:12:09.665391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.265741+0000","last_change":"2024-04-17T08:46:34.253773+0000","last_active":"2024-04-17T08:46:39.265741+0000","last_peered":"2024-04-17T08:46:39.265741+0000","last_clean":"2024-04-17T08:46:39.265741+0000","last_became_active":"2024-04-17T08:46:34.253462+0000","last_became_peered":"2024-04-17T08:46:34.253462+0000","last_unstale":"2024-04-17T08:46:39.265741+0000","last_undegraded":"2024-04-17T08:46:39.265741+0000","last_fullsized":"2024-04-17T08:46:39.265741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:13:10.309148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581198+0000","last_change":"2024-04-17T08:46:34.248730+0000","last_active":"2024-04-17T08:46:39.581198+0000","last_peered":"2024-04-17T08:46:39.581198+0000","last_clean":"2024-04-17T08:46:39.581198+0000","last_became_active":"2024-04-17T08:46:34.248175+0000","last_became_peered":"2024-04-17T08:46:34.248175+0000","last_unstale":"2024-04-17T08:46:39.581198+0000","last_undegraded":"2024-04-17T08:46:39.581198+0000","last_fullsized":"2024-04-17T08:46:39.581198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:12:09.665391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582624+0000","last_change":"2024-04-17T08:46:34.240984+0000","last_active":"2024-04-17T08:46:39.582624+0000","last_peered":"2024-04-17T08:46:39.582624+0000","last_clean":"2024-04-17T08:46:39.582624+0000","last_became_active":"2024-04-17T08:46:34.240649+0000","last_became_peered":"2024-04-17T08:46:34.240649+0000","last_unstale":"2024-04-17T08:46:39.582624+0000","last_undegraded":"2024-04-17T08:46:39.582624+0000","last_fullsized":"2024-04-17T08:46:39.582624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:49:50.654842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583627+0000","last_change":"2024-04-17T08:46:34.252899+0000","last_active":"2024-04-17T08:46:39.583627+0000","last_peered":"2024-04-17T08:46:39.583627+0000","last_clean":"2024-04-17T08:46:39.583627+0000","last_became_active":"2024-04-17T08:46:34.252649+0000","last_became_peered":"2024-04-17T08:46:34.252649+0000","last_unstale":"2024-04-17T08:46:39.583627+0000","last_undegraded":"2024-04-17T08:46:39.583627+0000","last_fullsized":"2024-04-17T08:46:39.583627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:34:31.277838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.263565+0000","last_change":"2024-04-17T08:46:34.245775+0000","last_active":"2024-04-17T08:46:39.263565+0000","last_peered":"2024-04-17T08:46:39.263565+0000","last_clean":"2024-04-17T08:46:39.263565+0000","last_became_active":"2024-04-17T08:46:34.245478+0000","last_became_peered":"2024-04-17T08:46:34.245478+0000","last_unstale":"2024-04-17T08:46:39.263565+0000","last_undegraded":"2024-04-17T08:46:39.263565+0000","last_fullsized":"2024-04-17T08:46:39.263565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:22:15.267186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.268138+0000","last_change":"2024-04-17T08:46:34.263140+0000","last_active":"2024-04-17T08:46:39.268138+0000","last_peered":"2024-04-17T08:46:39.268138+0000","last_clean":"2024-04-17T08:46:39.268138+0000","last_became_active":"2024-04-17T08:46:34.261735+0000","last_became_peered":"2024-04-17T08:46:34.261735+0000","last_unstale":"2024-04-17T08:46:39.268138+0000","last_undegraded":"2024-04-17T08:46:39.268138+0000","last_fullsized":"2024-04-17T08:46:39.268138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:34:31.277838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.265194+0000","last_change":"2024-04-17T08:46:34.252436+0000","last_active":"2024-04-17T08:46:39.265194+0000","last_peered":"2024-04-17T08:46:39.265194+0000","last_clean":"2024-04-17T08:46:39.265194+0000","last_became_active":"2024-04-17T08:46:34.250951+0000","last_became_peered":"2024-04-17T08:46:34.250951+0000","last_unstale":"2024-04-17T08:46:39.265194+0000","last_undegraded":"2024-04-17T08:46:39.265194+0000","last_fullsized":"2024-04-17T08:46:39.265194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:33:10.927487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581141+0000","last_change":"2024-04-17T08:46:34.243835+0000","last_active":"2024-04-17T08:46:39.581141+0000","last_peered":"2024-04-17T08:46:39.581141+0000","last_clean":"2024-04-17T08:46:39.581141+0000","last_became_active":"2024-04-17T08:46:34.243503+0000","last_became_peered":"2024-04-17T08:46:34.243503+0000","last_unstale":"2024-04-17T08:46:39.581141+0000","last_undegraded":"2024-04-17T08:46:39.581141+0000","last_fullsized":"2024-04-17T08:46:39.581141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:17:38.605512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581483+0000","last_change":"2024-04-17T08:46:34.239204+0000","last_active":"2024-04-17T08:46:39.581483+0000","last_peered":"2024-04-17T08:46:39.581483+0000","last_clean":"2024-04-17T08:46:39.581483+0000","last_became_active":"2024-04-17T08:46:34.237120+0000","last_became_peered":"2024-04-17T08:46:34.237120+0000","last_unstale":"2024-04-17T08:46:39.581483+0000","last_undegraded":"2024-04-17T08:46:39.581483+0000","last_fullsized":"2024-04-17T08:46:39.581483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:47:04.763844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582462+0000","last_change":"2024-04-17T08:46:34.233656+0000","last_active":"2024-04-17T08:46:39.582462+0000","last_peered":"2024-04-17T08:46:39.582462+0000","last_clean":"2024-04-17T08:46:39.582462+0000","last_became_active":"2024-04-17T08:46:34.233389+0000","last_became_peered":"2024-04-17T08:46:34.233389+0000","last_unstale":"2024-04-17T08:46:39.582462+0000","last_undegraded":"2024-04-17T08:46:39.582462+0000","last_fullsized":"2024-04-17T08:46:39.582462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:17:38.605512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.267000+0000","last_change":"2024-04-17T08:46:34.235333+0000","last_active":"2024-04-17T08:46:39.267000+0000","last_peered":"2024-04-17T08:46:39.267000+0000","last_clean":"2024-04-17T08:46:39.267000+0000","last_became_active":"2024-04-17T08:46:34.234982+0000","last_became_peered":"2024-04-17T08:46:34.234982+0000","last_unstale":"2024-04-17T08:46:39.267000+0000","last_undegraded":"2024-04-17T08:46:39.267000+0000","last_fullsized":"2024-04-17T08:46:39.267000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:18:09.786388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582701+0000","last_change":"2024-04-17T08:46:34.260932+0000","last_active":"2024-04-17T08:46:39.582701+0000","last_peered":"2024-04-17T08:46:39.582701+0000","last_clean":"2024-04-17T08:46:39.582701+0000","last_became_active":"2024-04-17T08:46:34.260666+0000","last_became_peered":"2024-04-17T08:46:34.260666+0000","last_unstale":"2024-04-17T08:46:39.582701+0000","last_undegraded":"2024-04-17T08:46:39.582701+0000","last_fullsized":"2024-04-17T08:46:39.582701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:33:41.705987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583345+0000","last_change":"2024-04-17T08:46:34.260377+0000","last_active":"2024-04-17T08:46:39.583345+0000","last_peered":"2024-04-17T08:46:39.583345+0000","last_clean":"2024-04-17T08:46:39.583345+0000","last_became_active":"2024-04-17T08:46:34.260101+0000","last_became_peered":"2024-04-17T08:46:34.260101+0000","last_unstale":"2024-04-17T08:46:39.583345+0000","last_undegraded":"2024-04-17T08:46:39.583345+0000","last_fullsized":"2024-04-17T08:46:39.583345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:33:10.927487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583903+0000","last_change":"2024-04-17T08:46:34.260965+0000","last_active":"2024-04-17T08:46:39.583903+0000","last_peered":"2024-04-17T08:46:39.583903+0000","last_clean":"2024-04-17T08:46:39.583903+0000","last_became_active":"2024-04-17T08:46:34.260673+0000","last_became_peered":"2024-04-17T08:46:34.260673+0000","last_unstale":"2024-04-17T08:46:39.583903+0000","last_undegraded":"2024-04-17T08:46:39.583903+0000","last_fullsized":"2024-04-17T08:46:39.583903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:43:38.645282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581159+0000","last_change":"2024-04-17T08:46:34.255100+0000","last_active":"2024-04-17T08:46:39.581159+0000","last_peered":"2024-04-17T08:46:39.581159+0000","last_clean":"2024-04-17T08:46:39.581159+0000","last_became_active":"2024-04-17T08:46:34.254891+0000","last_became_peered":"2024-04-17T08:46:34.254891+0000","last_unstale":"2024-04-17T08:46:39.581159+0000","last_undegraded":"2024-04-17T08:46:39.581159+0000","last_fullsized":"2024-04-17T08:46:39.581159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:37:26.964605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582850+0000","last_change":"2024-04-17T08:46:34.258835+0000","last_active":"2024-04-17T08:46:39.582850+0000","last_peered":"2024-04-17T08:46:39.582850+0000","last_clean":"2024-04-17T08:46:39.582850+0000","last_became_active":"2024-04-17T08:46:34.258445+0000","last_became_peered":"2024-04-17T08:46:34.258445+0000","last_unstale":"2024-04-17T08:46:39.582850+0000","last_undegraded":"2024-04-17T08:46:39.582850+0000","last_fullsized":"2024-04-17T08:46:39.582850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:10:10.605700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.265683+0000","last_change":"2024-04-17T08:46:34.253142+0000","last_active":"2024-04-17T08:46:39.265683+0000","last_peered":"2024-04-17T08:46:39.265683+0000","last_clean":"2024-04-17T08:46:39.265683+0000","last_became_active":"2024-04-17T08:46:34.250102+0000","last_became_peered":"2024-04-17T08:46:34.250102+0000","last_unstale":"2024-04-17T08:46:39.265683+0000","last_undegraded":"2024-04-17T08:46:39.265683+0000","last_fullsized":"2024-04-17T08:46:39.265683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:11:40.376111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582833+0000","last_change":"2024-04-17T08:46:34.245004+0000","last_active":"2024-04-17T08:46:39.582833+0000","last_peered":"2024-04-17T08:46:39.582833+0000","last_clean":"2024-04-17T08:46:39.582833+0000","last_became_active":"2024-04-17T08:46:34.244719+0000","last_became_peered":"2024-04-17T08:46:34.244719+0000","last_unstale":"2024-04-17T08:46:39.582833+0000","last_undegraded":"2024-04-17T08:46:39.582833+0000","last_fullsized":"2024-04-17T08:46:39.582833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:34:21.920165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.266124+0000","last_change":"2024-04-17T08:46:34.251799+0000","last_active":"2024-04-17T08:46:39.266124+0000","last_peered":"2024-04-17T08:46:39.266124+0000","last_clean":"2024-04-17T08:46:39.266124+0000","last_became_active":"2024-04-17T08:46:34.251489+0000","last_became_peered":"2024-04-17T08:46:34.251489+0000","last_unstale":"2024-04-17T08:46:39.266124+0000","last_undegraded":"2024-04-17T08:46:39.266124+0000","last_fullsized":"2024-04-17T08:46:39.266124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:16:39.000776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581875+0000","last_change":"2024-04-17T08:46:34.238421+0000","last_active":"2024-04-17T08:46:39.581875+0000","last_peered":"2024-04-17T08:46:39.581875+0000","last_clean":"2024-04-17T08:46:39.581875+0000","last_became_active":"2024-04-17T08:46:34.238155+0000","last_became_peered":"2024-04-17T08:46:34.238155+0000","last_unstale":"2024-04-17T08:46:39.581875+0000","last_undegraded":"2024-04-17T08:46:39.581875+0000","last_fullsized":"2024-04-17T08:46:39.581875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:17:38.605512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583178+0000","last_change":"2024-04-17T08:46:34.254457+0000","last_active":"2024-04-17T08:46:39.583178+0000","last_peered":"2024-04-17T08:46:39.583178+0000","last_clean":"2024-04-17T08:46:39.583178+0000","last_became_active":"2024-04-17T08:46:34.252735+0000","last_became_peered":"2024-04-17T08:46:34.252735+0000","last_unstale":"2024-04-17T08:46:39.583178+0000","last_undegraded":"2024-04-17T08:46:39.583178+0000","last_fullsized":"2024-04-17T08:46:39.583178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:33:10.927487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583825+0000","last_change":"2024-04-17T08:46:34.252075+0000","last_active":"2024-04-17T08:46:39.583825+0000","last_peered":"2024-04-17T08:46:39.583825+0000","last_clean":"2024-04-17T08:46:39.583825+0000","last_became_active":"2024-04-17T08:46:34.251791+0000","last_became_peered":"2024-04-17T08:46:34.251791+0000","last_unstale":"2024-04-17T08:46:39.583825+0000","last_undegraded":"2024-04-17T08:46:39.583825+0000","last_fullsized":"2024-04-17T08:46:39.583825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:30:28.171658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T08:46:59.531 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T08:46:59.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.702+0000 7fdf9d200640 1 Processor -- start 2024-04-17T08:46:59.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.702+0000 7fdf9d200640 1 -- start start 2024-04-17T08:46:59.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.702+0000 7fdf9d200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fdf9806f980 0x7fdf98072530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:59.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.702+0000 7fdf9d200640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf9815bfd0 con 0x7fdf980af670 2024-04-17T08:46:59.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.702+0000 7fdf9d200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf9815c260 con 0x7fdf980d0360 2024-04-17T08:46:59.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.702+0000 7fdf9d200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fdf9815c820 con 0x7fdf9806f980 2024-04-17T08:46:59.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.702+0000 7fdf95e00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fdf980af670 0x7fdf9815b8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:58360/0 (socket says 172.21.15.152:58360) 2024-04-17T08:46:59.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.702+0000 7fdf95e00640 1 -- 172.21.15.152:0/2107336670 learned_addr learned my addr 172.21.15.152:0/2107336670 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:46:59.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.706+0000 7fdf95400640 1 --2- 172.21.15.152:0/2107336670 >> v2:172.21.15.196:3300/0 conn(0x7fdf9806f980 0x7fdf98072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:59.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.706+0000 7fdf94a00640 1 -- 172.21.15.152:0/2107336670 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3071072267 0 0) 0x7fdf9815bfd0 con 0x7fdf980af670 2024-04-17T08:46:59.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.706+0000 7fdf94a00640 1 -- 172.21.15.152:0/2107336670 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf7c003530 con 0x7fdf980af670 2024-04-17T08:46:59.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.706+0000 7fdf95400640 1 -- 172.21.15.152:0/2107336670 >> v1:172.21.15.196:6789/0 conn(0x7fdf980d0360 legacy=0x7fdf9806dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:59.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.706+0000 7fdf95400640 1 -- 172.21.15.152:0/2107336670 >> v1:172.21.15.152:6789/0 conn(0x7fdf980af670 legacy=0x7fdf9815b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:59.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.706+0000 7fdf95400640 1 -- 172.21.15.152:0/2107336670 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf9815c540 con 0x7fdf9806f980 2024-04-17T08:46:59.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.706+0000 7fdf95400640 1 --2- 172.21.15.152:0/2107336670 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdf9806f980 0x7fdf98072530 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdf840097c0 tx=0x7fdf8401c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49e3ffa207b91d38 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:59.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.706+0000 7fdf94a00640 1 -- 172.21.15.152:0/2107336670 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf840b1070 con 0x7fdf9806f980 2024-04-17T08:46:59.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.706+0000 7fdf94a00640 1 -- 172.21.15.152:0/2107336670 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf840a8050 con 0x7fdf9806f980 2024-04-17T08:46:59.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.706+0000 7fdf94a00640 1 -- 172.21.15.152:0/2107336670 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf840ac860 con 0x7fdf9806f980 2024-04-17T08:46:59.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.710+0000 7fdf9d200640 1 -- 172.21.15.152:0/2107336670 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdf9806f980 msgr2=0x7fdf98072530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:59.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.710+0000 7fdf9d200640 1 --2- 172.21.15.152:0/2107336670 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdf9806f980 0x7fdf98072530 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdf840097c0 tx=0x7fdf8401c3e0 comp rx=0 tx=0).stop 2024-04-17T08:46:59.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.710+0000 7fdf9d200640 1 -- 172.21.15.152:0/2107336670 shutdown_connections 2024-04-17T08:46:59.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.710+0000 7fdf9d200640 1 --2- 172.21.15.152:0/2107336670 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdf9806f980 0x7fdf98072530 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:59.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.710+0000 7fdf9d200640 1 -- 172.21.15.152:0/2107336670 >> 172.21.15.152:0/2107336670 conn(0x7fdf980b3350 msgr2=0x7fdf980b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:59.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.710+0000 7fdf9d200640 1 -- 172.21.15.152:0/2107336670 shutdown_connections 2024-04-17T08:46:59.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.710+0000 7fdf9d200640 1 -- 172.21.15.152:0/2107336670 wait complete. 2024-04-17T08:46:59.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.710+0000 7fdf9d200640 1 Processor -- start 2024-04-17T08:46:59.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.710+0000 7fdf9d200640 1 -- start start 2024-04-17T08:46:59.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.710+0000 7fdf9d200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdf9806f980 0x7fdf980998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:59.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.710+0000 7fdf9d200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf980af670 0x7fdf98151c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:59.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.710+0000 7fdf9d200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdf980d0360 0x7fdf980ae1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:59.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.710+0000 7fdf9d200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdf980d0b80 con 0x7fdf980af670 2024-04-17T08:46:59.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.710+0000 7fdf9d200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fdf98072a70 con 0x7fdf9806f980 2024-04-17T08:46:59.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.710+0000 7fdf9d200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fdf98150d50 con 0x7fdf980d0360 2024-04-17T08:46:59.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.710+0000 7fdf95400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf980af670 0x7fdf98151c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:59.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.710+0000 7fdf95400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf980af670 0x7fdf98151c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46574/0 (socket says 172.21.15.152:46574) 2024-04-17T08:46:59.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.710+0000 7fdf95400640 1 -- 172.21.15.152:0/4289701172 learned_addr learned my addr 172.21.15.152:0/4289701172 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:46:59.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.710+0000 7fdf95e00640 1 --2- 172.21.15.152:0/4289701172 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdf9806f980 0x7fdf980998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:59.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.710+0000 7fdf96800640 1 --2- 172.21.15.152:0/4289701172 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdf980d0360 0x7fdf980ae1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:59.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.710+0000 7fdf95400640 1 -- 172.21.15.152:0/4289701172 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdf980d0360 msgr2=0x7fdf980ae1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:59.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.710+0000 7fdf95400640 1 --2- 172.21.15.152:0/4289701172 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdf980d0360 0x7fdf980ae1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:59.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.710+0000 7fdf95400640 1 -- 172.21.15.152:0/4289701172 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdf9806f980 msgr2=0x7fdf980998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:59.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.710+0000 7fdf95400640 1 --2- 172.21.15.152:0/4289701172 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdf9806f980 0x7fdf980998d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:59.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.710+0000 7fdf95400640 1 -- 172.21.15.152:0/4289701172 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf98156680 con 0x7fdf980af670 2024-04-17T08:46:59.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.710+0000 7fdf95e00640 1 --2- 172.21.15.152:0/4289701172 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdf9806f980 0x7fdf980998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:46:59.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.710+0000 7fdf95400640 1 --2- 172.21.15.152:0/4289701172 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf980af670 0x7fdf98151c90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdf84018ff0 tx=0x7fdf84019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:59.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.714+0000 7fdf8e000640 1 -- 172.21.15.152:0/4289701172 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf840b1040 con 0x7fdf980af670 2024-04-17T08:46:59.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.714+0000 7fdf8e000640 1 -- 172.21.15.152:0/4289701172 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf840bc070 con 0x7fdf980af670 2024-04-17T08:46:59.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.714+0000 7fdf9d200640 1 -- 172.21.15.152:0/4289701172 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf981560c0 con 0x7fdf980af670 2024-04-17T08:46:59.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.714+0000 7fdf8e000640 1 -- 172.21.15.152:0/4289701172 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf840b5650 con 0x7fdf980af670 2024-04-17T08:46:59.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.714+0000 7fdf9d200640 1 -- 172.21.15.152:0/4289701172 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf98150ff0 con 0x7fdf980af670 2024-04-17T08:46:59.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.714+0000 7fdf9d200640 1 -- 172.21.15.152:0/4289701172 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf98150b80 con 0x7fdf980af670 2024-04-17T08:46:59.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.714+0000 7fdf8e000640 1 -- 172.21.15.152:0/4289701172 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdf840b57f0 con 0x7fdf980af670 2024-04-17T08:46:59.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.714+0000 7fdf8e000640 1 --2- 172.21.15.152:0/4289701172 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fdf78068380 0x7fdf7806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:46:59.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.714+0000 7fdf8e000640 1 -- 172.21.15.152:0/4289701172 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fdf84120b60 con 0x7fdf980af670 2024-04-17T08:46:59.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.714+0000 7fdf95e00640 1 --2- 172.21.15.152:0/4289701172 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fdf78068380 0x7fdf7806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:46:59.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.714+0000 7fdf95e00640 1 --2- 172.21.15.152:0/4289701172 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fdf78068380 0x7fdf7806a840 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdf88001570 tx=0x7fdf88009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:46:59.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.718+0000 7fdf8e000640 1 -- 172.21.15.152:0/4289701172 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fdf84016090 con 0x7fdf980af670 2024-04-17T08:46:59.875 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.874+0000 7fdf9d200640 1 -- 172.21.15.152:0/4289701172 --> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdf98068a30 con 0x7fdf78068380 2024-04-17T08:46:59.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.882+0000 7fdf8e000640 1 -- 172.21.15.152:0/4289701172 <== mgr.4104 v2:172.21.15.152:6832/3078522445 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332537 (secure 0 0 0) 0x7fdf98068a30 con 0x7fdf78068380 2024-04-17T08:46:59.887 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:46:59.889 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2024-04-17T08:46:59.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.886+0000 7fdf9d200640 1 -- 172.21.15.152:0/4289701172 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fdf78068380 msgr2=0x7fdf7806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:59.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.886+0000 7fdf9d200640 1 --2- 172.21.15.152:0/4289701172 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fdf78068380 0x7fdf7806a840 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdf88001570 tx=0x7fdf88009040 comp rx=0 tx=0).stop 2024-04-17T08:46:59.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.886+0000 7fdf9d200640 1 -- 172.21.15.152:0/4289701172 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf980af670 msgr2=0x7fdf98151c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:46:59.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.886+0000 7fdf9d200640 1 --2- 172.21.15.152:0/4289701172 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf980af670 0x7fdf98151c90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdf84018ff0 tx=0x7fdf84019180 comp rx=0 tx=0).stop 2024-04-17T08:46:59.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.886+0000 7fdf9d200640 1 -- 172.21.15.152:0/4289701172 shutdown_connections 2024-04-17T08:46:59.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.886+0000 7fdf9d200640 1 --2- 172.21.15.152:0/4289701172 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fdf78068380 0x7fdf7806a840 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:59.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.886+0000 7fdf9d200640 1 --2- 172.21.15.152:0/4289701172 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdf980d0360 0x7fdf980ae1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:59.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.886+0000 7fdf9d200640 1 --2- 172.21.15.152:0/4289701172 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf980af670 0x7fdf98151c90 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:59.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.886+0000 7fdf9d200640 1 --2- 172.21.15.152:0/4289701172 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdf9806f980 0x7fdf980998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:46:59.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.886+0000 7fdf9d200640 1 -- 172.21.15.152:0/4289701172 >> 172.21.15.152:0/4289701172 conn(0x7fdf980b3350 msgr2=0x7fdf9815b950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:46:59.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.886+0000 7fdf9d200640 1 -- 172.21.15.152:0/4289701172 shutdown_connections 2024-04-17T08:46:59.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:46:59.886+0000 7fdf9d200640 1 -- 172.21.15.152:0/4289701172 wait complete. 2024-04-17T08:46:59.907 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-04-17T08:46:59.368734+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219388,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755332,"statfs":{"total":773094113280,"available":772869459968,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003748"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582361+0000","last_change":"2024-04-17T08:46:33.235434+0000","last_active":"2024-04-17T08:46:39.582361+0000","last_peered":"2024-04-17T08:46:39.582361+0000","last_clean":"2024-04-17T08:46:39.582361+0000","last_became_active":"2024-04-17T08:46:33.235164+0000","last_became_peered":"2024-04-17T08:46:33.235164+0000","last_unstale":"2024-04-17T08:46:39.582361+0000","last_undegraded":"2024-04-17T08:46:39.582361+0000","last_fullsized":"2024-04-17T08:46:39.582361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:22:07.958599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583648+0000","last_change":"2024-04-17T08:46:34.245833+0000","last_active":"2024-04-17T08:46:39.583648+0000","last_peered":"2024-04-17T08:46:39.583648+0000","last_clean":"2024-04-17T08:46:39.583648+0000","last_became_active":"2024-04-17T08:46:34.245456+0000","last_became_peered":"2024-04-17T08:46:34.245456+0000","last_unstale":"2024-04-17T08:46:39.583648+0000","last_undegraded":"2024-04-17T08:46:39.583648+0000","last_fullsized":"2024-04-17T08:46:39.583648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:11:40.376111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582185+0000","last_change":"2024-04-17T08:46:38.514450+0000","last_active":"2024-04-17T08:46:39.582185+0000","last_peered":"2024-04-17T08:46:39.582185+0000","last_clean":"2024-04-17T08:46:39.582185+0000","last_became_active":"2024-04-17T08:46:38.514041+0000","last_became_peered":"2024-04-17T08:46:38.514041+0000","last_unstale":"2024-04-17T08:46:39.582185+0000","last_undegraded":"2024-04-17T08:46:39.582185+0000","last_fullsized":"2024-04-17T08:46:39.582185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:00:35.685592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583737+0000","last_change":"2024-04-17T08:46:33.233688+0000","last_active":"2024-04-17T08:46:39.583737+0000","last_peered":"2024-04-17T08:46:39.583737+0000","last_clean":"2024-04-17T08:46:39.583737+0000","last_became_active":"2024-04-17T08:46:33.233377+0000","last_became_peered":"2024-04-17T08:46:33.233377+0000","last_unstale":"2024-04-17T08:46:39.583737+0000","last_undegraded":"2024-04-17T08:46:39.583737+0000","last_fullsized":"2024-04-17T08:46:39.583737+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:25:21.370859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582078+0000","last_change":"2024-04-17T08:46:34.255775+0000","last_active":"2024-04-17T08:46:39.582078+0000","last_peered":"2024-04-17T08:46:39.582078+0000","last_clean":"2024-04-17T08:46:39.582078+0000","last_became_active":"2024-04-17T08:46:34.255196+0000","last_became_peered":"2024-04-17T08:46:34.255196+0000","last_unstale":"2024-04-17T08:46:39.582078+0000","last_undegraded":"2024-04-17T08:46:39.582078+0000","last_fullsized":"2024-04-17T08:46:39.582078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:33:41.705987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.265703+0000","last_change":"2024-04-17T08:46:38.285336+0000","last_active":"2024-04-17T08:46:39.265703+0000","last_peered":"2024-04-17T08:46:39.265703+0000","last_clean":"2024-04-17T08:46:39.265703+0000","last_became_active":"2024-04-17T08:46:38.284905+0000","last_became_peered":"2024-04-17T08:46:38.284905+0000","last_unstale":"2024-04-17T08:46:39.265703+0000","last_undegraded":"2024-04-17T08:46:39.265703+0000","last_fullsized":"2024-04-17T08:46:39.265703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:33:14.972491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583533+0000","last_change":"2024-04-17T08:46:33.239191+0000","last_active":"2024-04-17T08:46:39.583533+0000","last_peered":"2024-04-17T08:46:39.583533+0000","last_clean":"2024-04-17T08:46:39.583533+0000","last_became_active":"2024-04-17T08:46:33.238959+0000","last_became_peered":"2024-04-17T08:46:33.238959+0000","last_unstale":"2024-04-17T08:46:39.583533+0000","last_undegraded":"2024-04-17T08:46:39.583533+0000","last_fullsized":"2024-04-17T08:46:39.583533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:45:46.167023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.266216+0000","last_change":"2024-04-17T08:46:34.251441+0000","last_active":"2024-04-17T08:46:39.266216+0000","last_peered":"2024-04-17T08:46:39.266216+0000","last_clean":"2024-04-17T08:46:39.266216+0000","last_became_active":"2024-04-17T08:46:34.251121+0000","last_became_peered":"2024-04-17T08:46:34.251121+0000","last_unstale":"2024-04-17T08:46:39.266216+0000","last_undegraded":"2024-04-17T08:46:39.266216+0000","last_fullsized":"2024-04-17T08:46:39.266216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:38:02.038788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.266419+0000","last_change":"2024-04-17T08:46:38.286397+0000","last_active":"2024-04-17T08:46:39.266419+0000","last_peered":"2024-04-17T08:46:39.266419+0000","last_clean":"2024-04-17T08:46:39.266419+0000","last_became_active":"2024-04-17T08:46:38.285683+0000","last_became_peered":"2024-04-17T08:46:38.285683+0000","last_unstale":"2024-04-17T08:46:39.266419+0000","last_undegraded":"2024-04-17T08:46:39.266419+0000","last_fullsized":"2024-04-17T08:46:39.266419+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:11:44.421115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583517+0000","last_change":"2024-04-17T08:46:33.241157+0000","last_active":"2024-04-17T08:46:39.583517+0000","last_peered":"2024-04-17T08:46:39.583517+0000","last_clean":"2024-04-17T08:46:39.583517+0000","last_became_active":"2024-04-17T08:46:33.236275+0000","last_became_peered":"2024-04-17T08:46:33.236275+0000","last_unstale":"2024-04-17T08:46:39.583517+0000","last_undegraded":"2024-04-17T08:46:39.583517+0000","last_fullsized":"2024-04-17T08:46:39.583517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:22:14.260721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.267730+0000","last_change":"2024-04-17T08:46:34.250653+0000","last_active":"2024-04-17T08:46:39.267730+0000","last_peered":"2024-04-17T08:46:39.267730+0000","last_clean":"2024-04-17T08:46:39.267730+0000","last_became_active":"2024-04-17T08:46:34.250401+0000","last_became_peered":"2024-04-17T08:46:34.250401+0000","last_unstale":"2024-04-17T08:46:39.267730+0000","last_undegraded":"2024-04-17T08:46:39.267730+0000","last_fullsized":"2024-04-17T08:46:39.267730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:58:55.513935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.266327+0000","last_change":"2024-04-17T08:46:38.282885+0000","last_active":"2024-04-17T08:46:39.266327+0000","last_peered":"2024-04-17T08:46:39.266327+0000","last_clean":"2024-04-17T08:46:39.266327+0000","last_became_active":"2024-04-17T08:46:38.282482+0000","last_became_peered":"2024-04-17T08:46:38.282482+0000","last_unstale":"2024-04-17T08:46:39.266327+0000","last_undegraded":"2024-04-17T08:46:39.266327+0000","last_fullsized":"2024-04-17T08:46:39.266327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:13:54.574905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582137+0000","last_change":"2024-04-17T08:46:34.243339+0000","last_active":"2024-04-17T08:46:39.582137+0000","last_peered":"2024-04-17T08:46:39.582137+0000","last_clean":"2024-04-17T08:46:39.582137+0000","last_became_active":"2024-04-17T08:46:34.243019+0000","last_became_peered":"2024-04-17T08:46:34.243019+0000","last_unstale":"2024-04-17T08:46:39.582137+0000","last_undegraded":"2024-04-17T08:46:39.582137+0000","last_fullsized":"2024-04-17T08:46:39.582137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:02:18.996319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583062+0000","last_change":"2024-04-17T08:46:33.236268+0000","last_active":"2024-04-17T08:46:39.583062+0000","last_peered":"2024-04-17T08:46:39.583062+0000","last_clean":"2024-04-17T08:46:39.583062+0000","last_became_active":"2024-04-17T08:46:33.235432+0000","last_became_peered":"2024-04-17T08:46:33.235432+0000","last_unstale":"2024-04-17T08:46:39.583062+0000","last_undegraded":"2024-04-17T08:46:39.583062+0000","last_fullsized":"2024-04-17T08:46:39.583062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:30:42.762461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.267184+0000","last_change":"2024-04-17T08:46:38.291945+0000","last_active":"2024-04-17T08:46:39.267184+0000","last_peered":"2024-04-17T08:46:39.267184+0000","last_clean":"2024-04-17T08:46:39.267184+0000","last_became_active":"2024-04-17T08:46:38.291516+0000","last_became_peered":"2024-04-17T08:46:38.291516+0000","last_unstale":"2024-04-17T08:46:39.267184+0000","last_undegraded":"2024-04-17T08:46:39.267184+0000","last_fullsized":"2024-04-17T08:46:39.267184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:38:06.083792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582509+0000","last_change":"2024-04-17T08:46:34.244135+0000","last_active":"2024-04-17T08:46:39.582509+0000","last_peered":"2024-04-17T08:46:39.582509+0000","last_clean":"2024-04-17T08:46:39.582509+0000","last_became_active":"2024-04-17T08:46:34.236180+0000","last_became_peered":"2024-04-17T08:46:34.236180+0000","last_unstale":"2024-04-17T08:46:39.582509+0000","last_undegraded":"2024-04-17T08:46:39.582509+0000","last_fullsized":"2024-04-17T08:46:39.582509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:33:10.927487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581609+0000","last_change":"2024-04-17T08:46:33.231027+0000","last_active":"2024-04-17T08:46:39.581609+0000","last_peered":"2024-04-17T08:46:39.581609+0000","last_clean":"2024-04-17T08:46:39.581609+0000","last_became_active":"2024-04-17T08:46:33.230663+0000","last_became_peered":"2024-04-17T08:46:33.230663+0000","last_unstale":"2024-04-17T08:46:39.581609+0000","last_undegraded":"2024-04-17T08:46:39.581609+0000","last_fullsized":"2024-04-17T08:46:39.581609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:20:19.185830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.266822+0000","last_change":"2024-04-17T08:46:38.292349+0000","last_active":"2024-04-17T08:46:39.266822+0000","last_peered":"2024-04-17T08:46:39.266822+0000","last_clean":"2024-04-17T08:46:39.266822+0000","last_became_active":"2024-04-17T08:46:38.291572+0000","last_became_peered":"2024-04-17T08:46:38.291572+0000","last_unstale":"2024-04-17T08:46:39.266822+0000","last_undegraded":"2024-04-17T08:46:39.266822+0000","last_fullsized":"2024-04-17T08:46:39.266822+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:10:14.650704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582076+0000","last_change":"2024-04-17T08:46:34.238266+0000","last_active":"2024-04-17T08:46:39.582076+0000","last_peered":"2024-04-17T08:46:39.582076+0000","last_clean":"2024-04-17T08:46:39.582076+0000","last_became_active":"2024-04-17T08:46:34.237968+0000","last_became_peered":"2024-04-17T08:46:34.237968+0000","last_unstale":"2024-04-17T08:46:39.582076+0000","last_undegraded":"2024-04-17T08:46:39.582076+0000","last_fullsized":"2024-04-17T08:46:39.582076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:33:41.705987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581246+0000","last_change":"2024-04-17T08:46:33.228954+0000","last_active":"2024-04-17T08:46:39.581246+0000","last_peered":"2024-04-17T08:46:39.581246+0000","last_clean":"2024-04-17T08:46:39.581246+0000","last_became_active":"2024-04-17T08:46:33.228638+0000","last_became_peered":"2024-04-17T08:46:33.228638+0000","last_unstale":"2024-04-17T08:46:39.581246+0000","last_undegraded":"2024-04-17T08:46:39.581246+0000","last_fullsized":"2024-04-17T08:46:39.581246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:55:39.562141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583149+0000","last_change":"2024-04-17T08:46:38.514583+0000","last_active":"2024-04-17T08:46:39.583149+0000","last_peered":"2024-04-17T08:46:39.583149+0000","last_clean":"2024-04-17T08:46:39.583149+0000","last_became_active":"2024-04-17T08:46:38.514225+0000","last_became_peered":"2024-04-17T08:46:38.514225+0000","last_unstale":"2024-04-17T08:46:39.583149+0000","last_undegraded":"2024-04-17T08:46:39.583149+0000","last_fullsized":"2024-04-17T08:46:39.583149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:34:35.322841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.267337+0000","last_change":"2024-04-17T08:46:34.241177+0000","last_active":"2024-04-17T08:46:39.267337+0000","last_peered":"2024-04-17T08:46:39.267337+0000","last_clean":"2024-04-17T08:46:39.267337+0000","last_became_active":"2024-04-17T08:46:34.240927+0000","last_became_peered":"2024-04-17T08:46:34.240927+0000","last_unstale":"2024-04-17T08:46:39.267337+0000","last_undegraded":"2024-04-17T08:46:39.267337+0000","last_fullsized":"2024-04-17T08:46:39.267337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:55:03.760867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583141+0000","last_change":"2024-04-17T08:46:33.240692+0000","last_active":"2024-04-17T08:46:39.583141+0000","last_peered":"2024-04-17T08:46:39.583141+0000","last_clean":"2024-04-17T08:46:39.583141+0000","last_became_active":"2024-04-17T08:46:33.240411+0000","last_became_peered":"2024-04-17T08:46:33.240411+0000","last_unstale":"2024-04-17T08:46:39.583141+0000","last_undegraded":"2024-04-17T08:46:39.583141+0000","last_fullsized":"2024-04-17T08:46:39.583141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:55:02.754402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.267455+0000","last_change":"2024-04-17T08:46:38.292332+0000","last_active":"2024-04-17T08:46:39.267455+0000","last_peered":"2024-04-17T08:46:39.267455+0000","last_clean":"2024-04-17T08:46:39.267455+0000","last_became_active":"2024-04-17T08:46:38.291458+0000","last_became_peered":"2024-04-17T08:46:38.291458+0000","last_unstale":"2024-04-17T08:46:39.267455+0000","last_undegraded":"2024-04-17T08:46:39.267455+0000","last_fullsized":"2024-04-17T08:46:39.267455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:58:59.558939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582715+0000","last_change":"2024-04-17T08:46:34.240195+0000","last_active":"2024-04-17T08:46:39.582715+0000","last_peered":"2024-04-17T08:46:39.582715+0000","last_clean":"2024-04-17T08:46:39.582715+0000","last_became_active":"2024-04-17T08:46:34.239873+0000","last_became_peered":"2024-04-17T08:46:34.239873+0000","last_unstale":"2024-04-17T08:46:39.582715+0000","last_undegraded":"2024-04-17T08:46:39.582715+0000","last_fullsized":"2024-04-17T08:46:39.582715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:02:18.996319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583776+0000","last_change":"2024-04-17T08:46:33.238292+0000","last_active":"2024-04-17T08:46:39.583776+0000","last_peered":"2024-04-17T08:46:39.583776+0000","last_clean":"2024-04-17T08:46:39.583776+0000","last_became_active":"2024-04-17T08:46:33.237934+0000","last_became_peered":"2024-04-17T08:46:33.237934+0000","last_unstale":"2024-04-17T08:46:39.583776+0000","last_undegraded":"2024-04-17T08:46:39.583776+0000","last_fullsized":"2024-04-17T08:46:39.583776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:22:14.260721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.267275+0000","last_change":"2024-04-17T08:46:38.510638+0000","last_active":"2024-04-17T08:46:39.267275+0000","last_peered":"2024-04-17T08:46:39.267275+0000","last_clean":"2024-04-17T08:46:39.267275+0000","last_became_active":"2024-04-17T08:46:38.510233+0000","last_became_peered":"2024-04-17T08:46:38.510233+0000","last_unstale":"2024-04-17T08:46:39.267275+0000","last_undegraded":"2024-04-17T08:46:39.267275+0000","last_fullsized":"2024-04-17T08:46:39.267275+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:34:25.965169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.584015+0000","last_change":"2024-04-17T08:46:34.252802+0000","last_active":"2024-04-17T08:46:39.584015+0000","last_peered":"2024-04-17T08:46:39.584015+0000","last_clean":"2024-04-17T08:46:39.584015+0000","last_became_active":"2024-04-17T08:46:34.252503+0000","last_became_peered":"2024-04-17T08:46:34.252503+0000","last_unstale":"2024-04-17T08:46:39.584015+0000","last_undegraded":"2024-04-17T08:46:39.584015+0000","last_fullsized":"2024-04-17T08:46:39.584015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:10:10.605700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583273+0000","last_change":"2024-04-17T08:46:33.235073+0000","last_active":"2024-04-17T08:46:39.583273+0000","last_peered":"2024-04-17T08:46:39.583273+0000","last_clean":"2024-04-17T08:46:39.583273+0000","last_became_active":"2024-04-17T08:46:33.234765+0000","last_became_peered":"2024-04-17T08:46:33.234765+0000","last_unstale":"2024-04-17T08:46:39.583273+0000","last_undegraded":"2024-04-17T08:46:39.583273+0000","last_fullsized":"2024-04-17T08:46:39.583273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:18:08.779923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.580688+0000","last_change":"2024-04-17T08:46:38.513389+0000","last_active":"2024-04-17T08:46:39.580688+0000","last_peered":"2024-04-17T08:46:39.580688+0000","last_clean":"2024-04-17T08:46:39.580688+0000","last_became_active":"2024-04-17T08:46:38.512983+0000","last_became_peered":"2024-04-17T08:46:38.512983+0000","last_unstale":"2024-04-17T08:46:39.580688+0000","last_undegraded":"2024-04-17T08:46:39.580688+0000","last_fullsized":"2024-04-17T08:46:39.580688+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:33:35.245363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581949+0000","last_change":"2024-04-17T08:46:34.244956+0000","last_active":"2024-04-17T08:46:39.581949+0000","last_peered":"2024-04-17T08:46:39.581949+0000","last_clean":"2024-04-17T08:46:39.581949+0000","last_became_active":"2024-04-17T08:46:34.244612+0000","last_became_peered":"2024-04-17T08:46:34.244612+0000","last_unstale":"2024-04-17T08:46:39.581949+0000","last_undegraded":"2024-04-17T08:46:39.581949+0000","last_fullsized":"2024-04-17T08:46:39.581949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:33:41.705987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583727+0000","last_change":"2024-04-17T08:46:33.240546+0000","last_active":"2024-04-17T08:46:39.583727+0000","last_peered":"2024-04-17T08:46:39.583727+0000","last_clean":"2024-04-17T08:46:39.583727+0000","last_became_active":"2024-04-17T08:46:33.240225+0000","last_became_peered":"2024-04-17T08:46:33.240225+0000","last_unstale":"2024-04-17T08:46:39.583727+0000","last_undegraded":"2024-04-17T08:46:39.583727+0000","last_fullsized":"2024-04-17T08:46:39.583727+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:39.361759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581144+0000","last_change":"2024-04-17T08:46:38.509788+0000","last_active":"2024-04-17T08:46:39.581144+0000","last_peered":"2024-04-17T08:46:39.581144+0000","last_clean":"2024-04-17T08:46:39.581144+0000","last_became_active":"2024-04-17T08:46:38.509392+0000","last_became_peered":"2024-04-17T08:46:38.509392+0000","last_unstale":"2024-04-17T08:46:39.581144+0000","last_undegraded":"2024-04-17T08:46:39.581144+0000","last_fullsized":"2024-04-17T08:46:39.581144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:58:59.558939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.267877+0000","last_change":"2024-04-17T08:46:34.250149+0000","last_active":"2024-04-17T08:46:39.267877+0000","last_peered":"2024-04-17T08:46:39.267877+0000","last_clean":"2024-04-17T08:46:39.267877+0000","last_became_active":"2024-04-17T08:46:34.249852+0000","last_became_peered":"2024-04-17T08:46:34.249852+0000","last_unstale":"2024-04-17T08:46:39.267877+0000","last_undegraded":"2024-04-17T08:46:39.267877+0000","last_fullsized":"2024-04-17T08:46:39.267877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:44:51.934889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582032+0000","last_change":"2024-04-17T08:46:33.230892+0000","last_active":"2024-04-17T08:46:39.582032+0000","last_peered":"2024-04-17T08:46:39.582032+0000","last_clean":"2024-04-17T08:46:39.582032+0000","last_became_active":"2024-04-17T08:46:33.230624+0000","last_became_peered":"2024-04-17T08:46:33.230624+0000","last_unstale":"2024-04-17T08:46:39.582032+0000","last_undegraded":"2024-04-17T08:46:39.582032+0000","last_fullsized":"2024-04-17T08:46:39.582032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:16:35.663647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581361+0000","last_change":"2024-04-17T08:46:38.291956+0000","last_active":"2024-04-17T08:46:39.581361+0000","last_peered":"2024-04-17T08:46:39.581361+0000","last_clean":"2024-04-17T08:46:39.581361+0000","last_became_active":"2024-04-17T08:46:38.291609+0000","last_became_peered":"2024-04-17T08:46:38.291609+0000","last_unstale":"2024-04-17T08:46:39.581361+0000","last_undegraded":"2024-04-17T08:46:39.581361+0000","last_fullsized":"2024-04-17T08:46:39.581361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:58:59.558939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.266827+0000","last_change":"2024-04-17T08:46:34.241919+0000","last_active":"2024-04-17T08:46:39.266827+0000","last_peered":"2024-04-17T08:46:39.266827+0000","last_clean":"2024-04-17T08:46:39.266827+0000","last_became_active":"2024-04-17T08:46:34.241745+0000","last_became_peered":"2024-04-17T08:46:34.241745+0000","last_unstale":"2024-04-17T08:46:39.266827+0000","last_undegraded":"2024-04-17T08:46:39.266827+0000","last_fullsized":"2024-04-17T08:46:39.266827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:20:20.192296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.265896+0000","last_change":"2024-04-17T08:46:33.223261+0000","last_active":"2024-04-17T08:46:39.265896+0000","last_peered":"2024-04-17T08:46:39.265896+0000","last_clean":"2024-04-17T08:46:39.265896+0000","last_became_active":"2024-04-17T08:46:33.222852+0000","last_became_peered":"2024-04-17T08:46:33.222852+0000","last_unstale":"2024-04-17T08:46:39.265896+0000","last_undegraded":"2024-04-17T08:46:39.265896+0000","last_fullsized":"2024-04-17T08:46:39.265896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:55:02.754402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581903+0000","last_change":"2024-04-17T08:46:38.291195+0000","last_active":"2024-04-17T08:46:39.581903+0000","last_peered":"2024-04-17T08:46:39.581903+0000","last_clean":"2024-04-17T08:46:39.581903+0000","last_became_active":"2024-04-17T08:46:38.290701+0000","last_became_peered":"2024-04-17T08:46:38.290701+0000","last_unstale":"2024-04-17T08:46:39.581903+0000","last_undegraded":"2024-04-17T08:46:39.581903+0000","last_fullsized":"2024-04-17T08:46:39.581903+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:54:46.069200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.580846+0000","last_change":"2024-04-17T08:46:34.243134+0000","last_active":"2024-04-17T08:46:39.580846+0000","last_peered":"2024-04-17T08:46:39.580846+0000","last_clean":"2024-04-17T08:46:39.580846+0000","last_became_active":"2024-04-17T08:46:34.242856+0000","last_became_peered":"2024-04-17T08:46:34.242856+0000","last_unstale":"2024-04-17T08:46:39.580846+0000","last_undegraded":"2024-04-17T08:46:39.580846+0000","last_fullsized":"2024-04-17T08:46:39.580846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:02:18.996319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.263200+0000","last_change":"2024-04-17T08:46:33.233832+0000","last_active":"2024-04-17T08:46:39.263200+0000","last_peered":"2024-04-17T08:46:39.263200+0000","last_clean":"2024-04-17T08:46:39.263200+0000","last_became_active":"2024-04-17T08:46:33.233591+0000","last_became_peered":"2024-04-17T08:46:33.233591+0000","last_unstale":"2024-04-17T08:46:39.263200+0000","last_undegraded":"2024-04-17T08:46:39.263200+0000","last_fullsized":"2024-04-17T08:46:39.263200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:16:35.663647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583229+0000","last_change":"2024-04-17T08:46:38.286653+0000","last_active":"2024-04-17T08:46:39.583229+0000","last_peered":"2024-04-17T08:46:39.583229+0000","last_clean":"2024-04-17T08:46:39.583229+0000","last_became_active":"2024-04-17T08:46:38.285745+0000","last_became_peered":"2024-04-17T08:46:38.285745+0000","last_unstale":"2024-04-17T08:46:39.583229+0000","last_undegraded":"2024-04-17T08:46:39.583229+0000","last_fullsized":"2024-04-17T08:46:39.583229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:30:32.216661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581290+0000","last_change":"2024-04-17T08:46:34.247813+0000","last_active":"2024-04-17T08:46:39.581290+0000","last_peered":"2024-04-17T08:46:39.581290+0000","last_clean":"2024-04-17T08:46:39.581290+0000","last_became_active":"2024-04-17T08:46:34.247520+0000","last_became_peered":"2024-04-17T08:46:34.247520+0000","last_unstale":"2024-04-17T08:46:39.581290+0000","last_undegraded":"2024-04-17T08:46:39.581290+0000","last_fullsized":"2024-04-17T08:46:39.581290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:31:20.501824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583142+0000","last_change":"2024-04-17T08:46:33.238907+0000","last_active":"2024-04-17T08:46:39.583142+0000","last_peered":"2024-04-17T08:46:39.583142+0000","last_clean":"2024-04-17T08:46:39.583142+0000","last_became_active":"2024-04-17T08:46:33.238615+0000","last_became_peered":"2024-04-17T08:46:33.238615+0000","last_unstale":"2024-04-17T08:46:39.583142+0000","last_undegraded":"2024-04-17T08:46:39.583142+0000","last_fullsized":"2024-04-17T08:46:39.583142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:18:08.779923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582573+0000","last_change":"2024-04-17T08:46:38.509796+0000","last_active":"2024-04-17T08:46:39.582573+0000","last_peered":"2024-04-17T08:46:39.582573+0000","last_clean":"2024-04-17T08:46:39.582573+0000","last_became_active":"2024-04-17T08:46:38.509416+0000","last_became_peered":"2024-04-17T08:46:38.509416+0000","last_unstale":"2024-04-17T08:46:39.582573+0000","last_undegraded":"2024-04-17T08:46:39.582573+0000","last_fullsized":"2024-04-17T08:46:39.582573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:30:32.216661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582207+0000","last_change":"2024-04-17T08:46:34.255520+0000","last_active":"2024-04-17T08:46:39.582207+0000","last_peered":"2024-04-17T08:46:39.582207+0000","last_clean":"2024-04-17T08:46:39.582207+0000","last_became_active":"2024-04-17T08:46:34.255053+0000","last_became_peered":"2024-04-17T08:46:34.255053+0000","last_unstale":"2024-04-17T08:46:39.582207+0000","last_undegraded":"2024-04-17T08:46:39.582207+0000","last_fullsized":"2024-04-17T08:46:39.582207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:49:50.654842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.265863+0000","last_change":"2024-04-17T08:46:33.217828+0000","last_active":"2024-04-17T08:46:39.265863+0000","last_peered":"2024-04-17T08:46:39.265863+0000","last_clean":"2024-04-17T08:46:39.265863+0000","last_became_active":"2024-04-17T08:46:33.217484+0000","last_became_peered":"2024-04-17T08:46:33.217484+0000","last_unstale":"2024-04-17T08:46:39.265863+0000","last_undegraded":"2024-04-17T08:46:39.265863+0000","last_fullsized":"2024-04-17T08:46:39.265863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:55:39.562141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":177,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583272+0000","last_change":"2024-04-17T08:46:22.807988+0000","last_active":"2024-04-17T08:46:39.583272+0000","last_peered":"2024-04-17T08:46:39.583272+0000","last_clean":"2024-04-17T08:46:39.583272+0000","last_became_active":"2024-04-17T08:46:22.806843+0000","last_became_peered":"2024-04-17T08:46:22.806843+0000","last_unstale":"2024-04-17T08:46:39.583272+0000","last_undegraded":"2024-04-17T08:46:39.583272+0000","last_fullsized":"2024-04-17T08:46:39.583272+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:21.741557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:21.741557+0000","last_clean_scrub_stamp":"2024-04-17T08:46:21.741557+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:28:38.254696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583294+0000","last_change":"2024-04-17T08:46:38.515691+0000","last_active":"2024-04-17T08:46:39.583294+0000","last_peered":"2024-04-17T08:46:39.583294+0000","last_clean":"2024-04-17T08:46:39.583294+0000","last_became_active":"2024-04-17T08:46:38.515336+0000","last_became_peered":"2024-04-17T08:46:38.515336+0000","last_unstale":"2024-04-17T08:46:39.583294+0000","last_undegraded":"2024-04-17T08:46:39.583294+0000","last_fullsized":"2024-04-17T08:46:39.583294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:34:25.965169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583364+0000","last_change":"2024-04-17T08:46:34.261227+0000","last_active":"2024-04-17T08:46:39.583364+0000","last_peered":"2024-04-17T08:46:39.583364+0000","last_clean":"2024-04-17T08:46:39.583364+0000","last_became_active":"2024-04-17T08:46:34.260463+0000","last_became_peered":"2024-04-17T08:46:34.260463+0000","last_unstale":"2024-04-17T08:46:39.583364+0000","last_undegraded":"2024-04-17T08:46:39.583364+0000","last_fullsized":"2024-04-17T08:46:39.583364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:38:02.038788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.263511+0000","last_change":"2024-04-17T08:46:33.231431+0000","last_active":"2024-04-17T08:46:39.263511+0000","last_peered":"2024-04-17T08:46:39.263511+0000","last_clean":"2024-04-17T08:46:39.263511+0000","last_became_active":"2024-04-17T08:46:33.227785+0000","last_became_peered":"2024-04-17T08:46:33.227785+0000","last_unstale":"2024-04-17T08:46:39.263511+0000","last_undegraded":"2024-04-17T08:46:39.263511+0000","last_fullsized":"2024-04-17T08:46:39.263511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:25:21.370859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582182+0000","last_change":"2024-04-17T08:46:38.514411+0000","last_active":"2024-04-17T08:46:39.582182+0000","last_peered":"2024-04-17T08:46:39.582182+0000","last_clean":"2024-04-17T08:46:39.582182+0000","last_became_active":"2024-04-17T08:46:38.512337+0000","last_became_peered":"2024-04-17T08:46:38.512337+0000","last_unstale":"2024-04-17T08:46:39.582182+0000","last_undegraded":"2024-04-17T08:46:39.582182+0000","last_fullsized":"2024-04-17T08:46:39.582182+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:38:06.083792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.267341+0000","last_change":"2024-04-17T08:46:34.253572+0000","last_active":"2024-04-17T08:46:39.267341+0000","last_peered":"2024-04-17T08:46:39.267341+0000","last_clean":"2024-04-17T08:46:39.267341+0000","last_became_active":"2024-04-17T08:46:34.253185+0000","last_became_peered":"2024-04-17T08:46:34.253185+0000","last_unstale":"2024-04-17T08:46:39.267341+0000","last_undegraded":"2024-04-17T08:46:39.267341+0000","last_fullsized":"2024-04-17T08:46:39.267341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:34:21.920165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582953+0000","last_change":"2024-04-17T08:46:33.224543+0000","last_active":"2024-04-17T08:46:39.582953+0000","last_peered":"2024-04-17T08:46:39.582953+0000","last_clean":"2024-04-17T08:46:39.582953+0000","last_became_active":"2024-04-17T08:46:33.224234+0000","last_became_peered":"2024-04-17T08:46:33.224234+0000","last_unstale":"2024-04-17T08:46:39.582953+0000","last_undegraded":"2024-04-17T08:46:39.582953+0000","last_fullsized":"2024-04-17T08:46:39.582953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:30:42.762461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581393+0000","last_change":"2024-04-17T08:46:38.289173+0000","last_active":"2024-04-17T08:46:39.581393+0000","last_peered":"2024-04-17T08:46:39.581393+0000","last_clean":"2024-04-17T08:46:39.581393+0000","last_became_active":"2024-04-17T08:46:38.288767+0000","last_became_peered":"2024-04-17T08:46:38.288767+0000","last_unstale":"2024-04-17T08:46:39.581393+0000","last_undegraded":"2024-04-17T08:46:39.581393+0000","last_fullsized":"2024-04-17T08:46:39.581393+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:44:55.979892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583968+0000","last_change":"2024-04-17T08:46:34.255234+0000","last_active":"2024-04-17T08:46:39.583968+0000","last_peered":"2024-04-17T08:46:39.583968+0000","last_clean":"2024-04-17T08:46:39.583968+0000","last_became_active":"2024-04-17T08:46:34.254849+0000","last_became_peered":"2024-04-17T08:46:34.254849+0000","last_unstale":"2024-04-17T08:46:39.583968+0000","last_undegraded":"2024-04-17T08:46:39.583968+0000","last_fullsized":"2024-04-17T08:46:39.583968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:33:31.200359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.263578+0000","last_change":"2024-04-17T08:46:33.236511+0000","last_active":"2024-04-17T08:46:39.263578+0000","last_peered":"2024-04-17T08:46:39.263578+0000","last_clean":"2024-04-17T08:46:39.263578+0000","last_became_active":"2024-04-17T08:46:33.236059+0000","last_became_peered":"2024-04-17T08:46:33.236059+0000","last_unstale":"2024-04-17T08:46:39.263578+0000","last_undegraded":"2024-04-17T08:46:39.263578+0000","last_fullsized":"2024-04-17T08:46:39.263578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:55:39.562141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.265271+0000","last_change":"2024-04-17T08:46:38.511281+0000","last_active":"2024-04-17T08:46:39.265271+0000","last_peered":"2024-04-17T08:46:39.265271+0000","last_clean":"2024-04-17T08:46:39.265271+0000","last_became_active":"2024-04-17T08:46:38.510068+0000","last_became_peered":"2024-04-17T08:46:38.510068+0000","last_unstale":"2024-04-17T08:46:39.265271+0000","last_undegraded":"2024-04-17T08:46:39.265271+0000","last_fullsized":"2024-04-17T08:46:39.265271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:00:35.685592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.584095+0000","last_change":"2024-04-17T08:46:34.249995+0000","last_active":"2024-04-17T08:46:39.584095+0000","last_peered":"2024-04-17T08:46:39.584095+0000","last_clean":"2024-04-17T08:46:39.584095+0000","last_became_active":"2024-04-17T08:46:34.249729+0000","last_became_peered":"2024-04-17T08:46:34.249729+0000","last_unstale":"2024-04-17T08:46:39.584095+0000","last_undegraded":"2024-04-17T08:46:39.584095+0000","last_fullsized":"2024-04-17T08:46:39.584095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:16:39.000776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.267069+0000","last_change":"2024-04-17T08:46:33.231993+0000","last_active":"2024-04-17T08:46:39.267069+0000","last_peered":"2024-04-17T08:46:39.267069+0000","last_clean":"2024-04-17T08:46:39.267069+0000","last_became_active":"2024-04-17T08:46:33.231265+0000","last_became_peered":"2024-04-17T08:46:33.231265+0000","last_unstale":"2024-04-17T08:46:39.267069+0000","last_undegraded":"2024-04-17T08:46:39.267069+0000","last_fullsized":"2024-04-17T08:46:39.267069+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:53:22.090817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.266950+0000","last_change":"2024-04-17T08:46:38.284999+0000","last_active":"2024-04-17T08:46:39.266950+0000","last_peered":"2024-04-17T08:46:39.266950+0000","last_clean":"2024-04-17T08:46:39.266950+0000","last_became_active":"2024-04-17T08:46:38.284570+0000","last_became_peered":"2024-04-17T08:46:38.284570+0000","last_unstale":"2024-04-17T08:46:39.266950+0000","last_undegraded":"2024-04-17T08:46:39.266950+0000","last_fullsized":"2024-04-17T08:46:39.266950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:16:43.045780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582901+0000","last_change":"2024-04-17T08:46:34.255136+0000","last_active":"2024-04-17T08:46:39.582901+0000","last_peered":"2024-04-17T08:46:39.582901+0000","last_clean":"2024-04-17T08:46:39.582901+0000","last_became_active":"2024-04-17T08:46:34.254805+0000","last_became_peered":"2024-04-17T08:46:34.254805+0000","last_unstale":"2024-04-17T08:46:39.582901+0000","last_undegraded":"2024-04-17T08:46:39.582901+0000","last_fullsized":"2024-04-17T08:46:39.582901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:44:51.934889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.263098+0000","last_change":"2024-04-17T08:46:33.221884+0000","last_active":"2024-04-17T08:46:39.263098+0000","last_peered":"2024-04-17T08:46:39.263098+0000","last_clean":"2024-04-17T08:46:39.263098+0000","last_became_active":"2024-04-17T08:46:33.220945+0000","last_became_peered":"2024-04-17T08:46:33.220945+0000","last_unstale":"2024-04-17T08:46:39.263098+0000","last_undegraded":"2024-04-17T08:46:39.263098+0000","last_fullsized":"2024-04-17T08:46:39.263098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:32:08.431466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582440+0000","last_change":"2024-04-17T08:46:38.292234+0000","last_active":"2024-04-17T08:46:39.582440+0000","last_peered":"2024-04-17T08:46:39.582440+0000","last_clean":"2024-04-17T08:46:39.582440+0000","last_became_active":"2024-04-17T08:46:38.291831+0000","last_became_peered":"2024-04-17T08:46:38.291831+0000","last_unstale":"2024-04-17T08:46:39.582440+0000","last_undegraded":"2024-04-17T08:46:39.582440+0000","last_fullsized":"2024-04-17T08:46:39.582440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:34:35.322841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582128+0000","last_change":"2024-04-17T08:46:34.238104+0000","last_active":"2024-04-17T08:46:39.582128+0000","last_peered":"2024-04-17T08:46:39.582128+0000","last_clean":"2024-04-17T08:46:39.582128+0000","last_became_active":"2024-04-17T08:46:34.237741+0000","last_became_peered":"2024-04-17T08:46:34.237741+0000","last_unstale":"2024-04-17T08:46:39.582128+0000","last_undegraded":"2024-04-17T08:46:39.582128+0000","last_fullsized":"2024-04-17T08:46:39.582128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:12:09.665391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582338+0000","last_change":"2024-04-17T08:46:33.227055+0000","last_active":"2024-04-17T08:46:39.582338+0000","last_peered":"2024-04-17T08:46:39.582338+0000","last_clean":"2024-04-17T08:46:39.582338+0000","last_became_active":"2024-04-17T08:46:33.226787+0000","last_became_peered":"2024-04-17T08:46:33.226787+0000","last_unstale":"2024-04-17T08:46:39.582338+0000","last_undegraded":"2024-04-17T08:46:39.582338+0000","last_fullsized":"2024-04-17T08:46:39.582338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:25:21.370859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583895+0000","last_change":"2024-04-17T08:46:38.514388+0000","last_active":"2024-04-17T08:46:39.583895+0000","last_peered":"2024-04-17T08:46:39.583895+0000","last_clean":"2024-04-17T08:46:39.583895+0000","last_became_active":"2024-04-17T08:46:38.514047+0000","last_became_peered":"2024-04-17T08:46:38.514047+0000","last_unstale":"2024-04-17T08:46:39.583895+0000","last_undegraded":"2024-04-17T08:46:39.583895+0000","last_fullsized":"2024-04-17T08:46:39.583895+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:43:04.302500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583016+0000","last_change":"2024-04-17T08:46:34.249520+0000","last_active":"2024-04-17T08:46:39.583016+0000","last_peered":"2024-04-17T08:46:39.583016+0000","last_clean":"2024-04-17T08:46:39.583016+0000","last_became_active":"2024-04-17T08:46:34.249225+0000","last_became_peered":"2024-04-17T08:46:34.249225+0000","last_unstale":"2024-04-17T08:46:39.583016+0000","last_undegraded":"2024-04-17T08:46:39.583016+0000","last_fullsized":"2024-04-17T08:46:39.583016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:54:42.024196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.265861+0000","last_change":"2024-04-17T08:46:33.236864+0000","last_active":"2024-04-17T08:46:39.265861+0000","last_peered":"2024-04-17T08:46:39.265861+0000","last_clean":"2024-04-17T08:46:39.265861+0000","last_became_active":"2024-04-17T08:46:33.236095+0000","last_became_peered":"2024-04-17T08:46:33.236095+0000","last_unstale":"2024-04-17T08:46:39.265861+0000","last_undegraded":"2024-04-17T08:46:39.265861+0000","last_fullsized":"2024-04-17T08:46:39.265861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:20:19.185830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582486+0000","last_change":"2024-04-17T08:46:38.509818+0000","last_active":"2024-04-17T08:46:39.582486+0000","last_peered":"2024-04-17T08:46:39.582486+0000","last_clean":"2024-04-17T08:46:39.582486+0000","last_became_active":"2024-04-17T08:46:38.509380+0000","last_became_peered":"2024-04-17T08:46:38.509380+0000","last_unstale":"2024-04-17T08:46:39.582486+0000","last_undegraded":"2024-04-17T08:46:39.582486+0000","last_fullsized":"2024-04-17T08:46:39.582486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:52:13.249971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581564+0000","last_change":"2024-04-17T08:46:34.248655+0000","last_active":"2024-04-17T08:46:39.581564+0000","last_peered":"2024-04-17T08:46:39.581564+0000","last_clean":"2024-04-17T08:46:39.581564+0000","last_became_active":"2024-04-17T08:46:34.247990+0000","last_became_peered":"2024-04-17T08:46:34.247990+0000","last_unstale":"2024-04-17T08:46:39.581564+0000","last_undegraded":"2024-04-17T08:46:39.581564+0000","last_fullsized":"2024-04-17T08:46:39.581564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:37:26.964605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581610+0000","last_change":"2024-04-17T08:46:33.225329+0000","last_active":"2024-04-17T08:46:39.581610+0000","last_peered":"2024-04-17T08:46:39.581610+0000","last_clean":"2024-04-17T08:46:39.581610+0000","last_became_active":"2024-04-17T08:46:33.225006+0000","last_became_peered":"2024-04-17T08:46:33.225006+0000","last_unstale":"2024-04-17T08:46:39.581610+0000","last_undegraded":"2024-04-17T08:46:39.581610+0000","last_fullsized":"2024-04-17T08:46:39.581610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:06:52.298728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.267811+0000","last_change":"2024-04-17T08:46:38.512665+0000","last_active":"2024-04-17T08:46:39.267811+0000","last_peered":"2024-04-17T08:46:39.267811+0000","last_clean":"2024-04-17T08:46:39.267811+0000","last_became_active":"2024-04-17T08:46:38.511018+0000","last_became_peered":"2024-04-17T08:46:38.511018+0000","last_unstale":"2024-04-17T08:46:39.267811+0000","last_undegraded":"2024-04-17T08:46:39.267811+0000","last_fullsized":"2024-04-17T08:46:39.267811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:07:22.236476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583254+0000","last_change":"2024-04-17T08:46:34.253169+0000","last_active":"2024-04-17T08:46:39.583254+0000","last_peered":"2024-04-17T08:46:39.583254+0000","last_clean":"2024-04-17T08:46:39.583254+0000","last_became_active":"2024-04-17T08:46:34.252781+0000","last_became_peered":"2024-04-17T08:46:34.252781+0000","last_unstale":"2024-04-17T08:46:39.583254+0000","last_undegraded":"2024-04-17T08:46:39.583254+0000","last_fullsized":"2024-04-17T08:46:39.583254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:58:55.513935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'10","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:49.408874+0000","last_change":"2024-04-17T08:46:33.238253+0000","last_active":"2024-04-17T08:46:49.408874+0000","last_peered":"2024-04-17T08:46:49.408874+0000","last_clean":"2024-04-17T08:46:49.408874+0000","last_became_active":"2024-04-17T08:46:33.237894+0000","last_became_peered":"2024-04-17T08:46:33.237894+0000","last_unstale":"2024-04-17T08:46:49.408874+0000","last_undegraded":"2024-04-17T08:46:49.408874+0000","last_fullsized":"2024-04-17T08:46:49.408874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:16:35.663647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581576+0000","last_change":"2024-04-17T08:46:38.292629+0000","last_active":"2024-04-17T08:46:39.581576+0000","last_peered":"2024-04-17T08:46:39.581576+0000","last_clean":"2024-04-17T08:46:39.581576+0000","last_became_active":"2024-04-17T08:46:38.292238+0000","last_became_peered":"2024-04-17T08:46:38.292238+0000","last_unstale":"2024-04-17T08:46:39.581576+0000","last_undegraded":"2024-04-17T08:46:39.581576+0000","last_fullsized":"2024-04-17T08:46:39.581576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:44:55.979892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.267104+0000","last_change":"2024-04-17T08:46:34.247592+0000","last_active":"2024-04-17T08:46:39.267104+0000","last_peered":"2024-04-17T08:46:39.267104+0000","last_clean":"2024-04-17T08:46:39.267104+0000","last_became_active":"2024-04-17T08:46:34.247307+0000","last_became_peered":"2024-04-17T08:46:34.247307+0000","last_unstale":"2024-04-17T08:46:39.267104+0000","last_undegraded":"2024-04-17T08:46:39.267104+0000","last_fullsized":"2024-04-17T08:46:39.267104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:22:15.267186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582951+0000","last_change":"2024-04-17T08:46:33.226914+0000","last_active":"2024-04-17T08:46:39.582951+0000","last_peered":"2024-04-17T08:46:39.582951+0000","last_clean":"2024-04-17T08:46:39.582951+0000","last_became_active":"2024-04-17T08:46:33.226607+0000","last_became_peered":"2024-04-17T08:46:33.226607+0000","last_unstale":"2024-04-17T08:46:39.582951+0000","last_undegraded":"2024-04-17T08:46:39.582951+0000","last_fullsized":"2024-04-17T08:46:39.582951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:22:14.260721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.266708+0000","last_change":"2024-04-17T08:46:38.286086+0000","last_active":"2024-04-17T08:46:39.266708+0000","last_peered":"2024-04-17T08:46:39.266708+0000","last_clean":"2024-04-17T08:46:39.266708+0000","last_became_active":"2024-04-17T08:46:38.285105+0000","last_became_peered":"2024-04-17T08:46:38.285105+0000","last_unstale":"2024-04-17T08:46:39.266708+0000","last_undegraded":"2024-04-17T08:46:39.266708+0000","last_fullsized":"2024-04-17T08:46:39.266708+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:13:14.354152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582237+0000","last_change":"2024-04-17T08:46:34.255537+0000","last_active":"2024-04-17T08:46:39.582237+0000","last_peered":"2024-04-17T08:46:39.582237+0000","last_clean":"2024-04-17T08:46:39.582237+0000","last_became_active":"2024-04-17T08:46:34.254801+0000","last_became_peered":"2024-04-17T08:46:34.254801+0000","last_unstale":"2024-04-17T08:46:39.582237+0000","last_undegraded":"2024-04-17T08:46:39.582237+0000","last_fullsized":"2024-04-17T08:46:39.582237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:13:50.529902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.267835+0000","last_change":"2024-04-17T08:46:33.233506+0000","last_active":"2024-04-17T08:46:39.267835+0000","last_peered":"2024-04-17T08:46:39.267835+0000","last_clean":"2024-04-17T08:46:39.267835+0000","last_became_active":"2024-04-17T08:46:33.233232+0000","last_became_peered":"2024-04-17T08:46:33.233232+0000","last_unstale":"2024-04-17T08:46:39.267835+0000","last_undegraded":"2024-04-17T08:46:39.267835+0000","last_fullsized":"2024-04-17T08:46:39.267835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:16:35.663647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581800+0000","last_change":"2024-04-17T08:46:38.279439+0000","last_active":"2024-04-17T08:46:39.581800+0000","last_peered":"2024-04-17T08:46:39.581800+0000","last_clean":"2024-04-17T08:46:39.581800+0000","last_became_active":"2024-04-17T08:46:38.278889+0000","last_became_peered":"2024-04-17T08:46:38.278889+0000","last_unstale":"2024-04-17T08:46:39.581800+0000","last_undegraded":"2024-04-17T08:46:39.581800+0000","last_fullsized":"2024-04-17T08:46:39.581800+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:43:42.690286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.267666+0000","last_change":"2024-04-17T08:46:34.259801+0000","last_active":"2024-04-17T08:46:39.267666+0000","last_peered":"2024-04-17T08:46:39.267666+0000","last_clean":"2024-04-17T08:46:39.267666+0000","last_became_active":"2024-04-17T08:46:34.259498+0000","last_became_peered":"2024-04-17T08:46:34.259498+0000","last_unstale":"2024-04-17T08:46:39.267666+0000","last_undegraded":"2024-04-17T08:46:39.267666+0000","last_fullsized":"2024-04-17T08:46:39.267666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:54:42.024196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583657+0000","last_change":"2024-04-17T08:46:33.235837+0000","last_active":"2024-04-17T08:46:39.583657+0000","last_peered":"2024-04-17T08:46:39.583657+0000","last_clean":"2024-04-17T08:46:39.583657+0000","last_became_active":"2024-04-17T08:46:33.235456+0000","last_became_peered":"2024-04-17T08:46:33.235456+0000","last_unstale":"2024-04-17T08:46:39.583657+0000","last_undegraded":"2024-04-17T08:46:39.583657+0000","last_fullsized":"2024-04-17T08:46:39.583657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:18:08.779923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582353+0000","last_change":"2024-04-17T08:46:38.509993+0000","last_active":"2024-04-17T08:46:39.582353+0000","last_peered":"2024-04-17T08:46:39.582353+0000","last_clean":"2024-04-17T08:46:39.582353+0000","last_became_active":"2024-04-17T08:46:38.509510+0000","last_became_peered":"2024-04-17T08:46:38.509510+0000","last_unstale":"2024-04-17T08:46:39.582353+0000","last_undegraded":"2024-04-17T08:46:39.582353+0000","last_fullsized":"2024-04-17T08:46:39.582353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:07:22.236476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582291+0000","last_change":"2024-04-17T08:46:38.510357+0000","last_active":"2024-04-17T08:46:39.582291+0000","last_peered":"2024-04-17T08:46:39.582291+0000","last_clean":"2024-04-17T08:46:39.582291+0000","last_became_active":"2024-04-17T08:46:38.509996+0000","last_became_peered":"2024-04-17T08:46:38.509996+0000","last_unstale":"2024-04-17T08:46:39.582291+0000","last_undegraded":"2024-04-17T08:46:39.582291+0000","last_fullsized":"2024-04-17T08:46:39.582291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:54:46.069200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581341+0000","last_change":"2024-04-17T08:46:34.238153+0000","last_active":"2024-04-17T08:46:39.581341+0000","last_peered":"2024-04-17T08:46:39.581341+0000","last_clean":"2024-04-17T08:46:39.581341+0000","last_became_active":"2024-04-17T08:46:34.237904+0000","last_became_peered":"2024-04-17T08:46:34.237904+0000","last_unstale":"2024-04-17T08:46:39.581341+0000","last_undegraded":"2024-04-17T08:46:39.581341+0000","last_fullsized":"2024-04-17T08:46:39.581341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:13:50.529902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.265341+0000","last_change":"2024-04-17T08:46:33.219586+0000","last_active":"2024-04-17T08:46:39.265341+0000","last_peered":"2024-04-17T08:46:39.265341+0000","last_clean":"2024-04-17T08:46:39.265341+0000","last_became_active":"2024-04-17T08:46:33.219227+0000","last_became_peered":"2024-04-17T08:46:33.219227+0000","last_unstale":"2024-04-17T08:46:39.265341+0000","last_undegraded":"2024-04-17T08:46:39.265341+0000","last_fullsized":"2024-04-17T08:46:39.265341+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:18:08.779923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583582+0000","last_change":"2024-04-17T08:46:38.287983+0000","last_active":"2024-04-17T08:46:39.583582+0000","last_peered":"2024-04-17T08:46:39.583582+0000","last_clean":"2024-04-17T08:46:39.583582+0000","last_became_active":"2024-04-17T08:46:38.287651+0000","last_became_peered":"2024-04-17T08:46:38.287651+0000","last_unstale":"2024-04-17T08:46:39.583582+0000","last_undegraded":"2024-04-17T08:46:39.583582+0000","last_fullsized":"2024-04-17T08:46:39.583582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:58:59.558939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581971+0000","last_change":"2024-04-17T08:46:34.237638+0000","last_active":"2024-04-17T08:46:39.581971+0000","last_peered":"2024-04-17T08:46:39.581971+0000","last_clean":"2024-04-17T08:46:39.581971+0000","last_became_active":"2024-04-17T08:46:34.237276+0000","last_became_peered":"2024-04-17T08:46:34.237276+0000","last_unstale":"2024-04-17T08:46:39.581971+0000","last_undegraded":"2024-04-17T08:46:39.581971+0000","last_fullsized":"2024-04-17T08:46:39.581971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:02:18.996319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582616+0000","last_change":"2024-04-17T08:46:33.230158+0000","last_active":"2024-04-17T08:46:39.582616+0000","last_peered":"2024-04-17T08:46:39.582616+0000","last_clean":"2024-04-17T08:46:39.582616+0000","last_became_active":"2024-04-17T08:46:33.229871+0000","last_became_peered":"2024-04-17T08:46:33.229871+0000","last_unstale":"2024-04-17T08:46:39.582616+0000","last_undegraded":"2024-04-17T08:46:39.582616+0000","last_fullsized":"2024-04-17T08:46:39.582616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:32:08.431466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582487+0000","last_change":"2024-04-17T08:46:33.228412+0000","last_active":"2024-04-17T08:46:39.582487+0000","last_peered":"2024-04-17T08:46:39.582487+0000","last_clean":"2024-04-17T08:46:39.582487+0000","last_became_active":"2024-04-17T08:46:33.228163+0000","last_became_peered":"2024-04-17T08:46:33.228163+0000","last_unstale":"2024-04-17T08:46:39.582487+0000","last_undegraded":"2024-04-17T08:46:39.582487+0000","last_fullsized":"2024-04-17T08:46:39.582487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:55:39.562141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581525+0000","last_change":"2024-04-17T08:46:34.248503+0000","last_active":"2024-04-17T08:46:39.581525+0000","last_peered":"2024-04-17T08:46:39.581525+0000","last_clean":"2024-04-17T08:46:39.581525+0000","last_became_active":"2024-04-17T08:46:34.247808+0000","last_became_peered":"2024-04-17T08:46:34.247808+0000","last_unstale":"2024-04-17T08:46:39.581525+0000","last_undegraded":"2024-04-17T08:46:39.581525+0000","last_fullsized":"2024-04-17T08:46:39.581525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:33:10.927487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.263496+0000","last_change":"2024-04-17T08:46:38.291370+0000","last_active":"2024-04-17T08:46:39.263496+0000","last_peered":"2024-04-17T08:46:39.263496+0000","last_clean":"2024-04-17T08:46:39.263496+0000","last_became_active":"2024-04-17T08:46:38.290866+0000","last_became_peered":"2024-04-17T08:46:38.290866+0000","last_unstale":"2024-04-17T08:46:39.263496+0000","last_undegraded":"2024-04-17T08:46:39.263496+0000","last_fullsized":"2024-04-17T08:46:39.263496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:44.413228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582559+0000","last_change":"2024-04-17T08:46:33.239929+0000","last_active":"2024-04-17T08:46:39.582559+0000","last_peered":"2024-04-17T08:46:39.582559+0000","last_clean":"2024-04-17T08:46:39.582559+0000","last_became_active":"2024-04-17T08:46:33.239619+0000","last_became_peered":"2024-04-17T08:46:33.239619+0000","last_unstale":"2024-04-17T08:46:39.582559+0000","last_undegraded":"2024-04-17T08:46:39.582559+0000","last_fullsized":"2024-04-17T08:46:39.582559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:22:07.958599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.266472+0000","last_change":"2024-04-17T08:46:34.237105+0000","last_active":"2024-04-17T08:46:39.266472+0000","last_peered":"2024-04-17T08:46:39.266472+0000","last_clean":"2024-04-17T08:46:39.266472+0000","last_became_active":"2024-04-17T08:46:34.236792+0000","last_became_peered":"2024-04-17T08:46:34.236792+0000","last_unstale":"2024-04-17T08:46:39.266472+0000","last_undegraded":"2024-04-17T08:46:39.266472+0000","last_fullsized":"2024-04-17T08:46:39.266472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:16:36.670112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583657+0000","last_change":"2024-04-17T08:46:38.287775+0000","last_active":"2024-04-17T08:46:39.583657+0000","last_peered":"2024-04-17T08:46:39.583657+0000","last_clean":"2024-04-17T08:46:39.583657+0000","last_became_active":"2024-04-17T08:46:38.287403+0000","last_became_peered":"2024-04-17T08:46:38.287403+0000","last_unstale":"2024-04-17T08:46:39.583657+0000","last_undegraded":"2024-04-17T08:46:39.583657+0000","last_fullsized":"2024-04-17T08:46:39.583657+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:32:12.270818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582001+0000","last_change":"2024-04-17T08:46:34.238359+0000","last_active":"2024-04-17T08:46:39.582001+0000","last_peered":"2024-04-17T08:46:39.582001+0000","last_clean":"2024-04-17T08:46:39.582001+0000","last_became_active":"2024-04-17T08:46:34.237809+0000","last_became_peered":"2024-04-17T08:46:34.237809+0000","last_unstale":"2024-04-17T08:46:39.582001+0000","last_undegraded":"2024-04-17T08:46:39.582001+0000","last_fullsized":"2024-04-17T08:46:39.582001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:17:38.605512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.263186+0000","last_change":"2024-04-17T08:46:34.251080+0000","last_active":"2024-04-17T08:46:39.263186+0000","last_peered":"2024-04-17T08:46:39.263186+0000","last_clean":"2024-04-17T08:46:39.263186+0000","last_became_active":"2024-04-17T08:46:34.250660+0000","last_became_peered":"2024-04-17T08:46:34.250660+0000","last_unstale":"2024-04-17T08:46:39.263186+0000","last_undegraded":"2024-04-17T08:46:39.263186+0000","last_fullsized":"2024-04-17T08:46:39.263186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:18:09.786388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.265791+0000","last_change":"2024-04-17T08:46:34.255117+0000","last_active":"2024-04-17T08:46:39.265791+0000","last_peered":"2024-04-17T08:46:39.265791+0000","last_clean":"2024-04-17T08:46:39.265791+0000","last_became_active":"2024-04-17T08:46:34.251710+0000","last_became_peered":"2024-04-17T08:46:34.251710+0000","last_unstale":"2024-04-17T08:46:39.265791+0000","last_undegraded":"2024-04-17T08:46:39.265791+0000","last_fullsized":"2024-04-17T08:46:39.265791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:10:10.605700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581443+0000","last_change":"2024-04-17T08:46:34.241337+0000","last_active":"2024-04-17T08:46:39.581443+0000","last_peered":"2024-04-17T08:46:39.581443+0000","last_clean":"2024-04-17T08:46:39.581443+0000","last_became_active":"2024-04-17T08:46:34.241042+0000","last_became_peered":"2024-04-17T08:46:34.241042+0000","last_unstale":"2024-04-17T08:46:39.581443+0000","last_undegraded":"2024-04-17T08:46:39.581443+0000","last_fullsized":"2024-04-17T08:46:39.581443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:49:50.654842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582703+0000","last_change":"2024-04-17T08:46:34.245617+0000","last_active":"2024-04-17T08:46:39.582703+0000","last_peered":"2024-04-17T08:46:39.582703+0000","last_clean":"2024-04-17T08:46:39.582703+0000","last_became_active":"2024-04-17T08:46:34.245271+0000","last_became_peered":"2024-04-17T08:46:34.245271+0000","last_unstale":"2024-04-17T08:46:39.582703+0000","last_undegraded":"2024-04-17T08:46:39.582703+0000","last_fullsized":"2024-04-17T08:46:39.582703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:13:50.529902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582834+0000","last_change":"2024-04-17T08:46:34.239456+0000","last_active":"2024-04-17T08:46:39.582834+0000","last_peered":"2024-04-17T08:46:39.582834+0000","last_clean":"2024-04-17T08:46:39.582834+0000","last_became_active":"2024-04-17T08:46:34.239162+0000","last_became_peered":"2024-04-17T08:46:34.239162+0000","last_unstale":"2024-04-17T08:46:39.582834+0000","last_undegraded":"2024-04-17T08:46:39.582834+0000","last_fullsized":"2024-04-17T08:46:39.582834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:49:50.654842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583417+0000","last_change":"2024-04-17T08:46:34.246242+0000","last_active":"2024-04-17T08:46:39.583417+0000","last_peered":"2024-04-17T08:46:39.583417+0000","last_clean":"2024-04-17T08:46:39.583417+0000","last_became_active":"2024-04-17T08:46:34.245994+0000","last_became_peered":"2024-04-17T08:46:34.245994+0000","last_unstale":"2024-04-17T08:46:39.583417+0000","last_undegraded":"2024-04-17T08:46:39.583417+0000","last_fullsized":"2024-04-17T08:46:39.583417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:13:50.529902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583939+0000","last_change":"2024-04-17T08:46:34.245854+0000","last_active":"2024-04-17T08:46:39.583939+0000","last_peered":"2024-04-17T08:46:39.583939+0000","last_clean":"2024-04-17T08:46:39.583939+0000","last_became_active":"2024-04-17T08:46:34.245381+0000","last_became_peered":"2024-04-17T08:46:34.245381+0000","last_unstale":"2024-04-17T08:46:39.583939+0000","last_undegraded":"2024-04-17T08:46:39.583939+0000","last_fullsized":"2024-04-17T08:46:39.583939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:13:10.309148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.265310+0000","last_change":"2024-04-17T08:46:34.249141+0000","last_active":"2024-04-17T08:46:39.265310+0000","last_peered":"2024-04-17T08:46:39.265310+0000","last_clean":"2024-04-17T08:46:39.265310+0000","last_became_active":"2024-04-17T08:46:34.248632+0000","last_became_peered":"2024-04-17T08:46:34.248632+0000","last_unstale":"2024-04-17T08:46:39.265310+0000","last_undegraded":"2024-04-17T08:46:39.265310+0000","last_fullsized":"2024-04-17T08:46:39.265310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:13:50.529902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582465+0000","last_change":"2024-04-17T08:46:34.247025+0000","last_active":"2024-04-17T08:46:39.582465+0000","last_peered":"2024-04-17T08:46:39.582465+0000","last_clean":"2024-04-17T08:46:39.582465+0000","last_became_active":"2024-04-17T08:46:34.246769+0000","last_became_peered":"2024-04-17T08:46:34.246769+0000","last_unstale":"2024-04-17T08:46:39.582465+0000","last_undegraded":"2024-04-17T08:46:39.582465+0000","last_fullsized":"2024-04-17T08:46:39.582465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:12:09.665391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.265741+0000","last_change":"2024-04-17T08:46:34.253773+0000","last_active":"2024-04-17T08:46:39.265741+0000","last_peered":"2024-04-17T08:46:39.265741+0000","last_clean":"2024-04-17T08:46:39.265741+0000","last_became_active":"2024-04-17T08:46:34.253462+0000","last_became_peered":"2024-04-17T08:46:34.253462+0000","last_unstale":"2024-04-17T08:46:39.265741+0000","last_undegraded":"2024-04-17T08:46:39.265741+0000","last_fullsized":"2024-04-17T08:46:39.265741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:13:10.309148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581198+0000","last_change":"2024-04-17T08:46:34.248730+0000","last_active":"2024-04-17T08:46:39.581198+0000","last_peered":"2024-04-17T08:46:39.581198+0000","last_clean":"2024-04-17T08:46:39.581198+0000","last_became_active":"2024-04-17T08:46:34.248175+0000","last_became_peered":"2024-04-17T08:46:34.248175+0000","last_unstale":"2024-04-17T08:46:39.581198+0000","last_undegraded":"2024-04-17T08:46:39.581198+0000","last_fullsized":"2024-04-17T08:46:39.581198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:12:09.665391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582624+0000","last_change":"2024-04-17T08:46:34.240984+0000","last_active":"2024-04-17T08:46:39.582624+0000","last_peered":"2024-04-17T08:46:39.582624+0000","last_clean":"2024-04-17T08:46:39.582624+0000","last_became_active":"2024-04-17T08:46:34.240649+0000","last_became_peered":"2024-04-17T08:46:34.240649+0000","last_unstale":"2024-04-17T08:46:39.582624+0000","last_undegraded":"2024-04-17T08:46:39.582624+0000","last_fullsized":"2024-04-17T08:46:39.582624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:49:50.654842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583627+0000","last_change":"2024-04-17T08:46:34.252899+0000","last_active":"2024-04-17T08:46:39.583627+0000","last_peered":"2024-04-17T08:46:39.583627+0000","last_clean":"2024-04-17T08:46:39.583627+0000","last_became_active":"2024-04-17T08:46:34.252649+0000","last_became_peered":"2024-04-17T08:46:34.252649+0000","last_unstale":"2024-04-17T08:46:39.583627+0000","last_undegraded":"2024-04-17T08:46:39.583627+0000","last_fullsized":"2024-04-17T08:46:39.583627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:34:31.277838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.263565+0000","last_change":"2024-04-17T08:46:34.245775+0000","last_active":"2024-04-17T08:46:39.263565+0000","last_peered":"2024-04-17T08:46:39.263565+0000","last_clean":"2024-04-17T08:46:39.263565+0000","last_became_active":"2024-04-17T08:46:34.245478+0000","last_became_peered":"2024-04-17T08:46:34.245478+0000","last_unstale":"2024-04-17T08:46:39.263565+0000","last_undegraded":"2024-04-17T08:46:39.263565+0000","last_fullsized":"2024-04-17T08:46:39.263565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:22:15.267186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.268138+0000","last_change":"2024-04-17T08:46:34.263140+0000","last_active":"2024-04-17T08:46:39.268138+0000","last_peered":"2024-04-17T08:46:39.268138+0000","last_clean":"2024-04-17T08:46:39.268138+0000","last_became_active":"2024-04-17T08:46:34.261735+0000","last_became_peered":"2024-04-17T08:46:34.261735+0000","last_unstale":"2024-04-17T08:46:39.268138+0000","last_undegraded":"2024-04-17T08:46:39.268138+0000","last_fullsized":"2024-04-17T08:46:39.268138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:34:31.277838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.265194+0000","last_change":"2024-04-17T08:46:34.252436+0000","last_active":"2024-04-17T08:46:39.265194+0000","last_peered":"2024-04-17T08:46:39.265194+0000","last_clean":"2024-04-17T08:46:39.265194+0000","last_became_active":"2024-04-17T08:46:34.250951+0000","last_became_peered":"2024-04-17T08:46:34.250951+0000","last_unstale":"2024-04-17T08:46:39.265194+0000","last_undegraded":"2024-04-17T08:46:39.265194+0000","last_fullsized":"2024-04-17T08:46:39.265194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:33:10.927487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581141+0000","last_change":"2024-04-17T08:46:34.243835+0000","last_active":"2024-04-17T08:46:39.581141+0000","last_peered":"2024-04-17T08:46:39.581141+0000","last_clean":"2024-04-17T08:46:39.581141+0000","last_became_active":"2024-04-17T08:46:34.243503+0000","last_became_peered":"2024-04-17T08:46:34.243503+0000","last_unstale":"2024-04-17T08:46:39.581141+0000","last_undegraded":"2024-04-17T08:46:39.581141+0000","last_fullsized":"2024-04-17T08:46:39.581141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:17:38.605512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581483+0000","last_change":"2024-04-17T08:46:34.239204+0000","last_active":"2024-04-17T08:46:39.581483+0000","last_peered":"2024-04-17T08:46:39.581483+0000","last_clean":"2024-04-17T08:46:39.581483+0000","last_became_active":"2024-04-17T08:46:34.237120+0000","last_became_peered":"2024-04-17T08:46:34.237120+0000","last_unstale":"2024-04-17T08:46:39.581483+0000","last_undegraded":"2024-04-17T08:46:39.581483+0000","last_fullsized":"2024-04-17T08:46:39.581483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:47:04.763844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582462+0000","last_change":"2024-04-17T08:46:34.233656+0000","last_active":"2024-04-17T08:46:39.582462+0000","last_peered":"2024-04-17T08:46:39.582462+0000","last_clean":"2024-04-17T08:46:39.582462+0000","last_became_active":"2024-04-17T08:46:34.233389+0000","last_became_peered":"2024-04-17T08:46:34.233389+0000","last_unstale":"2024-04-17T08:46:39.582462+0000","last_undegraded":"2024-04-17T08:46:39.582462+0000","last_fullsized":"2024-04-17T08:46:39.582462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:17:38.605512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.267000+0000","last_change":"2024-04-17T08:46:34.235333+0000","last_active":"2024-04-17T08:46:39.267000+0000","last_peered":"2024-04-17T08:46:39.267000+0000","last_clean":"2024-04-17T08:46:39.267000+0000","last_became_active":"2024-04-17T08:46:34.234982+0000","last_became_peered":"2024-04-17T08:46:34.234982+0000","last_unstale":"2024-04-17T08:46:39.267000+0000","last_undegraded":"2024-04-17T08:46:39.267000+0000","last_fullsized":"2024-04-17T08:46:39.267000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:18:09.786388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582701+0000","last_change":"2024-04-17T08:46:34.260932+0000","last_active":"2024-04-17T08:46:39.582701+0000","last_peered":"2024-04-17T08:46:39.582701+0000","last_clean":"2024-04-17T08:46:39.582701+0000","last_became_active":"2024-04-17T08:46:34.260666+0000","last_became_peered":"2024-04-17T08:46:34.260666+0000","last_unstale":"2024-04-17T08:46:39.582701+0000","last_undegraded":"2024-04-17T08:46:39.582701+0000","last_fullsized":"2024-04-17T08:46:39.582701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:33:41.705987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583345+0000","last_change":"2024-04-17T08:46:34.260377+0000","last_active":"2024-04-17T08:46:39.583345+0000","last_peered":"2024-04-17T08:46:39.583345+0000","last_clean":"2024-04-17T08:46:39.583345+0000","last_became_active":"2024-04-17T08:46:34.260101+0000","last_became_peered":"2024-04-17T08:46:34.260101+0000","last_unstale":"2024-04-17T08:46:39.583345+0000","last_undegraded":"2024-04-17T08:46:39.583345+0000","last_fullsized":"2024-04-17T08:46:39.583345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:33:10.927487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583903+0000","last_change":"2024-04-17T08:46:34.260965+0000","last_active":"2024-04-17T08:46:39.583903+0000","last_peered":"2024-04-17T08:46:39.583903+0000","last_clean":"2024-04-17T08:46:39.583903+0000","last_became_active":"2024-04-17T08:46:34.260673+0000","last_became_peered":"2024-04-17T08:46:34.260673+0000","last_unstale":"2024-04-17T08:46:39.583903+0000","last_undegraded":"2024-04-17T08:46:39.583903+0000","last_fullsized":"2024-04-17T08:46:39.583903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:43:38.645282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581159+0000","last_change":"2024-04-17T08:46:34.255100+0000","last_active":"2024-04-17T08:46:39.581159+0000","last_peered":"2024-04-17T08:46:39.581159+0000","last_clean":"2024-04-17T08:46:39.581159+0000","last_became_active":"2024-04-17T08:46:34.254891+0000","last_became_peered":"2024-04-17T08:46:34.254891+0000","last_unstale":"2024-04-17T08:46:39.581159+0000","last_undegraded":"2024-04-17T08:46:39.581159+0000","last_fullsized":"2024-04-17T08:46:39.581159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:37:26.964605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582850+0000","last_change":"2024-04-17T08:46:34.258835+0000","last_active":"2024-04-17T08:46:39.582850+0000","last_peered":"2024-04-17T08:46:39.582850+0000","last_clean":"2024-04-17T08:46:39.582850+0000","last_became_active":"2024-04-17T08:46:34.258445+0000","last_became_peered":"2024-04-17T08:46:34.258445+0000","last_unstale":"2024-04-17T08:46:39.582850+0000","last_undegraded":"2024-04-17T08:46:39.582850+0000","last_fullsized":"2024-04-17T08:46:39.582850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:10:10.605700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.265683+0000","last_change":"2024-04-17T08:46:34.253142+0000","last_active":"2024-04-17T08:46:39.265683+0000","last_peered":"2024-04-17T08:46:39.265683+0000","last_clean":"2024-04-17T08:46:39.265683+0000","last_became_active":"2024-04-17T08:46:34.250102+0000","last_became_peered":"2024-04-17T08:46:34.250102+0000","last_unstale":"2024-04-17T08:46:39.265683+0000","last_undegraded":"2024-04-17T08:46:39.265683+0000","last_fullsized":"2024-04-17T08:46:39.265683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:11:40.376111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582833+0000","last_change":"2024-04-17T08:46:34.245004+0000","last_active":"2024-04-17T08:46:39.582833+0000","last_peered":"2024-04-17T08:46:39.582833+0000","last_clean":"2024-04-17T08:46:39.582833+0000","last_became_active":"2024-04-17T08:46:34.244719+0000","last_became_peered":"2024-04-17T08:46:34.244719+0000","last_unstale":"2024-04-17T08:46:39.582833+0000","last_undegraded":"2024-04-17T08:46:39.582833+0000","last_fullsized":"2024-04-17T08:46:39.582833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:34:21.920165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.266124+0000","last_change":"2024-04-17T08:46:34.251799+0000","last_active":"2024-04-17T08:46:39.266124+0000","last_peered":"2024-04-17T08:46:39.266124+0000","last_clean":"2024-04-17T08:46:39.266124+0000","last_became_active":"2024-04-17T08:46:34.251489+0000","last_became_peered":"2024-04-17T08:46:34.251489+0000","last_unstale":"2024-04-17T08:46:39.266124+0000","last_undegraded":"2024-04-17T08:46:39.266124+0000","last_fullsized":"2024-04-17T08:46:39.266124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:16:39.000776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581875+0000","last_change":"2024-04-17T08:46:34.238421+0000","last_active":"2024-04-17T08:46:39.581875+0000","last_peered":"2024-04-17T08:46:39.581875+0000","last_clean":"2024-04-17T08:46:39.581875+0000","last_became_active":"2024-04-17T08:46:34.238155+0000","last_became_peered":"2024-04-17T08:46:34.238155+0000","last_unstale":"2024-04-17T08:46:39.581875+0000","last_undegraded":"2024-04-17T08:46:39.581875+0000","last_fullsized":"2024-04-17T08:46:39.581875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:17:38.605512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583178+0000","last_change":"2024-04-17T08:46:34.254457+0000","last_active":"2024-04-17T08:46:39.583178+0000","last_peered":"2024-04-17T08:46:39.583178+0000","last_clean":"2024-04-17T08:46:39.583178+0000","last_became_active":"2024-04-17T08:46:34.252735+0000","last_became_peered":"2024-04-17T08:46:34.252735+0000","last_unstale":"2024-04-17T08:46:39.583178+0000","last_undegraded":"2024-04-17T08:46:39.583178+0000","last_fullsized":"2024-04-17T08:46:39.583178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:33:10.927487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583825+0000","last_change":"2024-04-17T08:46:34.252075+0000","last_active":"2024-04-17T08:46:39.583825+0000","last_peered":"2024-04-17T08:46:39.583825+0000","last_clean":"2024-04-17T08:46:39.583825+0000","last_became_active":"2024-04-17T08:46:34.251791+0000","last_became_peered":"2024-04-17T08:46:34.251791+0000","last_unstale":"2024-04-17T08:46:39.583825+0000","last_undegraded":"2024-04-17T08:46:39.583825+0000","last_fullsized":"2024-04-17T08:46:39.583825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:30:28.171658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T08:46:59.911 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-17T08:46:59.912 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-17T08:46:59.912 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-17T08:46:59.912 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-17T08:46:59.912 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-17T08:47:00.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.082+0000 7fc767000640 1 Processor -- start 2024-04-17T08:47:00.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.082+0000 7fc767000640 1 -- start start 2024-04-17T08:47:00.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.082+0000 7fc767000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc76006dd60 0x7fc760071790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:00.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.082+0000 7fc767000640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc760071cd0 0x7fc7600d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:00.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.082+0000 7fc767000640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc76006e300 con 0x7fc76014c520 2024-04-17T08:47:00.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.082+0000 7fc767000640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fc760072120 con 0x7fc760071cd0 2024-04-17T08:47:00.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.082+0000 7fc767000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fc76006e8c0 con 0x7fc76006dd60 2024-04-17T08:47:00.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.082+0000 7fc765000640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc760071cd0 0x7fc7600d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:00.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.082+0000 7fc765000640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc760071cd0 0x7fc7600d0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46580/0 (socket says 172.21.15.152:46580) 2024-04-17T08:47:00.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.082+0000 7fc765000640 1 -- 172.21.15.152:0/1919154192 learned_addr learned my addr 172.21.15.152:0/1919154192 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:00.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.082+0000 7fc75fe00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fc76014c520 0x7fc7600c7710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:58370/0 (socket says 172.21.15.152:58370) 2024-04-17T08:47:00.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.082+0000 7fc757e00640 1 --2- 172.21.15.152:0/1919154192 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc76006dd60 0x7fc760071790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:00.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.086+0000 7fc765000640 1 -- 172.21.15.152:0/1919154192 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc76006dd60 msgr2=0x7fc760071790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:00.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.086+0000 7fc765000640 1 --2- 172.21.15.152:0/1919154192 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc76006dd60 0x7fc760071790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:00.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.086+0000 7fc765000640 1 -- 172.21.15.152:0/1919154192 >> v1:172.21.15.152:6789/0 conn(0x7fc76014c520 legacy=0x7fc7600c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:00.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.086+0000 7fc765000640 1 -- 172.21.15.152:0/1919154192 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc76006e5e0 con 0x7fc760071cd0 2024-04-17T08:47:00.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.086+0000 7fc75f400640 1 -- 172.21.15.152:0/1919154192 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2052635946 0 0) 0x7fc76006e300 con 0x7fc76014c520 2024-04-17T08:47:00.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.086+0000 7fc765000640 1 --2- 172.21.15.152:0/1919154192 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc760071cd0 0x7fc7600d0af0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc758009e50 tx=0x7fc75801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b06b2d30571da3ac server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:00.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.086+0000 7fc75f400640 1 -- 172.21.15.152:0/1919154192 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7580a5830 con 0x7fc760071cd0 2024-04-17T08:47:00.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.086+0000 7fc75f400640 1 -- 172.21.15.152:0/1919154192 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7580a59d0 con 0x7fc760071cd0 2024-04-17T08:47:00.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.086+0000 7fc75f400640 1 -- 172.21.15.152:0/1919154192 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7580a5da0 con 0x7fc760071cd0 2024-04-17T08:47:00.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.086+0000 7fc767000640 1 -- 172.21.15.152:0/1919154192 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc760071cd0 msgr2=0x7fc7600d0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:00.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.090+0000 7fc767000640 1 --2- 172.21.15.152:0/1919154192 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc760071cd0 0x7fc7600d0af0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc758009e50 tx=0x7fc75801c970 comp rx=0 tx=0).stop 2024-04-17T08:47:00.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.090+0000 7fc767000640 1 -- 172.21.15.152:0/1919154192 shutdown_connections 2024-04-17T08:47:00.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.090+0000 7fc767000640 1 --2- 172.21.15.152:0/1919154192 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc76006dd60 0x7fc760071790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:00.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.090+0000 7fc767000640 1 --2- 172.21.15.152:0/1919154192 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc760071cd0 0x7fc7600d0af0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:00.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.090+0000 7fc767000640 1 -- 172.21.15.152:0/1919154192 >> 172.21.15.152:0/1919154192 conn(0x7fc7600d2350 msgr2=0x7fc7600d2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:00.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.090+0000 7fc767000640 1 -- 172.21.15.152:0/1919154192 shutdown_connections 2024-04-17T08:47:00.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.090+0000 7fc767000640 1 -- 172.21.15.152:0/1919154192 wait complete. 2024-04-17T08:47:00.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.090+0000 7fc767000640 1 Processor -- start 2024-04-17T08:47:00.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.090+0000 7fc767000640 1 -- start start 2024-04-17T08:47:00.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.090+0000 7fc767000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc76006dd60 0x7fc76015e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:00.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.090+0000 7fc767000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc760071cd0 0x7fc7600ce330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:00.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.090+0000 7fc767000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc76014c520 0x7fc760148300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:00.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.090+0000 7fc767000640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc7600d19c0 con 0x7fc76006dd60 2024-04-17T08:47:00.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.090+0000 7fc767000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc7600d1840 con 0x7fc760071cd0 2024-04-17T08:47:00.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.090+0000 7fc767000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fc7600d1b40 con 0x7fc76014c520 2024-04-17T08:47:00.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.090+0000 7fc75fe00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc76006dd60 0x7fc76015e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:00.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.090+0000 7fc75fe00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc76006dd60 0x7fc76015e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46592/0 (socket says 172.21.15.152:46592) 2024-04-17T08:47:00.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.090+0000 7fc75fe00640 1 -- 172.21.15.152:0/2441247657 learned_addr learned my addr 172.21.15.152:0/2441247657 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:00.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.090+0000 7fc757e00640 1 --2- 172.21.15.152:0/2441247657 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc760071cd0 0x7fc7600ce330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:00.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.090+0000 7fc765000640 1 --2- 172.21.15.152:0/2441247657 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc76014c520 0x7fc760148300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:00.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.090+0000 7fc75fe00640 1 -- 172.21.15.152:0/2441247657 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc76014c520 msgr2=0x7fc760148300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:00.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.090+0000 7fc75fe00640 1 --2- 172.21.15.152:0/2441247657 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc76014c520 0x7fc760148300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:00.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.090+0000 7fc75fe00640 1 -- 172.21.15.152:0/2441247657 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc760071cd0 msgr2=0x7fc7600ce330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:00.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.090+0000 7fc75fe00640 1 --2- 172.21.15.152:0/2441247657 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc760071cd0 0x7fc7600ce330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:00.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.090+0000 7fc75fe00640 1 -- 172.21.15.152:0/2441247657 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc76015d330 con 0x7fc76006dd60 2024-04-17T08:47:00.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.090+0000 7fc75fe00640 1 --2- 172.21.15.152:0/2441247657 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc76006dd60 0x7fc76015e0f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc75000c480 tx=0x7fc75000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:00.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.090+0000 7fc75cc00640 1 -- 172.21.15.152:0/2441247657 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc750018070 con 0x7fc76006dd60 2024-04-17T08:47:00.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.090+0000 7fc75cc00640 1 -- 172.21.15.152:0/2441247657 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc750007500 con 0x7fc76006dd60 2024-04-17T08:47:00.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.090+0000 7fc75cc00640 1 -- 172.21.15.152:0/2441247657 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc750004a30 con 0x7fc76006dd60 2024-04-17T08:47:00.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.094+0000 7fc767000640 1 -- 172.21.15.152:0/2441247657 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc76015d610 con 0x7fc76006dd60 2024-04-17T08:47:00.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.094+0000 7fc767000640 1 -- 172.21.15.152:0/2441247657 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc76015dbd0 con 0x7fc76006dd60 2024-04-17T08:47:00.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.094+0000 7fc767000640 1 -- 172.21.15.152:0/2441247657 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc76015e690 con 0x7fc76006dd60 2024-04-17T08:47:00.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.094+0000 7fc75cc00640 1 -- 172.21.15.152:0/2441247657 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc750004bd0 con 0x7fc76006dd60 2024-04-17T08:47:00.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.094+0000 7fc75cc00640 1 --2- 172.21.15.152:0/2441247657 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc73c0683b0 0x7fc73c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:00.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.094+0000 7fc75cc00640 1 -- 172.21.15.152:0/2441247657 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc750085ed0 con 0x7fc76006dd60 2024-04-17T08:47:00.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.094+0000 7fc757e00640 1 --2- 172.21.15.152:0/2441247657 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc73c0683b0 0x7fc73c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:00.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.094+0000 7fc757e00640 1 --2- 172.21.15.152:0/2441247657 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc73c0683b0 0x7fc73c06a870 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc7600b55b0 tx=0x7fc748009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:00.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.102+0000 7fc75cc00640 1 -- 172.21.15.152:0/2441247657 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fc76015e690 con 0x7fc76006dd60 2024-04-17T08:47:00.298 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.298+0000 7fc767000640 1 -- 172.21.15.152:0/2441247657 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fc760068a30 con 0x7fc76006dd60 2024-04-17T08:47:00.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.302+0000 7fc75cc00640 1 -- 172.21.15.152:0/2441247657 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+168092 (secure 0 0 0) 0x7fc750055af0 con 0x7fc76006dd60 2024-04-17T08:47:00.304 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:47:00.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.302+0000 7fc767000640 1 -- 172.21.15.152:0/2441247657 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc73c0683b0 msgr2=0x7fc73c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:00.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.302+0000 7fc767000640 1 --2- 172.21.15.152:0/2441247657 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc73c0683b0 0x7fc73c06a870 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc7600b55b0 tx=0x7fc748009190 comp rx=0 tx=0).stop 2024-04-17T08:47:00.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.302+0000 7fc767000640 1 -- 172.21.15.152:0/2441247657 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc76006dd60 msgr2=0x7fc76015e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:00.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.302+0000 7fc767000640 1 --2- 172.21.15.152:0/2441247657 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc76006dd60 0x7fc76015e0f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc75000c480 tx=0x7fc75000c940 comp rx=0 tx=0).stop 2024-04-17T08:47:00.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.302+0000 7fc767000640 1 -- 172.21.15.152:0/2441247657 shutdown_connections 2024-04-17T08:47:00.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.302+0000 7fc767000640 1 --2- 172.21.15.152:0/2441247657 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc73c0683b0 0x7fc73c06a870 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:00.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.302+0000 7fc767000640 1 --2- 172.21.15.152:0/2441247657 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc76014c520 0x7fc760148300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:00.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.302+0000 7fc767000640 1 --2- 172.21.15.152:0/2441247657 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc760071cd0 0x7fc7600ce330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:00.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.302+0000 7fc767000640 1 --2- 172.21.15.152:0/2441247657 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc76006dd60 0x7fc76015e0f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:00.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.302+0000 7fc767000640 1 -- 172.21.15.152:0/2441247657 >> 172.21.15.152:0/2441247657 conn(0x7fc7600d2350 msgr2=0x7fc76014b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:00.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.302+0000 7fc767000640 1 -- 172.21.15.152:0/2441247657 shutdown_connections 2024-04-17T08:47:00.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.302+0000 7fc767000640 1 -- 172.21.15.152:0/2441247657 wait complete. 2024-04-17T08:47:00.325 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":3078522445},{"type":"v1","addr":"172.21.15.152:6833","nonce":3078522445}]},"active_addr":"172.21.15.152:6833/3078522445","active_change":"2024-04-17T08:46:13.350117+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4100,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.152:0","nonce":2431624708}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.152:0","nonce":2132635339}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.152:0","nonce":2476950753}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.152:0","nonce":1879940442}]}]} 2024-04-17T08:47:00.328 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-17T08:47:00.328 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-17T08:47:00.329 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T08:47:00.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.462+0000 7f0ebaa00640 1 Processor -- start 2024-04-17T08:47:00.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.462+0000 7f0ebaa00640 1 -- start start 2024-04-17T08:47:00.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.462+0000 7f0ebaa00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f0eb415a100 0x7f0eb406f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:00.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.466+0000 7f0ebaa00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0eb41602d0 con 0x7f0eb40cc8c0 2024-04-17T08:47:00.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.466+0000 7f0ebaa00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0eb41605b0 con 0x7f0eb40cf390 2024-04-17T08:47:00.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.466+0000 7f0ebaa00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f0eb406faa0 con 0x7f0eb415a100 2024-04-17T08:47:00.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.466+0000 7f0eb9600640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f0eb415a100 0x7f0eb406f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:00.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.466+0000 7f0eb8c00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f0eb40cc8c0 0x7f0eb40cec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:58382/0 (socket says 172.21.15.152:58382) 2024-04-17T08:47:00.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.466+0000 7f0eb8c00640 1 -- 172.21.15.152:0/307801485 learned_addr learned my addr 172.21.15.152:0/307801485 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:00.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.466+0000 7f0eb9600640 1 -- 172.21.15.152:0/307801485 >> v1:172.21.15.196:6789/0 conn(0x7f0eb40cf390 legacy=0x7f0eb415cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:00.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.466+0000 7f0eb9600640 1 -- 172.21.15.152:0/307801485 >> v1:172.21.15.152:6789/0 conn(0x7f0eb40cc8c0 legacy=0x7f0eb40cec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:00.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.466+0000 7f0eb9600640 1 -- 172.21.15.152:0/307801485 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0eb4160890 con 0x7f0eb415a100 2024-04-17T08:47:00.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.470+0000 7f0eb9600640 1 --2- 172.21.15.152:0/307801485 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0eb415a100 0x7f0eb406f560 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0ea80097c0 tx=0x7f0ea801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a36169de1361245 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:00.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.470+0000 7f0eb3e00640 1 -- 172.21.15.152:0/307801485 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ea80b0070 con 0x7f0eb415a100 2024-04-17T08:47:00.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.470+0000 7f0eb3e00640 1 -- 172.21.15.152:0/307801485 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ea80ab600 con 0x7f0eb415a100 2024-04-17T08:47:00.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.470+0000 7f0eb3e00640 1 -- 172.21.15.152:0/307801485 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ea80ab9d0 con 0x7f0eb415a100 2024-04-17T08:47:00.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.470+0000 7f0ebaa00640 1 -- 172.21.15.152:0/307801485 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0eb415a100 msgr2=0x7f0eb406f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:00.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.470+0000 7f0ebaa00640 1 --2- 172.21.15.152:0/307801485 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0eb415a100 0x7f0eb406f560 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0ea80097c0 tx=0x7f0ea801c4a0 comp rx=0 tx=0).stop 2024-04-17T08:47:00.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.470+0000 7f0ebaa00640 1 -- 172.21.15.152:0/307801485 shutdown_connections 2024-04-17T08:47:00.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.470+0000 7f0ebaa00640 1 --2- 172.21.15.152:0/307801485 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0eb415a100 0x7f0eb406f560 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:00.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.470+0000 7f0ebaa00640 1 -- 172.21.15.152:0/307801485 >> 172.21.15.152:0/307801485 conn(0x7f0eb40b3e00 msgr2=0x7f0eb40b4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:00.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.470+0000 7f0ebaa00640 1 -- 172.21.15.152:0/307801485 shutdown_connections 2024-04-17T08:47:00.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.470+0000 7f0ebaa00640 1 -- 172.21.15.152:0/307801485 wait complete. 2024-04-17T08:47:00.474 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.474+0000 7f0ebaa00640 1 Processor -- start 2024-04-17T08:47:00.474 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.474+0000 7f0ebaa00640 1 -- start start 2024-04-17T08:47:00.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.474+0000 7f0ebaa00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0eb40cc8c0 0x7f0eb41523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:00.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.474+0000 7f0ebaa00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0eb40cf390 0x7f0eb4152a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:00.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.474+0000 7f0ebaa00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0eb415a100 0x7f0eb40c78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:00.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.474+0000 7f0ebaa00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0eb416a8f0 con 0x7f0eb40cf390 2024-04-17T08:47:00.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.474+0000 7f0ebaa00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0eb415d850 con 0x7f0eb40cc8c0 2024-04-17T08:47:00.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.474+0000 7f0ebaa00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f0eb416aa70 con 0x7f0eb415a100 2024-04-17T08:47:00.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.474+0000 7f0eb8c00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0eb40cf390 0x7f0eb4152a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:00.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.474+0000 7f0eb8c00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0eb40cf390 0x7f0eb4152a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46612/0 (socket says 172.21.15.152:46612) 2024-04-17T08:47:00.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.474+0000 7f0eb8c00640 1 -- 172.21.15.152:0/1576948880 learned_addr learned my addr 172.21.15.152:0/1576948880 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:00.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.474+0000 7f0eb9600640 1 --2- 172.21.15.152:0/1576948880 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0eb40cc8c0 0x7f0eb41523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:00.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.474+0000 7f0eba000640 1 --2- 172.21.15.152:0/1576948880 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0eb415a100 0x7f0eb40c78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:00.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.474+0000 7f0eb8c00640 1 -- 172.21.15.152:0/1576948880 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0eb415a100 msgr2=0x7f0eb40c78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:00.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.474+0000 7f0eb8c00640 1 --2- 172.21.15.152:0/1576948880 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0eb415a100 0x7f0eb40c78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:00.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.474+0000 7f0eb8c00640 1 -- 172.21.15.152:0/1576948880 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0eb40cc8c0 msgr2=0x7f0eb41523b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:00.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.474+0000 7f0eb8c00640 1 --2- 172.21.15.152:0/1576948880 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0eb40cc8c0 0x7f0eb41523b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:00.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.474+0000 7f0eb8c00640 1 -- 172.21.15.152:0/1576948880 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0eb40c8620 con 0x7f0eb40cf390 2024-04-17T08:47:00.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.474+0000 7f0eb8c00640 1 --2- 172.21.15.152:0/1576948880 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0eb40cf390 0x7f0eb4152a40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0ea000c500 tx=0x7f0ea000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:00.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.474+0000 7f0eb1600640 1 -- 172.21.15.152:0/1576948880 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ea0017070 con 0x7f0eb40cf390 2024-04-17T08:47:00.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.474+0000 7f0eb1600640 1 -- 172.21.15.152:0/1576948880 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ea0005cf0 con 0x7f0eb40cf390 2024-04-17T08:47:00.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.474+0000 7f0ebaa00640 1 -- 172.21.15.152:0/1576948880 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0eb40c8900 con 0x7f0eb40cf390 2024-04-17T08:47:00.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.474+0000 7f0eb1600640 1 -- 172.21.15.152:0/1576948880 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ea00072f0 con 0x7f0eb40cf390 2024-04-17T08:47:00.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.474+0000 7f0ebaa00640 1 -- 172.21.15.152:0/1576948880 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0eb40c94f0 con 0x7f0eb40cf390 2024-04-17T08:47:00.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.474+0000 7f0ebaa00640 1 -- 172.21.15.152:0/1576948880 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0eb4075be0 con 0x7f0eb40cf390 2024-04-17T08:47:00.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.478+0000 7f0eb1600640 1 -- 172.21.15.152:0/1576948880 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0ea001a070 con 0x7f0eb40cf390 2024-04-17T08:47:00.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.478+0000 7f0eb1600640 1 --2- 172.21.15.152:0/1576948880 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0e94068380 0x7f0e9406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:00.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.478+0000 7f0eb1600640 1 -- 172.21.15.152:0/1576948880 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0ea0085fd0 con 0x7f0eb40cf390 2024-04-17T08:47:00.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.478+0000 7f0eb9600640 1 --2- 172.21.15.152:0/1576948880 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0e94068380 0x7f0e9406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:00.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.478+0000 7f0eb9600640 1 --2- 172.21.15.152:0/1576948880 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0e94068380 0x7f0e9406a840 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0ea80ad000 tx=0x7f0ea8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:00.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.482+0000 7f0eb1600640 1 -- 172.21.15.152:0/1576948880 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f0ea0055bf0 con 0x7f0eb40cf390 2024-04-17T08:47:00.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.642+0000 7f0ebaa00640 1 -- 172.21.15.152:0/1576948880 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0eb40cf040 con 0x7f0eb40cf390 2024-04-17T08:47:00.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.642+0000 7f0eb1600640 1 -- 172.21.15.152:0/1576948880 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7f0ea0059ef0 con 0x7f0eb40cf390 2024-04-17T08:47:00.643 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:47:00.644 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":24,"fsid":"ce68f82e-ec5f-4205-9fd5-bdfdf6ef31e2","created":"2024-04-17T08:46:08.353546+0000","modified":"2024-04-17T08:46:38.659862+0000","last_up_change":"2024-04-17T08:46:20.738799+0000","last_in_change":"2024-04-17T08:46:11.210050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T08:46:21.386856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T08:46:31.812460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T08:46:32.555559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T08:46:36.258078+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"682f0192-187c-404e-bc7a-b6b4e23825e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6819","nonce":3603799291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6823","nonce":3603799291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6831","nonce":3603799291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6827","nonce":3603799291}]},"public_addr":"172.21.15.152:6819/3603799291","cluster_addr":"172.21.15.152:6823/3603799291","heartbeat_back_addr":"172.21.15.152:6831/3603799291","heartbeat_front_addr":"172.21.15.152:6827/3603799291","state":["exists","up"]},{"osd":1,"uuid":"f0fe8fef-60ec-4a39-83b6-2fa6a5adb0f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6801","nonce":4133383142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6803","nonce":4133383142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6807","nonce":4133383142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6805","nonce":4133383142}]},"public_addr":"172.21.15.152:6801/4133383142","cluster_addr":"172.21.15.152:6803/4133383142","heartbeat_back_addr":"172.21.15.152:6807/4133383142","heartbeat_front_addr":"172.21.15.152:6805/4133383142","state":["exists","up"]},{"osd":2,"uuid":"35f36d9c-5245-4431-a618-f4df0fa380ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6809","nonce":3826143898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6811","nonce":3826143898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6815","nonce":3826143898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6813","nonce":3826143898}]},"public_addr":"172.21.15.152:6809/3826143898","cluster_addr":"172.21.15.152:6811/3826143898","heartbeat_back_addr":"172.21.15.152:6815/3826143898","heartbeat_front_addr":"172.21.15.152:6813/3826143898","state":["exists","up"]},{"osd":3,"uuid":"96e56ca5-15b4-4895-9b79-da2c92043159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6818","nonce":165717826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6822","nonce":165717826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6830","nonce":165717826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6826","nonce":165717826}]},"public_addr":"172.21.15.152:6818/165717826","cluster_addr":"172.21.15.152:6822/165717826","heartbeat_back_addr":"172.21.15.152:6830/165717826","heartbeat_front_addr":"172.21.15.152:6826/165717826","state":["exists","up"]},{"osd":4,"uuid":"f5aa10a4-9ff9-41fe-a5c9-15326f982cc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6817","nonce":4080159297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6819","nonce":4080159297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6823","nonce":4080159297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6821","nonce":4080159297}]},"public_addr":"172.21.15.196:6817/4080159297","cluster_addr":"172.21.15.196:6819/4080159297","heartbeat_back_addr":"172.21.15.196:6823/4080159297","heartbeat_front_addr":"172.21.15.196:6821/4080159297","state":["exists","up"]},{"osd":5,"uuid":"42bab884-3476-47ae-ac65-935fa6e0f055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6801","nonce":3519444232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6803","nonce":3519444232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6807","nonce":3519444232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6805","nonce":3519444232}]},"public_addr":"172.21.15.196:6801/3519444232","cluster_addr":"172.21.15.196:6803/3519444232","heartbeat_back_addr":"172.21.15.196:6807/3519444232","heartbeat_front_addr":"172.21.15.196:6805/3519444232","state":["exists","up"]},{"osd":6,"uuid":"460b6167-f57b-4224-9c92-cfc9b80bbe99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6809","nonce":275739834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6811","nonce":275739834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6815","nonce":275739834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6813","nonce":275739834}]},"public_addr":"172.21.15.196:6809/275739834","cluster_addr":"172.21.15.196:6811/275739834","heartbeat_back_addr":"172.21.15.196:6815/275739834","heartbeat_front_addr":"172.21.15.196:6813/275739834","state":["exists","up"]},{"osd":7,"uuid":"d695643f-5e07-4e2a-a646-c06bd97b6650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6825","nonce":307626968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6827","nonce":307626968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6831","nonce":307626968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6829","nonce":307626968}]},"public_addr":"172.21.15.196:6825/307626968","cluster_addr":"172.21.15.196:6827/307626968","heartbeat_back_addr":"172.21.15.196:6831/307626968","heartbeat_front_addr":"172.21.15.196:6829/307626968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.293257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.964533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.248895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.010000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.832554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.743704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930171+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930962+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T08:47:00.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.642+0000 7f0ebaa00640 1 -- 172.21.15.152:0/1576948880 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0e94068380 msgr2=0x7f0e9406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:00.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.642+0000 7f0ebaa00640 1 --2- 172.21.15.152:0/1576948880 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0e94068380 0x7f0e9406a840 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0ea80ad000 tx=0x7f0ea8008040 comp rx=0 tx=0).stop 2024-04-17T08:47:00.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.642+0000 7f0ebaa00640 1 -- 172.21.15.152:0/1576948880 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0eb40cf390 msgr2=0x7f0eb4152a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:00.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.642+0000 7f0ebaa00640 1 --2- 172.21.15.152:0/1576948880 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0eb40cf390 0x7f0eb4152a40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0ea000c500 tx=0x7f0ea000c9c0 comp rx=0 tx=0).stop 2024-04-17T08:47:00.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.642+0000 7f0ebaa00640 1 -- 172.21.15.152:0/1576948880 shutdown_connections 2024-04-17T08:47:00.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.642+0000 7f0ebaa00640 1 --2- 172.21.15.152:0/1576948880 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0e94068380 0x7f0e9406a840 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:00.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.642+0000 7f0ebaa00640 1 --2- 172.21.15.152:0/1576948880 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0eb415a100 0x7f0eb40c78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:00.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.642+0000 7f0ebaa00640 1 --2- 172.21.15.152:0/1576948880 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0eb40cf390 0x7f0eb4152a40 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:00.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.642+0000 7f0ebaa00640 1 --2- 172.21.15.152:0/1576948880 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0eb40cc8c0 0x7f0eb41523b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:00.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.642+0000 7f0ebaa00640 1 -- 172.21.15.152:0/1576948880 >> 172.21.15.152:0/1576948880 conn(0x7f0eb40b3e00 msgr2=0x7f0eb4167500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:00.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.642+0000 7f0ebaa00640 1 -- 172.21.15.152:0/1576948880 shutdown_connections 2024-04-17T08:47:00.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.642+0000 7f0ebaa00640 1 -- 172.21.15.152:0/1576948880 wait complete. 2024-04-17T08:47:00.665 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-17T08:47:00.665 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T08:47:00.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.798+0000 7fd9fda00640 1 Processor -- start 2024-04-17T08:47:00.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.798+0000 7fd9fda00640 1 -- start start 2024-04-17T08:47:00.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.802+0000 7fd9fda00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd9f806f980 0x7fd9f8072530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:00.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.802+0000 7fd9fda00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fd9f80d0360 0x7fd9f80d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:00.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.802+0000 7fd9fda00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9f815bfd0 con 0x7fd9f80af670 2024-04-17T08:47:00.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.802+0000 7fd9fda00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fd9f815c820 con 0x7fd9f80d0360 2024-04-17T08:47:00.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.802+0000 7fd9fda00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fd9f815c260 con 0x7fd9f806f980 2024-04-17T08:47:00.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.802+0000 7fd9f6a00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fd9f80af670 0x7fd9f815b8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:58386/0 (socket says 172.21.15.152:58386) 2024-04-17T08:47:00.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.802+0000 7fd9f6a00640 1 -- 172.21.15.152:0/3248974286 learned_addr learned my addr 172.21.15.152:0/3248974286 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:00.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.802+0000 7fd9f5600640 1 -- 172.21.15.152:0/3248974286 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2462532330 0 0) 0x7fd9f815bfd0 con 0x7fd9f80af670 2024-04-17T08:47:00.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.802+0000 7fd9f5600640 1 -- 172.21.15.152:0/3248974286 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd9dc005740 con 0x7fd9f80af670 2024-04-17T08:47:00.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.802+0000 7fd9f6000640 1 --2- 172.21.15.152:0/3248974286 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd9f806f980 0x7fd9f8072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:00.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.802+0000 7fd9f7400640 1 --2- 172.21.15.152:0/3248974286 >> v2:172.21.15.196:3300/0 conn(0x7fd9f80d0360 0x7fd9f80d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:00.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.802+0000 7fd9f5600640 1 -- 172.21.15.152:0/3248974286 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2536023048 0 0) 0x7fd9dc005740 con 0x7fd9f80af670 2024-04-17T08:47:00.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.802+0000 7fd9f5600640 1 -- 172.21.15.152:0/3248974286 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd9f806f980 msgr2=0x7fd9f8072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:00.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.802+0000 7fd9f5600640 1 --2- 172.21.15.152:0/3248974286 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd9f806f980 0x7fd9f8072530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:00.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.802+0000 7fd9f5600640 1 -- 172.21.15.152:0/3248974286 >> v2:172.21.15.196:3300/0 conn(0x7fd9f80d0360 msgr2=0x7fd9f80d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:00.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.802+0000 7fd9f5600640 1 --2- 172.21.15.152:0/3248974286 >> v2:172.21.15.196:3300/0 conn(0x7fd9f80d0360 0x7fd9f80d07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:00.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.802+0000 7fd9f5600640 1 -- 172.21.15.152:0/3248974286 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9f815c540 con 0x7fd9f80af670 2024-04-17T08:47:00.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.802+0000 7fd9f5600640 1 -- 172.21.15.152:0/3248974286 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2973887244 0 0) 0x7fd9e8001680 con 0x7fd9f80af670 2024-04-17T08:47:00.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.802+0000 7fd9f6000640 1 --2- 172.21.15.152:0/3248974286 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd9f806f980 0x7fd9f8072530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:00.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.802+0000 7fd9f5600640 1 -- 172.21.15.152:0/3248974286 >> v1:172.21.15.152:6789/0 conn(0x7fd9f80af670 legacy=0x7fd9f815b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:00.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.802+0000 7fd9f5600640 1 --2- 172.21.15.152:0/3248974286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9dc005bd0 0x7fd9dc005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:00.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.802+0000 7fd9f5600640 1 --2- 172.21.15.152:0/3248974286 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd9f806f980 0x7fd9dc006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:00.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.802+0000 7fd9f5600640 1 --2- 172.21.15.152:0/3248974286 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd9dc006f60 0x7fd9dc0073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:00.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.802+0000 7fd9f5600640 1 -- 172.21.15.152:0/3248974286 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f815c820 con 0x7fd9dc005bd0 2024-04-17T08:47:00.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.802+0000 7fd9f5600640 1 -- 172.21.15.152:0/3248974286 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f815c260 con 0x7fd9dc006f60 2024-04-17T08:47:00.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.802+0000 7fd9f5600640 1 -- 172.21.15.152:0/3248974286 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fd9dc00dc90 con 0x7fd9f806f980 2024-04-17T08:47:00.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.802+0000 7fd9f6a00640 1 --2- 172.21.15.152:0/3248974286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9dc005bd0 0x7fd9dc005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:00.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.802+0000 7fd9f6000640 1 --2- 172.21.15.152:0/3248974286 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd9f806f980 0x7fd9dc006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:00.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.802+0000 7fd9f7400640 1 --2- 172.21.15.152:0/3248974286 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd9dc006f60 0x7fd9dc0073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:00.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.802+0000 7fd9f6000640 1 -- 172.21.15.152:0/3248974286 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd9dc006f60 msgr2=0x7fd9dc0073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:00.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.802+0000 7fd9f6000640 1 --2- 172.21.15.152:0/3248974286 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd9dc006f60 0x7fd9dc0073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:00.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.802+0000 7fd9f6000640 1 -- 172.21.15.152:0/3248974286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9dc005bd0 msgr2=0x7fd9dc005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:00.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.802+0000 7fd9f6000640 1 --2- 172.21.15.152:0/3248974286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9dc005bd0 0x7fd9dc005ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:00.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.802+0000 7fd9f6000640 1 -- 172.21.15.152:0/3248974286 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9dc005740 con 0x7fd9f806f980 2024-04-17T08:47:00.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.802+0000 7fd9f6a00640 1 --2- 172.21.15.152:0/3248974286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9dc005bd0 0x7fd9dc005ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T08:47:00.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.806+0000 7fd9f6000640 1 --2- 172.21.15.152:0/3248974286 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd9f806f980 0x7fd9dc006a20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd9f806fdc0 tx=0x7fd9e401c5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4240f2b06322966 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:00.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.806+0000 7fd9f5600640 1 -- 172.21.15.152:0/3248974286 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e400f040 con 0x7fd9f806f980 2024-04-17T08:47:00.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.806+0000 7fd9f5600640 1 -- 172.21.15.152:0/3248974286 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9e40b0070 con 0x7fd9f806f980 2024-04-17T08:47:00.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.806+0000 7fd9f5600640 1 -- 172.21.15.152:0/3248974286 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e40ab810 con 0x7fd9f806f980 2024-04-17T08:47:00.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.806+0000 7fd9fda00640 1 -- 172.21.15.152:0/3248974286 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd9f806f980 msgr2=0x7fd9dc006a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:00.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.806+0000 7fd9fda00640 1 --2- 172.21.15.152:0/3248974286 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd9f806f980 0x7fd9dc006a20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd9f806fdc0 tx=0x7fd9e401c5d0 comp rx=0 tx=0).stop 2024-04-17T08:47:00.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.806+0000 7fd9f7400640 1 -- 172.21.15.152:0/3248974286 reap_dead start 2024-04-17T08:47:00.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.806+0000 7fd9fda00640 1 -- 172.21.15.152:0/3248974286 shutdown_connections 2024-04-17T08:47:00.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.806+0000 7fd9fda00640 1 -- 172.21.15.152:0/3248974286 >> 172.21.15.152:0/3248974286 conn(0x7fd9f80b3350 msgr2=0x7fd9f80b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:00.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.806+0000 7fd9fda00640 1 -- 172.21.15.152:0/3248974286 shutdown_connections 2024-04-17T08:47:00.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.806+0000 7fd9fda00640 1 -- 172.21.15.152:0/3248974286 wait complete. 2024-04-17T08:47:00.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.810+0000 7fd9fda00640 1 Processor -- start 2024-04-17T08:47:00.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.810+0000 7fd9fda00640 1 -- start start 2024-04-17T08:47:00.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.810+0000 7fd9fda00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd9f806f980 0x7fd9f8155640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:00.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.810+0000 7fd9fda00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9f815eeb0 0x7fd9f81f9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:00.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.810+0000 7fd9fda00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd9f815f310 0x7fd9f81fa150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:00.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.810+0000 7fd9fda00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f806dde0 con 0x7fd9f815eeb0 2024-04-17T08:47:00.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.810+0000 7fd9fda00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f806dc60 con 0x7fd9f806f980 2024-04-17T08:47:00.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.810+0000 7fd9fda00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fd9f806df60 con 0x7fd9f815f310 2024-04-17T08:47:00.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.810+0000 7fd9f6000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9f815eeb0 0x7fd9f81f9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:00.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.810+0000 7fd9f6000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9f815eeb0 0x7fd9f81f9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46632/0 (socket says 172.21.15.152:46632) 2024-04-17T08:47:00.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.810+0000 7fd9f6000640 1 -- 172.21.15.152:0/4004519035 learned_addr learned my addr 172.21.15.152:0/4004519035 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:00.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.810+0000 7fd9f6a00640 1 --2- 172.21.15.152:0/4004519035 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd9f806f980 0x7fd9f8155640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:00.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.810+0000 7fd9f7400640 1 --2- 172.21.15.152:0/4004519035 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd9f815f310 0x7fd9f81fa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:00.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.810+0000 7fd9f6000640 1 -- 172.21.15.152:0/4004519035 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd9f815f310 msgr2=0x7fd9f81fa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:00.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.810+0000 7fd9f6000640 1 --2- 172.21.15.152:0/4004519035 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd9f815f310 0x7fd9f81fa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:00.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.810+0000 7fd9f6000640 1 -- 172.21.15.152:0/4004519035 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd9f806f980 msgr2=0x7fd9f8155640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:00.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.810+0000 7fd9f6000640 1 --2- 172.21.15.152:0/4004519035 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd9f806f980 0x7fd9f8155640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:00.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.810+0000 7fd9f6000640 1 -- 172.21.15.152:0/4004519035 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9f8149490 con 0x7fd9f815eeb0 2024-04-17T08:47:00.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.810+0000 7fd9f6a00640 1 --2- 172.21.15.152:0/4004519035 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd9f806f980 0x7fd9f8155640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T08:47:00.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.810+0000 7fd9f6000640 1 --2- 172.21.15.152:0/4004519035 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9f815eeb0 0x7fd9f81f9c10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd9e40ad040 tx=0x7fd9dc007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:00.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.810+0000 7fd9eea00640 1 -- 172.21.15.152:0/4004519035 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e40c2070 con 0x7fd9f815eeb0 2024-04-17T08:47:00.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.810+0000 7fd9eea00640 1 -- 172.21.15.152:0/4004519035 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9e40ab550 con 0x7fd9f815eeb0 2024-04-17T08:47:00.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.810+0000 7fd9eea00640 1 -- 172.21.15.152:0/4004519035 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e40ab920 con 0x7fd9f815eeb0 2024-04-17T08:47:00.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.810+0000 7fd9fda00640 1 -- 172.21.15.152:0/4004519035 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9f8149770 con 0x7fd9f815eeb0 2024-04-17T08:47:00.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.810+0000 7fd9fda00640 1 -- 172.21.15.152:0/4004519035 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9f8149d30 con 0x7fd9f815eeb0 2024-04-17T08:47:00.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.814+0000 7fd9fda00640 1 -- 172.21.15.152:0/4004519035 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9f8068a30 con 0x7fd9f815eeb0 2024-04-17T08:47:00.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.814+0000 7fd9eea00640 1 -- 172.21.15.152:0/4004519035 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd9e40c5070 con 0x7fd9f815eeb0 2024-04-17T08:47:00.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.814+0000 7fd9eea00640 1 --2- 172.21.15.152:0/4004519035 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fd9d8068380 0x7fd9d806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:00.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.814+0000 7fd9eea00640 1 -- 172.21.15.152:0/4004519035 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd9e41205e0 con 0x7fd9f815eeb0 2024-04-17T08:47:00.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.814+0000 7fd9f6a00640 1 --2- 172.21.15.152:0/4004519035 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fd9d8068380 0x7fd9d806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:00.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.814+0000 7fd9f6a00640 1 --2- 172.21.15.152:0/4004519035 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fd9d8068380 0x7fd9d806a840 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd9e8007fd0 tx=0x7fd9e8001e10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:00.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.818+0000 7fd9eea00640 1 -- 172.21.15.152:0/4004519035 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fd9e40a8050 con 0x7fd9f815eeb0 2024-04-17T08:47:00.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.978+0000 7fd9fda00640 1 -- 172.21.15.152:0/4004519035 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd9f80cf670 con 0x7fd9f815eeb0 2024-04-17T08:47:00.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.978+0000 7fd9eea00640 1 -- 172.21.15.152:0/4004519035 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7fd9e40162e0 con 0x7fd9f815eeb0 2024-04-17T08:47:00.979 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:47:00.979 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":24,"fsid":"ce68f82e-ec5f-4205-9fd5-bdfdf6ef31e2","created":"2024-04-17T08:46:08.353546+0000","modified":"2024-04-17T08:46:38.659862+0000","last_up_change":"2024-04-17T08:46:20.738799+0000","last_in_change":"2024-04-17T08:46:11.210050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T08:46:21.386856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T08:46:31.812460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T08:46:32.555559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T08:46:36.258078+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"682f0192-187c-404e-bc7a-b6b4e23825e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6819","nonce":3603799291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6823","nonce":3603799291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6831","nonce":3603799291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6827","nonce":3603799291}]},"public_addr":"172.21.15.152:6819/3603799291","cluster_addr":"172.21.15.152:6823/3603799291","heartbeat_back_addr":"172.21.15.152:6831/3603799291","heartbeat_front_addr":"172.21.15.152:6827/3603799291","state":["exists","up"]},{"osd":1,"uuid":"f0fe8fef-60ec-4a39-83b6-2fa6a5adb0f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6801","nonce":4133383142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6803","nonce":4133383142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6807","nonce":4133383142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6805","nonce":4133383142}]},"public_addr":"172.21.15.152:6801/4133383142","cluster_addr":"172.21.15.152:6803/4133383142","heartbeat_back_addr":"172.21.15.152:6807/4133383142","heartbeat_front_addr":"172.21.15.152:6805/4133383142","state":["exists","up"]},{"osd":2,"uuid":"35f36d9c-5245-4431-a618-f4df0fa380ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6809","nonce":3826143898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6811","nonce":3826143898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6815","nonce":3826143898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6813","nonce":3826143898}]},"public_addr":"172.21.15.152:6809/3826143898","cluster_addr":"172.21.15.152:6811/3826143898","heartbeat_back_addr":"172.21.15.152:6815/3826143898","heartbeat_front_addr":"172.21.15.152:6813/3826143898","state":["exists","up"]},{"osd":3,"uuid":"96e56ca5-15b4-4895-9b79-da2c92043159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6818","nonce":165717826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6822","nonce":165717826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6830","nonce":165717826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6826","nonce":165717826}]},"public_addr":"172.21.15.152:6818/165717826","cluster_addr":"172.21.15.152:6822/165717826","heartbeat_back_addr":"172.21.15.152:6830/165717826","heartbeat_front_addr":"172.21.15.152:6826/165717826","state":["exists","up"]},{"osd":4,"uuid":"f5aa10a4-9ff9-41fe-a5c9-15326f982cc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6817","nonce":4080159297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6819","nonce":4080159297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6823","nonce":4080159297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6821","nonce":4080159297}]},"public_addr":"172.21.15.196:6817/4080159297","cluster_addr":"172.21.15.196:6819/4080159297","heartbeat_back_addr":"172.21.15.196:6823/4080159297","heartbeat_front_addr":"172.21.15.196:6821/4080159297","state":["exists","up"]},{"osd":5,"uuid":"42bab884-3476-47ae-ac65-935fa6e0f055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6801","nonce":3519444232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6803","nonce":3519444232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6807","nonce":3519444232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6805","nonce":3519444232}]},"public_addr":"172.21.15.196:6801/3519444232","cluster_addr":"172.21.15.196:6803/3519444232","heartbeat_back_addr":"172.21.15.196:6807/3519444232","heartbeat_front_addr":"172.21.15.196:6805/3519444232","state":["exists","up"]},{"osd":6,"uuid":"460b6167-f57b-4224-9c92-cfc9b80bbe99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6809","nonce":275739834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6811","nonce":275739834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6815","nonce":275739834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6813","nonce":275739834}]},"public_addr":"172.21.15.196:6809/275739834","cluster_addr":"172.21.15.196:6811/275739834","heartbeat_back_addr":"172.21.15.196:6815/275739834","heartbeat_front_addr":"172.21.15.196:6813/275739834","state":["exists","up"]},{"osd":7,"uuid":"d695643f-5e07-4e2a-a646-c06bd97b6650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6825","nonce":307626968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6827","nonce":307626968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6831","nonce":307626968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6829","nonce":307626968}]},"public_addr":"172.21.15.196:6825/307626968","cluster_addr":"172.21.15.196:6827/307626968","heartbeat_back_addr":"172.21.15.196:6831/307626968","heartbeat_front_addr":"172.21.15.196:6829/307626968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.293257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.964533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.248895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.010000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.832554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.743704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930171+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930962+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T08:47:00.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.978+0000 7fd9fda00640 1 -- 172.21.15.152:0/4004519035 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fd9d8068380 msgr2=0x7fd9d806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:00.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.978+0000 7fd9fda00640 1 --2- 172.21.15.152:0/4004519035 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fd9d8068380 0x7fd9d806a840 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd9e8007fd0 tx=0x7fd9e8001e10 comp rx=0 tx=0).stop 2024-04-17T08:47:00.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.978+0000 7fd9fda00640 1 -- 172.21.15.152:0/4004519035 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9f815eeb0 msgr2=0x7fd9f81f9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:00.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.978+0000 7fd9fda00640 1 --2- 172.21.15.152:0/4004519035 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9f815eeb0 0x7fd9f81f9c10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd9e40ad040 tx=0x7fd9dc007a50 comp rx=0 tx=0).stop 2024-04-17T08:47:00.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.978+0000 7fd9fda00640 1 -- 172.21.15.152:0/4004519035 shutdown_connections 2024-04-17T08:47:00.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.978+0000 7fd9fda00640 1 --2- 172.21.15.152:0/4004519035 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fd9d8068380 0x7fd9d806a840 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:00.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.978+0000 7fd9fda00640 1 --2- 172.21.15.152:0/4004519035 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd9f815f310 0x7fd9f81fa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:00.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.978+0000 7fd9fda00640 1 --2- 172.21.15.152:0/4004519035 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9f815eeb0 0x7fd9f81f9c10 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:00.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.978+0000 7fd9fda00640 1 --2- 172.21.15.152:0/4004519035 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd9f806f980 0x7fd9f8155640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:00.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.978+0000 7fd9fda00640 1 -- 172.21.15.152:0/4004519035 >> 172.21.15.152:0/4004519035 conn(0x7fd9f80b3350 msgr2=0x7fd9f8160060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:00.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.978+0000 7fd9fda00640 1 -- 172.21.15.152:0/4004519035 shutdown_connections 2024-04-17T08:47:00.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:00.982+0000 7fd9fda00640 1 -- 172.21.15.152:0/4004519035 wait complete. 2024-04-17T08:47:01.002 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-17T08:47:01.002 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-17T08:47:01.003 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-17T08:47:01.003 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-17T08:47:01.003 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-17T08:47:01.004 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-17T08:47:01.004 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-17T08:47:01.005 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-17T08:47:01.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.242+0000 7f31ba800640 1 Processor -- start 2024-04-17T08:47:01.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.242+0000 7f6871400640 1 Processor -- start 2024-04-17T08:47:01.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.242+0000 7f6871400640 1 -- start start 2024-04-17T08:47:01.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.242+0000 7f31ba800640 1 -- start start 2024-04-17T08:47:01.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.242+0000 7f31ba800640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f31b4162ca0 0x7f31b40cd690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.242+0000 7f31ba800640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31b4167510 con 0x7f31b4167080 2024-04-17T08:47:01.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.242+0000 7f31ba800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31b40ccbb0 con 0x7f31b40c38b0 2024-04-17T08:47:01.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.242+0000 7f31ba800640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f31b40cce90 con 0x7f31b4162ca0 2024-04-17T08:47:01.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.242+0000 7f6871400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f68640eae10 0x7f686400de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.242+0000 7f6871400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f68640ebf80 0x7f686400e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.242+0000 7f6871400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f6864055d20 0x7f6864054a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.242+0000 7f6871400640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f686404a5f0 con 0x7f6864055d20 2024-04-17T08:47:01.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.242+0000 7f6871400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f6864056a70 con 0x7f68640eae10 2024-04-17T08:47:01.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.242+0000 7f6871400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f68640eb4a0 con 0x7f68640ebf80 2024-04-17T08:47:01.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.246+0000 7f31b2a00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f31b4167080 0x7f31b40c31a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:58402/0 (socket says 172.21.15.152:58402) 2024-04-17T08:47:01.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.246+0000 7f31b2a00640 1 -- 172.21.15.152:0/2356082205 learned_addr learned my addr 172.21.15.152:0/2356082205 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:01.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.246+0000 7f31b3400640 1 --2- 172.21.15.152:0/2356082205 >> v2:172.21.15.152:3300/0 conn(0x7f31b4162ca0 0x7f31b40cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.246+0000 7f686a800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f68640eae10 0x7f686400de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.246+0000 7f686a800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f68640eae10 0x7f686400de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.152:41166/0 (socket says 172.21.15.152:41166) 2024-04-17T08:47:01.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.246+0000 7f686a800640 1 -- 172.21.15.152:0/220676383 learned_addr learned my addr 172.21.15.152:0/220676383 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:01.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.246+0000 7f60b1800640 1 Processor -- start 2024-04-17T08:47:01.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.246+0000 7f6870a00640 1 --2- 172.21.15.152:0/220676383 >> v2:172.21.15.152:3300/0 conn(0x7f6864055d20 0x7f6864054a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.246+0000 7f60b1800640 1 -- start start 2024-04-17T08:47:01.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.246+0000 7f31b2000640 1 -- 172.21.15.152:0/2356082205 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2742201635 0 0) 0x7f31b4167510 con 0x7f31b4167080 2024-04-17T08:47:01.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.246+0000 7f31b2000640 1 -- 172.21.15.152:0/2356082205 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3198003530 con 0x7f31b4167080 2024-04-17T08:47:01.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.246+0000 7f31b2000640 1 -- 172.21.15.152:0/2356082205 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2889356841 0 0) 0x7f3198003530 con 0x7f31b4167080 2024-04-17T08:47:01.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.246+0000 7f31b3400640 1 -- 172.21.15.152:0/2356082205 >> v1:172.21.15.196:6789/0 conn(0x7f31b40c38b0 legacy=0x7f31b406b9b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-17T08:47:01.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.246+0000 7f31b3400640 1 -- 172.21.15.152:0/2356082205 >> v1:172.21.15.152:6789/0 conn(0x7f31b4167080 legacy=0x7f31b40c31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.246+0000 7f31b3400640 1 -- 172.21.15.152:0/2356082205 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31b4163080 con 0x7f31b4162ca0 2024-04-17T08:47:01.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.246+0000 7f686a800640 1 -- 172.21.15.152:0/220676383 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f68640ebf80 msgr2=0x7f686400e380 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-17T08:47:01.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.246+0000 7f686a800640 1 --2- 172.21.15.152:0/220676383 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f68640ebf80 0x7f686400e380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.246+0000 7f686a800640 1 -- 172.21.15.152:0/220676383 >> v2:172.21.15.152:3300/0 conn(0x7f6864055d20 msgr2=0x7f6864054a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:01.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.246+0000 7f686a800640 1 --2- 172.21.15.152:0/220676383 >> v2:172.21.15.152:3300/0 conn(0x7f6864055d20 0x7f6864054a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.246+0000 7f686a800640 1 -- 172.21.15.152:0/220676383 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68640eb780 con 0x7f68640eae10 2024-04-17T08:47:01.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.246+0000 7f60b1800640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f60ac0d0310 0x7f60ac0d06f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.246+0000 7f60b1800640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60ac15f5f0 con 0x7f60ac0cf9e0 2024-04-17T08:47:01.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.246+0000 7f60b1800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60ac0b18e0 con 0x7f60ac073ba0 2024-04-17T08:47:01.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.246+0000 7f60b1800640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f60ac06d140 con 0x7f60ac0d0310 2024-04-17T08:47:01.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.250+0000 7f60aaa00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f60ac0d0310 0x7f60ac0d06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.250+0000 7f60aa000640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f60ac073ba0 0x7f60ac15e7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.152:43128/0 (socket says 172.21.15.152:43128) 2024-04-17T08:47:01.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.250+0000 7f60aa000640 1 -- 172.21.15.152:0/2142130804 learned_addr learned my addr 172.21.15.152:0/2142130804 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:01.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.250+0000 7f60aaa00640 1 -- 172.21.15.152:0/2142130804 >> v1:172.21.15.196:6789/0 conn(0x7f60ac073ba0 legacy=0x7f60ac15e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.250+0000 7f60aaa00640 1 -- 172.21.15.152:0/2142130804 >> v1:172.21.15.152:6789/0 conn(0x7f60ac0cf9e0 legacy=0x7f60ac15eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:01.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.250+0000 7f60aaa00640 1 -- 172.21.15.152:0/2142130804 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60ac06caf0 con 0x7f60ac0d0310 2024-04-17T08:47:01.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.250+0000 7f483cc00640 1 Processor -- start 2024-04-17T08:47:01.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.250+0000 7f483cc00640 1 -- start start 2024-04-17T08:47:01.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.250+0000 7f31b3400640 1 --2- 172.21.15.152:0/2356082205 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31b4162ca0 0x7f31b40cd690 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f31a40097c0 tx=0x7f31a401c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0d73d6d42aa9355 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.250+0000 7f31b2000640 1 -- 172.21.15.152:0/2356082205 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a40b0070 con 0x7f31b4162ca0 2024-04-17T08:47:01.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.250+0000 7f31b2000640 1 -- 172.21.15.152:0/2356082205 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31a40ab400 con 0x7f31b4162ca0 2024-04-17T08:47:01.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.250+0000 7f31b2000640 1 -- 172.21.15.152:0/2356082205 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a0001680 con 0x7f31b4162ca0 2024-04-17T08:47:01.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.254+0000 7f5859200640 1 Processor -- start 2024-04-17T08:47:01.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.254+0000 7f5859200640 1 -- start start 2024-04-17T08:47:01.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.254+0000 7f483cc00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f483815c540 0x7f48380d0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.254+0000 7f483cc00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f48380af750 0x7f48380ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.254+0000 7f483cc00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f483806e010 con 0x7f483806cee0 2024-04-17T08:47:01.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.254+0000 7f483cc00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f48380d1020 con 0x7f483815c540 2024-04-17T08:47:01.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.254+0000 7f483cc00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f483806c1b0 con 0x7f48380af750 2024-04-17T08:47:01.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.254+0000 7f686a800640 1 --2- 172.21.15.152:0/220676383 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f68640eae10 0x7f686400de40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6864057d00 tx=0x7f685c01c420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c316b91f05739f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.254+0000 7f31ba800640 1 -- 172.21.15.152:0/2356082205 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31b4162ca0 msgr2=0x7f31b40cd690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.254+0000 7f31ba800640 1 --2- 172.21.15.152:0/2356082205 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31b4162ca0 0x7f31b40cd690 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f31a40097c0 tx=0x7f31a401c320 comp rx=0 tx=0).stop 2024-04-17T08:47:01.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.254+0000 7f31ba800640 1 -- 172.21.15.152:0/2356082205 shutdown_connections 2024-04-17T08:47:01.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.254+0000 7f31ba800640 1 --2- 172.21.15.152:0/2356082205 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31b4162ca0 0x7f31b40cd690 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.254+0000 7f31ba800640 1 -- 172.21.15.152:0/2356082205 >> 172.21.15.152:0/2356082205 conn(0x7f31b40b51e0 msgr2=0x7f31b40b55f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:01.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.254+0000 7f6869400640 1 -- 172.21.15.152:0/220676383 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685c0b0070 con 0x7f68640eae10 2024-04-17T08:47:01.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.254+0000 7f6869400640 1 -- 172.21.15.152:0/220676383 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f685c0ab600 con 0x7f68640eae10 2024-04-17T08:47:01.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.254+0000 7f6869400640 1 -- 172.21.15.152:0/220676383 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685c0ab9d0 con 0x7f68640eae10 2024-04-17T08:47:01.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.254+0000 7f60aaa00640 1 --2- 172.21.15.152:0/2142130804 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60ac0d0310 0x7f60ac0d06f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f60a4009d90 tx=0x7f60a401c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f98faaa4a7f0d08 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.254+0000 7f31ba800640 1 -- 172.21.15.152:0/2356082205 shutdown_connections 2024-04-17T08:47:01.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.254+0000 7f4836800640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f483806cee0 0x7f483815ffb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.152:43140/0 (socket says 172.21.15.152:43140) 2024-04-17T08:47:01.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.254+0000 7f4836800640 1 -- 172.21.15.152:0/2498474288 learned_addr learned my addr 172.21.15.152:0/2498474288 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:01.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.254+0000 7f4835400640 1 --2- 172.21.15.152:0/2498474288 >> v2:172.21.15.196:3300/0 conn(0x7f48380af750 0x7f48380ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.254+0000 7f4835e00640 1 --2- 172.21.15.152:0/2498474288 >> v2:172.21.15.152:3300/0 conn(0x7f483815c540 0x7f48380d0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.254+0000 7f5859200640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f58540b2f80 0x7f58540b3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.254+0000 7f5859200640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58540b5290 con 0x7f58540736b0 2024-04-17T08:47:01.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.254+0000 7f5859200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f585406c560 con 0x7f5854071c30 2024-04-17T08:47:01.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.254+0000 7f5859200640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f585406c840 con 0x7f58540b2f80 2024-04-17T08:47:01.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.254+0000 7f6871400640 1 -- 172.21.15.152:0/220676383 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f68640eae10 msgr2=0x7f686400de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.254+0000 7f6871400640 1 --2- 172.21.15.152:0/220676383 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f68640eae10 0x7f686400de40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6864057d00 tx=0x7f685c01c420 comp rx=0 tx=0).stop 2024-04-17T08:47:01.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.254+0000 7f6871400640 1 -- 172.21.15.152:0/220676383 shutdown_connections 2024-04-17T08:47:01.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.254+0000 7f4834a00640 1 -- 172.21.15.152:0/2498474288 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4084906005 0 0) 0x7f483806e010 con 0x7f483806cee0 2024-04-17T08:47:01.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.254+0000 7f4834a00640 1 -- 172.21.15.152:0/2498474288 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f481c003530 con 0x7f483806cee0 2024-04-17T08:47:01.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.254+0000 7f5853400640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f58540736b0 0x7f58541438b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:58416/0 (socket says 172.21.15.152:58416) 2024-04-17T08:47:01.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.254+0000 7f5853400640 1 -- 172.21.15.152:0/1052448955 learned_addr learned my addr 172.21.15.152:0/1052448955 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:01.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.254+0000 7f4835e00640 1 -- 172.21.15.152:0/2498474288 >> v2:172.21.15.196:3300/0 conn(0x7f48380af750 msgr2=0x7f48380ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:01.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.254+0000 7f4835e00640 1 --2- 172.21.15.152:0/2498474288 >> v2:172.21.15.196:3300/0 conn(0x7f48380af750 0x7f48380ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.254+0000 7f4835e00640 1 -- 172.21.15.152:0/2498474288 >> v1:172.21.15.196:6789/0 conn(0x7f483806cee0 legacy=0x7f483815ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.254+0000 7f31ba800640 1 -- 172.21.15.152:0/2356082205 wait complete. 2024-04-17T08:47:01.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.254+0000 7f6871400640 1 --2- 172.21.15.152:0/220676383 >> v2:172.21.15.152:3300/0 conn(0x7f6864055d20 0x7f6864054a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.254+0000 7f6871400640 1 --2- 172.21.15.152:0/220676383 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f68640ebf80 0x7f686400e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.254+0000 7f6871400640 1 --2- 172.21.15.152:0/220676383 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f68640eae10 0x7f686400de40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.254+0000 7f6871400640 1 -- 172.21.15.152:0/220676383 >> 172.21.15.152:0/220676383 conn(0x7f6864056ec0 msgr2=0x7f68640572d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:01.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.254+0000 7f4835e00640 1 -- 172.21.15.152:0/2498474288 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f483806c400 con 0x7f483815c540 2024-04-17T08:47:01.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.254+0000 7f60a9600640 1 -- 172.21.15.152:0/2142130804 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a40b2070 con 0x7f60ac0d0310 2024-04-17T08:47:01.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.254+0000 7f60a9600640 1 -- 172.21.15.152:0/2142130804 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60a40a57e0 con 0x7f60ac0d0310 2024-04-17T08:47:01.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.254+0000 7f60a9600640 1 -- 172.21.15.152:0/2142130804 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a40a5bb0 con 0x7f60ac0d0310 2024-04-17T08:47:01.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.258+0000 7f31ba800640 1 Processor -- start 2024-04-17T08:47:01.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.254+0000 7f6871400640 1 -- 172.21.15.152:0/220676383 shutdown_connections 2024-04-17T08:47:01.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.258+0000 7f60b1800640 1 -- 172.21.15.152:0/2142130804 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60ac0d0310 msgr2=0x7f60ac0d06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.258+0000 7f60b1800640 1 --2- 172.21.15.152:0/2142130804 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60ac0d0310 0x7f60ac0d06f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f60a4009d90 tx=0x7f60a401c810 comp rx=0 tx=0).stop 2024-04-17T08:47:01.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.254+0000 7f5852a00640 1 --2- 172.21.15.152:0/1052448955 >> v2:172.21.15.152:3300/0 conn(0x7f58540b2f80 0x7f58540b3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.258+0000 7f5852a00640 1 -- 172.21.15.152:0/1052448955 >> v1:172.21.15.196:6789/0 conn(0x7f5854071c30 legacy=0x7f5854072080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.258+0000 7f5852a00640 1 -- 172.21.15.152:0/1052448955 >> v1:172.21.15.152:6789/0 conn(0x7f58540736b0 legacy=0x7f58541438b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.258+0000 7f5852a00640 1 -- 172.21.15.152:0/1052448955 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f585406cb20 con 0x7f58540b2f80 2024-04-17T08:47:01.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.258+0000 7fc291000640 1 Processor -- start 2024-04-17T08:47:01.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.258+0000 7fc291000640 1 -- start start 2024-04-17T08:47:01.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.258+0000 7f31ba800640 1 -- start start 2024-04-17T08:47:01.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.258+0000 7f6871400640 1 -- 172.21.15.152:0/220676383 wait complete. 2024-04-17T08:47:01.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.258+0000 7fc291000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc28c0d0360 0x7fc28c0d07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.258+0000 7fc291000640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc28c06e6b0 con 0x7fc28c0ad3d0 2024-04-17T08:47:01.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.258+0000 7fc291000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc28c06e990 con 0x7fc28c161b70 2024-04-17T08:47:01.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.258+0000 7fc291000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fc28c0d0d00 con 0x7fc28c0d0360 2024-04-17T08:47:01.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.258+0000 7f6871400640 1 Processor -- start 2024-04-17T08:47:01.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.258+0000 7fc289e00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fc28c161b70 0x7fc28c06dc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.152:43164/0 (socket says 172.21.15.152:43164) 2024-04-17T08:47:01.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.258+0000 7fc289e00640 1 -- 172.21.15.152:0/2520198281 learned_addr learned my addr 172.21.15.152:0/2520198281 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:01.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.258+0000 7fc288a00640 1 -- 172.21.15.152:0/2520198281 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2226310581 0 0) 0x7fc28c06e990 con 0x7fc28c161b70 2024-04-17T08:47:01.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.258+0000 7fc288a00640 1 -- 172.21.15.152:0/2520198281 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc270003530 con 0x7fc28c161b70 2024-04-17T08:47:01.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.258+0000 7fc288a00640 1 -- 172.21.15.152:0/2520198281 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3984180864 0 0) 0x7fc28c06e6b0 con 0x7fc28c0ad3d0 2024-04-17T08:47:01.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.258+0000 7fc288a00640 1 -- 172.21.15.152:0/2520198281 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc28c06e990 con 0x7fc28c0ad3d0 2024-04-17T08:47:01.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.258+0000 7f6871400640 1 -- start start 2024-04-17T08:47:01.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.258+0000 7fc288a00640 1 -- 172.21.15.152:0/2520198281 <== mon.1 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 928356810 0 0) 0x7fc270003530 con 0x7fc28c161b70 2024-04-17T08:47:01.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.258+0000 7fc288a00640 1 -- 172.21.15.152:0/2520198281 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc28c0d0360 msgr2=0x7fc28c0d07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:01.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.258+0000 7fc288a00640 1 --2- 172.21.15.152:0/2520198281 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc28c0d0360 0x7fc28c0d07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.258+0000 7fc288a00640 1 -- 172.21.15.152:0/2520198281 >> v1:172.21.15.152:6789/0 conn(0x7fc28c0ad3d0 legacy=0x7fc28c0ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.258+0000 7fc288a00640 1 -- 172.21.15.152:0/2520198281 --> v1:172.21.15.196:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc28c06ec70 con 0x7fc28c161b70 2024-04-17T08:47:01.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.258+0000 7fc288a00640 1 -- 172.21.15.152:0/2520198281 <== mon.1 v1:172.21.15.196:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2973887244 0 0) 0x7fc27c001680 con 0x7fc28c161b70 2024-04-17T08:47:01.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.258+0000 7fc288a00640 1 -- 172.21.15.152:0/2520198281 >> v1:172.21.15.196:6789/0 conn(0x7fc28c161b70 legacy=0x7fc28c06dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.258+0000 7fc288a00640 1 --2- 172.21.15.152:0/2520198281 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc270003b50 0x7fc270003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.258+0000 7fc288a00640 1 --2- 172.21.15.152:0/2520198281 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc270004810 0x7fc270004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.258+0000 7fc288a00640 1 --2- 172.21.15.152:0/2520198281 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc270005220 0x7fc27000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.258+0000 7fc288a00640 1 -- 172.21.15.152:0/2520198281 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc27000c120 con 0x7fc270004810 2024-04-17T08:47:01.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.258+0000 7fc288a00640 1 -- 172.21.15.152:0/2520198281 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc27000c2d0 con 0x7fc270005220 2024-04-17T08:47:01.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.258+0000 7fc288a00640 1 -- 172.21.15.152:0/2520198281 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fc27000c4d0 con 0x7fc270003b50 2024-04-17T08:47:01.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.258+0000 7f31ba800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31b40c38b0 0x7f31b4157350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7fc28a800640 1 --2- 172.21.15.152:0/2520198281 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc270005220 0x7fc27000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7fc289400640 1 --2- 172.21.15.152:0/2520198281 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc270004810 0x7fc270004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f31ba800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f31b4162ca0 0x7f31b40b1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f31b2a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f31b4162ca0 0x7f31b40b1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f31b3400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31b40c38b0 0x7f31b4157350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f31b2a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f31b4162ca0 0x7f31b40b1ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.152:41202/0 (socket says 172.21.15.152:41202) 2024-04-17T08:47:01.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f31ba800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f31b41632e0 0x7f31b40b2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f31b3400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31b40c38b0 0x7f31b4157350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46698/0 (socket says 172.21.15.152:46698) 2024-04-17T08:47:01.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f31b3e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f31b41632e0 0x7f31b40b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f31b3e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f31b41632e0 0x7f31b40b2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.152:33452/0 (socket says 172.21.15.152:33452) 2024-04-17T08:47:01.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f31b2a00640 1 -- 172.21.15.152:0/1880165836 learned_addr learned my addr 172.21.15.152:0/1880165836 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:01.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f31ba800640 1 -- 172.21.15.152:0/1880165836 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f31b4170f00 con 0x7f31b40c38b0 2024-04-17T08:47:01.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f31ba800640 1 -- 172.21.15.152:0/1880165836 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f31b4170d80 con 0x7f31b4162ca0 2024-04-17T08:47:01.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f31ba800640 1 -- 172.21.15.152:0/1880165836 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f31b4171080 con 0x7f31b41632e0 2024-04-17T08:47:01.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f6871400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6864055d20 0x7f686404b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f6871400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f68640eae10 0x7f686404d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f6871400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68640ebf80 0x7f686400de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f6871400640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f68640518a0 con 0x7f68640ebf80 2024-04-17T08:47:01.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f6871400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f6864051720 con 0x7f68640eae10 2024-04-17T08:47:01.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f6871400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f6864051a20 con 0x7f6864055d20 2024-04-17T08:47:01.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f686a800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6864055d20 0x7f686404b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f686a800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6864055d20 0x7f686404b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.152:33466/0 (socket says 172.21.15.152:33466) 2024-04-17T08:47:01.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f686a800640 1 -- 172.21.15.152:0/3728925742 learned_addr learned my addr 172.21.15.152:0/3728925742 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:01.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f60b1800640 1 -- 172.21.15.152:0/2142130804 shutdown_connections 2024-04-17T08:47:01.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f60b1800640 1 --2- 172.21.15.152:0/2142130804 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60ac0d0310 0x7f60ac0d06f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f60b1800640 1 -- 172.21.15.152:0/2142130804 >> 172.21.15.152:0/2142130804 conn(0x7f60ac073080 msgr2=0x7f60ac073490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:01.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f4835e00640 1 --2- 172.21.15.152:0/2498474288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f483815c540 0x7f48380d0ae0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f48380b3110 tx=0x7f4830020ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=638f35fd1007c080 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7fc28a800640 1 -- 172.21.15.152:0/2520198281 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc270003b50 msgr2=0x7fc270003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:01.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7fc28a800640 1 --2- 172.21.15.152:0/2520198281 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc270003b50 0x7fc270003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7fc28a800640 1 -- 172.21.15.152:0/2520198281 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc270004810 msgr2=0x7fc270004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:01.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7fc28a800640 1 --2- 172.21.15.152:0/2520198281 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc270004810 0x7fc270004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7fc28a800640 1 -- 172.21.15.152:0/2520198281 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc28c06ec70 con 0x7fc270005220 2024-04-17T08:47:01.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f6869e00640 1 --2- 172.21.15.152:0/3728925742 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f68640eae10 0x7f686404d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f5852a00640 1 --2- 172.21.15.152:0/1052448955 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58540b2f80 0x7f58540b3410 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f584400a8e0 tx=0x7f584401d6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a09da3fa187d0635 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f6870a00640 1 --2- 172.21.15.152:0/3728925742 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68640ebf80 0x7f686400de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f60b1800640 1 -- 172.21.15.152:0/2142130804 shutdown_connections 2024-04-17T08:47:01.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f60b1800640 1 -- 172.21.15.152:0/2142130804 wait complete. 2024-04-17T08:47:01.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f5852000640 1 -- 172.21.15.152:0/1052448955 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f584400b040 con 0x7f58540b2f80 2024-04-17T08:47:01.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f5852000640 1 -- 172.21.15.152:0/1052448955 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58440a7650 con 0x7f58540b2f80 2024-04-17T08:47:01.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f5852000640 1 -- 172.21.15.152:0/1052448955 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58440a7a20 con 0x7f58540b2f80 2024-04-17T08:47:01.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f31b3e00640 1 -- 172.21.15.152:0/1880165836 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f31b4162ca0 msgr2=0x7f31b40b1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f31b3e00640 1 --2- 172.21.15.152:0/1880165836 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f31b4162ca0 0x7f31b40b1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f31b3e00640 1 -- 172.21.15.152:0/1880165836 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31b40c38b0 msgr2=0x7f31b4157350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f6c6d400640 1 Processor -- start 2024-04-17T08:47:01.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f31b3e00640 1 --2- 172.21.15.152:0/1880165836 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31b40c38b0 0x7f31b4157350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f31b3e00640 1 -- 172.21.15.152:0/1880165836 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31b40b0120 con 0x7f31b41632e0 2024-04-17T08:47:01.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f31b3400640 1 --2- 172.21.15.152:0/1880165836 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31b40c38b0 0x7f31b4157350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:01.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f686a800640 1 -- 172.21.15.152:0/3728925742 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f68640eae10 msgr2=0x7f686404d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f686a800640 1 --2- 172.21.15.152:0/3728925742 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f68640eae10 0x7f686404d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f686a800640 1 -- 172.21.15.152:0/3728925742 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68640ebf80 msgr2=0x7f686400de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f686a800640 1 --2- 172.21.15.152:0/3728925742 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68640ebf80 0x7f686400de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f686a800640 1 -- 172.21.15.152:0/3728925742 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6864189560 con 0x7f6864055d20 2024-04-17T08:47:01.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f686a800640 1 --2- 172.21.15.152:0/3728925742 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6864055d20 0x7f686404b7c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f685c0ae040 tx=0x7f685c01ac60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f6862a00640 1 -- 172.21.15.152:0/3728925742 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685c0ba020 con 0x7f6864055d20 2024-04-17T08:47:01.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f6862a00640 1 -- 172.21.15.152:0/3728925742 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f685c0b6640 con 0x7f6864055d20 2024-04-17T08:47:01.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f6862a00640 1 -- 172.21.15.152:0/3728925742 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685c0b0040 con 0x7f6864055d20 2024-04-17T08:47:01.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f4834a00640 1 -- 172.21.15.152:0/2498474288 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f483000d0d0 con 0x7f483815c540 2024-04-17T08:47:01.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f4834a00640 1 -- 172.21.15.152:0/2498474288 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f483000d270 con 0x7f483815c540 2024-04-17T08:47:01.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f4834a00640 1 -- 172.21.15.152:0/2498474288 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48300a9970 con 0x7f483815c540 2024-04-17T08:47:01.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f6871400640 1 -- 172.21.15.152:0/3728925742 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6864189820 con 0x7f6864055d20 2024-04-17T08:47:01.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f6871400640 1 -- 172.21.15.152:0/3728925742 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6864189de0 con 0x7f6864055d20 2024-04-17T08:47:01.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f5859200640 1 -- 172.21.15.152:0/1052448955 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58540b2f80 msgr2=0x7f58540b3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f5859200640 1 --2- 172.21.15.152:0/1052448955 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58540b2f80 0x7f58540b3410 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f584400a8e0 tx=0x7f584401d6a0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.266+0000 7f5859200640 1 -- 172.21.15.152:0/1052448955 shutdown_connections 2024-04-17T08:47:01.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.266+0000 7f5859200640 1 --2- 172.21.15.152:0/1052448955 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58540b2f80 0x7f58540b3410 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.266+0000 7f5859200640 1 -- 172.21.15.152:0/1052448955 >> 172.21.15.152:0/1052448955 conn(0x7f58540d0050 msgr2=0x7f58540d0460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:01.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.266+0000 7f483cc00640 1 -- 172.21.15.152:0/2498474288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f483815c540 msgr2=0x7f48380d0ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.262+0000 7f6c6d400640 1 -- start start 2024-04-17T08:47:01.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.266+0000 7f483cc00640 1 --2- 172.21.15.152:0/2498474288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f483815c540 0x7f48380d0ae0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f48380b3110 tx=0x7f4830020ca0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.266+0000 7f6857e00640 1 -- 172.21.15.152:0/3728925742 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6840001040 con 0x7f6864055d20 2024-04-17T08:47:01.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.266+0000 7f483cc00640 1 -- 172.21.15.152:0/2498474288 shutdown_connections 2024-04-17T08:47:01.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.266+0000 7f483cc00640 1 --2- 172.21.15.152:0/2498474288 >> v2:172.21.15.196:3300/0 conn(0x7f48380af750 0x7f48380ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.266+0000 7f483cc00640 1 --2- 172.21.15.152:0/2498474288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f483815c540 0x7f48380d0ae0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.266+0000 7f483cc00640 1 -- 172.21.15.152:0/2498474288 >> 172.21.15.152:0/2498474288 conn(0x7f48380b51e0 msgr2=0x7f48380b55f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:01.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.266+0000 7f483cc00640 1 -- 172.21.15.152:0/2498474288 shutdown_connections 2024-04-17T08:47:01.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.266+0000 7f31b3e00640 1 --2- 172.21.15.152:0/1880165836 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f31b41632e0 0x7f31b40b2530 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f31ac00be50 tx=0x7f31ac00bf40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.266+0000 7f31ab400640 1 -- 172.21.15.152:0/1880165836 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31ac019070 con 0x7f31b41632e0 2024-04-17T08:47:01.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.266+0000 7f31ab400640 1 -- 172.21.15.152:0/1880165836 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31ac014440 con 0x7f31b41632e0 2024-04-17T08:47:01.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.266+0000 7f31ab400640 1 -- 172.21.15.152:0/1880165836 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31ac014830 con 0x7f31b41632e0 2024-04-17T08:47:01.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.266+0000 7f483cc00640 1 -- 172.21.15.152:0/2498474288 wait complete. 2024-04-17T08:47:01.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.266+0000 7f31ba800640 1 -- 172.21.15.152:0/1880165836 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31b4165590 con 0x7f31b41632e0 2024-04-17T08:47:01.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.266+0000 7f31ba800640 1 -- 172.21.15.152:0/1880165836 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f31b4165b50 con 0x7f31b41632e0 2024-04-17T08:47:01.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.266+0000 7f60b1800640 1 Processor -- start 2024-04-17T08:47:01.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.266+0000 7f5859200640 1 -- 172.21.15.152:0/1052448955 shutdown_connections 2024-04-17T08:47:01.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.266+0000 7fc28a800640 1 --2- 172.21.15.152:0/2520198281 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc270005220 0x7fc27000b9d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc284002010 tx=0x7fc28401c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d720100e977f7cd8 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.266+0000 7f6c6d400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f6c68162ca0 0x7f6c680cd690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.266+0000 7f6c6d400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c680c38b0 0x7f6c680d0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.266+0000 7f6c6d400640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c68167510 con 0x7f6c68167080 2024-04-17T08:47:01.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.266+0000 7f6c6d400640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f6c680ccbb0 con 0x7f6c68162ca0 2024-04-17T08:47:01.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.266+0000 7f6c6d400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f6c680cce90 con 0x7f6c680c38b0 2024-04-17T08:47:01.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.266+0000 7f60b1800640 1 -- start start 2024-04-17T08:47:01.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.266+0000 7f5859200640 1 -- 172.21.15.152:0/1052448955 wait complete. 2024-04-17T08:47:01.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.266+0000 7f31ba800640 1 -- 172.21.15.152:0/1880165836 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f31b4075be0 con 0x7f31b41632e0 2024-04-17T08:47:01.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.266+0000 7fc288a00640 1 -- 172.21.15.152:0/2520198281 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc284001c10 con 0x7fc270005220 2024-04-17T08:47:01.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.266+0000 7fc288a00640 1 -- 172.21.15.152:0/2520198281 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2840a6640 con 0x7fc270005220 2024-04-17T08:47:01.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.266+0000 7f46a7c00640 1 Processor -- start 2024-04-17T08:47:01.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.266+0000 7f46a7c00640 1 -- start start 2024-04-17T08:47:01.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.266+0000 7f6862a00640 1 -- 172.21.15.152:0/3728925742 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f685c0bd020 con 0x7f6864055d20 2024-04-17T08:47:01.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.266+0000 7fc291000640 1 -- 172.21.15.152:0/2520198281 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc270005220 msgr2=0x7fc27000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.266+0000 7fc291000640 1 --2- 172.21.15.152:0/2520198281 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc270005220 0x7fc27000b9d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc284002010 tx=0x7fc28401c940 comp rx=0 tx=0).stop 2024-04-17T08:47:01.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.266+0000 7fc28a800640 1 -- 172.21.15.152:0/2520198281 reap_dead start 2024-04-17T08:47:01.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f483cc00640 1 Processor -- start 2024-04-17T08:47:01.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f6862a00640 1 --2- 172.21.15.152:0/3728925742 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f684c068380 0x7f684c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f483cc00640 1 -- start start 2024-04-17T08:47:01.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7fc291000640 1 -- 172.21.15.152:0/2520198281 shutdown_connections 2024-04-17T08:47:01.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7fc291000640 1 -- 172.21.15.152:0/2520198281 >> 172.21.15.152:0/2520198281 conn(0x7fc28c0b3350 msgr2=0x7fc28c0b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:01.284 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.266+0000 7f6c65e00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f6c68167080 0x7f6c680c31a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:58446/0 (socket says 172.21.15.152:58446) 2024-04-17T08:47:01.284 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.266+0000 7f6c65e00640 1 -- 172.21.15.152:0/553727746 learned_addr learned my addr 172.21.15.152:0/553727746 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:01.284 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f6c66800640 1 --2- 172.21.15.152:0/553727746 >> v2:172.21.15.152:3300/0 conn(0x7f6c68162ca0 0x7f6c680cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.284 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f6862a00640 1 -- 172.21.15.152:0/3728925742 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f685c120fe0 con 0x7f6864055d20 2024-04-17T08:47:01.284 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f5859200640 1 Processor -- start 2024-04-17T08:47:01.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7fc291000640 1 -- 172.21.15.152:0/2520198281 shutdown_connections 2024-04-17T08:47:01.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f6862a00640 1 --2- 172.21.15.152:0/3728925742 >> [v2:172.21.15.152:6800/4133383142,v1:172.21.15.152:6801/4133383142] conn(0x7f684c071b00 0x7f684c073f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f6862a00640 1 -- 172.21.15.152:0/3728925742 --> [v2:172.21.15.152:6800/4133383142,v1:172.21.15.152:6801/4133383142] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f684c074610 con 0x7f684c071b00 2024-04-17T08:47:01.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f6862a00640 1 -- 172.21.15.152:0/3728925742 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f685c1235e0 con 0x7f6864055d20 2024-04-17T08:47:01.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f6c66800640 1 -- 172.21.15.152:0/553727746 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c680c38b0 msgr2=0x7f6c680d0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:01.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f6c66800640 1 --2- 172.21.15.152:0/553727746 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c680c38b0 0x7f6c680d0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7fc291000640 1 -- 172.21.15.152:0/2520198281 wait complete. 2024-04-17T08:47:01.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f6869e00640 1 --2- 172.21.15.152:0/3728925742 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f684c068380 0x7f684c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f6c66800640 1 -- 172.21.15.152:0/553727746 >> v1:172.21.15.152:6789/0 conn(0x7f6c68167080 legacy=0x7f6c680c31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.266+0000 7f60b1800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f60ac073ba0 0x7f60ac099a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.266+0000 7f60b1800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60ac0cf9e0 0x7f60ac09cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.266+0000 7f60b1800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f60ac0d0310 0x7f60ac09d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.266+0000 7f60b1800640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f60ac0b0710 con 0x7f60ac0cf9e0 2024-04-17T08:47:01.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.266+0000 7f60b1800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f60ac0b0590 con 0x7f60ac0d0310 2024-04-17T08:47:01.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.266+0000 7f60b1800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f60ac0cf0b0 con 0x7f60ac073ba0 2024-04-17T08:47:01.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f60aaa00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f60ac073ba0 0x7f60ac099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f60aaa00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f60ac073ba0 0x7f60ac099a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.152:33488/0 (socket says 172.21.15.152:33488) 2024-04-17T08:47:01.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f60aaa00640 1 -- 172.21.15.152:0/61561983 learned_addr learned my addr 172.21.15.152:0/61561983 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:01.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f60aaa00640 1 -- 172.21.15.152:0/61561983 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f60ac0d0310 msgr2=0x7f60ac09d3e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-17T08:47:01.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f60aaa00640 1 --2- 172.21.15.152:0/61561983 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f60ac0d0310 0x7f60ac09d3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f6c65400640 1 -- 172.21.15.152:0/553727746 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2683312025 0 0) 0x7f6c68167510 con 0x7f6c68167080 2024-04-17T08:47:01.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f60aaa00640 1 -- 172.21.15.152:0/61561983 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60ac0cf9e0 msgr2=0x7f60ac09cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f60aaa00640 1 --2- 172.21.15.152:0/61561983 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60ac0cf9e0 0x7f60ac09cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f60aaa00640 1 -- 172.21.15.152:0/61561983 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60ac09a610 con 0x7f60ac073ba0 2024-04-17T08:47:01.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f6c66800640 1 -- 172.21.15.152:0/553727746 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c68163080 con 0x7f6c68162ca0 2024-04-17T08:47:01.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f60aaa00640 1 --2- 172.21.15.152:0/61561983 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f60ac073ba0 0x7f60ac099a40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f60a4019420 tx=0x7f60a40195b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f5859200640 1 -- start start 2024-04-17T08:47:01.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f31ab400640 1 -- 172.21.15.152:0/1880165836 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f31ac01c070 con 0x7f31b41632e0 2024-04-17T08:47:01.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f6870a00640 1 --2- 172.21.15.152:0/3728925742 >> [v2:172.21.15.152:6800/4133383142,v1:172.21.15.152:6801/4133383142] conn(0x7f684c071b00 0x7f684c073f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f60a2a00640 1 -- 172.21.15.152:0/61561983 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a40ce020 con 0x7f60ac073ba0 2024-04-17T08:47:01.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f46a7c00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f46a0155af0 0x7f46a0072d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f6869e00640 1 --2- 172.21.15.152:0/3728925742 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f684c068380 0x7f684c06a840 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f686400a6e0 tx=0x7f6858008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f60a2a00640 1 -- 172.21.15.152:0/61561983 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60a40c9680 con 0x7f60ac073ba0 2024-04-17T08:47:01.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f60a2a00640 1 -- 172.21.15.152:0/61561983 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a40b2040 con 0x7f60ac073ba0 2024-04-17T08:47:01.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f60b1800640 1 -- 172.21.15.152:0/61561983 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60ac09a8f0 con 0x7f60ac073ba0 2024-04-17T08:47:01.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f46a7c00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f46a015c120 0x7f46a0073250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f46a7c00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46a015c790 con 0x7f46a00b4f70 2024-04-17T08:47:01.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f46a7c00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f46a015ca70 con 0x7f46a015c120 2024-04-17T08:47:01.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f46a7c00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f46a015c530 con 0x7f46a0155af0 2024-04-17T08:47:01.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f46a5200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f46a0155af0 0x7f46a0072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f46a5200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f46a0155af0 0x7f46a0072d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.152:41228/0 (socket says 172.21.15.152:41228) 2024-04-17T08:47:01.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f46a5200640 1 -- 172.21.15.152:0/3304281896 learned_addr learned my addr 172.21.15.152:0/3304281896 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:01.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7f31ab400640 1 --2- 172.21.15.152:0/1880165836 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3194068400 0x7f319406a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7f31ab400640 1 -- 172.21.15.152:0/1880165836 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f31ac087360 con 0x7f31b41632e0 2024-04-17T08:47:01.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7f31ab400640 1 --2- 172.21.15.152:0/1880165836 >> [v2:172.21.15.152:6817/3603799291,v1:172.21.15.152:6819/3603799291] conn(0x7f3194071b70 0x7f3194073fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7f31ab400640 1 -- 172.21.15.152:0/1880165836 --> [v2:172.21.15.152:6817/3603799291,v1:172.21.15.152:6819/3603799291] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f31ac020e50 con 0x7f3194071b70 2024-04-17T08:47:01.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7f31ab400640 1 -- 172.21.15.152:0/1880165836 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f31ac087710 con 0x7f31b41632e0 2024-04-17T08:47:01.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f6870a00640 1 --2- 172.21.15.152:0/3728925742 >> [v2:172.21.15.152:6800/4133383142,v1:172.21.15.152:6801/4133383142] conn(0x7f684c071b00 0x7f684c073f40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7f6862a00640 1 -- 172.21.15.152:0/3728925742 <== osd.1 v2:172.21.15.152:6800/4133383142 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f684c074610 con 0x7f684c071b00 2024-04-17T08:47:01.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f60b1800640 1 -- 172.21.15.152:0/61561983 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f60ac09aeb0 con 0x7f60ac073ba0 2024-04-17T08:47:01.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7f60b1800640 1 -- 172.21.15.152:0/61561983 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f60ac09b290 con 0x7f60ac073ba0 2024-04-17T08:47:01.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7f60a2a00640 1 -- 172.21.15.152:0/61561983 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f60a40d1020 con 0x7f60ac073ba0 2024-04-17T08:47:01.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f483cc00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f483806cee0 0x7f48380c40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f483cc00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f48380af750 0x7f4838151ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f483cc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f483815c540 0x7f4838152010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f483cc00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f48381674a0 con 0x7f483806cee0 2024-04-17T08:47:01.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f483cc00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4838167320 con 0x7f48380af750 2024-04-17T08:47:01.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f483cc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f4838167620 con 0x7f483815c540 2024-04-17T08:47:01.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7f4836800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f483815c540 0x7f4838152010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7f4836800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f483815c540 0x7f4838152010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.152:33490/0 (socket says 172.21.15.152:33490) 2024-04-17T08:47:01.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7f4836800640 1 -- 172.21.15.152:0/209512760 learned_addr learned my addr 172.21.15.152:0/209512760 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:01.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7f4835e00640 1 --2- 172.21.15.152:0/209512760 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f483806cee0 0x7f48380c40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7f4835400640 1 --2- 172.21.15.152:0/209512760 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f48380af750 0x7f4838151ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7f4836800640 1 -- 172.21.15.152:0/209512760 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f48380af750 msgr2=0x7f4838151ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7f4836800640 1 --2- 172.21.15.152:0/209512760 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f48380af750 0x7f4838151ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7f4836800640 1 -- 172.21.15.152:0/209512760 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f483806cee0 msgr2=0x7f48380c40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7f4836800640 1 --2- 172.21.15.152:0/209512760 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f483806cee0 0x7f48380c40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7f4836800640 1 -- 172.21.15.152:0/209512760 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48381529b0 con 0x7f483815c540 2024-04-17T08:47:01.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7f4836800640 1 --2- 172.21.15.152:0/209512760 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f483815c540 0x7f4838152010 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f482800c3e0 tx=0x7f482800c8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7f482e000640 1 -- 172.21.15.152:0/209512760 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4828017070 con 0x7f483815c540 2024-04-17T08:47:01.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7f482e000640 1 -- 172.21.15.152:0/209512760 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4828005cf0 con 0x7f483815c540 2024-04-17T08:47:01.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7f482e000640 1 -- 172.21.15.152:0/209512760 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4828017070 con 0x7f483815c540 2024-04-17T08:47:01.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7f483cc00640 1 -- 172.21.15.152:0/209512760 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48380b1630 con 0x7f483815c540 2024-04-17T08:47:01.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7f483cc00640 1 -- 172.21.15.152:0/209512760 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f48380b1bf0 con 0x7f483815c540 2024-04-17T08:47:01.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f5859200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5854071c30 0x7f5854159e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f5859200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f58540736b0 0x7f58540cd220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f5859200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58540b2f80 0x7f58541633f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f5859200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f58541686d0 con 0x7f58540b2f80 2024-04-17T08:47:01.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f5859200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f5854168550 con 0x7f58540736b0 2024-04-17T08:47:01.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f5859200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f5854168850 con 0x7f5854071c30 2024-04-17T08:47:01.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7f5852a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f58540736b0 0x7f58540cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7f5852a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f58540736b0 0x7f58540cd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.152:41238/0 (socket says 172.21.15.152:41238) 2024-04-17T08:47:01.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7f5852a00640 1 -- 172.21.15.152:0/387723471 learned_addr learned my addr 172.21.15.152:0/387723471 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:01.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7f5852a00640 1 -- 172.21.15.152:0/387723471 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5854071c30 msgr2=0x7f5854159e20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-17T08:47:01.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7f5852a00640 1 --2- 172.21.15.152:0/387723471 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5854071c30 0x7f5854159e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7f5852a00640 1 -- 172.21.15.152:0/387723471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58540b2f80 msgr2=0x7f58541633f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7f5852a00640 1 --2- 172.21.15.152:0/387723471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58540b2f80 0x7f58541633f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7f5852a00640 1 -- 172.21.15.152:0/387723471 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5854163f90 con 0x7f58540736b0 2024-04-17T08:47:01.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7f5852a00640 1 --2- 172.21.15.152:0/387723471 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f58540736b0 0x7f58540cd220 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f584401a2b0 tx=0x7f584401a440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7f584b400640 1 -- 172.21.15.152:0/387723471 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58440a8840 con 0x7f58540736b0 2024-04-17T08:47:01.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7f584b400640 1 -- 172.21.15.152:0/387723471 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58440a89e0 con 0x7f58540736b0 2024-04-17T08:47:01.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7f584b400640 1 -- 172.21.15.152:0/387723471 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58440a8d90 con 0x7f58540736b0 2024-04-17T08:47:01.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7f5859200640 1 -- 172.21.15.152:0/387723471 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5854164270 con 0x7f58540736b0 2024-04-17T08:47:01.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7fc291000640 1 Processor -- start 2024-04-17T08:47:01.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7fc291000640 1 -- start start 2024-04-17T08:47:01.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7fc291000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc270005220 0x7fc28c164ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7fc291000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc28c1699f0 0x7fc28c152650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7fc291000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc28c0afcd0 0x7fc28c0b0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7fc291000640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc28c16a1c0 con 0x7fc270005220 2024-04-17T08:47:01.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7fc291000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc28c06f230 con 0x7fc28c0afcd0 2024-04-17T08:47:01.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7fc291000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fc28c16a340 con 0x7fc28c1699f0 2024-04-17T08:47:01.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7fc28a800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc28c0afcd0 0x7fc28c0b0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7fc289e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc270005220 0x7fc28c164ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7fc28a800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc28c0afcd0 0x7fc28c0b0150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.152:41268/0 (socket says 172.21.15.152:41268) 2024-04-17T08:47:01.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7fc28a800640 1 -- 172.21.15.152:0/1790428606 learned_addr learned my addr 172.21.15.152:0/1790428606 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:01.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7fc289400640 1 --2- 172.21.15.152:0/1790428606 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc28c1699f0 0x7fc28c152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f46a5c00640 1 --2- 172.21.15.152:0/3304281896 >> v2:172.21.15.152:3300/0 conn(0x7f46a015c120 0x7f46a0073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f46a5200640 1 -- 172.21.15.152:0/3304281896 >> v2:172.21.15.152:3300/0 conn(0x7f46a015c120 msgr2=0x7f46a0073250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:01.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7f5859200640 1 -- 172.21.15.152:0/387723471 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58540ccd00 con 0x7f58540736b0 2024-04-17T08:47:01.298 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7f31b2a00640 1 --2- 172.21.15.152:0/1880165836 >> [v2:172.21.15.152:6817/3603799291,v1:172.21.15.152:6819/3603799291] conn(0x7f3194071b70 0x7f3194073fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.298 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7fc28a800640 1 -- 172.21.15.152:0/1790428606 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc28c1699f0 msgr2=0x7fc28c152650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.298 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7fc28a800640 1 --2- 172.21.15.152:0/1790428606 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc28c1699f0 0x7fc28c152650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.298 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7fc28a800640 1 -- 172.21.15.152:0/1790428606 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc270005220 msgr2=0x7fc28c164ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.298 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7fc28a800640 1 --2- 172.21.15.152:0/1790428606 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc270005220 0x7fc28c164ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.298 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7fc28a800640 1 -- 172.21.15.152:0/1790428606 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc28c1fe970 con 0x7fc28c0afcd0 2024-04-17T08:47:01.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.278+0000 7f31b2a00640 1 --2- 172.21.15.152:0/1880165836 >> [v2:172.21.15.152:6817/3603799291,v1:172.21.15.152:6819/3603799291] conn(0x7f3194071b70 0x7f3194073fb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7f60a2a00640 1 --2- 172.21.15.152:0/61561983 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f608c068450 0x7f608c06a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7f60a2a00640 1 -- 172.21.15.152:0/61561983 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f60a4132da0 con 0x7f60ac073ba0 2024-04-17T08:47:01.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7f60a2a00640 1 --2- 172.21.15.152:0/61561983 >> [v2:172.21.15.152:6808/3826143898,v1:172.21.15.152:6809/3826143898] conn(0x7f608c071b50 0x7f608c073f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7f60a2a00640 1 -- 172.21.15.152:0/61561983 --> [v2:172.21.15.152:6808/3826143898,v1:172.21.15.152:6809/3826143898] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f60a40aee50 con 0x7f608c071b50 2024-04-17T08:47:01.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7fc28a800640 1 --2- 172.21.15.152:0/1790428606 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc28c0afcd0 0x7fc28c0b0150 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc28401ce20 tx=0x7fc270005840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.278+0000 7fc282000640 1 -- 172.21.15.152:0/1790428606 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2840a6420 con 0x7fc28c0afcd0 2024-04-17T08:47:01.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f46a5200640 1 --2- 172.21.15.152:0/3304281896 >> v2:172.21.15.152:3300/0 conn(0x7f46a015c120 0x7f46a0073250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.270+0000 7f469f400640 1 -- 172.21.15.152:0/3304281896 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2686507545 0 0) 0x7f46a015c790 con 0x7f46a00b4f70 2024-04-17T08:47:01.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7f46a5200640 1 -- 172.21.15.152:0/3304281896 >> v1:172.21.15.196:6789/0 conn(0x7f46a00b4f70 legacy=0x7f46a015ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.274+0000 7f46a5200640 1 -- 172.21.15.152:0/3304281896 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46a00b4490 con 0x7f46a0155af0 2024-04-17T08:47:01.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.278+0000 7f46a5c00640 1 --2- 172.21.15.152:0/3304281896 >> v2:172.21.15.152:3300/0 conn(0x7f46a015c120 0x7f46a0073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:47:01.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.278+0000 7fc291000640 1 -- 172.21.15.152:0/1790428606 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc28c1fec50 con 0x7fc28c0afcd0 2024-04-17T08:47:01.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.278+0000 7fc291000640 1 -- 172.21.15.152:0/1790428606 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc28c1ff210 con 0x7fc28c0afcd0 2024-04-17T08:47:01.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.278+0000 7f4823400640 1 -- 172.21.15.152:0/209512760 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f480c001040 con 0x7f483815c540 2024-04-17T08:47:01.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.278+0000 7f31b3400640 1 --2- 172.21.15.152:0/1880165836 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3194068400 0x7f319406a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.278+0000 7fc282000640 1 -- 172.21.15.152:0/1790428606 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc284001cb0 con 0x7fc28c0afcd0 2024-04-17T08:47:01.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.278+0000 7fc282000640 1 -- 172.21.15.152:0/1790428606 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2840a6420 con 0x7fc28c0afcd0 2024-04-17T08:47:01.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.278+0000 7f60a2a00640 1 -- 172.21.15.152:0/61561983 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f60a40fecc0 con 0x7f60ac073ba0 2024-04-17T08:47:01.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.278+0000 7f584b400640 1 -- 172.21.15.152:0/387723471 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f58440b8070 con 0x7f58540736b0 2024-04-17T08:47:01.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.278+0000 7fc291000640 1 -- 172.21.15.152:0/1790428606 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc264001040 con 0x7fc28c0afcd0 2024-04-17T08:47:01.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.278+0000 7f46a5200640 1 --2- 172.21.15.152:0/3304281896 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f46a0155af0 0x7f46a0072d10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f46a0073b30 tx=0x7f468801c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f23945a35334965c server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.278+0000 7f60ab400640 1 --2- 172.21.15.152:0/61561983 >> [v2:172.21.15.152:6808/3826143898,v1:172.21.15.152:6809/3826143898] conn(0x7f608c071b50 0x7f608c073f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.278+0000 7f60aa000640 1 --2- 172.21.15.152:0/61561983 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f608c068450 0x7f608c06a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.278+0000 7f5848c00640 1 -- 172.21.15.152:0/387723471 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5854075c10 con 0x7f58540736b0 2024-04-17T08:47:01.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.278+0000 7f469f400640 1 -- 172.21.15.152:0/3304281896 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46880b0070 con 0x7f46a0155af0 2024-04-17T08:47:01.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.278+0000 7f469f400640 1 -- 172.21.15.152:0/3304281896 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46880ab600 con 0x7f46a0155af0 2024-04-17T08:47:01.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.278+0000 7f469f400640 1 -- 172.21.15.152:0/3304281896 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46880ab9d0 con 0x7f46a0155af0 2024-04-17T08:47:01.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.278+0000 7f584b400640 1 --2- 172.21.15.152:0/387723471 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5830068450 0x7f583006a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.278+0000 7f46a7c00640 1 -- 172.21.15.152:0/3304281896 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f46a0155af0 msgr2=0x7f46a0072d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.278+0000 7f46a7c00640 1 --2- 172.21.15.152:0/3304281896 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f46a0155af0 0x7f46a0072d10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f46a0073b30 tx=0x7f468801c560 comp rx=0 tx=0).stop 2024-04-17T08:47:01.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.278+0000 7fc282000640 1 -- 172.21.15.152:0/1790428606 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc2840a6640 con 0x7fc28c0afcd0 2024-04-17T08:47:01.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.278+0000 7f31ab400640 1 -- 172.21.15.152:0/1880165836 <== osd.0 v2:172.21.15.152:6817/3603799291 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f31ac020e50 con 0x7f3194071b70 2024-04-17T08:47:01.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.278+0000 7f46a7c00640 1 -- 172.21.15.152:0/3304281896 shutdown_connections 2024-04-17T08:47:01.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.282+0000 7f46a7c00640 1 --2- 172.21.15.152:0/3304281896 >> v2:172.21.15.152:3300/0 conn(0x7f46a015c120 0x7f46a0073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.282+0000 7f46a7c00640 1 --2- 172.21.15.152:0/3304281896 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f46a0155af0 0x7f46a0072d10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.282+0000 7f46a7c00640 1 -- 172.21.15.152:0/3304281896 >> 172.21.15.152:0/3304281896 conn(0x7f46a00b31c0 msgr2=0x7f46a00b35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:01.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.282+0000 7f6c66800640 1 --2- 172.21.15.152:0/553727746 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c68162ca0 0x7f6c680cd690 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6c580097c0 tx=0x7f6c5801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8938883c18106da4 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.278+0000 7f584b400640 1 -- 172.21.15.152:0/387723471 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f5844121000 con 0x7f58540736b0 2024-04-17T08:47:01.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.278+0000 7f584b400640 1 --2- 172.21.15.152:0/387723471 >> [v2:172.21.15.196:6816/4080159297,v1:172.21.15.196:6817/4080159297] conn(0x7f5830071b40 0x7f5830073f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.278+0000 7f584b400640 1 -- 172.21.15.152:0/387723471 --> [v2:172.21.15.196:6816/4080159297,v1:172.21.15.196:6817/4080159297] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f58440a7650 con 0x7f5830071b40 2024-04-17T08:47:01.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.278+0000 7f584b400640 1 -- 172.21.15.152:0/387723471 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f58440eccc0 con 0x7f58540736b0 2024-04-17T08:47:01.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.282+0000 7f5853e00640 1 --2- 172.21.15.152:0/387723471 >> [v2:172.21.15.196:6816/4080159297,v1:172.21.15.196:6817/4080159297] conn(0x7f5830071b40 0x7f5830073f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.282+0000 7f5853400640 1 --2- 172.21.15.152:0/387723471 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5830068450 0x7f583006a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.282+0000 7f46a7c00640 1 -- 172.21.15.152:0/3304281896 shutdown_connections 2024-04-17T08:47:01.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.282+0000 7f5853e00640 1 --2- 172.21.15.152:0/387723471 >> [v2:172.21.15.196:6816/4080159297,v1:172.21.15.196:6817/4080159297] conn(0x7f5830071b40 0x7f5830073f80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.282+0000 7fc282000640 1 --2- 172.21.15.152:0/1790428606 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc2680687b0 0x7fc26806ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.282+0000 7f60aa000640 1 --2- 172.21.15.152:0/61561983 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f608c068450 0x7f608c06a910 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f60ac15ea10 tx=0x7f609c007a50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.278+0000 7f482e000640 1 -- 172.21.15.152:0/209512760 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f482801a070 con 0x7f483815c540 2024-04-17T08:47:01.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.278+0000 7f482e000640 1 --2- 172.21.15.152:0/209512760 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f48180685b0 0x7f481806aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.282+0000 7fc282000640 1 -- 172.21.15.152:0/1790428606 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc2840b6070 con 0x7fc28c0afcd0 2024-04-17T08:47:01.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.282+0000 7f5853400640 1 --2- 172.21.15.152:0/387723471 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5830068450 0x7f583006a910 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f583c000f70 tx=0x7f583c0059d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.282+0000 7f46a7c00640 1 -- 172.21.15.152:0/3304281896 wait complete. 2024-04-17T08:47:01.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.282+0000 7fc282000640 1 --2- 172.21.15.152:0/1790428606 >> [v2:172.21.15.196:6800/3519444232,v1:172.21.15.196:6801/3519444232] conn(0x7fc268071e30 0x7fc268074270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.282+0000 7fc282000640 1 -- 172.21.15.152:0/1790428606 --> [v2:172.21.15.196:6800/3519444232,v1:172.21.15.196:6801/3519444232] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc268074940 con 0x7fc268071e30 2024-04-17T08:47:01.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.282+0000 7fc282000640 1 -- 172.21.15.152:0/1790428606 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc2841242c0 con 0x7fc28c0afcd0 2024-04-17T08:47:01.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.282+0000 7fc289400640 1 --2- 172.21.15.152:0/1790428606 >> [v2:172.21.15.196:6800/3519444232,v1:172.21.15.196:6801/3519444232] conn(0x7fc268071e30 0x7fc268074270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.282+0000 7f6c65400640 1 -- 172.21.15.152:0/553727746 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c580b0070 con 0x7f6c68162ca0 2024-04-17T08:47:01.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.282+0000 7f6c65400640 1 -- 172.21.15.152:0/553727746 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c58004230 con 0x7f6c68162ca0 2024-04-17T08:47:01.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.282+0000 7f6c65400640 1 -- 172.21.15.152:0/553727746 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c58003620 con 0x7f6c68162ca0 2024-04-17T08:47:01.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.282+0000 7f482e000640 1 -- 172.21.15.152:0/209512760 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f48280537d0 con 0x7f483815c540 2024-04-17T08:47:01.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.282+0000 7f482e000640 1 --2- 172.21.15.152:0/209512760 >> [v2:172.21.15.152:6816/165717826,v1:172.21.15.152:6818/165717826] conn(0x7f48180729c0 0x7f4818074e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.282+0000 7f482e000640 1 -- 172.21.15.152:0/209512760 --> [v2:172.21.15.152:6816/165717826,v1:172.21.15.152:6818/165717826] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4818075530 con 0x7f48180729c0 2024-04-17T08:47:01.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.282+0000 7f31b3400640 1 --2- 172.21.15.152:0/1880165836 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3194068400 0x7f319406a8c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f31a40ad000 tx=0x7f31a40a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.282+0000 7f482e000640 1 -- 172.21.15.152:0/209512760 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4828052160 con 0x7f483815c540 2024-04-17T08:47:01.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.282+0000 7f584b400640 1 -- 172.21.15.152:0/387723471 <== osd.4 v2:172.21.15.196:6816/4080159297 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f58440a7650 con 0x7f5830071b40 2024-04-17T08:47:01.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.282+0000 7f4835e00640 1 --2- 172.21.15.152:0/209512760 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f48180685b0 0x7f481806aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.282+0000 7f4835400640 1 --2- 172.21.15.152:0/209512760 >> [v2:172.21.15.152:6816/165717826,v1:172.21.15.152:6818/165717826] conn(0x7f48180729c0 0x7f4818074e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.282+0000 7fc289400640 1 --2- 172.21.15.152:0/1790428606 >> [v2:172.21.15.196:6800/3519444232,v1:172.21.15.196:6801/3519444232] conn(0x7fc268071e30 0x7fc268074270 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.282+0000 7f60ab400640 1 --2- 172.21.15.152:0/61561983 >> [v2:172.21.15.152:6808/3826143898,v1:172.21.15.152:6809/3826143898] conn(0x7f608c071b50 0x7f608c073f90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.282+0000 7f6c6d400640 1 -- 172.21.15.152:0/553727746 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c68162ca0 msgr2=0x7f6c680cd690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.282+0000 7f6c6d400640 1 --2- 172.21.15.152:0/553727746 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c68162ca0 0x7f6c680cd690 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6c580097c0 tx=0x7f6c5801c460 comp rx=0 tx=0).stop 2024-04-17T08:47:01.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.282+0000 7f6c6d400640 1 -- 172.21.15.152:0/553727746 shutdown_connections 2024-04-17T08:47:01.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.282+0000 7f6c6d400640 1 --2- 172.21.15.152:0/553727746 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c680c38b0 0x7f6c680d0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.282+0000 7f6c6d400640 1 --2- 172.21.15.152:0/553727746 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c68162ca0 0x7f6c680cd690 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.282+0000 7f6c6d400640 1 -- 172.21.15.152:0/553727746 >> 172.21.15.152:0/553727746 conn(0x7f6c680b51e0 msgr2=0x7f6c680b55f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:01.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.282+0000 7f6c6d400640 1 -- 172.21.15.152:0/553727746 shutdown_connections 2024-04-17T08:47:01.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.282+0000 7f6c6d400640 1 -- 172.21.15.152:0/553727746 wait complete. 2024-04-17T08:47:01.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.282+0000 7f4835400640 1 --2- 172.21.15.152:0/209512760 >> [v2:172.21.15.152:6816/165717826,v1:172.21.15.152:6818/165717826] conn(0x7f48180729c0 0x7f4818074e60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.282+0000 7fc282000640 1 -- 172.21.15.152:0/1790428606 <== osd.5 v2:172.21.15.196:6800/3519444232 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc268074940 con 0x7fc268071e30 2024-04-17T08:47:01.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.286+0000 7f4835e00640 1 --2- 172.21.15.152:0/209512760 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f48180685b0 0x7f481806aa70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f48300b2000 tx=0x7f48300ab070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.286+0000 7f482e000640 1 -- 172.21.15.152:0/209512760 <== osd.3 v2:172.21.15.152:6816/165717826 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4818075530 con 0x7f48180729c0 2024-04-17T08:47:01.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.286+0000 7fc289e00640 1 --2- 172.21.15.152:0/1790428606 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc2680687b0 0x7fc26806ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.286+0000 7fc289e00640 1 --2- 172.21.15.152:0/1790428606 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc2680687b0 0x7fc26806ac70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc27c0011f0 tx=0x7fc27c001980 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.286+0000 7f46a7c00640 1 Processor -- start 2024-04-17T08:47:01.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.286+0000 7f46a7c00640 1 -- start start 2024-04-17T08:47:01.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.286+0000 7f6c6d400640 1 Processor -- start 2024-04-17T08:47:01.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.286+0000 7f60a2a00640 1 -- 172.21.15.152:0/61561983 <== osd.2 v2:172.21.15.152:6808/3826143898 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f60a40aee50 con 0x7f608c071b50 2024-04-17T08:47:01.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.286+0000 7f46a7c00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46a00b4f70 0x7f46a01544a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.286+0000 7f46a7c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f46a0155af0 0x7f46a014d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.286+0000 7f46a7c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f46a015c120 0x7f46a014db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.286+0000 7f46a7c00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f46a00cf9e0 con 0x7f46a00b4f70 2024-04-17T08:47:01.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.286+0000 7f46a7c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f46a00cf860 con 0x7f46a015c120 2024-04-17T08:47:01.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.286+0000 7f46a7c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f46a00cfb60 con 0x7f46a0155af0 2024-04-17T08:47:01.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.286+0000 7f6c6d400640 1 -- start start 2024-04-17T08:47:01.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.290+0000 7f6c6d400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c680c38b0 0x7f6c6815dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.290+0000 7f6c6d400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6c68162ca0 0x7f6c68158cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.290+0000 7f6c6d400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c680ceef0 0x7f6c68159200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.290+0000 7f6c66800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c680c38b0 0x7f6c6815dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.290+0000 7f469fe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f46a0155af0 0x7f46a014d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.290+0000 7f469fe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f46a0155af0 0x7f46a014d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.152:33494/0 (socket says 172.21.15.152:33494) 2024-04-17T08:47:01.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.290+0000 7f469fe00640 1 -- 172.21.15.152:0/4230022665 learned_addr learned my addr 172.21.15.152:0/4230022665 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:01.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.290+0000 7f46a5c00640 1 --2- 172.21.15.152:0/4230022665 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f46a015c120 0x7f46a014db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.290+0000 7f46a5200640 1 --2- 172.21.15.152:0/4230022665 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46a00b4f70 0x7f46a01544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.290+0000 7f469fe00640 1 -- 172.21.15.152:0/4230022665 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f46a015c120 msgr2=0x7f46a014db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.290+0000 7f469fe00640 1 --2- 172.21.15.152:0/4230022665 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f46a015c120 0x7f46a014db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.290+0000 7f469fe00640 1 -- 172.21.15.152:0/4230022665 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46a00b4f70 msgr2=0x7f46a01544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.290+0000 7f469fe00640 1 --2- 172.21.15.152:0/4230022665 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46a00b4f70 0x7f46a01544a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.290+0000 7f469fe00640 1 -- 172.21.15.152:0/4230022665 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46a01526a0 con 0x7f46a0155af0 2024-04-17T08:47:01.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.290+0000 7f46a5c00640 1 --2- 172.21.15.152:0/4230022665 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f46a015c120 0x7f46a014db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T08:47:01.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.290+0000 7f6c65e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6c68162ca0 0x7f6c68158cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.290+0000 7f6c65e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6c68162ca0 0x7f6c68158cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.152:41274/0 (socket says 172.21.15.152:41274) 2024-04-17T08:47:01.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.290+0000 7f6c67200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c680ceef0 0x7f6c68159200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.290+0000 7f6c67200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c680ceef0 0x7f6c68159200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.152:33498/0 (socket says 172.21.15.152:33498) 2024-04-17T08:47:01.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.290+0000 7f6c65e00640 1 -- 172.21.15.152:0/743426656 learned_addr learned my addr 172.21.15.152:0/743426656 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:01.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.290+0000 7f6c6d400640 1 -- 172.21.15.152:0/743426656 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6806c590 con 0x7f6c680c38b0 2024-04-17T08:47:01.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.290+0000 7f6c6d400640 1 -- 172.21.15.152:0/743426656 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6806c410 con 0x7f6c68162ca0 2024-04-17T08:47:01.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.290+0000 7f6c6d400640 1 -- 172.21.15.152:0/743426656 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f6c6806c710 con 0x7f6c680ceef0 2024-04-17T08:47:01.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.290+0000 7f469fe00640 1 --2- 172.21.15.152:0/4230022665 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f46a0155af0 0x7f46a014d350 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f469800c4b0 tx=0x7f469800c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.290+0000 7f469cc00640 1 -- 172.21.15.152:0/4230022665 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4698005480 con 0x7f46a0155af0 2024-04-17T08:47:01.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.290+0000 7f469cc00640 1 -- 172.21.15.152:0/4230022665 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4698003600 con 0x7f46a0155af0 2024-04-17T08:47:01.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.290+0000 7f469cc00640 1 -- 172.21.15.152:0/4230022665 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46980039f0 con 0x7f46a0155af0 2024-04-17T08:47:01.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.290+0000 7f6c65e00640 1 -- 172.21.15.152:0/743426656 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c680ceef0 msgr2=0x7f6c68159200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.290+0000 7f6c65e00640 1 --2- 172.21.15.152:0/743426656 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c680ceef0 0x7f6c68159200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.290+0000 7f6c65e00640 1 -- 172.21.15.152:0/743426656 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c680c38b0 msgr2=0x7f6c6815dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.290+0000 7f6c65e00640 1 --2- 172.21.15.152:0/743426656 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c680c38b0 0x7f6c6815dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.290+0000 7f6c65e00640 1 -- 172.21.15.152:0/743426656 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c680c7750 con 0x7f6c68162ca0 2024-04-17T08:47:01.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.290+0000 7f6c67200640 1 --2- 172.21.15.152:0/743426656 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c680ceef0 0x7f6c68159200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T08:47:01.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.294+0000 7f46a7c00640 1 -- 172.21.15.152:0/4230022665 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46a0152980 con 0x7f46a0155af0 2024-04-17T08:47:01.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.294+0000 7f46a7c00640 1 -- 172.21.15.152:0/4230022665 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f46a0152f40 con 0x7f46a0155af0 2024-04-17T08:47:01.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.294+0000 7f46a7c00640 1 -- 172.21.15.152:0/4230022665 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f46a0068a30 con 0x7f46a0155af0 2024-04-17T08:47:01.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.294+0000 7f6c65e00640 1 --2- 172.21.15.152:0/743426656 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6c68162ca0 0x7f6c68158cc0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6c5400c4d0 tx=0x7f6c5400c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.294+0000 7f6c5ea00640 1 -- 172.21.15.152:0/743426656 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c54018070 con 0x7f6c68162ca0 2024-04-17T08:47:01.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.294+0000 7f6c5ea00640 1 -- 172.21.15.152:0/743426656 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c540075a0 con 0x7f6c68162ca0 2024-04-17T08:47:01.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.294+0000 7f6c5ea00640 1 -- 172.21.15.152:0/743426656 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c54004a30 con 0x7f6c68162ca0 2024-04-17T08:47:01.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.294+0000 7f6c6d400640 1 -- 172.21.15.152:0/743426656 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c680c7a30 con 0x7f6c68162ca0 2024-04-17T08:47:01.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.294+0000 7f6c6d400640 1 -- 172.21.15.152:0/743426656 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c680c7ff0 con 0x7f6c68162ca0 2024-04-17T08:47:01.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.298+0000 7f6c5ea00640 1 -- 172.21.15.152:0/743426656 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6c5401b070 con 0x7f6c68162ca0 2024-04-17T08:47:01.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.302+0000 7f6c6d400640 1 -- 172.21.15.152:0/743426656 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6c680c7500 con 0x7f6c68162ca0 2024-04-17T08:47:01.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.302+0000 7f6c5ea00640 1 --2- 172.21.15.152:0/743426656 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f6c48068450 0x7f6c4806a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.302+0000 7f6c5ea00640 1 -- 172.21.15.152:0/743426656 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f6c540860a0 con 0x7f6c68162ca0 2024-04-17T08:47:01.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.302+0000 7f6c5ea00640 1 --2- 172.21.15.152:0/743426656 >> [v2:172.21.15.196:6808/275739834,v1:172.21.15.196:6809/275739834] conn(0x7f6c48071b50 0x7f6c48073f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.302+0000 7f6c5ea00640 1 -- 172.21.15.152:0/743426656 --> [v2:172.21.15.196:6808/275739834,v1:172.21.15.196:6809/275739834] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6c5401ce50 con 0x7f6c48071b50 2024-04-17T08:47:01.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.298+0000 7f469cc00640 1 -- 172.21.15.152:0/4230022665 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4698003b90 con 0x7f46a0155af0 2024-04-17T08:47:01.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.302+0000 7f469cc00640 1 --2- 172.21.15.152:0/4230022665 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f467c0683d0 0x7f467c06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.302+0000 7f469cc00640 1 -- 172.21.15.152:0/4230022665 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4698086870 con 0x7f46a0155af0 2024-04-17T08:47:01.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.302+0000 7f469cc00640 1 --2- 172.21.15.152:0/4230022665 >> [v2:172.21.15.196:6824/307626968,v1:172.21.15.196:6825/307626968] conn(0x7f467c071ac0 0x7f467c073f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.302+0000 7f469cc00640 1 -- 172.21.15.152:0/4230022665 --> [v2:172.21.15.196:6824/307626968,v1:172.21.15.196:6825/307626968] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f467c0745d0 con 0x7f467c071ac0 2024-04-17T08:47:01.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.302+0000 7f6c67200640 1 --2- 172.21.15.152:0/743426656 >> [v2:172.21.15.196:6808/275739834,v1:172.21.15.196:6809/275739834] conn(0x7f6c48071b50 0x7f6c48073f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.302+0000 7f469cc00640 1 -- 172.21.15.152:0/4230022665 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f469808d050 con 0x7f46a0155af0 2024-04-17T08:47:01.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.302+0000 7f46a5c00640 1 --2- 172.21.15.152:0/4230022665 >> [v2:172.21.15.196:6824/307626968,v1:172.21.15.196:6825/307626968] conn(0x7f467c071ac0 0x7f467c073f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.302+0000 7f46a5200640 1 --2- 172.21.15.152:0/4230022665 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f467c0683d0 0x7f467c06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.302+0000 7f6c66800640 1 --2- 172.21.15.152:0/743426656 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f6c48068450 0x7f6c4806a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.302+0000 7f6c67200640 1 --2- 172.21.15.152:0/743426656 >> [v2:172.21.15.196:6808/275739834,v1:172.21.15.196:6809/275739834] conn(0x7f6c48071b50 0x7f6c48073f90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.306+0000 7f6c5ea00640 1 -- 172.21.15.152:0/743426656 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6c54051f50 con 0x7f6c68162ca0 2024-04-17T08:47:01.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.306+0000 7f6c5ea00640 1 -- 172.21.15.152:0/743426656 <== osd.6 v2:172.21.15.196:6808/275739834 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6c5401ce50 con 0x7f6c48071b50 2024-04-17T08:47:01.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.302+0000 7f46a5c00640 1 --2- 172.21.15.152:0/4230022665 >> [v2:172.21.15.196:6824/307626968,v1:172.21.15.196:6825/307626968] conn(0x7f467c071ac0 0x7f467c073f00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.306+0000 7f46a5200640 1 --2- 172.21.15.152:0/4230022665 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f467c0683d0 0x7f467c06a890 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f46a0073b30 tx=0x7f4688008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.306+0000 7f6857e00640 1 -- 172.21.15.152:0/3728925742 --> [v2:172.21.15.152:6800/4133383142,v1:172.21.15.152:6801/4133383142] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6840002de0 con 0x7f684c071b00 2024-04-17T08:47:01.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.306+0000 7f6c66800640 1 --2- 172.21.15.152:0/743426656 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f6c48068450 0x7f6c4806a910 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6c580ad000 tx=0x7f6c58008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.306+0000 7f6862a00640 1 -- 172.21.15.152:0/3728925742 <== osd.1 v2:172.21.15.152:6800/4133383142 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6840002de0 con 0x7f684c071b00 2024-04-17T08:47:01.328 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.306+0000 7f6857e00640 1 -- 172.21.15.152:0/3728925742 >> [v2:172.21.15.152:6800/4133383142,v1:172.21.15.152:6801/4133383142] conn(0x7f684c071b00 msgr2=0x7f684c073f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.328 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.306+0000 7f6857e00640 1 --2- 172.21.15.152:0/3728925742 >> [v2:172.21.15.152:6800/4133383142,v1:172.21.15.152:6801/4133383142] conn(0x7f684c071b00 0x7f684c073f40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.328 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.306+0000 7f469cc00640 1 -- 172.21.15.152:0/4230022665 <== osd.7 v2:172.21.15.196:6824/307626968 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f467c0745d0 con 0x7f467c071ac0 2024-04-17T08:47:01.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.306+0000 7f6857e00640 1 -- 172.21.15.152:0/3728925742 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f684c068380 msgr2=0x7f684c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.306+0000 7f6857e00640 1 --2- 172.21.15.152:0/3728925742 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f684c068380 0x7f684c06a840 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f686400a6e0 tx=0x7f6858008040 comp rx=0 tx=0).stop 2024-04-17T08:47:01.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.306+0000 7f6857e00640 1 -- 172.21.15.152:0/3728925742 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6864055d20 msgr2=0x7f686404b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.306+0000 7f6857e00640 1 --2- 172.21.15.152:0/3728925742 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6864055d20 0x7f686404b7c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f685c0ae040 tx=0x7f685c01ac60 comp rx=0 tx=0).stop 2024-04-17T08:47:01.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.306+0000 7f6870a00640 1 -- 172.21.15.152:0/3728925742 reap_dead start 2024-04-17T08:47:01.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.310+0000 7f6857e00640 1 -- 172.21.15.152:0/3728925742 shutdown_connections 2024-04-17T08:47:01.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.310+0000 7f6857e00640 1 -- 172.21.15.152:0/3728925742 >> 172.21.15.152:0/3728925742 conn(0x7f6864056ec0 msgr2=0x7f68640528e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:01.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.310+0000 7f6857e00640 1 -- 172.21.15.152:0/3728925742 shutdown_connections 2024-04-17T08:47:01.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.310+0000 7f6857e00640 1 -- 172.21.15.152:0/3728925742 wait complete. 2024-04-17T08:47:01.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.310+0000 7f31ba800640 1 -- 172.21.15.152:0/1880165836 --> [v2:172.21.15.152:6817/3603799291,v1:172.21.15.152:6819/3603799291] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f31b41661f0 con 0x7f3194071b70 2024-04-17T08:47:01.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.310+0000 7f31ab400640 1 -- 172.21.15.152:0/1880165836 <== osd.0 v2:172.21.15.152:6817/3603799291 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f31b41661f0 con 0x7f3194071b70 2024-04-17T08:47:01.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.310+0000 7f31ba800640 1 -- 172.21.15.152:0/1880165836 >> [v2:172.21.15.152:6817/3603799291,v1:172.21.15.152:6819/3603799291] conn(0x7f3194071b70 msgr2=0x7f3194073fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.310+0000 7f31ba800640 1 --2- 172.21.15.152:0/1880165836 >> [v2:172.21.15.152:6817/3603799291,v1:172.21.15.152:6819/3603799291] conn(0x7f3194071b70 0x7f3194073fb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.310+0000 7f31ba800640 1 -- 172.21.15.152:0/1880165836 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3194068400 msgr2=0x7f319406a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.310+0000 7f31ba800640 1 --2- 172.21.15.152:0/1880165836 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3194068400 0x7f319406a8c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f31a40ad000 tx=0x7f31a40a6000 comp rx=0 tx=0).stop 2024-04-17T08:47:01.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.310+0000 7f31ba800640 1 -- 172.21.15.152:0/1880165836 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f31b41632e0 msgr2=0x7f31b40b2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.310+0000 7f31ba800640 1 --2- 172.21.15.152:0/1880165836 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f31b41632e0 0x7f31b40b2530 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f31ac00be50 tx=0x7f31ac00bf40 comp rx=0 tx=0).stop 2024-04-17T08:47:01.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.310+0000 7f31b3e00640 1 -- 172.21.15.152:0/1880165836 reap_dead start 2024-04-17T08:47:01.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.314+0000 7f31ba800640 1 -- 172.21.15.152:0/1880165836 shutdown_connections 2024-04-17T08:47:01.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.314+0000 7f31ba800640 1 -- 172.21.15.152:0/1880165836 >> 172.21.15.152:0/1880165836 conn(0x7f31b40b51e0 msgr2=0x7f31b40af070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:01.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.314+0000 7f4823400640 1 -- 172.21.15.152:0/209512760 --> [v2:172.21.15.152:6816/165717826,v1:172.21.15.152:6818/165717826] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f480c002de0 con 0x7f48180729c0 2024-04-17T08:47:01.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.314+0000 7f31ba800640 1 -- 172.21.15.152:0/1880165836 shutdown_connections 2024-04-17T08:47:01.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.314+0000 7f31ba800640 1 -- 172.21.15.152:0/1880165836 wait complete. 2024-04-17T08:47:01.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.314+0000 7f482e000640 1 -- 172.21.15.152:0/209512760 <== osd.3 v2:172.21.15.152:6816/165717826 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f480c002de0 con 0x7f48180729c0 2024-04-17T08:47:01.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.314+0000 7f4823400640 1 -- 172.21.15.152:0/209512760 >> [v2:172.21.15.152:6816/165717826,v1:172.21.15.152:6818/165717826] conn(0x7f48180729c0 msgr2=0x7f4818074e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.314+0000 7f5848c00640 1 -- 172.21.15.152:0/387723471 --> [v2:172.21.15.196:6816/4080159297,v1:172.21.15.196:6817/4080159297] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f58540cc570 con 0x7f5830071b40 2024-04-17T08:47:01.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.314+0000 7f4823400640 1 --2- 172.21.15.152:0/209512760 >> [v2:172.21.15.152:6816/165717826,v1:172.21.15.152:6818/165717826] conn(0x7f48180729c0 0x7f4818074e60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.314+0000 7f4823400640 1 -- 172.21.15.152:0/209512760 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f48180685b0 msgr2=0x7f481806aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.314+0000 7f4823400640 1 --2- 172.21.15.152:0/209512760 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f48180685b0 0x7f481806aa70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f48300b2000 tx=0x7f48300ab070 comp rx=0 tx=0).stop 2024-04-17T08:47:01.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.314+0000 7f4823400640 1 -- 172.21.15.152:0/209512760 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f483815c540 msgr2=0x7f4838152010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.314+0000 7f4823400640 1 --2- 172.21.15.152:0/209512760 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f483815c540 0x7f4838152010 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f482800c3e0 tx=0x7f482800c8a0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.314+0000 7fc291000640 1 -- 172.21.15.152:0/1790428606 --> [v2:172.21.15.196:6800/3519444232,v1:172.21.15.196:6801/3519444232] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc264002de0 con 0x7fc268071e30 2024-04-17T08:47:01.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.314+0000 7f4836800640 1 -- 172.21.15.152:0/209512760 reap_dead start 2024-04-17T08:47:01.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.314+0000 7f4823400640 1 -- 172.21.15.152:0/209512760 shutdown_connections 2024-04-17T08:47:01.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.314+0000 7f4823400640 1 -- 172.21.15.152:0/209512760 >> 172.21.15.152:0/209512760 conn(0x7f48380b51e0 msgr2=0x7f48380ae220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:01.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.314+0000 7f584b400640 1 -- 172.21.15.152:0/387723471 <== osd.4 v2:172.21.15.196:6816/4080159297 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f58540cc570 con 0x7f5830071b40 2024-04-17T08:47:01.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.314+0000 7f4823400640 1 -- 172.21.15.152:0/209512760 shutdown_connections 2024-04-17T08:47:01.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.318+0000 7f4823400640 1 -- 172.21.15.152:0/209512760 wait complete. 2024-04-17T08:47:01.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.318+0000 7f5848c00640 1 -- 172.21.15.152:0/387723471 >> [v2:172.21.15.196:6816/4080159297,v1:172.21.15.196:6817/4080159297] conn(0x7f5830071b40 msgr2=0x7f5830073f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.318+0000 7f5848c00640 1 --2- 172.21.15.152:0/387723471 >> [v2:172.21.15.196:6816/4080159297,v1:172.21.15.196:6817/4080159297] conn(0x7f5830071b40 0x7f5830073f80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.318+0000 7f5848c00640 1 -- 172.21.15.152:0/387723471 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5830068450 msgr2=0x7f583006a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.318+0000 7f5848c00640 1 --2- 172.21.15.152:0/387723471 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5830068450 0x7f583006a910 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f583c000f70 tx=0x7f583c0059d0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.318+0000 7fc282000640 1 -- 172.21.15.152:0/1790428606 <== osd.5 v2:172.21.15.196:6800/3519444232 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc264002de0 con 0x7fc268071e30 2024-04-17T08:47:01.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.318+0000 7f60b1800640 1 -- 172.21.15.152:0/61561983 --> [v2:172.21.15.152:6808/3826143898,v1:172.21.15.152:6809/3826143898] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f60ac15bcd0 con 0x7f608c071b50 2024-04-17T08:47:01.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.318+0000 7f5848c00640 1 -- 172.21.15.152:0/387723471 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f58540736b0 msgr2=0x7f58540cd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.318+0000 7f5848c00640 1 --2- 172.21.15.152:0/387723471 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f58540736b0 0x7f58540cd220 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f584401a2b0 tx=0x7f584401a440 comp rx=0 tx=0).stop 2024-04-17T08:47:01.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.318+0000 7f5853e00640 1 -- 172.21.15.152:0/387723471 reap_dead start 2024-04-17T08:47:01.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.318+0000 7f5848c00640 1 -- 172.21.15.152:0/387723471 shutdown_connections 2024-04-17T08:47:01.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.318+0000 7f5848c00640 1 -- 172.21.15.152:0/387723471 >> 172.21.15.152:0/387723471 conn(0x7f58540d0050 msgr2=0x7f5854072080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:01.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.318+0000 7f60a2a00640 1 -- 172.21.15.152:0/61561983 <== osd.2 v2:172.21.15.152:6808/3826143898 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f60ac15bcd0 con 0x7f608c071b50 2024-04-17T08:47:01.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.318+0000 7fc291000640 1 -- 172.21.15.152:0/1790428606 >> [v2:172.21.15.196:6800/3519444232,v1:172.21.15.196:6801/3519444232] conn(0x7fc268071e30 msgr2=0x7fc268074270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.318+0000 7fc291000640 1 --2- 172.21.15.152:0/1790428606 >> [v2:172.21.15.196:6800/3519444232,v1:172.21.15.196:6801/3519444232] conn(0x7fc268071e30 0x7fc268074270 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.318+0000 7fc291000640 1 -- 172.21.15.152:0/1790428606 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc2680687b0 msgr2=0x7fc26806ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.318+0000 7fc291000640 1 --2- 172.21.15.152:0/1790428606 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc2680687b0 0x7fc26806ac70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc27c0011f0 tx=0x7fc27c001980 comp rx=0 tx=0).stop 2024-04-17T08:47:01.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.318+0000 7fc291000640 1 -- 172.21.15.152:0/1790428606 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc28c0afcd0 msgr2=0x7fc28c0b0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.318+0000 7fc291000640 1 --2- 172.21.15.152:0/1790428606 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc28c0afcd0 0x7fc28c0b0150 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc28401ce20 tx=0x7fc270005840 comp rx=0 tx=0).stop 2024-04-17T08:47:01.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.318+0000 7fc28a800640 1 -- 172.21.15.152:0/1790428606 reap_dead start 2024-04-17T08:47:01.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.318+0000 7fc291000640 1 -- 172.21.15.152:0/1790428606 shutdown_connections 2024-04-17T08:47:01.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.318+0000 7fc291000640 1 -- 172.21.15.152:0/1790428606 >> 172.21.15.152:0/1790428606 conn(0x7fc28c0b3350 msgr2=0x7fc28c0b0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:01.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.318+0000 7f5848c00640 1 -- 172.21.15.152:0/387723471 shutdown_connections 2024-04-17T08:47:01.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.318+0000 7f5848c00640 1 -- 172.21.15.152:0/387723471 wait complete. 2024-04-17T08:47:01.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.318+0000 7fc291000640 1 -- 172.21.15.152:0/1790428606 shutdown_connections 2024-04-17T08:47:01.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.318+0000 7fc291000640 1 -- 172.21.15.152:0/1790428606 wait complete. 2024-04-17T08:47:01.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.326+0000 7f60b1800640 1 -- 172.21.15.152:0/61561983 >> [v2:172.21.15.152:6808/3826143898,v1:172.21.15.152:6809/3826143898] conn(0x7f608c071b50 msgr2=0x7f608c073f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.326+0000 7f60b1800640 1 --2- 172.21.15.152:0/61561983 >> [v2:172.21.15.152:6808/3826143898,v1:172.21.15.152:6809/3826143898] conn(0x7f608c071b50 0x7f608c073f90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.326+0000 7f60b1800640 1 -- 172.21.15.152:0/61561983 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f608c068450 msgr2=0x7f608c06a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.326+0000 7f60b1800640 1 --2- 172.21.15.152:0/61561983 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f608c068450 0x7f608c06a910 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f60ac15ea10 tx=0x7f609c007a50 comp rx=0 tx=0).stop 2024-04-17T08:47:01.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.326+0000 7f60b1800640 1 -- 172.21.15.152:0/61561983 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f60ac073ba0 msgr2=0x7f60ac099a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.326+0000 7f60b1800640 1 --2- 172.21.15.152:0/61561983 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f60ac073ba0 0x7f60ac099a40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f60a4019420 tx=0x7f60a40195b0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.326+0000 7f60ab400640 1 -- 172.21.15.152:0/61561983 reap_dead start 2024-04-17T08:47:01.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.326+0000 7f60b1800640 1 -- 172.21.15.152:0/61561983 shutdown_connections 2024-04-17T08:47:01.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.326+0000 7f60b1800640 1 -- 172.21.15.152:0/61561983 >> 172.21.15.152:0/61561983 conn(0x7f60ac073080 msgr2=0x7f60ac06ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:01.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.326+0000 7f60b1800640 1 -- 172.21.15.152:0/61561983 shutdown_connections 2024-04-17T08:47:01.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.326+0000 7f60b1800640 1 -- 172.21.15.152:0/61561983 wait complete. 2024-04-17T08:47:01.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.326+0000 7f6c6d400640 1 -- 172.21.15.152:0/743426656 --> [v2:172.21.15.196:6808/275739834,v1:172.21.15.196:6809/275739834] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6c68075be0 con 0x7f6c48071b50 2024-04-17T08:47:01.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.330+0000 7f6c5ea00640 1 -- 172.21.15.152:0/743426656 <== osd.6 v2:172.21.15.196:6808/275739834 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6c68075be0 con 0x7f6c48071b50 2024-04-17T08:47:01.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.330+0000 7f6c6d400640 1 -- 172.21.15.152:0/743426656 >> [v2:172.21.15.196:6808/275739834,v1:172.21.15.196:6809/275739834] conn(0x7f6c48071b50 msgr2=0x7f6c48073f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.330+0000 7f6c6d400640 1 --2- 172.21.15.152:0/743426656 >> [v2:172.21.15.196:6808/275739834,v1:172.21.15.196:6809/275739834] conn(0x7f6c48071b50 0x7f6c48073f90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.330+0000 7f6c6d400640 1 -- 172.21.15.152:0/743426656 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f6c48068450 msgr2=0x7f6c4806a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.330+0000 7f6c6d400640 1 --2- 172.21.15.152:0/743426656 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f6c48068450 0x7f6c4806a910 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6c580ad000 tx=0x7f6c58008040 comp rx=0 tx=0).stop 2024-04-17T08:47:01.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.330+0000 7f6c6d400640 1 -- 172.21.15.152:0/743426656 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6c68162ca0 msgr2=0x7f6c68158cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.330+0000 7f6c6d400640 1 --2- 172.21.15.152:0/743426656 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6c68162ca0 0x7f6c68158cc0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6c5400c4d0 tx=0x7f6c5400c990 comp rx=0 tx=0).stop 2024-04-17T08:47:01.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.330+0000 7f6c67200640 1 -- 172.21.15.152:0/743426656 reap_dead start 2024-04-17T08:47:01.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.330+0000 7f6c6d400640 1 -- 172.21.15.152:0/743426656 shutdown_connections 2024-04-17T08:47:01.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.330+0000 7f6c6d400640 1 -- 172.21.15.152:0/743426656 >> 172.21.15.152:0/743426656 conn(0x7f6c680b51e0 msgr2=0x7f6c6815b910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:01.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.334+0000 7f6c6d400640 1 -- 172.21.15.152:0/743426656 shutdown_connections 2024-04-17T08:47:01.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.334+0000 7f6c6d400640 1 -- 172.21.15.152:0/743426656 wait complete. 2024-04-17T08:47:01.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.334+0000 7f46a7c00640 1 -- 172.21.15.152:0/4230022665 --> [v2:172.21.15.196:6824/307626968,v1:172.21.15.196:6825/307626968] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f46a00b2d60 con 0x7f467c071ac0 2024-04-17T08:47:01.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.334+0000 7f469cc00640 1 -- 172.21.15.152:0/4230022665 <== osd.7 v2:172.21.15.196:6824/307626968 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f46a00b2d60 con 0x7f467c071ac0 2024-04-17T08:47:01.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.338+0000 7f46a7c00640 1 -- 172.21.15.152:0/4230022665 >> [v2:172.21.15.196:6824/307626968,v1:172.21.15.196:6825/307626968] conn(0x7f467c071ac0 msgr2=0x7f467c073f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.338+0000 7f46a7c00640 1 --2- 172.21.15.152:0/4230022665 >> [v2:172.21.15.196:6824/307626968,v1:172.21.15.196:6825/307626968] conn(0x7f467c071ac0 0x7f467c073f00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.338+0000 7f46a7c00640 1 -- 172.21.15.152:0/4230022665 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f467c0683d0 msgr2=0x7f467c06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.338+0000 7f46a7c00640 1 --2- 172.21.15.152:0/4230022665 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f467c0683d0 0x7f467c06a890 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f46a0073b30 tx=0x7f4688008040 comp rx=0 tx=0).stop 2024-04-17T08:47:01.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.338+0000 7f46a7c00640 1 -- 172.21.15.152:0/4230022665 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f46a0155af0 msgr2=0x7f46a014d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.338+0000 7f46a7c00640 1 --2- 172.21.15.152:0/4230022665 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f46a0155af0 0x7f46a014d350 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f469800c4b0 tx=0x7f469800c970 comp rx=0 tx=0).stop 2024-04-17T08:47:01.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.338+0000 7f46a5c00640 1 -- 172.21.15.152:0/4230022665 reap_dead start 2024-04-17T08:47:01.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.338+0000 7f46a7c00640 1 -- 172.21.15.152:0/4230022665 shutdown_connections 2024-04-17T08:47:01.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.338+0000 7f46a7c00640 1 -- 172.21.15.152:0/4230022665 >> 172.21.15.152:0/4230022665 conn(0x7f46a00b31c0 msgr2=0x7f46a0154df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:01.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.338+0000 7f46a7c00640 1 -- 172.21.15.152:0/4230022665 shutdown_connections 2024-04-17T08:47:01.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.338+0000 7f46a7c00640 1 -- 172.21.15.152:0/4230022665 wait complete. 2024-04-17T08:47:01.361 INFO:teuthology.orchestra.run.smithi152.stdout:55834574859 2024-04-17T08:47:01.361 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-17T08:47:01.369 INFO:teuthology.orchestra.run.smithi152.stdout:55834574857 2024-04-17T08:47:01.369 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-17T08:47:01.370 INFO:teuthology.orchestra.run.smithi152.stdout:55834574859 2024-04-17T08:47:01.370 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-17T08:47:01.371 INFO:teuthology.orchestra.run.smithi152.stdout:55834574858 2024-04-17T08:47:01.372 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-17T08:47:01.372 INFO:teuthology.orchestra.run.smithi152.stdout:55834574858 2024-04-17T08:47:01.373 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-17T08:47:01.374 INFO:teuthology.orchestra.run.smithi152.stdout:55834574858 2024-04-17T08:47:01.374 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-17T08:47:01.380 INFO:teuthology.orchestra.run.smithi152.stdout:55834574858 2024-04-17T08:47:01.381 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-17T08:47:01.381 INFO:teuthology.orchestra.run.smithi152.stdout:55834574858 2024-04-17T08:47:01.381 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-17T08:47:01.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.598+0000 7f3e17e00640 1 Processor -- start 2024-04-17T08:47:01.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.598+0000 7f3e17e00640 1 -- start start 2024-04-17T08:47:01.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.598+0000 7f3e17e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3e100df2b0 0x7f3e1004faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.598+0000 7f3e17e00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e10054120 con 0x7f3e10033d00 2024-04-17T08:47:01.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.598+0000 7f3e17e00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e10054400 con 0x7f3e1000aae0 2024-04-17T08:47:01.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.598+0000 7f3e17e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f3e100df690 con 0x7f3e100df2b0 2024-04-17T08:47:01.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.598+0000 7f3e16000640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f3e10033d00 0x7f3e100e2d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:58456/0 (socket says 172.21.15.152:58456) 2024-04-17T08:47:01.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.598+0000 7f3e16000640 1 -- 172.21.15.152:0/717375608 learned_addr learned my addr 172.21.15.152:0/717375608 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:01.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.602+0000 7f3e15600640 1 -- 172.21.15.152:0/717375608 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1259210583 0 0) 0x7f3e10054120 con 0x7f3e10033d00 2024-04-17T08:47:01.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.602+0000 7f3e15600640 1 -- 172.21.15.152:0/717375608 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3dfc005740 con 0x7f3e10033d00 2024-04-17T08:47:01.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.602+0000 7f3e15600640 1 -- 172.21.15.152:0/717375608 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1771656519 0 0) 0x7f3dfc005740 con 0x7f3e10033d00 2024-04-17T08:47:01.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.602+0000 7f3e15600640 1 -- 172.21.15.152:0/717375608 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3e100df2b0 msgr2=0x7f3e1004faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:01.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.602+0000 7f3e15600640 1 --2- 172.21.15.152:0/717375608 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3e100df2b0 0x7f3e1004faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.602+0000 7f3e15600640 1 -- 172.21.15.152:0/717375608 >> v1:172.21.15.196:6789/0 conn(0x7f3e1000aae0 legacy=0x7f3e100ea040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.602+0000 7f3e15600640 1 -- 172.21.15.152:0/717375608 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e100546e0 con 0x7f3e10033d00 2024-04-17T08:47:01.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.602+0000 7f3e15600640 1 -- 172.21.15.152:0/717375608 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2973887244 0 0) 0x7f3e08001660 con 0x7f3e10033d00 2024-04-17T08:47:01.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.602+0000 7f3e15600640 1 -- 172.21.15.152:0/717375608 >> v1:172.21.15.152:6789/0 conn(0x7f3e10033d00 legacy=0x7f3e100e2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.602+0000 7f3e15600640 1 --2- 172.21.15.152:0/717375608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3dfc005c00 0x7f3dfc006040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.602+0000 7f3e15600640 1 --2- 172.21.15.152:0/717375608 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3e100df2b0 0x7f3dfc006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.602+0000 7f3e15600640 1 --2- 172.21.15.152:0/717375608 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3dfc006f60 0x7f3dfc0073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.602+0000 7f3e15600640 1 -- 172.21.15.152:0/717375608 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3e100df690 con 0x7f3dfc005c00 2024-04-17T08:47:01.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.602+0000 7f3e15600640 1 -- 172.21.15.152:0/717375608 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f3dfc009da0 con 0x7f3dfc006f60 2024-04-17T08:47:01.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.602+0000 7f3e15600640 1 -- 172.21.15.152:0/717375608 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f3dfc009fa0 con 0x7f3e100df2b0 2024-04-17T08:47:01.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.602+0000 7f3e16a00640 1 --2- 172.21.15.152:0/717375608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3dfc005c00 0x7f3dfc006040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.602+0000 7f3e17400640 1 --2- 172.21.15.152:0/717375608 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3dfc006f60 0x7f3dfc0073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.606+0000 7f3e16a00640 1 -- 172.21.15.152:0/717375608 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3e100df2b0 msgr2=0x7f3dfc006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:01.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.602+0000 7f3e16000640 1 --2- 172.21.15.152:0/717375608 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3e100df2b0 0x7f3dfc006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.606+0000 7f3e16a00640 1 --2- 172.21.15.152:0/717375608 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3e100df2b0 0x7f3dfc006a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.606+0000 7f3e16a00640 1 -- 172.21.15.152:0/717375608 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3dfc006f60 msgr2=0x7f3dfc0073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:01.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.606+0000 7f3e16a00640 1 --2- 172.21.15.152:0/717375608 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3dfc006f60 0x7f3dfc0073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.606+0000 7f3e16a00640 1 -- 172.21.15.152:0/717375608 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e100546e0 con 0x7f3dfc005c00 2024-04-17T08:47:01.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.606+0000 7f3e17400640 1 --2- 172.21.15.152:0/717375608 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3dfc006f60 0x7f3dfc0073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T08:47:01.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.606+0000 7f3e16000640 1 --2- 172.21.15.152:0/717375608 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3e100df2b0 0x7f3dfc006a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:47:01.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.606+0000 7efe83e00640 1 Processor -- start 2024-04-17T08:47:01.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.606+0000 7f5c63e00640 1 Processor -- start 2024-04-17T08:47:01.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.606+0000 7f5c63e00640 1 -- start start 2024-04-17T08:47:01.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.610+0000 7f5c63e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5c5c057b10 0x7f5c5c038450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.610+0000 7f5c63e00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c5c007af0 con 0x7f5c5c007710 2024-04-17T08:47:01.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.610+0000 7f5c63e00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c5c056ab0 con 0x7f5c5c0068c0 2024-04-17T08:47:01.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.610+0000 7f5c63e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f5c5c0e1f70 con 0x7f5c5c057b10 2024-04-17T08:47:01.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.610+0000 7f5c62a00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f5c5c007710 0x7f5c5c0061b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:58458/0 (socket says 172.21.15.152:58458) 2024-04-17T08:47:01.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.610+0000 7f5c62a00640 1 -- 172.21.15.152:0/89382717 learned_addr learned my addr 172.21.15.152:0/89382717 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:01.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.606+0000 7efe83e00640 1 -- start start 2024-04-17T08:47:01.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.610+0000 7efe83e00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7efe7c0cffd0 0x7efe7c0cabb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.610+0000 7efe83e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efe7c06cdc0 0x7efe7c166560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.610+0000 7efe83e00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe7c06bd20 con 0x7efe7c166aa0 2024-04-17T08:47:01.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.610+0000 7efe83e00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7efe7c0d03b0 con 0x7efe7c0cffd0 2024-04-17T08:47:01.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.610+0000 7efe83e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7efe7c06c000 con 0x7efe7c06cdc0 2024-04-17T08:47:01.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.610+0000 7fb6a9600640 1 Processor -- start 2024-04-17T08:47:01.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.610+0000 7fb6a9600640 1 -- start start 2024-04-17T08:47:01.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.610+0000 7efe80a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efe7c06cdc0 0x7efe7c166560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.610+0000 7efe81e00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7efe7c166aa0 0x7efe7c0ce830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:58464/0 (socket says 172.21.15.152:58464) 2024-04-17T08:47:01.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.610+0000 7efe81400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7efe7c0cffd0 0x7efe7c0cabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.610+0000 7efe81400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7efe7c0cffd0 0x7efe7c0cabb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46806/0 (socket says 172.21.15.152:46806) 2024-04-17T08:47:01.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.610+0000 7efe81400640 1 -- 172.21.15.152:0/1699055170 learned_addr learned my addr 172.21.15.152:0/1699055170 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:01.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.610+0000 7efe80a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efe7c06cdc0 0x7efe7c166560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.152:33536/0 (socket says 172.21.15.152:33536) 2024-04-17T08:47:01.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.610+0000 7f5c61600640 1 -- 172.21.15.152:0/89382717 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 498927433 0 0) 0x7f5c5c007af0 con 0x7f5c5c007710 2024-04-17T08:47:01.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.610+0000 7f5c61600640 1 -- 172.21.15.152:0/89382717 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c48003530 con 0x7f5c5c007710 2024-04-17T08:47:01.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.610+0000 7f3e16a00640 1 --2- 172.21.15.152:0/717375608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3dfc005c00 0x7f3dfc006040 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3e04009af0 tx=0x7f3e0401c5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86d1aa1c42aa17a server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.610+0000 7f5c62000640 1 --2- 172.21.15.152:0/89382717 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5c5c057b10 0x7f5c5c038450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.610+0000 7f3e15600640 1 -- 172.21.15.152:0/717375608 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e040b1070 con 0x7f3dfc005c00 2024-04-17T08:47:01.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.610+0000 7f5c61600640 1 -- 172.21.15.152:0/89382717 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1416261046 0 0) 0x7f5c48003530 con 0x7f5c5c007710 2024-04-17T08:47:01.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.610+0000 7f5c61600640 1 -- 172.21.15.152:0/89382717 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5c5c057b10 msgr2=0x7f5c5c038450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:01.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.610+0000 7fb6a9600640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb6a40b0700 0x7fb6a40cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.610+0000 7fb6a9600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb6a415eb20 0x7fb6a40cf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.610+0000 7f5c61600640 1 --2- 172.21.15.152:0/89382717 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5c5c057b10 0x7f5c5c038450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.610+0000 7fb6a9600640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6a40b6c80 con 0x7fb6a40cfb10 2024-04-17T08:47:01.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.610+0000 7fb6a9600640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fb6a40cee80 con 0x7fb6a40b0700 2024-04-17T08:47:01.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.610+0000 7fb6a9600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fb6a40ce270 con 0x7fb6a415eb20 2024-04-17T08:47:01.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.610+0000 7f5c61600640 1 -- 172.21.15.152:0/89382717 >> v1:172.21.15.196:6789/0 conn(0x7f5c5c0068c0 legacy=0x7f5c5c0e7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.614+0000 7f3e15600640 1 -- 172.21.15.152:0/717375608 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e040ac650 con 0x7f3dfc005c00 2024-04-17T08:47:01.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.614+0000 7fb6a3e00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb6a40b0700 0x7fb6a40cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.610+0000 7efe80a00640 1 -- 172.21.15.152:0/1699055170 >> v2:172.21.15.152:3300/0 conn(0x7efe7c0cffd0 msgr2=0x7efe7c0cabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:01.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.610+0000 7efe80a00640 1 --2- 172.21.15.152:0/1699055170 >> v2:172.21.15.152:3300/0 conn(0x7efe7c0cffd0 0x7efe7c0cabb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.610+0000 7efe80a00640 1 -- 172.21.15.152:0/1699055170 >> v1:172.21.15.152:6789/0 conn(0x7efe7c166aa0 legacy=0x7efe7c0ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.610+0000 7efe80a00640 1 -- 172.21.15.152:0/1699055170 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe7c06c2e0 con 0x7efe7c06cdc0 2024-04-17T08:47:01.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.614+0000 7fb6a8c00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fb6a40cfb10 0x7fb6a41583f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:58472/0 (socket says 172.21.15.152:58472) 2024-04-17T08:47:01.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.610+0000 7f5c61600640 1 -- 172.21.15.152:0/89382717 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c5c055730 con 0x7f5c5c007710 2024-04-17T08:47:01.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.610+0000 7f5c62000640 1 --2- 172.21.15.152:0/89382717 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5c5c057b10 0x7f5c5c038450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:47:01.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.610+0000 7f5c61600640 1 -- 172.21.15.152:0/89382717 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2973887244 0 0) 0x7f5c54001680 con 0x7f5c5c007710 2024-04-17T08:47:01.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.610+0000 7f5c61600640 1 -- 172.21.15.152:0/89382717 >> v1:172.21.15.152:6789/0 conn(0x7f5c5c007710 legacy=0x7f5c5c0061b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.610+0000 7f5c61600640 1 --2- 172.21.15.152:0/89382717 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c480039f0 0x7f5c48003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.610+0000 7f5c61600640 1 --2- 172.21.15.152:0/89382717 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5c5c057b10 0x7f5c48004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.610+0000 7f5c61600640 1 --2- 172.21.15.152:0/89382717 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5c48004e70 0x7f5c4800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.610+0000 7f5c61600640 1 -- 172.21.15.152:0/89382717 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5c5c0e1f70 con 0x7f5c480039f0 2024-04-17T08:47:01.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.610+0000 7f5c61600640 1 -- 172.21.15.152:0/89382717 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f5c480054f0 con 0x7f5c48004e70 2024-04-17T08:47:01.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.610+0000 7f5c61600640 1 -- 172.21.15.152:0/89382717 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f5c4800bf10 con 0x7f5c5c057b10 2024-04-17T08:47:01.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.614+0000 7f5c63400640 1 --2- 172.21.15.152:0/89382717 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5c48004e70 0x7f5c4800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.614+0000 7f5c62a00640 1 --2- 172.21.15.152:0/89382717 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c480039f0 0x7f5c48003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.614+0000 7fb6a8c00640 1 -- 172.21.15.152:0/2254502714 learned_addr learned my addr 172.21.15.152:0/2254502714 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:01.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.614+0000 7f3e15600640 1 -- 172.21.15.152:0/717375608 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e040a8050 con 0x7f3dfc005c00 2024-04-17T08:47:01.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.614+0000 7f3e17e00640 1 -- 172.21.15.152:0/717375608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3dfc005c00 msgr2=0x7f3dfc006040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.614+0000 7f3e17e00640 1 --2- 172.21.15.152:0/717375608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3dfc005c00 0x7f3dfc006040 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3e04009af0 tx=0x7f3e0401c5e0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.614+0000 7f3e17400640 1 -- 172.21.15.152:0/717375608 reap_dead start 2024-04-17T08:47:01.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.614+0000 7fb69be00640 1 --2- 172.21.15.152:0/2254502714 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb6a415eb20 0x7fb6a40cf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.614+0000 7f3e17e00640 1 -- 172.21.15.152:0/717375608 shutdown_connections 2024-04-17T08:47:01.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.614+0000 7f3e17e00640 1 -- 172.21.15.152:0/717375608 >> 172.21.15.152:0/717375608 conn(0x7f3e10009fc0 msgr2=0x7f3e1000a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:01.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.614+0000 7f3e17e00640 1 -- 172.21.15.152:0/717375608 shutdown_connections 2024-04-17T08:47:01.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.614+0000 7f3e17e00640 1 -- 172.21.15.152:0/717375608 wait complete. 2024-04-17T08:47:01.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.614+0000 7fb69be00640 1 -- 172.21.15.152:0/2254502714 >> v2:172.21.15.152:3300/0 conn(0x7fb6a40b0700 msgr2=0x7fb6a40cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:01.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.614+0000 7fb69be00640 1 --2- 172.21.15.152:0/2254502714 >> v2:172.21.15.152:3300/0 conn(0x7fb6a40b0700 0x7fb6a40cdbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.614+0000 7fb69be00640 1 -- 172.21.15.152:0/2254502714 >> v1:172.21.15.152:6789/0 conn(0x7fb6a40cfb10 legacy=0x7fb6a41583f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:01.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.614+0000 7fb69be00640 1 -- 172.21.15.152:0/2254502714 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6a40ce550 con 0x7fb6a415eb20 2024-04-17T08:47:01.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.614+0000 7f5c62000640 1 --2- 172.21.15.152:0/89382717 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5c5c057b10 0x7f5c48004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.614+0000 7f5c63400640 1 -- 172.21.15.152:0/89382717 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5c5c057b10 msgr2=0x7f5c48004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:01.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.614+0000 7f5c63400640 1 --2- 172.21.15.152:0/89382717 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5c5c057b10 0x7f5c48004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.614+0000 7f5c63400640 1 -- 172.21.15.152:0/89382717 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c480039f0 msgr2=0x7f5c48003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:01.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.614+0000 7f5c63400640 1 --2- 172.21.15.152:0/89382717 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c480039f0 0x7f5c48003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.614+0000 7f5c63400640 1 -- 172.21.15.152:0/89382717 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c48003530 con 0x7f5c48004e70 2024-04-17T08:47:01.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.614+0000 7f5c62000640 1 --2- 172.21.15.152:0/89382717 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5c5c057b10 0x7f5c48004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T08:47:01.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.618+0000 7f3e17e00640 1 Processor -- start 2024-04-17T08:47:01.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.618+0000 7f3e17e00640 1 -- start start 2024-04-17T08:47:01.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.618+0000 7efe80a00640 1 --2- 172.21.15.152:0/1699055170 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efe7c06cdc0 0x7efe7c166560 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7efe680097c0 tx=0x7efe6801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce70ca41641d5fae server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.618+0000 7efe7be00640 1 -- 172.21.15.152:0/1699055170 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe680b1070 con 0x7efe7c06cdc0 2024-04-17T08:47:01.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.618+0000 7efe7be00640 1 -- 172.21.15.152:0/1699055170 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe680ac410 con 0x7efe7c06cdc0 2024-04-17T08:47:01.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.618+0000 7efe7be00640 1 -- 172.21.15.152:0/1699055170 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe680ac7e0 con 0x7efe7c06cdc0 2024-04-17T08:47:01.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.618+0000 7f3e17e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3dfc005c00 0x7f3e100cd050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.618+0000 7f3e17e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3e10048ea0 0x7f3e10049300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.618+0000 7f3e17e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e10050660 0x7f3e10050ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.618+0000 7f465b000640 1 Processor -- start 2024-04-17T08:47:01.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.618+0000 7f5c63400640 1 --2- 172.21.15.152:0/89382717 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5c48004e70 0x7f5c4800b9d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5c50001800 tx=0x7f5c5002d4c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61bbe442661f6d92 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.618+0000 7f3e17e00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1004f7e0 con 0x7f3e10050660 2024-04-17T08:47:01.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.618+0000 7f3e17e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1004f660 con 0x7f3e10048ea0 2024-04-17T08:47:01.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.618+0000 7f3e17e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f3e1004faa0 con 0x7f3dfc005c00 2024-04-17T08:47:01.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.618+0000 7f3e16a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3dfc005c00 0x7f3e100cd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.618+0000 7f3e16a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3dfc005c00 0x7f3e100cd050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.152:33564/0 (socket says 172.21.15.152:33564) 2024-04-17T08:47:01.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.618+0000 7f3e16a00640 1 -- 172.21.15.152:0/4094150121 learned_addr learned my addr 172.21.15.152:0/4094150121 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:01.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.618+0000 7efe83e00640 1 -- 172.21.15.152:0/1699055170 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efe7c06cdc0 msgr2=0x7efe7c166560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.618+0000 7efe83e00640 1 --2- 172.21.15.152:0/1699055170 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efe7c06cdc0 0x7efe7c166560 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7efe680097c0 tx=0x7efe6801c4a0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.618+0000 7f5c61600640 1 -- 172.21.15.152:0/89382717 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c500b9050 con 0x7f5c48004e70 2024-04-17T08:47:01.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.618+0000 7f5c61600640 1 -- 172.21.15.152:0/89382717 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c500052d0 con 0x7f5c48004e70 2024-04-17T08:47:01.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.618+0000 7f5c61600640 1 -- 172.21.15.152:0/89382717 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c50001420 con 0x7f5c48004e70 2024-04-17T08:47:01.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.618+0000 7efe83e00640 1 -- 172.21.15.152:0/1699055170 shutdown_connections 2024-04-17T08:47:01.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.618+0000 7efe83e00640 1 --2- 172.21.15.152:0/1699055170 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efe7c06cdc0 0x7efe7c166560 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.618+0000 7efe83e00640 1 --2- 172.21.15.152:0/1699055170 >> v2:172.21.15.152:3300/0 conn(0x7efe7c0cffd0 0x7efe7c0cabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.618+0000 7efe83e00640 1 -- 172.21.15.152:0/1699055170 >> 172.21.15.152:0/1699055170 conn(0x7efe7c0ccfe0 msgr2=0x7efe7c0cd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:01.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.618+0000 7fb69be00640 1 --2- 172.21.15.152:0/2254502714 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb6a415eb20 0x7fb6a40cf5d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb68c0097c0 tx=0x7fb68c01c2a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7b51ae6c721cbff server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.618+0000 7efe83e00640 1 -- 172.21.15.152:0/1699055170 shutdown_connections 2024-04-17T08:47:01.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.618+0000 7efe83e00640 1 -- 172.21.15.152:0/1699055170 wait complete. 2024-04-17T08:47:01.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.618+0000 7f465b000640 1 -- start start 2024-04-17T08:47:01.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.618+0000 7f3e16000640 1 --2- 172.21.15.152:0/4094150121 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3e10048ea0 0x7f3e10049300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.618+0000 7f3e17400640 1 --2- 172.21.15.152:0/4094150121 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e10050660 0x7f3e10050ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.618+0000 7f3e16a00640 1 -- 172.21.15.152:0/4094150121 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3e10048ea0 msgr2=0x7f3e10049300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.618+0000 7f3e16a00640 1 --2- 172.21.15.152:0/4094150121 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3e10048ea0 0x7f3e10049300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.618+0000 7f3e16a00640 1 -- 172.21.15.152:0/4094150121 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e10050660 msgr2=0x7f3e10050ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.618+0000 7f3e16a00640 1 --2- 172.21.15.152:0/4094150121 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e10050660 0x7f3e10050ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.618+0000 7f3e16a00640 1 -- 172.21.15.152:0/4094150121 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e100e05b0 con 0x7f3dfc005c00 2024-04-17T08:47:01.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.618+0000 7f3e17400640 1 --2- 172.21.15.152:0/4094150121 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e10050660 0x7f3e10050ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:47:01.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.618+0000 7f3e16000640 1 --2- 172.21.15.152:0/4094150121 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3e10048ea0 0x7f3e10049300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:47:01.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.622+0000 7f5c63e00640 1 -- 172.21.15.152:0/89382717 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5c48004e70 msgr2=0x7f5c4800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.622+0000 7f5c63e00640 1 --2- 172.21.15.152:0/89382717 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5c48004e70 0x7f5c4800b9d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5c50001800 tx=0x7f5c5002d4c0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.622+0000 7f3e16a00640 1 --2- 172.21.15.152:0/4094150121 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3dfc005c00 0x7f3e100cd050 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3e04000c10 tx=0x7f3dfc007a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.622+0000 7fb6a3400640 1 -- 172.21.15.152:0/2254502714 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb68c0b0070 con 0x7fb6a415eb20 2024-04-17T08:47:01.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.622+0000 7fb6a3400640 1 -- 172.21.15.152:0/2254502714 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb68c0ab600 con 0x7fb6a415eb20 2024-04-17T08:47:01.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.622+0000 7fb6a3400640 1 -- 172.21.15.152:0/2254502714 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb68c0ab9d0 con 0x7fb6a415eb20 2024-04-17T08:47:01.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.622+0000 7f5c63400640 1 -- 172.21.15.152:0/89382717 reap_dead start 2024-04-17T08:47:01.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.622+0000 7f5c63e00640 1 -- 172.21.15.152:0/89382717 shutdown_connections 2024-04-17T08:47:01.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.622+0000 7f5c63e00640 1 -- 172.21.15.152:0/89382717 >> 172.21.15.152:0/89382717 conn(0x7f5c5c0559f0 msgr2=0x7f5c5c055e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:01.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.622+0000 7f5c63e00640 1 -- 172.21.15.152:0/89382717 shutdown_connections 2024-04-17T08:47:01.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.622+0000 7f3e0ea00640 1 -- 172.21.15.152:0/4094150121 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e040bb070 con 0x7f3dfc005c00 2024-04-17T08:47:01.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.622+0000 7f3e0ea00640 1 -- 172.21.15.152:0/4094150121 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e040b6460 con 0x7f3dfc005c00 2024-04-17T08:47:01.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.622+0000 7f3e0ea00640 1 -- 172.21.15.152:0/4094150121 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e040b1040 con 0x7f3dfc005c00 2024-04-17T08:47:01.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.622+0000 7f3e17e00640 1 -- 172.21.15.152:0/4094150121 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e100e0890 con 0x7f3dfc005c00 2024-04-17T08:47:01.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.622+0000 7f3e17e00640 1 -- 172.21.15.152:0/4094150121 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e1004ced0 con 0x7f3dfc005c00 2024-04-17T08:47:01.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.622+0000 7efe83e00640 1 Processor -- start 2024-04-17T08:47:01.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.622+0000 7f3e17e00640 1 -- 172.21.15.152:0/4094150121 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e100089e0 con 0x7f3dfc005c00 2024-04-17T08:47:01.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.622+0000 7efe83e00640 1 -- start start 2024-04-17T08:47:01.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.622+0000 7fb6a9600640 1 -- 172.21.15.152:0/2254502714 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb6a415eb20 msgr2=0x7fb6a40cf5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.622+0000 7fb6a9600640 1 --2- 172.21.15.152:0/2254502714 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb6a415eb20 0x7fb6a40cf5d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb68c0097c0 tx=0x7fb68c01c2a0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.622+0000 7f465b000640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f4654162900 0x7f4654072610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.622+0000 7f465b000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f465406dc60 0x7f46540d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.622+0000 7f5c63e00640 1 -- 172.21.15.152:0/89382717 wait complete. 2024-04-17T08:47:01.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.622+0000 7f5c63e00640 1 Processor -- start 2024-04-17T08:47:01.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.622+0000 7f5c63e00640 1 -- start start 2024-04-17T08:47:01.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.622+0000 7fb6a9600640 1 -- 172.21.15.152:0/2254502714 shutdown_connections 2024-04-17T08:47:01.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.622+0000 7fb6a9600640 1 --2- 172.21.15.152:0/2254502714 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb6a415eb20 0x7fb6a40cf5d0 secure :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb68c0097c0 tx=0x7fb68c01c2a0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.622+0000 7fb6a9600640 1 --2- 172.21.15.152:0/2254502714 >> v2:172.21.15.152:3300/0 conn(0x7fb6a40b0700 0x7fb6a40cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.622+0000 7f4653400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f465406dc60 0x7f46540d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.626+0000 7f4653400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f465406dc60 0x7f46540d0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.152:33568/0 (socket says 172.21.15.152:33568) 2024-04-17T08:47:01.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.626+0000 7f4653e00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f4654162900 0x7f4654072610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.626+0000 7f465b000640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f465406e0f0 con 0x7f465406f190 2024-04-17T08:47:01.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.626+0000 7f465b000640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f465406e3d0 con 0x7f4654162900 2024-04-17T08:47:01.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.626+0000 7f465b000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f465406e6b0 con 0x7f465406dc60 2024-04-17T08:47:01.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.626+0000 7f4653e00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f4654162900 0x7f4654072610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46832/0 (socket says 172.21.15.152:46832) 2024-04-17T08:47:01.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.626+0000 7f4653e00640 1 -- 172.21.15.152:0/2041181146 learned_addr learned my addr 172.21.15.152:0/2041181146 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:01.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.622+0000 7fb6a9600640 1 -- 172.21.15.152:0/2254502714 >> 172.21.15.152:0/2254502714 conn(0x7fb6a40d1140 msgr2=0x7fb6a40d1550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:01.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.622+0000 7efe83e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efe7c06cdc0 0x7efe7c0b5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.626+0000 7efe83e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efe7c0cffd0 0x7efe7c146620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.626+0000 7efe83e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe7c166aa0 0x7efe7c0b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.626+0000 7efe83e00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7efe7c167340 con 0x7efe7c166aa0 2024-04-17T08:47:01.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.626+0000 7efe83e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7efe7c0cb0f0 con 0x7efe7c0cffd0 2024-04-17T08:47:01.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.626+0000 7efe83e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7efe7c06b9b0 con 0x7efe7c06cdc0 2024-04-17T08:47:01.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.626+0000 7f3e0ea00640 1 -- 172.21.15.152:0/4094150121 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3e040be070 con 0x7f3dfc005c00 2024-04-17T08:47:01.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.626+0000 7fb6a9600640 1 -- 172.21.15.152:0/2254502714 shutdown_connections 2024-04-17T08:47:01.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.626+0000 7fb6a9600640 1 -- 172.21.15.152:0/2254502714 wait complete. 2024-04-17T08:47:01.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.626+0000 7efe81400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efe7c06cdc0 0x7efe7c0b5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.626+0000 7efe81400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efe7c06cdc0 0x7efe7c0b5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.152:33584/0 (socket says 172.21.15.152:33584) 2024-04-17T08:47:01.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.626+0000 7efe81400640 1 -- 172.21.15.152:0/301195264 learned_addr learned my addr 172.21.15.152:0/301195264 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:01.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.626+0000 7efe80a00640 1 --2- 172.21.15.152:0/301195264 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efe7c0cffd0 0x7efe7c146620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.626+0000 7f5c63e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c48004e70 0x7f5c5c0d0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.626+0000 7f5c63e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5c5c04ef00 0x7f5c5c0d8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.626+0000 7efe81400640 1 -- 172.21.15.152:0/301195264 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efe7c0cffd0 msgr2=0x7efe7c146620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.626+0000 7efe81400640 1 --2- 172.21.15.152:0/301195264 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efe7c0cffd0 0x7efe7c146620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.626+0000 7efe81400640 1 -- 172.21.15.152:0/301195264 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe7c166aa0 msgr2=0x7efe7c0b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.626+0000 7efe81400640 1 --2- 172.21.15.152:0/301195264 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe7c166aa0 0x7efe7c0b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.626+0000 7efe81400640 1 -- 172.21.15.152:0/301195264 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe7c14a3f0 con 0x7efe7c06cdc0 2024-04-17T08:47:01.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.626+0000 7efe80a00640 1 --2- 172.21.15.152:0/301195264 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efe7c0cffd0 0x7efe7c146620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:01.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.626+0000 7efe81400640 1 --2- 172.21.15.152:0/301195264 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efe7c06cdc0 0x7efe7c0b5e50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7efe7000e890 tx=0x7efe7000ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.626+0000 7f5c63e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5c5c0d6850 0x7f5c5c0d6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.626+0000 7f5c62000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5c5c04ef00 0x7f5c5c0d8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.626+0000 7f5c62000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5c5c04ef00 0x7f5c5c0d8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.152:33590/0 (socket says 172.21.15.152:33590) 2024-04-17T08:47:01.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.626+0000 7f5c62000640 1 -- 172.21.15.152:0/3035636935 learned_addr learned my addr 172.21.15.152:0/3035636935 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:01.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.626+0000 7f5c63400640 1 --2- 172.21.15.152:0/3035636935 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5c5c0d6850 0x7f5c5c0d6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.626+0000 7f5c63e00640 1 -- 172.21.15.152:0/3035636935 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5c5c02f8e0 con 0x7f5c48004e70 2024-04-17T08:47:01.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.626+0000 7f5c63e00640 1 -- 172.21.15.152:0/3035636935 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f5c5c0575f0 con 0x7f5c5c0d6850 2024-04-17T08:47:01.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.626+0000 7ff4f6200640 1 Processor -- start 2024-04-17T08:47:01.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.626+0000 7ff4f6200640 1 -- start start 2024-04-17T08:47:01.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.626+0000 7ff4f6200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff4f00736b0 0x7ff4f01438b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.626+0000 7ff4f6200640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff4f0143df0 0x7ff4f00b2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.626+0000 7ff4f6200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4f00b5290 con 0x7ff4f00b34c0 2024-04-17T08:47:01.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.626+0000 7ff4f6200640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7ff4f006c560 con 0x7ff4f0143df0 2024-04-17T08:47:01.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.626+0000 7ff4f6200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7ff4f006c840 con 0x7ff4f00736b0 2024-04-17T08:47:01.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.626+0000 7fb6a9600640 1 Processor -- start 2024-04-17T08:47:01.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.626+0000 7f5c63e00640 1 -- 172.21.15.152:0/3035636935 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f5c5c02fa60 con 0x7f5c5c04ef00 2024-04-17T08:47:01.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.630+0000 7f3e0ea00640 1 --2- 172.21.15.152:0/4094150121 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3df80683b0 0x7f3df806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.630+0000 7fb6a9600640 1 -- start start 2024-04-17T08:47:01.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.630+0000 7f5c63400640 1 -- 172.21.15.152:0/3035636935 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5c5c04ef00 msgr2=0x7f5c5c0d8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.630+0000 7f5c63400640 1 --2- 172.21.15.152:0/3035636935 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5c5c04ef00 0x7f5c5c0d8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.630+0000 7f5c63400640 1 -- 172.21.15.152:0/3035636935 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c48004e70 msgr2=0x7f5c5c0d0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.630+0000 7f5c63400640 1 --2- 172.21.15.152:0/3035636935 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c48004e70 0x7f5c5c0d0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.630+0000 7f5c63400640 1 -- 172.21.15.152:0/3035636935 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c5c0d8a70 con 0x7f5c5c0d6850 2024-04-17T08:47:01.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.630+0000 7ff4efe00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff4f0143df0 0x7ff4f00b2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.630+0000 7ff4f5800640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7ff4f00b34c0 0x7ff4f015e1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.152:43208/0 (socket says 172.21.15.152:43208) 2024-04-17T08:47:01.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.630+0000 7ff4f5800640 1 -- 172.21.15.152:0/1893683930 learned_addr learned my addr 172.21.15.152:0/1893683930 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:01.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.630+0000 7f3e0ea00640 1 -- 172.21.15.152:0/4094150121 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f3e04120f50 con 0x7f3dfc005c00 2024-04-17T08:47:01.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.630+0000 7f5c63400640 1 --2- 172.21.15.152:0/3035636935 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5c5c0d6850 0x7f5c5c0d6cd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5c480056c0 tx=0x7f5c48005840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.630+0000 7ff4f4e00640 1 --2- 172.21.15.152:0/1893683930 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff4f00736b0 0x7ff4f01438b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.630+0000 7ff4ef400640 1 -- 172.21.15.152:0/1893683930 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1563506853 0 0) 0x7ff4f00b5290 con 0x7ff4f00b34c0 2024-04-17T08:47:01.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.630+0000 7ff4ef400640 1 -- 172.21.15.152:0/1893683930 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff4d4003530 con 0x7ff4f00b34c0 2024-04-17T08:47:01.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.630+0000 7f5c5aa00640 1 -- 172.21.15.152:0/3035636935 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c500b9070 con 0x7f5c5c0d6850 2024-04-17T08:47:01.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.630+0000 7f5c5aa00640 1 -- 172.21.15.152:0/3035636935 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c500cc070 con 0x7f5c5c0d6850 2024-04-17T08:47:01.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.630+0000 7f5c5aa00640 1 -- 172.21.15.152:0/3035636935 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c64050c90 con 0x7f5c5c0d6850 2024-04-17T08:47:01.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.626+0000 7f4653400640 1 -- 172.21.15.152:0/2041181146 >> v2:172.21.15.152:3300/0 conn(0x7f4654162900 msgr2=0x7f4654072610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:01.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.630+0000 7f5c63e00640 1 -- 172.21.15.152:0/3035636935 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c5c04de60 con 0x7f5c5c0d6850 2024-04-17T08:47:01.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.626+0000 7f4653400640 1 --2- 172.21.15.152:0/2041181146 >> v2:172.21.15.152:3300/0 conn(0x7f4654162900 0x7f4654072610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.630+0000 7f3e16000640 1 --2- 172.21.15.152:0/4094150121 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3df80683b0 0x7f3df806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.630+0000 7ff4efe00640 1 -- 172.21.15.152:0/1893683930 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff4f00736b0 msgr2=0x7ff4f01438b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:01.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.626+0000 7f4653400640 1 -- 172.21.15.152:0/2041181146 >> v1:172.21.15.152:6789/0 conn(0x7f465406f190 legacy=0x7f465406b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:01.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.626+0000 7f4653400640 1 -- 172.21.15.152:0/2041181146 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f465406e990 con 0x7f465406dc60 2024-04-17T08:47:01.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.630+0000 7f5c63e00640 1 -- 172.21.15.152:0/3035636935 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c5c04e420 con 0x7f5c5c0d6850 2024-04-17T08:47:01.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.630+0000 7ff4ef400640 1 -- 172.21.15.152:0/1893683930 <== mon.1 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2440706931 0 0) 0x7ff4d4003530 con 0x7ff4f00b34c0 2024-04-17T08:47:01.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.630+0000 7f4653400640 1 --2- 172.21.15.152:0/2041181146 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f465406dc60 0x7f46540d0360 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f46440097c0 tx=0x7f464401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12d26c671e4ca17 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.630+0000 7fb6a9600640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6a40b0700 0x7fb6a4154e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.630+0000 7fb6a9600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb6a40cfb10 0x7fb6a406c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.630+0000 7fb6a9600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb6a4204390 0x7fb6a4204840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.630+0000 7efe79600640 1 -- 172.21.15.152:0/301195264 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe70017070 con 0x7efe7c06cdc0 2024-04-17T08:47:01.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.630+0000 7f4652a00640 1 -- 172.21.15.152:0/2041181146 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46440b0070 con 0x7f465406dc60 2024-04-17T08:47:01.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.630+0000 7efe79600640 1 -- 172.21.15.152:0/301195264 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe7000c940 con 0x7efe7c06cdc0 2024-04-17T08:47:01.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.630+0000 7efe79600640 1 -- 172.21.15.152:0/301195264 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe7000ccf0 con 0x7efe7c06cdc0 2024-04-17T08:47:01.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.630+0000 7f4652a00640 1 -- 172.21.15.152:0/2041181146 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46440ab600 con 0x7f465406dc60 2024-04-17T08:47:01.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.630+0000 7f4652a00640 1 -- 172.21.15.152:0/2041181146 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46440ab9d0 con 0x7f465406dc60 2024-04-17T08:47:01.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.630+0000 7fb6a3e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6a40b0700 0x7fb6a4154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.630+0000 7fb6a3e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6a40b0700 0x7fb6a4154e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46876/0 (socket says 172.21.15.152:46876) 2024-04-17T08:47:01.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.630+0000 7fb6a3e00640 1 -- 172.21.15.152:0/2245180472 learned_addr learned my addr 172.21.15.152:0/2245180472 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:01.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.630+0000 7fb69be00640 1 --2- 172.21.15.152:0/2245180472 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb6a40cfb10 0x7fb6a406c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.634+0000 7fb6a9600640 1 -- 172.21.15.152:0/2245180472 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb6a40b0c60 con 0x7fb6a40b0700 2024-04-17T08:47:01.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.634+0000 7fb6a9600640 1 -- 172.21.15.152:0/2245180472 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb6a40b0ae0 con 0x7fb6a40cfb10 2024-04-17T08:47:01.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.634+0000 7fb6a9600640 1 -- 172.21.15.152:0/2245180472 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fb6a40b4a00 con 0x7fb6a4204390 2024-04-17T08:47:01.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.634+0000 7f465b000640 1 -- 172.21.15.152:0/2041181146 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f465406dc60 msgr2=0x7f46540d0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.634+0000 7f465b000640 1 --2- 172.21.15.152:0/2041181146 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f465406dc60 0x7f46540d0360 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f46440097c0 tx=0x7f464401c480 comp rx=0 tx=0).stop 2024-04-17T08:47:01.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.634+0000 7f5c4fe00640 1 -- 172.21.15.152:0/3035636935 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c380052a0 con 0x7f5c5c0d6850 2024-04-17T08:47:01.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.634+0000 7f3e0ea00640 1 -- 172.21.15.152:0/4094150121 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f3e040162f0 con 0x7f3dfc005c00 2024-04-17T08:47:01.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.634+0000 7f3e16000640 1 --2- 172.21.15.152:0/4094150121 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3df80683b0 0x7f3df806a870 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3e08001810 tx=0x7f3e08009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.634+0000 7efe83e00640 1 -- 172.21.15.152:0/301195264 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe7c14a6d0 con 0x7efe7c06cdc0 2024-04-17T08:47:01.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.634+0000 7ff4efe00640 1 --2- 172.21.15.152:0/1893683930 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff4f00736b0 0x7ff4f01438b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.634+0000 7efe83e00640 1 -- 172.21.15.152:0/301195264 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7efe7c14ac90 con 0x7efe7c06cdc0 2024-04-17T08:47:01.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.634+0000 7ff4efe00640 1 -- 172.21.15.152:0/1893683930 >> v1:172.21.15.196:6789/0 conn(0x7ff4f00b34c0 legacy=0x7ff4f015e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.634+0000 7ff4efe00640 1 -- 172.21.15.152:0/1893683930 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4f006cb20 con 0x7ff4f0143df0 2024-04-17T08:47:01.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.634+0000 7f465b000640 1 -- 172.21.15.152:0/2041181146 shutdown_connections 2024-04-17T08:47:01.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.634+0000 7f465b000640 1 --2- 172.21.15.152:0/2041181146 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f465406dc60 0x7f46540d0360 secure :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f46440097c0 tx=0x7f464401c480 comp rx=0 tx=0).stop 2024-04-17T08:47:01.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.634+0000 7f465b000640 1 --2- 172.21.15.152:0/2041181146 >> v2:172.21.15.152:3300/0 conn(0x7f4654162900 0x7f4654072610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.634+0000 7f465b000640 1 -- 172.21.15.152:0/2041181146 >> 172.21.15.152:0/2041181146 conn(0x7f46540b3350 msgr2=0x7f46540b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:01.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.634+0000 7ff4f4e00640 1 --2- 172.21.15.152:0/1893683930 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff4f00736b0 0x7ff4f01438b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:47:01.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.634+0000 7fb6a8c00640 1 --2- 172.21.15.152:0/2245180472 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb6a4204390 0x7fb6a4204840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.634+0000 7fb6a3e00640 1 -- 172.21.15.152:0/2245180472 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb6a4204390 msgr2=0x7fb6a4204840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.634+0000 7fb6a3e00640 1 --2- 172.21.15.152:0/2245180472 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb6a4204390 0x7fb6a4204840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.634+0000 7fb6a3e00640 1 -- 172.21.15.152:0/2245180472 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb6a40cfb10 msgr2=0x7fb6a406c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.634+0000 7fb6a3e00640 1 --2- 172.21.15.152:0/2245180472 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb6a40cfb10 0x7fb6a406c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.634+0000 7fb6a3e00640 1 -- 172.21.15.152:0/2245180472 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6a4204eb0 con 0x7fb6a40b0700 2024-04-17T08:47:01.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.634+0000 7f465b000640 1 -- 172.21.15.152:0/2041181146 shutdown_connections 2024-04-17T08:47:01.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.634+0000 7fb6a3e00640 1 --2- 172.21.15.152:0/2245180472 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6a40b0700 0x7fb6a4154e40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb69400c7f0 tx=0x7fb69400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.634+0000 7fb6a8c00640 1 --2- 172.21.15.152:0/2245180472 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb6a4204390 0x7fb6a4204840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:01.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.634+0000 7f5c5aa00640 1 -- 172.21.15.152:0/3035636935 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5c500067e0 con 0x7f5c5c0d6850 2024-04-17T08:47:01.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.634+0000 7fb6a0c00640 1 -- 172.21.15.152:0/2245180472 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb694015070 con 0x7fb6a40b0700 2024-04-17T08:47:01.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.634+0000 7fb6a0c00640 1 -- 172.21.15.152:0/2245180472 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb694004220 con 0x7fb6a40b0700 2024-04-17T08:47:01.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.634+0000 7fb6a0c00640 1 -- 172.21.15.152:0/2245180472 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb694003620 con 0x7fb6a40b0700 2024-04-17T08:47:01.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.634+0000 7fb69be00640 1 --2- 172.21.15.152:0/2245180472 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb6a40cfb10 0x7fb6a406c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T08:47:01.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.634+0000 7f465b000640 1 -- 172.21.15.152:0/2041181146 wait complete. 2024-04-17T08:47:01.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.638+0000 7f5c5aa00640 1 --2- 172.21.15.152:0/3035636935 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5c44068400 0x7f5c4406a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.638+0000 7f5c5aa00640 1 -- 172.21.15.152:0/3035636935 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f5c501318f0 con 0x7f5c5c0d6850 2024-04-17T08:47:01.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.638+0000 7efe83e00640 1 -- 172.21.15.152:0/301195264 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe7c068a30 con 0x7efe7c06cdc0 2024-04-17T08:47:01.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.638+0000 7f465b000640 1 Processor -- start 2024-04-17T08:47:01.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.638+0000 7f5c62a00640 1 --2- 172.21.15.152:0/3035636935 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5c44068400 0x7f5c4406a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.638+0000 7f465b000640 1 -- start start 2024-04-17T08:47:01.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.638+0000 7f5c62a00640 1 --2- 172.21.15.152:0/3035636935 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5c44068400 0x7f5c4406a8c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5c54001210 tx=0x7f5c54001120 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.638+0000 7efe79600640 1 -- 172.21.15.152:0/301195264 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efe7001a070 con 0x7efe7c06cdc0 2024-04-17T08:47:01.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.638+0000 7efe79600640 1 --2- 172.21.15.152:0/301195264 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7efe5c0683b0 0x7efe5c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.638+0000 7fb6a9600640 1 -- 172.21.15.152:0/2245180472 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6a4205190 con 0x7fb6a40b0700 2024-04-17T08:47:01.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.638+0000 7fb6a9600640 1 -- 172.21.15.152:0/2245180472 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6a40aac40 con 0x7fb6a40b0700 2024-04-17T08:47:01.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.638+0000 7efe79600640 1 -- 172.21.15.152:0/301195264 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7efe70086ea0 con 0x7efe7c06cdc0 2024-04-17T08:47:01.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.638+0000 7efe80a00640 1 --2- 172.21.15.152:0/301195264 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7efe5c0683b0 0x7efe5c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.642+0000 7f465b000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f465406f190 0x7f4654152220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.642+0000 7f465b000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4654162900 0x7f46541528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.642+0000 7fb6a9600640 1 -- 172.21.15.152:0/2245180472 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6a4075c10 con 0x7fb6a40b0700 2024-04-17T08:47:01.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.642+0000 7f465b000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4654152e00 0x7f465415da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.642+0000 7f465b000640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f465416f760 con 0x7f465406f190 2024-04-17T08:47:01.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.642+0000 7f465b000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f465416f5e0 con 0x7f4654152e00 2024-04-17T08:47:01.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.642+0000 7ff4efe00640 1 --2- 172.21.15.152:0/1893683930 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4f0143df0 0x7ff4f00b2f80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff4e000c2e0 tx=0x7ff4e001dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19f6b3f8bf68cd43 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.642+0000 7f465b000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f465416f8e0 con 0x7f4654162900 2024-04-17T08:47:01.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.642+0000 7f4653400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4654162900 0x7f46541528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.642+0000 7f4653400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4654162900 0x7f46541528c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.152:33614/0 (socket says 172.21.15.152:33614) 2024-04-17T08:47:01.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.642+0000 7f4653400640 1 -- 172.21.15.152:0/2464618290 learned_addr learned my addr 172.21.15.152:0/2464618290 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:01.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.642+0000 7f4659000640 1 --2- 172.21.15.152:0/2464618290 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4654152e00 0x7f465415da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.642+0000 7f4653e00640 1 --2- 172.21.15.152:0/2464618290 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f465406f190 0x7f4654152220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.642+0000 7f4653400640 1 -- 172.21.15.152:0/2464618290 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4654152e00 msgr2=0x7f465415da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.642+0000 7f4653400640 1 --2- 172.21.15.152:0/2464618290 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4654152e00 0x7f465415da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.642+0000 7f4653400640 1 -- 172.21.15.152:0/2464618290 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f465406f190 msgr2=0x7f4654152220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.642+0000 7f4653400640 1 --2- 172.21.15.152:0/2464618290 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f465406f190 0x7f4654152220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.642+0000 7f4653400640 1 -- 172.21.15.152:0/2464618290 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4654153480 con 0x7f4654162900 2024-04-17T08:47:01.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.642+0000 7f4653e00640 1 --2- 172.21.15.152:0/2464618290 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f465406f190 0x7f4654152220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:47:01.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.642+0000 7f4653400640 1 --2- 172.21.15.152:0/2464618290 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4654162900 0x7f46541528c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f464401a0b0 tx=0x7f4644019220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.642+0000 7ff4ef400640 1 -- 172.21.15.152:0/1893683930 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d8001680 con 0x7ff4f0143df0 2024-04-17T08:47:01.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.642+0000 7f5c5aa00640 1 -- 172.21.15.152:0/3035636935 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f5c50027200 con 0x7f5c5c0d6850 2024-04-17T08:47:01.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.642+0000 7ff4ef400640 1 -- 172.21.15.152:0/1893683930 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4e00a6a60 con 0x7ff4f0143df0 2024-04-17T08:47:01.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.642+0000 7ff4ef400640 1 -- 172.21.15.152:0/1893683930 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e00a6e30 con 0x7ff4f0143df0 2024-04-17T08:47:01.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.642+0000 7efe80a00640 1 --2- 172.21.15.152:0/301195264 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7efe5c0683b0 0x7efe5c06a870 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7efe680ae000 tx=0x7efe680a6040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.642+0000 7fb6a0c00640 1 -- 172.21.15.152:0/2245180472 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb6940037c0 con 0x7fb6a40b0700 2024-04-17T08:47:01.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.646+0000 7ff4f6200640 1 -- 172.21.15.152:0/1893683930 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4f0143df0 msgr2=0x7ff4f00b2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.646+0000 7ff4f6200640 1 --2- 172.21.15.152:0/1893683930 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4f0143df0 0x7ff4f00b2f80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff4e000c2e0 tx=0x7ff4e001dd70 comp rx=0 tx=0).stop 2024-04-17T08:47:01.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.646+0000 7ff4f6200640 1 -- 172.21.15.152:0/1893683930 shutdown_connections 2024-04-17T08:47:01.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.646+0000 7ff4f6200640 1 --2- 172.21.15.152:0/1893683930 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4f0143df0 0x7ff4f00b2f80 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.646+0000 7ff4f6200640 1 --2- 172.21.15.152:0/1893683930 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff4f00736b0 0x7ff4f01438b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.646+0000 7ff4f6200640 1 -- 172.21.15.152:0/1893683930 >> 172.21.15.152:0/1893683930 conn(0x7ff4f00d0050 msgr2=0x7ff4f00d0460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:01.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.646+0000 7fb6a0c00640 1 --2- 172.21.15.152:0/2245180472 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb680068380 0x7fb68006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.646+0000 7fb6a0c00640 1 -- 172.21.15.152:0/2245180472 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb694086b40 con 0x7fb6a40b0700 2024-04-17T08:47:01.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.646+0000 7f464be00640 1 -- 172.21.15.152:0/2464618290 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46440b0040 con 0x7f4654162900 2024-04-17T08:47:01.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.646+0000 7f464be00640 1 -- 172.21.15.152:0/2464618290 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46440bb070 con 0x7f4654162900 2024-04-17T08:47:01.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.646+0000 7f464be00640 1 -- 172.21.15.152:0/2464618290 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46440b56c0 con 0x7f4654162900 2024-04-17T08:47:01.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.646+0000 7f465b000640 1 -- 172.21.15.152:0/2464618290 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4654153760 con 0x7f4654162900 2024-04-17T08:47:01.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.646+0000 7ff4f6200640 1 -- 172.21.15.152:0/1893683930 shutdown_connections 2024-04-17T08:47:01.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.646+0000 7fb69be00640 1 --2- 172.21.15.152:0/2245180472 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb680068380 0x7fb68006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.646+0000 7f465b000640 1 -- 172.21.15.152:0/2464618290 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4654158240 con 0x7f4654162900 2024-04-17T08:47:01.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.646+0000 7efe79600640 1 -- 172.21.15.152:0/301195264 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7efe70056b60 con 0x7efe7c06cdc0 2024-04-17T08:47:01.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.646+0000 7fb69be00640 1 --2- 172.21.15.152:0/2245180472 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb680068380 0x7fb68006a840 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb68c0ad000 tx=0x7fb68c0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.646+0000 7f4649600640 1 -- 172.21.15.152:0/2464618290 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4654153210 con 0x7f4654162900 2024-04-17T08:47:01.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.650+0000 7f464be00640 1 -- 172.21.15.152:0/2464618290 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f46440b3070 con 0x7f4654162900 2024-04-17T08:47:01.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.650+0000 7f464be00640 1 --2- 172.21.15.152:0/2464618290 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f46340683d0 0x7f463406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.646+0000 7ff4f6200640 1 -- 172.21.15.152:0/1893683930 wait complete. 2024-04-17T08:47:01.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.650+0000 7ff4f6200640 1 Processor -- start 2024-04-17T08:47:01.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.650+0000 7ff4f6200640 1 -- start start 2024-04-17T08:47:01.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.650+0000 7ff4f6200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4f00736b0 0x7ff4f01413c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.650+0000 7ff4f6200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff4f00b34c0 0x7ff4f015f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.654+0000 7f464be00640 1 -- 172.21.15.152:0/2464618290 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f46440edc40 con 0x7f4654162900 2024-04-17T08:47:01.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.650+0000 7ff4f6200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4f0143df0 0x7ff4f0159ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.654+0000 7ff4f6200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f01678d0 con 0x7ff4f0143df0 2024-04-17T08:47:01.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.654+0000 7ff4f6200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f0167750 con 0x7ff4f00736b0 2024-04-17T08:47:01.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.654+0000 7ff4f6200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7ff4f0167a50 con 0x7ff4f00b34c0 2024-04-17T08:47:01.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.654+0000 7ff4efe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff4f00b34c0 0x7ff4f015f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.654+0000 7f4653e00640 1 --2- 172.21.15.152:0/2464618290 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f46340683d0 0x7f463406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.654+0000 7ff4f4e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4f00736b0 0x7ff4f01413c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.654+0000 7ff4efe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff4f00b34c0 0x7ff4f015f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.152:33620/0 (socket says 172.21.15.152:33620) 2024-04-17T08:47:01.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.654+0000 7ff4efe00640 1 -- 172.21.15.152:0/1089103913 learned_addr learned my addr 172.21.15.152:0/1089103913 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:01.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.654+0000 7ff4f5800640 1 --2- 172.21.15.152:0/1089103913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4f0143df0 0x7ff4f0159ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.654+0000 7ff4f4e00640 1 -- 172.21.15.152:0/1089103913 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff4f00b34c0 msgr2=0x7ff4f015f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.654+0000 7ff4f4e00640 1 --2- 172.21.15.152:0/1089103913 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff4f00b34c0 0x7ff4f015f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.654+0000 7ff4f4e00640 1 -- 172.21.15.152:0/1089103913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4f0143df0 msgr2=0x7ff4f0159ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.654+0000 7ff4f4e00640 1 --2- 172.21.15.152:0/1089103913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4f0143df0 0x7ff4f0159ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.654+0000 7ff4f4e00640 1 -- 172.21.15.152:0/1089103913 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4f009cef0 con 0x7ff4f00736b0 2024-04-17T08:47:01.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.654+0000 7ff4f5800640 1 --2- 172.21.15.152:0/1089103913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4f0143df0 0x7ff4f0159ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:01.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.654+0000 7ff4f4e00640 1 --2- 172.21.15.152:0/1089103913 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4f00736b0 0x7ff4f01413c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff4e800c7c0 tx=0x7ff4e800cc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.654+0000 7ff4ecc00640 1 -- 172.21.15.152:0/1089103913 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e8015070 con 0x7ff4f00736b0 2024-04-17T08:47:01.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.654+0000 7ff4ecc00640 1 -- 172.21.15.152:0/1089103913 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4e8007820 con 0x7ff4f00736b0 2024-04-17T08:47:01.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.654+0000 7ff4ecc00640 1 -- 172.21.15.152:0/1089103913 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e8007bf0 con 0x7ff4f00736b0 2024-04-17T08:47:01.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.654+0000 7f464be00640 1 -- 172.21.15.152:0/2464618290 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f4644016070 con 0x7f4654162900 2024-04-17T08:47:01.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.654+0000 7f4653e00640 1 --2- 172.21.15.152:0/2464618290 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f46340683d0 0x7f463406a890 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f464c009bc0 tx=0x7f464c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.654+0000 7ff4f6200640 1 -- 172.21.15.152:0/1089103913 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4f009d1d0 con 0x7ff4f00736b0 2024-04-17T08:47:01.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.654+0000 7ff4f6200640 1 -- 172.21.15.152:0/1089103913 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4f00cd6b0 con 0x7ff4f00736b0 2024-04-17T08:47:01.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.658+0000 7ff4e6000640 1 -- 172.21.15.152:0/1089103913 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4f0075c10 con 0x7ff4f00736b0 2024-04-17T08:47:01.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.658+0000 7fb6a0c00640 1 -- 172.21.15.152:0/2245180472 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fb694056760 con 0x7fb6a40b0700 2024-04-17T08:47:01.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.658+0000 7ff4ecc00640 1 -- 172.21.15.152:0/1089103913 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff4e8018070 con 0x7ff4f00736b0 2024-04-17T08:47:01.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.662+0000 7ff4ecc00640 1 --2- 172.21.15.152:0/1089103913 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7ff4cc068380 0x7ff4cc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.662+0000 7ff4ecc00640 1 -- 172.21.15.152:0/1089103913 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff4e8054780 con 0x7ff4f00736b0 2024-04-17T08:47:01.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.662+0000 7ff4efe00640 1 --2- 172.21.15.152:0/1089103913 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7ff4cc068380 0x7ff4cc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.666+0000 7ff4efe00640 1 --2- 172.21.15.152:0/1089103913 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7ff4cc068380 0x7ff4cc06a840 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff4e000c2e0 tx=0x7ff4e00a8070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.666+0000 7fb5cd600640 1 Processor -- start 2024-04-17T08:47:01.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.666+0000 7fb5cd600640 1 -- start start 2024-04-17T08:47:01.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.666+0000 7fb5cd600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fb5c80b3c00 0x7fb5c8073440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.666+0000 7fb5cd600640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb5c815e210 0x7fb5c8073980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.666+0000 7fb5cd600640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5c815e710 con 0x7fb5c806d610 2024-04-17T08:47:01.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.666+0000 7fb5cd600640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fb5c815bc10 con 0x7fb5c815e210 2024-04-17T08:47:01.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.666+0000 7fb5cd600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fb5c815e9f0 con 0x7fb5c80b3c00 2024-04-17T08:47:01.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.666+0000 7ff4ecc00640 1 -- 172.21.15.152:0/1089103913 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7ff4e80566e0 con 0x7ff4f00736b0 2024-04-17T08:47:01.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.666+0000 7fb5c6000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fb5c80b3c00 0x7fb5c8073440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.666+0000 7fb5c6000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fb5c80b3c00 0x7fb5c8073440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.152:41346/0 (socket says 172.21.15.152:41346) 2024-04-17T08:47:01.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.666+0000 7fb5c6000640 1 -- 172.21.15.152:0/1221520931 learned_addr learned my addr 172.21.15.152:0/1221520931 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:01.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.666+0000 7fb5c7400640 1 --2- 172.21.15.152:0/1221520931 >> v2:172.21.15.152:3300/0 conn(0x7fb5c815e210 0x7fb5c8073980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.670+0000 7fb5c6000640 1 -- 172.21.15.152:0/1221520931 >> v2:172.21.15.152:3300/0 conn(0x7fb5c815e210 msgr2=0x7fb5c8073980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:01.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.670+0000 7fb5c6000640 1 --2- 172.21.15.152:0/1221520931 >> v2:172.21.15.152:3300/0 conn(0x7fb5c815e210 0x7fb5c8073980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.670+0000 7fb5c6000640 1 -- 172.21.15.152:0/1221520931 >> v1:172.21.15.152:6789/0 conn(0x7fb5c806d610 legacy=0x7fb5c815bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.670+0000 7fb5c6000640 1 -- 172.21.15.152:0/1221520931 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5c815ecd0 con 0x7fb5c80b3c00 2024-04-17T08:47:01.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.674+0000 7fb5c6000640 1 --2- 172.21.15.152:0/1221520931 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb5c80b3c00 0x7fb5c8073440 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb5c80ad170 tx=0x7fb5b401ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=527b46c86cdc6aa9 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.678+0000 7fb5c5600640 1 -- 172.21.15.152:0/1221520931 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b40b5070 con 0x7fb5c80b3c00 2024-04-17T08:47:01.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.678+0000 7fb5c5600640 1 -- 172.21.15.152:0/1221520931 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5b40a8a10 con 0x7fb5c80b3c00 2024-04-17T08:47:01.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.678+0000 7fb5c5600640 1 -- 172.21.15.152:0/1221520931 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b40a8de0 con 0x7fb5c80b3c00 2024-04-17T08:47:01.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.678+0000 7fb5cd600640 1 -- 172.21.15.152:0/1221520931 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb5c80b3c00 msgr2=0x7fb5c8073440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.678+0000 7fb5cd600640 1 --2- 172.21.15.152:0/1221520931 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb5c80b3c00 0x7fb5c8073440 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb5c80ad170 tx=0x7fb5b401ed50 comp rx=0 tx=0).stop 2024-04-17T08:47:01.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.678+0000 7fb5cd600640 1 -- 172.21.15.152:0/1221520931 shutdown_connections 2024-04-17T08:47:01.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.678+0000 7fb5cd600640 1 --2- 172.21.15.152:0/1221520931 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb5c80b3c00 0x7fb5c8073440 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.678+0000 7fb5cd600640 1 --2- 172.21.15.152:0/1221520931 >> v2:172.21.15.152:3300/0 conn(0x7fb5c815e210 0x7fb5c8073980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.678+0000 7fb5cd600640 1 -- 172.21.15.152:0/1221520931 >> 172.21.15.152:0/1221520931 conn(0x7fb5c8072140 msgr2=0x7fb5c80b4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:01.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.678+0000 7fb5cd600640 1 -- 172.21.15.152:0/1221520931 shutdown_connections 2024-04-17T08:47:01.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.678+0000 7fb5cd600640 1 -- 172.21.15.152:0/1221520931 wait complete. 2024-04-17T08:47:01.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.682+0000 7fb5cd600640 1 Processor -- start 2024-04-17T08:47:01.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.682+0000 7fb5cd600640 1 -- start start 2024-04-17T08:47:01.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.682+0000 7f163f200640 1 Processor -- start 2024-04-17T08:47:01.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.682+0000 7fb5cd600640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5c80b3c00 0x7fb5c8154090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.682+0000 7fb5cd600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb5c815e210 0x7fb5c814a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.682+0000 7fb5cd600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb5c814ad90 0x7fb5c814a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.682+0000 7fb5cd600640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c8154f90 con 0x7fb5c80b3c00 2024-04-17T08:47:01.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.682+0000 7fb5cd600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c8073ec0 con 0x7fb5c815e210 2024-04-17T08:47:01.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.682+0000 7fb5cd600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fb5c8155110 con 0x7fb5c814ad90 2024-04-17T08:47:01.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.682+0000 7f163f200640 1 -- start start 2024-04-17T08:47:01.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.682+0000 7fb5c7400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb5c814ad90 0x7fb5c814a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.682+0000 7fb5c7400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb5c814ad90 0x7fb5c814a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.152:33628/0 (socket says 172.21.15.152:33628) 2024-04-17T08:47:01.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.682+0000 7fb5c7400640 1 -- 172.21.15.152:0/4272571988 learned_addr learned my addr 172.21.15.152:0/4272571988 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:01.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.682+0000 7fb5c6a00640 1 --2- 172.21.15.152:0/4272571988 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5c80b3c00 0x7fb5c8154090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.682+0000 7fb5c7400640 1 -- 172.21.15.152:0/4272571988 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb5c815e210 msgr2=0x7fb5c814a230 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-17T08:47:01.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.682+0000 7fb5c7400640 1 --2- 172.21.15.152:0/4272571988 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb5c815e210 0x7fb5c814a230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.682+0000 7fb5c7400640 1 -- 172.21.15.152:0/4272571988 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5c80b3c00 msgr2=0x7fb5c8154090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.682+0000 7fb5c7400640 1 --2- 172.21.15.152:0/4272571988 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5c80b3c00 0x7fb5c8154090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.682+0000 7fb5c7400640 1 -- 172.21.15.152:0/4272571988 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5c809e010 con 0x7fb5c814ad90 2024-04-17T08:47:01.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.682+0000 7fb5c6a00640 1 --2- 172.21.15.152:0/4272571988 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5c80b3c00 0x7fb5c8154090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:01.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.686+0000 7f163f200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f16400b3d40 0x7f16400b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.686+0000 7f163f200640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f16400b22f0 0x7f164006dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.686+0000 7f163f200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16400adcb0 con 0x7f164015a630 2024-04-17T08:47:01.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.686+0000 7f163f200640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f16400b2760 con 0x7f16400b22f0 2024-04-17T08:47:01.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.686+0000 7f163f200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f16400adf90 con 0x7f16400b3d40 2024-04-17T08:47:01.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.686+0000 7fb5c7400640 1 --2- 172.21.15.152:0/4272571988 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb5c814ad90 0x7fb5c814a770 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb5c000efc0 tx=0x7fb5c000c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.686+0000 7f163de00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f164015a630 0x7f164015aa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.152:43216/0 (socket says 172.21.15.152:43216) 2024-04-17T08:47:01.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.686+0000 7f163de00640 1 -- 172.21.15.152:0/2143821872 learned_addr learned my addr 172.21.15.152:0/2143821872 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:01.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.686+0000 7f163e800640 1 --2- 172.21.15.152:0/2143821872 >> v2:172.21.15.152:3300/0 conn(0x7f16400b22f0 0x7f164006dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.686+0000 7fb5bea00640 1 -- 172.21.15.152:0/4272571988 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c0018020 con 0x7fb5c814ad90 2024-04-17T08:47:01.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.686+0000 7fb5bea00640 1 -- 172.21.15.152:0/4272571988 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5c0014480 con 0x7fb5c814ad90 2024-04-17T08:47:01.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.686+0000 7f163d400640 1 --2- 172.21.15.152:0/2143821872 >> v2:172.21.15.196:3300/0 conn(0x7f16400b3d40 0x7f16400b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.686+0000 7f163ca00640 1 -- 172.21.15.152:0/2143821872 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3651974847 0 0) 0x7f16400adcb0 con 0x7f164015a630 2024-04-17T08:47:01.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.686+0000 7f163ca00640 1 -- 172.21.15.152:0/2143821872 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1624003530 con 0x7f164015a630 2024-04-17T08:47:01.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.686+0000 7f163ca00640 1 -- 172.21.15.152:0/2143821872 <== mon.1 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1793283667 0 0) 0x7f1624003530 con 0x7f164015a630 2024-04-17T08:47:01.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.686+0000 7fb5bea00640 1 -- 172.21.15.152:0/4272571988 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c0009e60 con 0x7fb5c814ad90 2024-04-17T08:47:01.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.686+0000 7fb5cd600640 1 -- 172.21.15.152:0/4272571988 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5c80ad430 con 0x7fb5c814ad90 2024-04-17T08:47:01.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.686+0000 7fb5cd600640 1 -- 172.21.15.152:0/4272571988 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5c80ad9f0 con 0x7fb5c814ad90 2024-04-17T08:47:01.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.686+0000 7f163ca00640 1 -- 172.21.15.152:0/2143821872 >> v2:172.21.15.196:3300/0 conn(0x7f16400b3d40 msgr2=0x7f16400b1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:01.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.686+0000 7f163ca00640 1 --2- 172.21.15.152:0/2143821872 >> v2:172.21.15.196:3300/0 conn(0x7f16400b3d40 0x7f16400b1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.686+0000 7f163ca00640 1 -- 172.21.15.152:0/2143821872 >> v2:172.21.15.152:3300/0 conn(0x7f16400b22f0 msgr2=0x7f164006dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:01.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.686+0000 7f163ca00640 1 --2- 172.21.15.152:0/2143821872 >> v2:172.21.15.152:3300/0 conn(0x7f16400b22f0 0x7f164006dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.686+0000 7f163ca00640 1 -- 172.21.15.152:0/2143821872 --> v1:172.21.15.196:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16400ae270 con 0x7f164015a630 2024-04-17T08:47:01.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.686+0000 7f163ca00640 1 -- 172.21.15.152:0/2143821872 <== mon.1 v1:172.21.15.196:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2973887244 0 0) 0x7f1630001680 con 0x7f164015a630 2024-04-17T08:47:01.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.686+0000 7f163ca00640 1 -- 172.21.15.152:0/2143821872 >> v1:172.21.15.196:6789/0 conn(0x7f164015a630 legacy=0x7f164015aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.686+0000 7f163ca00640 1 --2- 172.21.15.152:0/2143821872 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f16240039c0 0x7f1624003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.686+0000 7f163ca00640 1 --2- 172.21.15.152:0/2143821872 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1624004810 0x7f1624004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.686+0000 7f163ca00640 1 --2- 172.21.15.152:0/2143821872 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f16240051d0 0x7f162400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.686+0000 7f163ca00640 1 -- 172.21.15.152:0/2143821872 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f16400b2760 con 0x7f1624004810 2024-04-17T08:47:01.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.686+0000 7f163ca00640 1 -- 172.21.15.152:0/2143821872 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f16400adf90 con 0x7f16240051d0 2024-04-17T08:47:01.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.686+0000 7f163ca00640 1 -- 172.21.15.152:0/2143821872 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f162400c150 con 0x7f16240039c0 2024-04-17T08:47:01.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.686+0000 7f163d400640 1 --2- 172.21.15.152:0/2143821872 >> v2:172.21.15.196:3300/0 conn(0x7f16400b3d40 0x7f16400b1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:01.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.686+0000 7f163e800640 1 --2- 172.21.15.152:0/2143821872 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f16240051d0 0x7f162400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.686+0000 7f163de00640 1 --2- 172.21.15.152:0/2143821872 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f16240039c0 0x7f1624003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.690+0000 7fb5b3e00640 1 -- 172.21.15.152:0/4272571988 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5a00052a0 con 0x7fb5c814ad90 2024-04-17T08:47:01.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.690+0000 7fb5bea00640 1 -- 172.21.15.152:0/4272571988 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb5c001b020 con 0x7fb5c814ad90 2024-04-17T08:47:01.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.690+0000 7fb5bea00640 1 --2- 172.21.15.152:0/4272571988 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb5a8068450 0x7fb5a806a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.690+0000 7fb5bea00640 1 -- 172.21.15.152:0/4272571988 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb5c0087a90 con 0x7fb5c814ad90 2024-04-17T08:47:01.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.690+0000 7f163e800640 1 -- 172.21.15.152:0/2143821872 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f16240039c0 msgr2=0x7f1624003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:01.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.690+0000 7f163e800640 1 --2- 172.21.15.152:0/2143821872 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f16240039c0 0x7f1624003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.690+0000 7f163e800640 1 -- 172.21.15.152:0/2143821872 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1624004810 msgr2=0x7f1624004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:01.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.690+0000 7f163e800640 1 --2- 172.21.15.152:0/2143821872 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1624004810 0x7f1624004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.690+0000 7f163e800640 1 -- 172.21.15.152:0/2143821872 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16400ae270 con 0x7f16240051d0 2024-04-17T08:47:01.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.694+0000 7fb5c6a00640 1 --2- 172.21.15.152:0/4272571988 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb5a8068450 0x7fb5a806a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.694+0000 7f163e800640 1 -- 172.21.15.152:0/2143821872 reap_dead start 2024-04-17T08:47:01.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.694+0000 7fb5c6a00640 1 --2- 172.21.15.152:0/4272571988 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb5a8068450 0x7fb5a806a910 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb5b8007fd0 tx=0x7fb5b8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.694+0000 7f163e800640 1 --2- 172.21.15.152:0/2143821872 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f16240051d0 0x7f162400b9d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1638009bb0 tx=0x7f16380210b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23bb52052f1eec65 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.694+0000 7f163ca00640 1 -- 172.21.15.152:0/2143821872 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16380b6070 con 0x7f16240051d0 2024-04-17T08:47:01.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.694+0000 7f163ca00640 1 -- 172.21.15.152:0/2143821872 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16380b1440 con 0x7f16240051d0 2024-04-17T08:47:01.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.694+0000 7f163ca00640 1 -- 172.21.15.152:0/2143821872 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1638009bf0 con 0x7f16240051d0 2024-04-17T08:47:01.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.698+0000 7f163f200640 1 -- 172.21.15.152:0/2143821872 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f16240051d0 msgr2=0x7f162400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.698+0000 7f163f200640 1 --2- 172.21.15.152:0/2143821872 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f16240051d0 0x7f162400b9d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1638009bb0 tx=0x7f16380210b0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.694+0000 7fb5bea00640 1 -- 172.21.15.152:0/4272571988 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fb5c0022020 con 0x7fb5c814ad90 2024-04-17T08:47:01.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.698+0000 7f163f200640 1 -- 172.21.15.152:0/2143821872 shutdown_connections 2024-04-17T08:47:01.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.698+0000 7f163f200640 1 --2- 172.21.15.152:0/2143821872 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f16240051d0 0x7f162400b9d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.698+0000 7f163f200640 1 -- 172.21.15.152:0/2143821872 >> 172.21.15.152:0/2143821872 conn(0x7f16400b3220 msgr2=0x7f16400b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:01.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.698+0000 7f163f200640 1 -- 172.21.15.152:0/2143821872 shutdown_connections 2024-04-17T08:47:01.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.698+0000 7f163f200640 1 -- 172.21.15.152:0/2143821872 wait complete. 2024-04-17T08:47:01.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.702+0000 7f163f200640 1 Processor -- start 2024-04-17T08:47:01.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.702+0000 7f163f200640 1 -- start start 2024-04-17T08:47:01.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.702+0000 7f163f200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f16240051d0 0x7f1640151780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.702+0000 7f163f200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1640149510 0x7f164014b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.702+0000 7f163d400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1640149510 0x7f164014b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.702+0000 7f163d400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1640149510 0x7f164014b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46930/0 (socket says 172.21.15.152:46930) 2024-04-17T08:47:01.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.702+0000 7f163de00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f16240051d0 0x7f1640151780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.702+0000 7f163de00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f16240051d0 0x7f1640151780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.152:33642/0 (socket says 172.21.15.152:33642) 2024-04-17T08:47:01.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.702+0000 7f163d400640 1 -- 172.21.15.152:0/1643396352 learned_addr learned my addr 172.21.15.152:0/1643396352 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:01.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.706+0000 7f163f200640 1 --2- 172.21.15.152:0/1643396352 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f164014b6d0 0x7f1640146640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.706+0000 7f163f200640 1 -- 172.21.15.152:0/1643396352 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f164006e160 con 0x7f1640149510 2024-04-17T08:47:01.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.706+0000 7f163f200640 1 -- 172.21.15.152:0/1643396352 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f164006dfe0 con 0x7f164014b6d0 2024-04-17T08:47:01.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.706+0000 7f163f200640 1 -- 172.21.15.152:0/1643396352 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f164006e2e0 con 0x7f16240051d0 2024-04-17T08:47:01.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.706+0000 7f163e800640 1 --2- 172.21.15.152:0/1643396352 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f164014b6d0 0x7f1640146640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.706+0000 7f163de00640 1 -- 172.21.15.152:0/1643396352 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f164014b6d0 msgr2=0x7f1640146640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.706+0000 7f163de00640 1 --2- 172.21.15.152:0/1643396352 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f164014b6d0 0x7f1640146640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.706+0000 7f163de00640 1 -- 172.21.15.152:0/1643396352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1640149510 msgr2=0x7f164014b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.706+0000 7f163de00640 1 --2- 172.21.15.152:0/1643396352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1640149510 0x7f164014b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.706+0000 7f163de00640 1 -- 172.21.15.152:0/1643396352 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1640156460 con 0x7f16240051d0 2024-04-17T08:47:01.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.706+0000 7f163e800640 1 --2- 172.21.15.152:0/1643396352 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f164014b6d0 0x7f1640146640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T08:47:01.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.706+0000 7f163d400640 1 --2- 172.21.15.152:0/1643396352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1640149510 0x7f164014b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T08:47:01.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.706+0000 7f163de00640 1 --2- 172.21.15.152:0/1643396352 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f16240051d0 0x7f1640151780 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1630001060 tx=0x7f16300077f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.706+0000 7f1636000640 1 -- 172.21.15.152:0/1643396352 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163000fa20 con 0x7f16240051d0 2024-04-17T08:47:01.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.706+0000 7f1636000640 1 -- 172.21.15.152:0/1643396352 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1630018070 con 0x7f16240051d0 2024-04-17T08:47:01.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.706+0000 7f1636000640 1 -- 172.21.15.152:0/1643396352 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163000fe20 con 0x7f16240051d0 2024-04-17T08:47:01.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.706+0000 7f163f200640 1 -- 172.21.15.152:0/1643396352 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16401499a0 con 0x7f16240051d0 2024-04-17T08:47:01.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.706+0000 7f163f200640 1 -- 172.21.15.152:0/1643396352 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f16401569e0 con 0x7f16240051d0 2024-04-17T08:47:01.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.710+0000 7f1636000640 1 -- 172.21.15.152:0/1643396352 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f163001d460 con 0x7f16240051d0 2024-04-17T08:47:01.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.710+0000 7f163f200640 1 -- 172.21.15.152:0/1643396352 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1640075be0 con 0x7f16240051d0 2024-04-17T08:47:01.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.710+0000 7f1636000640 1 --2- 172.21.15.152:0/1643396352 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1620068380 0x7f162006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:01.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.714+0000 7f1636000640 1 -- 172.21.15.152:0/1643396352 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f1630086d40 con 0x7f16240051d0 2024-04-17T08:47:01.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.714+0000 7f163d400640 1 --2- 172.21.15.152:0/1643396352 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1620068380 0x7f162006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:01.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.718+0000 7f1636000640 1 -- 172.21.15.152:0/1643396352 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f1630056960 con 0x7f16240051d0 2024-04-17T08:47:01.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.722+0000 7f163d400640 1 --2- 172.21.15.152:0/1643396352 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1620068380 0x7f162006a840 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f16401488c0 tx=0x7f162c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:01.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.974+0000 7f3e17e00640 1 -- 172.21.15.152:0/4094150121 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f3e10033710 con 0x7f3dfc005c00 2024-04-17T08:47:01.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.982+0000 7f3e0ea00640 1 -- 172.21.15.152:0/4094150121 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3e040f0ca0 con 0x7f3dfc005c00 2024-04-17T08:47:01.982 INFO:teuthology.orchestra.run.smithi152.stdout:55834574858 2024-04-17T08:47:01.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.986+0000 7f3e17e00640 1 -- 172.21.15.152:0/4094150121 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3df80683b0 msgr2=0x7f3df806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.986+0000 7f3e17e00640 1 --2- 172.21.15.152:0/4094150121 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3df80683b0 0x7f3df806a870 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3e08001810 tx=0x7f3e08009040 comp rx=0 tx=0).stop 2024-04-17T08:47:01.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.986+0000 7f3e17e00640 1 -- 172.21.15.152:0/4094150121 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3dfc005c00 msgr2=0x7f3e100cd050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.986+0000 7f3e17e00640 1 --2- 172.21.15.152:0/4094150121 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3dfc005c00 0x7f3e100cd050 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3e04000c10 tx=0x7f3dfc007a50 comp rx=0 tx=0).stop 2024-04-17T08:47:01.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.986+0000 7f3e17e00640 1 -- 172.21.15.152:0/4094150121 shutdown_connections 2024-04-17T08:47:01.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.986+0000 7f3e17e00640 1 --2- 172.21.15.152:0/4094150121 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e10050660 0x7f3e10050ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.986+0000 7f3e17e00640 1 --2- 172.21.15.152:0/4094150121 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3e10048ea0 0x7f3e10049300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.986+0000 7f3e17e00640 1 --2- 172.21.15.152:0/4094150121 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3df80683b0 0x7f3df806a870 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.986+0000 7f3e17e00640 1 --2- 172.21.15.152:0/4094150121 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3dfc005c00 0x7f3e100cd050 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.986+0000 7f3e17e00640 1 -- 172.21.15.152:0/4094150121 >> 172.21.15.152:0/4094150121 conn(0x7f3e10009fc0 msgr2=0x7f3e10034530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:01.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.986+0000 7f3e17e00640 1 -- 172.21.15.152:0/4094150121 shutdown_connections 2024-04-17T08:47:01.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.986+0000 7f3e17e00640 1 -- 172.21.15.152:0/4094150121 wait complete. 2024-04-17T08:47:01.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.990+0000 7f4649600640 1 -- 172.21.15.152:0/2464618290 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f4654068a30 con 0x7f4654162900 2024-04-17T08:47:01.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.990+0000 7f464be00640 1 -- 172.21.15.152:0/2464618290 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f46440f02a0 con 0x7f4654162900 2024-04-17T08:47:01.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.990+0000 7efe83e00640 1 -- 172.21.15.152:0/301195264 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7efe7c0ce350 con 0x7efe7c06cdc0 2024-04-17T08:47:01.995 INFO:teuthology.orchestra.run.smithi152.stdout:55834574857 2024-04-17T08:47:01.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.994+0000 7f5c4fe00640 1 -- 172.21.15.152:0/3035636935 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f5c38005860 con 0x7f5c5c0d6850 2024-04-17T08:47:01.996 INFO:teuthology.orchestra.run.smithi152.stdout:55834574859 2024-04-17T08:47:01.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.990+0000 7efe79600640 1 -- 172.21.15.152:0/301195264 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efe7005ae60 con 0x7efe7c06cdc0 2024-04-17T08:47:01.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.994+0000 7f4649600640 1 -- 172.21.15.152:0/2464618290 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f46340683d0 msgr2=0x7f463406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.994+0000 7f4649600640 1 --2- 172.21.15.152:0/2464618290 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f46340683d0 0x7f463406a890 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f464c009bc0 tx=0x7f464c009040 comp rx=0 tx=0).stop 2024-04-17T08:47:01.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.994+0000 7f4649600640 1 -- 172.21.15.152:0/2464618290 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4654162900 msgr2=0x7f46541528c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:01.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.994+0000 7f4649600640 1 --2- 172.21.15.152:0/2464618290 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4654162900 0x7f46541528c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f464401a0b0 tx=0x7f4644019220 comp rx=0 tx=0).stop 2024-04-17T08:47:01.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.994+0000 7f5c5aa00640 1 -- 172.21.15.152:0/3035636935 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5c50101c50 con 0x7f5c5c0d6850 2024-04-17T08:47:01.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.994+0000 7f4649600640 1 -- 172.21.15.152:0/2464618290 shutdown_connections 2024-04-17T08:47:01.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.994+0000 7f4649600640 1 --2- 172.21.15.152:0/2464618290 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4654152e00 0x7f465415da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.994+0000 7f4649600640 1 --2- 172.21.15.152:0/2464618290 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f46340683d0 0x7f463406a890 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.998 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.994+0000 7f4649600640 1 --2- 172.21.15.152:0/2464618290 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4654162900 0x7f46541528c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.998 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.994+0000 7f4649600640 1 --2- 172.21.15.152:0/2464618290 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f465406f190 0x7f4654152220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:01.998 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.994+0000 7f4649600640 1 -- 172.21.15.152:0/2464618290 >> 172.21.15.152:0/2464618290 conn(0x7f46540b3350 msgr2=0x7f46540b0800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:01.998 INFO:teuthology.orchestra.run.smithi152.stdout:55834574859 2024-04-17T08:47:01.998 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.994+0000 7f4649600640 1 -- 172.21.15.152:0/2464618290 shutdown_connections 2024-04-17T08:47:01.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.994+0000 7f4649600640 1 -- 172.21.15.152:0/2464618290 wait complete. 2024-04-17T08:47:02.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.998+0000 7efe83e00640 1 -- 172.21.15.152:0/301195264 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7efe5c0683b0 msgr2=0x7efe5c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:02.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.998+0000 7efe83e00640 1 --2- 172.21.15.152:0/301195264 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7efe5c0683b0 0x7efe5c06a870 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7efe680ae000 tx=0x7efe680a6040 comp rx=0 tx=0).stop 2024-04-17T08:47:02.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.998+0000 7efe83e00640 1 -- 172.21.15.152:0/301195264 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efe7c06cdc0 msgr2=0x7efe7c0b5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:02.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.998+0000 7efe83e00640 1 --2- 172.21.15.152:0/301195264 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efe7c06cdc0 0x7efe7c0b5e50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7efe7000e890 tx=0x7efe7000ed50 comp rx=0 tx=0).stop 2024-04-17T08:47:02.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.998+0000 7efe83e00640 1 -- 172.21.15.152:0/301195264 shutdown_connections 2024-04-17T08:47:02.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.998+0000 7efe83e00640 1 --2- 172.21.15.152:0/301195264 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe7c166aa0 0x7efe7c0b34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:02.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.998+0000 7efe83e00640 1 --2- 172.21.15.152:0/301195264 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efe7c0cffd0 0x7efe7c146620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:02.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.998+0000 7efe83e00640 1 --2- 172.21.15.152:0/301195264 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7efe5c0683b0 0x7efe5c06a870 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:02.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.998+0000 7efe83e00640 1 --2- 172.21.15.152:0/301195264 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efe7c06cdc0 0x7efe7c0b5e50 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:02.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.998+0000 7efe83e00640 1 -- 172.21.15.152:0/301195264 >> 172.21.15.152:0/301195264 conn(0x7efe7c0ccfe0 msgr2=0x7efe7c1641a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:02.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.998+0000 7efe83e00640 1 -- 172.21.15.152:0/301195264 shutdown_connections 2024-04-17T08:47:02.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.998+0000 7efe83e00640 1 -- 172.21.15.152:0/301195264 wait complete. 2024-04-17T08:47:02.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.998+0000 7f5c4fe00640 1 -- 172.21.15.152:0/3035636935 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5c44068400 msgr2=0x7f5c4406a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:02.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.998+0000 7f5c4fe00640 1 --2- 172.21.15.152:0/3035636935 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5c44068400 0x7f5c4406a8c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5c54001210 tx=0x7f5c54001120 comp rx=0 tx=0).stop 2024-04-17T08:47:02.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.998+0000 7f5c4fe00640 1 -- 172.21.15.152:0/3035636935 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5c5c0d6850 msgr2=0x7f5c5c0d6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:02.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.998+0000 7f5c4fe00640 1 --2- 172.21.15.152:0/3035636935 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5c5c0d6850 0x7f5c5c0d6cd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5c480056c0 tx=0x7f5c48005840 comp rx=0 tx=0).stop 2024-04-17T08:47:02.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.998+0000 7f5c4fe00640 1 -- 172.21.15.152:0/3035636935 shutdown_connections 2024-04-17T08:47:02.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.998+0000 7f5c4fe00640 1 --2- 172.21.15.152:0/3035636935 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5c5c0d6850 0x7f5c5c0d6cd0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:02.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.998+0000 7f5c4fe00640 1 --2- 172.21.15.152:0/3035636935 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5c44068400 0x7f5c4406a8c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:02.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.998+0000 7f5c4fe00640 1 --2- 172.21.15.152:0/3035636935 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5c5c04ef00 0x7f5c5c0d8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:02.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.998+0000 7f5c4fe00640 1 --2- 172.21.15.152:0/3035636935 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c48004e70 0x7f5c5c0d0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:02.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.998+0000 7f5c4fe00640 1 -- 172.21.15.152:0/3035636935 >> 172.21.15.152:0/3035636935 conn(0x7f5c5c0559f0 msgr2=0x7f5c5c0e7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:02.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.998+0000 7f5c4fe00640 1 -- 172.21.15.152:0/3035636935 shutdown_connections 2024-04-17T08:47:02.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:01.998+0000 7f5c4fe00640 1 -- 172.21.15.152:0/3035636935 wait complete. 2024-04-17T08:47:02.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.002+0000 7ff4e6000640 1 -- 172.21.15.152:0/1089103913 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7ff4f00ae0b0 con 0x7ff4f00736b0 2024-04-17T08:47:02.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.002+0000 7ff4ecc00640 1 -- 172.21.15.152:0/1089103913 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff4e805a9e0 con 0x7ff4f00736b0 2024-04-17T08:47:02.006 INFO:teuthology.orchestra.run.smithi152.stdout:55834574858 2024-04-17T08:47:02.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.006+0000 7fb6a9600640 1 -- 172.21.15.152:0/2245180472 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fb6a40b5fe0 con 0x7fb6a40b0700 2024-04-17T08:47:02.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.006+0000 7fb6a0c00640 1 -- 172.21.15.152:0/2245180472 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb69405aa60 con 0x7fb6a40b0700 2024-04-17T08:47:02.007 INFO:teuthology.orchestra.run.smithi152.stdout:55834574858 2024-04-17T08:47:02.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.010+0000 7ff4e6000640 1 -- 172.21.15.152:0/1089103913 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7ff4cc068380 msgr2=0x7ff4cc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:02.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.010+0000 7ff4e6000640 1 --2- 172.21.15.152:0/1089103913 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7ff4cc068380 0x7ff4cc06a840 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff4e000c2e0 tx=0x7ff4e00a8070 comp rx=0 tx=0).stop 2024-04-17T08:47:02.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.010+0000 7ff4e6000640 1 -- 172.21.15.152:0/1089103913 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4f00736b0 msgr2=0x7ff4f01413c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:02.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.010+0000 7ff4e6000640 1 --2- 172.21.15.152:0/1089103913 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4f00736b0 0x7ff4f01413c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff4e800c7c0 tx=0x7ff4e800cc80 comp rx=0 tx=0).stop 2024-04-17T08:47:02.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.010+0000 7fb6a9600640 1 -- 172.21.15.152:0/2245180472 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb680068380 msgr2=0x7fb68006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:02.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.010+0000 7fb6a9600640 1 --2- 172.21.15.152:0/2245180472 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb680068380 0x7fb68006a840 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb68c0ad000 tx=0x7fb68c0a6000 comp rx=0 tx=0).stop 2024-04-17T08:47:02.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.010+0000 7fb6a9600640 1 -- 172.21.15.152:0/2245180472 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6a40b0700 msgr2=0x7fb6a4154e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:02.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.010+0000 7fb6a9600640 1 --2- 172.21.15.152:0/2245180472 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6a40b0700 0x7fb6a4154e40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb69400c7f0 tx=0x7fb69400ccb0 comp rx=0 tx=0).stop 2024-04-17T08:47:02.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.010+0000 7ff4e6000640 1 -- 172.21.15.152:0/1089103913 shutdown_connections 2024-04-17T08:47:02.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.010+0000 7ff4e6000640 1 --2- 172.21.15.152:0/1089103913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4f0143df0 0x7ff4f0159ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:02.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.010+0000 7ff4e6000640 1 --2- 172.21.15.152:0/1089103913 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7ff4cc068380 0x7ff4cc06a840 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:02.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.010+0000 7ff4e6000640 1 --2- 172.21.15.152:0/1089103913 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff4f00b34c0 0x7ff4f015f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:02.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.010+0000 7ff4e6000640 1 --2- 172.21.15.152:0/1089103913 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4f00736b0 0x7ff4f01413c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:02.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.010+0000 7ff4e6000640 1 -- 172.21.15.152:0/1089103913 >> 172.21.15.152:0/1089103913 conn(0x7ff4f00d0050 msgr2=0x7ff4f015d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:02.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.010+0000 7ff4e6000640 1 -- 172.21.15.152:0/1089103913 shutdown_connections 2024-04-17T08:47:02.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.010+0000 7ff4e6000640 1 -- 172.21.15.152:0/1089103913 wait complete. 2024-04-17T08:47:02.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.010+0000 7fb6a9600640 1 -- 172.21.15.152:0/2245180472 shutdown_connections 2024-04-17T08:47:02.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.010+0000 7fb6a9600640 1 --2- 172.21.15.152:0/2245180472 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb680068380 0x7fb68006a840 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:02.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.010+0000 7fb6a9600640 1 --2- 172.21.15.152:0/2245180472 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb6a4204390 0x7fb6a4204840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:02.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.010+0000 7fb6a9600640 1 --2- 172.21.15.152:0/2245180472 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb6a40cfb10 0x7fb6a406c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:02.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.010+0000 7fb6a9600640 1 --2- 172.21.15.152:0/2245180472 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6a40b0700 0x7fb6a4154e40 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:02.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.010+0000 7fb6a9600640 1 -- 172.21.15.152:0/2245180472 >> 172.21.15.152:0/2245180472 conn(0x7fb6a40d1140 msgr2=0x7fb6a40b0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:02.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.010+0000 7fb6a9600640 1 -- 172.21.15.152:0/2245180472 shutdown_connections 2024-04-17T08:47:02.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.010+0000 7fb6a9600640 1 -- 172.21.15.152:0/2245180472 wait complete. 2024-04-17T08:47:02.028 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.5 2024-04-17T08:47:02.028 DEBUG:teuthology.parallel:result is None 2024-04-17T08:47:02.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.034+0000 7fb5b3e00640 1 -- 172.21.15.152:0/4272571988 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fb5a0005590 con 0x7fb5c814ad90 2024-04-17T08:47:02.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.038+0000 7fb5bea00640 1 -- 172.21.15.152:0/4272571988 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb5c0022020 con 0x7fb5c814ad90 2024-04-17T08:47:02.039 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.0 2024-04-17T08:47:02.039 DEBUG:teuthology.parallel:result is None 2024-04-17T08:47:02.042 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.3 2024-04-17T08:47:02.043 INFO:teuthology.orchestra.run.smithi152.stdout:55834574858 2024-04-17T08:47:02.043 DEBUG:teuthology.parallel:result is None 2024-04-17T08:47:02.043 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.1 2024-04-17T08:47:02.043 DEBUG:teuthology.parallel:result is None 2024-04-17T08:47:02.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.042+0000 7fb5b3e00640 1 -- 172.21.15.152:0/4272571988 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb5a8068450 msgr2=0x7fb5a806a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:02.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.042+0000 7fb5b3e00640 1 --2- 172.21.15.152:0/4272571988 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb5a8068450 0x7fb5a806a910 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb5b8007fd0 tx=0x7fb5b8009040 comp rx=0 tx=0).stop 2024-04-17T08:47:02.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.042+0000 7fb5b3e00640 1 -- 172.21.15.152:0/4272571988 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb5c814ad90 msgr2=0x7fb5c814a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:02.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.042+0000 7fb5b3e00640 1 --2- 172.21.15.152:0/4272571988 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb5c814ad90 0x7fb5c814a770 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb5c000efc0 tx=0x7fb5c000c490 comp rx=0 tx=0).stop 2024-04-17T08:47:02.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.046+0000 7fb5b3e00640 1 -- 172.21.15.152:0/4272571988 shutdown_connections 2024-04-17T08:47:02.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.046+0000 7fb5b3e00640 1 --2- 172.21.15.152:0/4272571988 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb5a8068450 0x7fb5a806a910 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:02.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.046+0000 7fb5b3e00640 1 --2- 172.21.15.152:0/4272571988 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb5c814ad90 0x7fb5c814a770 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:02.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.046+0000 7fb5b3e00640 1 --2- 172.21.15.152:0/4272571988 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb5c815e210 0x7fb5c814a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:02.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.046+0000 7fb5b3e00640 1 --2- 172.21.15.152:0/4272571988 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5c80b3c00 0x7fb5c8154090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:02.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.046+0000 7fb5b3e00640 1 -- 172.21.15.152:0/4272571988 >> 172.21.15.152:0/4272571988 conn(0x7fb5c8072140 msgr2=0x7fb5c815c730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:02.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.046+0000 7fb5b3e00640 1 -- 172.21.15.152:0/4272571988 shutdown_connections 2024-04-17T08:47:02.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.046+0000 7fb5b3e00640 1 -- 172.21.15.152:0/4272571988 wait complete. 2024-04-17T08:47:02.049 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.4 2024-04-17T08:47:02.049 DEBUG:teuthology.parallel:result is None 2024-04-17T08:47:02.051 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.2 2024-04-17T08:47:02.051 DEBUG:teuthology.parallel:result is None 2024-04-17T08:47:02.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.054+0000 7f163f200640 1 -- 172.21.15.152:0/1643396352 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f1640149ce0 con 0x7f16240051d0 2024-04-17T08:47:02.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.054+0000 7f1636000640 1 -- 172.21.15.152:0/1643396352 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f163005ac60 con 0x7f16240051d0 2024-04-17T08:47:02.055 INFO:teuthology.orchestra.run.smithi152.stdout:55834574858 2024-04-17T08:47:02.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.058+0000 7f163f200640 1 -- 172.21.15.152:0/1643396352 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1620068380 msgr2=0x7f162006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:02.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.058+0000 7f163f200640 1 --2- 172.21.15.152:0/1643396352 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1620068380 0x7f162006a840 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f16401488c0 tx=0x7f162c008040 comp rx=0 tx=0).stop 2024-04-17T08:47:02.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.058+0000 7f163f200640 1 -- 172.21.15.152:0/1643396352 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f16240051d0 msgr2=0x7f1640151780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:02.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.058+0000 7f163f200640 1 --2- 172.21.15.152:0/1643396352 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f16240051d0 0x7f1640151780 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1630001060 tx=0x7f16300077f0 comp rx=0 tx=0).stop 2024-04-17T08:47:02.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.058+0000 7f163f200640 1 -- 172.21.15.152:0/1643396352 shutdown_connections 2024-04-17T08:47:02.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.058+0000 7f163f200640 1 --2- 172.21.15.152:0/1643396352 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f164014b6d0 0x7f1640146640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:02.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.058+0000 7f163f200640 1 --2- 172.21.15.152:0/1643396352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1640149510 0x7f164014b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:02.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.058+0000 7f163f200640 1 --2- 172.21.15.152:0/1643396352 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1620068380 0x7f162006a840 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:02.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.058+0000 7f163f200640 1 --2- 172.21.15.152:0/1643396352 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f16240051d0 0x7f1640151780 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:02.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.058+0000 7f163f200640 1 -- 172.21.15.152:0/1643396352 >> 172.21.15.152:0/1643396352 conn(0x7f16400b3220 msgr2=0x7f16400b0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:02.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.058+0000 7f163f200640 1 -- 172.21.15.152:0/1643396352 shutdown_connections 2024-04-17T08:47:02.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.058+0000 7f163f200640 1 -- 172.21.15.152:0/1643396352 wait complete. 2024-04-17T08:47:02.071 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.6 2024-04-17T08:47:02.071 DEBUG:teuthology.parallel:result is None 2024-04-17T08:47:02.080 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.7 2024-04-17T08:47:02.080 DEBUG:teuthology.parallel:result is None 2024-04-17T08:47:02.080 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-17T08:47:02.081 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T08:47:02.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.254+0000 7f1a89c00640 1 Processor -- start 2024-04-17T08:47:02.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.254+0000 7f1a89c00640 1 -- start start 2024-04-17T08:47:02.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.254+0000 7f1a89c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1a8415a010 0x7f1a840d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:02.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.254+0000 7f1a89c00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f1a8415d710 0x7f1a840d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:02.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.254+0000 7f1a89c00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f1a84160010 0x7f1a84160480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:02.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.254+0000 7f1a89c00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f1a8415d280 con 0x7f1a84160010 2024-04-17T08:47:02.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.254+0000 7f1a89c00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f1a8415c9d0 con 0x7f1a8415d710 2024-04-17T08:47:02.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.254+0000 7f1a89c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f1a84160d20 con 0x7f1a8415a010 2024-04-17T08:47:02.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.254+0000 7f1a83400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f1a84160010 0x7f1a84160480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:02.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.254+0000 7f1a83400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f1a84160010 0x7f1a84160480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46932/0 (socket says 172.21.15.152:46932) 2024-04-17T08:47:02.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.254+0000 7f1a83400640 1 -- 172.21.15.152:0/3224823681 learned_addr learned my addr 172.21.15.152:0/3224823681 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:02.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.254+0000 7f1a82000640 1 --2- 172.21.15.152:0/3224823681 >> v2:172.21.15.196:3300/0 conn(0x7f1a8415d710 0x7f1a840d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:02.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.254+0000 7f1a82a00640 1 --2- 172.21.15.152:0/3224823681 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1a8415a010 0x7f1a840d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:02.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.254+0000 7f1a83400640 1 -- 172.21.15.152:0/3224823681 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1a8415a010 msgr2=0x7f1a840d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:02.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.254+0000 7f1a83400640 1 --2- 172.21.15.152:0/3224823681 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1a8415a010 0x7f1a840d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:02.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.254+0000 7f1a83400640 1 -- 172.21.15.152:0/3224823681 >> v2:172.21.15.196:3300/0 conn(0x7f1a8415d710 msgr2=0x7f1a840d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:02.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.254+0000 7f1a83400640 1 --2- 172.21.15.152:0/3224823681 >> v2:172.21.15.196:3300/0 conn(0x7f1a8415d710 0x7f1a840d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:02.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.254+0000 7f1a83400640 1 -- 172.21.15.152:0/3224823681 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a8415cc30 con 0x7f1a84160010 2024-04-17T08:47:02.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.258+0000 7f1a83400640 1 --2- 172.21.15.152:0/3224823681 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a84160010 0x7f1a84160480 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1a8406fec0 tx=0x7f1a7c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3451f4818fcfaae6 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:02.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.258+0000 7f1a81600640 1 -- 172.21.15.152:0/3224823681 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c0b0070 con 0x7f1a84160010 2024-04-17T08:47:02.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.258+0000 7f1a81600640 1 -- 172.21.15.152:0/3224823681 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a7c0ab600 con 0x7f1a84160010 2024-04-17T08:47:02.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.258+0000 7f1a81600640 1 -- 172.21.15.152:0/3224823681 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c0ab9d0 con 0x7f1a84160010 2024-04-17T08:47:02.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.258+0000 7f1a89c00640 1 -- 172.21.15.152:0/3224823681 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a84160010 msgr2=0x7f1a84160480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:02.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.258+0000 7f1a89c00640 1 --2- 172.21.15.152:0/3224823681 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a84160010 0x7f1a84160480 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1a8406fec0 tx=0x7f1a7c01c490 comp rx=0 tx=0).stop 2024-04-17T08:47:02.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.258+0000 7f1a89c00640 1 -- 172.21.15.152:0/3224823681 shutdown_connections 2024-04-17T08:47:02.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.258+0000 7f1a89c00640 1 --2- 172.21.15.152:0/3224823681 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a84160010 0x7f1a84160480 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:02.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.258+0000 7f1a89c00640 1 --2- 172.21.15.152:0/3224823681 >> v2:172.21.15.196:3300/0 conn(0x7f1a8415d710 0x7f1a840d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:02.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.258+0000 7f1a89c00640 1 --2- 172.21.15.152:0/3224823681 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1a8415a010 0x7f1a840d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:02.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.258+0000 7f1a89c00640 1 -- 172.21.15.152:0/3224823681 >> 172.21.15.152:0/3224823681 conn(0x7f1a840b3350 msgr2=0x7f1a840b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:02.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.258+0000 7f1a89c00640 1 -- 172.21.15.152:0/3224823681 shutdown_connections 2024-04-17T08:47:02.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.258+0000 7f1a89c00640 1 -- 172.21.15.152:0/3224823681 wait complete. 2024-04-17T08:47:02.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.262+0000 7f1a89c00640 1 Processor -- start 2024-04-17T08:47:02.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.262+0000 7f1a89c00640 1 -- start start 2024-04-17T08:47:02.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.262+0000 7f1a89c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1a8415a010 0x7f1a8415e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:02.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.262+0000 7f1a89c00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a8415d710 0x7f1a84156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:02.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.262+0000 7f1a89c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1a84160010 0x7f1a84157410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:02.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.262+0000 7f1a89c00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1a8406c340 con 0x7f1a8415d710 2024-04-17T08:47:02.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.262+0000 7f1a89c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1a8406c1c0 con 0x7f1a8415a010 2024-04-17T08:47:02.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.262+0000 7f1a89c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f1a8406c4c0 con 0x7f1a84160010 2024-04-17T08:47:02.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.262+0000 7f1a82000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a8415d710 0x7f1a84156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:02.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.262+0000 7f1a82000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a8415d710 0x7f1a84156ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46940/0 (socket says 172.21.15.152:46940) 2024-04-17T08:47:02.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.262+0000 7f1a82000640 1 -- 172.21.15.152:0/2609065495 learned_addr learned my addr 172.21.15.152:0/2609065495 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:02.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.262+0000 7f1a82a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1a8415a010 0x7f1a8415e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:02.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.262+0000 7f1a83400640 1 --2- 172.21.15.152:0/2609065495 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1a84160010 0x7f1a84157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:02.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.262+0000 7f1a82000640 1 -- 172.21.15.152:0/2609065495 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1a84160010 msgr2=0x7f1a84157410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:02.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.262+0000 7f1a82000640 1 --2- 172.21.15.152:0/2609065495 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1a84160010 0x7f1a84157410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:02.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.262+0000 7f1a82000640 1 -- 172.21.15.152:0/2609065495 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1a8415a010 msgr2=0x7f1a8415e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:02.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.262+0000 7f1a82000640 1 --2- 172.21.15.152:0/2609065495 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1a8415a010 0x7f1a8415e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:02.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.262+0000 7f1a82000640 1 -- 172.21.15.152:0/2609065495 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a840693b0 con 0x7f1a8415d710 2024-04-17T08:47:02.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.262+0000 7f1a82a00640 1 --2- 172.21.15.152:0/2609065495 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1a8415a010 0x7f1a8415e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T08:47:02.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.262+0000 7f1a82000640 1 --2- 172.21.15.152:0/2609065495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a8415d710 0x7f1a84156ed0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c00e960 tx=0x7f1a6c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:02.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.262+0000 7f1a7aa00640 1 -- 172.21.15.152:0/2609065495 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c017070 con 0x7f1a8415d710 2024-04-17T08:47:02.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.262+0000 7f1a7aa00640 1 -- 172.21.15.152:0/2609065495 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a6c00ca00 con 0x7f1a8415d710 2024-04-17T08:47:02.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.262+0000 7f1a7aa00640 1 -- 172.21.15.152:0/2609065495 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c00cdb0 con 0x7f1a8415d710 2024-04-17T08:47:02.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.262+0000 7f1a89c00640 1 -- 172.21.15.152:0/2609065495 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a8415edf0 con 0x7f1a8415d710 2024-04-17T08:47:02.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.262+0000 7f1a89c00640 1 -- 172.21.15.152:0/2609065495 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a84157d20 con 0x7f1a8415d710 2024-04-17T08:47:02.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.266+0000 7f1a89c00640 1 -- 172.21.15.152:0/2609065495 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a84150520 con 0x7f1a8415d710 2024-04-17T08:47:02.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.266+0000 7f1a7aa00640 1 -- 172.21.15.152:0/2609065495 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1a6c01a070 con 0x7f1a8415d710 2024-04-17T08:47:02.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.266+0000 7f1a7aa00640 1 --2- 172.21.15.152:0/2609065495 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1a60068380 0x7f1a6006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:02.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.266+0000 7f1a7aa00640 1 -- 172.21.15.152:0/2609065495 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f1a6c086c30 con 0x7f1a8415d710 2024-04-17T08:47:02.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.266+0000 7f1a82a00640 1 --2- 172.21.15.152:0/2609065495 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1a60068380 0x7f1a6006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:02.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.266+0000 7f1a82a00640 1 --2- 172.21.15.152:0/2609065495 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1a60068380 0x7f1a6006a840 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1a7400e740 tx=0x7f1a7400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:02.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.270+0000 7f1a7aa00640 1 -- 172.21.15.152:0/2609065495 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f1a84150520 con 0x7f1a8415d710 2024-04-17T08:47:02.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.430+0000 7f1a89c00640 1 -- 172.21.15.152:0/2609065495 --> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1a84068a30 con 0x7f1a60068380 2024-04-17T08:47:02.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.438+0000 7f1a7aa00640 1 -- 172.21.15.152:0/2609065495 <== mgr.4104 v2:172.21.15.152:6832/3078522445 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332537 (secure 0 0 0) 0x7f1a84068a30 con 0x7f1a60068380 2024-04-17T08:47:02.442 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:47:02.444 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2024-04-17T08:47:02.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.442+0000 7f1a89c00640 1 -- 172.21.15.152:0/2609065495 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1a60068380 msgr2=0x7f1a6006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:02.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.442+0000 7f1a89c00640 1 --2- 172.21.15.152:0/2609065495 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1a60068380 0x7f1a6006a840 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1a7400e740 tx=0x7f1a7400b040 comp rx=0 tx=0).stop 2024-04-17T08:47:02.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.442+0000 7f1a89c00640 1 -- 172.21.15.152:0/2609065495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a8415d710 msgr2=0x7f1a84156ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:02.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.442+0000 7f1a89c00640 1 --2- 172.21.15.152:0/2609065495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a8415d710 0x7f1a84156ed0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c00e960 tx=0x7f1a6c00ee20 comp rx=0 tx=0).stop 2024-04-17T08:47:02.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.442+0000 7f1a89c00640 1 -- 172.21.15.152:0/2609065495 shutdown_connections 2024-04-17T08:47:02.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.442+0000 7f1a89c00640 1 --2- 172.21.15.152:0/2609065495 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1a60068380 0x7f1a6006a840 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:02.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.442+0000 7f1a89c00640 1 --2- 172.21.15.152:0/2609065495 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1a84160010 0x7f1a84157410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:02.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.442+0000 7f1a89c00640 1 --2- 172.21.15.152:0/2609065495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a8415d710 0x7f1a84156ed0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:02.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.442+0000 7f1a89c00640 1 --2- 172.21.15.152:0/2609065495 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1a8415a010 0x7f1a8415e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:02.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.442+0000 7f1a89c00640 1 -- 172.21.15.152:0/2609065495 >> 172.21.15.152:0/2609065495 conn(0x7f1a840b3350 msgr2=0x7f1a841592d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:02.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.442+0000 7f1a89c00640 1 -- 172.21.15.152:0/2609065495 shutdown_connections 2024-04-17T08:47:02.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.442+0000 7f1a89c00640 1 -- 172.21.15.152:0/2609065495 wait complete. 2024-04-17T08:47:02.462 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-04-17T08:47:01.370275+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219388,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755332,"statfs":{"total":773094113280,"available":772869459968,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004461"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582361+0000","last_change":"2024-04-17T08:46:33.235434+0000","last_active":"2024-04-17T08:46:39.582361+0000","last_peered":"2024-04-17T08:46:39.582361+0000","last_clean":"2024-04-17T08:46:39.582361+0000","last_became_active":"2024-04-17T08:46:33.235164+0000","last_became_peered":"2024-04-17T08:46:33.235164+0000","last_unstale":"2024-04-17T08:46:39.582361+0000","last_undegraded":"2024-04-17T08:46:39.582361+0000","last_fullsized":"2024-04-17T08:46:39.582361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:22:07.958599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583648+0000","last_change":"2024-04-17T08:46:34.245833+0000","last_active":"2024-04-17T08:46:39.583648+0000","last_peered":"2024-04-17T08:46:39.583648+0000","last_clean":"2024-04-17T08:46:39.583648+0000","last_became_active":"2024-04-17T08:46:34.245456+0000","last_became_peered":"2024-04-17T08:46:34.245456+0000","last_unstale":"2024-04-17T08:46:39.583648+0000","last_undegraded":"2024-04-17T08:46:39.583648+0000","last_fullsized":"2024-04-17T08:46:39.583648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:11:40.376111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582185+0000","last_change":"2024-04-17T08:46:38.514450+0000","last_active":"2024-04-17T08:46:39.582185+0000","last_peered":"2024-04-17T08:46:39.582185+0000","last_clean":"2024-04-17T08:46:39.582185+0000","last_became_active":"2024-04-17T08:46:38.514041+0000","last_became_peered":"2024-04-17T08:46:38.514041+0000","last_unstale":"2024-04-17T08:46:39.582185+0000","last_undegraded":"2024-04-17T08:46:39.582185+0000","last_fullsized":"2024-04-17T08:46:39.582185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:00:35.685592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583737+0000","last_change":"2024-04-17T08:46:33.233688+0000","last_active":"2024-04-17T08:46:39.583737+0000","last_peered":"2024-04-17T08:46:39.583737+0000","last_clean":"2024-04-17T08:46:39.583737+0000","last_became_active":"2024-04-17T08:46:33.233377+0000","last_became_peered":"2024-04-17T08:46:33.233377+0000","last_unstale":"2024-04-17T08:46:39.583737+0000","last_undegraded":"2024-04-17T08:46:39.583737+0000","last_fullsized":"2024-04-17T08:46:39.583737+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:25:21.370859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582078+0000","last_change":"2024-04-17T08:46:34.255775+0000","last_active":"2024-04-17T08:46:39.582078+0000","last_peered":"2024-04-17T08:46:39.582078+0000","last_clean":"2024-04-17T08:46:39.582078+0000","last_became_active":"2024-04-17T08:46:34.255196+0000","last_became_peered":"2024-04-17T08:46:34.255196+0000","last_unstale":"2024-04-17T08:46:39.582078+0000","last_undegraded":"2024-04-17T08:46:39.582078+0000","last_fullsized":"2024-04-17T08:46:39.582078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:33:41.705987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.265703+0000","last_change":"2024-04-17T08:46:38.285336+0000","last_active":"2024-04-17T08:46:39.265703+0000","last_peered":"2024-04-17T08:46:39.265703+0000","last_clean":"2024-04-17T08:46:39.265703+0000","last_became_active":"2024-04-17T08:46:38.284905+0000","last_became_peered":"2024-04-17T08:46:38.284905+0000","last_unstale":"2024-04-17T08:46:39.265703+0000","last_undegraded":"2024-04-17T08:46:39.265703+0000","last_fullsized":"2024-04-17T08:46:39.265703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:33:14.972491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583533+0000","last_change":"2024-04-17T08:46:33.239191+0000","last_active":"2024-04-17T08:46:39.583533+0000","last_peered":"2024-04-17T08:46:39.583533+0000","last_clean":"2024-04-17T08:46:39.583533+0000","last_became_active":"2024-04-17T08:46:33.238959+0000","last_became_peered":"2024-04-17T08:46:33.238959+0000","last_unstale":"2024-04-17T08:46:39.583533+0000","last_undegraded":"2024-04-17T08:46:39.583533+0000","last_fullsized":"2024-04-17T08:46:39.583533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:45:46.167023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.266216+0000","last_change":"2024-04-17T08:46:34.251441+0000","last_active":"2024-04-17T08:46:39.266216+0000","last_peered":"2024-04-17T08:46:39.266216+0000","last_clean":"2024-04-17T08:46:39.266216+0000","last_became_active":"2024-04-17T08:46:34.251121+0000","last_became_peered":"2024-04-17T08:46:34.251121+0000","last_unstale":"2024-04-17T08:46:39.266216+0000","last_undegraded":"2024-04-17T08:46:39.266216+0000","last_fullsized":"2024-04-17T08:46:39.266216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:38:02.038788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.266419+0000","last_change":"2024-04-17T08:46:38.286397+0000","last_active":"2024-04-17T08:46:39.266419+0000","last_peered":"2024-04-17T08:46:39.266419+0000","last_clean":"2024-04-17T08:46:39.266419+0000","last_became_active":"2024-04-17T08:46:38.285683+0000","last_became_peered":"2024-04-17T08:46:38.285683+0000","last_unstale":"2024-04-17T08:46:39.266419+0000","last_undegraded":"2024-04-17T08:46:39.266419+0000","last_fullsized":"2024-04-17T08:46:39.266419+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:11:44.421115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583517+0000","last_change":"2024-04-17T08:46:33.241157+0000","last_active":"2024-04-17T08:46:39.583517+0000","last_peered":"2024-04-17T08:46:39.583517+0000","last_clean":"2024-04-17T08:46:39.583517+0000","last_became_active":"2024-04-17T08:46:33.236275+0000","last_became_peered":"2024-04-17T08:46:33.236275+0000","last_unstale":"2024-04-17T08:46:39.583517+0000","last_undegraded":"2024-04-17T08:46:39.583517+0000","last_fullsized":"2024-04-17T08:46:39.583517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:22:14.260721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.267730+0000","last_change":"2024-04-17T08:46:34.250653+0000","last_active":"2024-04-17T08:46:39.267730+0000","last_peered":"2024-04-17T08:46:39.267730+0000","last_clean":"2024-04-17T08:46:39.267730+0000","last_became_active":"2024-04-17T08:46:34.250401+0000","last_became_peered":"2024-04-17T08:46:34.250401+0000","last_unstale":"2024-04-17T08:46:39.267730+0000","last_undegraded":"2024-04-17T08:46:39.267730+0000","last_fullsized":"2024-04-17T08:46:39.267730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:58:55.513935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.266327+0000","last_change":"2024-04-17T08:46:38.282885+0000","last_active":"2024-04-17T08:46:39.266327+0000","last_peered":"2024-04-17T08:46:39.266327+0000","last_clean":"2024-04-17T08:46:39.266327+0000","last_became_active":"2024-04-17T08:46:38.282482+0000","last_became_peered":"2024-04-17T08:46:38.282482+0000","last_unstale":"2024-04-17T08:46:39.266327+0000","last_undegraded":"2024-04-17T08:46:39.266327+0000","last_fullsized":"2024-04-17T08:46:39.266327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:13:54.574905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582137+0000","last_change":"2024-04-17T08:46:34.243339+0000","last_active":"2024-04-17T08:46:39.582137+0000","last_peered":"2024-04-17T08:46:39.582137+0000","last_clean":"2024-04-17T08:46:39.582137+0000","last_became_active":"2024-04-17T08:46:34.243019+0000","last_became_peered":"2024-04-17T08:46:34.243019+0000","last_unstale":"2024-04-17T08:46:39.582137+0000","last_undegraded":"2024-04-17T08:46:39.582137+0000","last_fullsized":"2024-04-17T08:46:39.582137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:02:18.996319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583062+0000","last_change":"2024-04-17T08:46:33.236268+0000","last_active":"2024-04-17T08:46:39.583062+0000","last_peered":"2024-04-17T08:46:39.583062+0000","last_clean":"2024-04-17T08:46:39.583062+0000","last_became_active":"2024-04-17T08:46:33.235432+0000","last_became_peered":"2024-04-17T08:46:33.235432+0000","last_unstale":"2024-04-17T08:46:39.583062+0000","last_undegraded":"2024-04-17T08:46:39.583062+0000","last_fullsized":"2024-04-17T08:46:39.583062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:30:42.762461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.267184+0000","last_change":"2024-04-17T08:46:38.291945+0000","last_active":"2024-04-17T08:46:39.267184+0000","last_peered":"2024-04-17T08:46:39.267184+0000","last_clean":"2024-04-17T08:46:39.267184+0000","last_became_active":"2024-04-17T08:46:38.291516+0000","last_became_peered":"2024-04-17T08:46:38.291516+0000","last_unstale":"2024-04-17T08:46:39.267184+0000","last_undegraded":"2024-04-17T08:46:39.267184+0000","last_fullsized":"2024-04-17T08:46:39.267184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:38:06.083792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582509+0000","last_change":"2024-04-17T08:46:34.244135+0000","last_active":"2024-04-17T08:46:39.582509+0000","last_peered":"2024-04-17T08:46:39.582509+0000","last_clean":"2024-04-17T08:46:39.582509+0000","last_became_active":"2024-04-17T08:46:34.236180+0000","last_became_peered":"2024-04-17T08:46:34.236180+0000","last_unstale":"2024-04-17T08:46:39.582509+0000","last_undegraded":"2024-04-17T08:46:39.582509+0000","last_fullsized":"2024-04-17T08:46:39.582509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:33:10.927487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581609+0000","last_change":"2024-04-17T08:46:33.231027+0000","last_active":"2024-04-17T08:46:39.581609+0000","last_peered":"2024-04-17T08:46:39.581609+0000","last_clean":"2024-04-17T08:46:39.581609+0000","last_became_active":"2024-04-17T08:46:33.230663+0000","last_became_peered":"2024-04-17T08:46:33.230663+0000","last_unstale":"2024-04-17T08:46:39.581609+0000","last_undegraded":"2024-04-17T08:46:39.581609+0000","last_fullsized":"2024-04-17T08:46:39.581609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:20:19.185830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.266822+0000","last_change":"2024-04-17T08:46:38.292349+0000","last_active":"2024-04-17T08:46:39.266822+0000","last_peered":"2024-04-17T08:46:39.266822+0000","last_clean":"2024-04-17T08:46:39.266822+0000","last_became_active":"2024-04-17T08:46:38.291572+0000","last_became_peered":"2024-04-17T08:46:38.291572+0000","last_unstale":"2024-04-17T08:46:39.266822+0000","last_undegraded":"2024-04-17T08:46:39.266822+0000","last_fullsized":"2024-04-17T08:46:39.266822+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:10:14.650704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582076+0000","last_change":"2024-04-17T08:46:34.238266+0000","last_active":"2024-04-17T08:46:39.582076+0000","last_peered":"2024-04-17T08:46:39.582076+0000","last_clean":"2024-04-17T08:46:39.582076+0000","last_became_active":"2024-04-17T08:46:34.237968+0000","last_became_peered":"2024-04-17T08:46:34.237968+0000","last_unstale":"2024-04-17T08:46:39.582076+0000","last_undegraded":"2024-04-17T08:46:39.582076+0000","last_fullsized":"2024-04-17T08:46:39.582076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:33:41.705987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581246+0000","last_change":"2024-04-17T08:46:33.228954+0000","last_active":"2024-04-17T08:46:39.581246+0000","last_peered":"2024-04-17T08:46:39.581246+0000","last_clean":"2024-04-17T08:46:39.581246+0000","last_became_active":"2024-04-17T08:46:33.228638+0000","last_became_peered":"2024-04-17T08:46:33.228638+0000","last_unstale":"2024-04-17T08:46:39.581246+0000","last_undegraded":"2024-04-17T08:46:39.581246+0000","last_fullsized":"2024-04-17T08:46:39.581246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:55:39.562141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583149+0000","last_change":"2024-04-17T08:46:38.514583+0000","last_active":"2024-04-17T08:46:39.583149+0000","last_peered":"2024-04-17T08:46:39.583149+0000","last_clean":"2024-04-17T08:46:39.583149+0000","last_became_active":"2024-04-17T08:46:38.514225+0000","last_became_peered":"2024-04-17T08:46:38.514225+0000","last_unstale":"2024-04-17T08:46:39.583149+0000","last_undegraded":"2024-04-17T08:46:39.583149+0000","last_fullsized":"2024-04-17T08:46:39.583149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:34:35.322841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.267337+0000","last_change":"2024-04-17T08:46:34.241177+0000","last_active":"2024-04-17T08:46:39.267337+0000","last_peered":"2024-04-17T08:46:39.267337+0000","last_clean":"2024-04-17T08:46:39.267337+0000","last_became_active":"2024-04-17T08:46:34.240927+0000","last_became_peered":"2024-04-17T08:46:34.240927+0000","last_unstale":"2024-04-17T08:46:39.267337+0000","last_undegraded":"2024-04-17T08:46:39.267337+0000","last_fullsized":"2024-04-17T08:46:39.267337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:55:03.760867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583141+0000","last_change":"2024-04-17T08:46:33.240692+0000","last_active":"2024-04-17T08:46:39.583141+0000","last_peered":"2024-04-17T08:46:39.583141+0000","last_clean":"2024-04-17T08:46:39.583141+0000","last_became_active":"2024-04-17T08:46:33.240411+0000","last_became_peered":"2024-04-17T08:46:33.240411+0000","last_unstale":"2024-04-17T08:46:39.583141+0000","last_undegraded":"2024-04-17T08:46:39.583141+0000","last_fullsized":"2024-04-17T08:46:39.583141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:55:02.754402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.267455+0000","last_change":"2024-04-17T08:46:38.292332+0000","last_active":"2024-04-17T08:46:39.267455+0000","last_peered":"2024-04-17T08:46:39.267455+0000","last_clean":"2024-04-17T08:46:39.267455+0000","last_became_active":"2024-04-17T08:46:38.291458+0000","last_became_peered":"2024-04-17T08:46:38.291458+0000","last_unstale":"2024-04-17T08:46:39.267455+0000","last_undegraded":"2024-04-17T08:46:39.267455+0000","last_fullsized":"2024-04-17T08:46:39.267455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:58:59.558939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582715+0000","last_change":"2024-04-17T08:46:34.240195+0000","last_active":"2024-04-17T08:46:39.582715+0000","last_peered":"2024-04-17T08:46:39.582715+0000","last_clean":"2024-04-17T08:46:39.582715+0000","last_became_active":"2024-04-17T08:46:34.239873+0000","last_became_peered":"2024-04-17T08:46:34.239873+0000","last_unstale":"2024-04-17T08:46:39.582715+0000","last_undegraded":"2024-04-17T08:46:39.582715+0000","last_fullsized":"2024-04-17T08:46:39.582715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:02:18.996319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583776+0000","last_change":"2024-04-17T08:46:33.238292+0000","last_active":"2024-04-17T08:46:39.583776+0000","last_peered":"2024-04-17T08:46:39.583776+0000","last_clean":"2024-04-17T08:46:39.583776+0000","last_became_active":"2024-04-17T08:46:33.237934+0000","last_became_peered":"2024-04-17T08:46:33.237934+0000","last_unstale":"2024-04-17T08:46:39.583776+0000","last_undegraded":"2024-04-17T08:46:39.583776+0000","last_fullsized":"2024-04-17T08:46:39.583776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:22:14.260721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.267275+0000","last_change":"2024-04-17T08:46:38.510638+0000","last_active":"2024-04-17T08:46:39.267275+0000","last_peered":"2024-04-17T08:46:39.267275+0000","last_clean":"2024-04-17T08:46:39.267275+0000","last_became_active":"2024-04-17T08:46:38.510233+0000","last_became_peered":"2024-04-17T08:46:38.510233+0000","last_unstale":"2024-04-17T08:46:39.267275+0000","last_undegraded":"2024-04-17T08:46:39.267275+0000","last_fullsized":"2024-04-17T08:46:39.267275+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:34:25.965169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.584015+0000","last_change":"2024-04-17T08:46:34.252802+0000","last_active":"2024-04-17T08:46:39.584015+0000","last_peered":"2024-04-17T08:46:39.584015+0000","last_clean":"2024-04-17T08:46:39.584015+0000","last_became_active":"2024-04-17T08:46:34.252503+0000","last_became_peered":"2024-04-17T08:46:34.252503+0000","last_unstale":"2024-04-17T08:46:39.584015+0000","last_undegraded":"2024-04-17T08:46:39.584015+0000","last_fullsized":"2024-04-17T08:46:39.584015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:10:10.605700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583273+0000","last_change":"2024-04-17T08:46:33.235073+0000","last_active":"2024-04-17T08:46:39.583273+0000","last_peered":"2024-04-17T08:46:39.583273+0000","last_clean":"2024-04-17T08:46:39.583273+0000","last_became_active":"2024-04-17T08:46:33.234765+0000","last_became_peered":"2024-04-17T08:46:33.234765+0000","last_unstale":"2024-04-17T08:46:39.583273+0000","last_undegraded":"2024-04-17T08:46:39.583273+0000","last_fullsized":"2024-04-17T08:46:39.583273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:18:08.779923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.580688+0000","last_change":"2024-04-17T08:46:38.513389+0000","last_active":"2024-04-17T08:46:39.580688+0000","last_peered":"2024-04-17T08:46:39.580688+0000","last_clean":"2024-04-17T08:46:39.580688+0000","last_became_active":"2024-04-17T08:46:38.512983+0000","last_became_peered":"2024-04-17T08:46:38.512983+0000","last_unstale":"2024-04-17T08:46:39.580688+0000","last_undegraded":"2024-04-17T08:46:39.580688+0000","last_fullsized":"2024-04-17T08:46:39.580688+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:33:35.245363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581949+0000","last_change":"2024-04-17T08:46:34.244956+0000","last_active":"2024-04-17T08:46:39.581949+0000","last_peered":"2024-04-17T08:46:39.581949+0000","last_clean":"2024-04-17T08:46:39.581949+0000","last_became_active":"2024-04-17T08:46:34.244612+0000","last_became_peered":"2024-04-17T08:46:34.244612+0000","last_unstale":"2024-04-17T08:46:39.581949+0000","last_undegraded":"2024-04-17T08:46:39.581949+0000","last_fullsized":"2024-04-17T08:46:39.581949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:33:41.705987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583727+0000","last_change":"2024-04-17T08:46:33.240546+0000","last_active":"2024-04-17T08:46:39.583727+0000","last_peered":"2024-04-17T08:46:39.583727+0000","last_clean":"2024-04-17T08:46:39.583727+0000","last_became_active":"2024-04-17T08:46:33.240225+0000","last_became_peered":"2024-04-17T08:46:33.240225+0000","last_unstale":"2024-04-17T08:46:39.583727+0000","last_undegraded":"2024-04-17T08:46:39.583727+0000","last_fullsized":"2024-04-17T08:46:39.583727+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:39.361759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581144+0000","last_change":"2024-04-17T08:46:38.509788+0000","last_active":"2024-04-17T08:46:39.581144+0000","last_peered":"2024-04-17T08:46:39.581144+0000","last_clean":"2024-04-17T08:46:39.581144+0000","last_became_active":"2024-04-17T08:46:38.509392+0000","last_became_peered":"2024-04-17T08:46:38.509392+0000","last_unstale":"2024-04-17T08:46:39.581144+0000","last_undegraded":"2024-04-17T08:46:39.581144+0000","last_fullsized":"2024-04-17T08:46:39.581144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:58:59.558939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.267877+0000","last_change":"2024-04-17T08:46:34.250149+0000","last_active":"2024-04-17T08:46:39.267877+0000","last_peered":"2024-04-17T08:46:39.267877+0000","last_clean":"2024-04-17T08:46:39.267877+0000","last_became_active":"2024-04-17T08:46:34.249852+0000","last_became_peered":"2024-04-17T08:46:34.249852+0000","last_unstale":"2024-04-17T08:46:39.267877+0000","last_undegraded":"2024-04-17T08:46:39.267877+0000","last_fullsized":"2024-04-17T08:46:39.267877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:44:51.934889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582032+0000","last_change":"2024-04-17T08:46:33.230892+0000","last_active":"2024-04-17T08:46:39.582032+0000","last_peered":"2024-04-17T08:46:39.582032+0000","last_clean":"2024-04-17T08:46:39.582032+0000","last_became_active":"2024-04-17T08:46:33.230624+0000","last_became_peered":"2024-04-17T08:46:33.230624+0000","last_unstale":"2024-04-17T08:46:39.582032+0000","last_undegraded":"2024-04-17T08:46:39.582032+0000","last_fullsized":"2024-04-17T08:46:39.582032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:16:35.663647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581361+0000","last_change":"2024-04-17T08:46:38.291956+0000","last_active":"2024-04-17T08:46:39.581361+0000","last_peered":"2024-04-17T08:46:39.581361+0000","last_clean":"2024-04-17T08:46:39.581361+0000","last_became_active":"2024-04-17T08:46:38.291609+0000","last_became_peered":"2024-04-17T08:46:38.291609+0000","last_unstale":"2024-04-17T08:46:39.581361+0000","last_undegraded":"2024-04-17T08:46:39.581361+0000","last_fullsized":"2024-04-17T08:46:39.581361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:58:59.558939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.266827+0000","last_change":"2024-04-17T08:46:34.241919+0000","last_active":"2024-04-17T08:46:39.266827+0000","last_peered":"2024-04-17T08:46:39.266827+0000","last_clean":"2024-04-17T08:46:39.266827+0000","last_became_active":"2024-04-17T08:46:34.241745+0000","last_became_peered":"2024-04-17T08:46:34.241745+0000","last_unstale":"2024-04-17T08:46:39.266827+0000","last_undegraded":"2024-04-17T08:46:39.266827+0000","last_fullsized":"2024-04-17T08:46:39.266827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:20:20.192296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.265896+0000","last_change":"2024-04-17T08:46:33.223261+0000","last_active":"2024-04-17T08:46:39.265896+0000","last_peered":"2024-04-17T08:46:39.265896+0000","last_clean":"2024-04-17T08:46:39.265896+0000","last_became_active":"2024-04-17T08:46:33.222852+0000","last_became_peered":"2024-04-17T08:46:33.222852+0000","last_unstale":"2024-04-17T08:46:39.265896+0000","last_undegraded":"2024-04-17T08:46:39.265896+0000","last_fullsized":"2024-04-17T08:46:39.265896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:55:02.754402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581903+0000","last_change":"2024-04-17T08:46:38.291195+0000","last_active":"2024-04-17T08:46:39.581903+0000","last_peered":"2024-04-17T08:46:39.581903+0000","last_clean":"2024-04-17T08:46:39.581903+0000","last_became_active":"2024-04-17T08:46:38.290701+0000","last_became_peered":"2024-04-17T08:46:38.290701+0000","last_unstale":"2024-04-17T08:46:39.581903+0000","last_undegraded":"2024-04-17T08:46:39.581903+0000","last_fullsized":"2024-04-17T08:46:39.581903+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:54:46.069200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.580846+0000","last_change":"2024-04-17T08:46:34.243134+0000","last_active":"2024-04-17T08:46:39.580846+0000","last_peered":"2024-04-17T08:46:39.580846+0000","last_clean":"2024-04-17T08:46:39.580846+0000","last_became_active":"2024-04-17T08:46:34.242856+0000","last_became_peered":"2024-04-17T08:46:34.242856+0000","last_unstale":"2024-04-17T08:46:39.580846+0000","last_undegraded":"2024-04-17T08:46:39.580846+0000","last_fullsized":"2024-04-17T08:46:39.580846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:02:18.996319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.263200+0000","last_change":"2024-04-17T08:46:33.233832+0000","last_active":"2024-04-17T08:46:39.263200+0000","last_peered":"2024-04-17T08:46:39.263200+0000","last_clean":"2024-04-17T08:46:39.263200+0000","last_became_active":"2024-04-17T08:46:33.233591+0000","last_became_peered":"2024-04-17T08:46:33.233591+0000","last_unstale":"2024-04-17T08:46:39.263200+0000","last_undegraded":"2024-04-17T08:46:39.263200+0000","last_fullsized":"2024-04-17T08:46:39.263200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:16:35.663647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583229+0000","last_change":"2024-04-17T08:46:38.286653+0000","last_active":"2024-04-17T08:46:39.583229+0000","last_peered":"2024-04-17T08:46:39.583229+0000","last_clean":"2024-04-17T08:46:39.583229+0000","last_became_active":"2024-04-17T08:46:38.285745+0000","last_became_peered":"2024-04-17T08:46:38.285745+0000","last_unstale":"2024-04-17T08:46:39.583229+0000","last_undegraded":"2024-04-17T08:46:39.583229+0000","last_fullsized":"2024-04-17T08:46:39.583229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:30:32.216661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581290+0000","last_change":"2024-04-17T08:46:34.247813+0000","last_active":"2024-04-17T08:46:39.581290+0000","last_peered":"2024-04-17T08:46:39.581290+0000","last_clean":"2024-04-17T08:46:39.581290+0000","last_became_active":"2024-04-17T08:46:34.247520+0000","last_became_peered":"2024-04-17T08:46:34.247520+0000","last_unstale":"2024-04-17T08:46:39.581290+0000","last_undegraded":"2024-04-17T08:46:39.581290+0000","last_fullsized":"2024-04-17T08:46:39.581290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:31:20.501824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583142+0000","last_change":"2024-04-17T08:46:33.238907+0000","last_active":"2024-04-17T08:46:39.583142+0000","last_peered":"2024-04-17T08:46:39.583142+0000","last_clean":"2024-04-17T08:46:39.583142+0000","last_became_active":"2024-04-17T08:46:33.238615+0000","last_became_peered":"2024-04-17T08:46:33.238615+0000","last_unstale":"2024-04-17T08:46:39.583142+0000","last_undegraded":"2024-04-17T08:46:39.583142+0000","last_fullsized":"2024-04-17T08:46:39.583142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:18:08.779923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582573+0000","last_change":"2024-04-17T08:46:38.509796+0000","last_active":"2024-04-17T08:46:39.582573+0000","last_peered":"2024-04-17T08:46:39.582573+0000","last_clean":"2024-04-17T08:46:39.582573+0000","last_became_active":"2024-04-17T08:46:38.509416+0000","last_became_peered":"2024-04-17T08:46:38.509416+0000","last_unstale":"2024-04-17T08:46:39.582573+0000","last_undegraded":"2024-04-17T08:46:39.582573+0000","last_fullsized":"2024-04-17T08:46:39.582573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:30:32.216661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582207+0000","last_change":"2024-04-17T08:46:34.255520+0000","last_active":"2024-04-17T08:46:39.582207+0000","last_peered":"2024-04-17T08:46:39.582207+0000","last_clean":"2024-04-17T08:46:39.582207+0000","last_became_active":"2024-04-17T08:46:34.255053+0000","last_became_peered":"2024-04-17T08:46:34.255053+0000","last_unstale":"2024-04-17T08:46:39.582207+0000","last_undegraded":"2024-04-17T08:46:39.582207+0000","last_fullsized":"2024-04-17T08:46:39.582207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:49:50.654842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.265863+0000","last_change":"2024-04-17T08:46:33.217828+0000","last_active":"2024-04-17T08:46:39.265863+0000","last_peered":"2024-04-17T08:46:39.265863+0000","last_clean":"2024-04-17T08:46:39.265863+0000","last_became_active":"2024-04-17T08:46:33.217484+0000","last_became_peered":"2024-04-17T08:46:33.217484+0000","last_unstale":"2024-04-17T08:46:39.265863+0000","last_undegraded":"2024-04-17T08:46:39.265863+0000","last_fullsized":"2024-04-17T08:46:39.265863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:55:39.562141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":177,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583272+0000","last_change":"2024-04-17T08:46:22.807988+0000","last_active":"2024-04-17T08:46:39.583272+0000","last_peered":"2024-04-17T08:46:39.583272+0000","last_clean":"2024-04-17T08:46:39.583272+0000","last_became_active":"2024-04-17T08:46:22.806843+0000","last_became_peered":"2024-04-17T08:46:22.806843+0000","last_unstale":"2024-04-17T08:46:39.583272+0000","last_undegraded":"2024-04-17T08:46:39.583272+0000","last_fullsized":"2024-04-17T08:46:39.583272+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:21.741557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:21.741557+0000","last_clean_scrub_stamp":"2024-04-17T08:46:21.741557+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:28:38.254696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583294+0000","last_change":"2024-04-17T08:46:38.515691+0000","last_active":"2024-04-17T08:46:39.583294+0000","last_peered":"2024-04-17T08:46:39.583294+0000","last_clean":"2024-04-17T08:46:39.583294+0000","last_became_active":"2024-04-17T08:46:38.515336+0000","last_became_peered":"2024-04-17T08:46:38.515336+0000","last_unstale":"2024-04-17T08:46:39.583294+0000","last_undegraded":"2024-04-17T08:46:39.583294+0000","last_fullsized":"2024-04-17T08:46:39.583294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:34:25.965169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583364+0000","last_change":"2024-04-17T08:46:34.261227+0000","last_active":"2024-04-17T08:46:39.583364+0000","last_peered":"2024-04-17T08:46:39.583364+0000","last_clean":"2024-04-17T08:46:39.583364+0000","last_became_active":"2024-04-17T08:46:34.260463+0000","last_became_peered":"2024-04-17T08:46:34.260463+0000","last_unstale":"2024-04-17T08:46:39.583364+0000","last_undegraded":"2024-04-17T08:46:39.583364+0000","last_fullsized":"2024-04-17T08:46:39.583364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:38:02.038788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.263511+0000","last_change":"2024-04-17T08:46:33.231431+0000","last_active":"2024-04-17T08:46:39.263511+0000","last_peered":"2024-04-17T08:46:39.263511+0000","last_clean":"2024-04-17T08:46:39.263511+0000","last_became_active":"2024-04-17T08:46:33.227785+0000","last_became_peered":"2024-04-17T08:46:33.227785+0000","last_unstale":"2024-04-17T08:46:39.263511+0000","last_undegraded":"2024-04-17T08:46:39.263511+0000","last_fullsized":"2024-04-17T08:46:39.263511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:25:21.370859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582182+0000","last_change":"2024-04-17T08:46:38.514411+0000","last_active":"2024-04-17T08:46:39.582182+0000","last_peered":"2024-04-17T08:46:39.582182+0000","last_clean":"2024-04-17T08:46:39.582182+0000","last_became_active":"2024-04-17T08:46:38.512337+0000","last_became_peered":"2024-04-17T08:46:38.512337+0000","last_unstale":"2024-04-17T08:46:39.582182+0000","last_undegraded":"2024-04-17T08:46:39.582182+0000","last_fullsized":"2024-04-17T08:46:39.582182+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:38:06.083792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.267341+0000","last_change":"2024-04-17T08:46:34.253572+0000","last_active":"2024-04-17T08:46:39.267341+0000","last_peered":"2024-04-17T08:46:39.267341+0000","last_clean":"2024-04-17T08:46:39.267341+0000","last_became_active":"2024-04-17T08:46:34.253185+0000","last_became_peered":"2024-04-17T08:46:34.253185+0000","last_unstale":"2024-04-17T08:46:39.267341+0000","last_undegraded":"2024-04-17T08:46:39.267341+0000","last_fullsized":"2024-04-17T08:46:39.267341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:34:21.920165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582953+0000","last_change":"2024-04-17T08:46:33.224543+0000","last_active":"2024-04-17T08:46:39.582953+0000","last_peered":"2024-04-17T08:46:39.582953+0000","last_clean":"2024-04-17T08:46:39.582953+0000","last_became_active":"2024-04-17T08:46:33.224234+0000","last_became_peered":"2024-04-17T08:46:33.224234+0000","last_unstale":"2024-04-17T08:46:39.582953+0000","last_undegraded":"2024-04-17T08:46:39.582953+0000","last_fullsized":"2024-04-17T08:46:39.582953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:30:42.762461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581393+0000","last_change":"2024-04-17T08:46:38.289173+0000","last_active":"2024-04-17T08:46:39.581393+0000","last_peered":"2024-04-17T08:46:39.581393+0000","last_clean":"2024-04-17T08:46:39.581393+0000","last_became_active":"2024-04-17T08:46:38.288767+0000","last_became_peered":"2024-04-17T08:46:38.288767+0000","last_unstale":"2024-04-17T08:46:39.581393+0000","last_undegraded":"2024-04-17T08:46:39.581393+0000","last_fullsized":"2024-04-17T08:46:39.581393+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:44:55.979892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583968+0000","last_change":"2024-04-17T08:46:34.255234+0000","last_active":"2024-04-17T08:46:39.583968+0000","last_peered":"2024-04-17T08:46:39.583968+0000","last_clean":"2024-04-17T08:46:39.583968+0000","last_became_active":"2024-04-17T08:46:34.254849+0000","last_became_peered":"2024-04-17T08:46:34.254849+0000","last_unstale":"2024-04-17T08:46:39.583968+0000","last_undegraded":"2024-04-17T08:46:39.583968+0000","last_fullsized":"2024-04-17T08:46:39.583968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:33:31.200359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.263578+0000","last_change":"2024-04-17T08:46:33.236511+0000","last_active":"2024-04-17T08:46:39.263578+0000","last_peered":"2024-04-17T08:46:39.263578+0000","last_clean":"2024-04-17T08:46:39.263578+0000","last_became_active":"2024-04-17T08:46:33.236059+0000","last_became_peered":"2024-04-17T08:46:33.236059+0000","last_unstale":"2024-04-17T08:46:39.263578+0000","last_undegraded":"2024-04-17T08:46:39.263578+0000","last_fullsized":"2024-04-17T08:46:39.263578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:55:39.562141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.265271+0000","last_change":"2024-04-17T08:46:38.511281+0000","last_active":"2024-04-17T08:46:39.265271+0000","last_peered":"2024-04-17T08:46:39.265271+0000","last_clean":"2024-04-17T08:46:39.265271+0000","last_became_active":"2024-04-17T08:46:38.510068+0000","last_became_peered":"2024-04-17T08:46:38.510068+0000","last_unstale":"2024-04-17T08:46:39.265271+0000","last_undegraded":"2024-04-17T08:46:39.265271+0000","last_fullsized":"2024-04-17T08:46:39.265271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:00:35.685592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.584095+0000","last_change":"2024-04-17T08:46:34.249995+0000","last_active":"2024-04-17T08:46:39.584095+0000","last_peered":"2024-04-17T08:46:39.584095+0000","last_clean":"2024-04-17T08:46:39.584095+0000","last_became_active":"2024-04-17T08:46:34.249729+0000","last_became_peered":"2024-04-17T08:46:34.249729+0000","last_unstale":"2024-04-17T08:46:39.584095+0000","last_undegraded":"2024-04-17T08:46:39.584095+0000","last_fullsized":"2024-04-17T08:46:39.584095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:16:39.000776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.267069+0000","last_change":"2024-04-17T08:46:33.231993+0000","last_active":"2024-04-17T08:46:39.267069+0000","last_peered":"2024-04-17T08:46:39.267069+0000","last_clean":"2024-04-17T08:46:39.267069+0000","last_became_active":"2024-04-17T08:46:33.231265+0000","last_became_peered":"2024-04-17T08:46:33.231265+0000","last_unstale":"2024-04-17T08:46:39.267069+0000","last_undegraded":"2024-04-17T08:46:39.267069+0000","last_fullsized":"2024-04-17T08:46:39.267069+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:53:22.090817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.266950+0000","last_change":"2024-04-17T08:46:38.284999+0000","last_active":"2024-04-17T08:46:39.266950+0000","last_peered":"2024-04-17T08:46:39.266950+0000","last_clean":"2024-04-17T08:46:39.266950+0000","last_became_active":"2024-04-17T08:46:38.284570+0000","last_became_peered":"2024-04-17T08:46:38.284570+0000","last_unstale":"2024-04-17T08:46:39.266950+0000","last_undegraded":"2024-04-17T08:46:39.266950+0000","last_fullsized":"2024-04-17T08:46:39.266950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:16:43.045780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582901+0000","last_change":"2024-04-17T08:46:34.255136+0000","last_active":"2024-04-17T08:46:39.582901+0000","last_peered":"2024-04-17T08:46:39.582901+0000","last_clean":"2024-04-17T08:46:39.582901+0000","last_became_active":"2024-04-17T08:46:34.254805+0000","last_became_peered":"2024-04-17T08:46:34.254805+0000","last_unstale":"2024-04-17T08:46:39.582901+0000","last_undegraded":"2024-04-17T08:46:39.582901+0000","last_fullsized":"2024-04-17T08:46:39.582901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:44:51.934889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.263098+0000","last_change":"2024-04-17T08:46:33.221884+0000","last_active":"2024-04-17T08:46:39.263098+0000","last_peered":"2024-04-17T08:46:39.263098+0000","last_clean":"2024-04-17T08:46:39.263098+0000","last_became_active":"2024-04-17T08:46:33.220945+0000","last_became_peered":"2024-04-17T08:46:33.220945+0000","last_unstale":"2024-04-17T08:46:39.263098+0000","last_undegraded":"2024-04-17T08:46:39.263098+0000","last_fullsized":"2024-04-17T08:46:39.263098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:32:08.431466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582440+0000","last_change":"2024-04-17T08:46:38.292234+0000","last_active":"2024-04-17T08:46:39.582440+0000","last_peered":"2024-04-17T08:46:39.582440+0000","last_clean":"2024-04-17T08:46:39.582440+0000","last_became_active":"2024-04-17T08:46:38.291831+0000","last_became_peered":"2024-04-17T08:46:38.291831+0000","last_unstale":"2024-04-17T08:46:39.582440+0000","last_undegraded":"2024-04-17T08:46:39.582440+0000","last_fullsized":"2024-04-17T08:46:39.582440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:34:35.322841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582128+0000","last_change":"2024-04-17T08:46:34.238104+0000","last_active":"2024-04-17T08:46:39.582128+0000","last_peered":"2024-04-17T08:46:39.582128+0000","last_clean":"2024-04-17T08:46:39.582128+0000","last_became_active":"2024-04-17T08:46:34.237741+0000","last_became_peered":"2024-04-17T08:46:34.237741+0000","last_unstale":"2024-04-17T08:46:39.582128+0000","last_undegraded":"2024-04-17T08:46:39.582128+0000","last_fullsized":"2024-04-17T08:46:39.582128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:12:09.665391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582338+0000","last_change":"2024-04-17T08:46:33.227055+0000","last_active":"2024-04-17T08:46:39.582338+0000","last_peered":"2024-04-17T08:46:39.582338+0000","last_clean":"2024-04-17T08:46:39.582338+0000","last_became_active":"2024-04-17T08:46:33.226787+0000","last_became_peered":"2024-04-17T08:46:33.226787+0000","last_unstale":"2024-04-17T08:46:39.582338+0000","last_undegraded":"2024-04-17T08:46:39.582338+0000","last_fullsized":"2024-04-17T08:46:39.582338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:25:21.370859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583895+0000","last_change":"2024-04-17T08:46:38.514388+0000","last_active":"2024-04-17T08:46:39.583895+0000","last_peered":"2024-04-17T08:46:39.583895+0000","last_clean":"2024-04-17T08:46:39.583895+0000","last_became_active":"2024-04-17T08:46:38.514047+0000","last_became_peered":"2024-04-17T08:46:38.514047+0000","last_unstale":"2024-04-17T08:46:39.583895+0000","last_undegraded":"2024-04-17T08:46:39.583895+0000","last_fullsized":"2024-04-17T08:46:39.583895+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:43:04.302500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583016+0000","last_change":"2024-04-17T08:46:34.249520+0000","last_active":"2024-04-17T08:46:39.583016+0000","last_peered":"2024-04-17T08:46:39.583016+0000","last_clean":"2024-04-17T08:46:39.583016+0000","last_became_active":"2024-04-17T08:46:34.249225+0000","last_became_peered":"2024-04-17T08:46:34.249225+0000","last_unstale":"2024-04-17T08:46:39.583016+0000","last_undegraded":"2024-04-17T08:46:39.583016+0000","last_fullsized":"2024-04-17T08:46:39.583016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:54:42.024196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.265861+0000","last_change":"2024-04-17T08:46:33.236864+0000","last_active":"2024-04-17T08:46:39.265861+0000","last_peered":"2024-04-17T08:46:39.265861+0000","last_clean":"2024-04-17T08:46:39.265861+0000","last_became_active":"2024-04-17T08:46:33.236095+0000","last_became_peered":"2024-04-17T08:46:33.236095+0000","last_unstale":"2024-04-17T08:46:39.265861+0000","last_undegraded":"2024-04-17T08:46:39.265861+0000","last_fullsized":"2024-04-17T08:46:39.265861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:20:19.185830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582486+0000","last_change":"2024-04-17T08:46:38.509818+0000","last_active":"2024-04-17T08:46:39.582486+0000","last_peered":"2024-04-17T08:46:39.582486+0000","last_clean":"2024-04-17T08:46:39.582486+0000","last_became_active":"2024-04-17T08:46:38.509380+0000","last_became_peered":"2024-04-17T08:46:38.509380+0000","last_unstale":"2024-04-17T08:46:39.582486+0000","last_undegraded":"2024-04-17T08:46:39.582486+0000","last_fullsized":"2024-04-17T08:46:39.582486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:52:13.249971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581564+0000","last_change":"2024-04-17T08:46:34.248655+0000","last_active":"2024-04-17T08:46:39.581564+0000","last_peered":"2024-04-17T08:46:39.581564+0000","last_clean":"2024-04-17T08:46:39.581564+0000","last_became_active":"2024-04-17T08:46:34.247990+0000","last_became_peered":"2024-04-17T08:46:34.247990+0000","last_unstale":"2024-04-17T08:46:39.581564+0000","last_undegraded":"2024-04-17T08:46:39.581564+0000","last_fullsized":"2024-04-17T08:46:39.581564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:37:26.964605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581610+0000","last_change":"2024-04-17T08:46:33.225329+0000","last_active":"2024-04-17T08:46:39.581610+0000","last_peered":"2024-04-17T08:46:39.581610+0000","last_clean":"2024-04-17T08:46:39.581610+0000","last_became_active":"2024-04-17T08:46:33.225006+0000","last_became_peered":"2024-04-17T08:46:33.225006+0000","last_unstale":"2024-04-17T08:46:39.581610+0000","last_undegraded":"2024-04-17T08:46:39.581610+0000","last_fullsized":"2024-04-17T08:46:39.581610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:06:52.298728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.267811+0000","last_change":"2024-04-17T08:46:38.512665+0000","last_active":"2024-04-17T08:46:39.267811+0000","last_peered":"2024-04-17T08:46:39.267811+0000","last_clean":"2024-04-17T08:46:39.267811+0000","last_became_active":"2024-04-17T08:46:38.511018+0000","last_became_peered":"2024-04-17T08:46:38.511018+0000","last_unstale":"2024-04-17T08:46:39.267811+0000","last_undegraded":"2024-04-17T08:46:39.267811+0000","last_fullsized":"2024-04-17T08:46:39.267811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:07:22.236476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583254+0000","last_change":"2024-04-17T08:46:34.253169+0000","last_active":"2024-04-17T08:46:39.583254+0000","last_peered":"2024-04-17T08:46:39.583254+0000","last_clean":"2024-04-17T08:46:39.583254+0000","last_became_active":"2024-04-17T08:46:34.252781+0000","last_became_peered":"2024-04-17T08:46:34.252781+0000","last_unstale":"2024-04-17T08:46:39.583254+0000","last_undegraded":"2024-04-17T08:46:39.583254+0000","last_fullsized":"2024-04-17T08:46:39.583254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:58:55.513935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'10","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:49.408874+0000","last_change":"2024-04-17T08:46:33.238253+0000","last_active":"2024-04-17T08:46:49.408874+0000","last_peered":"2024-04-17T08:46:49.408874+0000","last_clean":"2024-04-17T08:46:49.408874+0000","last_became_active":"2024-04-17T08:46:33.237894+0000","last_became_peered":"2024-04-17T08:46:33.237894+0000","last_unstale":"2024-04-17T08:46:49.408874+0000","last_undegraded":"2024-04-17T08:46:49.408874+0000","last_fullsized":"2024-04-17T08:46:49.408874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:16:35.663647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581576+0000","last_change":"2024-04-17T08:46:38.292629+0000","last_active":"2024-04-17T08:46:39.581576+0000","last_peered":"2024-04-17T08:46:39.581576+0000","last_clean":"2024-04-17T08:46:39.581576+0000","last_became_active":"2024-04-17T08:46:38.292238+0000","last_became_peered":"2024-04-17T08:46:38.292238+0000","last_unstale":"2024-04-17T08:46:39.581576+0000","last_undegraded":"2024-04-17T08:46:39.581576+0000","last_fullsized":"2024-04-17T08:46:39.581576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:44:55.979892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.267104+0000","last_change":"2024-04-17T08:46:34.247592+0000","last_active":"2024-04-17T08:46:39.267104+0000","last_peered":"2024-04-17T08:46:39.267104+0000","last_clean":"2024-04-17T08:46:39.267104+0000","last_became_active":"2024-04-17T08:46:34.247307+0000","last_became_peered":"2024-04-17T08:46:34.247307+0000","last_unstale":"2024-04-17T08:46:39.267104+0000","last_undegraded":"2024-04-17T08:46:39.267104+0000","last_fullsized":"2024-04-17T08:46:39.267104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:22:15.267186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582951+0000","last_change":"2024-04-17T08:46:33.226914+0000","last_active":"2024-04-17T08:46:39.582951+0000","last_peered":"2024-04-17T08:46:39.582951+0000","last_clean":"2024-04-17T08:46:39.582951+0000","last_became_active":"2024-04-17T08:46:33.226607+0000","last_became_peered":"2024-04-17T08:46:33.226607+0000","last_unstale":"2024-04-17T08:46:39.582951+0000","last_undegraded":"2024-04-17T08:46:39.582951+0000","last_fullsized":"2024-04-17T08:46:39.582951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:22:14.260721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.266708+0000","last_change":"2024-04-17T08:46:38.286086+0000","last_active":"2024-04-17T08:46:39.266708+0000","last_peered":"2024-04-17T08:46:39.266708+0000","last_clean":"2024-04-17T08:46:39.266708+0000","last_became_active":"2024-04-17T08:46:38.285105+0000","last_became_peered":"2024-04-17T08:46:38.285105+0000","last_unstale":"2024-04-17T08:46:39.266708+0000","last_undegraded":"2024-04-17T08:46:39.266708+0000","last_fullsized":"2024-04-17T08:46:39.266708+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:13:14.354152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582237+0000","last_change":"2024-04-17T08:46:34.255537+0000","last_active":"2024-04-17T08:46:39.582237+0000","last_peered":"2024-04-17T08:46:39.582237+0000","last_clean":"2024-04-17T08:46:39.582237+0000","last_became_active":"2024-04-17T08:46:34.254801+0000","last_became_peered":"2024-04-17T08:46:34.254801+0000","last_unstale":"2024-04-17T08:46:39.582237+0000","last_undegraded":"2024-04-17T08:46:39.582237+0000","last_fullsized":"2024-04-17T08:46:39.582237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:13:50.529902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.267835+0000","last_change":"2024-04-17T08:46:33.233506+0000","last_active":"2024-04-17T08:46:39.267835+0000","last_peered":"2024-04-17T08:46:39.267835+0000","last_clean":"2024-04-17T08:46:39.267835+0000","last_became_active":"2024-04-17T08:46:33.233232+0000","last_became_peered":"2024-04-17T08:46:33.233232+0000","last_unstale":"2024-04-17T08:46:39.267835+0000","last_undegraded":"2024-04-17T08:46:39.267835+0000","last_fullsized":"2024-04-17T08:46:39.267835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:16:35.663647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581800+0000","last_change":"2024-04-17T08:46:38.279439+0000","last_active":"2024-04-17T08:46:39.581800+0000","last_peered":"2024-04-17T08:46:39.581800+0000","last_clean":"2024-04-17T08:46:39.581800+0000","last_became_active":"2024-04-17T08:46:38.278889+0000","last_became_peered":"2024-04-17T08:46:38.278889+0000","last_unstale":"2024-04-17T08:46:39.581800+0000","last_undegraded":"2024-04-17T08:46:39.581800+0000","last_fullsized":"2024-04-17T08:46:39.581800+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:43:42.690286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.267666+0000","last_change":"2024-04-17T08:46:34.259801+0000","last_active":"2024-04-17T08:46:39.267666+0000","last_peered":"2024-04-17T08:46:39.267666+0000","last_clean":"2024-04-17T08:46:39.267666+0000","last_became_active":"2024-04-17T08:46:34.259498+0000","last_became_peered":"2024-04-17T08:46:34.259498+0000","last_unstale":"2024-04-17T08:46:39.267666+0000","last_undegraded":"2024-04-17T08:46:39.267666+0000","last_fullsized":"2024-04-17T08:46:39.267666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:54:42.024196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583657+0000","last_change":"2024-04-17T08:46:33.235837+0000","last_active":"2024-04-17T08:46:39.583657+0000","last_peered":"2024-04-17T08:46:39.583657+0000","last_clean":"2024-04-17T08:46:39.583657+0000","last_became_active":"2024-04-17T08:46:33.235456+0000","last_became_peered":"2024-04-17T08:46:33.235456+0000","last_unstale":"2024-04-17T08:46:39.583657+0000","last_undegraded":"2024-04-17T08:46:39.583657+0000","last_fullsized":"2024-04-17T08:46:39.583657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:18:08.779923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582353+0000","last_change":"2024-04-17T08:46:38.509993+0000","last_active":"2024-04-17T08:46:39.582353+0000","last_peered":"2024-04-17T08:46:39.582353+0000","last_clean":"2024-04-17T08:46:39.582353+0000","last_became_active":"2024-04-17T08:46:38.509510+0000","last_became_peered":"2024-04-17T08:46:38.509510+0000","last_unstale":"2024-04-17T08:46:39.582353+0000","last_undegraded":"2024-04-17T08:46:39.582353+0000","last_fullsized":"2024-04-17T08:46:39.582353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:07:22.236476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582291+0000","last_change":"2024-04-17T08:46:38.510357+0000","last_active":"2024-04-17T08:46:39.582291+0000","last_peered":"2024-04-17T08:46:39.582291+0000","last_clean":"2024-04-17T08:46:39.582291+0000","last_became_active":"2024-04-17T08:46:38.509996+0000","last_became_peered":"2024-04-17T08:46:38.509996+0000","last_unstale":"2024-04-17T08:46:39.582291+0000","last_undegraded":"2024-04-17T08:46:39.582291+0000","last_fullsized":"2024-04-17T08:46:39.582291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:54:46.069200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581341+0000","last_change":"2024-04-17T08:46:34.238153+0000","last_active":"2024-04-17T08:46:39.581341+0000","last_peered":"2024-04-17T08:46:39.581341+0000","last_clean":"2024-04-17T08:46:39.581341+0000","last_became_active":"2024-04-17T08:46:34.237904+0000","last_became_peered":"2024-04-17T08:46:34.237904+0000","last_unstale":"2024-04-17T08:46:39.581341+0000","last_undegraded":"2024-04-17T08:46:39.581341+0000","last_fullsized":"2024-04-17T08:46:39.581341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:13:50.529902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.265341+0000","last_change":"2024-04-17T08:46:33.219586+0000","last_active":"2024-04-17T08:46:39.265341+0000","last_peered":"2024-04-17T08:46:39.265341+0000","last_clean":"2024-04-17T08:46:39.265341+0000","last_became_active":"2024-04-17T08:46:33.219227+0000","last_became_peered":"2024-04-17T08:46:33.219227+0000","last_unstale":"2024-04-17T08:46:39.265341+0000","last_undegraded":"2024-04-17T08:46:39.265341+0000","last_fullsized":"2024-04-17T08:46:39.265341+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:18:08.779923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583582+0000","last_change":"2024-04-17T08:46:38.287983+0000","last_active":"2024-04-17T08:46:39.583582+0000","last_peered":"2024-04-17T08:46:39.583582+0000","last_clean":"2024-04-17T08:46:39.583582+0000","last_became_active":"2024-04-17T08:46:38.287651+0000","last_became_peered":"2024-04-17T08:46:38.287651+0000","last_unstale":"2024-04-17T08:46:39.583582+0000","last_undegraded":"2024-04-17T08:46:39.583582+0000","last_fullsized":"2024-04-17T08:46:39.583582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:58:59.558939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581971+0000","last_change":"2024-04-17T08:46:34.237638+0000","last_active":"2024-04-17T08:46:39.581971+0000","last_peered":"2024-04-17T08:46:39.581971+0000","last_clean":"2024-04-17T08:46:39.581971+0000","last_became_active":"2024-04-17T08:46:34.237276+0000","last_became_peered":"2024-04-17T08:46:34.237276+0000","last_unstale":"2024-04-17T08:46:39.581971+0000","last_undegraded":"2024-04-17T08:46:39.581971+0000","last_fullsized":"2024-04-17T08:46:39.581971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:02:18.996319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582616+0000","last_change":"2024-04-17T08:46:33.230158+0000","last_active":"2024-04-17T08:46:39.582616+0000","last_peered":"2024-04-17T08:46:39.582616+0000","last_clean":"2024-04-17T08:46:39.582616+0000","last_became_active":"2024-04-17T08:46:33.229871+0000","last_became_peered":"2024-04-17T08:46:33.229871+0000","last_unstale":"2024-04-17T08:46:39.582616+0000","last_undegraded":"2024-04-17T08:46:39.582616+0000","last_fullsized":"2024-04-17T08:46:39.582616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:32:08.431466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582487+0000","last_change":"2024-04-17T08:46:33.228412+0000","last_active":"2024-04-17T08:46:39.582487+0000","last_peered":"2024-04-17T08:46:39.582487+0000","last_clean":"2024-04-17T08:46:39.582487+0000","last_became_active":"2024-04-17T08:46:33.228163+0000","last_became_peered":"2024-04-17T08:46:33.228163+0000","last_unstale":"2024-04-17T08:46:39.582487+0000","last_undegraded":"2024-04-17T08:46:39.582487+0000","last_fullsized":"2024-04-17T08:46:39.582487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:55:39.562141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581525+0000","last_change":"2024-04-17T08:46:34.248503+0000","last_active":"2024-04-17T08:46:39.581525+0000","last_peered":"2024-04-17T08:46:39.581525+0000","last_clean":"2024-04-17T08:46:39.581525+0000","last_became_active":"2024-04-17T08:46:34.247808+0000","last_became_peered":"2024-04-17T08:46:34.247808+0000","last_unstale":"2024-04-17T08:46:39.581525+0000","last_undegraded":"2024-04-17T08:46:39.581525+0000","last_fullsized":"2024-04-17T08:46:39.581525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:33:10.927487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.263496+0000","last_change":"2024-04-17T08:46:38.291370+0000","last_active":"2024-04-17T08:46:39.263496+0000","last_peered":"2024-04-17T08:46:39.263496+0000","last_clean":"2024-04-17T08:46:39.263496+0000","last_became_active":"2024-04-17T08:46:38.290866+0000","last_became_peered":"2024-04-17T08:46:38.290866+0000","last_unstale":"2024-04-17T08:46:39.263496+0000","last_undegraded":"2024-04-17T08:46:39.263496+0000","last_fullsized":"2024-04-17T08:46:39.263496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:44.413228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582559+0000","last_change":"2024-04-17T08:46:33.239929+0000","last_active":"2024-04-17T08:46:39.582559+0000","last_peered":"2024-04-17T08:46:39.582559+0000","last_clean":"2024-04-17T08:46:39.582559+0000","last_became_active":"2024-04-17T08:46:33.239619+0000","last_became_peered":"2024-04-17T08:46:33.239619+0000","last_unstale":"2024-04-17T08:46:39.582559+0000","last_undegraded":"2024-04-17T08:46:39.582559+0000","last_fullsized":"2024-04-17T08:46:39.582559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:22:07.958599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.266472+0000","last_change":"2024-04-17T08:46:34.237105+0000","last_active":"2024-04-17T08:46:39.266472+0000","last_peered":"2024-04-17T08:46:39.266472+0000","last_clean":"2024-04-17T08:46:39.266472+0000","last_became_active":"2024-04-17T08:46:34.236792+0000","last_became_peered":"2024-04-17T08:46:34.236792+0000","last_unstale":"2024-04-17T08:46:39.266472+0000","last_undegraded":"2024-04-17T08:46:39.266472+0000","last_fullsized":"2024-04-17T08:46:39.266472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:16:36.670112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583657+0000","last_change":"2024-04-17T08:46:38.287775+0000","last_active":"2024-04-17T08:46:39.583657+0000","last_peered":"2024-04-17T08:46:39.583657+0000","last_clean":"2024-04-17T08:46:39.583657+0000","last_became_active":"2024-04-17T08:46:38.287403+0000","last_became_peered":"2024-04-17T08:46:38.287403+0000","last_unstale":"2024-04-17T08:46:39.583657+0000","last_undegraded":"2024-04-17T08:46:39.583657+0000","last_fullsized":"2024-04-17T08:46:39.583657+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:32:12.270818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582001+0000","last_change":"2024-04-17T08:46:34.238359+0000","last_active":"2024-04-17T08:46:39.582001+0000","last_peered":"2024-04-17T08:46:39.582001+0000","last_clean":"2024-04-17T08:46:39.582001+0000","last_became_active":"2024-04-17T08:46:34.237809+0000","last_became_peered":"2024-04-17T08:46:34.237809+0000","last_unstale":"2024-04-17T08:46:39.582001+0000","last_undegraded":"2024-04-17T08:46:39.582001+0000","last_fullsized":"2024-04-17T08:46:39.582001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:17:38.605512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.263186+0000","last_change":"2024-04-17T08:46:34.251080+0000","last_active":"2024-04-17T08:46:39.263186+0000","last_peered":"2024-04-17T08:46:39.263186+0000","last_clean":"2024-04-17T08:46:39.263186+0000","last_became_active":"2024-04-17T08:46:34.250660+0000","last_became_peered":"2024-04-17T08:46:34.250660+0000","last_unstale":"2024-04-17T08:46:39.263186+0000","last_undegraded":"2024-04-17T08:46:39.263186+0000","last_fullsized":"2024-04-17T08:46:39.263186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:18:09.786388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.265791+0000","last_change":"2024-04-17T08:46:34.255117+0000","last_active":"2024-04-17T08:46:39.265791+0000","last_peered":"2024-04-17T08:46:39.265791+0000","last_clean":"2024-04-17T08:46:39.265791+0000","last_became_active":"2024-04-17T08:46:34.251710+0000","last_became_peered":"2024-04-17T08:46:34.251710+0000","last_unstale":"2024-04-17T08:46:39.265791+0000","last_undegraded":"2024-04-17T08:46:39.265791+0000","last_fullsized":"2024-04-17T08:46:39.265791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:10:10.605700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581443+0000","last_change":"2024-04-17T08:46:34.241337+0000","last_active":"2024-04-17T08:46:39.581443+0000","last_peered":"2024-04-17T08:46:39.581443+0000","last_clean":"2024-04-17T08:46:39.581443+0000","last_became_active":"2024-04-17T08:46:34.241042+0000","last_became_peered":"2024-04-17T08:46:34.241042+0000","last_unstale":"2024-04-17T08:46:39.581443+0000","last_undegraded":"2024-04-17T08:46:39.581443+0000","last_fullsized":"2024-04-17T08:46:39.581443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:49:50.654842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582703+0000","last_change":"2024-04-17T08:46:34.245617+0000","last_active":"2024-04-17T08:46:39.582703+0000","last_peered":"2024-04-17T08:46:39.582703+0000","last_clean":"2024-04-17T08:46:39.582703+0000","last_became_active":"2024-04-17T08:46:34.245271+0000","last_became_peered":"2024-04-17T08:46:34.245271+0000","last_unstale":"2024-04-17T08:46:39.582703+0000","last_undegraded":"2024-04-17T08:46:39.582703+0000","last_fullsized":"2024-04-17T08:46:39.582703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:13:50.529902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582834+0000","last_change":"2024-04-17T08:46:34.239456+0000","last_active":"2024-04-17T08:46:39.582834+0000","last_peered":"2024-04-17T08:46:39.582834+0000","last_clean":"2024-04-17T08:46:39.582834+0000","last_became_active":"2024-04-17T08:46:34.239162+0000","last_became_peered":"2024-04-17T08:46:34.239162+0000","last_unstale":"2024-04-17T08:46:39.582834+0000","last_undegraded":"2024-04-17T08:46:39.582834+0000","last_fullsized":"2024-04-17T08:46:39.582834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:49:50.654842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583417+0000","last_change":"2024-04-17T08:46:34.246242+0000","last_active":"2024-04-17T08:46:39.583417+0000","last_peered":"2024-04-17T08:46:39.583417+0000","last_clean":"2024-04-17T08:46:39.583417+0000","last_became_active":"2024-04-17T08:46:34.245994+0000","last_became_peered":"2024-04-17T08:46:34.245994+0000","last_unstale":"2024-04-17T08:46:39.583417+0000","last_undegraded":"2024-04-17T08:46:39.583417+0000","last_fullsized":"2024-04-17T08:46:39.583417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:13:50.529902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583939+0000","last_change":"2024-04-17T08:46:34.245854+0000","last_active":"2024-04-17T08:46:39.583939+0000","last_peered":"2024-04-17T08:46:39.583939+0000","last_clean":"2024-04-17T08:46:39.583939+0000","last_became_active":"2024-04-17T08:46:34.245381+0000","last_became_peered":"2024-04-17T08:46:34.245381+0000","last_unstale":"2024-04-17T08:46:39.583939+0000","last_undegraded":"2024-04-17T08:46:39.583939+0000","last_fullsized":"2024-04-17T08:46:39.583939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:13:10.309148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.265310+0000","last_change":"2024-04-17T08:46:34.249141+0000","last_active":"2024-04-17T08:46:39.265310+0000","last_peered":"2024-04-17T08:46:39.265310+0000","last_clean":"2024-04-17T08:46:39.265310+0000","last_became_active":"2024-04-17T08:46:34.248632+0000","last_became_peered":"2024-04-17T08:46:34.248632+0000","last_unstale":"2024-04-17T08:46:39.265310+0000","last_undegraded":"2024-04-17T08:46:39.265310+0000","last_fullsized":"2024-04-17T08:46:39.265310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:13:50.529902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582465+0000","last_change":"2024-04-17T08:46:34.247025+0000","last_active":"2024-04-17T08:46:39.582465+0000","last_peered":"2024-04-17T08:46:39.582465+0000","last_clean":"2024-04-17T08:46:39.582465+0000","last_became_active":"2024-04-17T08:46:34.246769+0000","last_became_peered":"2024-04-17T08:46:34.246769+0000","last_unstale":"2024-04-17T08:46:39.582465+0000","last_undegraded":"2024-04-17T08:46:39.582465+0000","last_fullsized":"2024-04-17T08:46:39.582465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:12:09.665391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.265741+0000","last_change":"2024-04-17T08:46:34.253773+0000","last_active":"2024-04-17T08:46:39.265741+0000","last_peered":"2024-04-17T08:46:39.265741+0000","last_clean":"2024-04-17T08:46:39.265741+0000","last_became_active":"2024-04-17T08:46:34.253462+0000","last_became_peered":"2024-04-17T08:46:34.253462+0000","last_unstale":"2024-04-17T08:46:39.265741+0000","last_undegraded":"2024-04-17T08:46:39.265741+0000","last_fullsized":"2024-04-17T08:46:39.265741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:13:10.309148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581198+0000","last_change":"2024-04-17T08:46:34.248730+0000","last_active":"2024-04-17T08:46:39.581198+0000","last_peered":"2024-04-17T08:46:39.581198+0000","last_clean":"2024-04-17T08:46:39.581198+0000","last_became_active":"2024-04-17T08:46:34.248175+0000","last_became_peered":"2024-04-17T08:46:34.248175+0000","last_unstale":"2024-04-17T08:46:39.581198+0000","last_undegraded":"2024-04-17T08:46:39.581198+0000","last_fullsized":"2024-04-17T08:46:39.581198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:12:09.665391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582624+0000","last_change":"2024-04-17T08:46:34.240984+0000","last_active":"2024-04-17T08:46:39.582624+0000","last_peered":"2024-04-17T08:46:39.582624+0000","last_clean":"2024-04-17T08:46:39.582624+0000","last_became_active":"2024-04-17T08:46:34.240649+0000","last_became_peered":"2024-04-17T08:46:34.240649+0000","last_unstale":"2024-04-17T08:46:39.582624+0000","last_undegraded":"2024-04-17T08:46:39.582624+0000","last_fullsized":"2024-04-17T08:46:39.582624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:49:50.654842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583627+0000","last_change":"2024-04-17T08:46:34.252899+0000","last_active":"2024-04-17T08:46:39.583627+0000","last_peered":"2024-04-17T08:46:39.583627+0000","last_clean":"2024-04-17T08:46:39.583627+0000","last_became_active":"2024-04-17T08:46:34.252649+0000","last_became_peered":"2024-04-17T08:46:34.252649+0000","last_unstale":"2024-04-17T08:46:39.583627+0000","last_undegraded":"2024-04-17T08:46:39.583627+0000","last_fullsized":"2024-04-17T08:46:39.583627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:34:31.277838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.263565+0000","last_change":"2024-04-17T08:46:34.245775+0000","last_active":"2024-04-17T08:46:39.263565+0000","last_peered":"2024-04-17T08:46:39.263565+0000","last_clean":"2024-04-17T08:46:39.263565+0000","last_became_active":"2024-04-17T08:46:34.245478+0000","last_became_peered":"2024-04-17T08:46:34.245478+0000","last_unstale":"2024-04-17T08:46:39.263565+0000","last_undegraded":"2024-04-17T08:46:39.263565+0000","last_fullsized":"2024-04-17T08:46:39.263565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:22:15.267186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.268138+0000","last_change":"2024-04-17T08:46:34.263140+0000","last_active":"2024-04-17T08:46:39.268138+0000","last_peered":"2024-04-17T08:46:39.268138+0000","last_clean":"2024-04-17T08:46:39.268138+0000","last_became_active":"2024-04-17T08:46:34.261735+0000","last_became_peered":"2024-04-17T08:46:34.261735+0000","last_unstale":"2024-04-17T08:46:39.268138+0000","last_undegraded":"2024-04-17T08:46:39.268138+0000","last_fullsized":"2024-04-17T08:46:39.268138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:34:31.277838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.265194+0000","last_change":"2024-04-17T08:46:34.252436+0000","last_active":"2024-04-17T08:46:39.265194+0000","last_peered":"2024-04-17T08:46:39.265194+0000","last_clean":"2024-04-17T08:46:39.265194+0000","last_became_active":"2024-04-17T08:46:34.250951+0000","last_became_peered":"2024-04-17T08:46:34.250951+0000","last_unstale":"2024-04-17T08:46:39.265194+0000","last_undegraded":"2024-04-17T08:46:39.265194+0000","last_fullsized":"2024-04-17T08:46:39.265194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:33:10.927487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581141+0000","last_change":"2024-04-17T08:46:34.243835+0000","last_active":"2024-04-17T08:46:39.581141+0000","last_peered":"2024-04-17T08:46:39.581141+0000","last_clean":"2024-04-17T08:46:39.581141+0000","last_became_active":"2024-04-17T08:46:34.243503+0000","last_became_peered":"2024-04-17T08:46:34.243503+0000","last_unstale":"2024-04-17T08:46:39.581141+0000","last_undegraded":"2024-04-17T08:46:39.581141+0000","last_fullsized":"2024-04-17T08:46:39.581141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:17:38.605512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581483+0000","last_change":"2024-04-17T08:46:34.239204+0000","last_active":"2024-04-17T08:46:39.581483+0000","last_peered":"2024-04-17T08:46:39.581483+0000","last_clean":"2024-04-17T08:46:39.581483+0000","last_became_active":"2024-04-17T08:46:34.237120+0000","last_became_peered":"2024-04-17T08:46:34.237120+0000","last_unstale":"2024-04-17T08:46:39.581483+0000","last_undegraded":"2024-04-17T08:46:39.581483+0000","last_fullsized":"2024-04-17T08:46:39.581483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:47:04.763844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582462+0000","last_change":"2024-04-17T08:46:34.233656+0000","last_active":"2024-04-17T08:46:39.582462+0000","last_peered":"2024-04-17T08:46:39.582462+0000","last_clean":"2024-04-17T08:46:39.582462+0000","last_became_active":"2024-04-17T08:46:34.233389+0000","last_became_peered":"2024-04-17T08:46:34.233389+0000","last_unstale":"2024-04-17T08:46:39.582462+0000","last_undegraded":"2024-04-17T08:46:39.582462+0000","last_fullsized":"2024-04-17T08:46:39.582462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:17:38.605512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.267000+0000","last_change":"2024-04-17T08:46:34.235333+0000","last_active":"2024-04-17T08:46:39.267000+0000","last_peered":"2024-04-17T08:46:39.267000+0000","last_clean":"2024-04-17T08:46:39.267000+0000","last_became_active":"2024-04-17T08:46:34.234982+0000","last_became_peered":"2024-04-17T08:46:34.234982+0000","last_unstale":"2024-04-17T08:46:39.267000+0000","last_undegraded":"2024-04-17T08:46:39.267000+0000","last_fullsized":"2024-04-17T08:46:39.267000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:18:09.786388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582701+0000","last_change":"2024-04-17T08:46:34.260932+0000","last_active":"2024-04-17T08:46:39.582701+0000","last_peered":"2024-04-17T08:46:39.582701+0000","last_clean":"2024-04-17T08:46:39.582701+0000","last_became_active":"2024-04-17T08:46:34.260666+0000","last_became_peered":"2024-04-17T08:46:34.260666+0000","last_unstale":"2024-04-17T08:46:39.582701+0000","last_undegraded":"2024-04-17T08:46:39.582701+0000","last_fullsized":"2024-04-17T08:46:39.582701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:33:41.705987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583345+0000","last_change":"2024-04-17T08:46:34.260377+0000","last_active":"2024-04-17T08:46:39.583345+0000","last_peered":"2024-04-17T08:46:39.583345+0000","last_clean":"2024-04-17T08:46:39.583345+0000","last_became_active":"2024-04-17T08:46:34.260101+0000","last_became_peered":"2024-04-17T08:46:34.260101+0000","last_unstale":"2024-04-17T08:46:39.583345+0000","last_undegraded":"2024-04-17T08:46:39.583345+0000","last_fullsized":"2024-04-17T08:46:39.583345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:33:10.927487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583903+0000","last_change":"2024-04-17T08:46:34.260965+0000","last_active":"2024-04-17T08:46:39.583903+0000","last_peered":"2024-04-17T08:46:39.583903+0000","last_clean":"2024-04-17T08:46:39.583903+0000","last_became_active":"2024-04-17T08:46:34.260673+0000","last_became_peered":"2024-04-17T08:46:34.260673+0000","last_unstale":"2024-04-17T08:46:39.583903+0000","last_undegraded":"2024-04-17T08:46:39.583903+0000","last_fullsized":"2024-04-17T08:46:39.583903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:43:38.645282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581159+0000","last_change":"2024-04-17T08:46:34.255100+0000","last_active":"2024-04-17T08:46:39.581159+0000","last_peered":"2024-04-17T08:46:39.581159+0000","last_clean":"2024-04-17T08:46:39.581159+0000","last_became_active":"2024-04-17T08:46:34.254891+0000","last_became_peered":"2024-04-17T08:46:34.254891+0000","last_unstale":"2024-04-17T08:46:39.581159+0000","last_undegraded":"2024-04-17T08:46:39.581159+0000","last_fullsized":"2024-04-17T08:46:39.581159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:37:26.964605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582850+0000","last_change":"2024-04-17T08:46:34.258835+0000","last_active":"2024-04-17T08:46:39.582850+0000","last_peered":"2024-04-17T08:46:39.582850+0000","last_clean":"2024-04-17T08:46:39.582850+0000","last_became_active":"2024-04-17T08:46:34.258445+0000","last_became_peered":"2024-04-17T08:46:34.258445+0000","last_unstale":"2024-04-17T08:46:39.582850+0000","last_undegraded":"2024-04-17T08:46:39.582850+0000","last_fullsized":"2024-04-17T08:46:39.582850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:10:10.605700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.265683+0000","last_change":"2024-04-17T08:46:34.253142+0000","last_active":"2024-04-17T08:46:39.265683+0000","last_peered":"2024-04-17T08:46:39.265683+0000","last_clean":"2024-04-17T08:46:39.265683+0000","last_became_active":"2024-04-17T08:46:34.250102+0000","last_became_peered":"2024-04-17T08:46:34.250102+0000","last_unstale":"2024-04-17T08:46:39.265683+0000","last_undegraded":"2024-04-17T08:46:39.265683+0000","last_fullsized":"2024-04-17T08:46:39.265683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:11:40.376111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582833+0000","last_change":"2024-04-17T08:46:34.245004+0000","last_active":"2024-04-17T08:46:39.582833+0000","last_peered":"2024-04-17T08:46:39.582833+0000","last_clean":"2024-04-17T08:46:39.582833+0000","last_became_active":"2024-04-17T08:46:34.244719+0000","last_became_peered":"2024-04-17T08:46:34.244719+0000","last_unstale":"2024-04-17T08:46:39.582833+0000","last_undegraded":"2024-04-17T08:46:39.582833+0000","last_fullsized":"2024-04-17T08:46:39.582833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:34:21.920165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.266124+0000","last_change":"2024-04-17T08:46:34.251799+0000","last_active":"2024-04-17T08:46:39.266124+0000","last_peered":"2024-04-17T08:46:39.266124+0000","last_clean":"2024-04-17T08:46:39.266124+0000","last_became_active":"2024-04-17T08:46:34.251489+0000","last_became_peered":"2024-04-17T08:46:34.251489+0000","last_unstale":"2024-04-17T08:46:39.266124+0000","last_undegraded":"2024-04-17T08:46:39.266124+0000","last_fullsized":"2024-04-17T08:46:39.266124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:16:39.000776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581875+0000","last_change":"2024-04-17T08:46:34.238421+0000","last_active":"2024-04-17T08:46:39.581875+0000","last_peered":"2024-04-17T08:46:39.581875+0000","last_clean":"2024-04-17T08:46:39.581875+0000","last_became_active":"2024-04-17T08:46:34.238155+0000","last_became_peered":"2024-04-17T08:46:34.238155+0000","last_unstale":"2024-04-17T08:46:39.581875+0000","last_undegraded":"2024-04-17T08:46:39.581875+0000","last_fullsized":"2024-04-17T08:46:39.581875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:17:38.605512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583178+0000","last_change":"2024-04-17T08:46:34.254457+0000","last_active":"2024-04-17T08:46:39.583178+0000","last_peered":"2024-04-17T08:46:39.583178+0000","last_clean":"2024-04-17T08:46:39.583178+0000","last_became_active":"2024-04-17T08:46:34.252735+0000","last_became_peered":"2024-04-17T08:46:34.252735+0000","last_unstale":"2024-04-17T08:46:39.583178+0000","last_undegraded":"2024-04-17T08:46:39.583178+0000","last_fullsized":"2024-04-17T08:46:39.583178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:33:10.927487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583825+0000","last_change":"2024-04-17T08:46:34.252075+0000","last_active":"2024-04-17T08:46:39.583825+0000","last_peered":"2024-04-17T08:46:39.583825+0000","last_clean":"2024-04-17T08:46:39.583825+0000","last_became_active":"2024-04-17T08:46:34.251791+0000","last_became_peered":"2024-04-17T08:46:34.251791+0000","last_unstale":"2024-04-17T08:46:39.583825+0000","last_undegraded":"2024-04-17T08:46:39.583825+0000","last_fullsized":"2024-04-17T08:46:39.583825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:30:28.171658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T08:47:02.468 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T08:47:02.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.642+0000 7f3d90200640 1 Processor -- start 2024-04-17T08:47:02.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.642+0000 7f3d90200640 1 -- start start 2024-04-17T08:47:02.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.642+0000 7f3d90200640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f3d880af670 0x7f3d8815b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:02.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.642+0000 7f3d90200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d8806f980 0x7f3d88072530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:02.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.642+0000 7f3d90200640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d8815c260 con 0x7f3d880d0360 2024-04-17T08:47:02.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.642+0000 7f3d90200640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f3d8815c820 con 0x7f3d880af670 2024-04-17T08:47:02.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.642+0000 7f3d90200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f3d8815c540 con 0x7f3d8806f980 2024-04-17T08:47:02.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.642+0000 7f3d8d800640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f3d880af670 0x7f3d8815b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:02.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.642+0000 7f3d8e200640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f3d880d0360 0x7f3d8806dc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:58494/0 (socket says 172.21.15.152:58494) 2024-04-17T08:47:02.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.642+0000 7f3d8e200640 1 -- 172.21.15.152:0/2485160811 learned_addr learned my addr 172.21.15.152:0/2485160811 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:02.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.646+0000 7f3d8ce00640 1 --2- 172.21.15.152:0/2485160811 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d8806f980 0x7f3d88072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:02.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.646+0000 7f3d8d800640 1 -- 172.21.15.152:0/2485160811 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d8806f980 msgr2=0x7f3d88072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:02.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.646+0000 7f3d8d800640 1 --2- 172.21.15.152:0/2485160811 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d8806f980 0x7f3d88072530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:02.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.646+0000 7f3d8d800640 1 -- 172.21.15.152:0/2485160811 >> v1:172.21.15.152:6789/0 conn(0x7f3d880d0360 legacy=0x7f3d8806dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:02.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.646+0000 7f3d8d800640 1 -- 172.21.15.152:0/2485160811 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d88071d30 con 0x7f3d880af670 2024-04-17T08:47:02.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.646+0000 7f3d87e00640 1 -- 172.21.15.152:0/2485160811 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2359285737 0 0) 0x7f3d8815c260 con 0x7f3d880d0360 2024-04-17T08:47:02.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.646+0000 7f3d8ce00640 1 --2- 172.21.15.152:0/2485160811 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d8806f980 0x7f3d88072530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:47:02.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.646+0000 7f3d8d800640 1 --2- 172.21.15.152:0/2485160811 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d880af670 0x7f3d8815b8c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c009d90 tx=0x7f3d7c01c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e42c309c91bd5c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:02.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.646+0000 7f3d87e00640 1 -- 172.21.15.152:0/2485160811 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c0b2070 con 0x7f3d880af670 2024-04-17T08:47:02.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.646+0000 7f3d87e00640 1 -- 172.21.15.152:0/2485160811 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d7c0a5900 con 0x7f3d880af670 2024-04-17T08:47:02.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.646+0000 7f3d87e00640 1 -- 172.21.15.152:0/2485160811 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c0a5cd0 con 0x7f3d880af670 2024-04-17T08:47:02.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.646+0000 7f3d90200640 1 -- 172.21.15.152:0/2485160811 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d880af670 msgr2=0x7f3d8815b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:02.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.646+0000 7f3d90200640 1 --2- 172.21.15.152:0/2485160811 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d880af670 0x7f3d8815b8c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c009d90 tx=0x7f3d7c01c8b0 comp rx=0 tx=0).stop 2024-04-17T08:47:02.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.646+0000 7f3d90200640 1 -- 172.21.15.152:0/2485160811 shutdown_connections 2024-04-17T08:47:02.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.646+0000 7f3d90200640 1 --2- 172.21.15.152:0/2485160811 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d8806f980 0x7f3d88072530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:02.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.646+0000 7f3d90200640 1 --2- 172.21.15.152:0/2485160811 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d880af670 0x7f3d8815b8c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:02.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.646+0000 7f3d90200640 1 -- 172.21.15.152:0/2485160811 >> 172.21.15.152:0/2485160811 conn(0x7f3d880b3350 msgr2=0x7f3d880b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:02.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.646+0000 7f3d90200640 1 -- 172.21.15.152:0/2485160811 shutdown_connections 2024-04-17T08:47:02.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.646+0000 7f3d90200640 1 -- 172.21.15.152:0/2485160811 wait complete. 2024-04-17T08:47:02.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.650+0000 7f3d90200640 1 Processor -- start 2024-04-17T08:47:02.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.650+0000 7f3d90200640 1 -- start start 2024-04-17T08:47:02.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.650+0000 7f3d90200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d8806f980 0x7f3d881395d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:02.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.650+0000 7f3d90200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3d880af670 0x7f3d88154ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:02.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.650+0000 7f3d90200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d880d0360 0x7f3d88155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:02.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.650+0000 7f3d90200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8815bf80 con 0x7f3d8806f980 2024-04-17T08:47:02.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.650+0000 7f3d90200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8815be00 con 0x7f3d880af670 2024-04-17T08:47:02.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.650+0000 7f3d90200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f3d88072a70 con 0x7f3d880d0360 2024-04-17T08:47:02.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.650+0000 7f3d8d800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d8806f980 0x7f3d881395d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:02.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.650+0000 7f3d8d800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d8806f980 0x7f3d881395d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46964/0 (socket says 172.21.15.152:46964) 2024-04-17T08:47:02.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.650+0000 7f3d8d800640 1 -- 172.21.15.152:0/1554027763 learned_addr learned my addr 172.21.15.152:0/1554027763 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:02.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.650+0000 7f3d8ce00640 1 --2- 172.21.15.152:0/1554027763 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3d880af670 0x7f3d88154ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:02.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.650+0000 7f3d8e200640 1 --2- 172.21.15.152:0/1554027763 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d880d0360 0x7f3d88155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:02.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.650+0000 7f3d8d800640 1 -- 172.21.15.152:0/1554027763 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d880d0360 msgr2=0x7f3d88155410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:02.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.650+0000 7f3d8d800640 1 --2- 172.21.15.152:0/1554027763 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d880d0360 0x7f3d88155410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:02.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.650+0000 7f3d8d800640 1 -- 172.21.15.152:0/1554027763 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3d880af670 msgr2=0x7f3d88154ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:02.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.650+0000 7f3d8d800640 1 --2- 172.21.15.152:0/1554027763 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3d880af670 0x7f3d88154ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:02.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.650+0000 7f3d8d800640 1 -- 172.21.15.152:0/1554027763 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d8814fd10 con 0x7f3d8806f980 2024-04-17T08:47:02.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.650+0000 7f3d8ce00640 1 --2- 172.21.15.152:0/1554027763 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3d880af670 0x7f3d88154ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:47:02.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.650+0000 7f3d8e200640 1 --2- 172.21.15.152:0/1554027763 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d880d0360 0x7f3d88155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:47:02.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.650+0000 7f3d8d800640 1 --2- 172.21.15.152:0/1554027763 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d8806f980 0x7f3d881395d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c009d90 tx=0x7f3d7c019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:02.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.650+0000 7f3d85600640 1 -- 172.21.15.152:0/1554027763 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c0bd030 con 0x7f3d8806f980 2024-04-17T08:47:02.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.650+0000 7f3d85600640 1 -- 172.21.15.152:0/1554027763 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d7c0ad4c0 con 0x7f3d8806f980 2024-04-17T08:47:02.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.650+0000 7f3d85600640 1 -- 172.21.15.152:0/1554027763 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c0b2040 con 0x7f3d8806f980 2024-04-17T08:47:02.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.650+0000 7f3d90200640 1 -- 172.21.15.152:0/1554027763 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d8814fff0 con 0x7f3d8806f980 2024-04-17T08:47:02.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.650+0000 7f3d90200640 1 -- 172.21.15.152:0/1554027763 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d881505b0 con 0x7f3d8806f980 2024-04-17T08:47:02.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.654+0000 7f3d90200640 1 -- 172.21.15.152:0/1554027763 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d88068a30 con 0x7f3d8806f980 2024-04-17T08:47:02.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.654+0000 7f3d85600640 1 -- 172.21.15.152:0/1554027763 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3d7c0c0070 con 0x7f3d8806f980 2024-04-17T08:47:02.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.654+0000 7f3d85600640 1 --2- 172.21.15.152:0/1554027763 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3d68068380 0x7f3d6806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:02.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.654+0000 7f3d85600640 1 -- 172.21.15.152:0/1554027763 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f3d7c1216d0 con 0x7f3d8806f980 2024-04-17T08:47:02.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.654+0000 7f3d8ce00640 1 --2- 172.21.15.152:0/1554027763 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3d68068380 0x7f3d6806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:02.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.654+0000 7f3d8ce00640 1 --2- 172.21.15.152:0/1554027763 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3d68068380 0x7f3d6806a840 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3d8815a750 tx=0x7f3d74008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:02.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.658+0000 7f3d85600640 1 -- 172.21.15.152:0/1554027763 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f3d7c0c8020 con 0x7f3d8806f980 2024-04-17T08:47:02.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.810+0000 7f3d90200640 1 -- 172.21.15.152:0/1554027763 --> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3d88072740 con 0x7f3d68068380 2024-04-17T08:47:02.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.818+0000 7f3d85600640 1 -- 172.21.15.152:0/1554027763 <== mgr.4104 v2:172.21.15.152:6832/3078522445 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332537 (secure 0 0 0) 0x7f3d88072740 con 0x7f3d68068380 2024-04-17T08:47:02.823 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:47:02.825 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2024-04-17T08:47:02.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.822+0000 7f3d90200640 1 -- 172.21.15.152:0/1554027763 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3d68068380 msgr2=0x7f3d6806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:02.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.822+0000 7f3d90200640 1 --2- 172.21.15.152:0/1554027763 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3d68068380 0x7f3d6806a840 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3d8815a750 tx=0x7f3d74008040 comp rx=0 tx=0).stop 2024-04-17T08:47:02.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.822+0000 7f3d90200640 1 -- 172.21.15.152:0/1554027763 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d8806f980 msgr2=0x7f3d881395d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:02.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.822+0000 7f3d90200640 1 --2- 172.21.15.152:0/1554027763 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d8806f980 0x7f3d881395d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c009d90 tx=0x7f3d7c019650 comp rx=0 tx=0).stop 2024-04-17T08:47:02.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.822+0000 7f3d90200640 1 -- 172.21.15.152:0/1554027763 shutdown_connections 2024-04-17T08:47:02.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.822+0000 7f3d90200640 1 --2- 172.21.15.152:0/1554027763 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3d68068380 0x7f3d6806a840 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:02.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.822+0000 7f3d90200640 1 --2- 172.21.15.152:0/1554027763 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d880d0360 0x7f3d88155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:02.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.822+0000 7f3d90200640 1 --2- 172.21.15.152:0/1554027763 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3d880af670 0x7f3d88154ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:02.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.822+0000 7f3d90200640 1 --2- 172.21.15.152:0/1554027763 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d8806f980 0x7f3d881395d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:02.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.822+0000 7f3d90200640 1 -- 172.21.15.152:0/1554027763 >> 172.21.15.152:0/1554027763 conn(0x7f3d880b3350 msgr2=0x7f3d8806e810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:02.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.822+0000 7f3d90200640 1 -- 172.21.15.152:0/1554027763 shutdown_connections 2024-04-17T08:47:02.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:02.822+0000 7f3d90200640 1 -- 172.21.15.152:0/1554027763 wait complete. 2024-04-17T08:47:02.843 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-04-17T08:47:01.370275+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219388,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755332,"statfs":{"total":773094113280,"available":772869459968,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004461"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582361+0000","last_change":"2024-04-17T08:46:33.235434+0000","last_active":"2024-04-17T08:46:39.582361+0000","last_peered":"2024-04-17T08:46:39.582361+0000","last_clean":"2024-04-17T08:46:39.582361+0000","last_became_active":"2024-04-17T08:46:33.235164+0000","last_became_peered":"2024-04-17T08:46:33.235164+0000","last_unstale":"2024-04-17T08:46:39.582361+0000","last_undegraded":"2024-04-17T08:46:39.582361+0000","last_fullsized":"2024-04-17T08:46:39.582361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:22:07.958599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583648+0000","last_change":"2024-04-17T08:46:34.245833+0000","last_active":"2024-04-17T08:46:39.583648+0000","last_peered":"2024-04-17T08:46:39.583648+0000","last_clean":"2024-04-17T08:46:39.583648+0000","last_became_active":"2024-04-17T08:46:34.245456+0000","last_became_peered":"2024-04-17T08:46:34.245456+0000","last_unstale":"2024-04-17T08:46:39.583648+0000","last_undegraded":"2024-04-17T08:46:39.583648+0000","last_fullsized":"2024-04-17T08:46:39.583648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:11:40.376111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582185+0000","last_change":"2024-04-17T08:46:38.514450+0000","last_active":"2024-04-17T08:46:39.582185+0000","last_peered":"2024-04-17T08:46:39.582185+0000","last_clean":"2024-04-17T08:46:39.582185+0000","last_became_active":"2024-04-17T08:46:38.514041+0000","last_became_peered":"2024-04-17T08:46:38.514041+0000","last_unstale":"2024-04-17T08:46:39.582185+0000","last_undegraded":"2024-04-17T08:46:39.582185+0000","last_fullsized":"2024-04-17T08:46:39.582185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:00:35.685592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583737+0000","last_change":"2024-04-17T08:46:33.233688+0000","last_active":"2024-04-17T08:46:39.583737+0000","last_peered":"2024-04-17T08:46:39.583737+0000","last_clean":"2024-04-17T08:46:39.583737+0000","last_became_active":"2024-04-17T08:46:33.233377+0000","last_became_peered":"2024-04-17T08:46:33.233377+0000","last_unstale":"2024-04-17T08:46:39.583737+0000","last_undegraded":"2024-04-17T08:46:39.583737+0000","last_fullsized":"2024-04-17T08:46:39.583737+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:25:21.370859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582078+0000","last_change":"2024-04-17T08:46:34.255775+0000","last_active":"2024-04-17T08:46:39.582078+0000","last_peered":"2024-04-17T08:46:39.582078+0000","last_clean":"2024-04-17T08:46:39.582078+0000","last_became_active":"2024-04-17T08:46:34.255196+0000","last_became_peered":"2024-04-17T08:46:34.255196+0000","last_unstale":"2024-04-17T08:46:39.582078+0000","last_undegraded":"2024-04-17T08:46:39.582078+0000","last_fullsized":"2024-04-17T08:46:39.582078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:33:41.705987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.265703+0000","last_change":"2024-04-17T08:46:38.285336+0000","last_active":"2024-04-17T08:46:39.265703+0000","last_peered":"2024-04-17T08:46:39.265703+0000","last_clean":"2024-04-17T08:46:39.265703+0000","last_became_active":"2024-04-17T08:46:38.284905+0000","last_became_peered":"2024-04-17T08:46:38.284905+0000","last_unstale":"2024-04-17T08:46:39.265703+0000","last_undegraded":"2024-04-17T08:46:39.265703+0000","last_fullsized":"2024-04-17T08:46:39.265703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:33:14.972491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583533+0000","last_change":"2024-04-17T08:46:33.239191+0000","last_active":"2024-04-17T08:46:39.583533+0000","last_peered":"2024-04-17T08:46:39.583533+0000","last_clean":"2024-04-17T08:46:39.583533+0000","last_became_active":"2024-04-17T08:46:33.238959+0000","last_became_peered":"2024-04-17T08:46:33.238959+0000","last_unstale":"2024-04-17T08:46:39.583533+0000","last_undegraded":"2024-04-17T08:46:39.583533+0000","last_fullsized":"2024-04-17T08:46:39.583533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:45:46.167023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.266216+0000","last_change":"2024-04-17T08:46:34.251441+0000","last_active":"2024-04-17T08:46:39.266216+0000","last_peered":"2024-04-17T08:46:39.266216+0000","last_clean":"2024-04-17T08:46:39.266216+0000","last_became_active":"2024-04-17T08:46:34.251121+0000","last_became_peered":"2024-04-17T08:46:34.251121+0000","last_unstale":"2024-04-17T08:46:39.266216+0000","last_undegraded":"2024-04-17T08:46:39.266216+0000","last_fullsized":"2024-04-17T08:46:39.266216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:38:02.038788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.266419+0000","last_change":"2024-04-17T08:46:38.286397+0000","last_active":"2024-04-17T08:46:39.266419+0000","last_peered":"2024-04-17T08:46:39.266419+0000","last_clean":"2024-04-17T08:46:39.266419+0000","last_became_active":"2024-04-17T08:46:38.285683+0000","last_became_peered":"2024-04-17T08:46:38.285683+0000","last_unstale":"2024-04-17T08:46:39.266419+0000","last_undegraded":"2024-04-17T08:46:39.266419+0000","last_fullsized":"2024-04-17T08:46:39.266419+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:11:44.421115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583517+0000","last_change":"2024-04-17T08:46:33.241157+0000","last_active":"2024-04-17T08:46:39.583517+0000","last_peered":"2024-04-17T08:46:39.583517+0000","last_clean":"2024-04-17T08:46:39.583517+0000","last_became_active":"2024-04-17T08:46:33.236275+0000","last_became_peered":"2024-04-17T08:46:33.236275+0000","last_unstale":"2024-04-17T08:46:39.583517+0000","last_undegraded":"2024-04-17T08:46:39.583517+0000","last_fullsized":"2024-04-17T08:46:39.583517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:22:14.260721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.267730+0000","last_change":"2024-04-17T08:46:34.250653+0000","last_active":"2024-04-17T08:46:39.267730+0000","last_peered":"2024-04-17T08:46:39.267730+0000","last_clean":"2024-04-17T08:46:39.267730+0000","last_became_active":"2024-04-17T08:46:34.250401+0000","last_became_peered":"2024-04-17T08:46:34.250401+0000","last_unstale":"2024-04-17T08:46:39.267730+0000","last_undegraded":"2024-04-17T08:46:39.267730+0000","last_fullsized":"2024-04-17T08:46:39.267730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:58:55.513935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.266327+0000","last_change":"2024-04-17T08:46:38.282885+0000","last_active":"2024-04-17T08:46:39.266327+0000","last_peered":"2024-04-17T08:46:39.266327+0000","last_clean":"2024-04-17T08:46:39.266327+0000","last_became_active":"2024-04-17T08:46:38.282482+0000","last_became_peered":"2024-04-17T08:46:38.282482+0000","last_unstale":"2024-04-17T08:46:39.266327+0000","last_undegraded":"2024-04-17T08:46:39.266327+0000","last_fullsized":"2024-04-17T08:46:39.266327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:13:54.574905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582137+0000","last_change":"2024-04-17T08:46:34.243339+0000","last_active":"2024-04-17T08:46:39.582137+0000","last_peered":"2024-04-17T08:46:39.582137+0000","last_clean":"2024-04-17T08:46:39.582137+0000","last_became_active":"2024-04-17T08:46:34.243019+0000","last_became_peered":"2024-04-17T08:46:34.243019+0000","last_unstale":"2024-04-17T08:46:39.582137+0000","last_undegraded":"2024-04-17T08:46:39.582137+0000","last_fullsized":"2024-04-17T08:46:39.582137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:02:18.996319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583062+0000","last_change":"2024-04-17T08:46:33.236268+0000","last_active":"2024-04-17T08:46:39.583062+0000","last_peered":"2024-04-17T08:46:39.583062+0000","last_clean":"2024-04-17T08:46:39.583062+0000","last_became_active":"2024-04-17T08:46:33.235432+0000","last_became_peered":"2024-04-17T08:46:33.235432+0000","last_unstale":"2024-04-17T08:46:39.583062+0000","last_undegraded":"2024-04-17T08:46:39.583062+0000","last_fullsized":"2024-04-17T08:46:39.583062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:30:42.762461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.267184+0000","last_change":"2024-04-17T08:46:38.291945+0000","last_active":"2024-04-17T08:46:39.267184+0000","last_peered":"2024-04-17T08:46:39.267184+0000","last_clean":"2024-04-17T08:46:39.267184+0000","last_became_active":"2024-04-17T08:46:38.291516+0000","last_became_peered":"2024-04-17T08:46:38.291516+0000","last_unstale":"2024-04-17T08:46:39.267184+0000","last_undegraded":"2024-04-17T08:46:39.267184+0000","last_fullsized":"2024-04-17T08:46:39.267184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:38:06.083792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582509+0000","last_change":"2024-04-17T08:46:34.244135+0000","last_active":"2024-04-17T08:46:39.582509+0000","last_peered":"2024-04-17T08:46:39.582509+0000","last_clean":"2024-04-17T08:46:39.582509+0000","last_became_active":"2024-04-17T08:46:34.236180+0000","last_became_peered":"2024-04-17T08:46:34.236180+0000","last_unstale":"2024-04-17T08:46:39.582509+0000","last_undegraded":"2024-04-17T08:46:39.582509+0000","last_fullsized":"2024-04-17T08:46:39.582509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:33:10.927487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581609+0000","last_change":"2024-04-17T08:46:33.231027+0000","last_active":"2024-04-17T08:46:39.581609+0000","last_peered":"2024-04-17T08:46:39.581609+0000","last_clean":"2024-04-17T08:46:39.581609+0000","last_became_active":"2024-04-17T08:46:33.230663+0000","last_became_peered":"2024-04-17T08:46:33.230663+0000","last_unstale":"2024-04-17T08:46:39.581609+0000","last_undegraded":"2024-04-17T08:46:39.581609+0000","last_fullsized":"2024-04-17T08:46:39.581609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:20:19.185830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.266822+0000","last_change":"2024-04-17T08:46:38.292349+0000","last_active":"2024-04-17T08:46:39.266822+0000","last_peered":"2024-04-17T08:46:39.266822+0000","last_clean":"2024-04-17T08:46:39.266822+0000","last_became_active":"2024-04-17T08:46:38.291572+0000","last_became_peered":"2024-04-17T08:46:38.291572+0000","last_unstale":"2024-04-17T08:46:39.266822+0000","last_undegraded":"2024-04-17T08:46:39.266822+0000","last_fullsized":"2024-04-17T08:46:39.266822+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:10:14.650704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582076+0000","last_change":"2024-04-17T08:46:34.238266+0000","last_active":"2024-04-17T08:46:39.582076+0000","last_peered":"2024-04-17T08:46:39.582076+0000","last_clean":"2024-04-17T08:46:39.582076+0000","last_became_active":"2024-04-17T08:46:34.237968+0000","last_became_peered":"2024-04-17T08:46:34.237968+0000","last_unstale":"2024-04-17T08:46:39.582076+0000","last_undegraded":"2024-04-17T08:46:39.582076+0000","last_fullsized":"2024-04-17T08:46:39.582076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:33:41.705987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581246+0000","last_change":"2024-04-17T08:46:33.228954+0000","last_active":"2024-04-17T08:46:39.581246+0000","last_peered":"2024-04-17T08:46:39.581246+0000","last_clean":"2024-04-17T08:46:39.581246+0000","last_became_active":"2024-04-17T08:46:33.228638+0000","last_became_peered":"2024-04-17T08:46:33.228638+0000","last_unstale":"2024-04-17T08:46:39.581246+0000","last_undegraded":"2024-04-17T08:46:39.581246+0000","last_fullsized":"2024-04-17T08:46:39.581246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:55:39.562141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583149+0000","last_change":"2024-04-17T08:46:38.514583+0000","last_active":"2024-04-17T08:46:39.583149+0000","last_peered":"2024-04-17T08:46:39.583149+0000","last_clean":"2024-04-17T08:46:39.583149+0000","last_became_active":"2024-04-17T08:46:38.514225+0000","last_became_peered":"2024-04-17T08:46:38.514225+0000","last_unstale":"2024-04-17T08:46:39.583149+0000","last_undegraded":"2024-04-17T08:46:39.583149+0000","last_fullsized":"2024-04-17T08:46:39.583149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:34:35.322841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.267337+0000","last_change":"2024-04-17T08:46:34.241177+0000","last_active":"2024-04-17T08:46:39.267337+0000","last_peered":"2024-04-17T08:46:39.267337+0000","last_clean":"2024-04-17T08:46:39.267337+0000","last_became_active":"2024-04-17T08:46:34.240927+0000","last_became_peered":"2024-04-17T08:46:34.240927+0000","last_unstale":"2024-04-17T08:46:39.267337+0000","last_undegraded":"2024-04-17T08:46:39.267337+0000","last_fullsized":"2024-04-17T08:46:39.267337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:55:03.760867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583141+0000","last_change":"2024-04-17T08:46:33.240692+0000","last_active":"2024-04-17T08:46:39.583141+0000","last_peered":"2024-04-17T08:46:39.583141+0000","last_clean":"2024-04-17T08:46:39.583141+0000","last_became_active":"2024-04-17T08:46:33.240411+0000","last_became_peered":"2024-04-17T08:46:33.240411+0000","last_unstale":"2024-04-17T08:46:39.583141+0000","last_undegraded":"2024-04-17T08:46:39.583141+0000","last_fullsized":"2024-04-17T08:46:39.583141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:55:02.754402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.267455+0000","last_change":"2024-04-17T08:46:38.292332+0000","last_active":"2024-04-17T08:46:39.267455+0000","last_peered":"2024-04-17T08:46:39.267455+0000","last_clean":"2024-04-17T08:46:39.267455+0000","last_became_active":"2024-04-17T08:46:38.291458+0000","last_became_peered":"2024-04-17T08:46:38.291458+0000","last_unstale":"2024-04-17T08:46:39.267455+0000","last_undegraded":"2024-04-17T08:46:39.267455+0000","last_fullsized":"2024-04-17T08:46:39.267455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:58:59.558939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582715+0000","last_change":"2024-04-17T08:46:34.240195+0000","last_active":"2024-04-17T08:46:39.582715+0000","last_peered":"2024-04-17T08:46:39.582715+0000","last_clean":"2024-04-17T08:46:39.582715+0000","last_became_active":"2024-04-17T08:46:34.239873+0000","last_became_peered":"2024-04-17T08:46:34.239873+0000","last_unstale":"2024-04-17T08:46:39.582715+0000","last_undegraded":"2024-04-17T08:46:39.582715+0000","last_fullsized":"2024-04-17T08:46:39.582715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:02:18.996319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583776+0000","last_change":"2024-04-17T08:46:33.238292+0000","last_active":"2024-04-17T08:46:39.583776+0000","last_peered":"2024-04-17T08:46:39.583776+0000","last_clean":"2024-04-17T08:46:39.583776+0000","last_became_active":"2024-04-17T08:46:33.237934+0000","last_became_peered":"2024-04-17T08:46:33.237934+0000","last_unstale":"2024-04-17T08:46:39.583776+0000","last_undegraded":"2024-04-17T08:46:39.583776+0000","last_fullsized":"2024-04-17T08:46:39.583776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:22:14.260721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.267275+0000","last_change":"2024-04-17T08:46:38.510638+0000","last_active":"2024-04-17T08:46:39.267275+0000","last_peered":"2024-04-17T08:46:39.267275+0000","last_clean":"2024-04-17T08:46:39.267275+0000","last_became_active":"2024-04-17T08:46:38.510233+0000","last_became_peered":"2024-04-17T08:46:38.510233+0000","last_unstale":"2024-04-17T08:46:39.267275+0000","last_undegraded":"2024-04-17T08:46:39.267275+0000","last_fullsized":"2024-04-17T08:46:39.267275+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:34:25.965169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.584015+0000","last_change":"2024-04-17T08:46:34.252802+0000","last_active":"2024-04-17T08:46:39.584015+0000","last_peered":"2024-04-17T08:46:39.584015+0000","last_clean":"2024-04-17T08:46:39.584015+0000","last_became_active":"2024-04-17T08:46:34.252503+0000","last_became_peered":"2024-04-17T08:46:34.252503+0000","last_unstale":"2024-04-17T08:46:39.584015+0000","last_undegraded":"2024-04-17T08:46:39.584015+0000","last_fullsized":"2024-04-17T08:46:39.584015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:10:10.605700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583273+0000","last_change":"2024-04-17T08:46:33.235073+0000","last_active":"2024-04-17T08:46:39.583273+0000","last_peered":"2024-04-17T08:46:39.583273+0000","last_clean":"2024-04-17T08:46:39.583273+0000","last_became_active":"2024-04-17T08:46:33.234765+0000","last_became_peered":"2024-04-17T08:46:33.234765+0000","last_unstale":"2024-04-17T08:46:39.583273+0000","last_undegraded":"2024-04-17T08:46:39.583273+0000","last_fullsized":"2024-04-17T08:46:39.583273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:18:08.779923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.580688+0000","last_change":"2024-04-17T08:46:38.513389+0000","last_active":"2024-04-17T08:46:39.580688+0000","last_peered":"2024-04-17T08:46:39.580688+0000","last_clean":"2024-04-17T08:46:39.580688+0000","last_became_active":"2024-04-17T08:46:38.512983+0000","last_became_peered":"2024-04-17T08:46:38.512983+0000","last_unstale":"2024-04-17T08:46:39.580688+0000","last_undegraded":"2024-04-17T08:46:39.580688+0000","last_fullsized":"2024-04-17T08:46:39.580688+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:33:35.245363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581949+0000","last_change":"2024-04-17T08:46:34.244956+0000","last_active":"2024-04-17T08:46:39.581949+0000","last_peered":"2024-04-17T08:46:39.581949+0000","last_clean":"2024-04-17T08:46:39.581949+0000","last_became_active":"2024-04-17T08:46:34.244612+0000","last_became_peered":"2024-04-17T08:46:34.244612+0000","last_unstale":"2024-04-17T08:46:39.581949+0000","last_undegraded":"2024-04-17T08:46:39.581949+0000","last_fullsized":"2024-04-17T08:46:39.581949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:33:41.705987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583727+0000","last_change":"2024-04-17T08:46:33.240546+0000","last_active":"2024-04-17T08:46:39.583727+0000","last_peered":"2024-04-17T08:46:39.583727+0000","last_clean":"2024-04-17T08:46:39.583727+0000","last_became_active":"2024-04-17T08:46:33.240225+0000","last_became_peered":"2024-04-17T08:46:33.240225+0000","last_unstale":"2024-04-17T08:46:39.583727+0000","last_undegraded":"2024-04-17T08:46:39.583727+0000","last_fullsized":"2024-04-17T08:46:39.583727+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:39.361759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581144+0000","last_change":"2024-04-17T08:46:38.509788+0000","last_active":"2024-04-17T08:46:39.581144+0000","last_peered":"2024-04-17T08:46:39.581144+0000","last_clean":"2024-04-17T08:46:39.581144+0000","last_became_active":"2024-04-17T08:46:38.509392+0000","last_became_peered":"2024-04-17T08:46:38.509392+0000","last_unstale":"2024-04-17T08:46:39.581144+0000","last_undegraded":"2024-04-17T08:46:39.581144+0000","last_fullsized":"2024-04-17T08:46:39.581144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:58:59.558939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.267877+0000","last_change":"2024-04-17T08:46:34.250149+0000","last_active":"2024-04-17T08:46:39.267877+0000","last_peered":"2024-04-17T08:46:39.267877+0000","last_clean":"2024-04-17T08:46:39.267877+0000","last_became_active":"2024-04-17T08:46:34.249852+0000","last_became_peered":"2024-04-17T08:46:34.249852+0000","last_unstale":"2024-04-17T08:46:39.267877+0000","last_undegraded":"2024-04-17T08:46:39.267877+0000","last_fullsized":"2024-04-17T08:46:39.267877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:44:51.934889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582032+0000","last_change":"2024-04-17T08:46:33.230892+0000","last_active":"2024-04-17T08:46:39.582032+0000","last_peered":"2024-04-17T08:46:39.582032+0000","last_clean":"2024-04-17T08:46:39.582032+0000","last_became_active":"2024-04-17T08:46:33.230624+0000","last_became_peered":"2024-04-17T08:46:33.230624+0000","last_unstale":"2024-04-17T08:46:39.582032+0000","last_undegraded":"2024-04-17T08:46:39.582032+0000","last_fullsized":"2024-04-17T08:46:39.582032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:16:35.663647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581361+0000","last_change":"2024-04-17T08:46:38.291956+0000","last_active":"2024-04-17T08:46:39.581361+0000","last_peered":"2024-04-17T08:46:39.581361+0000","last_clean":"2024-04-17T08:46:39.581361+0000","last_became_active":"2024-04-17T08:46:38.291609+0000","last_became_peered":"2024-04-17T08:46:38.291609+0000","last_unstale":"2024-04-17T08:46:39.581361+0000","last_undegraded":"2024-04-17T08:46:39.581361+0000","last_fullsized":"2024-04-17T08:46:39.581361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:58:59.558939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.266827+0000","last_change":"2024-04-17T08:46:34.241919+0000","last_active":"2024-04-17T08:46:39.266827+0000","last_peered":"2024-04-17T08:46:39.266827+0000","last_clean":"2024-04-17T08:46:39.266827+0000","last_became_active":"2024-04-17T08:46:34.241745+0000","last_became_peered":"2024-04-17T08:46:34.241745+0000","last_unstale":"2024-04-17T08:46:39.266827+0000","last_undegraded":"2024-04-17T08:46:39.266827+0000","last_fullsized":"2024-04-17T08:46:39.266827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:20:20.192296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.265896+0000","last_change":"2024-04-17T08:46:33.223261+0000","last_active":"2024-04-17T08:46:39.265896+0000","last_peered":"2024-04-17T08:46:39.265896+0000","last_clean":"2024-04-17T08:46:39.265896+0000","last_became_active":"2024-04-17T08:46:33.222852+0000","last_became_peered":"2024-04-17T08:46:33.222852+0000","last_unstale":"2024-04-17T08:46:39.265896+0000","last_undegraded":"2024-04-17T08:46:39.265896+0000","last_fullsized":"2024-04-17T08:46:39.265896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:55:02.754402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581903+0000","last_change":"2024-04-17T08:46:38.291195+0000","last_active":"2024-04-17T08:46:39.581903+0000","last_peered":"2024-04-17T08:46:39.581903+0000","last_clean":"2024-04-17T08:46:39.581903+0000","last_became_active":"2024-04-17T08:46:38.290701+0000","last_became_peered":"2024-04-17T08:46:38.290701+0000","last_unstale":"2024-04-17T08:46:39.581903+0000","last_undegraded":"2024-04-17T08:46:39.581903+0000","last_fullsized":"2024-04-17T08:46:39.581903+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:54:46.069200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.580846+0000","last_change":"2024-04-17T08:46:34.243134+0000","last_active":"2024-04-17T08:46:39.580846+0000","last_peered":"2024-04-17T08:46:39.580846+0000","last_clean":"2024-04-17T08:46:39.580846+0000","last_became_active":"2024-04-17T08:46:34.242856+0000","last_became_peered":"2024-04-17T08:46:34.242856+0000","last_unstale":"2024-04-17T08:46:39.580846+0000","last_undegraded":"2024-04-17T08:46:39.580846+0000","last_fullsized":"2024-04-17T08:46:39.580846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:02:18.996319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.263200+0000","last_change":"2024-04-17T08:46:33.233832+0000","last_active":"2024-04-17T08:46:39.263200+0000","last_peered":"2024-04-17T08:46:39.263200+0000","last_clean":"2024-04-17T08:46:39.263200+0000","last_became_active":"2024-04-17T08:46:33.233591+0000","last_became_peered":"2024-04-17T08:46:33.233591+0000","last_unstale":"2024-04-17T08:46:39.263200+0000","last_undegraded":"2024-04-17T08:46:39.263200+0000","last_fullsized":"2024-04-17T08:46:39.263200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:16:35.663647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583229+0000","last_change":"2024-04-17T08:46:38.286653+0000","last_active":"2024-04-17T08:46:39.583229+0000","last_peered":"2024-04-17T08:46:39.583229+0000","last_clean":"2024-04-17T08:46:39.583229+0000","last_became_active":"2024-04-17T08:46:38.285745+0000","last_became_peered":"2024-04-17T08:46:38.285745+0000","last_unstale":"2024-04-17T08:46:39.583229+0000","last_undegraded":"2024-04-17T08:46:39.583229+0000","last_fullsized":"2024-04-17T08:46:39.583229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:30:32.216661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581290+0000","last_change":"2024-04-17T08:46:34.247813+0000","last_active":"2024-04-17T08:46:39.581290+0000","last_peered":"2024-04-17T08:46:39.581290+0000","last_clean":"2024-04-17T08:46:39.581290+0000","last_became_active":"2024-04-17T08:46:34.247520+0000","last_became_peered":"2024-04-17T08:46:34.247520+0000","last_unstale":"2024-04-17T08:46:39.581290+0000","last_undegraded":"2024-04-17T08:46:39.581290+0000","last_fullsized":"2024-04-17T08:46:39.581290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:31:20.501824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583142+0000","last_change":"2024-04-17T08:46:33.238907+0000","last_active":"2024-04-17T08:46:39.583142+0000","last_peered":"2024-04-17T08:46:39.583142+0000","last_clean":"2024-04-17T08:46:39.583142+0000","last_became_active":"2024-04-17T08:46:33.238615+0000","last_became_peered":"2024-04-17T08:46:33.238615+0000","last_unstale":"2024-04-17T08:46:39.583142+0000","last_undegraded":"2024-04-17T08:46:39.583142+0000","last_fullsized":"2024-04-17T08:46:39.583142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:18:08.779923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582573+0000","last_change":"2024-04-17T08:46:38.509796+0000","last_active":"2024-04-17T08:46:39.582573+0000","last_peered":"2024-04-17T08:46:39.582573+0000","last_clean":"2024-04-17T08:46:39.582573+0000","last_became_active":"2024-04-17T08:46:38.509416+0000","last_became_peered":"2024-04-17T08:46:38.509416+0000","last_unstale":"2024-04-17T08:46:39.582573+0000","last_undegraded":"2024-04-17T08:46:39.582573+0000","last_fullsized":"2024-04-17T08:46:39.582573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:30:32.216661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582207+0000","last_change":"2024-04-17T08:46:34.255520+0000","last_active":"2024-04-17T08:46:39.582207+0000","last_peered":"2024-04-17T08:46:39.582207+0000","last_clean":"2024-04-17T08:46:39.582207+0000","last_became_active":"2024-04-17T08:46:34.255053+0000","last_became_peered":"2024-04-17T08:46:34.255053+0000","last_unstale":"2024-04-17T08:46:39.582207+0000","last_undegraded":"2024-04-17T08:46:39.582207+0000","last_fullsized":"2024-04-17T08:46:39.582207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:49:50.654842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.265863+0000","last_change":"2024-04-17T08:46:33.217828+0000","last_active":"2024-04-17T08:46:39.265863+0000","last_peered":"2024-04-17T08:46:39.265863+0000","last_clean":"2024-04-17T08:46:39.265863+0000","last_became_active":"2024-04-17T08:46:33.217484+0000","last_became_peered":"2024-04-17T08:46:33.217484+0000","last_unstale":"2024-04-17T08:46:39.265863+0000","last_undegraded":"2024-04-17T08:46:39.265863+0000","last_fullsized":"2024-04-17T08:46:39.265863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:55:39.562141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":177,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583272+0000","last_change":"2024-04-17T08:46:22.807988+0000","last_active":"2024-04-17T08:46:39.583272+0000","last_peered":"2024-04-17T08:46:39.583272+0000","last_clean":"2024-04-17T08:46:39.583272+0000","last_became_active":"2024-04-17T08:46:22.806843+0000","last_became_peered":"2024-04-17T08:46:22.806843+0000","last_unstale":"2024-04-17T08:46:39.583272+0000","last_undegraded":"2024-04-17T08:46:39.583272+0000","last_fullsized":"2024-04-17T08:46:39.583272+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:21.741557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:21.741557+0000","last_clean_scrub_stamp":"2024-04-17T08:46:21.741557+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:28:38.254696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583294+0000","last_change":"2024-04-17T08:46:38.515691+0000","last_active":"2024-04-17T08:46:39.583294+0000","last_peered":"2024-04-17T08:46:39.583294+0000","last_clean":"2024-04-17T08:46:39.583294+0000","last_became_active":"2024-04-17T08:46:38.515336+0000","last_became_peered":"2024-04-17T08:46:38.515336+0000","last_unstale":"2024-04-17T08:46:39.583294+0000","last_undegraded":"2024-04-17T08:46:39.583294+0000","last_fullsized":"2024-04-17T08:46:39.583294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:34:25.965169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583364+0000","last_change":"2024-04-17T08:46:34.261227+0000","last_active":"2024-04-17T08:46:39.583364+0000","last_peered":"2024-04-17T08:46:39.583364+0000","last_clean":"2024-04-17T08:46:39.583364+0000","last_became_active":"2024-04-17T08:46:34.260463+0000","last_became_peered":"2024-04-17T08:46:34.260463+0000","last_unstale":"2024-04-17T08:46:39.583364+0000","last_undegraded":"2024-04-17T08:46:39.583364+0000","last_fullsized":"2024-04-17T08:46:39.583364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:38:02.038788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.263511+0000","last_change":"2024-04-17T08:46:33.231431+0000","last_active":"2024-04-17T08:46:39.263511+0000","last_peered":"2024-04-17T08:46:39.263511+0000","last_clean":"2024-04-17T08:46:39.263511+0000","last_became_active":"2024-04-17T08:46:33.227785+0000","last_became_peered":"2024-04-17T08:46:33.227785+0000","last_unstale":"2024-04-17T08:46:39.263511+0000","last_undegraded":"2024-04-17T08:46:39.263511+0000","last_fullsized":"2024-04-17T08:46:39.263511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:25:21.370859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582182+0000","last_change":"2024-04-17T08:46:38.514411+0000","last_active":"2024-04-17T08:46:39.582182+0000","last_peered":"2024-04-17T08:46:39.582182+0000","last_clean":"2024-04-17T08:46:39.582182+0000","last_became_active":"2024-04-17T08:46:38.512337+0000","last_became_peered":"2024-04-17T08:46:38.512337+0000","last_unstale":"2024-04-17T08:46:39.582182+0000","last_undegraded":"2024-04-17T08:46:39.582182+0000","last_fullsized":"2024-04-17T08:46:39.582182+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:38:06.083792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.267341+0000","last_change":"2024-04-17T08:46:34.253572+0000","last_active":"2024-04-17T08:46:39.267341+0000","last_peered":"2024-04-17T08:46:39.267341+0000","last_clean":"2024-04-17T08:46:39.267341+0000","last_became_active":"2024-04-17T08:46:34.253185+0000","last_became_peered":"2024-04-17T08:46:34.253185+0000","last_unstale":"2024-04-17T08:46:39.267341+0000","last_undegraded":"2024-04-17T08:46:39.267341+0000","last_fullsized":"2024-04-17T08:46:39.267341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:34:21.920165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582953+0000","last_change":"2024-04-17T08:46:33.224543+0000","last_active":"2024-04-17T08:46:39.582953+0000","last_peered":"2024-04-17T08:46:39.582953+0000","last_clean":"2024-04-17T08:46:39.582953+0000","last_became_active":"2024-04-17T08:46:33.224234+0000","last_became_peered":"2024-04-17T08:46:33.224234+0000","last_unstale":"2024-04-17T08:46:39.582953+0000","last_undegraded":"2024-04-17T08:46:39.582953+0000","last_fullsized":"2024-04-17T08:46:39.582953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:30:42.762461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581393+0000","last_change":"2024-04-17T08:46:38.289173+0000","last_active":"2024-04-17T08:46:39.581393+0000","last_peered":"2024-04-17T08:46:39.581393+0000","last_clean":"2024-04-17T08:46:39.581393+0000","last_became_active":"2024-04-17T08:46:38.288767+0000","last_became_peered":"2024-04-17T08:46:38.288767+0000","last_unstale":"2024-04-17T08:46:39.581393+0000","last_undegraded":"2024-04-17T08:46:39.581393+0000","last_fullsized":"2024-04-17T08:46:39.581393+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:44:55.979892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583968+0000","last_change":"2024-04-17T08:46:34.255234+0000","last_active":"2024-04-17T08:46:39.583968+0000","last_peered":"2024-04-17T08:46:39.583968+0000","last_clean":"2024-04-17T08:46:39.583968+0000","last_became_active":"2024-04-17T08:46:34.254849+0000","last_became_peered":"2024-04-17T08:46:34.254849+0000","last_unstale":"2024-04-17T08:46:39.583968+0000","last_undegraded":"2024-04-17T08:46:39.583968+0000","last_fullsized":"2024-04-17T08:46:39.583968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:33:31.200359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.263578+0000","last_change":"2024-04-17T08:46:33.236511+0000","last_active":"2024-04-17T08:46:39.263578+0000","last_peered":"2024-04-17T08:46:39.263578+0000","last_clean":"2024-04-17T08:46:39.263578+0000","last_became_active":"2024-04-17T08:46:33.236059+0000","last_became_peered":"2024-04-17T08:46:33.236059+0000","last_unstale":"2024-04-17T08:46:39.263578+0000","last_undegraded":"2024-04-17T08:46:39.263578+0000","last_fullsized":"2024-04-17T08:46:39.263578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:55:39.562141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.265271+0000","last_change":"2024-04-17T08:46:38.511281+0000","last_active":"2024-04-17T08:46:39.265271+0000","last_peered":"2024-04-17T08:46:39.265271+0000","last_clean":"2024-04-17T08:46:39.265271+0000","last_became_active":"2024-04-17T08:46:38.510068+0000","last_became_peered":"2024-04-17T08:46:38.510068+0000","last_unstale":"2024-04-17T08:46:39.265271+0000","last_undegraded":"2024-04-17T08:46:39.265271+0000","last_fullsized":"2024-04-17T08:46:39.265271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:00:35.685592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.584095+0000","last_change":"2024-04-17T08:46:34.249995+0000","last_active":"2024-04-17T08:46:39.584095+0000","last_peered":"2024-04-17T08:46:39.584095+0000","last_clean":"2024-04-17T08:46:39.584095+0000","last_became_active":"2024-04-17T08:46:34.249729+0000","last_became_peered":"2024-04-17T08:46:34.249729+0000","last_unstale":"2024-04-17T08:46:39.584095+0000","last_undegraded":"2024-04-17T08:46:39.584095+0000","last_fullsized":"2024-04-17T08:46:39.584095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:16:39.000776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.267069+0000","last_change":"2024-04-17T08:46:33.231993+0000","last_active":"2024-04-17T08:46:39.267069+0000","last_peered":"2024-04-17T08:46:39.267069+0000","last_clean":"2024-04-17T08:46:39.267069+0000","last_became_active":"2024-04-17T08:46:33.231265+0000","last_became_peered":"2024-04-17T08:46:33.231265+0000","last_unstale":"2024-04-17T08:46:39.267069+0000","last_undegraded":"2024-04-17T08:46:39.267069+0000","last_fullsized":"2024-04-17T08:46:39.267069+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:53:22.090817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.266950+0000","last_change":"2024-04-17T08:46:38.284999+0000","last_active":"2024-04-17T08:46:39.266950+0000","last_peered":"2024-04-17T08:46:39.266950+0000","last_clean":"2024-04-17T08:46:39.266950+0000","last_became_active":"2024-04-17T08:46:38.284570+0000","last_became_peered":"2024-04-17T08:46:38.284570+0000","last_unstale":"2024-04-17T08:46:39.266950+0000","last_undegraded":"2024-04-17T08:46:39.266950+0000","last_fullsized":"2024-04-17T08:46:39.266950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:16:43.045780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582901+0000","last_change":"2024-04-17T08:46:34.255136+0000","last_active":"2024-04-17T08:46:39.582901+0000","last_peered":"2024-04-17T08:46:39.582901+0000","last_clean":"2024-04-17T08:46:39.582901+0000","last_became_active":"2024-04-17T08:46:34.254805+0000","last_became_peered":"2024-04-17T08:46:34.254805+0000","last_unstale":"2024-04-17T08:46:39.582901+0000","last_undegraded":"2024-04-17T08:46:39.582901+0000","last_fullsized":"2024-04-17T08:46:39.582901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:44:51.934889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.263098+0000","last_change":"2024-04-17T08:46:33.221884+0000","last_active":"2024-04-17T08:46:39.263098+0000","last_peered":"2024-04-17T08:46:39.263098+0000","last_clean":"2024-04-17T08:46:39.263098+0000","last_became_active":"2024-04-17T08:46:33.220945+0000","last_became_peered":"2024-04-17T08:46:33.220945+0000","last_unstale":"2024-04-17T08:46:39.263098+0000","last_undegraded":"2024-04-17T08:46:39.263098+0000","last_fullsized":"2024-04-17T08:46:39.263098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:32:08.431466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582440+0000","last_change":"2024-04-17T08:46:38.292234+0000","last_active":"2024-04-17T08:46:39.582440+0000","last_peered":"2024-04-17T08:46:39.582440+0000","last_clean":"2024-04-17T08:46:39.582440+0000","last_became_active":"2024-04-17T08:46:38.291831+0000","last_became_peered":"2024-04-17T08:46:38.291831+0000","last_unstale":"2024-04-17T08:46:39.582440+0000","last_undegraded":"2024-04-17T08:46:39.582440+0000","last_fullsized":"2024-04-17T08:46:39.582440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:34:35.322841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582128+0000","last_change":"2024-04-17T08:46:34.238104+0000","last_active":"2024-04-17T08:46:39.582128+0000","last_peered":"2024-04-17T08:46:39.582128+0000","last_clean":"2024-04-17T08:46:39.582128+0000","last_became_active":"2024-04-17T08:46:34.237741+0000","last_became_peered":"2024-04-17T08:46:34.237741+0000","last_unstale":"2024-04-17T08:46:39.582128+0000","last_undegraded":"2024-04-17T08:46:39.582128+0000","last_fullsized":"2024-04-17T08:46:39.582128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:12:09.665391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582338+0000","last_change":"2024-04-17T08:46:33.227055+0000","last_active":"2024-04-17T08:46:39.582338+0000","last_peered":"2024-04-17T08:46:39.582338+0000","last_clean":"2024-04-17T08:46:39.582338+0000","last_became_active":"2024-04-17T08:46:33.226787+0000","last_became_peered":"2024-04-17T08:46:33.226787+0000","last_unstale":"2024-04-17T08:46:39.582338+0000","last_undegraded":"2024-04-17T08:46:39.582338+0000","last_fullsized":"2024-04-17T08:46:39.582338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:25:21.370859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583895+0000","last_change":"2024-04-17T08:46:38.514388+0000","last_active":"2024-04-17T08:46:39.583895+0000","last_peered":"2024-04-17T08:46:39.583895+0000","last_clean":"2024-04-17T08:46:39.583895+0000","last_became_active":"2024-04-17T08:46:38.514047+0000","last_became_peered":"2024-04-17T08:46:38.514047+0000","last_unstale":"2024-04-17T08:46:39.583895+0000","last_undegraded":"2024-04-17T08:46:39.583895+0000","last_fullsized":"2024-04-17T08:46:39.583895+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:43:04.302500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583016+0000","last_change":"2024-04-17T08:46:34.249520+0000","last_active":"2024-04-17T08:46:39.583016+0000","last_peered":"2024-04-17T08:46:39.583016+0000","last_clean":"2024-04-17T08:46:39.583016+0000","last_became_active":"2024-04-17T08:46:34.249225+0000","last_became_peered":"2024-04-17T08:46:34.249225+0000","last_unstale":"2024-04-17T08:46:39.583016+0000","last_undegraded":"2024-04-17T08:46:39.583016+0000","last_fullsized":"2024-04-17T08:46:39.583016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:54:42.024196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.265861+0000","last_change":"2024-04-17T08:46:33.236864+0000","last_active":"2024-04-17T08:46:39.265861+0000","last_peered":"2024-04-17T08:46:39.265861+0000","last_clean":"2024-04-17T08:46:39.265861+0000","last_became_active":"2024-04-17T08:46:33.236095+0000","last_became_peered":"2024-04-17T08:46:33.236095+0000","last_unstale":"2024-04-17T08:46:39.265861+0000","last_undegraded":"2024-04-17T08:46:39.265861+0000","last_fullsized":"2024-04-17T08:46:39.265861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:20:19.185830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582486+0000","last_change":"2024-04-17T08:46:38.509818+0000","last_active":"2024-04-17T08:46:39.582486+0000","last_peered":"2024-04-17T08:46:39.582486+0000","last_clean":"2024-04-17T08:46:39.582486+0000","last_became_active":"2024-04-17T08:46:38.509380+0000","last_became_peered":"2024-04-17T08:46:38.509380+0000","last_unstale":"2024-04-17T08:46:39.582486+0000","last_undegraded":"2024-04-17T08:46:39.582486+0000","last_fullsized":"2024-04-17T08:46:39.582486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:52:13.249971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581564+0000","last_change":"2024-04-17T08:46:34.248655+0000","last_active":"2024-04-17T08:46:39.581564+0000","last_peered":"2024-04-17T08:46:39.581564+0000","last_clean":"2024-04-17T08:46:39.581564+0000","last_became_active":"2024-04-17T08:46:34.247990+0000","last_became_peered":"2024-04-17T08:46:34.247990+0000","last_unstale":"2024-04-17T08:46:39.581564+0000","last_undegraded":"2024-04-17T08:46:39.581564+0000","last_fullsized":"2024-04-17T08:46:39.581564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:37:26.964605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581610+0000","last_change":"2024-04-17T08:46:33.225329+0000","last_active":"2024-04-17T08:46:39.581610+0000","last_peered":"2024-04-17T08:46:39.581610+0000","last_clean":"2024-04-17T08:46:39.581610+0000","last_became_active":"2024-04-17T08:46:33.225006+0000","last_became_peered":"2024-04-17T08:46:33.225006+0000","last_unstale":"2024-04-17T08:46:39.581610+0000","last_undegraded":"2024-04-17T08:46:39.581610+0000","last_fullsized":"2024-04-17T08:46:39.581610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:06:52.298728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.267811+0000","last_change":"2024-04-17T08:46:38.512665+0000","last_active":"2024-04-17T08:46:39.267811+0000","last_peered":"2024-04-17T08:46:39.267811+0000","last_clean":"2024-04-17T08:46:39.267811+0000","last_became_active":"2024-04-17T08:46:38.511018+0000","last_became_peered":"2024-04-17T08:46:38.511018+0000","last_unstale":"2024-04-17T08:46:39.267811+0000","last_undegraded":"2024-04-17T08:46:39.267811+0000","last_fullsized":"2024-04-17T08:46:39.267811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:07:22.236476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583254+0000","last_change":"2024-04-17T08:46:34.253169+0000","last_active":"2024-04-17T08:46:39.583254+0000","last_peered":"2024-04-17T08:46:39.583254+0000","last_clean":"2024-04-17T08:46:39.583254+0000","last_became_active":"2024-04-17T08:46:34.252781+0000","last_became_peered":"2024-04-17T08:46:34.252781+0000","last_unstale":"2024-04-17T08:46:39.583254+0000","last_undegraded":"2024-04-17T08:46:39.583254+0000","last_fullsized":"2024-04-17T08:46:39.583254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:58:55.513935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'10","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:49.408874+0000","last_change":"2024-04-17T08:46:33.238253+0000","last_active":"2024-04-17T08:46:49.408874+0000","last_peered":"2024-04-17T08:46:49.408874+0000","last_clean":"2024-04-17T08:46:49.408874+0000","last_became_active":"2024-04-17T08:46:33.237894+0000","last_became_peered":"2024-04-17T08:46:33.237894+0000","last_unstale":"2024-04-17T08:46:49.408874+0000","last_undegraded":"2024-04-17T08:46:49.408874+0000","last_fullsized":"2024-04-17T08:46:49.408874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:16:35.663647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581576+0000","last_change":"2024-04-17T08:46:38.292629+0000","last_active":"2024-04-17T08:46:39.581576+0000","last_peered":"2024-04-17T08:46:39.581576+0000","last_clean":"2024-04-17T08:46:39.581576+0000","last_became_active":"2024-04-17T08:46:38.292238+0000","last_became_peered":"2024-04-17T08:46:38.292238+0000","last_unstale":"2024-04-17T08:46:39.581576+0000","last_undegraded":"2024-04-17T08:46:39.581576+0000","last_fullsized":"2024-04-17T08:46:39.581576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:44:55.979892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.267104+0000","last_change":"2024-04-17T08:46:34.247592+0000","last_active":"2024-04-17T08:46:39.267104+0000","last_peered":"2024-04-17T08:46:39.267104+0000","last_clean":"2024-04-17T08:46:39.267104+0000","last_became_active":"2024-04-17T08:46:34.247307+0000","last_became_peered":"2024-04-17T08:46:34.247307+0000","last_unstale":"2024-04-17T08:46:39.267104+0000","last_undegraded":"2024-04-17T08:46:39.267104+0000","last_fullsized":"2024-04-17T08:46:39.267104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:22:15.267186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582951+0000","last_change":"2024-04-17T08:46:33.226914+0000","last_active":"2024-04-17T08:46:39.582951+0000","last_peered":"2024-04-17T08:46:39.582951+0000","last_clean":"2024-04-17T08:46:39.582951+0000","last_became_active":"2024-04-17T08:46:33.226607+0000","last_became_peered":"2024-04-17T08:46:33.226607+0000","last_unstale":"2024-04-17T08:46:39.582951+0000","last_undegraded":"2024-04-17T08:46:39.582951+0000","last_fullsized":"2024-04-17T08:46:39.582951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:22:14.260721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.266708+0000","last_change":"2024-04-17T08:46:38.286086+0000","last_active":"2024-04-17T08:46:39.266708+0000","last_peered":"2024-04-17T08:46:39.266708+0000","last_clean":"2024-04-17T08:46:39.266708+0000","last_became_active":"2024-04-17T08:46:38.285105+0000","last_became_peered":"2024-04-17T08:46:38.285105+0000","last_unstale":"2024-04-17T08:46:39.266708+0000","last_undegraded":"2024-04-17T08:46:39.266708+0000","last_fullsized":"2024-04-17T08:46:39.266708+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:13:14.354152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582237+0000","last_change":"2024-04-17T08:46:34.255537+0000","last_active":"2024-04-17T08:46:39.582237+0000","last_peered":"2024-04-17T08:46:39.582237+0000","last_clean":"2024-04-17T08:46:39.582237+0000","last_became_active":"2024-04-17T08:46:34.254801+0000","last_became_peered":"2024-04-17T08:46:34.254801+0000","last_unstale":"2024-04-17T08:46:39.582237+0000","last_undegraded":"2024-04-17T08:46:39.582237+0000","last_fullsized":"2024-04-17T08:46:39.582237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:13:50.529902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.267835+0000","last_change":"2024-04-17T08:46:33.233506+0000","last_active":"2024-04-17T08:46:39.267835+0000","last_peered":"2024-04-17T08:46:39.267835+0000","last_clean":"2024-04-17T08:46:39.267835+0000","last_became_active":"2024-04-17T08:46:33.233232+0000","last_became_peered":"2024-04-17T08:46:33.233232+0000","last_unstale":"2024-04-17T08:46:39.267835+0000","last_undegraded":"2024-04-17T08:46:39.267835+0000","last_fullsized":"2024-04-17T08:46:39.267835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:16:35.663647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581800+0000","last_change":"2024-04-17T08:46:38.279439+0000","last_active":"2024-04-17T08:46:39.581800+0000","last_peered":"2024-04-17T08:46:39.581800+0000","last_clean":"2024-04-17T08:46:39.581800+0000","last_became_active":"2024-04-17T08:46:38.278889+0000","last_became_peered":"2024-04-17T08:46:38.278889+0000","last_unstale":"2024-04-17T08:46:39.581800+0000","last_undegraded":"2024-04-17T08:46:39.581800+0000","last_fullsized":"2024-04-17T08:46:39.581800+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:43:42.690286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.267666+0000","last_change":"2024-04-17T08:46:34.259801+0000","last_active":"2024-04-17T08:46:39.267666+0000","last_peered":"2024-04-17T08:46:39.267666+0000","last_clean":"2024-04-17T08:46:39.267666+0000","last_became_active":"2024-04-17T08:46:34.259498+0000","last_became_peered":"2024-04-17T08:46:34.259498+0000","last_unstale":"2024-04-17T08:46:39.267666+0000","last_undegraded":"2024-04-17T08:46:39.267666+0000","last_fullsized":"2024-04-17T08:46:39.267666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:54:42.024196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583657+0000","last_change":"2024-04-17T08:46:33.235837+0000","last_active":"2024-04-17T08:46:39.583657+0000","last_peered":"2024-04-17T08:46:39.583657+0000","last_clean":"2024-04-17T08:46:39.583657+0000","last_became_active":"2024-04-17T08:46:33.235456+0000","last_became_peered":"2024-04-17T08:46:33.235456+0000","last_unstale":"2024-04-17T08:46:39.583657+0000","last_undegraded":"2024-04-17T08:46:39.583657+0000","last_fullsized":"2024-04-17T08:46:39.583657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:18:08.779923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582353+0000","last_change":"2024-04-17T08:46:38.509993+0000","last_active":"2024-04-17T08:46:39.582353+0000","last_peered":"2024-04-17T08:46:39.582353+0000","last_clean":"2024-04-17T08:46:39.582353+0000","last_became_active":"2024-04-17T08:46:38.509510+0000","last_became_peered":"2024-04-17T08:46:38.509510+0000","last_unstale":"2024-04-17T08:46:39.582353+0000","last_undegraded":"2024-04-17T08:46:39.582353+0000","last_fullsized":"2024-04-17T08:46:39.582353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:07:22.236476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582291+0000","last_change":"2024-04-17T08:46:38.510357+0000","last_active":"2024-04-17T08:46:39.582291+0000","last_peered":"2024-04-17T08:46:39.582291+0000","last_clean":"2024-04-17T08:46:39.582291+0000","last_became_active":"2024-04-17T08:46:38.509996+0000","last_became_peered":"2024-04-17T08:46:38.509996+0000","last_unstale":"2024-04-17T08:46:39.582291+0000","last_undegraded":"2024-04-17T08:46:39.582291+0000","last_fullsized":"2024-04-17T08:46:39.582291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:54:46.069200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581341+0000","last_change":"2024-04-17T08:46:34.238153+0000","last_active":"2024-04-17T08:46:39.581341+0000","last_peered":"2024-04-17T08:46:39.581341+0000","last_clean":"2024-04-17T08:46:39.581341+0000","last_became_active":"2024-04-17T08:46:34.237904+0000","last_became_peered":"2024-04-17T08:46:34.237904+0000","last_unstale":"2024-04-17T08:46:39.581341+0000","last_undegraded":"2024-04-17T08:46:39.581341+0000","last_fullsized":"2024-04-17T08:46:39.581341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:13:50.529902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.265341+0000","last_change":"2024-04-17T08:46:33.219586+0000","last_active":"2024-04-17T08:46:39.265341+0000","last_peered":"2024-04-17T08:46:39.265341+0000","last_clean":"2024-04-17T08:46:39.265341+0000","last_became_active":"2024-04-17T08:46:33.219227+0000","last_became_peered":"2024-04-17T08:46:33.219227+0000","last_unstale":"2024-04-17T08:46:39.265341+0000","last_undegraded":"2024-04-17T08:46:39.265341+0000","last_fullsized":"2024-04-17T08:46:39.265341+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:18:08.779923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583582+0000","last_change":"2024-04-17T08:46:38.287983+0000","last_active":"2024-04-17T08:46:39.583582+0000","last_peered":"2024-04-17T08:46:39.583582+0000","last_clean":"2024-04-17T08:46:39.583582+0000","last_became_active":"2024-04-17T08:46:38.287651+0000","last_became_peered":"2024-04-17T08:46:38.287651+0000","last_unstale":"2024-04-17T08:46:39.583582+0000","last_undegraded":"2024-04-17T08:46:39.583582+0000","last_fullsized":"2024-04-17T08:46:39.583582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:58:59.558939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581971+0000","last_change":"2024-04-17T08:46:34.237638+0000","last_active":"2024-04-17T08:46:39.581971+0000","last_peered":"2024-04-17T08:46:39.581971+0000","last_clean":"2024-04-17T08:46:39.581971+0000","last_became_active":"2024-04-17T08:46:34.237276+0000","last_became_peered":"2024-04-17T08:46:34.237276+0000","last_unstale":"2024-04-17T08:46:39.581971+0000","last_undegraded":"2024-04-17T08:46:39.581971+0000","last_fullsized":"2024-04-17T08:46:39.581971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:02:18.996319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582616+0000","last_change":"2024-04-17T08:46:33.230158+0000","last_active":"2024-04-17T08:46:39.582616+0000","last_peered":"2024-04-17T08:46:39.582616+0000","last_clean":"2024-04-17T08:46:39.582616+0000","last_became_active":"2024-04-17T08:46:33.229871+0000","last_became_peered":"2024-04-17T08:46:33.229871+0000","last_unstale":"2024-04-17T08:46:39.582616+0000","last_undegraded":"2024-04-17T08:46:39.582616+0000","last_fullsized":"2024-04-17T08:46:39.582616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:32:08.431466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582487+0000","last_change":"2024-04-17T08:46:33.228412+0000","last_active":"2024-04-17T08:46:39.582487+0000","last_peered":"2024-04-17T08:46:39.582487+0000","last_clean":"2024-04-17T08:46:39.582487+0000","last_became_active":"2024-04-17T08:46:33.228163+0000","last_became_peered":"2024-04-17T08:46:33.228163+0000","last_unstale":"2024-04-17T08:46:39.582487+0000","last_undegraded":"2024-04-17T08:46:39.582487+0000","last_fullsized":"2024-04-17T08:46:39.582487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:55:39.562141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581525+0000","last_change":"2024-04-17T08:46:34.248503+0000","last_active":"2024-04-17T08:46:39.581525+0000","last_peered":"2024-04-17T08:46:39.581525+0000","last_clean":"2024-04-17T08:46:39.581525+0000","last_became_active":"2024-04-17T08:46:34.247808+0000","last_became_peered":"2024-04-17T08:46:34.247808+0000","last_unstale":"2024-04-17T08:46:39.581525+0000","last_undegraded":"2024-04-17T08:46:39.581525+0000","last_fullsized":"2024-04-17T08:46:39.581525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:33:10.927487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.263496+0000","last_change":"2024-04-17T08:46:38.291370+0000","last_active":"2024-04-17T08:46:39.263496+0000","last_peered":"2024-04-17T08:46:39.263496+0000","last_clean":"2024-04-17T08:46:39.263496+0000","last_became_active":"2024-04-17T08:46:38.290866+0000","last_became_peered":"2024-04-17T08:46:38.290866+0000","last_unstale":"2024-04-17T08:46:39.263496+0000","last_undegraded":"2024-04-17T08:46:39.263496+0000","last_fullsized":"2024-04-17T08:46:39.263496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:44.413228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582559+0000","last_change":"2024-04-17T08:46:33.239929+0000","last_active":"2024-04-17T08:46:39.582559+0000","last_peered":"2024-04-17T08:46:39.582559+0000","last_clean":"2024-04-17T08:46:39.582559+0000","last_became_active":"2024-04-17T08:46:33.239619+0000","last_became_peered":"2024-04-17T08:46:33.239619+0000","last_unstale":"2024-04-17T08:46:39.582559+0000","last_undegraded":"2024-04-17T08:46:39.582559+0000","last_fullsized":"2024-04-17T08:46:39.582559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:32.194697+0000","last_clean_scrub_stamp":"2024-04-17T08:46:32.194697+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:22:07.958599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.266472+0000","last_change":"2024-04-17T08:46:34.237105+0000","last_active":"2024-04-17T08:46:39.266472+0000","last_peered":"2024-04-17T08:46:39.266472+0000","last_clean":"2024-04-17T08:46:39.266472+0000","last_became_active":"2024-04-17T08:46:34.236792+0000","last_became_peered":"2024-04-17T08:46:34.236792+0000","last_unstale":"2024-04-17T08:46:39.266472+0000","last_undegraded":"2024-04-17T08:46:39.266472+0000","last_fullsized":"2024-04-17T08:46:39.266472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:16:36.670112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583657+0000","last_change":"2024-04-17T08:46:38.287775+0000","last_active":"2024-04-17T08:46:39.583657+0000","last_peered":"2024-04-17T08:46:39.583657+0000","last_clean":"2024-04-17T08:46:39.583657+0000","last_became_active":"2024-04-17T08:46:38.287403+0000","last_became_peered":"2024-04-17T08:46:38.287403+0000","last_unstale":"2024-04-17T08:46:39.583657+0000","last_undegraded":"2024-04-17T08:46:39.583657+0000","last_fullsized":"2024-04-17T08:46:39.583657+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:37.246166+0000","last_clean_scrub_stamp":"2024-04-17T08:46:37.246166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:32:12.270818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582001+0000","last_change":"2024-04-17T08:46:34.238359+0000","last_active":"2024-04-17T08:46:39.582001+0000","last_peered":"2024-04-17T08:46:39.582001+0000","last_clean":"2024-04-17T08:46:39.582001+0000","last_became_active":"2024-04-17T08:46:34.237809+0000","last_became_peered":"2024-04-17T08:46:34.237809+0000","last_unstale":"2024-04-17T08:46:39.582001+0000","last_undegraded":"2024-04-17T08:46:39.582001+0000","last_fullsized":"2024-04-17T08:46:39.582001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:17:38.605512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.263186+0000","last_change":"2024-04-17T08:46:34.251080+0000","last_active":"2024-04-17T08:46:39.263186+0000","last_peered":"2024-04-17T08:46:39.263186+0000","last_clean":"2024-04-17T08:46:39.263186+0000","last_became_active":"2024-04-17T08:46:34.250660+0000","last_became_peered":"2024-04-17T08:46:34.250660+0000","last_unstale":"2024-04-17T08:46:39.263186+0000","last_undegraded":"2024-04-17T08:46:39.263186+0000","last_fullsized":"2024-04-17T08:46:39.263186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:18:09.786388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.265791+0000","last_change":"2024-04-17T08:46:34.255117+0000","last_active":"2024-04-17T08:46:39.265791+0000","last_peered":"2024-04-17T08:46:39.265791+0000","last_clean":"2024-04-17T08:46:39.265791+0000","last_became_active":"2024-04-17T08:46:34.251710+0000","last_became_peered":"2024-04-17T08:46:34.251710+0000","last_unstale":"2024-04-17T08:46:39.265791+0000","last_undegraded":"2024-04-17T08:46:39.265791+0000","last_fullsized":"2024-04-17T08:46:39.265791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:10:10.605700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581443+0000","last_change":"2024-04-17T08:46:34.241337+0000","last_active":"2024-04-17T08:46:39.581443+0000","last_peered":"2024-04-17T08:46:39.581443+0000","last_clean":"2024-04-17T08:46:39.581443+0000","last_became_active":"2024-04-17T08:46:34.241042+0000","last_became_peered":"2024-04-17T08:46:34.241042+0000","last_unstale":"2024-04-17T08:46:39.581443+0000","last_undegraded":"2024-04-17T08:46:39.581443+0000","last_fullsized":"2024-04-17T08:46:39.581443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:49:50.654842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582703+0000","last_change":"2024-04-17T08:46:34.245617+0000","last_active":"2024-04-17T08:46:39.582703+0000","last_peered":"2024-04-17T08:46:39.582703+0000","last_clean":"2024-04-17T08:46:39.582703+0000","last_became_active":"2024-04-17T08:46:34.245271+0000","last_became_peered":"2024-04-17T08:46:34.245271+0000","last_unstale":"2024-04-17T08:46:39.582703+0000","last_undegraded":"2024-04-17T08:46:39.582703+0000","last_fullsized":"2024-04-17T08:46:39.582703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:13:50.529902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582834+0000","last_change":"2024-04-17T08:46:34.239456+0000","last_active":"2024-04-17T08:46:39.582834+0000","last_peered":"2024-04-17T08:46:39.582834+0000","last_clean":"2024-04-17T08:46:39.582834+0000","last_became_active":"2024-04-17T08:46:34.239162+0000","last_became_peered":"2024-04-17T08:46:34.239162+0000","last_unstale":"2024-04-17T08:46:39.582834+0000","last_undegraded":"2024-04-17T08:46:39.582834+0000","last_fullsized":"2024-04-17T08:46:39.582834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:49:50.654842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583417+0000","last_change":"2024-04-17T08:46:34.246242+0000","last_active":"2024-04-17T08:46:39.583417+0000","last_peered":"2024-04-17T08:46:39.583417+0000","last_clean":"2024-04-17T08:46:39.583417+0000","last_became_active":"2024-04-17T08:46:34.245994+0000","last_became_peered":"2024-04-17T08:46:34.245994+0000","last_unstale":"2024-04-17T08:46:39.583417+0000","last_undegraded":"2024-04-17T08:46:39.583417+0000","last_fullsized":"2024-04-17T08:46:39.583417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:13:50.529902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583939+0000","last_change":"2024-04-17T08:46:34.245854+0000","last_active":"2024-04-17T08:46:39.583939+0000","last_peered":"2024-04-17T08:46:39.583939+0000","last_clean":"2024-04-17T08:46:39.583939+0000","last_became_active":"2024-04-17T08:46:34.245381+0000","last_became_peered":"2024-04-17T08:46:34.245381+0000","last_unstale":"2024-04-17T08:46:39.583939+0000","last_undegraded":"2024-04-17T08:46:39.583939+0000","last_fullsized":"2024-04-17T08:46:39.583939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:13:10.309148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.265310+0000","last_change":"2024-04-17T08:46:34.249141+0000","last_active":"2024-04-17T08:46:39.265310+0000","last_peered":"2024-04-17T08:46:39.265310+0000","last_clean":"2024-04-17T08:46:39.265310+0000","last_became_active":"2024-04-17T08:46:34.248632+0000","last_became_peered":"2024-04-17T08:46:34.248632+0000","last_unstale":"2024-04-17T08:46:39.265310+0000","last_undegraded":"2024-04-17T08:46:39.265310+0000","last_fullsized":"2024-04-17T08:46:39.265310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:13:50.529902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582465+0000","last_change":"2024-04-17T08:46:34.247025+0000","last_active":"2024-04-17T08:46:39.582465+0000","last_peered":"2024-04-17T08:46:39.582465+0000","last_clean":"2024-04-17T08:46:39.582465+0000","last_became_active":"2024-04-17T08:46:34.246769+0000","last_became_peered":"2024-04-17T08:46:34.246769+0000","last_unstale":"2024-04-17T08:46:39.582465+0000","last_undegraded":"2024-04-17T08:46:39.582465+0000","last_fullsized":"2024-04-17T08:46:39.582465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:12:09.665391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.265741+0000","last_change":"2024-04-17T08:46:34.253773+0000","last_active":"2024-04-17T08:46:39.265741+0000","last_peered":"2024-04-17T08:46:39.265741+0000","last_clean":"2024-04-17T08:46:39.265741+0000","last_became_active":"2024-04-17T08:46:34.253462+0000","last_became_peered":"2024-04-17T08:46:34.253462+0000","last_unstale":"2024-04-17T08:46:39.265741+0000","last_undegraded":"2024-04-17T08:46:39.265741+0000","last_fullsized":"2024-04-17T08:46:39.265741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:13:10.309148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581198+0000","last_change":"2024-04-17T08:46:34.248730+0000","last_active":"2024-04-17T08:46:39.581198+0000","last_peered":"2024-04-17T08:46:39.581198+0000","last_clean":"2024-04-17T08:46:39.581198+0000","last_became_active":"2024-04-17T08:46:34.248175+0000","last_became_peered":"2024-04-17T08:46:34.248175+0000","last_unstale":"2024-04-17T08:46:39.581198+0000","last_undegraded":"2024-04-17T08:46:39.581198+0000","last_fullsized":"2024-04-17T08:46:39.581198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:12:09.665391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582624+0000","last_change":"2024-04-17T08:46:34.240984+0000","last_active":"2024-04-17T08:46:39.582624+0000","last_peered":"2024-04-17T08:46:39.582624+0000","last_clean":"2024-04-17T08:46:39.582624+0000","last_became_active":"2024-04-17T08:46:34.240649+0000","last_became_peered":"2024-04-17T08:46:34.240649+0000","last_unstale":"2024-04-17T08:46:39.582624+0000","last_undegraded":"2024-04-17T08:46:39.582624+0000","last_fullsized":"2024-04-17T08:46:39.582624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:49:50.654842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583627+0000","last_change":"2024-04-17T08:46:34.252899+0000","last_active":"2024-04-17T08:46:39.583627+0000","last_peered":"2024-04-17T08:46:39.583627+0000","last_clean":"2024-04-17T08:46:39.583627+0000","last_became_active":"2024-04-17T08:46:34.252649+0000","last_became_peered":"2024-04-17T08:46:34.252649+0000","last_unstale":"2024-04-17T08:46:39.583627+0000","last_undegraded":"2024-04-17T08:46:39.583627+0000","last_fullsized":"2024-04-17T08:46:39.583627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:34:31.277838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.263565+0000","last_change":"2024-04-17T08:46:34.245775+0000","last_active":"2024-04-17T08:46:39.263565+0000","last_peered":"2024-04-17T08:46:39.263565+0000","last_clean":"2024-04-17T08:46:39.263565+0000","last_became_active":"2024-04-17T08:46:34.245478+0000","last_became_peered":"2024-04-17T08:46:34.245478+0000","last_unstale":"2024-04-17T08:46:39.263565+0000","last_undegraded":"2024-04-17T08:46:39.263565+0000","last_fullsized":"2024-04-17T08:46:39.263565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:22:15.267186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.268138+0000","last_change":"2024-04-17T08:46:34.263140+0000","last_active":"2024-04-17T08:46:39.268138+0000","last_peered":"2024-04-17T08:46:39.268138+0000","last_clean":"2024-04-17T08:46:39.268138+0000","last_became_active":"2024-04-17T08:46:34.261735+0000","last_became_peered":"2024-04-17T08:46:34.261735+0000","last_unstale":"2024-04-17T08:46:39.268138+0000","last_undegraded":"2024-04-17T08:46:39.268138+0000","last_fullsized":"2024-04-17T08:46:39.268138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:34:31.277838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.265194+0000","last_change":"2024-04-17T08:46:34.252436+0000","last_active":"2024-04-17T08:46:39.265194+0000","last_peered":"2024-04-17T08:46:39.265194+0000","last_clean":"2024-04-17T08:46:39.265194+0000","last_became_active":"2024-04-17T08:46:34.250951+0000","last_became_peered":"2024-04-17T08:46:34.250951+0000","last_unstale":"2024-04-17T08:46:39.265194+0000","last_undegraded":"2024-04-17T08:46:39.265194+0000","last_fullsized":"2024-04-17T08:46:39.265194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:33:10.927487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581141+0000","last_change":"2024-04-17T08:46:34.243835+0000","last_active":"2024-04-17T08:46:39.581141+0000","last_peered":"2024-04-17T08:46:39.581141+0000","last_clean":"2024-04-17T08:46:39.581141+0000","last_became_active":"2024-04-17T08:46:34.243503+0000","last_became_peered":"2024-04-17T08:46:34.243503+0000","last_unstale":"2024-04-17T08:46:39.581141+0000","last_undegraded":"2024-04-17T08:46:39.581141+0000","last_fullsized":"2024-04-17T08:46:39.581141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:17:38.605512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581483+0000","last_change":"2024-04-17T08:46:34.239204+0000","last_active":"2024-04-17T08:46:39.581483+0000","last_peered":"2024-04-17T08:46:39.581483+0000","last_clean":"2024-04-17T08:46:39.581483+0000","last_became_active":"2024-04-17T08:46:34.237120+0000","last_became_peered":"2024-04-17T08:46:34.237120+0000","last_unstale":"2024-04-17T08:46:39.581483+0000","last_undegraded":"2024-04-17T08:46:39.581483+0000","last_fullsized":"2024-04-17T08:46:39.581483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:47:04.763844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582462+0000","last_change":"2024-04-17T08:46:34.233656+0000","last_active":"2024-04-17T08:46:39.582462+0000","last_peered":"2024-04-17T08:46:39.582462+0000","last_clean":"2024-04-17T08:46:39.582462+0000","last_became_active":"2024-04-17T08:46:34.233389+0000","last_became_peered":"2024-04-17T08:46:34.233389+0000","last_unstale":"2024-04-17T08:46:39.582462+0000","last_undegraded":"2024-04-17T08:46:39.582462+0000","last_fullsized":"2024-04-17T08:46:39.582462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:17:38.605512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.267000+0000","last_change":"2024-04-17T08:46:34.235333+0000","last_active":"2024-04-17T08:46:39.267000+0000","last_peered":"2024-04-17T08:46:39.267000+0000","last_clean":"2024-04-17T08:46:39.267000+0000","last_became_active":"2024-04-17T08:46:34.234982+0000","last_became_peered":"2024-04-17T08:46:34.234982+0000","last_unstale":"2024-04-17T08:46:39.267000+0000","last_undegraded":"2024-04-17T08:46:39.267000+0000","last_fullsized":"2024-04-17T08:46:39.267000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:18:09.786388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582701+0000","last_change":"2024-04-17T08:46:34.260932+0000","last_active":"2024-04-17T08:46:39.582701+0000","last_peered":"2024-04-17T08:46:39.582701+0000","last_clean":"2024-04-17T08:46:39.582701+0000","last_became_active":"2024-04-17T08:46:34.260666+0000","last_became_peered":"2024-04-17T08:46:34.260666+0000","last_unstale":"2024-04-17T08:46:39.582701+0000","last_undegraded":"2024-04-17T08:46:39.582701+0000","last_fullsized":"2024-04-17T08:46:39.582701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:33:41.705987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583345+0000","last_change":"2024-04-17T08:46:34.260377+0000","last_active":"2024-04-17T08:46:39.583345+0000","last_peered":"2024-04-17T08:46:39.583345+0000","last_clean":"2024-04-17T08:46:39.583345+0000","last_became_active":"2024-04-17T08:46:34.260101+0000","last_became_peered":"2024-04-17T08:46:34.260101+0000","last_unstale":"2024-04-17T08:46:39.583345+0000","last_undegraded":"2024-04-17T08:46:39.583345+0000","last_fullsized":"2024-04-17T08:46:39.583345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:33:10.927487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583903+0000","last_change":"2024-04-17T08:46:34.260965+0000","last_active":"2024-04-17T08:46:39.583903+0000","last_peered":"2024-04-17T08:46:39.583903+0000","last_clean":"2024-04-17T08:46:39.583903+0000","last_became_active":"2024-04-17T08:46:34.260673+0000","last_became_peered":"2024-04-17T08:46:34.260673+0000","last_unstale":"2024-04-17T08:46:39.583903+0000","last_undegraded":"2024-04-17T08:46:39.583903+0000","last_fullsized":"2024-04-17T08:46:39.583903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:43:38.645282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581159+0000","last_change":"2024-04-17T08:46:34.255100+0000","last_active":"2024-04-17T08:46:39.581159+0000","last_peered":"2024-04-17T08:46:39.581159+0000","last_clean":"2024-04-17T08:46:39.581159+0000","last_became_active":"2024-04-17T08:46:34.254891+0000","last_became_peered":"2024-04-17T08:46:34.254891+0000","last_unstale":"2024-04-17T08:46:39.581159+0000","last_undegraded":"2024-04-17T08:46:39.581159+0000","last_fullsized":"2024-04-17T08:46:39.581159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:37:26.964605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582850+0000","last_change":"2024-04-17T08:46:34.258835+0000","last_active":"2024-04-17T08:46:39.582850+0000","last_peered":"2024-04-17T08:46:39.582850+0000","last_clean":"2024-04-17T08:46:39.582850+0000","last_became_active":"2024-04-17T08:46:34.258445+0000","last_became_peered":"2024-04-17T08:46:34.258445+0000","last_unstale":"2024-04-17T08:46:39.582850+0000","last_undegraded":"2024-04-17T08:46:39.582850+0000","last_fullsized":"2024-04-17T08:46:39.582850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:10:10.605700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.265683+0000","last_change":"2024-04-17T08:46:34.253142+0000","last_active":"2024-04-17T08:46:39.265683+0000","last_peered":"2024-04-17T08:46:39.265683+0000","last_clean":"2024-04-17T08:46:39.265683+0000","last_became_active":"2024-04-17T08:46:34.250102+0000","last_became_peered":"2024-04-17T08:46:34.250102+0000","last_unstale":"2024-04-17T08:46:39.265683+0000","last_undegraded":"2024-04-17T08:46:39.265683+0000","last_fullsized":"2024-04-17T08:46:39.265683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:11:40.376111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.582833+0000","last_change":"2024-04-17T08:46:34.245004+0000","last_active":"2024-04-17T08:46:39.582833+0000","last_peered":"2024-04-17T08:46:39.582833+0000","last_clean":"2024-04-17T08:46:39.582833+0000","last_became_active":"2024-04-17T08:46:34.244719+0000","last_became_peered":"2024-04-17T08:46:34.244719+0000","last_unstale":"2024-04-17T08:46:39.582833+0000","last_undegraded":"2024-04-17T08:46:39.582833+0000","last_fullsized":"2024-04-17T08:46:39.582833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:34:21.920165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.266124+0000","last_change":"2024-04-17T08:46:34.251799+0000","last_active":"2024-04-17T08:46:39.266124+0000","last_peered":"2024-04-17T08:46:39.266124+0000","last_clean":"2024-04-17T08:46:39.266124+0000","last_became_active":"2024-04-17T08:46:34.251489+0000","last_became_peered":"2024-04-17T08:46:34.251489+0000","last_unstale":"2024-04-17T08:46:39.266124+0000","last_undegraded":"2024-04-17T08:46:39.266124+0000","last_fullsized":"2024-04-17T08:46:39.266124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:16:39.000776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.581875+0000","last_change":"2024-04-17T08:46:34.238421+0000","last_active":"2024-04-17T08:46:39.581875+0000","last_peered":"2024-04-17T08:46:39.581875+0000","last_clean":"2024-04-17T08:46:39.581875+0000","last_became_active":"2024-04-17T08:46:34.238155+0000","last_became_peered":"2024-04-17T08:46:34.238155+0000","last_unstale":"2024-04-17T08:46:39.581875+0000","last_undegraded":"2024-04-17T08:46:39.581875+0000","last_fullsized":"2024-04-17T08:46:39.581875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:17:38.605512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583178+0000","last_change":"2024-04-17T08:46:34.254457+0000","last_active":"2024-04-17T08:46:39.583178+0000","last_peered":"2024-04-17T08:46:39.583178+0000","last_clean":"2024-04-17T08:46:39.583178+0000","last_became_active":"2024-04-17T08:46:34.252735+0000","last_became_peered":"2024-04-17T08:46:34.252735+0000","last_unstale":"2024-04-17T08:46:39.583178+0000","last_undegraded":"2024-04-17T08:46:39.583178+0000","last_fullsized":"2024-04-17T08:46:39.583178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:33:10.927487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-17T08:46:39.583825+0000","last_change":"2024-04-17T08:46:34.252075+0000","last_active":"2024-04-17T08:46:39.583825+0000","last_peered":"2024-04-17T08:46:39.583825+0000","last_clean":"2024-04-17T08:46:39.583825+0000","last_became_active":"2024-04-17T08:46:34.251791+0000","last_became_peered":"2024-04-17T08:46:34.251791+0000","last_unstale":"2024-04-17T08:46:39.583825+0000","last_undegraded":"2024-04-17T08:46:39.583825+0000","last_fullsized":"2024-04-17T08:46:39.583825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:33.201162+0000","last_clean_scrub_stamp":"2024-04-17T08:46:33.201162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:30:28.171658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T08:47:02.848 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-17T08:47:02.848 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-17T08:47:02.848 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-17T08:47:02.848 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-17T08:47:03.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.022+0000 7f96b0400640 1 Processor -- start 2024-04-17T08:47:03.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.022+0000 7f96b0400640 1 -- start start 2024-04-17T08:47:03.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.022+0000 7f96b0400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f96a815e4b0 0x7f96a80cd250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:03.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.022+0000 7f96b0400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f96a806fb90 0x7f96a80c6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:03.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.022+0000 7f96b0400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96a80cf0c0 con 0x7f96a815e890 2024-04-17T08:47:03.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.022+0000 7f96b0400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f96a80cee70 con 0x7f96a806fb90 2024-04-17T08:47:03.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.022+0000 7f96b0400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f96a80cf3a0 con 0x7f96a815e4b0 2024-04-17T08:47:03.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.022+0000 7f96ae400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f96a806fb90 0x7f96a80c6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:03.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.022+0000 7f96ae400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f96a806fb90 0x7f96a80c6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.152:41420/0 (socket says 172.21.15.152:41420) 2024-04-17T08:47:03.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.022+0000 7f96ae400640 1 -- 172.21.15.152:0/1006032332 learned_addr learned my addr 172.21.15.152:0/1006032332 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:03.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.022+0000 7f96ada00640 1 --2- 172.21.15.152:0/1006032332 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f96a815e4b0 0x7f96a80cd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:03.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.022+0000 7f96ada00640 1 -- 172.21.15.152:0/1006032332 >> v2:172.21.15.196:3300/0 conn(0x7f96a806fb90 msgr2=0x7f96a80c6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:03.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.022+0000 7f96ada00640 1 --2- 172.21.15.152:0/1006032332 >> v2:172.21.15.196:3300/0 conn(0x7f96a806fb90 0x7f96a80c6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:03.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.022+0000 7f96ada00640 1 -- 172.21.15.152:0/1006032332 >> v1:172.21.15.196:6789/0 conn(0x7f96a815e890 legacy=0x7f96a806f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:03.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.022+0000 7f96ada00640 1 -- 172.21.15.152:0/1006032332 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a80cf680 con 0x7f96a815e4b0 2024-04-17T08:47:03.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.022+0000 7f96ae400640 1 --2- 172.21.15.152:0/1006032332 >> v2:172.21.15.196:3300/0 conn(0x7f96a806fb90 0x7f96a80c6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T08:47:03.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.026+0000 7f96ada00640 1 --2- 172.21.15.152:0/1006032332 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f96a815e4b0 0x7f96a80cd250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f969c009d90 tx=0x7f969c01c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d45ceaec6f16582f server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:03.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.026+0000 7f96a7e00640 1 -- 172.21.15.152:0/1006032332 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969c0b2070 con 0x7f96a815e4b0 2024-04-17T08:47:03.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.026+0000 7f96a7e00640 1 -- 172.21.15.152:0/1006032332 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f969c0a5990 con 0x7f96a815e4b0 2024-04-17T08:47:03.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.026+0000 7f96a7e00640 1 -- 172.21.15.152:0/1006032332 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969c0a5d60 con 0x7f96a815e4b0 2024-04-17T08:47:03.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.026+0000 7f96b0400640 1 -- 172.21.15.152:0/1006032332 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f96a815e4b0 msgr2=0x7f96a80cd250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:03.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.026+0000 7f96b0400640 1 --2- 172.21.15.152:0/1006032332 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f96a815e4b0 0x7f96a80cd250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f969c009d90 tx=0x7f969c01c8b0 comp rx=0 tx=0).stop 2024-04-17T08:47:03.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.026+0000 7f96b0400640 1 -- 172.21.15.152:0/1006032332 shutdown_connections 2024-04-17T08:47:03.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.026+0000 7f96b0400640 1 --2- 172.21.15.152:0/1006032332 >> v2:172.21.15.196:3300/0 conn(0x7f96a806fb90 0x7f96a80c6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:03.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.026+0000 7f96b0400640 1 --2- 172.21.15.152:0/1006032332 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f96a815e4b0 0x7f96a80cd250 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:03.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.026+0000 7f96b0400640 1 -- 172.21.15.152:0/1006032332 >> 172.21.15.152:0/1006032332 conn(0x7f96a8072ca0 msgr2=0x7f96a8073080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:03.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.026+0000 7f96b0400640 1 -- 172.21.15.152:0/1006032332 shutdown_connections 2024-04-17T08:47:03.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.026+0000 7f96b0400640 1 -- 172.21.15.152:0/1006032332 wait complete. 2024-04-17T08:47:03.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.030+0000 7f96b0400640 1 Processor -- start 2024-04-17T08:47:03.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.030+0000 7f96b0400640 1 -- start start 2024-04-17T08:47:03.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.030+0000 7f96b0400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f96a806fb90 0x7f96a80b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:03.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.030+0000 7f96b0400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96a815e4b0 0x7f96a80b5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:03.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.030+0000 7f96b0400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96a815e890 0x7f96a8156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:03.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.030+0000 7f96b0400640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f96a80c7050 con 0x7f96a815e890 2024-04-17T08:47:03.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.030+0000 7f96b0400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f96a80c6ed0 con 0x7f96a815e4b0 2024-04-17T08:47:03.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.030+0000 7f96b0400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f96a816b3f0 con 0x7f96a806fb90 2024-04-17T08:47:03.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.030+0000 7f96ae400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96a815e890 0x7f96a8156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:03.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.030+0000 7f96ad000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96a815e4b0 0x7f96a80b5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:03.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.030+0000 7f96ada00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f96a806fb90 0x7f96a80b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:03.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.030+0000 7f96ae400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96a815e890 0x7f96a8156020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46966/0 (socket says 172.21.15.152:46966) 2024-04-17T08:47:03.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.030+0000 7f96ada00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f96a806fb90 0x7f96a80b4aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.152:33702/0 (socket says 172.21.15.152:33702) 2024-04-17T08:47:03.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.030+0000 7f96ae400640 1 -- 172.21.15.152:0/1773496599 learned_addr learned my addr 172.21.15.152:0/1773496599 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:03.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.030+0000 7f96ada00640 1 -- 172.21.15.152:0/1773496599 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96a815e4b0 msgr2=0x7f96a80b5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:03.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.030+0000 7f96ada00640 1 --2- 172.21.15.152:0/1773496599 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96a815e4b0 0x7f96a80b5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:03.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.030+0000 7f96ada00640 1 -- 172.21.15.152:0/1773496599 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96a815e890 msgr2=0x7f96a8156020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:03.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.030+0000 7f96ada00640 1 --2- 172.21.15.152:0/1773496599 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96a815e890 0x7f96a8156020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:03.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.030+0000 7f96ada00640 1 -- 172.21.15.152:0/1773496599 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a80cb1b0 con 0x7f96a806fb90 2024-04-17T08:47:03.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.030+0000 7f96ae400640 1 --2- 172.21.15.152:0/1773496599 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96a815e890 0x7f96a8156020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T08:47:03.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.030+0000 7f96ada00640 1 --2- 172.21.15.152:0/1773496599 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f96a806fb90 0x7f96a80b4aa0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f969c0ac000 tx=0x7f969c019650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:03.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.030+0000 7f96a5600640 1 -- 172.21.15.152:0/1773496599 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969c0bd020 con 0x7f96a806fb90 2024-04-17T08:47:03.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.030+0000 7f96a5600640 1 -- 172.21.15.152:0/1773496599 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f969c0b3040 con 0x7f96a806fb90 2024-04-17T08:47:03.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.030+0000 7f96a5600640 1 -- 172.21.15.152:0/1773496599 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969c0b2050 con 0x7f96a806fb90 2024-04-17T08:47:03.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.030+0000 7f96b0400640 1 -- 172.21.15.152:0/1773496599 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96a80cb700 con 0x7f96a806fb90 2024-04-17T08:47:03.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.030+0000 7f96b0400640 1 -- 172.21.15.152:0/1773496599 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f96a80b5bc0 con 0x7f96a806fb90 2024-04-17T08:47:03.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.030+0000 7f96b0400640 1 -- 172.21.15.152:0/1773496599 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96a8068a30 con 0x7f96a806fb90 2024-04-17T08:47:03.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.034+0000 7f96a5600640 1 -- 172.21.15.152:0/1773496599 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f969c0c0070 con 0x7f96a806fb90 2024-04-17T08:47:03.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.034+0000 7f96a5600640 1 --2- 172.21.15.152:0/1773496599 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9688068380 0x7f968806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:03.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.034+0000 7f96a5600640 1 -- 172.21.15.152:0/1773496599 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f969c120fe0 con 0x7f96a806fb90 2024-04-17T08:47:03.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.034+0000 7f96ad000640 1 --2- 172.21.15.152:0/1773496599 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9688068380 0x7f968806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:03.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.034+0000 7f96ad000640 1 --2- 172.21.15.152:0/1773496599 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9688068380 0x7f968806a840 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f96a81fa930 tx=0x7f9694009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:03.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.038+0000 7f96a5600640 1 -- 172.21.15.152:0/1773496599 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f969c016560 con 0x7f96a806fb90 2024-04-17T08:47:03.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.230+0000 7f96b0400640 1 -- 172.21.15.152:0/1773496599 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f96a80b00c0 con 0x7f96a806fb90 2024-04-17T08:47:03.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.230+0000 7f96a5600640 1 -- 172.21.15.152:0/1773496599 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f969c0f0ce0 con 0x7f96a806fb90 2024-04-17T08:47:03.231 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:47:03.231 INFO:teuthology.orchestra.run.smithi152.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-17T08:47:03.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.230+0000 7f96b0400640 1 -- 172.21.15.152:0/1773496599 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9688068380 msgr2=0x7f968806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:03.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.230+0000 7f96b0400640 1 --2- 172.21.15.152:0/1773496599 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9688068380 0x7f968806a840 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f96a81fa930 tx=0x7f9694009040 comp rx=0 tx=0).stop 2024-04-17T08:47:03.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.230+0000 7f96b0400640 1 -- 172.21.15.152:0/1773496599 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f96a806fb90 msgr2=0x7f96a80b4aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:03.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.230+0000 7f96b0400640 1 --2- 172.21.15.152:0/1773496599 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f96a806fb90 0x7f96a80b4aa0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f969c0ac000 tx=0x7f969c019650 comp rx=0 tx=0).stop 2024-04-17T08:47:03.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.230+0000 7f96b0400640 1 -- 172.21.15.152:0/1773496599 shutdown_connections 2024-04-17T08:47:03.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.230+0000 7f96b0400640 1 --2- 172.21.15.152:0/1773496599 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96a815e890 0x7f96a8156020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:03.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.230+0000 7f96b0400640 1 --2- 172.21.15.152:0/1773496599 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96a815e4b0 0x7f96a80b5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:03.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.230+0000 7f96b0400640 1 --2- 172.21.15.152:0/1773496599 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9688068380 0x7f968806a840 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:03.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.230+0000 7f96b0400640 1 --2- 172.21.15.152:0/1773496599 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f96a806fb90 0x7f96a80b4aa0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:03.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.230+0000 7f96b0400640 1 -- 172.21.15.152:0/1773496599 >> 172.21.15.152:0/1773496599 conn(0x7f96a8072ca0 msgr2=0x7f96a8070320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:03.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.230+0000 7f96b0400640 1 -- 172.21.15.152:0/1773496599 shutdown_connections 2024-04-17T08:47:03.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.230+0000 7f96b0400640 1 -- 172.21.15.152:0/1773496599 wait complete. 2024-04-17T08:47:03.252 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-17T08:47:03.252 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T08:47:03.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.386+0000 7fa033200640 1 Processor -- start 2024-04-17T08:47:03.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.386+0000 7fa033200640 1 -- start start 2024-04-17T08:47:03.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.386+0000 7fa033200640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa02c15d710 0x7fa02c160720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:03.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.386+0000 7fa033200640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa02c160d20 con 0x7fa02c0d0a70 2024-04-17T08:47:03.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.386+0000 7fa033200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa02c15cc30 con 0x7fa02c15a010 2024-04-17T08:47:03.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.386+0000 7fa033200640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fa02c15d280 con 0x7fa02c15d710 2024-04-17T08:47:03.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.386+0000 7fa023400640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fa02c0d0a70 0x7fa02c160010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:58496/0 (socket says 172.21.15.152:58496) 2024-04-17T08:47:03.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.386+0000 7fa023400640 1 -- 172.21.15.152:0/2762133079 learned_addr learned my addr 172.21.15.152:0/2762133079 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:03.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.386+0000 7fa031200640 1 --2- 172.21.15.152:0/2762133079 >> v2:172.21.15.152:3300/0 conn(0x7fa02c15d710 0x7fa02c160720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:03.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.386+0000 7fa031200640 1 -- 172.21.15.152:0/2762133079 >> v1:172.21.15.196:6789/0 conn(0x7fa02c15a010 legacy=0x7fa02c0d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:03.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.386+0000 7fa031200640 1 -- 172.21.15.152:0/2762133079 >> v1:172.21.15.152:6789/0 conn(0x7fa02c0d0a70 legacy=0x7fa02c160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:03.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.386+0000 7fa031200640 1 -- 172.21.15.152:0/2762133079 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa02c15cf10 con 0x7fa02c15d710 2024-04-17T08:47:03.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.390+0000 7fa031200640 1 --2- 172.21.15.152:0/2762133079 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa02c15d710 0x7fa02c160720 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa024009d90 tx=0x7fa02401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa778afff2b1ea0c server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:03.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.390+0000 7fa02b400640 1 -- 172.21.15.152:0/2762133079 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0240b2070 con 0x7fa02c15d710 2024-04-17T08:47:03.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.390+0000 7fa02b400640 1 -- 172.21.15.152:0/2762133079 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0240a57a0 con 0x7fa02c15d710 2024-04-17T08:47:03.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.390+0000 7fa02b400640 1 -- 172.21.15.152:0/2762133079 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0240a5b70 con 0x7fa02c15d710 2024-04-17T08:47:03.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.390+0000 7fa033200640 1 -- 172.21.15.152:0/2762133079 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa02c15d710 msgr2=0x7fa02c160720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:03.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.390+0000 7fa033200640 1 --2- 172.21.15.152:0/2762133079 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa02c15d710 0x7fa02c160720 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa024009d90 tx=0x7fa02401c8e0 comp rx=0 tx=0).stop 2024-04-17T08:47:03.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.390+0000 7fa033200640 1 -- 172.21.15.152:0/2762133079 shutdown_connections 2024-04-17T08:47:03.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.390+0000 7fa033200640 1 --2- 172.21.15.152:0/2762133079 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa02c15d710 0x7fa02c160720 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:03.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.390+0000 7fa033200640 1 -- 172.21.15.152:0/2762133079 >> 172.21.15.152:0/2762133079 conn(0x7fa02c0b3350 msgr2=0x7fa02c0b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:03.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.390+0000 7fa033200640 1 -- 172.21.15.152:0/2762133079 shutdown_connections 2024-04-17T08:47:03.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.390+0000 7fa033200640 1 -- 172.21.15.152:0/2762133079 wait complete. 2024-04-17T08:47:03.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.394+0000 7fa033200640 1 Processor -- start 2024-04-17T08:47:03.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.394+0000 7fa033200640 1 -- start start 2024-04-17T08:47:03.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.394+0000 7fa033200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa02c0d0a70 0x7fa02c14b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:03.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.394+0000 7fa033200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa02c15a010 0x7fa02c14dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:03.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.394+0000 7fa033200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa02c15d710 0x7fa02c0cdd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:03.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.394+0000 7fa033200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa02c169f50 con 0x7fa02c15d710 2024-04-17T08:47:03.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.394+0000 7fa033200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa02c169dd0 con 0x7fa02c0d0a70 2024-04-17T08:47:03.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.394+0000 7fa033200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fa02c16a0d0 con 0x7fa02c15a010 2024-04-17T08:47:03.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.394+0000 7fa031200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa02c15d710 0x7fa02c0cdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:03.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.394+0000 7fa031200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa02c15d710 0x7fa02c0cdd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46994/0 (socket says 172.21.15.152:46994) 2024-04-17T08:47:03.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.394+0000 7fa031200640 1 -- 172.21.15.152:0/2321285680 learned_addr learned my addr 172.21.15.152:0/2321285680 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:03.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.394+0000 7fa023400640 1 --2- 172.21.15.152:0/2321285680 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa02c15a010 0x7fa02c14dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:03.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.394+0000 7fa02be00640 1 --2- 172.21.15.152:0/2321285680 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa02c0d0a70 0x7fa02c14b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:03.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.394+0000 7fa031200640 1 -- 172.21.15.152:0/2321285680 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa02c15a010 msgr2=0x7fa02c14dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:03.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.394+0000 7fa031200640 1 --2- 172.21.15.152:0/2321285680 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa02c15a010 0x7fa02c14dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:03.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.394+0000 7fa031200640 1 -- 172.21.15.152:0/2321285680 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa02c0d0a70 msgr2=0x7fa02c14b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:03.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.394+0000 7fa031200640 1 --2- 172.21.15.152:0/2321285680 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa02c0d0a70 0x7fa02c14b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:03.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.394+0000 7fa031200640 1 -- 172.21.15.152:0/2321285680 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa02c0ce470 con 0x7fa02c15d710 2024-04-17T08:47:03.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.394+0000 7fa031200640 1 --2- 172.21.15.152:0/2321285680 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa02c15d710 0x7fa02c0cdd20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa0240b0040 tx=0x7fa024019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:03.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.394+0000 7fa028c00640 1 -- 172.21.15.152:0/2321285680 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0240b2050 con 0x7fa02c15d710 2024-04-17T08:47:03.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.394+0000 7fa028c00640 1 -- 172.21.15.152:0/2321285680 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0240be070 con 0x7fa02c15d710 2024-04-17T08:47:03.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.394+0000 7fa028c00640 1 -- 172.21.15.152:0/2321285680 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0240adba0 con 0x7fa02c15d710 2024-04-17T08:47:03.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.394+0000 7fa033200640 1 -- 172.21.15.152:0/2321285680 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa02c0ce750 con 0x7fa02c15d710 2024-04-17T08:47:03.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.394+0000 7fa033200640 1 -- 172.21.15.152:0/2321285680 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa02c0b0ea0 con 0x7fa02c15d710 2024-04-17T08:47:03.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.398+0000 7fa033200640 1 -- 172.21.15.152:0/2321285680 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa02c068a30 con 0x7fa02c15d710 2024-04-17T08:47:03.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.398+0000 7fa028c00640 1 -- 172.21.15.152:0/2321285680 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa0240c3460 con 0x7fa02c15d710 2024-04-17T08:47:03.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.398+0000 7fa028c00640 1 --2- 172.21.15.152:0/2321285680 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fa008068380 0x7fa00806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:03.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.398+0000 7fa028c00640 1 -- 172.21.15.152:0/2321285680 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa0241220a0 con 0x7fa02c15d710 2024-04-17T08:47:03.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.398+0000 7fa02be00640 1 --2- 172.21.15.152:0/2321285680 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fa008068380 0x7fa00806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:03.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.398+0000 7fa02be00640 1 --2- 172.21.15.152:0/2321285680 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fa008068380 0x7fa00806a840 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa02c0af9b0 tx=0x7fa01c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:03.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.402+0000 7fa028c00640 1 -- 172.21.15.152:0/2321285680 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fa024016560 con 0x7fa02c15d710 2024-04-17T08:47:03.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.562+0000 7fa033200640 1 -- 172.21.15.152:0/2321285680 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa02c06d660 con 0x7fa02c15d710 2024-04-17T08:47:03.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.566+0000 7fa028c00640 1 -- 172.21.15.152:0/2321285680 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7fa0240f1d50 con 0x7fa02c15d710 2024-04-17T08:47:03.566 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:47:03.566 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":24,"fsid":"ce68f82e-ec5f-4205-9fd5-bdfdf6ef31e2","created":"2024-04-17T08:46:08.353546+0000","modified":"2024-04-17T08:46:38.659862+0000","last_up_change":"2024-04-17T08:46:20.738799+0000","last_in_change":"2024-04-17T08:46:11.210050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T08:46:21.386856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T08:46:31.812460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T08:46:32.555559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T08:46:36.258078+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"682f0192-187c-404e-bc7a-b6b4e23825e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6819","nonce":3603799291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6823","nonce":3603799291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6831","nonce":3603799291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6827","nonce":3603799291}]},"public_addr":"172.21.15.152:6819/3603799291","cluster_addr":"172.21.15.152:6823/3603799291","heartbeat_back_addr":"172.21.15.152:6831/3603799291","heartbeat_front_addr":"172.21.15.152:6827/3603799291","state":["exists","up"]},{"osd":1,"uuid":"f0fe8fef-60ec-4a39-83b6-2fa6a5adb0f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6801","nonce":4133383142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6803","nonce":4133383142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6807","nonce":4133383142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6805","nonce":4133383142}]},"public_addr":"172.21.15.152:6801/4133383142","cluster_addr":"172.21.15.152:6803/4133383142","heartbeat_back_addr":"172.21.15.152:6807/4133383142","heartbeat_front_addr":"172.21.15.152:6805/4133383142","state":["exists","up"]},{"osd":2,"uuid":"35f36d9c-5245-4431-a618-f4df0fa380ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6809","nonce":3826143898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6811","nonce":3826143898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6815","nonce":3826143898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6813","nonce":3826143898}]},"public_addr":"172.21.15.152:6809/3826143898","cluster_addr":"172.21.15.152:6811/3826143898","heartbeat_back_addr":"172.21.15.152:6815/3826143898","heartbeat_front_addr":"172.21.15.152:6813/3826143898","state":["exists","up"]},{"osd":3,"uuid":"96e56ca5-15b4-4895-9b79-da2c92043159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6818","nonce":165717826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6822","nonce":165717826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6830","nonce":165717826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6826","nonce":165717826}]},"public_addr":"172.21.15.152:6818/165717826","cluster_addr":"172.21.15.152:6822/165717826","heartbeat_back_addr":"172.21.15.152:6830/165717826","heartbeat_front_addr":"172.21.15.152:6826/165717826","state":["exists","up"]},{"osd":4,"uuid":"f5aa10a4-9ff9-41fe-a5c9-15326f982cc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6817","nonce":4080159297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6819","nonce":4080159297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6823","nonce":4080159297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6821","nonce":4080159297}]},"public_addr":"172.21.15.196:6817/4080159297","cluster_addr":"172.21.15.196:6819/4080159297","heartbeat_back_addr":"172.21.15.196:6823/4080159297","heartbeat_front_addr":"172.21.15.196:6821/4080159297","state":["exists","up"]},{"osd":5,"uuid":"42bab884-3476-47ae-ac65-935fa6e0f055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6801","nonce":3519444232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6803","nonce":3519444232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6807","nonce":3519444232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6805","nonce":3519444232}]},"public_addr":"172.21.15.196:6801/3519444232","cluster_addr":"172.21.15.196:6803/3519444232","heartbeat_back_addr":"172.21.15.196:6807/3519444232","heartbeat_front_addr":"172.21.15.196:6805/3519444232","state":["exists","up"]},{"osd":6,"uuid":"460b6167-f57b-4224-9c92-cfc9b80bbe99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6809","nonce":275739834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6811","nonce":275739834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6815","nonce":275739834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6813","nonce":275739834}]},"public_addr":"172.21.15.196:6809/275739834","cluster_addr":"172.21.15.196:6811/275739834","heartbeat_back_addr":"172.21.15.196:6815/275739834","heartbeat_front_addr":"172.21.15.196:6813/275739834","state":["exists","up"]},{"osd":7,"uuid":"d695643f-5e07-4e2a-a646-c06bd97b6650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6825","nonce":307626968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6827","nonce":307626968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6831","nonce":307626968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6829","nonce":307626968}]},"public_addr":"172.21.15.196:6825/307626968","cluster_addr":"172.21.15.196:6827/307626968","heartbeat_back_addr":"172.21.15.196:6831/307626968","heartbeat_front_addr":"172.21.15.196:6829/307626968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.293257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.964533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.248895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.010000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.832554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.743704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930171+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930962+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T08:47:03.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.566+0000 7fa033200640 1 -- 172.21.15.152:0/2321285680 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fa008068380 msgr2=0x7fa00806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:03.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.566+0000 7fa033200640 1 --2- 172.21.15.152:0/2321285680 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fa008068380 0x7fa00806a840 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa02c0af9b0 tx=0x7fa01c009040 comp rx=0 tx=0).stop 2024-04-17T08:47:03.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.566+0000 7fa033200640 1 -- 172.21.15.152:0/2321285680 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa02c15d710 msgr2=0x7fa02c0cdd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:03.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.566+0000 7fa033200640 1 --2- 172.21.15.152:0/2321285680 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa02c15d710 0x7fa02c0cdd20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa0240b0040 tx=0x7fa024019680 comp rx=0 tx=0).stop 2024-04-17T08:47:03.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.566+0000 7fa033200640 1 -- 172.21.15.152:0/2321285680 shutdown_connections 2024-04-17T08:47:03.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.566+0000 7fa033200640 1 --2- 172.21.15.152:0/2321285680 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa02c15d710 0x7fa02c0cdd20 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:03.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.566+0000 7fa033200640 1 --2- 172.21.15.152:0/2321285680 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fa008068380 0x7fa00806a840 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:03.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.566+0000 7fa033200640 1 --2- 172.21.15.152:0/2321285680 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa02c15a010 0x7fa02c14dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:03.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.566+0000 7fa033200640 1 --2- 172.21.15.152:0/2321285680 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa02c0d0a70 0x7fa02c14b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:03.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.566+0000 7fa033200640 1 -- 172.21.15.152:0/2321285680 >> 172.21.15.152:0/2321285680 conn(0x7fa02c0b3350 msgr2=0x7fa02c072cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:03.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.566+0000 7fa033200640 1 -- 172.21.15.152:0/2321285680 shutdown_connections 2024-04-17T08:47:03.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.566+0000 7fa033200640 1 -- 172.21.15.152:0/2321285680 wait complete. 2024-04-17T08:47:03.587 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T08:46:21.386856+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-17T08:46:31.812460+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-17T08:46:32.555559+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-17T08:46:36.258078+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-17T08:47:03.588 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T08:47:03.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.722+0000 7f7179c00640 1 Processor -- start 2024-04-17T08:47:03.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.722+0000 7f7179c00640 1 -- start start 2024-04-17T08:47:03.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.726+0000 7f7179c00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f717415a010 0x7f71740d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:03.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.726+0000 7f7179c00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7174160d20 con 0x7f7174160720 2024-04-17T08:47:03.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.726+0000 7f7179c00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f717415cc30 con 0x7f717415d710 2024-04-17T08:47:03.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.726+0000 7f7179c00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f717415d280 con 0x7f717415a010 2024-04-17T08:47:03.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.726+0000 7f7172a00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f717415a010 0x7f71740d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:03.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.726+0000 7f7172a00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f717415a010 0x7f71740d0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47008/0 (socket says 172.21.15.152:47008) 2024-04-17T08:47:03.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.726+0000 7f7172a00640 1 -- 172.21.15.152:0/3826426644 learned_addr learned my addr 172.21.15.152:0/3826426644 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:03.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.726+0000 7f7173400640 1 --1- 172.21.15.152:0/3826426644 >> v1:172.21.15.152:6789/0 conn(0x7f7174160720 0x7f717415dbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:58498/0 (socket says 172.21.15.152:58498) 2024-04-17T08:47:03.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.726+0000 7f7172a00640 1 -- 172.21.15.152:0/3826426644 >> v1:172.21.15.196:6789/0 conn(0x7f717415d710 legacy=0x7f7174160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:03.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.726+0000 7f7172a00640 1 -- 172.21.15.152:0/3826426644 >> v1:172.21.15.152:6789/0 conn(0x7f7174160720 legacy=0x7f717415dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:03.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.726+0000 7f7171600640 1 -- 172.21.15.152:0/3826426644 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3315423191 0 0) 0x7f7174160d20 con 0x7f7174160720 2024-04-17T08:47:03.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.726+0000 7f7172a00640 1 -- 172.21.15.152:0/3826426644 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f717415cf10 con 0x7f717415a010 2024-04-17T08:47:03.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.730+0000 7f7172a00640 1 --2- 172.21.15.152:0/3826426644 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f717415a010 0x7f71740d0360 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f717415d400 tx=0x7f716401c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18fe90e6fdbc7310 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:03.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.730+0000 7f7171600640 1 -- 172.21.15.152:0/3826426644 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71640a5650 con 0x7f717415a010 2024-04-17T08:47:03.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.730+0000 7f7171600640 1 -- 172.21.15.152:0/3826426644 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71640a57f0 con 0x7f717415a010 2024-04-17T08:47:03.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.730+0000 7f7171600640 1 -- 172.21.15.152:0/3826426644 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71640a5bc0 con 0x7f717415a010 2024-04-17T08:47:03.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.730+0000 7f7179c00640 1 -- 172.21.15.152:0/3826426644 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f717415a010 msgr2=0x7f71740d0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:03.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.730+0000 7f7179c00640 1 --2- 172.21.15.152:0/3826426644 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f717415a010 0x7f71740d0360 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f717415d400 tx=0x7f716401c980 comp rx=0 tx=0).stop 2024-04-17T08:47:03.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.730+0000 7f7179c00640 1 -- 172.21.15.152:0/3826426644 shutdown_connections 2024-04-17T08:47:03.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.730+0000 7f7179c00640 1 --2- 172.21.15.152:0/3826426644 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f717415a010 0x7f71740d0360 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:03.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.730+0000 7f7179c00640 1 -- 172.21.15.152:0/3826426644 >> 172.21.15.152:0/3826426644 conn(0x7f71740b3350 msgr2=0x7f71740b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:03.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.730+0000 7f7179c00640 1 -- 172.21.15.152:0/3826426644 shutdown_connections 2024-04-17T08:47:03.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.730+0000 7f7179c00640 1 -- 172.21.15.152:0/3826426644 wait complete. 2024-04-17T08:47:03.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.730+0000 7f7179c00640 1 Processor -- start 2024-04-17T08:47:03.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.730+0000 7f7179c00640 1 -- start start 2024-04-17T08:47:03.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.730+0000 7f7179c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f717415a010 0x7f717415ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:03.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.730+0000 7f7179c00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f717415d710 0x7f71740cc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:03.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.730+0000 7f7179c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7174160720 0x7f717414e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:03.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.730+0000 7f7179c00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f71740d0cb0 con 0x7f717415d710 2024-04-17T08:47:03.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.730+0000 7f7179c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f717415c9d0 con 0x7f717415a010 2024-04-17T08:47:03.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.730+0000 7f7179c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f717416a5d0 con 0x7f7174160720 2024-04-17T08:47:03.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.730+0000 7f7172000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f717415d710 0x7f71740cc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:03.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.730+0000 7f7172000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f717415d710 0x7f71740cc2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47016/0 (socket says 172.21.15.152:47016) 2024-04-17T08:47:03.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.730+0000 7f7172000640 1 -- 172.21.15.152:0/323061273 learned_addr learned my addr 172.21.15.152:0/323061273 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:03.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.734+0000 7f7172a00640 1 --2- 172.21.15.152:0/323061273 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f717415a010 0x7f717415ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:03.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.734+0000 7f7173400640 1 --2- 172.21.15.152:0/323061273 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7174160720 0x7f717414e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:03.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.734+0000 7f7172000640 1 -- 172.21.15.152:0/323061273 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7174160720 msgr2=0x7f717414e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:03.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.734+0000 7f7172000640 1 --2- 172.21.15.152:0/323061273 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7174160720 0x7f717414e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:03.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.734+0000 7f7172000640 1 -- 172.21.15.152:0/323061273 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f717415a010 msgr2=0x7f717415ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:03.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.734+0000 7f7172000640 1 --2- 172.21.15.152:0/323061273 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f717415a010 0x7f717415ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:03.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.734+0000 7f7172000640 1 -- 172.21.15.152:0/323061273 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7174151150 con 0x7f717415d710 2024-04-17T08:47:03.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.734+0000 7f7173400640 1 --2- 172.21.15.152:0/323061273 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7174160720 0x7f717414e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:03.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.734+0000 7f7172000640 1 --2- 172.21.15.152:0/323061273 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f717415d710 0x7f71740cc2e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f716000c500 tx=0x7f716000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:03.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.734+0000 7f716aa00640 1 -- 172.21.15.152:0/323061273 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7160016020 con 0x7f717415d710 2024-04-17T08:47:03.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.734+0000 7f716aa00640 1 -- 172.21.15.152:0/323061273 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7160005220 con 0x7f717415d710 2024-04-17T08:47:03.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.734+0000 7f7179c00640 1 -- 172.21.15.152:0/323061273 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7174151430 con 0x7f717415d710 2024-04-17T08:47:03.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.734+0000 7f716aa00640 1 -- 172.21.15.152:0/323061273 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7160007030 con 0x7f717415d710 2024-04-17T08:47:03.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.734+0000 7f7179c00640 1 -- 172.21.15.152:0/323061273 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71740cf050 con 0x7f717415d710 2024-04-17T08:47:03.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.734+0000 7f7179c00640 1 -- 172.21.15.152:0/323061273 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71740cf250 con 0x7f717415d710 2024-04-17T08:47:03.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.734+0000 7f716aa00640 1 -- 172.21.15.152:0/323061273 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f71600071f0 con 0x7f717415d710 2024-04-17T08:47:03.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.734+0000 7f716aa00640 1 --2- 172.21.15.152:0/323061273 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f7154068380 0x7f715406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:03.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.734+0000 7f716aa00640 1 -- 172.21.15.152:0/323061273 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f7160086700 con 0x7f717415d710 2024-04-17T08:47:03.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.734+0000 7f7172a00640 1 --2- 172.21.15.152:0/323061273 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f7154068380 0x7f715406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:03.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.738+0000 7f7172a00640 1 --2- 172.21.15.152:0/323061273 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f7154068380 0x7f715406a840 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f71640ae000 tx=0x7f71640a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:03.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.738+0000 7f716aa00640 1 -- 172.21.15.152:0/323061273 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f71740cf250 con 0x7f717415d710 2024-04-17T08:47:03.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.898+0000 7f7179c00640 1 -- 172.21.15.152:0/323061273 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7174068a30 con 0x7f717415d710 2024-04-17T08:47:03.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.898+0000 7f716aa00640 1 -- 172.21.15.152:0/323061273 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7f7160020020 con 0x7f717415d710 2024-04-17T08:47:03.899 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2024-04-17T08:47:03.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.898+0000 7f7179c00640 1 -- 172.21.15.152:0/323061273 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f7154068380 msgr2=0x7f715406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:03.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.898+0000 7f7179c00640 1 --2- 172.21.15.152:0/323061273 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f7154068380 0x7f715406a840 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f71640ae000 tx=0x7f71640a7070 comp rx=0 tx=0).stop 2024-04-17T08:47:03.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.898+0000 7f7179c00640 1 -- 172.21.15.152:0/323061273 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f717415d710 msgr2=0x7f71740cc2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:03.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.898+0000 7f7179c00640 1 --2- 172.21.15.152:0/323061273 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f717415d710 0x7f71740cc2e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f716000c500 tx=0x7f716000c9c0 comp rx=0 tx=0).stop 2024-04-17T08:47:03.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.898+0000 7f7179c00640 1 -- 172.21.15.152:0/323061273 shutdown_connections 2024-04-17T08:47:03.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.898+0000 7f7179c00640 1 --2- 172.21.15.152:0/323061273 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f7154068380 0x7f715406a840 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:03.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.898+0000 7f7179c00640 1 --2- 172.21.15.152:0/323061273 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7174160720 0x7f717414e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:03.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.898+0000 7f7179c00640 1 --2- 172.21.15.152:0/323061273 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f717415d710 0x7f71740cc2e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:03.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.898+0000 7f7179c00640 1 --2- 172.21.15.152:0/323061273 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f717415a010 0x7f717415ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:03.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.898+0000 7f7179c00640 1 -- 172.21.15.152:0/323061273 >> 172.21.15.152:0/323061273 conn(0x7f71740b3350 msgr2=0x7f7174071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:03.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.898+0000 7f7179c00640 1 -- 172.21.15.152:0/323061273 shutdown_connections 2024-04-17T08:47:03.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:03.898+0000 7f7179c00640 1 -- 172.21.15.152:0/323061273 wait complete. 2024-04-17T08:47:03.920 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-17T08:47:04.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.054+0000 7f27fd400640 1 Processor -- start 2024-04-17T08:47:04.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.054+0000 7f27fd400640 1 -- start start 2024-04-17T08:47:04.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.058+0000 7f27fd400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f27f80d0360 0x7f27f80d07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:04.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.058+0000 7f27fd400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f27f80ad3d0 0x7f27f80ad820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:04.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.058+0000 7f27fd400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27f806e6b0 con 0x7f27f8161b70 2024-04-17T08:47:04.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.058+0000 7f27fd400640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f27f80d0d00 con 0x7f27f80d0360 2024-04-17T08:47:04.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.058+0000 7f27fd400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f27f8161f50 con 0x7f27f80ad3d0 2024-04-17T08:47:04.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.058+0000 7f27f5e00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f27f80d0360 0x7f27f80d07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:04.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.058+0000 7f27f5e00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f27f80d0360 0x7f27f80d07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47020/0 (socket says 172.21.15.152:47020) 2024-04-17T08:47:04.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.058+0000 7f27f5e00640 1 -- 172.21.15.152:0/2142219829 learned_addr learned my addr 172.21.15.152:0/2142219829 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:04.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.058+0000 7f27f7200640 1 --2- 172.21.15.152:0/2142219829 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f27f80ad3d0 0x7f27f80ad820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:04.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.058+0000 7f27f5e00640 1 -- 172.21.15.152:0/2142219829 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f27f80ad3d0 msgr2=0x7f27f80ad820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:04.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.058+0000 7f27f5e00640 1 --2- 172.21.15.152:0/2142219829 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f27f80ad3d0 0x7f27f80ad820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:04.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.058+0000 7f27f5e00640 1 -- 172.21.15.152:0/2142219829 >> v1:172.21.15.196:6789/0 conn(0x7f27f8161b70 legacy=0x7f27f806dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:04.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.058+0000 7f27f5e00640 1 -- 172.21.15.152:0/2142219829 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27f806e990 con 0x7f27f80d0360 2024-04-17T08:47:04.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.062+0000 7f27f5e00640 1 --2- 172.21.15.152:0/2142219829 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27f80d0360 0x7f27f80d07c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f27e4009870 tx=0x7f27e401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4ee6f388fd97abc server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:04.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.062+0000 7f27f5400640 1 -- 172.21.15.152:0/2142219829 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e40b1070 con 0x7f27f80d0360 2024-04-17T08:47:04.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.062+0000 7f27f5400640 1 -- 172.21.15.152:0/2142219829 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27e40ac620 con 0x7f27f80d0360 2024-04-17T08:47:04.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.062+0000 7f27f5400640 1 -- 172.21.15.152:0/2142219829 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e40ac9f0 con 0x7f27f80d0360 2024-04-17T08:47:04.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.062+0000 7f27fd400640 1 -- 172.21.15.152:0/2142219829 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27f80d0360 msgr2=0x7f27f80d07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:04.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.062+0000 7f27fd400640 1 --2- 172.21.15.152:0/2142219829 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27f80d0360 0x7f27f80d07c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f27e4009870 tx=0x7f27e401c4d0 comp rx=0 tx=0).stop 2024-04-17T08:47:04.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.062+0000 7f27fd400640 1 -- 172.21.15.152:0/2142219829 shutdown_connections 2024-04-17T08:47:04.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.062+0000 7f27fd400640 1 --2- 172.21.15.152:0/2142219829 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f27f80ad3d0 0x7f27f80ad820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:04.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.062+0000 7f27fd400640 1 --2- 172.21.15.152:0/2142219829 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27f80d0360 0x7f27f80d07c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:04.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.062+0000 7f27fd400640 1 -- 172.21.15.152:0/2142219829 >> 172.21.15.152:0/2142219829 conn(0x7f27f80b3350 msgr2=0x7f27f80b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:04.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.062+0000 7f27fd400640 1 -- 172.21.15.152:0/2142219829 shutdown_connections 2024-04-17T08:47:04.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.062+0000 7f27fd400640 1 -- 172.21.15.152:0/2142219829 wait complete. 2024-04-17T08:47:04.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.062+0000 7f27fd400640 1 Processor -- start 2024-04-17T08:47:04.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.062+0000 7f27fd400640 1 -- start start 2024-04-17T08:47:04.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.062+0000 7f27fd400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f27f80ad3d0 0x7f27f8150c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:04.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.062+0000 7f27fd400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f27f80d0360 0x7f27f8159810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:04.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.062+0000 7f27fd400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27f8161b70 0x7f27f813ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:04.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.062+0000 7f27fd400640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f27f8071ef0 con 0x7f27f8161b70 2024-04-17T08:47:04.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.062+0000 7f27fd400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f27f8071d70 con 0x7f27f80d0360 2024-04-17T08:47:04.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.062+0000 7f27fd400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f27f816b1c0 con 0x7f27f80ad3d0 2024-04-17T08:47:04.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.066+0000 7f27f7200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27f8161b70 0x7f27f813ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:04.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.066+0000 7f27f7200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27f8161b70 0x7f27f813ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47022/0 (socket says 172.21.15.152:47022) 2024-04-17T08:47:04.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.066+0000 7f27f7200640 1 -- 172.21.15.152:0/1273293191 learned_addr learned my addr 172.21.15.152:0/1273293191 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:04.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.066+0000 7f27f5e00640 1 --2- 172.21.15.152:0/1273293191 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f27f80d0360 0x7f27f8159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:04.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.066+0000 7f27f6800640 1 --2- 172.21.15.152:0/1273293191 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f27f80ad3d0 0x7f27f8150c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:04.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.066+0000 7f27f7200640 1 -- 172.21.15.152:0/1273293191 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f27f80ad3d0 msgr2=0x7f27f8150c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:04.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.066+0000 7f27f7200640 1 --2- 172.21.15.152:0/1273293191 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f27f80ad3d0 0x7f27f8150c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:04.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.066+0000 7f27f7200640 1 -- 172.21.15.152:0/1273293191 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f27f80d0360 msgr2=0x7f27f8159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:04.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.066+0000 7f27f7200640 1 --2- 172.21.15.152:0/1273293191 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f27f80d0360 0x7f27f8159810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:04.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.066+0000 7f27f7200640 1 -- 172.21.15.152:0/1273293191 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27f81512b0 con 0x7f27f8161b70 2024-04-17T08:47:04.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.066+0000 7f27f5e00640 1 --2- 172.21.15.152:0/1273293191 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f27f80d0360 0x7f27f8159810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T08:47:04.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.066+0000 7f27f7200640 1 --2- 172.21.15.152:0/1273293191 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27f8161b70 0x7f27f813ef00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f27f000d590 tx=0x7f27f000da50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:04.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.066+0000 7f27eea00640 1 -- 172.21.15.152:0/1273293191 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f00125f0 con 0x7f27f8161b70 2024-04-17T08:47:04.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.066+0000 7f27eea00640 1 -- 172.21.15.152:0/1273293191 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27f0019070 con 0x7f27f8161b70 2024-04-17T08:47:04.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.066+0000 7f27fd400640 1 -- 172.21.15.152:0/1273293191 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27f8151590 con 0x7f27f8161b70 2024-04-17T08:47:04.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.066+0000 7f27eea00640 1 -- 172.21.15.152:0/1273293191 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f00129f0 con 0x7f27f8161b70 2024-04-17T08:47:04.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.066+0000 7f27fd400640 1 -- 172.21.15.152:0/1273293191 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27f8151b50 con 0x7f27f8161b70 2024-04-17T08:47:04.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.066+0000 7f27fd400640 1 -- 172.21.15.152:0/1273293191 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27f815b280 con 0x7f27f8161b70 2024-04-17T08:47:04.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.066+0000 7f27eea00640 1 -- 172.21.15.152:0/1273293191 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f27f0012b90 con 0x7f27f8161b70 2024-04-17T08:47:04.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.066+0000 7f27eea00640 1 --2- 172.21.15.152:0/1273293191 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f27d8068380 0x7f27d806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:04.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.070+0000 7f27eea00640 1 -- 172.21.15.152:0/1273293191 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f27f0086ff0 con 0x7f27f8161b70 2024-04-17T08:47:04.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.070+0000 7f27f6800640 1 --2- 172.21.15.152:0/1273293191 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f27d8068380 0x7f27d806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:04.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.070+0000 7f27f6800640 1 --2- 172.21.15.152:0/1273293191 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f27d8068380 0x7f27d806a840 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f27e8001ea0 tx=0x7f27e8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:04.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.074+0000 7f27eea00640 1 -- 172.21.15.152:0/1273293191 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f27f815b280 con 0x7f27f8161b70 2024-04-17T08:47:04.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.226+0000 7f27fd400640 1 -- 172.21.15.152:0/1273293191 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f27f8068a30 con 0x7f27f8161b70 2024-04-17T08:47:04.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.230+0000 7f27eea00640 1 -- 172.21.15.152:0/1273293191 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7f27f0056be0 con 0x7f27f8161b70 2024-04-17T08:47:04.230 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-04-17T08:47:04.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.230+0000 7f27fd400640 1 -- 172.21.15.152:0/1273293191 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f27d8068380 msgr2=0x7f27d806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:04.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.230+0000 7f27fd400640 1 --2- 172.21.15.152:0/1273293191 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f27d8068380 0x7f27d806a840 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f27e8001ea0 tx=0x7f27e8009040 comp rx=0 tx=0).stop 2024-04-17T08:47:04.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.230+0000 7f27fd400640 1 -- 172.21.15.152:0/1273293191 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27f8161b70 msgr2=0x7f27f813ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:04.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.230+0000 7f27fd400640 1 --2- 172.21.15.152:0/1273293191 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27f8161b70 0x7f27f813ef00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f27f000d590 tx=0x7f27f000da50 comp rx=0 tx=0).stop 2024-04-17T08:47:04.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.230+0000 7f27fd400640 1 -- 172.21.15.152:0/1273293191 shutdown_connections 2024-04-17T08:47:04.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.230+0000 7f27fd400640 1 --2- 172.21.15.152:0/1273293191 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27f8161b70 0x7f27f813ef00 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:04.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.230+0000 7f27fd400640 1 --2- 172.21.15.152:0/1273293191 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f27f80d0360 0x7f27f8159810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:04.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.230+0000 7f27fd400640 1 --2- 172.21.15.152:0/1273293191 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f27d8068380 0x7f27d806a840 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:04.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.230+0000 7f27fd400640 1 --2- 172.21.15.152:0/1273293191 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f27f80ad3d0 0x7f27f8150c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:04.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.230+0000 7f27fd400640 1 -- 172.21.15.152:0/1273293191 >> 172.21.15.152:0/1273293191 conn(0x7f27f80b3350 msgr2=0x7f27f8155860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:04.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.230+0000 7f27fd400640 1 -- 172.21.15.152:0/1273293191 shutdown_connections 2024-04-17T08:47:04.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.230+0000 7f27fd400640 1 -- 172.21.15.152:0/1273293191 wait complete. 2024-04-17T08:47:04.251 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-17T08:47:04.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.390+0000 7fddb2200640 1 Processor -- start 2024-04-17T08:47:04.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.390+0000 7fddb2200640 1 -- start start 2024-04-17T08:47:04.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.390+0000 7fddb2200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fddac0af670 0x7fddac15b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:04.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.390+0000 7fddb2200640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fddac0d0360 0x7fddac0d07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:04.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.390+0000 7fddb2200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddac072c40 con 0x7fddac06f980 2024-04-17T08:47:04.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.390+0000 7fddb2200640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fddac0d0cf0 con 0x7fddac0d0360 2024-04-17T08:47:04.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.390+0000 7fddb2200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fddac15c820 con 0x7fddac0af670 2024-04-17T08:47:04.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.390+0000 7fddabe00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fddac0d0360 0x7fddac0d07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:04.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.390+0000 7fddabe00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fddac0d0360 0x7fddac0d07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47032/0 (socket says 172.21.15.152:47032) 2024-04-17T08:47:04.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.390+0000 7fddabe00640 1 -- 172.21.15.152:0/1747301096 learned_addr learned my addr 172.21.15.152:0/1747301096 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:04.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.390+0000 7fddab400640 1 --2- 172.21.15.152:0/1747301096 >> v2:172.21.15.196:3300/0 conn(0x7fddac0af670 0x7fddac15b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:04.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.390+0000 7fddabe00640 1 -- 172.21.15.152:0/1747301096 >> v2:172.21.15.196:3300/0 conn(0x7fddac0af670 msgr2=0x7fddac15b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:04.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.390+0000 7fddabe00640 1 --2- 172.21.15.152:0/1747301096 >> v2:172.21.15.196:3300/0 conn(0x7fddac0af670 0x7fddac15b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:04.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.390+0000 7fddabe00640 1 -- 172.21.15.152:0/1747301096 >> v1:172.21.15.196:6789/0 conn(0x7fddac06f980 legacy=0x7fddac072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:04.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.390+0000 7fddabe00640 1 -- 172.21.15.152:0/1747301096 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddac15c260 con 0x7fddac0d0360 2024-04-17T08:47:04.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.394+0000 7fddabe00640 1 --2- 172.21.15.152:0/1747301096 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fddac0d0360 0x7fddac0d07b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fddac074260 tx=0x7fdda401c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13dcd7f2c0581b45 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:04.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.394+0000 7fddaa000640 1 -- 172.21.15.152:0/1747301096 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda40a57b0 con 0x7fddac0d0360 2024-04-17T08:47:04.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.394+0000 7fddaa000640 1 -- 172.21.15.152:0/1747301096 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdda40a5950 con 0x7fddac0d0360 2024-04-17T08:47:04.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.394+0000 7fddaa000640 1 -- 172.21.15.152:0/1747301096 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda40a5d20 con 0x7fddac0d0360 2024-04-17T08:47:04.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.394+0000 7fddb2200640 1 -- 172.21.15.152:0/1747301096 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fddac0d0360 msgr2=0x7fddac0d07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:04.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.394+0000 7fddb2200640 1 --2- 172.21.15.152:0/1747301096 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fddac0d0360 0x7fddac0d07b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fddac074260 tx=0x7fdda401c8f0 comp rx=0 tx=0).stop 2024-04-17T08:47:04.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.394+0000 7fddb2200640 1 -- 172.21.15.152:0/1747301096 shutdown_connections 2024-04-17T08:47:04.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.394+0000 7fddb2200640 1 --2- 172.21.15.152:0/1747301096 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fddac0d0360 0x7fddac0d07b0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:04.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.394+0000 7fddb2200640 1 --2- 172.21.15.152:0/1747301096 >> v2:172.21.15.196:3300/0 conn(0x7fddac0af670 0x7fddac15b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:04.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.394+0000 7fddb2200640 1 -- 172.21.15.152:0/1747301096 >> 172.21.15.152:0/1747301096 conn(0x7fddac0b3350 msgr2=0x7fddac0b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:04.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.394+0000 7fddb2200640 1 -- 172.21.15.152:0/1747301096 shutdown_connections 2024-04-17T08:47:04.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.394+0000 7fddb2200640 1 -- 172.21.15.152:0/1747301096 wait complete. 2024-04-17T08:47:04.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.398+0000 7fddb2200640 1 Processor -- start 2024-04-17T08:47:04.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.398+0000 7fddb2200640 1 -- start start 2024-04-17T08:47:04.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.398+0000 7fddb2200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fddac06f980 0x7fddac155850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:04.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.398+0000 7fddb2200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fddac0af670 0x7fddac0998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:04.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.398+0000 7fddb2200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fddac0d0360 0x7fddac155f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:04.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.398+0000 7fddb2200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fddac15be00 con 0x7fddac0d0360 2024-04-17T08:47:04.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.398+0000 7fddb2200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fddac0afa50 con 0x7fddac0af670 2024-04-17T08:47:04.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.398+0000 7fddb2200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fddac15bf80 con 0x7fddac06f980 2024-04-17T08:47:04.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.398+0000 7fddabe00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fddac0d0360 0x7fddac155f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:04.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.398+0000 7fddabe00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fddac0d0360 0x7fddac155f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47042/0 (socket says 172.21.15.152:47042) 2024-04-17T08:47:04.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.398+0000 7fddabe00640 1 -- 172.21.15.152:0/651022866 learned_addr learned my addr 172.21.15.152:0/651022866 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:04.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.398+0000 7fddabe00640 1 -- 172.21.15.152:0/651022866 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fddac06f980 msgr2=0x7fddac155850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:04.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.398+0000 7fddabe00640 1 --2- 172.21.15.152:0/651022866 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fddac06f980 0x7fddac155850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:04.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.398+0000 7fddabe00640 1 -- 172.21.15.152:0/651022866 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fddac0af670 msgr2=0x7fddac0998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:04.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.398+0000 7fddabe00640 1 --2- 172.21.15.152:0/651022866 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fddac0af670 0x7fddac0998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:04.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.398+0000 7fddabe00640 1 -- 172.21.15.152:0/651022866 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddac156fa0 con 0x7fddac0d0360 2024-04-17T08:47:04.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.398+0000 7fddabe00640 1 --2- 172.21.15.152:0/651022866 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fddac0d0360 0x7fddac155f20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fdda40af040 tx=0x7fdda4019690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:04.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.398+0000 7fdda3400640 1 -- 172.21.15.152:0/651022866 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda40bc020 con 0x7fddac0d0360 2024-04-17T08:47:04.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.398+0000 7fdda3400640 1 -- 172.21.15.152:0/651022866 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdda40b8670 con 0x7fddac0d0360 2024-04-17T08:47:04.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.398+0000 7fdda3400640 1 -- 172.21.15.152:0/651022866 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda40b8a60 con 0x7fddac0d0360 2024-04-17T08:47:04.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.398+0000 7fddb2200640 1 -- 172.21.15.152:0/651022866 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddac147a60 con 0x7fddac0d0360 2024-04-17T08:47:04.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.398+0000 7fddb2200640 1 -- 172.21.15.152:0/651022866 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddac148020 con 0x7fddac0d0360 2024-04-17T08:47:04.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.398+0000 7fddb2200640 1 -- 172.21.15.152:0/651022866 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddac068a30 con 0x7fddac0d0360 2024-04-17T08:47:04.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.402+0000 7fdda3400640 1 -- 172.21.15.152:0/651022866 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdda40bf020 con 0x7fddac0d0360 2024-04-17T08:47:04.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.402+0000 7fdda3400640 1 --2- 172.21.15.152:0/651022866 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fdd8c0683b0 0x7fdd8c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:04.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.402+0000 7fdda3400640 1 -- 172.21.15.152:0/651022866 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fdda4121e00 con 0x7fddac0d0360 2024-04-17T08:47:04.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.402+0000 7fddab400640 1 --2- 172.21.15.152:0/651022866 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fdd8c0683b0 0x7fdd8c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:04.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.402+0000 7fddab400640 1 --2- 172.21.15.152:0/651022866 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fdd8c0683b0 0x7fdd8c06a870 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c0098f0 tx=0x7fdd9c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:04.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.406+0000 7fdda3400640 1 -- 172.21.15.152:0/651022866 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fdda40c6030 con 0x7fddac0d0360 2024-04-17T08:47:04.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.562+0000 7fddb2200640 1 -- 172.21.15.152:0/651022866 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fddac099df0 con 0x7fddac0d0360 2024-04-17T08:47:04.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.562+0000 7fdda3400640 1 -- 172.21.15.152:0/651022866 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7fdda40165a0 con 0x7fddac0d0360 2024-04-17T08:47:04.564 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 64 2024-04-17T08:47:04.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.566+0000 7fddb2200640 1 -- 172.21.15.152:0/651022866 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fdd8c0683b0 msgr2=0x7fdd8c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:04.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.566+0000 7fddb2200640 1 --2- 172.21.15.152:0/651022866 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fdd8c0683b0 0x7fdd8c06a870 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c0098f0 tx=0x7fdd9c008040 comp rx=0 tx=0).stop 2024-04-17T08:47:04.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.566+0000 7fddb2200640 1 -- 172.21.15.152:0/651022866 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fddac0d0360 msgr2=0x7fddac155f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:04.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.566+0000 7fddb2200640 1 --2- 172.21.15.152:0/651022866 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fddac0d0360 0x7fddac155f20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fdda40af040 tx=0x7fdda4019690 comp rx=0 tx=0).stop 2024-04-17T08:47:04.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.566+0000 7fddb2200640 1 -- 172.21.15.152:0/651022866 shutdown_connections 2024-04-17T08:47:04.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.566+0000 7fddb2200640 1 --2- 172.21.15.152:0/651022866 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fddac0d0360 0x7fddac155f20 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:04.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.566+0000 7fddb2200640 1 --2- 172.21.15.152:0/651022866 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fddac0af670 0x7fddac0998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:04.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.566+0000 7fddb2200640 1 --2- 172.21.15.152:0/651022866 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fdd8c0683b0 0x7fdd8c06a870 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:04.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.566+0000 7fddb2200640 1 --2- 172.21.15.152:0/651022866 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fddac06f980 0x7fddac155850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:04.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.566+0000 7fddb2200640 1 -- 172.21.15.152:0/651022866 >> 172.21.15.152:0/651022866 conn(0x7fddac0b3350 msgr2=0x7fddac15ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:04.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.566+0000 7fddb2200640 1 -- 172.21.15.152:0/651022866 shutdown_connections 2024-04-17T08:47:04.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.566+0000 7fddb2200640 1 -- 172.21.15.152:0/651022866 wait complete. 2024-04-17T08:47:04.586 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-17T08:47:04.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.722+0000 7f9198c00640 1 Processor -- start 2024-04-17T08:47:04.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.722+0000 7f9198c00640 1 -- start start 2024-04-17T08:47:04.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.722+0000 7f9198c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f919406f980 0x7f9194072530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:04.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.722+0000 7f9198c00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f919415bfd0 con 0x7f91940af670 2024-04-17T08:47:04.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.722+0000 7f9198c00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f919415c260 con 0x7f91940d0360 2024-04-17T08:47:04.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.722+0000 7f9198c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f919415c820 con 0x7f919406f980 2024-04-17T08:47:04.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.722+0000 7f9191e00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f91940af670 0x7f919415b8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:58506/0 (socket says 172.21.15.152:58506) 2024-04-17T08:47:04.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.722+0000 7f9191e00640 1 -- 172.21.15.152:0/445258110 learned_addr learned my addr 172.21.15.152:0/445258110 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:04.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.722+0000 7f9189400640 1 --2- 172.21.15.152:0/445258110 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f919406f980 0x7f9194072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:04.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.722+0000 7f9191400640 1 -- 172.21.15.152:0/445258110 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1729796558 0 0) 0x7f919415bfd0 con 0x7f91940af670 2024-04-17T08:47:04.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.722+0000 7f9191400640 1 -- 172.21.15.152:0/445258110 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9178003530 con 0x7f91940af670 2024-04-17T08:47:04.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.722+0000 7f9191400640 1 -- 172.21.15.152:0/445258110 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3622400605 0 0) 0x7f9178003530 con 0x7f91940af670 2024-04-17T08:47:04.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.722+0000 7f9191400640 1 -- 172.21.15.152:0/445258110 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f919406f980 msgr2=0x7f9194072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:04.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.722+0000 7f9191400640 1 --2- 172.21.15.152:0/445258110 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f919406f980 0x7f9194072530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:04.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.722+0000 7f9191400640 1 -- 172.21.15.152:0/445258110 >> v1:172.21.15.196:6789/0 conn(0x7f91940d0360 legacy=0x7f919406dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:04.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.722+0000 7f9191400640 1 -- 172.21.15.152:0/445258110 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f919415c540 con 0x7f91940af670 2024-04-17T08:47:04.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.722+0000 7f9191400640 1 -- 172.21.15.152:0/445258110 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2973887244 0 0) 0x7f9184001680 con 0x7f91940af670 2024-04-17T08:47:04.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.722+0000 7f9191400640 1 -- 172.21.15.152:0/445258110 >> v1:172.21.15.152:6789/0 conn(0x7f91940af670 legacy=0x7f919415b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:04.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.722+0000 7f9191400640 1 --2- 172.21.15.152:0/445258110 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f919406f980 0x7f91780039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:04.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.722+0000 7f9191400640 1 --2- 172.21.15.152:0/445258110 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9178003fc0 0x7f9178004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:04.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.726+0000 7f9191400640 1 --2- 172.21.15.152:0/445258110 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9178004d50 0x7f91780051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:04.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.726+0000 7f9191400640 1 -- 172.21.15.152:0/445258110 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f919415c820 con 0x7f9178004d50 2024-04-17T08:47:04.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.726+0000 7f9191400640 1 -- 172.21.15.152:0/445258110 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f917800bbc0 con 0x7f9178003fc0 2024-04-17T08:47:04.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.726+0000 7f9191400640 1 -- 172.21.15.152:0/445258110 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f917800dfd0 con 0x7f919406f980 2024-04-17T08:47:04.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.726+0000 7f9189400640 1 --2- 172.21.15.152:0/445258110 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9178003fc0 0x7f9178004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:04.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.726+0000 7f9192800640 1 --2- 172.21.15.152:0/445258110 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9178004d50 0x7f91780051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:04.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.726+0000 7f9191e00640 1 --2- 172.21.15.152:0/445258110 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f919406f980 0x7f91780039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:04.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.726+0000 7f9192800640 1 -- 172.21.15.152:0/445258110 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f919406f980 msgr2=0x7f91780039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:04.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.726+0000 7f9192800640 1 --2- 172.21.15.152:0/445258110 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f919406f980 0x7f91780039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:04.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.726+0000 7f9192800640 1 -- 172.21.15.152:0/445258110 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9178003fc0 msgr2=0x7f9178004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:04.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.726+0000 7f9192800640 1 --2- 172.21.15.152:0/445258110 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9178003fc0 0x7f9178004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:04.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.726+0000 7f9192800640 1 -- 172.21.15.152:0/445258110 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9178003530 con 0x7f9178004d50 2024-04-17T08:47:04.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.726+0000 7f9192800640 1 --2- 172.21.15.152:0/445258110 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9178004d50 0x7f91780051d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f918c001e70 tx=0x7f918c01c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c243fcd4720ae909 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:04.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.726+0000 7f9191400640 1 -- 172.21.15.152:0/445258110 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918c001a90 con 0x7f9178004d50 2024-04-17T08:47:04.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.726+0000 7f9191400640 1 -- 172.21.15.152:0/445258110 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f918c003b80 con 0x7f9178004d50 2024-04-17T08:47:04.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.726+0000 7f9191400640 1 -- 172.21.15.152:0/445258110 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9184007e60 con 0x7f9178004d50 2024-04-17T08:47:04.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.730+0000 7f9198c00640 1 -- 172.21.15.152:0/445258110 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9178004d50 msgr2=0x7f91780051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:04.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.730+0000 7f9198c00640 1 --2- 172.21.15.152:0/445258110 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9178004d50 0x7f91780051d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f918c001e70 tx=0x7f918c01c780 comp rx=0 tx=0).stop 2024-04-17T08:47:04.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.730+0000 7f9192800640 1 -- 172.21.15.152:0/445258110 reap_dead start 2024-04-17T08:47:04.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.730+0000 7f9198c00640 1 -- 172.21.15.152:0/445258110 shutdown_connections 2024-04-17T08:47:04.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.730+0000 7f9198c00640 1 -- 172.21.15.152:0/445258110 >> 172.21.15.152:0/445258110 conn(0x7f91940b3350 msgr2=0x7f91940b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:04.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.730+0000 7f9198c00640 1 -- 172.21.15.152:0/445258110 shutdown_connections 2024-04-17T08:47:04.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.730+0000 7f9198c00640 1 -- 172.21.15.152:0/445258110 wait complete. 2024-04-17T08:47:04.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.730+0000 7f9198c00640 1 Processor -- start 2024-04-17T08:47:04.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.730+0000 7f9198c00640 1 -- start start 2024-04-17T08:47:04.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.730+0000 7f9198c00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9178004d50 0x7f919415af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:04.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.730+0000 7f9198c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f91940cb510 0x7f91941f4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:04.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.730+0000 7f9198c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f919414b190 0x7f91940c9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:04.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.730+0000 7f9198c00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f91940afa50 con 0x7f9178004d50 2024-04-17T08:47:04.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.730+0000 7f9198c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f9194072010 con 0x7f91940cb510 2024-04-17T08:47:04.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.730+0000 7f9198c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f919406e370 con 0x7f919414b190 2024-04-17T08:47:04.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.730+0000 7f9191e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9178004d50 0x7f919415af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:04.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.730+0000 7f9191e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9178004d50 0x7f919415af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47064/0 (socket says 172.21.15.152:47064) 2024-04-17T08:47:04.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.730+0000 7f9191e00640 1 -- 172.21.15.152:0/333484677 learned_addr learned my addr 172.21.15.152:0/333484677 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:04.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.730+0000 7f9191e00640 1 -- 172.21.15.152:0/333484677 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f919414b190 msgr2=0x7f91940c9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:04.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.730+0000 7f9192800640 1 --2- 172.21.15.152:0/333484677 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f919414b190 0x7f91940c9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:04.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.730+0000 7f9189400640 1 --2- 172.21.15.152:0/333484677 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f91940cb510 0x7f91941f4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:04.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.730+0000 7f9191e00640 1 --2- 172.21.15.152:0/333484677 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f919414b190 0x7f91940c9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:04.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.730+0000 7f9191e00640 1 -- 172.21.15.152:0/333484677 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f91940cb510 msgr2=0x7f91941f4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:04.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.730+0000 7f9191e00640 1 --2- 172.21.15.152:0/333484677 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f91940cb510 0x7f91941f4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:04.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.730+0000 7f9191e00640 1 -- 172.21.15.152:0/333484677 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f919415a4d0 con 0x7f9178004d50 2024-04-17T08:47:04.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.730+0000 7f9192800640 1 --2- 172.21.15.152:0/333484677 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f919414b190 0x7f91940c9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:47:04.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.730+0000 7f9189400640 1 --2- 172.21.15.152:0/333484677 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f91940cb510 0x7f91941f4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:47:04.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.734+0000 7f9191e00640 1 --2- 172.21.15.152:0/333484677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9178004d50 0x7f919415af70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f91840017f0 tx=0x7f9184012920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:04.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.734+0000 7f918aa00640 1 -- 172.21.15.152:0/333484677 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918401c070 con 0x7f9178004d50 2024-04-17T08:47:04.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.734+0000 7f918aa00640 1 -- 172.21.15.152:0/333484677 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9184014810 con 0x7f9178004d50 2024-04-17T08:47:04.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.734+0000 7f918aa00640 1 -- 172.21.15.152:0/333484677 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9184014be0 con 0x7f9178004d50 2024-04-17T08:47:04.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.734+0000 7f9198c00640 1 -- 172.21.15.152:0/333484677 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91940cba80 con 0x7f9178004d50 2024-04-17T08:47:04.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.734+0000 7f9198c00640 1 -- 172.21.15.152:0/333484677 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f919415a790 con 0x7f9178004d50 2024-04-17T08:47:04.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.734+0000 7f9198c00640 1 -- 172.21.15.152:0/333484677 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9194068a30 con 0x7f9178004d50 2024-04-17T08:47:04.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.734+0000 7f918aa00640 1 -- 172.21.15.152:0/333484677 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f91840153e0 con 0x7f9178004d50 2024-04-17T08:47:04.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.734+0000 7f918aa00640 1 --2- 172.21.15.152:0/333484677 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f91700683b0 0x7f917006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:04.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.734+0000 7f918aa00640 1 -- 172.21.15.152:0/333484677 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9184089640 con 0x7f9178004d50 2024-04-17T08:47:04.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.734+0000 7f9189400640 1 --2- 172.21.15.152:0/333484677 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f91700683b0 0x7f917006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:04.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.738+0000 7f9189400640 1 --2- 172.21.15.152:0/333484677 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f91700683b0 0x7f917006a870 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f91940b3de0 tx=0x7f917c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:04.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.738+0000 7f918aa00640 1 -- 172.21.15.152:0/333484677 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f91840598b0 con 0x7f9178004d50 2024-04-17T08:47:04.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.898+0000 7f9198c00640 1 -- 172.21.15.152:0/333484677 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f9194154b80 con 0x7f9178004d50 2024-04-17T08:47:04.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.898+0000 7f918aa00640 1 -- 172.21.15.152:0/333484677 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) ==== 103+0+11 (secure 0 0 0) 0x7f91840591b0 con 0x7f9178004d50 2024-04-17T08:47:04.899 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-04-17T08:47:04.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.898+0000 7f9198c00640 1 -- 172.21.15.152:0/333484677 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f91700683b0 msgr2=0x7f917006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:04.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.898+0000 7f9198c00640 1 --2- 172.21.15.152:0/333484677 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f91700683b0 0x7f917006a870 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f91940b3de0 tx=0x7f917c008040 comp rx=0 tx=0).stop 2024-04-17T08:47:04.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.898+0000 7f9198c00640 1 -- 172.21.15.152:0/333484677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9178004d50 msgr2=0x7f919415af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:04.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.898+0000 7f9198c00640 1 --2- 172.21.15.152:0/333484677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9178004d50 0x7f919415af70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f91840017f0 tx=0x7f9184012920 comp rx=0 tx=0).stop 2024-04-17T08:47:04.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.898+0000 7f9198c00640 1 -- 172.21.15.152:0/333484677 shutdown_connections 2024-04-17T08:47:04.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.898+0000 7f9198c00640 1 --2- 172.21.15.152:0/333484677 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f91700683b0 0x7f917006a870 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:04.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.898+0000 7f9198c00640 1 --2- 172.21.15.152:0/333484677 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f919414b190 0x7f91940c9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:04.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.898+0000 7f9198c00640 1 --2- 172.21.15.152:0/333484677 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f91940cb510 0x7f91941f4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:04.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.898+0000 7f9198c00640 1 --2- 172.21.15.152:0/333484677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9178004d50 0x7f919415af70 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:04.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.898+0000 7f9198c00640 1 -- 172.21.15.152:0/333484677 >> 172.21.15.152:0/333484677 conn(0x7f91940b3350 msgr2=0x7f9194072530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:04.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.898+0000 7f9198c00640 1 -- 172.21.15.152:0/333484677 shutdown_connections 2024-04-17T08:47:04.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:04.898+0000 7f9198c00640 1 -- 172.21.15.152:0/333484677 wait complete. 2024-04-17T08:47:04.921 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T08:47:05.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.054+0000 7f39c1a00640 1 Processor -- start 2024-04-17T08:47:05.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.054+0000 7f39c1a00640 1 -- start start 2024-04-17T08:47:05.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.054+0000 7f39c1a00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f39bc0d0360 0x7f39bc0d07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:05.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.054+0000 7f39c1a00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39bc15bfd0 con 0x7f39bc0af670 2024-04-17T08:47:05.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.054+0000 7f39c1a00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39bc072c40 con 0x7f39bc06f980 2024-04-17T08:47:05.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.054+0000 7f39c1a00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f39bc0d0cf0 con 0x7f39bc0d0360 2024-04-17T08:47:05.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.054+0000 7f39bb400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f39bc0d0360 0x7f39bc0d07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:05.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.054+0000 7f39baa00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f39bc0af670 0x7f39bc15b8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:58522/0 (socket says 172.21.15.152:58522) 2024-04-17T08:47:05.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.054+0000 7f39bb400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f39bc0d0360 0x7f39bc0d07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47074/0 (socket says 172.21.15.152:47074) 2024-04-17T08:47:05.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.054+0000 7f39baa00640 1 -- 172.21.15.152:0/1675327617 learned_addr learned my addr 172.21.15.152:0/1675327617 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:05.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.058+0000 7f39bb400640 1 -- 172.21.15.152:0/1675327617 >> v1:172.21.15.196:6789/0 conn(0x7f39bc06f980 legacy=0x7f39bc072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:05.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.058+0000 7f39bb400640 1 -- 172.21.15.152:0/1675327617 >> v1:172.21.15.152:6789/0 conn(0x7f39bc0af670 legacy=0x7f39bc15b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:05.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.058+0000 7f39bb400640 1 -- 172.21.15.152:0/1675327617 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39bc15c260 con 0x7f39bc0d0360 2024-04-17T08:47:05.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.058+0000 7f39bb400640 1 --2- 172.21.15.152:0/1675327617 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39bc0d0360 0x7f39bc0d07b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f39b40097c0 tx=0x7f39b401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a648216af9fccc9 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:05.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.058+0000 7f39ba000640 1 -- 172.21.15.152:0/1675327617 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b40b0070 con 0x7f39bc0d0360 2024-04-17T08:47:05.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.058+0000 7f39ba000640 1 -- 172.21.15.152:0/1675327617 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39b40ab600 con 0x7f39bc0d0360 2024-04-17T08:47:05.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.058+0000 7f39ba000640 1 -- 172.21.15.152:0/1675327617 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b40ab9d0 con 0x7f39bc0d0360 2024-04-17T08:47:05.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.058+0000 7f39c1a00640 1 -- 172.21.15.152:0/1675327617 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39bc0d0360 msgr2=0x7f39bc0d07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:05.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.058+0000 7f39c1a00640 1 --2- 172.21.15.152:0/1675327617 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39bc0d0360 0x7f39bc0d07b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f39b40097c0 tx=0x7f39b401c3d0 comp rx=0 tx=0).stop 2024-04-17T08:47:05.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.058+0000 7f39c1a00640 1 -- 172.21.15.152:0/1675327617 shutdown_connections 2024-04-17T08:47:05.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.058+0000 7f39c1a00640 1 --2- 172.21.15.152:0/1675327617 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39bc0d0360 0x7f39bc0d07b0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:05.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.058+0000 7f39c1a00640 1 -- 172.21.15.152:0/1675327617 >> 172.21.15.152:0/1675327617 conn(0x7f39bc0b3350 msgr2=0x7f39bc0b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:05.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.062+0000 7f39c1a00640 1 -- 172.21.15.152:0/1675327617 shutdown_connections 2024-04-17T08:47:05.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.062+0000 7f39c1a00640 1 -- 172.21.15.152:0/1675327617 wait complete. 2024-04-17T08:47:05.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.062+0000 7f39c1a00640 1 Processor -- start 2024-04-17T08:47:05.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.062+0000 7f39c1a00640 1 -- start start 2024-04-17T08:47:05.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.062+0000 7f39c1a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f39bc06f980 0x7f39bc148180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:05.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.062+0000 7f39c1a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39bc0af670 0x7f39bc15ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:05.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.062+0000 7f39c1a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f39bc0d0360 0x7f39bc15cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:05.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.062+0000 7f39c1a00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f39bc169060 con 0x7f39bc0af670 2024-04-17T08:47:05.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.062+0000 7f39c1a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f39bc0afa50 con 0x7f39bc06f980 2024-04-17T08:47:05.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.062+0000 7f39c1a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f39bc1691e0 con 0x7f39bc0d0360 2024-04-17T08:47:05.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.062+0000 7f39b2000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39bc0af670 0x7f39bc15ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:05.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.062+0000 7f39b2000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39bc0af670 0x7f39bc15ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47084/0 (socket says 172.21.15.152:47084) 2024-04-17T08:47:05.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.062+0000 7f39b2000640 1 -- 172.21.15.152:0/2822462634 learned_addr learned my addr 172.21.15.152:0/2822462634 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:05.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.062+0000 7f39baa00640 1 --2- 172.21.15.152:0/2822462634 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f39bc06f980 0x7f39bc148180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:05.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.062+0000 7f39bb400640 1 --2- 172.21.15.152:0/2822462634 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f39bc0d0360 0x7f39bc15cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:05.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.062+0000 7f39b2000640 1 -- 172.21.15.152:0/2822462634 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f39bc0d0360 msgr2=0x7f39bc15cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:05.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.062+0000 7f39b2000640 1 --2- 172.21.15.152:0/2822462634 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f39bc0d0360 0x7f39bc15cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:05.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.062+0000 7f39b2000640 1 -- 172.21.15.152:0/2822462634 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f39bc06f980 msgr2=0x7f39bc148180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:05.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.062+0000 7f39b2000640 1 --2- 172.21.15.152:0/2822462634 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f39bc06f980 0x7f39bc148180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:05.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.062+0000 7f39b2000640 1 -- 172.21.15.152:0/2822462634 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39bc1486c0 con 0x7f39bc0af670 2024-04-17T08:47:05.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.062+0000 7f39b2000640 1 --2- 172.21.15.152:0/2822462634 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39bc0af670 0x7f39bc15ca20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f39a400c410 tx=0x7f39a400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:05.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.062+0000 7f39b3400640 1 -- 172.21.15.152:0/2822462634 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a4011790 con 0x7f39bc0af670 2024-04-17T08:47:05.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.062+0000 7f39b3400640 1 -- 172.21.15.152:0/2822462634 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39a4017070 con 0x7f39bc0af670 2024-04-17T08:47:05.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.062+0000 7f39c1a00640 1 -- 172.21.15.152:0/2822462634 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39bc149530 con 0x7f39bc0af670 2024-04-17T08:47:05.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.062+0000 7f39b3400640 1 -- 172.21.15.152:0/2822462634 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a4011bb0 con 0x7f39bc0af670 2024-04-17T08:47:05.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.066+0000 7f39c1a00640 1 -- 172.21.15.152:0/2822462634 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39bc0afd70 con 0x7f39bc0af670 2024-04-17T08:47:05.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.066+0000 7f39c1a00640 1 -- 172.21.15.152:0/2822462634 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39bc068a30 con 0x7f39bc0af670 2024-04-17T08:47:05.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.066+0000 7f39b3400640 1 -- 172.21.15.152:0/2822462634 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f39a401c460 con 0x7f39bc0af670 2024-04-17T08:47:05.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.066+0000 7f39b3400640 1 --2- 172.21.15.152:0/2822462634 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3998068380 0x7f399806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:05.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.066+0000 7f39b3400640 1 -- 172.21.15.152:0/2822462634 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f39a4086830 con 0x7f39bc0af670 2024-04-17T08:47:05.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.066+0000 7f39baa00640 1 --2- 172.21.15.152:0/2822462634 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3998068380 0x7f399806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:05.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.066+0000 7f39baa00640 1 --2- 172.21.15.152:0/2822462634 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3998068380 0x7f399806a840 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f39bc09dc60 tx=0x7f39ac001a40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:05.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.070+0000 7f39b3400640 1 -- 172.21.15.152:0/2822462634 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f39a4021020 con 0x7f39bc0af670 2024-04-17T08:47:05.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.262+0000 7f39c1a00640 1 -- 172.21.15.152:0/2822462634 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f39bc15b2a0 con 0x7f39bc0af670 2024-04-17T08:47:05.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.266+0000 7f39b3400640 1 -- 172.21.15.152:0/2822462634 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5207 (secure 0 0 0) 0x7f39a4056450 con 0x7f39bc0af670 2024-04-17T08:47:05.266 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:47:05.266 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6834/2461981726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":2461981726},{"type":"v1","addr":"172.21.15.196:6834","nonce":2461981726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6835/3397289430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6833","nonce":3397289430},{"type":"v1","addr":"172.21.15.196:6835","nonce":3397289430}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/2491486613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2491486613},{"type":"v1","addr":"172.21.15.152:6836","nonce":2491486613}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-17T08:46:33.607720+0000","modified":"2024-04-17T08:46:57.830153+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6837/3890159871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":3890159871},{"type":"v1","addr":"172.21.15.152:6837","nonce":3890159871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-04-17T08:47:05.267 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 9 2024-04-17T08:47:05.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.266+0000 7f39c1a00640 1 -- 172.21.15.152:0/2822462634 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3998068380 msgr2=0x7f399806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:05.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.266+0000 7f39c1a00640 1 --2- 172.21.15.152:0/2822462634 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3998068380 0x7f399806a840 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f39bc09dc60 tx=0x7f39ac001a40 comp rx=0 tx=0).stop 2024-04-17T08:47:05.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.266+0000 7f39c1a00640 1 -- 172.21.15.152:0/2822462634 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39bc0af670 msgr2=0x7f39bc15ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:05.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.266+0000 7f39c1a00640 1 --2- 172.21.15.152:0/2822462634 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39bc0af670 0x7f39bc15ca20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f39a400c410 tx=0x7f39a400c8d0 comp rx=0 tx=0).stop 2024-04-17T08:47:05.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.266+0000 7f39c1a00640 1 -- 172.21.15.152:0/2822462634 shutdown_connections 2024-04-17T08:47:05.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.266+0000 7f39c1a00640 1 --2- 172.21.15.152:0/2822462634 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3998068380 0x7f399806a840 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:05.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.266+0000 7f39c1a00640 1 --2- 172.21.15.152:0/2822462634 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f39bc0d0360 0x7f39bc15cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:05.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.266+0000 7f39c1a00640 1 --2- 172.21.15.152:0/2822462634 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39bc0af670 0x7f39bc15ca20 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:05.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.266+0000 7f39c1a00640 1 --2- 172.21.15.152:0/2822462634 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f39bc06f980 0x7f39bc148180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:05.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.266+0000 7f39c1a00640 1 -- 172.21.15.152:0/2822462634 >> 172.21.15.152:0/2822462634 conn(0x7f39bc0b3350 msgr2=0x7f39bc1587a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:05.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.266+0000 7f39c1a00640 1 -- 172.21.15.152:0/2822462634 shutdown_connections 2024-04-17T08:47:05.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.266+0000 7f39c1a00640 1 -- 172.21.15.152:0/2822462634 wait complete. 2024-04-17T08:47:05.287 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T08:47:05.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.422+0000 7f0e31a00640 1 Processor -- start 2024-04-17T08:47:05.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.422+0000 7f0e31a00640 1 -- start start 2024-04-17T08:47:05.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.422+0000 7f0e31a00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f0e2c148190 0x7f0e2c0b3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:05.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.422+0000 7f0e31a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0e2c0b4e50 0x7f0e2c06e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:05.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.422+0000 7f0e31a00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e2c0aebe0 con 0x7f0e2c0b52e0 2024-04-17T08:47:05.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.422+0000 7f0e31a00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f0e2c148570 con 0x7f0e2c148190 2024-04-17T08:47:05.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.422+0000 7f0e31a00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f0e2c06bae0 con 0x7f0e2c0b4e50 2024-04-17T08:47:05.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.422+0000 7f0e2aa00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f0e2c148190 0x7f0e2c0b3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:05.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.422+0000 7f0e2a000640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f0e2c0b52e0 0x7f0e2c0b4740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:58538/0 (socket says 172.21.15.152:58538) 2024-04-17T08:47:05.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.422+0000 7f0e2a000640 1 -- 172.21.15.152:0/2251465884 learned_addr learned my addr 172.21.15.152:0/2251465884 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:05.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.422+0000 7f0e2b400640 1 --2- 172.21.15.152:0/2251465884 >> v2:172.21.15.196:3300/0 conn(0x7f0e2c0b4e50 0x7f0e2c06e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:05.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.422+0000 7f0e2aa00640 1 -- 172.21.15.152:0/2251465884 >> v2:172.21.15.196:3300/0 conn(0x7f0e2c0b4e50 msgr2=0x7f0e2c06e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:05.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.422+0000 7f0e2aa00640 1 --2- 172.21.15.152:0/2251465884 >> v2:172.21.15.196:3300/0 conn(0x7f0e2c0b4e50 0x7f0e2c06e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:05.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.422+0000 7f0e2aa00640 1 -- 172.21.15.152:0/2251465884 >> v1:172.21.15.152:6789/0 conn(0x7f0e2c0b52e0 legacy=0x7f0e2c0b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:05.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.422+0000 7f0e2aa00640 1 -- 172.21.15.152:0/2251465884 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e2c06bdc0 con 0x7f0e2c148190 2024-04-17T08:47:05.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.426+0000 7f0e2aa00640 1 --2- 172.21.15.152:0/2251465884 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e2c148190 0x7f0e2c0b3d70 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c0b42b0 tx=0x7f0e1c01c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3b69aa623ef0fa3 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:05.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.426+0000 7f0e29600640 1 -- 172.21.15.152:0/2251465884 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c0b0070 con 0x7f0e2c148190 2024-04-17T08:47:05.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.426+0000 7f0e29600640 1 -- 172.21.15.152:0/2251465884 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e1c0ab600 con 0x7f0e2c148190 2024-04-17T08:47:05.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.426+0000 7f0e29600640 1 -- 172.21.15.152:0/2251465884 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c0ab9d0 con 0x7f0e2c148190 2024-04-17T08:47:05.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.426+0000 7f0e31a00640 1 -- 172.21.15.152:0/2251465884 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e2c148190 msgr2=0x7f0e2c0b3d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:05.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.426+0000 7f0e31a00640 1 --2- 172.21.15.152:0/2251465884 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e2c148190 0x7f0e2c0b3d70 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c0b42b0 tx=0x7f0e1c01c360 comp rx=0 tx=0).stop 2024-04-17T08:47:05.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.426+0000 7f0e31a00640 1 -- 172.21.15.152:0/2251465884 shutdown_connections 2024-04-17T08:47:05.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.426+0000 7f0e31a00640 1 --2- 172.21.15.152:0/2251465884 >> v2:172.21.15.196:3300/0 conn(0x7f0e2c0b4e50 0x7f0e2c06e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:05.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.426+0000 7f0e31a00640 1 --2- 172.21.15.152:0/2251465884 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e2c148190 0x7f0e2c0b3d70 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:05.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.426+0000 7f0e31a00640 1 -- 172.21.15.152:0/2251465884 >> 172.21.15.152:0/2251465884 conn(0x7f0e2c0d0570 msgr2=0x7f0e2c0d0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:05.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.426+0000 7f0e31a00640 1 -- 172.21.15.152:0/2251465884 shutdown_connections 2024-04-17T08:47:05.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.426+0000 7f0e31a00640 1 -- 172.21.15.152:0/2251465884 wait complete. 2024-04-17T08:47:05.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.430+0000 7f0e31a00640 1 Processor -- start 2024-04-17T08:47:05.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.430+0000 7f0e31a00640 1 -- start start 2024-04-17T08:47:05.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.430+0000 7f0e31a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e2c0b4e50 0x7f0e2c13fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:05.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.430+0000 7f0e31a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e2c0b52e0 0x7f0e2c140d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:05.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.430+0000 7f0e31a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e2c148190 0x7f0e2c141290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:05.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.430+0000 7f0e31a00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0e2c06cf50 con 0x7f0e2c148190 2024-04-17T08:47:05.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.430+0000 7f0e31a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0e2c06cdd0 con 0x7f0e2c0b4e50 2024-04-17T08:47:05.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.430+0000 7f0e31a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f0e2c06d0d0 con 0x7f0e2c0b52e0 2024-04-17T08:47:05.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.430+0000 7f0e2b400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e2c148190 0x7f0e2c141290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:05.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.430+0000 7f0e2b400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e2c148190 0x7f0e2c141290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47104/0 (socket says 172.21.15.152:47104) 2024-04-17T08:47:05.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.430+0000 7f0e2b400640 1 -- 172.21.15.152:0/2485311547 learned_addr learned my addr 172.21.15.152:0/2485311547 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:05.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.430+0000 7f0e2aa00640 1 --2- 172.21.15.152:0/2485311547 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e2c0b4e50 0x7f0e2c13fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:05.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.430+0000 7f0e2a000640 1 --2- 172.21.15.152:0/2485311547 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e2c0b52e0 0x7f0e2c140d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:05.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.430+0000 7f0e2b400640 1 -- 172.21.15.152:0/2485311547 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e2c0b52e0 msgr2=0x7f0e2c140d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:05.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.430+0000 7f0e2b400640 1 --2- 172.21.15.152:0/2485311547 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e2c0b52e0 0x7f0e2c140d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:05.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.430+0000 7f0e2b400640 1 -- 172.21.15.152:0/2485311547 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e2c0b4e50 msgr2=0x7f0e2c13fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:05.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.430+0000 7f0e2b400640 1 --2- 172.21.15.152:0/2485311547 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e2c0b4e50 0x7f0e2c13fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:05.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.430+0000 7f0e2b400640 1 -- 172.21.15.152:0/2485311547 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e2c1637d0 con 0x7f0e2c148190 2024-04-17T08:47:05.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.430+0000 7f0e2b400640 1 --2- 172.21.15.152:0/2485311547 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e2c148190 0x7f0e2c141290 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0e24007e40 tx=0x7f0e2400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:05.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.430+0000 7f0e22a00640 1 -- 172.21.15.152:0/2485311547 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e24014620 con 0x7f0e2c148190 2024-04-17T08:47:05.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.430+0000 7f0e22a00640 1 -- 172.21.15.152:0/2485311547 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e24019070 con 0x7f0e2c148190 2024-04-17T08:47:05.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.430+0000 7f0e22a00640 1 -- 172.21.15.152:0/2485311547 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e24014a20 con 0x7f0e2c148190 2024-04-17T08:47:05.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.430+0000 7f0e31a00640 1 -- 172.21.15.152:0/2485311547 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e2c163ab0 con 0x7f0e2c148190 2024-04-17T08:47:05.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.430+0000 7f0e31a00640 1 -- 172.21.15.152:0/2485311547 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e2c164070 con 0x7f0e2c148190 2024-04-17T08:47:05.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.434+0000 7f0e31a00640 1 -- 172.21.15.152:0/2485311547 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e2c168160 con 0x7f0e2c148190 2024-04-17T08:47:05.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.434+0000 7f0e22a00640 1 -- 172.21.15.152:0/2485311547 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0e24014bc0 con 0x7f0e2c148190 2024-04-17T08:47:05.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.434+0000 7f0e22a00640 1 --2- 172.21.15.152:0/2485311547 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0e0c068380 0x7f0e0c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:05.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.434+0000 7f0e22a00640 1 -- 172.21.15.152:0/2485311547 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0e24087550 con 0x7f0e2c148190 2024-04-17T08:47:05.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.434+0000 7f0e2aa00640 1 --2- 172.21.15.152:0/2485311547 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0e0c068380 0x7f0e0c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:05.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.434+0000 7f0e2aa00640 1 --2- 172.21.15.152:0/2485311547 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0e0c068380 0x7f0e0c06a840 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c0ad000 tx=0x7f0e1c0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:05.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.438+0000 7f0e22a00640 1 -- 172.21.15.152:0/2485311547 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f0e2c168160 con 0x7f0e2c148190 2024-04-17T08:47:05.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.598+0000 7f0e31a00640 1 -- 172.21.15.152:0/2485311547 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0e2c140070 con 0x7f0e2c148190 2024-04-17T08:47:05.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.598+0000 7f0e22a00640 1 -- 172.21.15.152:0/2485311547 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7f0e240570e0 con 0x7f0e2c148190 2024-04-17T08:47:05.600 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:47:05.600 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":24,"fsid":"ce68f82e-ec5f-4205-9fd5-bdfdf6ef31e2","created":"2024-04-17T08:46:08.353546+0000","modified":"2024-04-17T08:46:38.659862+0000","last_up_change":"2024-04-17T08:46:20.738799+0000","last_in_change":"2024-04-17T08:46:11.210050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T08:46:21.386856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T08:46:31.812460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T08:46:32.555559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T08:46:36.258078+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"682f0192-187c-404e-bc7a-b6b4e23825e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6819","nonce":3603799291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6823","nonce":3603799291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6831","nonce":3603799291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6827","nonce":3603799291}]},"public_addr":"172.21.15.152:6819/3603799291","cluster_addr":"172.21.15.152:6823/3603799291","heartbeat_back_addr":"172.21.15.152:6831/3603799291","heartbeat_front_addr":"172.21.15.152:6827/3603799291","state":["exists","up"]},{"osd":1,"uuid":"f0fe8fef-60ec-4a39-83b6-2fa6a5adb0f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6801","nonce":4133383142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6803","nonce":4133383142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6807","nonce":4133383142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6805","nonce":4133383142}]},"public_addr":"172.21.15.152:6801/4133383142","cluster_addr":"172.21.15.152:6803/4133383142","heartbeat_back_addr":"172.21.15.152:6807/4133383142","heartbeat_front_addr":"172.21.15.152:6805/4133383142","state":["exists","up"]},{"osd":2,"uuid":"35f36d9c-5245-4431-a618-f4df0fa380ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6809","nonce":3826143898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6811","nonce":3826143898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6815","nonce":3826143898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6813","nonce":3826143898}]},"public_addr":"172.21.15.152:6809/3826143898","cluster_addr":"172.21.15.152:6811/3826143898","heartbeat_back_addr":"172.21.15.152:6815/3826143898","heartbeat_front_addr":"172.21.15.152:6813/3826143898","state":["exists","up"]},{"osd":3,"uuid":"96e56ca5-15b4-4895-9b79-da2c92043159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6818","nonce":165717826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6822","nonce":165717826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6830","nonce":165717826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6826","nonce":165717826}]},"public_addr":"172.21.15.152:6818/165717826","cluster_addr":"172.21.15.152:6822/165717826","heartbeat_back_addr":"172.21.15.152:6830/165717826","heartbeat_front_addr":"172.21.15.152:6826/165717826","state":["exists","up"]},{"osd":4,"uuid":"f5aa10a4-9ff9-41fe-a5c9-15326f982cc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6817","nonce":4080159297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6819","nonce":4080159297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6823","nonce":4080159297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6821","nonce":4080159297}]},"public_addr":"172.21.15.196:6817/4080159297","cluster_addr":"172.21.15.196:6819/4080159297","heartbeat_back_addr":"172.21.15.196:6823/4080159297","heartbeat_front_addr":"172.21.15.196:6821/4080159297","state":["exists","up"]},{"osd":5,"uuid":"42bab884-3476-47ae-ac65-935fa6e0f055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6801","nonce":3519444232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6803","nonce":3519444232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6807","nonce":3519444232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6805","nonce":3519444232}]},"public_addr":"172.21.15.196:6801/3519444232","cluster_addr":"172.21.15.196:6803/3519444232","heartbeat_back_addr":"172.21.15.196:6807/3519444232","heartbeat_front_addr":"172.21.15.196:6805/3519444232","state":["exists","up"]},{"osd":6,"uuid":"460b6167-f57b-4224-9c92-cfc9b80bbe99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6809","nonce":275739834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6811","nonce":275739834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6815","nonce":275739834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6813","nonce":275739834}]},"public_addr":"172.21.15.196:6809/275739834","cluster_addr":"172.21.15.196:6811/275739834","heartbeat_back_addr":"172.21.15.196:6815/275739834","heartbeat_front_addr":"172.21.15.196:6813/275739834","state":["exists","up"]},{"osd":7,"uuid":"d695643f-5e07-4e2a-a646-c06bd97b6650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6825","nonce":307626968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6827","nonce":307626968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6831","nonce":307626968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6829","nonce":307626968}]},"public_addr":"172.21.15.196:6825/307626968","cluster_addr":"172.21.15.196:6827/307626968","heartbeat_back_addr":"172.21.15.196:6831/307626968","heartbeat_front_addr":"172.21.15.196:6829/307626968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.293257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.964533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.248895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.010000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.832554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.743704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930171+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930962+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T08:47:05.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.598+0000 7f0e31a00640 1 -- 172.21.15.152:0/2485311547 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0e0c068380 msgr2=0x7f0e0c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:05.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.598+0000 7f0e31a00640 1 --2- 172.21.15.152:0/2485311547 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0e0c068380 0x7f0e0c06a840 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c0ad000 tx=0x7f0e1c0a6000 comp rx=0 tx=0).stop 2024-04-17T08:47:05.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.602+0000 7f0e31a00640 1 -- 172.21.15.152:0/2485311547 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e2c148190 msgr2=0x7f0e2c141290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:05.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.602+0000 7f0e31a00640 1 --2- 172.21.15.152:0/2485311547 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e2c148190 0x7f0e2c141290 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0e24007e40 tx=0x7f0e2400e4b0 comp rx=0 tx=0).stop 2024-04-17T08:47:05.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.602+0000 7f0e31a00640 1 -- 172.21.15.152:0/2485311547 shutdown_connections 2024-04-17T08:47:05.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.602+0000 7f0e31a00640 1 --2- 172.21.15.152:0/2485311547 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e2c148190 0x7f0e2c141290 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:05.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.602+0000 7f0e31a00640 1 --2- 172.21.15.152:0/2485311547 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0e0c068380 0x7f0e0c06a840 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:05.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.602+0000 7f0e31a00640 1 --2- 172.21.15.152:0/2485311547 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e2c0b52e0 0x7f0e2c140d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:05.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.602+0000 7f0e31a00640 1 --2- 172.21.15.152:0/2485311547 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e2c0b4e50 0x7f0e2c13fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:05.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.602+0000 7f0e31a00640 1 -- 172.21.15.152:0/2485311547 >> 172.21.15.152:0/2485311547 conn(0x7f0e2c0d0570 msgr2=0x7f0e2c0b1610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:05.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.602+0000 7f0e31a00640 1 -- 172.21.15.152:0/2485311547 shutdown_connections 2024-04-17T08:47:05.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.602+0000 7f0e31a00640 1 -- 172.21.15.152:0/2485311547 wait complete. 2024-04-17T08:47:05.622 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T08:46:21.386856+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-17T08:46:31.812460+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-17T08:46:32.555559+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-17T08:46:36.258078+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-17T08:47:05.622 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T08:47:05.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.758+0000 7fbf9ae00640 1 Processor -- start 2024-04-17T08:47:05.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.758+0000 7fbf9ae00640 1 -- start start 2024-04-17T08:47:05.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.758+0000 7fbf9ae00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fbf9415a010 0x7fbf940d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:05.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.758+0000 7fbf9ae00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf9415d710 0x7fbf940d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:05.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.758+0000 7fbf9ae00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf94160d20 con 0x7fbf94160010 2024-04-17T08:47:05.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.758+0000 7fbf9ae00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fbf9415d280 con 0x7fbf9415a010 2024-04-17T08:47:05.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.758+0000 7fbf9ae00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fbf9415c9d0 con 0x7fbf9415d710 2024-04-17T08:47:05.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.758+0000 7fbf93e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fbf9415a010 0x7fbf940d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:05.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.758+0000 7fbf8b400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf9415d710 0x7fbf940d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:05.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.758+0000 7fbf8b400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf9415d710 0x7fbf940d08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.152:33804/0 (socket says 172.21.15.152:33804) 2024-04-17T08:47:05.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.758+0000 7fbf8b400640 1 -- 172.21.15.152:0/3108603933 learned_addr learned my addr 172.21.15.152:0/3108603933 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:05.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.758+0000 7fbf93e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fbf9415a010 0x7fbf940d0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.152:41524/0 (socket says 172.21.15.152:41524) 2024-04-17T08:47:05.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.762+0000 7fbf8b400640 1 -- 172.21.15.152:0/3108603933 >> v2:172.21.15.196:3300/0 conn(0x7fbf9415a010 msgr2=0x7fbf940d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:05.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.762+0000 7fbf8b400640 1 --2- 172.21.15.152:0/3108603933 >> v2:172.21.15.196:3300/0 conn(0x7fbf9415a010 0x7fbf940d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:05.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.762+0000 7fbf8b400640 1 -- 172.21.15.152:0/3108603933 >> v1:172.21.15.196:6789/0 conn(0x7fbf94160010 legacy=0x7fbf94160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:05.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.762+0000 7fbf8b400640 1 -- 172.21.15.152:0/3108603933 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf9415cc30 con 0x7fbf9415d710 2024-04-17T08:47:05.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.762+0000 7fbf8b400640 1 --2- 172.21.15.152:0/3108603933 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf9415d710 0x7fbf940d08a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c009870 tx=0x7fbf7c01c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3052de655fc2eeb5 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:05.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.762+0000 7fbf93400640 1 -- 172.21.15.152:0/3108603933 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c0b1070 con 0x7fbf9415d710 2024-04-17T08:47:05.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.762+0000 7fbf93400640 1 -- 172.21.15.152:0/3108603933 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf7c0ac600 con 0x7fbf9415d710 2024-04-17T08:47:05.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.762+0000 7fbf93400640 1 -- 172.21.15.152:0/3108603933 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c0ac9d0 con 0x7fbf9415d710 2024-04-17T08:47:05.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.762+0000 7fbf9ae00640 1 -- 172.21.15.152:0/3108603933 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf9415d710 msgr2=0x7fbf940d08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:05.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.762+0000 7fbf9ae00640 1 --2- 172.21.15.152:0/3108603933 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf9415d710 0x7fbf940d08a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c009870 tx=0x7fbf7c01c4d0 comp rx=0 tx=0).stop 2024-04-17T08:47:05.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.766+0000 7fbf9ae00640 1 -- 172.21.15.152:0/3108603933 shutdown_connections 2024-04-17T08:47:05.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.766+0000 7fbf9ae00640 1 --2- 172.21.15.152:0/3108603933 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf9415d710 0x7fbf940d08a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:05.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.766+0000 7fbf9ae00640 1 --2- 172.21.15.152:0/3108603933 >> v2:172.21.15.196:3300/0 conn(0x7fbf9415a010 0x7fbf940d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:05.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.766+0000 7fbf9ae00640 1 -- 172.21.15.152:0/3108603933 >> 172.21.15.152:0/3108603933 conn(0x7fbf940b3350 msgr2=0x7fbf940b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:05.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.766+0000 7fbf9ae00640 1 -- 172.21.15.152:0/3108603933 shutdown_connections 2024-04-17T08:47:05.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.766+0000 7fbf9ae00640 1 -- 172.21.15.152:0/3108603933 wait complete. 2024-04-17T08:47:05.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.766+0000 7fbf9ae00640 1 Processor -- start 2024-04-17T08:47:05.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.766+0000 7fbf9ae00640 1 -- start start 2024-04-17T08:47:05.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.766+0000 7fbf9ae00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf9415a010 0x7fbf94155560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:05.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.766+0000 7fbf9ae00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf9415d710 0x7fbf9415b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:05.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.766+0000 7fbf9ae00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbf94160010 0x7fbf9415bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:05.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.766+0000 7fbf9ae00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbf9415e780 con 0x7fbf9415d710 2024-04-17T08:47:05.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.766+0000 7fbf9ae00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fbf9415e600 con 0x7fbf94160010 2024-04-17T08:47:05.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.766+0000 7fbf9ae00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fbf9415e900 con 0x7fbf9415a010 2024-04-17T08:47:05.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.766+0000 7fbf8b400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf9415d710 0x7fbf9415b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:05.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.766+0000 7fbf8b400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf9415d710 0x7fbf9415b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47112/0 (socket says 172.21.15.152:47112) 2024-04-17T08:47:05.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.766+0000 7fbf8b400640 1 -- 172.21.15.152:0/224189813 learned_addr learned my addr 172.21.15.152:0/224189813 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:05.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.766+0000 7fbf93e00640 1 --2- 172.21.15.152:0/224189813 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf9415a010 0x7fbf94155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:05.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.766+0000 7fbf98e00640 1 --2- 172.21.15.152:0/224189813 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbf94160010 0x7fbf9415bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:05.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.766+0000 7fbf8b400640 1 -- 172.21.15.152:0/224189813 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf9415a010 msgr2=0x7fbf94155560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:05.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.766+0000 7fbf8b400640 1 --2- 172.21.15.152:0/224189813 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf9415a010 0x7fbf94155560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:05.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.766+0000 7fbf8b400640 1 -- 172.21.15.152:0/224189813 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbf94160010 msgr2=0x7fbf9415bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:05.771 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.766+0000 7fbf8b400640 1 --2- 172.21.15.152:0/224189813 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbf94160010 0x7fbf9415bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:05.771 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.766+0000 7fbf8b400640 1 -- 172.21.15.152:0/224189813 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf94155aa0 con 0x7fbf9415d710 2024-04-17T08:47:05.771 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.766+0000 7fbf98e00640 1 --2- 172.21.15.152:0/224189813 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbf94160010 0x7fbf9415bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:05.771 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.766+0000 7fbf8b400640 1 --2- 172.21.15.152:0/224189813 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf9415d710 0x7fbf9415b7c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c01a100 tx=0x7fbf7c01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:05.771 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.766+0000 7fbf90c00640 1 -- 172.21.15.152:0/224189813 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c0b1040 con 0x7fbf9415d710 2024-04-17T08:47:05.771 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.766+0000 7fbf90c00640 1 -- 172.21.15.152:0/224189813 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf7c0ac400 con 0x7fbf9415d710 2024-04-17T08:47:05.771 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.766+0000 7fbf9ae00640 1 -- 172.21.15.152:0/224189813 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf9406e750 con 0x7fbf9415d710 2024-04-17T08:47:05.771 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.770+0000 7fbf90c00640 1 -- 172.21.15.152:0/224189813 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c0b7670 con 0x7fbf9415d710 2024-04-17T08:47:05.771 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.770+0000 7fbf9ae00640 1 -- 172.21.15.152:0/224189813 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf94154810 con 0x7fbf9415d710 2024-04-17T08:47:05.772 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.770+0000 7fbf9ae00640 1 -- 172.21.15.152:0/224189813 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf94068a30 con 0x7fbf9415d710 2024-04-17T08:47:05.772 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.770+0000 7fbf90c00640 1 -- 172.21.15.152:0/224189813 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbf7c0be030 con 0x7fbf9415d710 2024-04-17T08:47:05.772 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.770+0000 7fbf90c00640 1 --2- 172.21.15.152:0/224189813 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fbf70068380 0x7fbf7006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:05.772 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.770+0000 7fbf90c00640 1 -- 172.21.15.152:0/224189813 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fbf7c120350 con 0x7fbf9415d710 2024-04-17T08:47:05.772 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.770+0000 7fbf93e00640 1 --2- 172.21.15.152:0/224189813 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fbf70068380 0x7fbf7006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:05.773 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.770+0000 7fbf93e00640 1 --2- 172.21.15.152:0/224189813 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fbf70068380 0x7fbf7006a840 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbf84009b60 tx=0x7fbf84009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:05.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.774+0000 7fbf90c00640 1 -- 172.21.15.152:0/224189813 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fbf7c016150 con 0x7fbf9415d710 2024-04-17T08:47:05.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.930+0000 7fbf9ae00640 1 -- 172.21.15.152:0/224189813 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbf9414cb00 con 0x7fbf9415d710 2024-04-17T08:47:05.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.930+0000 7fbf90c00640 1 -- 172.21.15.152:0/224189813 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7fbf7c0f05c0 con 0x7fbf9415d710 2024-04-17T08:47:05.934 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2024-04-17T08:47:05.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.934+0000 7fbf9ae00640 1 -- 172.21.15.152:0/224189813 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fbf70068380 msgr2=0x7fbf7006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:05.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.934+0000 7fbf9ae00640 1 --2- 172.21.15.152:0/224189813 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fbf70068380 0x7fbf7006a840 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbf84009b60 tx=0x7fbf84009190 comp rx=0 tx=0).stop 2024-04-17T08:47:05.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.934+0000 7fbf9ae00640 1 -- 172.21.15.152:0/224189813 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf9415d710 msgr2=0x7fbf9415b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:05.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.934+0000 7fbf9ae00640 1 --2- 172.21.15.152:0/224189813 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf9415d710 0x7fbf9415b7c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c01a100 tx=0x7fbf7c01ad10 comp rx=0 tx=0).stop 2024-04-17T08:47:05.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.934+0000 7fbf9ae00640 1 -- 172.21.15.152:0/224189813 shutdown_connections 2024-04-17T08:47:05.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.934+0000 7fbf9ae00640 1 --2- 172.21.15.152:0/224189813 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbf94160010 0x7fbf9415bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:05.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.934+0000 7fbf9ae00640 1 --2- 172.21.15.152:0/224189813 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf9415d710 0x7fbf9415b7c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:05.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.934+0000 7fbf9ae00640 1 --2- 172.21.15.152:0/224189813 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fbf70068380 0x7fbf7006a840 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:05.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.934+0000 7fbf9ae00640 1 --2- 172.21.15.152:0/224189813 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf9415a010 0x7fbf94155560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:05.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.934+0000 7fbf9ae00640 1 -- 172.21.15.152:0/224189813 >> 172.21.15.152:0/224189813 conn(0x7fbf940b3350 msgr2=0x7fbf940734c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:05.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.934+0000 7fbf9ae00640 1 -- 172.21.15.152:0/224189813 shutdown_connections 2024-04-17T08:47:05.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:05.934+0000 7fbf9ae00640 1 -- 172.21.15.152:0/224189813 wait complete. 2024-04-17T08:47:05.954 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-17T08:47:06.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.090+0000 7fb284a00640 1 Processor -- start 2024-04-17T08:47:06.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.090+0000 7fb284a00640 1 -- start start 2024-04-17T08:47:06.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.090+0000 7fb284a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb2800af670 0x7fb28015b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:06.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.090+0000 7fb284a00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb2800d0360 0x7fb2800d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:06.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.090+0000 7fb284a00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb280072c40 con 0x7fb28006f980 2024-04-17T08:47:06.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.090+0000 7fb284a00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fb28015c820 con 0x7fb2800d0360 2024-04-17T08:47:06.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.090+0000 7fb284a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fb28015c260 con 0x7fb2800af670 2024-04-17T08:47:06.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.090+0000 7fb27e800640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb2800d0360 0x7fb2800d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:06.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.090+0000 7fb27e800640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb2800d0360 0x7fb2800d07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47128/0 (socket says 172.21.15.152:47128) 2024-04-17T08:47:06.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.090+0000 7fb27e800640 1 -- 172.21.15.152:0/4139398080 learned_addr learned my addr 172.21.15.152:0/4139398080 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:06.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.094+0000 7fb27de00640 1 --2- 172.21.15.152:0/4139398080 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb2800af670 0x7fb28015b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:06.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.094+0000 7fb27e800640 1 -- 172.21.15.152:0/4139398080 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb2800af670 msgr2=0x7fb28015b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:06.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.094+0000 7fb27e800640 1 --2- 172.21.15.152:0/4139398080 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb2800af670 0x7fb28015b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:06.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.094+0000 7fb27e800640 1 -- 172.21.15.152:0/4139398080 >> v1:172.21.15.196:6789/0 conn(0x7fb28006f980 legacy=0x7fb280072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:06.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.094+0000 7fb27e800640 1 -- 172.21.15.152:0/4139398080 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb28015c540 con 0x7fb2800d0360 2024-04-17T08:47:06.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.094+0000 7fb27e800640 1 --2- 172.21.15.152:0/4139398080 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2800d0360 0x7fb2800d07f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb278009e50 tx=0x7fb27801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19c6bd79a6688f5c server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:06.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.094+0000 7fb27d400640 1 -- 172.21.15.152:0/4139398080 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2780a5750 con 0x7fb2800d0360 2024-04-17T08:47:06.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.094+0000 7fb27d400640 1 -- 172.21.15.152:0/4139398080 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2780a58f0 con 0x7fb2800d0360 2024-04-17T08:47:06.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.094+0000 7fb27d400640 1 -- 172.21.15.152:0/4139398080 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2780a5cc0 con 0x7fb2800d0360 2024-04-17T08:47:06.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.094+0000 7fb284a00640 1 -- 172.21.15.152:0/4139398080 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2800d0360 msgr2=0x7fb2800d07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:06.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.094+0000 7fb284a00640 1 --2- 172.21.15.152:0/4139398080 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2800d0360 0x7fb2800d07f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb278009e50 tx=0x7fb27801c9a0 comp rx=0 tx=0).stop 2024-04-17T08:47:06.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.094+0000 7fb284a00640 1 -- 172.21.15.152:0/4139398080 shutdown_connections 2024-04-17T08:47:06.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.094+0000 7fb284a00640 1 --2- 172.21.15.152:0/4139398080 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2800d0360 0x7fb2800d07f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:06.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.094+0000 7fb284a00640 1 --2- 172.21.15.152:0/4139398080 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb2800af670 0x7fb28015b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:06.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.094+0000 7fb284a00640 1 -- 172.21.15.152:0/4139398080 >> 172.21.15.152:0/4139398080 conn(0x7fb2800b3350 msgr2=0x7fb2800b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:06.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.098+0000 7fb284a00640 1 -- 172.21.15.152:0/4139398080 shutdown_connections 2024-04-17T08:47:06.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.098+0000 7fb284a00640 1 -- 172.21.15.152:0/4139398080 wait complete. 2024-04-17T08:47:06.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.098+0000 7fb284a00640 1 Processor -- start 2024-04-17T08:47:06.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.098+0000 7fb284a00640 1 -- start start 2024-04-17T08:47:06.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.098+0000 7fb284a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb28006f980 0x7fb280164660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:06.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.098+0000 7fb284a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2800af670 0x7fb280167df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:06.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.098+0000 7fb284a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb2800d0360 0x7fb280155280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:06.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.098+0000 7fb284a00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb28015bf80 con 0x7fb2800af670 2024-04-17T08:47:06.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.098+0000 7fb284a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb28015be00 con 0x7fb2800d0360 2024-04-17T08:47:06.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.098+0000 7fb284a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fb280166040 con 0x7fb28006f980 2024-04-17T08:47:06.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.098+0000 7fb275400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2800af670 0x7fb280167df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:06.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.098+0000 7fb275400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2800af670 0x7fb280167df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47144/0 (socket says 172.21.15.152:47144) 2024-04-17T08:47:06.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.098+0000 7fb275400640 1 -- 172.21.15.152:0/1283813170 learned_addr learned my addr 172.21.15.152:0/1283813170 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:06.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.098+0000 7fb27de00640 1 --2- 172.21.15.152:0/1283813170 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb28006f980 0x7fb280164660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:06.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.098+0000 7fb27e800640 1 --2- 172.21.15.152:0/1283813170 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb2800d0360 0x7fb280155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:06.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.098+0000 7fb275400640 1 -- 172.21.15.152:0/1283813170 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb28006f980 msgr2=0x7fb280164660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:06.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.098+0000 7fb275400640 1 --2- 172.21.15.152:0/1283813170 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb28006f980 0x7fb280164660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:06.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.098+0000 7fb275400640 1 -- 172.21.15.152:0/1283813170 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb2800d0360 msgr2=0x7fb280155280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:06.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.098+0000 7fb275400640 1 --2- 172.21.15.152:0/1283813170 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb2800d0360 0x7fb280155280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:06.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.098+0000 7fb275400640 1 -- 172.21.15.152:0/1283813170 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb28014e1b0 con 0x7fb2800af670 2024-04-17T08:47:06.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.098+0000 7fb27e800640 1 --2- 172.21.15.152:0/1283813170 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb2800d0360 0x7fb280155280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:06.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.098+0000 7fb275400640 1 --2- 172.21.15.152:0/1283813170 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2800af670 0x7fb280167df0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb26800c430 tx=0x7fb26800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:06.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.098+0000 7fb276a00640 1 -- 172.21.15.152:0/1283813170 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2680052d0 con 0x7fb2800af670 2024-04-17T08:47:06.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.098+0000 7fb276a00640 1 -- 172.21.15.152:0/1283813170 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb268005470 con 0x7fb2800af670 2024-04-17T08:47:06.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.098+0000 7fb276a00640 1 -- 172.21.15.152:0/1283813170 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb268007260 con 0x7fb2800af670 2024-04-17T08:47:06.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.098+0000 7fb284a00640 1 -- 172.21.15.152:0/1283813170 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb28014e490 con 0x7fb2800af670 2024-04-17T08:47:06.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.098+0000 7fb284a00640 1 -- 172.21.15.152:0/1283813170 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb28014ea50 con 0x7fb2800af670 2024-04-17T08:47:06.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.102+0000 7fb284a00640 1 -- 172.21.15.152:0/1283813170 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb280068a30 con 0x7fb2800af670 2024-04-17T08:47:06.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.102+0000 7fb276a00640 1 -- 172.21.15.152:0/1283813170 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb268007400 con 0x7fb2800af670 2024-04-17T08:47:06.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.102+0000 7fb276a00640 1 --2- 172.21.15.152:0/1283813170 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb25c068380 0x7fb25c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:06.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.102+0000 7fb276a00640 1 -- 172.21.15.152:0/1283813170 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb268086240 con 0x7fb2800af670 2024-04-17T08:47:06.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.102+0000 7fb27de00640 1 --2- 172.21.15.152:0/1283813170 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb25c068380 0x7fb25c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:06.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.102+0000 7fb27de00640 1 --2- 172.21.15.152:0/1283813170 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb25c068380 0x7fb25c06a840 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb270007a60 tx=0x7fb270008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:06.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.106+0000 7fb276a00640 1 -- 172.21.15.152:0/1283813170 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fb268055dd0 con 0x7fb2800af670 2024-04-17T08:47:06.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.266+0000 7fb284a00640 1 -- 172.21.15.152:0/1283813170 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb2800d0970 con 0x7fb2800af670 2024-04-17T08:47:06.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.266+0000 7fb276a00640 1 -- 172.21.15.152:0/1283813170 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7fb26805a0d0 con 0x7fb2800af670 2024-04-17T08:47:06.269 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-04-17T08:47:06.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.270+0000 7fb284a00640 1 -- 172.21.15.152:0/1283813170 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb25c068380 msgr2=0x7fb25c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:06.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.270+0000 7fb284a00640 1 --2- 172.21.15.152:0/1283813170 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb25c068380 0x7fb25c06a840 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb270007a60 tx=0x7fb270008040 comp rx=0 tx=0).stop 2024-04-17T08:47:06.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.270+0000 7fb284a00640 1 -- 172.21.15.152:0/1283813170 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2800af670 msgr2=0x7fb280167df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:06.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.270+0000 7fb284a00640 1 --2- 172.21.15.152:0/1283813170 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2800af670 0x7fb280167df0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb26800c430 tx=0x7fb26800c8f0 comp rx=0 tx=0).stop 2024-04-17T08:47:06.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.270+0000 7fb284a00640 1 -- 172.21.15.152:0/1283813170 shutdown_connections 2024-04-17T08:47:06.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.270+0000 7fb284a00640 1 --2- 172.21.15.152:0/1283813170 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb2800d0360 0x7fb280155280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:06.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.270+0000 7fb284a00640 1 --2- 172.21.15.152:0/1283813170 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2800af670 0x7fb280167df0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:06.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.270+0000 7fb284a00640 1 --2- 172.21.15.152:0/1283813170 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb25c068380 0x7fb25c06a840 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:06.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.270+0000 7fb284a00640 1 --2- 172.21.15.152:0/1283813170 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb28006f980 0x7fb280164660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:06.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.270+0000 7fb284a00640 1 -- 172.21.15.152:0/1283813170 >> 172.21.15.152:0/1283813170 conn(0x7fb2800b3350 msgr2=0x7fb28006e830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:06.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.270+0000 7fb284a00640 1 -- 172.21.15.152:0/1283813170 shutdown_connections 2024-04-17T08:47:06.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.270+0000 7fb284a00640 1 -- 172.21.15.152:0/1283813170 wait complete. 2024-04-17T08:47:06.290 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-17T08:47:06.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.430+0000 7f4180c00640 1 Processor -- start 2024-04-17T08:47:06.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.430+0000 7f4180c00640 1 -- start start 2024-04-17T08:47:06.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.430+0000 7f4180c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f417c15b0f0 0x7f417c0d0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:06.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.430+0000 7f4180c00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f417c073020 0x7f417c0adc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:06.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.430+0000 7f4180c00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f417c06e3a0 con 0x7f417c0ae150 2024-04-17T08:47:06.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.430+0000 7f4180c00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f417c0d0fc0 con 0x7f417c073020 2024-04-17T08:47:06.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.430+0000 7f4180c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f417c06e9a0 con 0x7f417c15b0f0 2024-04-17T08:47:06.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.430+0000 7f4173e00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f417c073020 0x7f417c0adc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:06.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.430+0000 7f417be00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f417c0ae150 0x7f417c06cac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:58550/0 (socket says 172.21.15.152:58550) 2024-04-17T08:47:06.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.430+0000 7f4173e00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f417c073020 0x7f417c0adc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47160/0 (socket says 172.21.15.152:47160) 2024-04-17T08:47:06.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.430+0000 7f417be00640 1 -- 172.21.15.152:0/1207078093 learned_addr learned my addr 172.21.15.152:0/1207078093 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:06.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.430+0000 7f417b400640 1 --2- 172.21.15.152:0/1207078093 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f417c15b0f0 0x7f417c0d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:06.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.430+0000 7f4173e00640 1 -- 172.21.15.152:0/1207078093 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f417c15b0f0 msgr2=0x7f417c0d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:06.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.430+0000 7f4173e00640 1 --2- 172.21.15.152:0/1207078093 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f417c15b0f0 0x7f417c0d0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:06.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.430+0000 7f4173e00640 1 -- 172.21.15.152:0/1207078093 >> v1:172.21.15.152:6789/0 conn(0x7f417c0ae150 legacy=0x7f417c06cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:06.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.430+0000 7f4173e00640 1 -- 172.21.15.152:0/1207078093 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f417c0d0720 con 0x7f417c073020 2024-04-17T08:47:06.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.430+0000 7f417aa00640 1 -- 172.21.15.152:0/1207078093 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 415564767 0 0) 0x7f417c06e3a0 con 0x7f417c0ae150 2024-04-17T08:47:06.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.434+0000 7f4173e00640 1 --2- 172.21.15.152:0/1207078093 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f417c073020 0x7f417c0adc10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f41640097c0 tx=0x7f416401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=911d79b707d0344b server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:06.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.434+0000 7f417aa00640 1 -- 172.21.15.152:0/1207078093 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41640ab610 con 0x7f417c073020 2024-04-17T08:47:06.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.434+0000 7f417aa00640 1 -- 172.21.15.152:0/1207078093 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41640b0070 con 0x7f417c073020 2024-04-17T08:47:06.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.434+0000 7f417aa00640 1 -- 172.21.15.152:0/1207078093 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41640ab9d0 con 0x7f417c073020 2024-04-17T08:47:06.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.434+0000 7f4180c00640 1 -- 172.21.15.152:0/1207078093 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f417c073020 msgr2=0x7f417c0adc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:06.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.434+0000 7f4180c00640 1 --2- 172.21.15.152:0/1207078093 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f417c073020 0x7f417c0adc10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f41640097c0 tx=0x7f416401c410 comp rx=0 tx=0).stop 2024-04-17T08:47:06.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.434+0000 7f4180c00640 1 -- 172.21.15.152:0/1207078093 shutdown_connections 2024-04-17T08:47:06.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.434+0000 7f4180c00640 1 --2- 172.21.15.152:0/1207078093 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f417c073020 0x7f417c0adc10 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:06.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.434+0000 7f4180c00640 1 --2- 172.21.15.152:0/1207078093 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f417c15b0f0 0x7f417c0d0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:06.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.434+0000 7f4180c00640 1 -- 172.21.15.152:0/1207078093 >> 172.21.15.152:0/1207078093 conn(0x7f417c0b5280 msgr2=0x7f417c0b3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:06.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.434+0000 7f4180c00640 1 -- 172.21.15.152:0/1207078093 shutdown_connections 2024-04-17T08:47:06.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.434+0000 7f4180c00640 1 -- 172.21.15.152:0/1207078093 wait complete. 2024-04-17T08:47:06.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.434+0000 7f4180c00640 1 Processor -- start 2024-04-17T08:47:06.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.434+0000 7f4180c00640 1 -- start start 2024-04-17T08:47:06.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.438+0000 7f4180c00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f417c073020 0x7f417c14f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:06.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.438+0000 7f4180c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f417c0ae150 0x7f417c155950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:06.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.438+0000 7f4180c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f417c15b0f0 0x7f417c153960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:06.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.438+0000 7f4180c00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f417c06f7a0 con 0x7f417c073020 2024-04-17T08:47:06.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.438+0000 7f4180c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f417c06f620 con 0x7f417c0ae150 2024-04-17T08:47:06.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.438+0000 7f4180c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f417c06d1d0 con 0x7f417c15b0f0 2024-04-17T08:47:06.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.438+0000 7f417b400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f417c073020 0x7f417c14f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:06.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.438+0000 7f417b400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f417c073020 0x7f417c14f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47164/0 (socket says 172.21.15.152:47164) 2024-04-17T08:47:06.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.438+0000 7f417b400640 1 -- 172.21.15.152:0/137809906 learned_addr learned my addr 172.21.15.152:0/137809906 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:06.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.438+0000 7f417be00640 1 --2- 172.21.15.152:0/137809906 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f417c15b0f0 0x7f417c153960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:06.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.438+0000 7f4173e00640 1 --2- 172.21.15.152:0/137809906 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f417c0ae150 0x7f417c155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:06.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.438+0000 7f417b400640 1 -- 172.21.15.152:0/137809906 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f417c15b0f0 msgr2=0x7f417c153960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:06.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.438+0000 7f417b400640 1 --2- 172.21.15.152:0/137809906 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f417c15b0f0 0x7f417c153960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:06.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.438+0000 7f417b400640 1 -- 172.21.15.152:0/137809906 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f417c0ae150 msgr2=0x7f417c155950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:06.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.438+0000 7f417b400640 1 --2- 172.21.15.152:0/137809906 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f417c0ae150 0x7f417c155950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:06.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.438+0000 7f417b400640 1 -- 172.21.15.152:0/137809906 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f417c09c3a0 con 0x7f417c073020 2024-04-17T08:47:06.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.438+0000 7f4173e00640 1 --2- 172.21.15.152:0/137809906 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f417c0ae150 0x7f417c155950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:47:06.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.438+0000 7f417b400640 1 --2- 172.21.15.152:0/137809906 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f417c073020 0x7f417c14f880 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f416c00d800 tx=0x7f416c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:06.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.438+0000 7f4173400640 1 -- 172.21.15.152:0/137809906 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f416c00b6c0 con 0x7f417c073020 2024-04-17T08:47:06.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.438+0000 7f4173400640 1 -- 172.21.15.152:0/137809906 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f416c019070 con 0x7f417c073020 2024-04-17T08:47:06.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.438+0000 7f4173400640 1 -- 172.21.15.152:0/137809906 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f416c00ba60 con 0x7f417c073020 2024-04-17T08:47:06.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.438+0000 7f4180c00640 1 -- 172.21.15.152:0/137809906 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f417c09c680 con 0x7f417c073020 2024-04-17T08:47:06.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.438+0000 7f4180c00640 1 -- 172.21.15.152:0/137809906 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f417c09cc40 con 0x7f417c073020 2024-04-17T08:47:06.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.438+0000 7f4180c00640 1 -- 172.21.15.152:0/137809906 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f417c075be0 con 0x7f417c073020 2024-04-17T08:47:06.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.438+0000 7f4173400640 1 -- 172.21.15.152:0/137809906 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f416c00bc00 con 0x7f417c073020 2024-04-17T08:47:06.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.442+0000 7f4173400640 1 --2- 172.21.15.152:0/137809906 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f4158068380 0x7f415806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:06.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.442+0000 7f4173400640 1 -- 172.21.15.152:0/137809906 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f416c087210 con 0x7f417c073020 2024-04-17T08:47:06.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.442+0000 7f4173e00640 1 --2- 172.21.15.152:0/137809906 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f4158068380 0x7f415806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:06.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.442+0000 7f4173e00640 1 --2- 172.21.15.152:0/137809906 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f4158068380 0x7f415806a840 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f41640af000 tx=0x7f4164008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:06.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.446+0000 7f4173400640 1 -- 172.21.15.152:0/137809906 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f416c057470 con 0x7f417c073020 2024-04-17T08:47:06.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.602+0000 7f4180c00640 1 -- 172.21.15.152:0/137809906 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f417c0728f0 con 0x7f417c073020 2024-04-17T08:47:06.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.602+0000 7f4173400640 1 -- 172.21.15.152:0/137809906 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7f416c056d70 con 0x7f417c073020 2024-04-17T08:47:06.603 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 64 2024-04-17T08:47:06.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.602+0000 7f4180c00640 1 -- 172.21.15.152:0/137809906 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f4158068380 msgr2=0x7f415806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:06.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.602+0000 7f4180c00640 1 --2- 172.21.15.152:0/137809906 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f4158068380 0x7f415806a840 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f41640af000 tx=0x7f4164008040 comp rx=0 tx=0).stop 2024-04-17T08:47:06.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.602+0000 7f4180c00640 1 -- 172.21.15.152:0/137809906 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f417c073020 msgr2=0x7f417c14f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:06.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.602+0000 7f4180c00640 1 --2- 172.21.15.152:0/137809906 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f417c073020 0x7f417c14f880 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f416c00d800 tx=0x7f416c00dcc0 comp rx=0 tx=0).stop 2024-04-17T08:47:06.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.602+0000 7f4180c00640 1 -- 172.21.15.152:0/137809906 shutdown_connections 2024-04-17T08:47:06.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.602+0000 7f4180c00640 1 --2- 172.21.15.152:0/137809906 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f4158068380 0x7f415806a840 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:06.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.602+0000 7f4180c00640 1 --2- 172.21.15.152:0/137809906 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f417c15b0f0 0x7f417c153960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:06.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.602+0000 7f4180c00640 1 --2- 172.21.15.152:0/137809906 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f417c0ae150 0x7f417c155950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:06.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.602+0000 7f4180c00640 1 --2- 172.21.15.152:0/137809906 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f417c073020 0x7f417c14f880 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:06.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.602+0000 7f4180c00640 1 -- 172.21.15.152:0/137809906 >> 172.21.15.152:0/137809906 conn(0x7f417c0b5280 msgr2=0x7f417c155130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:06.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.602+0000 7f4180c00640 1 -- 172.21.15.152:0/137809906 shutdown_connections 2024-04-17T08:47:06.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.602+0000 7f4180c00640 1 -- 172.21.15.152:0/137809906 wait complete. 2024-04-17T08:47:06.624 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-17T08:47:06.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.762+0000 7f5f1fc00640 1 Processor -- start 2024-04-17T08:47:06.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.762+0000 7f5f1fc00640 1 -- start start 2024-04-17T08:47:06.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.762+0000 7f5f1fc00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f5f18158fe0 0x7f5f1815f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:06.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.762+0000 7f5f1fc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5f1806b9b0 0x7f5f1806bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:06.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.762+0000 7f5f1fc00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f1806c310 con 0x7f5f18070950 2024-04-17T08:47:06.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.762+0000 7f5f1fc00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f5f180b4610 con 0x7f5f18158fe0 2024-04-17T08:47:06.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.762+0000 7f5f1fc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f5f1815fcf0 con 0x7f5f1806b9b0 2024-04-17T08:47:06.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.762+0000 7f5f1d200640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f5f18158fe0 0x7f5f1815f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:06.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.762+0000 7f5f17e00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f5f18070950 0x7f5f180b3f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:58554/0 (socket says 172.21.15.152:58554) 2024-04-17T08:47:06.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.762+0000 7f5f17e00640 1 -- 172.21.15.152:0/811341646 learned_addr learned my addr 172.21.15.152:0/811341646 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:06.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.762+0000 7f5f1d200640 1 -- 172.21.15.152:0/811341646 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5f1806b9b0 msgr2=0x7f5f1806bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:06.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.762+0000 7f5f1d200640 1 --2- 172.21.15.152:0/811341646 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5f1806b9b0 0x7f5f1806bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:06.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.762+0000 7f5f1d200640 1 -- 172.21.15.152:0/811341646 >> v1:172.21.15.152:6789/0 conn(0x7f5f18070950 legacy=0x7f5f180b3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:06.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.762+0000 7f5f1d200640 1 -- 172.21.15.152:0/811341646 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f180cea60 con 0x7f5f18158fe0 2024-04-17T08:47:06.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.762+0000 7f5f17400640 1 -- 172.21.15.152:0/811341646 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 702417353 0 0) 0x7f5f1806c310 con 0x7f5f18070950 2024-04-17T08:47:06.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.766+0000 7f5f1d200640 1 --2- 172.21.15.152:0/811341646 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f18158fe0 0x7f5f1815f7b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5f08009d90 tx=0x7f5f0801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0ac0ea07d3acc3f server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:06.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.766+0000 7f5f17400640 1 -- 172.21.15.152:0/811341646 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f080b2070 con 0x7f5f18158fe0 2024-04-17T08:47:06.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.766+0000 7f5f17400640 1 -- 172.21.15.152:0/811341646 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f080a5a00 con 0x7f5f18158fe0 2024-04-17T08:47:06.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.766+0000 7f5f17400640 1 -- 172.21.15.152:0/811341646 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f080a5dd0 con 0x7f5f18158fe0 2024-04-17T08:47:06.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.766+0000 7f5f1fc00640 1 -- 172.21.15.152:0/811341646 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f18158fe0 msgr2=0x7f5f1815f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:06.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.766+0000 7f5f1fc00640 1 --2- 172.21.15.152:0/811341646 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f18158fe0 0x7f5f1815f7b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5f08009d90 tx=0x7f5f0801c940 comp rx=0 tx=0).stop 2024-04-17T08:47:06.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.766+0000 7f5f1fc00640 1 -- 172.21.15.152:0/811341646 shutdown_connections 2024-04-17T08:47:06.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.766+0000 7f5f1fc00640 1 --2- 172.21.15.152:0/811341646 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5f1806b9b0 0x7f5f1806bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:06.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.766+0000 7f5f1fc00640 1 --2- 172.21.15.152:0/811341646 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f18158fe0 0x7f5f1815f7b0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:06.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.766+0000 7f5f1fc00640 1 -- 172.21.15.152:0/811341646 >> 172.21.15.152:0/811341646 conn(0x7f5f180cd540 msgr2=0x7f5f180cd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:06.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.766+0000 7f5f1fc00640 1 -- 172.21.15.152:0/811341646 shutdown_connections 2024-04-17T08:47:06.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.766+0000 7f5f1fc00640 1 -- 172.21.15.152:0/811341646 wait complete. 2024-04-17T08:47:06.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.766+0000 7f5f1fc00640 1 Processor -- start 2024-04-17T08:47:06.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.770+0000 7f5f1fc00640 1 -- start start 2024-04-17T08:47:06.772 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.770+0000 7f5f1fc00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f1806b9b0 0x7f5f181596a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:06.772 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.770+0000 7f5f1fc00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5f18070950 0x7f5f181fa7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:06.772 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.770+0000 7f5f1fc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5f18158fe0 0x7f5f181fad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:06.772 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.770+0000 7f5f1fc00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5f1816b3c0 con 0x7f5f1806b9b0 2024-04-17T08:47:06.772 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.770+0000 7f5f1fc00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f5f180cf5e0 con 0x7f5f18070950 2024-04-17T08:47:06.772 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.770+0000 7f5f1fc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f5f1816b540 con 0x7f5f18158fe0 2024-04-17T08:47:06.772 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.770+0000 7f5f1d200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f1806b9b0 0x7f5f181596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:06.772 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.770+0000 7f5f1d200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f1806b9b0 0x7f5f181596a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47194/0 (socket says 172.21.15.152:47194) 2024-04-17T08:47:06.772 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.770+0000 7f5f1d200640 1 -- 172.21.15.152:0/1163843850 learned_addr learned my addr 172.21.15.152:0/1163843850 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:06.772 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.770+0000 7f5f17e00640 1 --2- 172.21.15.152:0/1163843850 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5f18070950 0x7f5f181fa7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:06.772 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.770+0000 7f5f1d200640 1 -- 172.21.15.152:0/1163843850 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5f18158fe0 msgr2=0x7f5f181fad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:06.772 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.770+0000 7f5f1dc00640 1 --2- 172.21.15.152:0/1163843850 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5f18158fe0 0x7f5f181fad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:06.772 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.770+0000 7f5f1d200640 1 --2- 172.21.15.152:0/1163843850 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5f18158fe0 0x7f5f181fad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:06.773 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.770+0000 7f5f1d200640 1 -- 172.21.15.152:0/1163843850 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5f18070950 msgr2=0x7f5f181fa7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:06.773 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.770+0000 7f5f1d200640 1 --2- 172.21.15.152:0/1163843850 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5f18070950 0x7f5f181fa7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:06.773 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.770+0000 7f5f1d200640 1 -- 172.21.15.152:0/1163843850 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f1815e530 con 0x7f5f1806b9b0 2024-04-17T08:47:06.773 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.770+0000 7f5f17e00640 1 --2- 172.21.15.152:0/1163843850 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5f18070950 0x7f5f181fa7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:47:06.773 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.770+0000 7f5f1dc00640 1 --2- 172.21.15.152:0/1163843850 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5f18158fe0 0x7f5f181fad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:47:06.773 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.770+0000 7f5f1d200640 1 --2- 172.21.15.152:0/1163843850 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f1806b9b0 0x7f5f181596a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5f080b0040 tx=0x7f5f080196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:06.773 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.770+0000 7f5f14c00640 1 -- 172.21.15.152:0/1163843850 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f080b2050 con 0x7f5f1806b9b0 2024-04-17T08:47:06.773 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.770+0000 7f5f14c00640 1 -- 172.21.15.152:0/1163843850 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f080be070 con 0x7f5f1806b9b0 2024-04-17T08:47:06.773 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.770+0000 7f5f14c00640 1 -- 172.21.15.152:0/1163843850 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f080adc50 con 0x7f5f1806b9b0 2024-04-17T08:47:06.773 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.770+0000 7f5f1fc00640 1 -- 172.21.15.152:0/1163843850 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f1815e810 con 0x7f5f1806b9b0 2024-04-17T08:47:06.773 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.770+0000 7f5f1fc00640 1 -- 172.21.15.152:0/1163843850 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f1806f110 con 0x7f5f1806b9b0 2024-04-17T08:47:06.774 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.770+0000 7f5f1fc00640 1 -- 172.21.15.152:0/1163843850 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f18068a30 con 0x7f5f1806b9b0 2024-04-17T08:47:06.774 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.774+0000 7f5f14c00640 1 -- 172.21.15.152:0/1163843850 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5f080c3460 con 0x7f5f1806b9b0 2024-04-17T08:47:06.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.774+0000 7f5f14c00640 1 --2- 172.21.15.152:0/1163843850 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5ef8068380 0x7f5ef806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:06.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.774+0000 7f5f14c00640 1 -- 172.21.15.152:0/1163843850 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f5f08122220 con 0x7f5f1806b9b0 2024-04-17T08:47:06.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.774+0000 7f5f17e00640 1 --2- 172.21.15.152:0/1163843850 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5ef8068380 0x7f5ef806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:06.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.774+0000 7f5f17e00640 1 --2- 172.21.15.152:0/1163843850 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5ef8068380 0x7f5ef806a840 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5f04000f70 tx=0x7f5f04009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:06.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.778+0000 7f5f14c00640 1 -- 172.21.15.152:0/1163843850 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f5f08016560 con 0x7f5f1806b9b0 2024-04-17T08:47:06.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.934+0000 7f5f1fc00640 1 -- 172.21.15.152:0/1163843850 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f5f1806ebe0 con 0x7f5f1806b9b0 2024-04-17T08:47:06.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.934+0000 7f5f14c00640 1 -- 172.21.15.152:0/1163843850 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) ==== 103+0+11 (secure 0 0 0) 0x7f5f080f2650 con 0x7f5f1806b9b0 2024-04-17T08:47:06.935 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-04-17T08:47:06.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.934+0000 7f5f1fc00640 1 -- 172.21.15.152:0/1163843850 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5ef8068380 msgr2=0x7f5ef806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:06.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.934+0000 7f5f1fc00640 1 --2- 172.21.15.152:0/1163843850 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5ef8068380 0x7f5ef806a840 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5f04000f70 tx=0x7f5f04009040 comp rx=0 tx=0).stop 2024-04-17T08:47:06.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.934+0000 7f5f1fc00640 1 -- 172.21.15.152:0/1163843850 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f1806b9b0 msgr2=0x7f5f181596a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:06.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.934+0000 7f5f1fc00640 1 --2- 172.21.15.152:0/1163843850 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f1806b9b0 0x7f5f181596a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5f080b0040 tx=0x7f5f080196e0 comp rx=0 tx=0).stop 2024-04-17T08:47:06.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.934+0000 7f5f1fc00640 1 -- 172.21.15.152:0/1163843850 shutdown_connections 2024-04-17T08:47:06.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.934+0000 7f5f1fc00640 1 --2- 172.21.15.152:0/1163843850 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5ef8068380 0x7f5ef806a840 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:06.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.934+0000 7f5f1fc00640 1 --2- 172.21.15.152:0/1163843850 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5f18158fe0 0x7f5f181fad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:06.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.934+0000 7f5f1fc00640 1 --2- 172.21.15.152:0/1163843850 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5f18070950 0x7f5f181fa7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:06.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.934+0000 7f5f1fc00640 1 --2- 172.21.15.152:0/1163843850 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f1806b9b0 0x7f5f181596a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:06.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.934+0000 7f5f1fc00640 1 -- 172.21.15.152:0/1163843850 >> 172.21.15.152:0/1163843850 conn(0x7f5f180cd540 msgr2=0x7f5f180ade30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:06.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.934+0000 7f5f1fc00640 1 -- 172.21.15.152:0/1163843850 shutdown_connections 2024-04-17T08:47:06.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:06.934+0000 7f5f1fc00640 1 -- 172.21.15.152:0/1163843850 wait complete. 2024-04-17T08:47:06.958 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T08:47:07.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.090+0000 7f43d2000640 1 Processor -- start 2024-04-17T08:47:07.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.090+0000 7f43d2000640 1 -- start start 2024-04-17T08:47:07.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.094+0000 7f43d2000640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f43cc06d070 0x7f43cc072d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:07.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.094+0000 7f43d2000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f43cc06d450 0x7f43cc073250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:07.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.094+0000 7f43d2000640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43cc15d8f0 con 0x7f43cc15cbc0 2024-04-17T08:47:07.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.094+0000 7f43d2000640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f43cc0cdd70 con 0x7f43cc06d070 2024-04-17T08:47:07.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.094+0000 7f43d2000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f43cc0ce050 con 0x7f43cc06d450 2024-04-17T08:47:07.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.094+0000 7f43cb400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f43cc06d070 0x7f43cc072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:07.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.094+0000 7f43cbe00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f43cc15cbc0 0x7f43cc15cff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:58560/0 (socket says 172.21.15.152:58560) 2024-04-17T08:47:07.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.094+0000 7f43cbe00640 1 -- 172.21.15.152:0/4181439070 learned_addr learned my addr 172.21.15.152:0/4181439070 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:07.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.094+0000 7f43c2a00640 1 --2- 172.21.15.152:0/4181439070 >> v2:172.21.15.196:3300/0 conn(0x7f43cc06d450 0x7f43cc073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:07.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.094+0000 7f43cb400640 1 -- 172.21.15.152:0/4181439070 >> v2:172.21.15.196:3300/0 conn(0x7f43cc06d450 msgr2=0x7f43cc073250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:07.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.094+0000 7f43cb400640 1 --2- 172.21.15.152:0/4181439070 >> v2:172.21.15.196:3300/0 conn(0x7f43cc06d450 0x7f43cc073250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:07.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.094+0000 7f43cb400640 1 -- 172.21.15.152:0/4181439070 >> v1:172.21.15.152:6789/0 conn(0x7f43cc15cbc0 legacy=0x7f43cc15cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:07.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.094+0000 7f43cb400640 1 -- 172.21.15.152:0/4181439070 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43cc0ce330 con 0x7f43cc06d070 2024-04-17T08:47:07.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.094+0000 7f43caa00640 1 -- 172.21.15.152:0/4181439070 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2868206903 0 0) 0x7f43cc15d8f0 con 0x7f43cc15cbc0 2024-04-17T08:47:07.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.094+0000 7f43c2a00640 1 --2- 172.21.15.152:0/4181439070 >> v2:172.21.15.196:3300/0 conn(0x7f43cc06d450 0x7f43cc073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:07.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.098+0000 7f43cb400640 1 --2- 172.21.15.152:0/4181439070 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43cc06d070 0x7f43cc072d10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f43cc0cf2d0 tx=0x7f43bc01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=371fcbcb347ac72b server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:07.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.098+0000 7f43caa00640 1 -- 172.21.15.152:0/4181439070 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43bc0b1070 con 0x7f43cc06d070 2024-04-17T08:47:07.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.098+0000 7f43caa00640 1 -- 172.21.15.152:0/4181439070 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43bc0ac5f0 con 0x7f43cc06d070 2024-04-17T08:47:07.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.098+0000 7f43caa00640 1 -- 172.21.15.152:0/4181439070 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43cc0ced40 con 0x7f43cc06d070 2024-04-17T08:47:07.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.098+0000 7f43d2000640 1 -- 172.21.15.152:0/4181439070 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43cc06d070 msgr2=0x7f43cc072d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:07.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.098+0000 7f43d2000640 1 --2- 172.21.15.152:0/4181439070 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43cc06d070 0x7f43cc072d10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f43cc0cf2d0 tx=0x7f43bc01c480 comp rx=0 tx=0).stop 2024-04-17T08:47:07.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.098+0000 7f43d2000640 1 -- 172.21.15.152:0/4181439070 shutdown_connections 2024-04-17T08:47:07.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.098+0000 7f43d2000640 1 --2- 172.21.15.152:0/4181439070 >> v2:172.21.15.196:3300/0 conn(0x7f43cc06d450 0x7f43cc073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:07.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.098+0000 7f43d2000640 1 --2- 172.21.15.152:0/4181439070 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43cc06d070 0x7f43cc072d10 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:07.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.098+0000 7f43d2000640 1 -- 172.21.15.152:0/4181439070 >> 172.21.15.152:0/4181439070 conn(0x7f43cc0b31c0 msgr2=0x7f43cc0b35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:07.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.098+0000 7f43d2000640 1 -- 172.21.15.152:0/4181439070 shutdown_connections 2024-04-17T08:47:07.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.098+0000 7f43d2000640 1 -- 172.21.15.152:0/4181439070 wait complete. 2024-04-17T08:47:07.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.098+0000 7f43d2000640 1 Processor -- start 2024-04-17T08:47:07.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.098+0000 7f43d2000640 1 -- start start 2024-04-17T08:47:07.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.098+0000 7f43d2000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43cc06d070 0x7f43cc13bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:07.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.098+0000 7f43d2000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f43cc06d450 0x7f43cc0b26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:07.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.098+0000 7f43d2000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f43cc15cbc0 0x7f43cc152360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:07.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.098+0000 7f43d2000640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f43cc06f730 con 0x7f43cc06d070 2024-04-17T08:47:07.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.098+0000 7f43d2000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f43cc06f5b0 con 0x7f43cc15cbc0 2024-04-17T08:47:07.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.098+0000 7f43d2000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f43cc06f8b0 con 0x7f43cc06d450 2024-04-17T08:47:07.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.098+0000 7f43cb400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43cc06d070 0x7f43cc13bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:07.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.098+0000 7f43cb400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43cc06d070 0x7f43cc13bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47220/0 (socket says 172.21.15.152:47220) 2024-04-17T08:47:07.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.098+0000 7f43cb400640 1 -- 172.21.15.152:0/2989662890 learned_addr learned my addr 172.21.15.152:0/2989662890 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:07.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.102+0000 7f43c2a00640 1 --2- 172.21.15.152:0/2989662890 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f43cc06d450 0x7f43cc0b26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:07.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.102+0000 7f43cbe00640 1 --2- 172.21.15.152:0/2989662890 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f43cc15cbc0 0x7f43cc152360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:07.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.102+0000 7f43cb400640 1 -- 172.21.15.152:0/2989662890 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f43cc06d450 msgr2=0x7f43cc0b26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:07.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.102+0000 7f43cb400640 1 --2- 172.21.15.152:0/2989662890 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f43cc06d450 0x7f43cc0b26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:07.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.102+0000 7f43cb400640 1 -- 172.21.15.152:0/2989662890 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f43cc15cbc0 msgr2=0x7f43cc152360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:07.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.102+0000 7f43cb400640 1 --2- 172.21.15.152:0/2989662890 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f43cc15cbc0 0x7f43cc152360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:07.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.102+0000 7f43cb400640 1 -- 172.21.15.152:0/2989662890 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43cc153ae0 con 0x7f43cc06d070 2024-04-17T08:47:07.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.102+0000 7f43c2a00640 1 --2- 172.21.15.152:0/2989662890 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f43cc06d450 0x7f43cc0b26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:47:07.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.102+0000 7f43cbe00640 1 --2- 172.21.15.152:0/2989662890 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f43cc15cbc0 0x7f43cc152360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:47:07.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.102+0000 7f43cb400640 1 --2- 172.21.15.152:0/2989662890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43cc06d070 0x7f43cc13bb50 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f43bc01ab30 tx=0x7f43bc019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:07.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.102+0000 7f43c3e00640 1 -- 172.21.15.152:0/2989662890 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43bc0b9020 con 0x7f43cc06d070 2024-04-17T08:47:07.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.102+0000 7f43c3e00640 1 -- 172.21.15.152:0/2989662890 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43bc0b5410 con 0x7f43cc06d070 2024-04-17T08:47:07.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.102+0000 7f43d2000640 1 -- 172.21.15.152:0/2989662890 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43cc153dc0 con 0x7f43cc06d070 2024-04-17T08:47:07.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.102+0000 7f43c3e00640 1 -- 172.21.15.152:0/2989662890 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43bc0b1040 con 0x7f43cc06d070 2024-04-17T08:47:07.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.102+0000 7f43d2000640 1 -- 172.21.15.152:0/2989662890 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43cc154380 con 0x7f43cc06d070 2024-04-17T08:47:07.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.102+0000 7f43d2000640 1 -- 172.21.15.152:0/2989662890 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43cc068a30 con 0x7f43cc06d070 2024-04-17T08:47:07.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.102+0000 7f43c3e00640 1 -- 172.21.15.152:0/2989662890 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f43bc0bc020 con 0x7f43cc06d070 2024-04-17T08:47:07.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.106+0000 7f43c3e00640 1 --2- 172.21.15.152:0/2989662890 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f43a8068380 0x7f43a806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:07.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.106+0000 7f43c3e00640 1 -- 172.21.15.152:0/2989662890 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f43bc1208d0 con 0x7f43cc06d070 2024-04-17T08:47:07.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.106+0000 7f43c2a00640 1 --2- 172.21.15.152:0/2989662890 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f43a8068380 0x7f43a806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:07.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.106+0000 7f43c2a00640 1 --2- 172.21.15.152:0/2989662890 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f43a8068380 0x7f43a806a840 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f43cc15e700 tx=0x7f43b4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:07.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.110+0000 7f43c3e00640 1 -- 172.21.15.152:0/2989662890 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f43bc0c3030 con 0x7f43cc06d070 2024-04-17T08:47:07.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.298+0000 7f43d2000640 1 -- 172.21.15.152:0/2989662890 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f43cc0cd990 con 0x7f43cc06d070 2024-04-17T08:47:07.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.302+0000 7f43c3e00640 1 -- 172.21.15.152:0/2989662890 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5207 (secure 0 0 0) 0x7f43bc0a9070 con 0x7f43cc06d070 2024-04-17T08:47:07.302 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:47:07.303 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6834/2461981726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":2461981726},{"type":"v1","addr":"172.21.15.196:6834","nonce":2461981726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6835/3397289430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6833","nonce":3397289430},{"type":"v1","addr":"172.21.15.196:6835","nonce":3397289430}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/2491486613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2491486613},{"type":"v1","addr":"172.21.15.152:6836","nonce":2491486613}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-17T08:46:33.607720+0000","modified":"2024-04-17T08:46:57.830153+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6837/3890159871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":3890159871},{"type":"v1","addr":"172.21.15.152:6837","nonce":3890159871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-04-17T08:47:07.303 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 9 2024-04-17T08:47:07.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.302+0000 7f43d2000640 1 -- 172.21.15.152:0/2989662890 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f43a8068380 msgr2=0x7f43a806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:07.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.302+0000 7f43d2000640 1 --2- 172.21.15.152:0/2989662890 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f43a8068380 0x7f43a806a840 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f43cc15e700 tx=0x7f43b4008040 comp rx=0 tx=0).stop 2024-04-17T08:47:07.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.302+0000 7f43d2000640 1 -- 172.21.15.152:0/2989662890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43cc06d070 msgr2=0x7f43cc13bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:07.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.302+0000 7f43d2000640 1 --2- 172.21.15.152:0/2989662890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43cc06d070 0x7f43cc13bb50 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f43bc01ab30 tx=0x7f43bc019220 comp rx=0 tx=0).stop 2024-04-17T08:47:07.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.302+0000 7f43d2000640 1 -- 172.21.15.152:0/2989662890 shutdown_connections 2024-04-17T08:47:07.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.302+0000 7f43d2000640 1 --2- 172.21.15.152:0/2989662890 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f43cc15cbc0 0x7f43cc152360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:07.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.302+0000 7f43d2000640 1 --2- 172.21.15.152:0/2989662890 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f43a8068380 0x7f43a806a840 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:07.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.302+0000 7f43d2000640 1 --2- 172.21.15.152:0/2989662890 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f43cc06d450 0x7f43cc0b26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:07.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.302+0000 7f43d2000640 1 --2- 172.21.15.152:0/2989662890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43cc06d070 0x7f43cc13bb50 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:07.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.302+0000 7f43d2000640 1 -- 172.21.15.152:0/2989662890 >> 172.21.15.152:0/2989662890 conn(0x7f43cc0b31c0 msgr2=0x7f43cc15bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:07.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.302+0000 7f43d2000640 1 -- 172.21.15.152:0/2989662890 shutdown_connections 2024-04-17T08:47:07.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.302+0000 7f43d2000640 1 -- 172.21.15.152:0/2989662890 wait complete. 2024-04-17T08:47:07.323 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T08:47:07.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.458+0000 7f07cc200640 1 Processor -- start 2024-04-17T08:47:07.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.458+0000 7f07cc200640 1 -- start start 2024-04-17T08:47:07.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.458+0000 7f07cc200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07c4145ea0 0x7f07c40d0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:07.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.458+0000 7f07cc200640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07c40ccbb0 con 0x7f07c4071790 2024-04-17T08:47:07.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.458+0000 7f07cc200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07c40cce90 con 0x7f07c40d0790 2024-04-17T08:47:07.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.458+0000 7f07cc200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f07c40cd170 con 0x7f07c4145ea0 2024-04-17T08:47:07.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.458+0000 7f07ca200640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f07c4071790 0x7f07c40cd970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:58576/0 (socket says 172.21.15.152:58576) 2024-04-17T08:47:07.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.458+0000 7f07ca200640 1 -- 172.21.15.152:0/3500549511 learned_addr learned my addr 172.21.15.152:0/3500549511 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:07.462 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.458+0000 7f07c3e00640 1 -- 172.21.15.152:0/3500549511 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2470894633 0 0) 0x7f07c40ccbb0 con 0x7f07c4071790 2024-04-17T08:47:07.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.458+0000 7f07c3e00640 1 -- 172.21.15.152:0/3500549511 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07ac003530 con 0x7f07c4071790 2024-04-17T08:47:07.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.458+0000 7f07c9800640 1 --2- 172.21.15.152:0/3500549511 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07c4145ea0 0x7f07c40d0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:07.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.458+0000 7f07c3e00640 1 -- 172.21.15.152:0/3500549511 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1846705308 0 0) 0x7f07ac003530 con 0x7f07c4071790 2024-04-17T08:47:07.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.458+0000 7f07c3e00640 1 -- 172.21.15.152:0/3500549511 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07c4145ea0 msgr2=0x7f07c40d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:07.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.458+0000 7f07c3e00640 1 --2- 172.21.15.152:0/3500549511 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07c4145ea0 0x7f07c40d0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:07.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.458+0000 7f07c3e00640 1 -- 172.21.15.152:0/3500549511 >> v1:172.21.15.196:6789/0 conn(0x7f07c40d0790 legacy=0x7f07c40c7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:07.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.458+0000 7f07c3e00640 1 -- 172.21.15.152:0/3500549511 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07c40cd450 con 0x7f07c4071790 2024-04-17T08:47:07.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.458+0000 7f07c3e00640 1 -- 172.21.15.152:0/3500549511 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2973887244 0 0) 0x7f07bc001a00 con 0x7f07c4071790 2024-04-17T08:47:07.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.458+0000 7f07c3e00640 1 -- 172.21.15.152:0/3500549511 >> v1:172.21.15.152:6789/0 conn(0x7f07c4071790 legacy=0x7f07c40cd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:07.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.458+0000 7f07c3e00640 1 --2- 172.21.15.152:0/3500549511 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07ac0039f0 0x7f07ac003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:07.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.458+0000 7f07c3e00640 1 --2- 172.21.15.152:0/3500549511 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07c4145ea0 0x7f07ac004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:07.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.458+0000 7f07c3e00640 1 --2- 172.21.15.152:0/3500549511 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07ac004d50 0x7f07ac0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:07.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.458+0000 7f07c3e00640 1 -- 172.21.15.152:0/3500549511 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f07c40cd170 con 0x7f07ac0039f0 2024-04-17T08:47:07.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.458+0000 7f07c3e00640 1 -- 172.21.15.152:0/3500549511 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f07ac00ba80 con 0x7f07ac004d50 2024-04-17T08:47:07.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.458+0000 7f07c3e00640 1 -- 172.21.15.152:0/3500549511 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f07ac00bc80 con 0x7f07c4145ea0 2024-04-17T08:47:07.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.458+0000 7f07c9800640 1 --2- 172.21.15.152:0/3500549511 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07ac0039f0 0x7f07ac003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:07.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.462+0000 7f07ca200640 1 --2- 172.21.15.152:0/3500549511 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07ac004d50 0x7f07ac0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:07.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.462+0000 7f07c8e00640 1 --2- 172.21.15.152:0/3500549511 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07c4145ea0 0x7f07ac004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:07.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.462+0000 7f07c9800640 1 -- 172.21.15.152:0/3500549511 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07c4145ea0 msgr2=0x7f07ac004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:07.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.462+0000 7f07c9800640 1 --2- 172.21.15.152:0/3500549511 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07c4145ea0 0x7f07ac004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:07.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.462+0000 7f07c9800640 1 -- 172.21.15.152:0/3500549511 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07ac004d50 msgr2=0x7f07ac0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:07.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.462+0000 7f07c9800640 1 --2- 172.21.15.152:0/3500549511 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07ac004d50 0x7f07ac0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:07.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.462+0000 7f07c9800640 1 -- 172.21.15.152:0/3500549511 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07ac003530 con 0x7f07ac0039f0 2024-04-17T08:47:07.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.462+0000 7f07c9800640 1 --2- 172.21.15.152:0/3500549511 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07ac0039f0 0x7f07ac003dd0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f07b800ba00 tx=0x7f07b801c660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11713e49fd9f052 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:07.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.462+0000 7f07c3e00640 1 -- 172.21.15.152:0/3500549511 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b800b600 con 0x7f07ac0039f0 2024-04-17T08:47:07.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.462+0000 7f07c3e00640 1 -- 172.21.15.152:0/3500549511 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07b80b0070 con 0x7f07ac0039f0 2024-04-17T08:47:07.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.462+0000 7f07c3e00640 1 -- 172.21.15.152:0/3500549511 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b80ab8b0 con 0x7f07ac0039f0 2024-04-17T08:47:07.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.462+0000 7f07cc200640 1 -- 172.21.15.152:0/3500549511 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07ac0039f0 msgr2=0x7f07ac003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:07.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.462+0000 7f07cc200640 1 --2- 172.21.15.152:0/3500549511 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07ac0039f0 0x7f07ac003dd0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f07b800ba00 tx=0x7f07b801c660 comp rx=0 tx=0).stop 2024-04-17T08:47:07.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.462+0000 7f07ca200640 1 -- 172.21.15.152:0/3500549511 reap_dead start 2024-04-17T08:47:07.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.462+0000 7f07cc200640 1 -- 172.21.15.152:0/3500549511 shutdown_connections 2024-04-17T08:47:07.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.462+0000 7f07cc200640 1 -- 172.21.15.152:0/3500549511 >> 172.21.15.152:0/3500549511 conn(0x7f07c40d2350 msgr2=0x7f07c40d2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:07.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.466+0000 7f07cc200640 1 -- 172.21.15.152:0/3500549511 shutdown_connections 2024-04-17T08:47:07.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.466+0000 7f07cc200640 1 -- 172.21.15.152:0/3500549511 wait complete. 2024-04-17T08:47:07.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.466+0000 7f07cc200640 1 Processor -- start 2024-04-17T08:47:07.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.466+0000 7f07cc200640 1 -- start start 2024-04-17T08:47:07.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.466+0000 7f07cc200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07ac0039f0 0x7f07c40cbe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:07.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.466+0000 7f07cc200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07c4140700 0x7f07c41433d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:07.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.466+0000 7f07cc200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07c414f190 0x7f07c415da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:07.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.466+0000 7f07cc200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f07c40c7940 con 0x7f07c414f190 2024-04-17T08:47:07.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.466+0000 7f07cc200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f07c40b2cf0 con 0x7f07ac0039f0 2024-04-17T08:47:07.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.466+0000 7f07cc200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f07c40c7ac0 con 0x7f07c4140700 2024-04-17T08:47:07.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.466+0000 7f07ca200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07c414f190 0x7f07c415da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:07.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.466+0000 7f07ca200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07c414f190 0x7f07c415da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47238/0 (socket says 172.21.15.152:47238) 2024-04-17T08:47:07.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.466+0000 7f07ca200640 1 -- 172.21.15.152:0/1208534628 learned_addr learned my addr 172.21.15.152:0/1208534628 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:07.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.466+0000 7f07c9800640 1 --2- 172.21.15.152:0/1208534628 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07ac0039f0 0x7f07c40cbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:07.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.466+0000 7f07c8e00640 1 --2- 172.21.15.152:0/1208534628 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07c4140700 0x7f07c41433d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:07.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.466+0000 7f07ca200640 1 -- 172.21.15.152:0/1208534628 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07c4140700 msgr2=0x7f07c41433d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:07.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.466+0000 7f07ca200640 1 --2- 172.21.15.152:0/1208534628 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07c4140700 0x7f07c41433d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:07.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.466+0000 7f07ca200640 1 -- 172.21.15.152:0/1208534628 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07ac0039f0 msgr2=0x7f07c40cbe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:07.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.466+0000 7f07ca200640 1 --2- 172.21.15.152:0/1208534628 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07ac0039f0 0x7f07c40cbe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:07.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.466+0000 7f07ca200640 1 -- 172.21.15.152:0/1208534628 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07c4140be0 con 0x7f07c414f190 2024-04-17T08:47:07.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.466+0000 7f07ca200640 1 --2- 172.21.15.152:0/1208534628 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07c414f190 0x7f07c415da20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f07bc000f90 tx=0x7f07bc007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:07.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.466+0000 7f07c1600640 1 -- 172.21.15.152:0/1208534628 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07bc00eb00 con 0x7f07c414f190 2024-04-17T08:47:07.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.466+0000 7f07c1600640 1 -- 172.21.15.152:0/1208534628 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07bc018070 con 0x7f07c414f190 2024-04-17T08:47:07.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.466+0000 7f07c1600640 1 -- 172.21.15.152:0/1208534628 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07bc013420 con 0x7f07c414f190 2024-04-17T08:47:07.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.466+0000 7f07cc200640 1 -- 172.21.15.152:0/1208534628 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07c414e6b0 con 0x7f07c414f190 2024-04-17T08:47:07.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.470+0000 7f07cc200640 1 -- 172.21.15.152:0/1208534628 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07c414ec70 con 0x7f07c414f190 2024-04-17T08:47:07.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.470+0000 7f07cc200640 1 -- 172.21.15.152:0/1208534628 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07c4068a30 con 0x7f07c414f190 2024-04-17T08:47:07.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.470+0000 7f07c1600640 1 -- 172.21.15.152:0/1208534628 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f07bc0135c0 con 0x7f07c414f190 2024-04-17T08:47:07.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.470+0000 7f07c1600640 1 --2- 172.21.15.152:0/1208534628 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f07a4068380 0x7f07a406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:07.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.470+0000 7f07c1600640 1 -- 172.21.15.152:0/1208534628 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f07bc086f90 con 0x7f07c414f190 2024-04-17T08:47:07.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.470+0000 7f07c9800640 1 --2- 172.21.15.152:0/1208534628 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f07a4068380 0x7f07a406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:07.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.470+0000 7f07c9800640 1 --2- 172.21.15.152:0/1208534628 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f07a4068380 0x7f07a406a840 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f07b80af000 tx=0x7f07b80b6040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:07.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.474+0000 7f07c1600640 1 -- 172.21.15.152:0/1208534628 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f07bc056b20 con 0x7f07c414f190 2024-04-17T08:47:07.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.634+0000 7f07cc200640 1 -- 172.21.15.152:0/1208534628 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f07c414ee40 con 0x7f07c414f190 2024-04-17T08:47:07.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.634+0000 7f07c1600640 1 -- 172.21.15.152:0/1208534628 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7f07bc05ae20 con 0x7f07c414f190 2024-04-17T08:47:07.637 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:47:07.637 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":24,"fsid":"ce68f82e-ec5f-4205-9fd5-bdfdf6ef31e2","created":"2024-04-17T08:46:08.353546+0000","modified":"2024-04-17T08:46:38.659862+0000","last_up_change":"2024-04-17T08:46:20.738799+0000","last_in_change":"2024-04-17T08:46:11.210050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T08:46:21.386856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T08:46:31.812460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T08:46:32.555559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T08:46:36.258078+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"682f0192-187c-404e-bc7a-b6b4e23825e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6819","nonce":3603799291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6823","nonce":3603799291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6831","nonce":3603799291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6827","nonce":3603799291}]},"public_addr":"172.21.15.152:6819/3603799291","cluster_addr":"172.21.15.152:6823/3603799291","heartbeat_back_addr":"172.21.15.152:6831/3603799291","heartbeat_front_addr":"172.21.15.152:6827/3603799291","state":["exists","up"]},{"osd":1,"uuid":"f0fe8fef-60ec-4a39-83b6-2fa6a5adb0f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6801","nonce":4133383142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6803","nonce":4133383142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6807","nonce":4133383142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6805","nonce":4133383142}]},"public_addr":"172.21.15.152:6801/4133383142","cluster_addr":"172.21.15.152:6803/4133383142","heartbeat_back_addr":"172.21.15.152:6807/4133383142","heartbeat_front_addr":"172.21.15.152:6805/4133383142","state":["exists","up"]},{"osd":2,"uuid":"35f36d9c-5245-4431-a618-f4df0fa380ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6809","nonce":3826143898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6811","nonce":3826143898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6815","nonce":3826143898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6813","nonce":3826143898}]},"public_addr":"172.21.15.152:6809/3826143898","cluster_addr":"172.21.15.152:6811/3826143898","heartbeat_back_addr":"172.21.15.152:6815/3826143898","heartbeat_front_addr":"172.21.15.152:6813/3826143898","state":["exists","up"]},{"osd":3,"uuid":"96e56ca5-15b4-4895-9b79-da2c92043159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6818","nonce":165717826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6822","nonce":165717826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6830","nonce":165717826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6826","nonce":165717826}]},"public_addr":"172.21.15.152:6818/165717826","cluster_addr":"172.21.15.152:6822/165717826","heartbeat_back_addr":"172.21.15.152:6830/165717826","heartbeat_front_addr":"172.21.15.152:6826/165717826","state":["exists","up"]},{"osd":4,"uuid":"f5aa10a4-9ff9-41fe-a5c9-15326f982cc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6817","nonce":4080159297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6819","nonce":4080159297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6823","nonce":4080159297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6821","nonce":4080159297}]},"public_addr":"172.21.15.196:6817/4080159297","cluster_addr":"172.21.15.196:6819/4080159297","heartbeat_back_addr":"172.21.15.196:6823/4080159297","heartbeat_front_addr":"172.21.15.196:6821/4080159297","state":["exists","up"]},{"osd":5,"uuid":"42bab884-3476-47ae-ac65-935fa6e0f055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6801","nonce":3519444232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6803","nonce":3519444232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6807","nonce":3519444232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6805","nonce":3519444232}]},"public_addr":"172.21.15.196:6801/3519444232","cluster_addr":"172.21.15.196:6803/3519444232","heartbeat_back_addr":"172.21.15.196:6807/3519444232","heartbeat_front_addr":"172.21.15.196:6805/3519444232","state":["exists","up"]},{"osd":6,"uuid":"460b6167-f57b-4224-9c92-cfc9b80bbe99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6809","nonce":275739834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6811","nonce":275739834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6815","nonce":275739834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6813","nonce":275739834}]},"public_addr":"172.21.15.196:6809/275739834","cluster_addr":"172.21.15.196:6811/275739834","heartbeat_back_addr":"172.21.15.196:6815/275739834","heartbeat_front_addr":"172.21.15.196:6813/275739834","state":["exists","up"]},{"osd":7,"uuid":"d695643f-5e07-4e2a-a646-c06bd97b6650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6825","nonce":307626968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6827","nonce":307626968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6831","nonce":307626968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6829","nonce":307626968}]},"public_addr":"172.21.15.196:6825/307626968","cluster_addr":"172.21.15.196:6827/307626968","heartbeat_back_addr":"172.21.15.196:6831/307626968","heartbeat_front_addr":"172.21.15.196:6829/307626968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.293257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.964533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.248895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.010000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.832554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.743704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930171+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930962+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T08:47:07.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.638+0000 7f07cc200640 1 -- 172.21.15.152:0/1208534628 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f07a4068380 msgr2=0x7f07a406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:07.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.638+0000 7f07cc200640 1 --2- 172.21.15.152:0/1208534628 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f07a4068380 0x7f07a406a840 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f07b80af000 tx=0x7f07b80b6040 comp rx=0 tx=0).stop 2024-04-17T08:47:07.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.638+0000 7f07cc200640 1 -- 172.21.15.152:0/1208534628 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07c414f190 msgr2=0x7f07c415da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:07.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.638+0000 7f07cc200640 1 --2- 172.21.15.152:0/1208534628 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07c414f190 0x7f07c415da20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f07bc000f90 tx=0x7f07bc007bc0 comp rx=0 tx=0).stop 2024-04-17T08:47:07.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.638+0000 7f07cc200640 1 -- 172.21.15.152:0/1208534628 shutdown_connections 2024-04-17T08:47:07.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.638+0000 7f07cc200640 1 --2- 172.21.15.152:0/1208534628 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07c414f190 0x7f07c415da20 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:07.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.638+0000 7f07cc200640 1 --2- 172.21.15.152:0/1208534628 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f07a4068380 0x7f07a406a840 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:07.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.638+0000 7f07cc200640 1 --2- 172.21.15.152:0/1208534628 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07c4140700 0x7f07c41433d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:07.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.638+0000 7f07cc200640 1 --2- 172.21.15.152:0/1208534628 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07ac0039f0 0x7f07c40cbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:07.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.638+0000 7f07cc200640 1 -- 172.21.15.152:0/1208534628 >> 172.21.15.152:0/1208534628 conn(0x7f07c40d2350 msgr2=0x7f07c40c7230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:07.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.638+0000 7f07cc200640 1 -- 172.21.15.152:0/1208534628 shutdown_connections 2024-04-17T08:47:07.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.638+0000 7f07cc200640 1 -- 172.21.15.152:0/1208534628 wait complete. 2024-04-17T08:47:07.658 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T08:47:07.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.794+0000 7f613e600640 1 Processor -- start 2024-04-17T08:47:07.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.794+0000 7f613e600640 1 -- start start 2024-04-17T08:47:07.795 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.794+0000 7f613e600640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f61380af670 0x7f613815b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:07.795 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.794+0000 7f613e600640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6138072c40 con 0x7f61380d0360 2024-04-17T08:47:07.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.794+0000 7f613e600640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f613815c260 con 0x7f613806f980 2024-04-17T08:47:07.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.794+0000 7f613e600640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f613815c820 con 0x7f61380af670 2024-04-17T08:47:07.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.794+0000 7f6137400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f61380af670 0x7f613815b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:07.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.794+0000 7f6137e00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f61380d0360 0x7f613806dc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:58592/0 (socket says 172.21.15.152:58592) 2024-04-17T08:47:07.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.794+0000 7f6137e00640 1 -- 172.21.15.152:0/1765874245 learned_addr learned my addr 172.21.15.152:0/1765874245 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:07.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.794+0000 7f6137400640 1 -- 172.21.15.152:0/1765874245 >> v1:172.21.15.196:6789/0 conn(0x7f613806f980 legacy=0x7f6138072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:07.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.794+0000 7f6137400640 1 -- 172.21.15.152:0/1765874245 >> v1:172.21.15.152:6789/0 conn(0x7f61380d0360 legacy=0x7f613806dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:07.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.794+0000 7f6137400640 1 -- 172.21.15.152:0/1765874245 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f613815c540 con 0x7f61380af670 2024-04-17T08:47:07.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.794+0000 7f6136000640 1 -- 172.21.15.152:0/1765874245 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 620187923 0 0) 0x7f6138072c40 con 0x7f61380d0360 2024-04-17T08:47:07.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.798+0000 7f6137400640 1 --2- 172.21.15.152:0/1765874245 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61380af670 0x7f613815b8c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f61280097c0 tx=0x7f612801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8480a47821848f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:07.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.798+0000 7f6136000640 1 -- 172.21.15.152:0/1765874245 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61280b1070 con 0x7f61380af670 2024-04-17T08:47:07.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.798+0000 7f6136000640 1 -- 172.21.15.152:0/1765874245 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61280ac600 con 0x7f61380af670 2024-04-17T08:47:07.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.798+0000 7f6136000640 1 -- 172.21.15.152:0/1765874245 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61280ac9d0 con 0x7f61380af670 2024-04-17T08:47:07.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.798+0000 7f613e600640 1 -- 172.21.15.152:0/1765874245 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61380af670 msgr2=0x7f613815b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:07.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.798+0000 7f613e600640 1 --2- 172.21.15.152:0/1765874245 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61380af670 0x7f613815b8c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f61280097c0 tx=0x7f612801c3a0 comp rx=0 tx=0).stop 2024-04-17T08:47:07.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.798+0000 7f613e600640 1 -- 172.21.15.152:0/1765874245 shutdown_connections 2024-04-17T08:47:07.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.798+0000 7f613e600640 1 --2- 172.21.15.152:0/1765874245 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61380af670 0x7f613815b8c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:07.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.798+0000 7f613e600640 1 -- 172.21.15.152:0/1765874245 >> 172.21.15.152:0/1765874245 conn(0x7f61380b3350 msgr2=0x7f61380b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:07.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.798+0000 7f613e600640 1 -- 172.21.15.152:0/1765874245 shutdown_connections 2024-04-17T08:47:07.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.798+0000 7f613e600640 1 -- 172.21.15.152:0/1765874245 wait complete. 2024-04-17T08:47:07.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.798+0000 7f613e600640 1 Processor -- start 2024-04-17T08:47:07.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.798+0000 7f613e600640 1 -- start start 2024-04-17T08:47:07.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.802+0000 7f613e600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f613806f980 0x7f6138150ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:07.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.802+0000 7f613e600640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61380af670 0x7f61380b0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:07.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.802+0000 7f613e600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f61380d0360 0x7f6138154e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:07.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.802+0000 7f613e600640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f61380d0b80 con 0x7f61380af670 2024-04-17T08:47:07.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.802+0000 7f613e600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f613815be00 con 0x7f613806f980 2024-04-17T08:47:07.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.802+0000 7f613e600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f61380afc60 con 0x7f61380d0360 2024-04-17T08:47:07.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.802+0000 7f6136a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61380af670 0x7f61380b0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:07.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.802+0000 7f6136a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61380af670 0x7f61380b0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47256/0 (socket says 172.21.15.152:47256) 2024-04-17T08:47:07.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.802+0000 7f6136a00640 1 -- 172.21.15.152:0/677539918 learned_addr learned my addr 172.21.15.152:0/677539918 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:07.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.802+0000 7f6137400640 1 --2- 172.21.15.152:0/677539918 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f613806f980 0x7f6138150ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:07.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.802+0000 7f6137e00640 1 --2- 172.21.15.152:0/677539918 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f61380d0360 0x7f6138154e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:07.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.802+0000 7f6136a00640 1 -- 172.21.15.152:0/677539918 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f61380d0360 msgr2=0x7f6138154e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:07.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.802+0000 7f6136a00640 1 --2- 172.21.15.152:0/677539918 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f61380d0360 0x7f6138154e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:07.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.802+0000 7f6136a00640 1 -- 172.21.15.152:0/677539918 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f613806f980 msgr2=0x7f6138150ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:07.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.802+0000 7f6136a00640 1 --2- 172.21.15.152:0/677539918 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f613806f980 0x7f6138150ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:07.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.802+0000 7f6136a00640 1 -- 172.21.15.152:0/677539918 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6138155360 con 0x7f61380af670 2024-04-17T08:47:07.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.802+0000 7f6136a00640 1 --2- 172.21.15.152:0/677539918 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61380af670 0x7f61380b0f50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f612400c410 tx=0x7f612400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:07.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.802+0000 7f612f400640 1 -- 172.21.15.152:0/677539918 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6124011790 con 0x7f61380af670 2024-04-17T08:47:07.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.802+0000 7f612f400640 1 -- 172.21.15.152:0/677539918 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6124017070 con 0x7f61380af670 2024-04-17T08:47:07.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.802+0000 7f612f400640 1 -- 172.21.15.152:0/677539918 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6124011bb0 con 0x7f61380af670 2024-04-17T08:47:07.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.802+0000 7f613e600640 1 -- 172.21.15.152:0/677539918 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61380afeb0 con 0x7f61380af670 2024-04-17T08:47:07.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.802+0000 7f613e600640 1 -- 172.21.15.152:0/677539918 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61380b0470 con 0x7f61380af670 2024-04-17T08:47:07.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.802+0000 7f613e600640 1 -- 172.21.15.152:0/677539918 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6138068a30 con 0x7f61380af670 2024-04-17T08:47:07.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.806+0000 7f612f400640 1 -- 172.21.15.152:0/677539918 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f612401c460 con 0x7f61380af670 2024-04-17T08:47:07.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.806+0000 7f612f400640 1 --2- 172.21.15.152:0/677539918 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f6118068380 0x7f611806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:07.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.806+0000 7f612f400640 1 -- 172.21.15.152:0/677539918 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f61240868e0 con 0x7f61380af670 2024-04-17T08:47:07.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.806+0000 7f6137400640 1 --2- 172.21.15.152:0/677539918 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f6118068380 0x7f611806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:07.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.806+0000 7f6137400640 1 --2- 172.21.15.152:0/677539918 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f6118068380 0x7f611806a840 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f61280ae000 tx=0x7f61280a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:07.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.810+0000 7f612f400640 1 -- 172.21.15.152:0/677539918 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f6124021020 con 0x7f61380af670 2024-04-17T08:47:08.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.998+0000 7f613e600640 1 -- 172.21.15.152:0/677539918 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6138072a20 con 0x7f61380af670 2024-04-17T08:47:08.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:07.998+0000 7f612f400640 1 -- 172.21.15.152:0/677539918 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5207 (secure 0 0 0) 0x7f6124056b50 con 0x7f61380af670 2024-04-17T08:47:08.001 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:47:08.001 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6834/2461981726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":2461981726},{"type":"v1","addr":"172.21.15.196:6834","nonce":2461981726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6835/3397289430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6833","nonce":3397289430},{"type":"v1","addr":"172.21.15.196:6835","nonce":3397289430}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/2491486613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2491486613},{"type":"v1","addr":"172.21.15.152:6836","nonce":2491486613}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-17T08:46:33.607720+0000","modified":"2024-04-17T08:46:57.830153+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6837/3890159871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":3890159871},{"type":"v1","addr":"172.21.15.152:6837","nonce":3890159871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-04-17T08:47:08.002 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 9 2024-04-17T08:47:08.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.002+0000 7f613e600640 1 -- 172.21.15.152:0/677539918 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f6118068380 msgr2=0x7f611806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:08.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.002+0000 7f613e600640 1 --2- 172.21.15.152:0/677539918 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f6118068380 0x7f611806a840 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f61280ae000 tx=0x7f61280a7000 comp rx=0 tx=0).stop 2024-04-17T08:47:08.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.002+0000 7f613e600640 1 -- 172.21.15.152:0/677539918 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61380af670 msgr2=0x7f61380b0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:08.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.002+0000 7f613e600640 1 --2- 172.21.15.152:0/677539918 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61380af670 0x7f61380b0f50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f612400c410 tx=0x7f612400c8d0 comp rx=0 tx=0).stop 2024-04-17T08:47:08.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.002+0000 7f613e600640 1 -- 172.21.15.152:0/677539918 shutdown_connections 2024-04-17T08:47:08.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.002+0000 7f613e600640 1 --2- 172.21.15.152:0/677539918 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f6118068380 0x7f611806a840 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:08.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.002+0000 7f613e600640 1 --2- 172.21.15.152:0/677539918 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f61380d0360 0x7f6138154e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:08.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.002+0000 7f613e600640 1 --2- 172.21.15.152:0/677539918 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61380af670 0x7f61380b0f50 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:08.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.002+0000 7f613e600640 1 --2- 172.21.15.152:0/677539918 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f613806f980 0x7f6138150ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:08.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.002+0000 7f613e600640 1 -- 172.21.15.152:0/677539918 >> 172.21.15.152:0/677539918 conn(0x7f61380b3350 msgr2=0x7f61380b3730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:08.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.002+0000 7f613e600640 1 -- 172.21.15.152:0/677539918 shutdown_connections 2024-04-17T08:47:08.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.002+0000 7f613e600640 1 -- 172.21.15.152:0/677539918 wait complete. 2024-04-17T08:47:08.425 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-17T08:46:33.607720+0000', 'modified': '2024-04-17T08:46:57.830153+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'snap_rstat': True, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4278}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4278': {'gid': 4278, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.152:6837/3890159871', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6835', 'nonce': 3890159871}, {'type': 'v1', 'addr': '172.21.15.152:6837', 'nonce': 3890159871}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4278, 'qdb_cluster': [4278]} 2024-04-17T08:47:08.425 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-17T08:47:08.425 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-17T08:47:08.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.562+0000 7fd981e00640 1 Processor -- start 2024-04-17T08:47:08.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.562+0000 7fd981e00640 1 -- start start 2024-04-17T08:47:08.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.562+0000 7fd981e00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd97c0b5760 0x7fd97c15ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:08.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.562+0000 7fd981e00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd97c15f290 con 0x7fd97c0ce730 2024-04-17T08:47:08.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.562+0000 7fd981e00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd97c15f570 con 0x7fd97c0b3e90 2024-04-17T08:47:08.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.562+0000 7fd981e00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fd97c15fb30 con 0x7fd97c0b5760 2024-04-17T08:47:08.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.562+0000 7fd97aa00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd97c0b5760 0x7fd97c15ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:08.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.562+0000 7fd972000640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fd97c0ce730 0x7fd97c0d0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:55578/0 (socket says 172.21.15.152:55578) 2024-04-17T08:47:08.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.562+0000 7fd972000640 1 -- 172.21.15.152:0/2870802744 learned_addr learned my addr 172.21.15.152:0/2870802744 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:08.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.562+0000 7fd97aa00640 1 -- 172.21.15.152:0/2870802744 >> v1:172.21.15.196:6789/0 conn(0x7fd97c0b3e90 legacy=0x7fd97c0b7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:08.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.562+0000 7fd97aa00640 1 -- 172.21.15.152:0/2870802744 >> v1:172.21.15.152:6789/0 conn(0x7fd97c0ce730 legacy=0x7fd97c0d0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:08.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.562+0000 7fd97aa00640 1 -- 172.21.15.152:0/2870802744 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd97c15f850 con 0x7fd97c0b5760 2024-04-17T08:47:08.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.562+0000 7fd97a000640 1 -- 172.21.15.152:0/2870802744 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3274427409 0 0) 0x7fd97c15f290 con 0x7fd97c0ce730 2024-04-17T08:47:08.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.566+0000 7fd97aa00640 1 --2- 172.21.15.152:0/2870802744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd97c0b5760 0x7fd97c15ec00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd97c15fcb0 tx=0x7fd96c01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9517d51e4af7aea server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:08.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.566+0000 7fd97a000640 1 -- 172.21.15.152:0/2870802744 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd96c0b0070 con 0x7fd97c0b5760 2024-04-17T08:47:08.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.566+0000 7fd97a000640 1 -- 172.21.15.152:0/2870802744 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd96c0ab600 con 0x7fd97c0b5760 2024-04-17T08:47:08.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.566+0000 7fd97a000640 1 -- 172.21.15.152:0/2870802744 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd96c0ab9d0 con 0x7fd97c0b5760 2024-04-17T08:47:08.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.566+0000 7fd981e00640 1 -- 172.21.15.152:0/2870802744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd97c0b5760 msgr2=0x7fd97c15ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:08.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.566+0000 7fd981e00640 1 --2- 172.21.15.152:0/2870802744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd97c0b5760 0x7fd97c15ec00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd97c15fcb0 tx=0x7fd96c01c3d0 comp rx=0 tx=0).stop 2024-04-17T08:47:08.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.566+0000 7fd981e00640 1 -- 172.21.15.152:0/2870802744 shutdown_connections 2024-04-17T08:47:08.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.566+0000 7fd981e00640 1 --2- 172.21.15.152:0/2870802744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd97c0b5760 0x7fd97c15ec00 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:08.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.566+0000 7fd981e00640 1 -- 172.21.15.152:0/2870802744 >> 172.21.15.152:0/2870802744 conn(0x7fd97c0cf060 msgr2=0x7fd97c0cf470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:08.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.566+0000 7fd981e00640 1 -- 172.21.15.152:0/2870802744 shutdown_connections 2024-04-17T08:47:08.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.566+0000 7fd981e00640 1 -- 172.21.15.152:0/2870802744 wait complete. 2024-04-17T08:47:08.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.570+0000 7fd981e00640 1 Processor -- start 2024-04-17T08:47:08.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.570+0000 7fd981e00640 1 -- start start 2024-04-17T08:47:08.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.570+0000 7fd981e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd97c0b3e90 0x7fd97c0c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:08.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.570+0000 7fd981e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd97c0b5760 0x7fd97c1555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:08.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.570+0000 7fd981e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd97c0ce730 0x7fd97c14cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:08.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.570+0000 7fd981e00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd97c0d0ec0 con 0x7fd97c0b5760 2024-04-17T08:47:08.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.570+0000 7fd981e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd97c0d0d40 con 0x7fd97c0b3e90 2024-04-17T08:47:08.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.570+0000 7fd981e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fd97c16cdb0 con 0x7fd97c0ce730 2024-04-17T08:47:08.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.570+0000 7fd972000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd97c0b5760 0x7fd97c1555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:08.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.570+0000 7fd972000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd97c0b5760 0x7fd97c1555a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46186/0 (socket says 172.21.15.152:46186) 2024-04-17T08:47:08.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.570+0000 7fd972000640 1 -- 172.21.15.152:0/2301435732 learned_addr learned my addr 172.21.15.152:0/2301435732 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:08.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.570+0000 7fd97b400640 1 --2- 172.21.15.152:0/2301435732 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd97c0ce730 0x7fd97c14cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:08.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.570+0000 7fd97aa00640 1 --2- 172.21.15.152:0/2301435732 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd97c0b3e90 0x7fd97c0c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:08.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.570+0000 7fd972000640 1 -- 172.21.15.152:0/2301435732 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd97c0ce730 msgr2=0x7fd97c14cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:08.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.570+0000 7fd972000640 1 --2- 172.21.15.152:0/2301435732 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd97c0ce730 0x7fd97c14cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:08.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.570+0000 7fd972000640 1 -- 172.21.15.152:0/2301435732 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd97c0b3e90 msgr2=0x7fd97c0c7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:08.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.570+0000 7fd972000640 1 --2- 172.21.15.152:0/2301435732 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd97c0b3e90 0x7fd97c0c7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:08.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.570+0000 7fd972000640 1 -- 172.21.15.152:0/2301435732 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd97c15e700 con 0x7fd97c0b5760 2024-04-17T08:47:08.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.570+0000 7fd97aa00640 1 --2- 172.21.15.152:0/2301435732 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd97c0b3e90 0x7fd97c0c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:47:08.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.570+0000 7fd97b400640 1 --2- 172.21.15.152:0/2301435732 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd97c0ce730 0x7fd97c14cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:08.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.570+0000 7fd972000640 1 --2- 172.21.15.152:0/2301435732 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd97c0b5760 0x7fd97c1555a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd9640011f0 tx=0x7fd96400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:08.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.570+0000 7fd973e00640 1 -- 172.21.15.152:0/2301435732 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd964018070 con 0x7fd97c0b5760 2024-04-17T08:47:08.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.570+0000 7fd973e00640 1 -- 172.21.15.152:0/2301435732 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9640074e0 con 0x7fd97c0b5760 2024-04-17T08:47:08.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.570+0000 7fd981e00640 1 -- 172.21.15.152:0/2301435732 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd97c0c8520 con 0x7fd97c0b5760 2024-04-17T08:47:08.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.570+0000 7fd973e00640 1 -- 172.21.15.152:0/2301435732 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd964004a10 con 0x7fd97c0b5760 2024-04-17T08:47:08.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.570+0000 7fd981e00640 1 -- 172.21.15.152:0/2301435732 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd97c1505a0 con 0x7fd97c0b5760 2024-04-17T08:47:08.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.574+0000 7fd973e00640 1 -- 172.21.15.152:0/2301435732 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd96401b070 con 0x7fd97c0b5760 2024-04-17T08:47:08.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.574+0000 7fd973e00640 1 --2- 172.21.15.152:0/2301435732 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fd958068380 0x7fd95806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:08.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.574+0000 7fd973e00640 1 -- 172.21.15.152:0/2301435732 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd9640860b0 con 0x7fd97c0b5760 2024-04-17T08:47:08.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.574+0000 7fd97aa00640 1 --2- 172.21.15.152:0/2301435732 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fd958068380 0x7fd95806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:08.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.574+0000 7fd98528b000 1 Processor -- start 2024-04-17T08:47:08.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.574+0000 7fd97aa00640 1 --2- 172.21.15.152:0/2301435732 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fd958068380 0x7fd95806a840 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd96c0ad000 tx=0x7fd96c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:08.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.574+0000 7fd98528b000 1 -- start start 2024-04-17T08:47:08.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.578+0000 7fd98528b000 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f5bb5fb50 0x560f5bb5ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:08.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.578+0000 7fd98528b000 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x560f5bb60470 0x560f5bb157b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:08.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.578+0000 7fd98528b000 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f5bb15cf0 0x560f5bb160d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:08.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.578+0000 7fd98528b000 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x560f5b9634d0 con 0x560f5bb15cf0 2024-04-17T08:47:08.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.578+0000 7fd98528b000 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x560f5b8fdbf0 con 0x560f5bb5fb50 2024-04-17T08:47:08.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.578+0000 7fd98528b000 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x560f5b95f490 con 0x560f5bb60470 2024-04-17T08:47:08.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.578+0000 7fd97b400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f5bb15cf0 0x560f5bb160d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:08.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.578+0000 7fd97b400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f5bb15cf0 0x560f5bb160d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46202/0 (socket says 172.21.15.152:46202) 2024-04-17T08:47:08.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.578+0000 7fd97b400640 1 -- 172.21.15.152:0/3500080867 learned_addr learned my addr 172.21.15.152:0/3500080867 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:08.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.578+0000 7fd97aa00640 1 --2- 172.21.15.152:0/3500080867 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f5bb5fb50 0x560f5bb5ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:08.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.578+0000 7fd972000640 1 --2- 172.21.15.152:0/3500080867 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x560f5bb60470 0x560f5bb157b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:08.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.578+0000 7fd97b400640 1 -- 172.21.15.152:0/3500080867 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x560f5bb60470 msgr2=0x560f5bb157b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:08.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.578+0000 7fd97b400640 1 --2- 172.21.15.152:0/3500080867 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x560f5bb60470 0x560f5bb157b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:08.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.578+0000 7fd97b400640 1 -- 172.21.15.152:0/3500080867 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f5bb5fb50 msgr2=0x560f5bb5ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:08.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.578+0000 7fd97b400640 1 --2- 172.21.15.152:0/3500080867 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f5bb5fb50 0x560f5bb5ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:08.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.578+0000 7fd97b400640 1 -- 172.21.15.152:0/3500080867 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f5b8e9e80 con 0x560f5bb15cf0 2024-04-17T08:47:08.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.578+0000 7fd972000640 1 --2- 172.21.15.152:0/3500080867 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x560f5bb60470 0x560f5bb157b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:08.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.578+0000 7fd97b400640 1 --2- 172.21.15.152:0/3500080867 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f5bb15cf0 0x560f5bb160d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd974009fa0 tx=0x7fd97400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df729b4e3c9d85e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:08.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.578+0000 7fd96be00640 1 -- 172.21.15.152:0/3500080867 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd974003980 con 0x560f5bb15cf0 2024-04-17T08:47:08.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.578+0000 7fd96be00640 1 -- 172.21.15.152:0/3500080867 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd974003b40 con 0x560f5bb15cf0 2024-04-17T08:47:08.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.578+0000 7fd96be00640 1 -- 172.21.15.152:0/3500080867 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd974004020 con 0x560f5bb15cf0 2024-04-17T08:47:08.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.578+0000 7fd98528b000 1 -- 172.21.15.152:0/3500080867 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f5bb15cf0 msgr2=0x560f5bb160d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:08.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.578+0000 7fd98528b000 1 --2- 172.21.15.152:0/3500080867 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f5bb15cf0 0x560f5bb160d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd974009fa0 tx=0x7fd97400c890 comp rx=0 tx=0).stop 2024-04-17T08:47:08.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.578+0000 7fd98528b000 1 -- 172.21.15.152:0/3500080867 shutdown_connections 2024-04-17T08:47:08.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.578+0000 7fd98528b000 1 --2- 172.21.15.152:0/3500080867 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f5bb15cf0 0x560f5bb160d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:08.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.578+0000 7fd98528b000 1 --2- 172.21.15.152:0/3500080867 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x560f5bb60470 0x560f5bb157b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:08.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.578+0000 7fd98528b000 1 --2- 172.21.15.152:0/3500080867 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f5bb5fb50 0x560f5bb5ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:08.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.578+0000 7fd98528b000 1 -- 172.21.15.152:0/3500080867 >> 172.21.15.152:0/3500080867 conn(0x560f5bb1b470 msgr2=0x560f5bb14090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:08.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.578+0000 7fd98528b000 1 -- 172.21.15.152:0/3500080867 shutdown_connections 2024-04-17T08:47:08.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.578+0000 7fd98528b000 1 -- 172.21.15.152:0/3500080867 wait complete. 2024-04-17T08:47:08.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.578+0000 7fd98528b000 1 -- start start 2024-04-17T08:47:08.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.578+0000 7fd98528b000 1 Processor -- start 2024-04-17T08:47:08.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.578+0000 7fd98528b000 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f5bb15cf0 0x560f5bb1a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:08.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.578+0000 7fd98528b000 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x560f5bb5fb50 0x560f5bb4d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:08.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.578+0000 7fd98528b000 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f5bb60470 0x560f5bb4d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:08.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.578+0000 7fd98528b000 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x560f5b920a60 con 0x560f5bb60470 2024-04-17T08:47:08.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.578+0000 7fd98528b000 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x560f5b907e80 con 0x560f5bb15cf0 2024-04-17T08:47:08.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.578+0000 7fd98528b000 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x560f5b91ecf0 con 0x560f5bb5fb50 2024-04-17T08:47:08.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.578+0000 7fd98528b000 10 client.0 _ll_register_callbacks cb 0x560f5bb00a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-17T08:47:08.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.582+0000 7fd97b400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f5bb60470 0x560f5bb4d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:08.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.582+0000 7fd97b400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f5bb60470 0x560f5bb4d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46210/0 (socket says 172.21.15.152:46210) 2024-04-17T08:47:08.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.582+0000 7fd97b400640 1 -- 172.21.15.152:0/1994945719 learned_addr learned my addr 172.21.15.152:0/1994945719 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:08.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.582+0000 7fd972000640 1 --2- 172.21.15.152:0/1994945719 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x560f5bb5fb50 0x560f5bb4d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:08.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.582+0000 7fd97aa00640 1 --2- 172.21.15.152:0/1994945719 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f5bb15cf0 0x560f5bb1a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:08.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.582+0000 7fd97b400640 1 -- 172.21.15.152:0/1994945719 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x560f5bb5fb50 msgr2=0x560f5bb4d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:08.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.582+0000 7fd97b400640 1 --2- 172.21.15.152:0/1994945719 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x560f5bb5fb50 0x560f5bb4d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:08.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.582+0000 7fd97b400640 1 -- 172.21.15.152:0/1994945719 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f5bb15cf0 msgr2=0x560f5bb1a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:08.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.582+0000 7fd97b400640 1 --2- 172.21.15.152:0/1994945719 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f5bb15cf0 0x560f5bb1a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:08.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.582+0000 7fd97b400640 1 -- 172.21.15.152:0/1994945719 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f5b8fde40 con 0x560f5bb60470 2024-04-17T08:47:08.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.582+0000 7fd97b400640 1 --2- 172.21.15.152:0/1994945719 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f5bb60470 0x560f5bb4d980 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd97400c8d0 tx=0x7fd974004a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=918e612ceee47edb server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:08.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.582+0000 7fd968c00640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-04-17T08:47:08.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.582+0000 7fd968c00640 1 -- 172.21.15.152:0/1994945719 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd974025020 con 0x560f5bb60470 2024-04-17T08:47:08.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.582+0000 7fd968c00640 1 -- 172.21.15.152:0/1994945719 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd9740044b0 con 0x560f5bb60470 2024-04-17T08:47:08.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.582+0000 7fd98528b000 1 -- 172.21.15.152:0/1994945719 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd974003b40 con 0x560f5bb60470 2024-04-17T08:47:08.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.582+0000 7fd968c00640 1 -- 172.21.15.152:0/1994945719 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fd97402f050 con 0x560f5bb60470 2024-04-17T08:47:08.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.582+0000 7fd98528b000 10 client.4830 fetch_fsmap learned FSMap version 9 2024-04-17T08:47:08.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.582+0000 7fd98528b000 1 -- 172.21.15.152:0/1994945719 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x560f5b92ee00 con 0x560f5bb60470 2024-04-17T08:47:08.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.582+0000 7fd968c00640 1 -- 172.21.15.152:0/1994945719 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd974003b40 con 0x560f5bb60470 2024-04-17T08:47:08.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.582+0000 7fd968c00640 1 -- 172.21.15.152:0/1994945719 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 9) ==== 3503+0+0 (secure 0 0 0) 0x7fd974032020 con 0x560f5bb60470 2024-04-17T08:47:08.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.582+0000 7fd98528b000 10 client.4830 fetch_fsmap finished waiting for FSMap version 9 2024-04-17T08:47:08.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.582+0000 7fd98528b000 10 client.4830 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-17T08:47:08.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.582+0000 7fd98528b000 20 client.4830 populate_metadata read hostname 'smithi152' 2024-04-17T08:47:08.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.582+0000 7fd98528b000 1 --2- 172.21.15.152:0/1994945719 >> [v2:172.21.15.152:6835/3890159871,v1:172.21.15.152:6837/3890159871] conn(0x560f5bb6ebe0 0x560f5bb70fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:08.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.582+0000 7fd98528b000 4 client.4830 mds_command: new command op to 4278 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-17T08:47:08.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.582+0000 7fd98528b000 1 -- 172.21.15.152:0/1994945719 --> [v2:172.21.15.152:6835/3890159871,v1:172.21.15.152:6837/3890159871] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560f5b8fcbc0 con 0x560f5bb6ebe0 2024-04-17T08:47:08.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.582+0000 7fd97aa00640 1 --2- 172.21.15.152:0/1994945719 >> [v2:172.21.15.152:6835/3890159871,v1:172.21.15.152:6837/3890159871] conn(0x560f5bb6ebe0 0x560f5bb70fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:08.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.582+0000 7fd968c00640 10 client.4830 ms_handle_connect on v2:172.21.15.152:6835/3890159871 2024-04-17T08:47:08.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.582+0000 7fd97aa00640 1 --2- 172.21.15.152:0/1994945719 >> [v2:172.21.15.152:6835/3890159871,v1:172.21.15.152:6837/3890159871] conn(0x560f5bb6ebe0 0x560f5bb70fd0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e45b7c96533681bb server_cookie=289b6b8ac4f5a27c in_seq=0 out_seq=0 2024-04-17T08:47:08.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.582+0000 7fd968c00640 1 -- 172.21.15.152:0/1994945719 <== mds.0 v2:172.21.15.152:6835/3890159871 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x560f5b8fcbc0 con 0x560f5bb6ebe0 2024-04-17T08:47:08.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.582+0000 7fd968c00640 10 client.4830 handle_command_reply: tid=0 2024-04-17T08:47:08.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.582+0000 7fd98528b000 1 client.4830 shutdown 2024-04-17T08:47:08.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.582+0000 7fd98528b000 1 -- 172.21.15.152:0/1994945719 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f5bb60470 msgr2=0x560f5bb4d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:08.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.582+0000 7fd98528b000 1 --2- 172.21.15.152:0/1994945719 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f5bb60470 0x560f5bb4d980 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd97400c8d0 tx=0x7fd974004a10 comp rx=0 tx=0).stop 2024-04-17T08:47:08.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.582+0000 7fd98528b000 1 -- 172.21.15.152:0/1994945719 shutdown_connections 2024-04-17T08:47:08.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.582+0000 7fd98528b000 1 --2- 172.21.15.152:0/1994945719 >> [v2:172.21.15.152:6835/3890159871,v1:172.21.15.152:6837/3890159871] conn(0x560f5bb6ebe0 0x560f5bb70fd0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:08.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.582+0000 7fd98528b000 1 --2- 172.21.15.152:0/1994945719 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f5bb60470 0x560f5bb4d980 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:08.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.582+0000 7fd98528b000 1 --2- 172.21.15.152:0/1994945719 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x560f5bb5fb50 0x560f5bb4d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:08.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.582+0000 7fd98528b000 1 --2- 172.21.15.152:0/1994945719 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f5bb15cf0 0x560f5bb1a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:08.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.582+0000 7fd968c00640 0 client.4830 ms_handle_reset on v2:172.21.15.152:6835/3890159871 2024-04-17T08:47:08.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.582+0000 7fd98528b000 1 -- 172.21.15.152:0/1994945719 >> 172.21.15.152:0/1994945719 conn(0x560f5bb1b470 msgr2=0x560f5bb147a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:08.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.582+0000 7fd98528b000 1 -- 172.21.15.152:0/1994945719 shutdown_connections 2024-04-17T08:47:08.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.582+0000 7fd98528b000 1 -- 172.21.15.152:0/1994945719 wait complete. 2024-04-17T08:47:08.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.582+0000 7fd98528b000 20 client.4830 trim_cache size 0 max 16384 2024-04-17T08:47:08.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.602+0000 7fd98528b000 1 Processor -- start 2024-04-17T08:47:08.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.602+0000 7fd98528b000 1 -- start start 2024-04-17T08:47:08.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.602+0000 7fd98528b000 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f5bb15cf0 0x560f5bb17920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:08.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.602+0000 7fd98528b000 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f5bb5fb50 0x560f5bb17e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:08.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.602+0000 7fd98528b000 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x560f5bb60470 0x560f5bb70fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:08.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.602+0000 7fd98528b000 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd97c204750 con 0x560f5bb5fb50 2024-04-17T08:47:08.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.602+0000 7fd98528b000 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd97c154340 con 0x560f5bb15cf0 2024-04-17T08:47:08.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.602+0000 7fd98528b000 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fd97c204100 con 0x560f5bb60470 2024-04-17T08:47:08.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.602+0000 7fd972000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f5bb5fb50 0x560f5bb17e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:08.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.602+0000 7fd972000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f5bb5fb50 0x560f5bb17e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46216/0 (socket says 172.21.15.152:46216) 2024-04-17T08:47:08.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.602+0000 7fd972000640 1 -- 172.21.15.152:0/403990446 learned_addr learned my addr 172.21.15.152:0/403990446 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:08.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.602+0000 7fd972000640 1 -- 172.21.15.152:0/403990446 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x560f5bb60470 msgr2=0x560f5bb70fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:08.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.602+0000 7fd972000640 1 --2- 172.21.15.152:0/403990446 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x560f5bb60470 0x560f5bb70fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:08.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.602+0000 7fd972000640 1 -- 172.21.15.152:0/403990446 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f5bb15cf0 msgr2=0x560f5bb17920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:08.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.602+0000 7fd972000640 1 --2- 172.21.15.152:0/403990446 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f5bb15cf0 0x560f5bb17920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:08.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.602+0000 7fd972000640 1 -- 172.21.15.152:0/403990446 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f5b9e4d30 con 0x560f5bb5fb50 2024-04-17T08:47:08.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.602+0000 7fd972000640 1 --2- 172.21.15.152:0/403990446 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f5bb5fb50 0x560f5bb17e60 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd964055840 tx=0x7fd964058040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0083c189924aa56 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:08.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.602+0000 7fd96b400640 1 -- 172.21.15.152:0/403990446 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd964052200 con 0x560f5bb5fb50 2024-04-17T08:47:08.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.602+0000 7fd96b400640 1 -- 172.21.15.152:0/403990446 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd964004bb0 con 0x560f5bb5fb50 2024-04-17T08:47:08.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.602+0000 7fd96b400640 1 -- 172.21.15.152:0/403990446 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9640523a0 con 0x560f5bb5fb50 2024-04-17T08:47:08.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.602+0000 7fd98528b000 1 -- 172.21.15.152:0/403990446 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f5bb5fb50 msgr2=0x560f5bb17e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:08.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.602+0000 7fd98528b000 1 --2- 172.21.15.152:0/403990446 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f5bb5fb50 0x560f5bb17e60 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd964055840 tx=0x7fd964058040 comp rx=0 tx=0).stop 2024-04-17T08:47:08.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.602+0000 7fd98528b000 1 -- 172.21.15.152:0/403990446 shutdown_connections 2024-04-17T08:47:08.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.602+0000 7fd98528b000 1 --2- 172.21.15.152:0/403990446 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x560f5bb60470 0x560f5bb70fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:08.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.602+0000 7fd98528b000 1 --2- 172.21.15.152:0/403990446 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f5bb5fb50 0x560f5bb17e60 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:08.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.602+0000 7fd98528b000 1 --2- 172.21.15.152:0/403990446 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f5bb15cf0 0x560f5bb17920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:08.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.602+0000 7fd98528b000 1 -- 172.21.15.152:0/403990446 >> 172.21.15.152:0/403990446 conn(0x560f5bb1b470 msgr2=0x560f5bb17210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:08.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.602+0000 7fd98528b000 1 -- 172.21.15.152:0/403990446 shutdown_connections 2024-04-17T08:47:08.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.602+0000 7fd98528b000 1 -- 172.21.15.152:0/403990446 wait complete. 2024-04-17T08:47:08.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.606+0000 7fd98528b000 1 -- start start 2024-04-17T08:47:08.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.606+0000 7fd98528b000 1 Processor -- start 2024-04-17T08:47:08.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.606+0000 7fd98528b000 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f5bb15cf0 0x560f5bb736e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:08.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.606+0000 7fd98528b000 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f5bb5fb50 0x560f5bb93370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:08.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.606+0000 7fd98528b000 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x560f5bb60470 0x560f5bb938b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:08.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.606+0000 7fd98528b000 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x560f5b967b00 con 0x560f5bb5fb50 2024-04-17T08:47:08.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.606+0000 7fd98528b000 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x560f5b9627e0 con 0x560f5bb15cf0 2024-04-17T08:47:08.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.606+0000 7fd98528b000 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x560f5b9706e0 con 0x560f5bb60470 2024-04-17T08:47:08.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.606+0000 7fd98528b000 10 client.0 _ll_register_callbacks cb 0x7fd974009e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-17T08:47:08.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.606+0000 7fd972000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f5bb5fb50 0x560f5bb93370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:08.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.606+0000 7fd972000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f5bb5fb50 0x560f5bb93370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46218/0 (socket says 172.21.15.152:46218) 2024-04-17T08:47:08.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.606+0000 7fd972000640 1 -- 172.21.15.152:0/720520630 learned_addr learned my addr 172.21.15.152:0/720520630 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:08.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.606+0000 7fd97b400640 1 --2- 172.21.15.152:0/720520630 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x560f5bb60470 0x560f5bb938b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:08.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.606+0000 7fd97aa00640 1 --2- 172.21.15.152:0/720520630 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f5bb15cf0 0x560f5bb736e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:08.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.606+0000 7fd972000640 1 -- 172.21.15.152:0/720520630 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x560f5bb60470 msgr2=0x560f5bb938b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:08.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.606+0000 7fd972000640 1 --2- 172.21.15.152:0/720520630 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x560f5bb60470 0x560f5bb938b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:08.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.606+0000 7fd972000640 1 -- 172.21.15.152:0/720520630 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f5bb15cf0 msgr2=0x560f5bb736e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:08.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.606+0000 7fd972000640 1 --2- 172.21.15.152:0/720520630 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f5bb15cf0 0x560f5bb736e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:08.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.606+0000 7fd972000640 1 -- 172.21.15.152:0/720520630 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f5b8f57c0 con 0x560f5bb5fb50 2024-04-17T08:47:08.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.606+0000 7fd97b400640 1 --2- 172.21.15.152:0/720520630 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x560f5bb60470 0x560f5bb938b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:08.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.606+0000 7fd97aa00640 1 --2- 172.21.15.152:0/720520630 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f5bb15cf0 0x560f5bb736e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:08.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.606+0000 7fd972000640 1 --2- 172.21.15.152:0/720520630 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f5bb5fb50 0x560f5bb93370 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd96400ceb0 tx=0x7fd964055a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9b5bee5af3cb2c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:08.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.606+0000 7fd968c00640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-04-17T08:47:08.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.606+0000 7fd968c00640 1 -- 172.21.15.152:0/720520630 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd964083070 con 0x560f5bb5fb50 2024-04-17T08:47:08.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.606+0000 7fd968c00640 1 -- 172.21.15.152:0/720520630 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd96407dd60 con 0x560f5bb5fb50 2024-04-17T08:47:08.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.606+0000 7fd98528b000 1 -- 172.21.15.152:0/720520630 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd964004bb0 con 0x560f5bb5fb50 2024-04-17T08:47:08.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.606+0000 7fd968c00640 1 -- 172.21.15.152:0/720520630 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fd964054fe0 con 0x560f5bb5fb50 2024-04-17T08:47:08.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.606+0000 7fd98528b000 10 client.4836 fetch_fsmap learned FSMap version 9 2024-04-17T08:47:08.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.606+0000 7fd98528b000 1 -- 172.21.15.152:0/720520630 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x560f5b908650 con 0x560f5bb5fb50 2024-04-17T08:47:08.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.606+0000 7fd968c00640 1 -- 172.21.15.152:0/720520630 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd964004bb0 con 0x560f5bb5fb50 2024-04-17T08:47:08.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.606+0000 7fd968c00640 1 -- 172.21.15.152:0/720520630 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 9) ==== 3503+0+0 (secure 0 0 0) 0x7fd964055180 con 0x560f5bb5fb50 2024-04-17T08:47:08.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.606+0000 7fd98528b000 10 client.4836 fetch_fsmap finished waiting for FSMap version 9 2024-04-17T08:47:08.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.606+0000 7fd98528b000 10 client.4836 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-17T08:47:08.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.606+0000 7fd98528b000 20 client.4836 populate_metadata read hostname 'smithi152' 2024-04-17T08:47:08.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.606+0000 7fd98528b000 1 --2- 172.21.15.152:0/720520630 >> [v2:172.21.15.152:6835/3890159871,v1:172.21.15.152:6837/3890159871] conn(0x560f5bbd69b0 0x560f5bbd6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:08.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.606+0000 7fd98528b000 4 client.4836 mds_command: new command op to 4278 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-17T08:47:08.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.606+0000 7fd98528b000 1 -- 172.21.15.152:0/720520630 --> [v2:172.21.15.152:6835/3890159871,v1:172.21.15.152:6837/3890159871] -- command(tid 0: {"prefix": "status"}) -- 0x560f5b970ef0 con 0x560f5bbd69b0 2024-04-17T08:47:08.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.606+0000 7fd97aa00640 1 --2- 172.21.15.152:0/720520630 >> [v2:172.21.15.152:6835/3890159871,v1:172.21.15.152:6837/3890159871] conn(0x560f5bbd69b0 0x560f5bbd6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:08.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.606+0000 7fd97aa00640 1 --2- 172.21.15.152:0/720520630 >> [v2:172.21.15.152:6835/3890159871,v1:172.21.15.152:6837/3890159871] conn(0x560f5bbd69b0 0x560f5bbd6d90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb17186e8630fc40 server_cookie=676738eeb5fa32c0 in_seq=0 out_seq=0 2024-04-17T08:47:08.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.606+0000 7fd968c00640 10 client.4836 ms_handle_connect on v2:172.21.15.152:6835/3890159871 2024-04-17T08:47:08.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.606+0000 7fd968c00640 1 -- 172.21.15.152:0/720520630 <== mds.0 v2:172.21.15.152:6835/3890159871 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x560f5b970ef0 con 0x560f5bbd69b0 2024-04-17T08:47:08.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.606+0000 7fd968c00640 10 client.4836 handle_command_reply: tid=0 2024-04-17T08:47:08.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.606+0000 7fd98528b000 1 client.4836 shutdown 2024-04-17T08:47:08.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.610+0000 7fd98528b000 1 -- 172.21.15.152:0/720520630 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f5bb5fb50 msgr2=0x560f5bb93370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:08.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.610+0000 7fd98528b000 1 --2- 172.21.15.152:0/720520630 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f5bb5fb50 0x560f5bb93370 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd96400ceb0 tx=0x7fd964055a90 comp rx=0 tx=0).stop 2024-04-17T08:47:08.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.610+0000 7fd98528b000 1 -- 172.21.15.152:0/720520630 shutdown_connections 2024-04-17T08:47:08.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.610+0000 7fd98528b000 1 --2- 172.21.15.152:0/720520630 >> [v2:172.21.15.152:6835/3890159871,v1:172.21.15.152:6837/3890159871] conn(0x560f5bbd69b0 0x560f5bbd6d90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:08.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.610+0000 7fd98528b000 1 --2- 172.21.15.152:0/720520630 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x560f5bb60470 0x560f5bb938b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:08.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.610+0000 7fd98528b000 1 --2- 172.21.15.152:0/720520630 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560f5bb5fb50 0x560f5bb93370 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:08.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.610+0000 7fd98528b000 1 --2- 172.21.15.152:0/720520630 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f5bb15cf0 0x560f5bb736e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:08.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.610+0000 7fd968c00640 0 client.4836 ms_handle_reset on v2:172.21.15.152:6835/3890159871 2024-04-17T08:47:08.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.610+0000 7fd98528b000 1 -- 172.21.15.152:0/720520630 >> 172.21.15.152:0/720520630 conn(0x560f5bb1b470 msgr2=0x560f5bb17920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:08.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.610+0000 7fd98528b000 1 -- 172.21.15.152:0/720520630 shutdown_connections 2024-04-17T08:47:08.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.610+0000 7fd98528b000 1 -- 172.21.15.152:0/720520630 wait complete. 2024-04-17T08:47:08.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.610+0000 7fd98528b000 20 client.4836 trim_cache size 0 max 16384 2024-04-17T08:47:08.615 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-17T08:47:08.615 INFO:teuthology.orchestra.run.smithi152.stdout: "cluster_fsid": "ce68f82e-ec5f-4205-9fd5-bdfdf6ef31e2", 2024-04-17T08:47:08.615 INFO:teuthology.orchestra.run.smithi152.stdout: "whoami": 0, 2024-04-17T08:47:08.615 INFO:teuthology.orchestra.run.smithi152.stdout: "id": 4278, 2024-04-17T08:47:08.615 INFO:teuthology.orchestra.run.smithi152.stdout: "want_state": "up:active", 2024-04-17T08:47:08.615 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "up:active", 2024-04-17T08:47:08.615 INFO:teuthology.orchestra.run.smithi152.stdout: "fs_name": "cephfs", 2024-04-17T08:47:08.615 INFO:teuthology.orchestra.run.smithi152.stdout: "rank_uptime": 34.375977509999998, 2024-04-17T08:47:08.615 INFO:teuthology.orchestra.run.smithi152.stdout: "mdsmap_epoch": 9, 2024-04-17T08:47:08.615 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_epoch": 24, 2024-04-17T08:47:08.615 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_epoch_barrier": 24, 2024-04-17T08:47:08.615 INFO:teuthology.orchestra.run.smithi152.stdout: "uptime": 41.439282081000002 2024-04-17T08:47:08.615 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-17T08:47:08.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.610+0000 7fd981e00640 1 -- 172.21.15.152:0/2301435732 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fd958068380 msgr2=0x7fd95806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:08.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.610+0000 7fd981e00640 1 --2- 172.21.15.152:0/2301435732 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fd958068380 0x7fd95806a840 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd96c0ad000 tx=0x7fd96c008040 comp rx=0 tx=0).stop 2024-04-17T08:47:08.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.610+0000 7fd981e00640 1 -- 172.21.15.152:0/2301435732 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd97c0b5760 msgr2=0x7fd97c1555a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:08.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.610+0000 7fd981e00640 1 --2- 172.21.15.152:0/2301435732 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd97c0b5760 0x7fd97c1555a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd9640011f0 tx=0x7fd96400c9b0 comp rx=0 tx=0).stop 2024-04-17T08:47:08.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.610+0000 7fd981e00640 1 -- 172.21.15.152:0/2301435732 shutdown_connections 2024-04-17T08:47:08.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.610+0000 7fd981e00640 1 --2- 172.21.15.152:0/2301435732 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fd958068380 0x7fd95806a840 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:08.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.610+0000 7fd981e00640 1 --2- 172.21.15.152:0/2301435732 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd97c0ce730 0x7fd97c14cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:08.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.610+0000 7fd981e00640 1 --2- 172.21.15.152:0/2301435732 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd97c0b5760 0x7fd97c1555a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:08.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.610+0000 7fd981e00640 1 --2- 172.21.15.152:0/2301435732 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd97c0b3e90 0x7fd97c0c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:08.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.610+0000 7fd981e00640 1 -- 172.21.15.152:0/2301435732 >> 172.21.15.152:0/2301435732 conn(0x7fd97c0cf060 msgr2=0x7fd97c0cf440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:08.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.610+0000 7fd981e00640 1 -- 172.21.15.152:0/2301435732 shutdown_connections 2024-04-17T08:47:08.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:08.610+0000 7fd981e00640 1 -- 172.21.15.152:0/2301435732 wait complete. 2024-04-17T08:47:08.630 INFO:teuthology.run_tasks:Running task sequential... 2024-04-17T08:47:08.639 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-17T08:47:08.639 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-17T08:47:08.640 INFO:teuthology.task.print:Enabling mgr modules 2024-04-17T08:47:08.640 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-17T08:47:08.666 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-17T08:47:08.666 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-04-17T08:47:08.666 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-17T08:47:08.666 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-17T08:47:08.666 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-17T08:47:08.666 INFO:tasks.ceph_fuse:client.2 config is {} 2024-04-17T08:47:08.666 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-17T08:47:08.666 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-17T08:47:08.667 INFO:tasks.ceph_fuse:client.1 config is {} 2024-04-17T08:47:08.667 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-17T08:47:08.667 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-17T08:47:08.667 INFO:tasks.ceph_fuse:client.3 config is {} 2024-04-17T08:47:08.667 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-17T08:47:08.667 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-17T08:47:08.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:08.667 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list 2024-04-17T08:47:08.675 INFO:teuthology.orchestra.run.smithi152.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-04-17T08:47:08.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:08.677 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-17T08:47:08.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:08.737 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link delete ceph-brx 2024-04-17T08:47:08.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:08.900 DEBUG:teuthology.orchestra.run.smithi196:> ip netns list 2024-04-17T08:47:08.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:08.910 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip link delete ceph-brx 2024-04-17T08:47:08.981 INFO:teuthology.orchestra.run.smithi196.stderr:Cannot find device "ceph-brx" 2024-04-17T08:47:08.983 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T08:47:08.983 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-17T08:47:08.984 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-17T08:47:09.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.118+0000 7f2b2fa00640 1 Processor -- start 2024-04-17T08:47:09.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.118+0000 7f2b2fa00640 1 -- start start 2024-04-17T08:47:09.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.118+0000 7f2b2fa00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f2b28145ea0 0x7f2b280d0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:09.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.118+0000 7f2b2fa00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b280ccbb0 con 0x7f2b28071790 2024-04-17T08:47:09.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.118+0000 7f2b2fa00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b280cce90 con 0x7f2b280d0790 2024-04-17T08:47:09.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.118+0000 7f2b2fa00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f2b280cd170 con 0x7f2b28145ea0 2024-04-17T08:47:09.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.118+0000 7f2b2da00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f2b28071790 0x7f2b280cd970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:55594/0 (socket says 172.21.15.152:55594) 2024-04-17T08:47:09.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.118+0000 7f2b2da00640 1 -- 172.21.15.152:0/2666778372 learned_addr learned my addr 172.21.15.152:0/2666778372 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:09.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.118+0000 7f2b2d000640 1 --2- 172.21.15.152:0/2666778372 >> v2:172.21.15.196:3300/0 conn(0x7f2b28145ea0 0x7f2b280d0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:09.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.118+0000 7f2b27400640 1 -- 172.21.15.152:0/2666778372 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 82206107 0 0) 0x7f2b280ccbb0 con 0x7f2b28071790 2024-04-17T08:47:09.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.118+0000 7f2b27400640 1 -- 172.21.15.152:0/2666778372 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b0c003530 con 0x7f2b28071790 2024-04-17T08:47:09.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.118+0000 7f2b27400640 1 -- 172.21.15.152:0/2666778372 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2948374956 0 0) 0x7f2b0c003530 con 0x7f2b28071790 2024-04-17T08:47:09.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.118+0000 7f2b2d000640 1 -- 172.21.15.152:0/2666778372 >> v1:172.21.15.196:6789/0 conn(0x7f2b280d0790 legacy=0x7f2b280c7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:09.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.118+0000 7f2b2d000640 1 -- 172.21.15.152:0/2666778372 >> v1:172.21.15.152:6789/0 conn(0x7f2b28071790 legacy=0x7f2b280cd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:09.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.118+0000 7f2b2d000640 1 -- 172.21.15.152:0/2666778372 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b280cd450 con 0x7f2b28145ea0 2024-04-17T08:47:09.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.122+0000 7f2b2d000640 1 --2- 172.21.15.152:0/2666778372 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2b28145ea0 0x7f2b280d0250 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2b100097c0 tx=0x7f2b1001c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbb4d69acc1b2e21 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:09.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.122+0000 7f2b27400640 1 -- 172.21.15.152:0/2666778372 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b100b0070 con 0x7f2b28145ea0 2024-04-17T08:47:09.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.122+0000 7f2b27400640 1 -- 172.21.15.152:0/2666778372 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b100ab400 con 0x7f2b28145ea0 2024-04-17T08:47:09.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.122+0000 7f2b27400640 1 -- 172.21.15.152:0/2666778372 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b20001a00 con 0x7f2b28145ea0 2024-04-17T08:47:09.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.122+0000 7f2b2fa00640 1 -- 172.21.15.152:0/2666778372 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2b28145ea0 msgr2=0x7f2b280d0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:09.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.122+0000 7f2b2fa00640 1 --2- 172.21.15.152:0/2666778372 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2b28145ea0 0x7f2b280d0250 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2b100097c0 tx=0x7f2b1001c330 comp rx=0 tx=0).stop 2024-04-17T08:47:09.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.122+0000 7f2b2fa00640 1 -- 172.21.15.152:0/2666778372 shutdown_connections 2024-04-17T08:47:09.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.122+0000 7f2b2fa00640 1 --2- 172.21.15.152:0/2666778372 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2b28145ea0 0x7f2b280d0250 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:09.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.122+0000 7f2b2fa00640 1 -- 172.21.15.152:0/2666778372 >> 172.21.15.152:0/2666778372 conn(0x7f2b280d2350 msgr2=0x7f2b280d2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:09.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.122+0000 7f2b2fa00640 1 -- 172.21.15.152:0/2666778372 shutdown_connections 2024-04-17T08:47:09.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.122+0000 7f2b2fa00640 1 -- 172.21.15.152:0/2666778372 wait complete. 2024-04-17T08:47:09.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.126+0000 7f2b2fa00640 1 Processor -- start 2024-04-17T08:47:09.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.126+0000 7f2b2fa00640 1 -- start start 2024-04-17T08:47:09.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.126+0000 7f2b2fa00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2b28071790 0x7f2b280b6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:09.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.126+0000 7f2b2fa00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2b280d0790 0x7f2b280b4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:09.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.126+0000 7f2b2fa00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2b28145ea0 0x7f2b28159420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:09.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.126+0000 7f2b2fa00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2b280c7ac0 con 0x7f2b280d0790 2024-04-17T08:47:09.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.126+0000 7f2b2fa00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f2b280c7940 con 0x7f2b28145ea0 2024-04-17T08:47:09.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.126+0000 7f2b2fa00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f2b2816acb0 con 0x7f2b28071790 2024-04-17T08:47:09.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.126+0000 7f2b27e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2b280d0790 0x7f2b280b4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:09.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.126+0000 7f2b27e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2b280d0790 0x7f2b280b4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46224/0 (socket says 172.21.15.152:46224) 2024-04-17T08:47:09.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.126+0000 7f2b27e00640 1 -- 172.21.15.152:0/3098089663 learned_addr learned my addr 172.21.15.152:0/3098089663 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:09.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.126+0000 7f2b2da00640 1 --2- 172.21.15.152:0/3098089663 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2b28145ea0 0x7f2b28159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:09.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.126+0000 7f2b2d000640 1 --2- 172.21.15.152:0/3098089663 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2b28071790 0x7f2b280b6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:09.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.126+0000 7f2b27e00640 1 -- 172.21.15.152:0/3098089663 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2b28071790 msgr2=0x7f2b280b6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:09.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.126+0000 7f2b27e00640 1 --2- 172.21.15.152:0/3098089663 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2b28071790 0x7f2b280b6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:09.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.126+0000 7f2b27e00640 1 -- 172.21.15.152:0/3098089663 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2b28145ea0 msgr2=0x7f2b28159420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:09.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.126+0000 7f2b27e00640 1 --2- 172.21.15.152:0/3098089663 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2b28145ea0 0x7f2b28159420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:09.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.126+0000 7f2b27e00640 1 -- 172.21.15.152:0/3098089663 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b280b7150 con 0x7f2b280d0790 2024-04-17T08:47:09.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.126+0000 7f2b2da00640 1 --2- 172.21.15.152:0/3098089663 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2b28145ea0 0x7f2b28159420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:09.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.126+0000 7f2b27e00640 1 --2- 172.21.15.152:0/3098089663 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2b280d0790 0x7f2b280b4ff0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2b1800c530 tx=0x7f2b1800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:09.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.126+0000 7f2b24c00640 1 -- 172.21.15.152:0/3098089663 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b18016020 con 0x7f2b280d0790 2024-04-17T08:47:09.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.126+0000 7f2b24c00640 1 -- 172.21.15.152:0/3098089663 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b18005220 con 0x7f2b280d0790 2024-04-17T08:47:09.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.126+0000 7f2b24c00640 1 -- 172.21.15.152:0/3098089663 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b18007030 con 0x7f2b280d0790 2024-04-17T08:47:09.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.126+0000 7f2b2fa00640 1 -- 172.21.15.152:0/3098089663 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b280b7430 con 0x7f2b280d0790 2024-04-17T08:47:09.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.126+0000 7f2b2fa00640 1 -- 172.21.15.152:0/3098089663 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b280b79f0 con 0x7f2b280d0790 2024-04-17T08:47:09.131 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.130+0000 7f2b2fa00640 1 -- 172.21.15.152:0/3098089663 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b28068a30 con 0x7f2b280d0790 2024-04-17T08:47:09.131 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.130+0000 7f2b24c00640 1 -- 172.21.15.152:0/3098089663 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2b180071d0 con 0x7f2b280d0790 2024-04-17T08:47:09.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.130+0000 7f2b24c00640 1 --2- 172.21.15.152:0/3098089663 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f2b04068380 0x7f2b0406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:09.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.130+0000 7f2b24c00640 1 -- 172.21.15.152:0/3098089663 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2b180866a0 con 0x7f2b280d0790 2024-04-17T08:47:09.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.130+0000 7f2b2d000640 1 --2- 172.21.15.152:0/3098089663 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f2b04068380 0x7f2b0406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:09.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.130+0000 7f2b2d000640 1 --2- 172.21.15.152:0/3098089663 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f2b04068380 0x7f2b0406a840 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2b100ad000 tx=0x7f2b100a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:09.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.134+0000 7f2b24c00640 1 -- 172.21.15.152:0/3098089663 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f2b18020020 con 0x7f2b280d0790 2024-04-17T08:47:09.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.326+0000 7f2b2fa00640 1 -- 172.21.15.152:0/3098089663 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f2b280b5530 con 0x7f2b280d0790 2024-04-17T08:47:09.328 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.326+0000 7f2b24c00640 1 -- 172.21.15.152:0/3098089663 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f2b180074c0 con 0x7f2b280d0790 2024-04-17T08:47:09.328 INFO:teuthology.orchestra.run.smithi152.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-17T08:47:09.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.326+0000 7f2b2fa00640 1 -- 172.21.15.152:0/3098089663 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f2b04068380 msgr2=0x7f2b0406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:09.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.326+0000 7f2b2fa00640 1 --2- 172.21.15.152:0/3098089663 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f2b04068380 0x7f2b0406a840 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2b100ad000 tx=0x7f2b100a6000 comp rx=0 tx=0).stop 2024-04-17T08:47:09.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.326+0000 7f2b2fa00640 1 -- 172.21.15.152:0/3098089663 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2b280d0790 msgr2=0x7f2b280b4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:09.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.326+0000 7f2b2fa00640 1 --2- 172.21.15.152:0/3098089663 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2b280d0790 0x7f2b280b4ff0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2b1800c530 tx=0x7f2b1800c9f0 comp rx=0 tx=0).stop 2024-04-17T08:47:09.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.330+0000 7f2b2fa00640 1 -- 172.21.15.152:0/3098089663 shutdown_connections 2024-04-17T08:47:09.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.330+0000 7f2b2fa00640 1 --2- 172.21.15.152:0/3098089663 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2b28145ea0 0x7f2b28159420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:09.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.330+0000 7f2b2fa00640 1 --2- 172.21.15.152:0/3098089663 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2b280d0790 0x7f2b280b4ff0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:09.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.330+0000 7f2b2fa00640 1 --2- 172.21.15.152:0/3098089663 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f2b04068380 0x7f2b0406a840 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:09.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.330+0000 7f2b2fa00640 1 --2- 172.21.15.152:0/3098089663 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2b28071790 0x7f2b280b6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:09.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.330+0000 7f2b2fa00640 1 -- 172.21.15.152:0/3098089663 >> 172.21.15.152:0/3098089663 conn(0x7f2b280d2350 msgr2=0x7f2b2815df20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:09.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.330+0000 7f2b2fa00640 1 -- 172.21.15.152:0/3098089663 shutdown_connections 2024-04-17T08:47:09.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09.330+0000 7f2b2fa00640 1 -- 172.21.15.152:0/3098089663 wait complete. 2024-04-17T08:47:09.349 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-17T08:47:09.349 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-17T08:47:09.349 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi152.front.sepia.ceph.com 2024-04-17T08:47:09.349 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-17T08:47:09.349 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-17T08:47:09.349 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-17T08:47:09.349 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-17T08:47:09.349 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-17T08:47:09.349 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-17T08:47:09.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:09.350 DEBUG:teuthology.orchestra.run.smithi152:> ip addr 2024-04-17T08:47:09.358 INFO:teuthology.orchestra.run.smithi152.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-17T08:47:09.358 INFO:teuthology.orchestra.run.smithi152.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-17T08:47:09.358 INFO:teuthology.orchestra.run.smithi152.stdout: inet 127.0.0.1/8 scope host lo 2024-04-17T08:47:09.358 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-04-17T08:47:09.358 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 ::1/128 scope host 2024-04-17T08:47:09.358 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-04-17T08:47:09.358 INFO:teuthology.orchestra.run.smithi152.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-17T08:47:09.358 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:da:6c:44 brd ff:ff:ff:ff:ff:ff 2024-04-17T08:47:09.358 INFO:teuthology.orchestra.run.smithi152.stdout: altname enp7s0f0 2024-04-17T08:47:09.359 INFO:teuthology.orchestra.run.smithi152.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-17T08:47:09.359 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:da:6c:45 brd ff:ff:ff:ff:ff:ff 2024-04-17T08:47:09.359 INFO:teuthology.orchestra.run.smithi152.stdout: altname enp7s0f1 2024-04-17T08:47:09.359 INFO:teuthology.orchestra.run.smithi152.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-17T08:47:09.359 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:88:6d:e2 brd ff:ff:ff:ff:ff:ff 2024-04-17T08:47:09.359 INFO:teuthology.orchestra.run.smithi152.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-17T08:47:09.359 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:88:6d:e3 brd ff:ff:ff:ff:ff:ff 2024-04-17T08:47:09.359 INFO:teuthology.orchestra.run.smithi152.stdout: inet 172.21.15.152/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-17T08:47:09.359 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft 42405sec preferred_lft 42405sec 2024-04-17T08:47:09.359 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 fe80::ec4:7aff:fe88:6de3/64 scope link 2024-04-17T08:47:09.359 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-04-17T08:47:09.359 INFO:teuthology.orchestra.run.smithi152.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-17T08:47:09.359 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 02:42:bf:a8:e8:00 brd ff:ff:ff:ff:ff:ff 2024-04-17T08:47:09.359 INFO:teuthology.orchestra.run.smithi152.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-17T08:47:09.359 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-04-17T08:47:09.360 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-17T08:47:09.360 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T08:47:09.361 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2024-04-17T08:47:09.361 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link add name ceph-brx type bridge 2024-04-17T08:47:09.361 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip addr flush dev ceph-brx 2024-04-17T08:47:09.361 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link set ceph-brx up 2024-04-17T08:47:09.361 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-17T08:47:09.361 DEBUG:teuthology.orchestra.run.smithi152:> ') 2024-04-17T08:47:09.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T08:47:09.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T08:47:09.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:09.517 DEBUG:teuthology.orchestra.run.smithi152:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-17T08:47:09.579 INFO:teuthology.orchestra.run.smithi152.stdout:1 2024-04-17T08:47:09.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:09.581 DEBUG:teuthology.orchestra.run.smithi152:> route 2024-04-17T08:47:09.632 INFO:teuthology.orchestra.run.smithi152.stdout:Kernel IP routing table 2024-04-17T08:47:09.633 INFO:teuthology.orchestra.run.smithi152.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-17T08:47:09.633 INFO:teuthology.orchestra.run.smithi152.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-17T08:47:09.633 INFO:teuthology.orchestra.run.smithi152.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-17T08:47:09.633 INFO:teuthology.orchestra.run.smithi152.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-17T08:47:09.633 INFO:teuthology.orchestra.run.smithi152.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-17T08:47:09.633 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-17T08:47:09.633 INFO:teuthology.orchestra.run.smithi152.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-17T08:47:09.633 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-17T08:47:09.633 INFO:teuthology.orchestra.run.smithi152.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-17T08:47:09.633 INFO:teuthology.orchestra.run.smithi152.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-17T08:47:09.633 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T08:47:09.634 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2024-04-17T08:47:09.634 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-17T08:47:09.634 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-17T08:47:09.634 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-17T08:47:09.634 DEBUG:teuthology.orchestra.run.smithi152:> ') 2024-04-17T08:47:09.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T08:47:09.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T08:47:09.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:09.765 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list 2024-04-17T08:47:09.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:09.775 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list-id 2024-04-17T08:47:09.825 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T08:47:09.825 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2024-04-17T08:47:09.825 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-17T08:47:09.826 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-17T08:47:09.826 DEBUG:teuthology.orchestra.run.smithi152:> ') 2024-04-17T08:47:09.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T08:47:09.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T08:47:09.951 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-17T08:47:09.951 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T08:47:09.951 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2024-04-17T08:47:09.951 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-17T08:47:09.951 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-17T08:47:09.951 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-17T08:47:09.951 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-17T08:47:09.951 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-17T08:47:09.951 DEBUG:teuthology.orchestra.run.smithi152:> ') 2024-04-17T08:47:09.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T08:47:10.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T08:47:10.088 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T08:47:10.088 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2024-04-17T08:47:10.088 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link set brx.0 up 2024-04-17T08:47:10.088 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link set dev brx.0 master ceph-brx 2024-04-17T08:47:10.088 DEBUG:teuthology.orchestra.run.smithi152:> ') 2024-04-17T08:47:10.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T08:47:10.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T08:47:10.171 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-17T08:47:10.172 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-17T08:47:10.172 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-17T08:47:10.180 INFO:teuthology.orchestra.run.smithi152.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-17T08:47:10.181 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-17T08:47:10.181 DEBUG:teuthology.orchestra.run.smithi152:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-17T08:47:10.232 DEBUG:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2024-04-17T08:47:10.295 DEBUG:teuthology.orchestra.run.smithi152:> cat /proc/self/mounts | awk '{print $2}' 2024-04-17T08:47:10.346 INFO:teuthology.orchestra.run.smithi152.stdout:/sys 2024-04-17T08:47:10.347 INFO:teuthology.orchestra.run.smithi152.stdout:/proc 2024-04-17T08:47:10.347 INFO:teuthology.orchestra.run.smithi152.stdout:/dev 2024-04-17T08:47:10.347 INFO:teuthology.orchestra.run.smithi152.stdout:/dev/pts 2024-04-17T08:47:10.347 INFO:teuthology.orchestra.run.smithi152.stdout:/run 2024-04-17T08:47:10.347 INFO:teuthology.orchestra.run.smithi152.stdout:/ 2024-04-17T08:47:10.347 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/kernel/security 2024-04-17T08:47:10.347 INFO:teuthology.orchestra.run.smithi152.stdout:/dev/shm 2024-04-17T08:47:10.347 INFO:teuthology.orchestra.run.smithi152.stdout:/run/lock 2024-04-17T08:47:10.347 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/cgroup 2024-04-17T08:47:10.347 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/pstore 2024-04-17T08:47:10.347 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/bpf 2024-04-17T08:47:10.347 INFO:teuthology.orchestra.run.smithi152.stdout:/proc/sys/fs/binfmt_misc 2024-04-17T08:47:10.347 INFO:teuthology.orchestra.run.smithi152.stdout:/dev/hugepages 2024-04-17T08:47:10.348 INFO:teuthology.orchestra.run.smithi152.stdout:/dev/mqueue 2024-04-17T08:47:10.348 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/kernel/debug 2024-04-17T08:47:10.348 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/kernel/tracing 2024-04-17T08:47:10.348 INFO:teuthology.orchestra.run.smithi152.stdout:/proc/fs/nfsd 2024-04-17T08:47:10.348 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/fuse/connections 2024-04-17T08:47:10.348 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/kernel/config 2024-04-17T08:47:10.348 INFO:teuthology.orchestra.run.smithi152.stdout:/run/credentials/systemd-sysusers.service 2024-04-17T08:47:10.348 INFO:teuthology.orchestra.run.smithi152.stdout:/run/rpc_pipefs 2024-04-17T08:47:10.348 INFO:teuthology.orchestra.run.smithi152.stdout:/run/user/1000 2024-04-17T08:47:10.348 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph 2024-04-17T08:47:10.348 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph/osd/ceph-0 2024-04-17T08:47:10.348 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph/osd/ceph-1 2024-04-17T08:47:10.348 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph/osd/ceph-2 2024-04-17T08:47:10.348 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph/osd/ceph-3 2024-04-17T08:47:10.348 INFO:teuthology.orchestra.run.smithi152.stdout:/run/netns 2024-04-17T08:47:10.349 INFO:teuthology.orchestra.run.smithi152.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-17T08:47:10.349 INFO:teuthology.orchestra.run.smithi152.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-17T08:47:10.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:10.349 DEBUG:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2024-04-17T08:47:10.401 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-17T08:47:10.401 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-17T08:47:10.444 DEBUG:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2024-04-17T08:47:10.464 DEBUG:teuthology.orchestra.run.smithi152:> cat /proc/self/mounts | awk '{print $2}' 2024-04-17T08:47:10.516 INFO:teuthology.orchestra.run.smithi152.stdout:/sys 2024-04-17T08:47:10.516 INFO:teuthology.orchestra.run.smithi152.stdout:/proc 2024-04-17T08:47:10.516 INFO:teuthology.orchestra.run.smithi152.stdout:/dev 2024-04-17T08:47:10.516 INFO:teuthology.orchestra.run.smithi152.stdout:/dev/pts 2024-04-17T08:47:10.516 INFO:teuthology.orchestra.run.smithi152.stdout:/run 2024-04-17T08:47:10.516 INFO:teuthology.orchestra.run.smithi152.stdout:/ 2024-04-17T08:47:10.516 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/kernel/security 2024-04-17T08:47:10.516 INFO:teuthology.orchestra.run.smithi152.stdout:/dev/shm 2024-04-17T08:47:10.516 INFO:teuthology.orchestra.run.smithi152.stdout:/run/lock 2024-04-17T08:47:10.516 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/cgroup 2024-04-17T08:47:10.517 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/pstore 2024-04-17T08:47:10.517 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/bpf 2024-04-17T08:47:10.517 INFO:teuthology.orchestra.run.smithi152.stdout:/proc/sys/fs/binfmt_misc 2024-04-17T08:47:10.517 INFO:teuthology.orchestra.run.smithi152.stdout:/dev/hugepages 2024-04-17T08:47:10.517 INFO:teuthology.orchestra.run.smithi152.stdout:/dev/mqueue 2024-04-17T08:47:10.517 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/kernel/debug 2024-04-17T08:47:10.517 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/kernel/tracing 2024-04-17T08:47:10.517 INFO:teuthology.orchestra.run.smithi152.stdout:/proc/fs/nfsd 2024-04-17T08:47:10.517 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/fuse/connections 2024-04-17T08:47:10.517 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/kernel/config 2024-04-17T08:47:10.517 INFO:teuthology.orchestra.run.smithi152.stdout:/run/credentials/systemd-sysusers.service 2024-04-17T08:47:10.517 INFO:teuthology.orchestra.run.smithi152.stdout:/run/rpc_pipefs 2024-04-17T08:47:10.517 INFO:teuthology.orchestra.run.smithi152.stdout:/run/user/1000 2024-04-17T08:47:10.517 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph 2024-04-17T08:47:10.518 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph/osd/ceph-0 2024-04-17T08:47:10.518 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph/osd/ceph-1 2024-04-17T08:47:10.518 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph/osd/ceph-2 2024-04-17T08:47:10.518 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph/osd/ceph-3 2024-04-17T08:47:10.518 INFO:teuthology.orchestra.run.smithi152.stdout:/run/netns 2024-04-17T08:47:10.518 INFO:teuthology.orchestra.run.smithi152.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-17T08:47:10.518 INFO:teuthology.orchestra.run.smithi152.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-17T08:47:10.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:10.519 DEBUG:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2024-04-17T08:47:10.538 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:2024-04-17T08:47:10.538+0000 7f36b5c2a580 -1 init, newargv = 0x55ac282aca90 newargc=15 2024-04-17T08:47:10.538 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:ceph-fuse[35800]: starting ceph client 2024-04-17T08:47:10.546 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:ceph-fuse[35800]: starting fuse 2024-04-17T08:47:10.547 INFO:teuthology.orchestra.run.smithi152.stdout:44 2024-04-17T08:47:10.547 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-04-17T08:47:10.547 DEBUG:teuthology.orchestra.run.smithi152:> sudo stdin-killer -- python3 -c ' 2024-04-17T08:47:10.548 DEBUG:teuthology.orchestra.run.smithi152:> import glob 2024-04-17T08:47:10.548 DEBUG:teuthology.orchestra.run.smithi152:> import re 2024-04-17T08:47:10.548 DEBUG:teuthology.orchestra.run.smithi152:> import os 2024-04-17T08:47:10.548 DEBUG:teuthology.orchestra.run.smithi152:> import subprocess 2024-04-17T08:47:10.548 DEBUG:teuthology.orchestra.run.smithi152:> 2024-04-17T08:47:10.548 DEBUG:teuthology.orchestra.run.smithi152:> def _find_admin_socket(client_name): 2024-04-17T08:47:10.548 DEBUG:teuthology.orchestra.run.smithi152:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-17T08:47:10.548 DEBUG:teuthology.orchestra.run.smithi152:> files = glob.glob(asok_path) 2024-04-17T08:47:10.548 DEBUG:teuthology.orchestra.run.smithi152:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-17T08:47:10.548 DEBUG:teuthology.orchestra.run.smithi152:> 2024-04-17T08:47:10.548 DEBUG:teuthology.orchestra.run.smithi152:> # Given a non-glob path, it better be there 2024-04-17T08:47:10.548 DEBUG:teuthology.orchestra.run.smithi152:> if "*" not in asok_path: 2024-04-17T08:47:10.549 DEBUG:teuthology.orchestra.run.smithi152:> assert(len(files) == 1) 2024-04-17T08:47:10.549 DEBUG:teuthology.orchestra.run.smithi152:> return files[0] 2024-04-17T08:47:10.549 DEBUG:teuthology.orchestra.run.smithi152:> 2024-04-17T08:47:10.549 DEBUG:teuthology.orchestra.run.smithi152:> for f in files: 2024-04-17T08:47:10.549 DEBUG:teuthology.orchestra.run.smithi152:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-17T08:47:10.549 DEBUG:teuthology.orchestra.run.smithi152:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-17T08:47:10.549 DEBUG:teuthology.orchestra.run.smithi152:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-17T08:47:10.549 DEBUG:teuthology.orchestra.run.smithi152:> contents = proc_f.read() 2024-04-17T08:47:10.549 DEBUG:teuthology.orchestra.run.smithi152:> if mountpoint in contents: 2024-04-17T08:47:10.549 DEBUG:teuthology.orchestra.run.smithi152:> return f 2024-04-17T08:47:10.549 DEBUG:teuthology.orchestra.run.smithi152:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-17T08:47:10.549 DEBUG:teuthology.orchestra.run.smithi152:> 2024-04-17T08:47:10.549 DEBUG:teuthology.orchestra.run.smithi152:> print(_find_admin_socket("client.0")) 2024-04-17T08:47:10.549 DEBUG:teuthology.orchestra.run.smithi152:> ' 2024-04-17T08:47:10.672 INFO:teuthology.orchestra.run.smithi152.stdout:/var/run/ceph/ceph-client.0.35800.asok 2024-04-17T08:47:10.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T08:47:10.683 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.35800.asok 2024-04-17T08:47:10.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:10.683 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.35800.asok status 2024-04-17T08:47:10.851 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-17T08:47:10.851 INFO:teuthology.orchestra.run.smithi152.stdout: "metadata": { 2024-04-17T08:47:10.851 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_sha1": "a8c84f5997950fd7d008204839253291d52e6eda", 2024-04-17T08:47:10.851 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_version": "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)", 2024-04-17T08:47:10.851 INFO:teuthology.orchestra.run.smithi152.stdout: "entity_id": "0", 2024-04-17T08:47:10.852 INFO:teuthology.orchestra.run.smithi152.stdout: "hostname": "smithi152", 2024-04-17T08:47:10.852 INFO:teuthology.orchestra.run.smithi152.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-17T08:47:10.852 INFO:teuthology.orchestra.run.smithi152.stdout: "pid": "35800", 2024-04-17T08:47:10.852 INFO:teuthology.orchestra.run.smithi152.stdout: "root": "/" 2024-04-17T08:47:10.852 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-17T08:47:10.852 INFO:teuthology.orchestra.run.smithi152.stdout: "dentry_count": 0, 2024-04-17T08:47:10.852 INFO:teuthology.orchestra.run.smithi152.stdout: "dentry_pinned_count": 0, 2024-04-17T08:47:10.852 INFO:teuthology.orchestra.run.smithi152.stdout: "id": 4851, 2024-04-17T08:47:10.852 INFO:teuthology.orchestra.run.smithi152.stdout: "inst": { 2024-04-17T08:47:10.852 INFO:teuthology.orchestra.run.smithi152.stdout: "name": { 2024-04-17T08:47:10.852 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "client", 2024-04-17T08:47:10.852 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 4851 2024-04-17T08:47:10.852 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-17T08:47:10.852 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": { 2024-04-17T08:47:10.852 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2024-04-17T08:47:10.852 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "192.168.0.1:0", 2024-04-17T08:47:10.852 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 2522266407 2024-04-17T08:47:10.853 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-17T08:47:10.853 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-17T08:47:10.853 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": { 2024-04-17T08:47:10.853 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2024-04-17T08:47:10.853 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "192.168.0.1:0", 2024-04-17T08:47:10.853 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 2522266407 2024-04-17T08:47:10.853 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-17T08:47:10.853 INFO:teuthology.orchestra.run.smithi152.stdout: "inst_str": "client.4851 192.168.0.1:0/2522266407", 2024-04-17T08:47:10.853 INFO:teuthology.orchestra.run.smithi152.stdout: "addr_str": "192.168.0.1:0/2522266407", 2024-04-17T08:47:10.853 INFO:teuthology.orchestra.run.smithi152.stdout: "inode_count": 1, 2024-04-17T08:47:10.853 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_epoch": 9, 2024-04-17T08:47:10.853 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_epoch": 24, 2024-04-17T08:47:10.853 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_epoch_barrier": 0, 2024-04-17T08:47:10.854 INFO:teuthology.orchestra.run.smithi152.stdout: "blocklisted": false, 2024-04-17T08:47:10.854 INFO:teuthology.orchestra.run.smithi152.stdout: "fs_name": "cephfs" 2024-04-17T08:47:10.854 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-17T08:47:10.866 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-17T08:47:11.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.002+0000 7f47c2e00640 1 Processor -- start 2024-04-17T08:47:11.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.002+0000 7f47c2e00640 1 -- start start 2024-04-17T08:47:11.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.002+0000 7f47c2e00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f47bc071ea0 0x7f47bc169670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:11.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.002+0000 7f47c2e00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47bc162aa0 con 0x7f47bc147a90 2024-04-17T08:47:11.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.002+0000 7f47c2e00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47bc162d80 con 0x7f47bc147690 2024-04-17T08:47:11.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.002+0000 7f47c2e00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f47bc163060 con 0x7f47bc071ea0 2024-04-17T08:47:11.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.002+0000 7f47c0e00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f47bc071ea0 0x7f47bc169670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:11.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.002+0000 7f47b3e00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f47bc147a90 0x7f47bc071790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:55606/0 (socket says 172.21.15.152:55606) 2024-04-17T08:47:11.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.002+0000 7f47b3e00640 1 -- 172.21.15.152:0/2170819243 learned_addr learned my addr 172.21.15.152:0/2170819243 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:11.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.002+0000 7f47c0e00640 1 -- 172.21.15.152:0/2170819243 >> v1:172.21.15.196:6789/0 conn(0x7f47bc147690 legacy=0x7f47bc1622e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:11.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.002+0000 7f47c0e00640 1 -- 172.21.15.152:0/2170819243 >> v1:172.21.15.152:6789/0 conn(0x7f47bc147a90 legacy=0x7f47bc071790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:11.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.002+0000 7f47c0e00640 1 -- 172.21.15.152:0/2170819243 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47bc06d560 con 0x7f47bc071ea0 2024-04-17T08:47:11.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.002+0000 7f47bb400640 1 -- 172.21.15.152:0/2170819243 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1457171236 0 0) 0x7f47bc162aa0 con 0x7f47bc147a90 2024-04-17T08:47:11.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.006+0000 7f47c0e00640 1 --2- 172.21.15.152:0/2170819243 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47bc071ea0 0x7f47bc169670 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f47b4009d90 tx=0x7f47b401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37db1f72466f6b31 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:11.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.006+0000 7f47bb400640 1 -- 172.21.15.152:0/2170819243 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b40b2070 con 0x7f47bc071ea0 2024-04-17T08:47:11.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.006+0000 7f47bb400640 1 -- 172.21.15.152:0/2170819243 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47b40a5830 con 0x7f47bc071ea0 2024-04-17T08:47:11.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.006+0000 7f47bb400640 1 -- 172.21.15.152:0/2170819243 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b40a5c00 con 0x7f47bc071ea0 2024-04-17T08:47:11.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.006+0000 7f47c2e00640 1 -- 172.21.15.152:0/2170819243 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47bc071ea0 msgr2=0x7f47bc169670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:11.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.006+0000 7f47c2e00640 1 --2- 172.21.15.152:0/2170819243 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47bc071ea0 0x7f47bc169670 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f47b4009d90 tx=0x7f47b401c930 comp rx=0 tx=0).stop 2024-04-17T08:47:11.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.006+0000 7f47c2e00640 1 -- 172.21.15.152:0/2170819243 shutdown_connections 2024-04-17T08:47:11.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.006+0000 7f47c2e00640 1 --2- 172.21.15.152:0/2170819243 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47bc071ea0 0x7f47bc169670 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:11.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.006+0000 7f47c2e00640 1 -- 172.21.15.152:0/2170819243 >> 172.21.15.152:0/2170819243 conn(0x7f47bc0d2350 msgr2=0x7f47bc0d2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:11.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.006+0000 7f47c2e00640 1 -- 172.21.15.152:0/2170819243 shutdown_connections 2024-04-17T08:47:11.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.006+0000 7f47c2e00640 1 -- 172.21.15.152:0/2170819243 wait complete. 2024-04-17T08:47:11.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.006+0000 7f47c2e00640 1 Processor -- start 2024-04-17T08:47:11.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.010+0000 7f47c2e00640 1 -- start start 2024-04-17T08:47:11.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.010+0000 7f47c2e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47bc071ea0 0x7f47bc15dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:11.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.010+0000 7f47c2e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f47bc147690 0x7f47bc06fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:11.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.010+0000 7f47c2e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f47bc147a90 0x7f47bc142760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:11.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.010+0000 7f47c2e00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f47bc16cb70 con 0x7f47bc071ea0 2024-04-17T08:47:11.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.010+0000 7f47c2e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f47bc16c9f0 con 0x7f47bc147690 2024-04-17T08:47:11.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.010+0000 7f47c2e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f47bc16ccf0 con 0x7f47bc147a90 2024-04-17T08:47:11.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.010+0000 7f47bbe00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47bc071ea0 0x7f47bc15dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:11.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.010+0000 7f47bbe00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47bc071ea0 0x7f47bc15dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46238/0 (socket says 172.21.15.152:46238) 2024-04-17T08:47:11.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.010+0000 7f47bbe00640 1 -- 172.21.15.152:0/3040804115 learned_addr learned my addr 172.21.15.152:0/3040804115 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:11.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.010+0000 7f47c0e00640 1 --2- 172.21.15.152:0/3040804115 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f47bc147a90 0x7f47bc142760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:11.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.010+0000 7f47b3e00640 1 --2- 172.21.15.152:0/3040804115 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f47bc147690 0x7f47bc06fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:11.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.010+0000 7f47bbe00640 1 -- 172.21.15.152:0/3040804115 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f47bc147a90 msgr2=0x7f47bc142760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:11.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.010+0000 7f47bbe00640 1 --2- 172.21.15.152:0/3040804115 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f47bc147a90 0x7f47bc142760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:11.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.010+0000 7f47bbe00640 1 -- 172.21.15.152:0/3040804115 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f47bc147690 msgr2=0x7f47bc06fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:11.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.010+0000 7f47bbe00640 1 --2- 172.21.15.152:0/3040804115 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f47bc147690 0x7f47bc06fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:11.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.010+0000 7f47bbe00640 1 -- 172.21.15.152:0/3040804115 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47bc143920 con 0x7f47bc071ea0 2024-04-17T08:47:11.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.010+0000 7f47bbe00640 1 --2- 172.21.15.152:0/3040804115 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47bc071ea0 0x7f47bc15dbe0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f47ac00c530 tx=0x7f47ac00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:11.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.010+0000 7f47b8c00640 1 -- 172.21.15.152:0/3040804115 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ac016020 con 0x7f47bc071ea0 2024-04-17T08:47:11.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.010+0000 7f47b8c00640 1 -- 172.21.15.152:0/3040804115 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47ac005220 con 0x7f47bc071ea0 2024-04-17T08:47:11.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.010+0000 7f47b8c00640 1 -- 172.21.15.152:0/3040804115 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ac007030 con 0x7f47bc071ea0 2024-04-17T08:47:11.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.010+0000 7f47c2e00640 1 -- 172.21.15.152:0/3040804115 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47bc0700c0 con 0x7f47bc071ea0 2024-04-17T08:47:11.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.010+0000 7f47c2e00640 1 -- 172.21.15.152:0/3040804115 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47bc070640 con 0x7f47bc071ea0 2024-04-17T08:47:11.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.010+0000 7f47c2e00640 1 -- 172.21.15.152:0/3040804115 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47bc068a30 con 0x7f47bc071ea0 2024-04-17T08:47:11.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.014+0000 7f47b8c00640 1 -- 172.21.15.152:0/3040804115 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f47ac0071d0 con 0x7f47bc071ea0 2024-04-17T08:47:11.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.014+0000 7f47b8c00640 1 --2- 172.21.15.152:0/3040804115 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f4798068380 0x7f479806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:11.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.014+0000 7f47b8c00640 1 -- 172.21.15.152:0/3040804115 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f47ac086580 con 0x7f47bc071ea0 2024-04-17T08:47:11.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.014+0000 7f47b3e00640 1 --2- 172.21.15.152:0/3040804115 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f4798068380 0x7f479806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:11.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.014+0000 7f47b3e00640 1 --2- 172.21.15.152:0/3040804115 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f4798068380 0x7f479806a840 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f47bc0d1e20 tx=0x7f47a4007240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:11.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.018+0000 7f47b8c00640 1 -- 172.21.15.152:0/3040804115 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f47ac020020 con 0x7f47bc071ea0 2024-04-17T08:47:11.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.210+0000 7f47c2e00640 1 -- 172.21.15.152:0/3040804115 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f47bc161010 con 0x7f47bc071ea0 2024-04-17T08:47:11.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.210+0000 7f47b8c00640 1 -- 172.21.15.152:0/3040804115 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f47ac0074c0 con 0x7f47bc071ea0 2024-04-17T08:47:11.212 INFO:teuthology.orchestra.run.smithi152.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-17T08:47:11.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.214+0000 7f47c2e00640 1 -- 172.21.15.152:0/3040804115 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f4798068380 msgr2=0x7f479806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:11.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.214+0000 7f47c2e00640 1 --2- 172.21.15.152:0/3040804115 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f4798068380 0x7f479806a840 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f47bc0d1e20 tx=0x7f47a4007240 comp rx=0 tx=0).stop 2024-04-17T08:47:11.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.214+0000 7f47c2e00640 1 -- 172.21.15.152:0/3040804115 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47bc071ea0 msgr2=0x7f47bc15dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:11.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.214+0000 7f47c2e00640 1 --2- 172.21.15.152:0/3040804115 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47bc071ea0 0x7f47bc15dbe0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f47ac00c530 tx=0x7f47ac00c9f0 comp rx=0 tx=0).stop 2024-04-17T08:47:11.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.214+0000 7f47c2e00640 1 -- 172.21.15.152:0/3040804115 shutdown_connections 2024-04-17T08:47:11.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.214+0000 7f47c2e00640 1 --2- 172.21.15.152:0/3040804115 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f4798068380 0x7f479806a840 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:11.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.214+0000 7f47c2e00640 1 --2- 172.21.15.152:0/3040804115 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f47bc147a90 0x7f47bc142760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:11.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.214+0000 7f47c2e00640 1 --2- 172.21.15.152:0/3040804115 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f47bc147690 0x7f47bc06fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:11.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.214+0000 7f47c2e00640 1 --2- 172.21.15.152:0/3040804115 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47bc071ea0 0x7f47bc15dbe0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:11.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.214+0000 7f47c2e00640 1 -- 172.21.15.152:0/3040804115 >> 172.21.15.152:0/3040804115 conn(0x7f47bc0d2350 msgr2=0x7f47bc0d2730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:11.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.214+0000 7f47c2e00640 1 -- 172.21.15.152:0/3040804115 shutdown_connections 2024-04-17T08:47:11.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11.214+0000 7f47c2e00640 1 -- 172.21.15.152:0/3040804115 wait complete. 2024-04-17T08:47:11.233 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-17T08:47:11.233 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-17T08:47:11.233 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi152.front.sepia.ceph.com 2024-04-17T08:47:11.233 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-04-17T08:47:11.233 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-17T08:47:11.233 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-17T08:47:11.233 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-17T08:47:11.233 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-17T08:47:11.233 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-04-17T08:47:11.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:11.234 DEBUG:teuthology.orchestra.run.smithi152:> ip addr 2024-04-17T08:47:11.242 INFO:teuthology.orchestra.run.smithi152.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-17T08:47:11.242 INFO:teuthology.orchestra.run.smithi152.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-17T08:47:11.242 INFO:teuthology.orchestra.run.smithi152.stdout: inet 127.0.0.1/8 scope host lo 2024-04-17T08:47:11.242 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-04-17T08:47:11.242 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 ::1/128 scope host 2024-04-17T08:47:11.242 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-04-17T08:47:11.243 INFO:teuthology.orchestra.run.smithi152.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-17T08:47:11.243 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:da:6c:44 brd ff:ff:ff:ff:ff:ff 2024-04-17T08:47:11.243 INFO:teuthology.orchestra.run.smithi152.stdout: altname enp7s0f0 2024-04-17T08:47:11.243 INFO:teuthology.orchestra.run.smithi152.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-17T08:47:11.243 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:da:6c:45 brd ff:ff:ff:ff:ff:ff 2024-04-17T08:47:11.243 INFO:teuthology.orchestra.run.smithi152.stdout: altname enp7s0f1 2024-04-17T08:47:11.243 INFO:teuthology.orchestra.run.smithi152.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-17T08:47:11.243 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:88:6d:e2 brd ff:ff:ff:ff:ff:ff 2024-04-17T08:47:11.243 INFO:teuthology.orchestra.run.smithi152.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-17T08:47:11.243 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:88:6d:e3 brd ff:ff:ff:ff:ff:ff 2024-04-17T08:47:11.243 INFO:teuthology.orchestra.run.smithi152.stdout: inet 172.21.15.152/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-17T08:47:11.243 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft 42403sec preferred_lft 42403sec 2024-04-17T08:47:11.243 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 fe80::ec4:7aff:fe88:6de3/64 scope link 2024-04-17T08:47:11.243 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-04-17T08:47:11.243 INFO:teuthology.orchestra.run.smithi152.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-17T08:47:11.244 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 02:42:bf:a8:e8:00 brd ff:ff:ff:ff:ff:ff 2024-04-17T08:47:11.244 INFO:teuthology.orchestra.run.smithi152.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-17T08:47:11.244 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-04-17T08:47:11.244 INFO:teuthology.orchestra.run.smithi152.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-17T08:47:11.244 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-17T08:47:11.244 INFO:teuthology.orchestra.run.smithi152.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-17T08:47:11.244 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-04-17T08:47:11.244 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2024-04-17T08:47:11.244 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-04-17T08:47:11.244 INFO:teuthology.orchestra.run.smithi152.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-17T08:47:11.244 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-17T08:47:11.244 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2024-04-17T08:47:11.244 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-04-17T08:47:11.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:11.245 DEBUG:teuthology.orchestra.run.smithi152:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-17T08:47:11.311 INFO:teuthology.orchestra.run.smithi152.stdout:1 2024-04-17T08:47:11.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:11.313 DEBUG:teuthology.orchestra.run.smithi152:> route 2024-04-17T08:47:11.365 INFO:teuthology.orchestra.run.smithi152.stdout:Kernel IP routing table 2024-04-17T08:47:11.365 INFO:teuthology.orchestra.run.smithi152.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-17T08:47:11.365 INFO:teuthology.orchestra.run.smithi152.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-17T08:47:11.365 INFO:teuthology.orchestra.run.smithi152.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-17T08:47:11.365 INFO:teuthology.orchestra.run.smithi152.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-17T08:47:11.365 INFO:teuthology.orchestra.run.smithi152.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-17T08:47:11.365 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-17T08:47:11.366 INFO:teuthology.orchestra.run.smithi152.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-17T08:47:11.366 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-17T08:47:11.366 INFO:teuthology.orchestra.run.smithi152.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-17T08:47:11.366 INFO:teuthology.orchestra.run.smithi152.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-17T08:47:11.366 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T08:47:11.366 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2024-04-17T08:47:11.366 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-17T08:47:11.366 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-17T08:47:11.366 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-17T08:47:11.366 DEBUG:teuthology.orchestra.run.smithi152:> ') 2024-04-17T08:47:11.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T08:47:11.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T08:47:11.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:11.501 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list 2024-04-17T08:47:11.557 INFO:teuthology.orchestra.run.smithi152.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-17T08:47:11.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:11.558 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list-id 2024-04-17T08:47:11.612 INFO:teuthology.orchestra.run.smithi152.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-04-17T08:47:11.613 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T08:47:11.613 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2024-04-17T08:47:11.613 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-17T08:47:11.614 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-04-17T08:47:11.614 DEBUG:teuthology.orchestra.run.smithi152:> ') 2024-04-17T08:47:11.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T08:47:11.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T08:47:11.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:11.740 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-17T08:47:11.805 INFO:teuthology.orchestra.run.smithi152.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-17T08:47:11.805 INFO:teuthology.orchestra.run.smithi152.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-17T08:47:11.805 INFO:teuthology.orchestra.run.smithi152.stdout: inet 127.0.0.1/8 scope host lo 2024-04-17T08:47:11.806 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-04-17T08:47:11.806 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 ::1/128 scope host 2024-04-17T08:47:11.806 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-04-17T08:47:11.806 INFO:teuthology.orchestra.run.smithi152.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-17T08:47:11.806 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether d2:8f:bf:6c:d8:b8 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-17T08:47:11.806 INFO:teuthology.orchestra.run.smithi152.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-17T08:47:11.806 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-04-17T08:47:11.806 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 fe80::d08f:bfff:fe6c:d8b8/64 scope link 2024-04-17T08:47:11.806 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-04-17T08:47:11.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:11.807 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-17T08:47:11.869 INFO:teuthology.orchestra.run.smithi152.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-17T08:47:11.869 INFO:teuthology.orchestra.run.smithi152.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-17T08:47:11.869 INFO:teuthology.orchestra.run.smithi152.stdout: inet 127.0.0.1/8 scope host lo 2024-04-17T08:47:11.869 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-04-17T08:47:11.869 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 ::1/128 scope host 2024-04-17T08:47:11.869 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-04-17T08:47:11.869 INFO:teuthology.orchestra.run.smithi152.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-17T08:47:11.869 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether d2:8f:bf:6c:d8:b8 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-17T08:47:11.869 INFO:teuthology.orchestra.run.smithi152.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-17T08:47:11.869 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-04-17T08:47:11.869 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 fe80::d08f:bfff:fe6c:d8b8/64 scope link 2024-04-17T08:47:11.869 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-04-17T08:47:11.871 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-04-17T08:47:11.871 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T08:47:11.871 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2024-04-17T08:47:11.871 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-04-17T08:47:11.871 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-17T08:47:11.871 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-04-17T08:47:11.871 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-04-17T08:47:11.872 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-04-17T08:47:11.872 DEBUG:teuthology.orchestra.run.smithi152:> ') 2024-04-17T08:47:11.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T08:47:12.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T08:47:12.050 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T08:47:12.050 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2024-04-17T08:47:12.050 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link set brx.1 up 2024-04-17T08:47:12.050 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link set dev brx.1 master ceph-brx 2024-04-17T08:47:12.050 DEBUG:teuthology.orchestra.run.smithi152:> ') 2024-04-17T08:47:12.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T08:47:12.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T08:47:12.179 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-04-17T08:47:12.179 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-17T08:47:12.179 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-04-17T08:47:12.188 INFO:teuthology.orchestra.run.smithi152.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-04-17T08:47:12.188 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-17T08:47:12.188 DEBUG:teuthology.orchestra.run.smithi152:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-04-17T08:47:12.236 DEBUG:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2024-04-17T08:47:12.297 DEBUG:teuthology.orchestra.run.smithi152:> cat /proc/self/mounts | awk '{print $2}' 2024-04-17T08:47:12.350 INFO:teuthology.orchestra.run.smithi152.stdout:/sys 2024-04-17T08:47:12.350 INFO:teuthology.orchestra.run.smithi152.stdout:/proc 2024-04-17T08:47:12.350 INFO:teuthology.orchestra.run.smithi152.stdout:/dev 2024-04-17T08:47:12.351 INFO:teuthology.orchestra.run.smithi152.stdout:/dev/pts 2024-04-17T08:47:12.351 INFO:teuthology.orchestra.run.smithi152.stdout:/run 2024-04-17T08:47:12.351 INFO:teuthology.orchestra.run.smithi152.stdout:/ 2024-04-17T08:47:12.351 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/kernel/security 2024-04-17T08:47:12.351 INFO:teuthology.orchestra.run.smithi152.stdout:/dev/shm 2024-04-17T08:47:12.351 INFO:teuthology.orchestra.run.smithi152.stdout:/run/lock 2024-04-17T08:47:12.351 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/cgroup 2024-04-17T08:47:12.351 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/pstore 2024-04-17T08:47:12.351 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/bpf 2024-04-17T08:47:12.351 INFO:teuthology.orchestra.run.smithi152.stdout:/proc/sys/fs/binfmt_misc 2024-04-17T08:47:12.351 INFO:teuthology.orchestra.run.smithi152.stdout:/dev/hugepages 2024-04-17T08:47:12.351 INFO:teuthology.orchestra.run.smithi152.stdout:/dev/mqueue 2024-04-17T08:47:12.351 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/kernel/debug 2024-04-17T08:47:12.351 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/kernel/tracing 2024-04-17T08:47:12.351 INFO:teuthology.orchestra.run.smithi152.stdout:/proc/fs/nfsd 2024-04-17T08:47:12.352 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/fuse/connections 2024-04-17T08:47:12.352 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/kernel/config 2024-04-17T08:47:12.352 INFO:teuthology.orchestra.run.smithi152.stdout:/run/credentials/systemd-sysusers.service 2024-04-17T08:47:12.352 INFO:teuthology.orchestra.run.smithi152.stdout:/run/rpc_pipefs 2024-04-17T08:47:12.352 INFO:teuthology.orchestra.run.smithi152.stdout:/run/user/1000 2024-04-17T08:47:12.352 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph 2024-04-17T08:47:12.352 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph/osd/ceph-0 2024-04-17T08:47:12.352 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph/osd/ceph-1 2024-04-17T08:47:12.352 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph/osd/ceph-2 2024-04-17T08:47:12.352 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph/osd/ceph-3 2024-04-17T08:47:12.352 INFO:teuthology.orchestra.run.smithi152.stdout:/run/netns 2024-04-17T08:47:12.352 INFO:teuthology.orchestra.run.smithi152.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-17T08:47:12.352 INFO:teuthology.orchestra.run.smithi152.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-17T08:47:12.352 INFO:teuthology.orchestra.run.smithi152.stdout:/home/ubuntu/cephtest/mnt.0 2024-04-17T08:47:12.352 INFO:teuthology.orchestra.run.smithi152.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-17T08:47:12.352 INFO:teuthology.orchestra.run.smithi152.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-17T08:47:12.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:12.353 DEBUG:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2024-04-17T08:47:12.408 INFO:teuthology.orchestra.run.smithi152.stdout:44 2024-04-17T08:47:12.409 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [44] 2024-04-17T08:47:12.409 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-04-17T08:47:12.452 DEBUG:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2024-04-17T08:47:12.472 DEBUG:teuthology.orchestra.run.smithi152:> cat /proc/self/mounts | awk '{print $2}' 2024-04-17T08:47:12.522 INFO:teuthology.orchestra.run.smithi152.stdout:/sys 2024-04-17T08:47:12.522 INFO:teuthology.orchestra.run.smithi152.stdout:/proc 2024-04-17T08:47:12.523 INFO:teuthology.orchestra.run.smithi152.stdout:/dev 2024-04-17T08:47:12.523 INFO:teuthology.orchestra.run.smithi152.stdout:/dev/pts 2024-04-17T08:47:12.523 INFO:teuthology.orchestra.run.smithi152.stdout:/run 2024-04-17T08:47:12.523 INFO:teuthology.orchestra.run.smithi152.stdout:/ 2024-04-17T08:47:12.523 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/kernel/security 2024-04-17T08:47:12.523 INFO:teuthology.orchestra.run.smithi152.stdout:/dev/shm 2024-04-17T08:47:12.523 INFO:teuthology.orchestra.run.smithi152.stdout:/run/lock 2024-04-17T08:47:12.523 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/cgroup 2024-04-17T08:47:12.523 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/pstore 2024-04-17T08:47:12.523 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/bpf 2024-04-17T08:47:12.523 INFO:teuthology.orchestra.run.smithi152.stdout:/proc/sys/fs/binfmt_misc 2024-04-17T08:47:12.523 INFO:teuthology.orchestra.run.smithi152.stdout:/dev/hugepages 2024-04-17T08:47:12.523 INFO:teuthology.orchestra.run.smithi152.stdout:/dev/mqueue 2024-04-17T08:47:12.523 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/kernel/debug 2024-04-17T08:47:12.523 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/kernel/tracing 2024-04-17T08:47:12.524 INFO:teuthology.orchestra.run.smithi152.stdout:/proc/fs/nfsd 2024-04-17T08:47:12.524 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/fuse/connections 2024-04-17T08:47:12.524 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/kernel/config 2024-04-17T08:47:12.524 INFO:teuthology.orchestra.run.smithi152.stdout:/run/credentials/systemd-sysusers.service 2024-04-17T08:47:12.524 INFO:teuthology.orchestra.run.smithi152.stdout:/run/rpc_pipefs 2024-04-17T08:47:12.524 INFO:teuthology.orchestra.run.smithi152.stdout:/run/user/1000 2024-04-17T08:47:12.524 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph 2024-04-17T08:47:12.524 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph/osd/ceph-0 2024-04-17T08:47:12.524 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph/osd/ceph-1 2024-04-17T08:47:12.524 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph/osd/ceph-2 2024-04-17T08:47:12.524 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph/osd/ceph-3 2024-04-17T08:47:12.524 INFO:teuthology.orchestra.run.smithi152.stdout:/run/netns 2024-04-17T08:47:12.524 INFO:teuthology.orchestra.run.smithi152.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-17T08:47:12.524 INFO:teuthology.orchestra.run.smithi152.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-17T08:47:12.524 INFO:teuthology.orchestra.run.smithi152.stdout:/home/ubuntu/cephtest/mnt.0 2024-04-17T08:47:12.524 INFO:teuthology.orchestra.run.smithi152.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-17T08:47:12.525 INFO:teuthology.orchestra.run.smithi152.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-17T08:47:12.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:12.525 DEBUG:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2024-04-17T08:47:12.545 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi152.stderr:2024-04-17T08:47:12.542+0000 7feccdb0e580 -1 init, newargv = 0x5561f10227b0 newargc=15 2024-04-17T08:47:12.545 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi152.stderr:ceph-fuse[35939]: starting ceph client 2024-04-17T08:47:12.552 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi152.stderr:ceph-fuse[35939]: starting fuse 2024-04-17T08:47:12.554 INFO:teuthology.orchestra.run.smithi152.stdout:44 2024-04-17T08:47:12.554 INFO:teuthology.orchestra.run.smithi152.stdout:45 2024-04-17T08:47:12.554 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44, 45] 2024-04-17T08:47:12.554 DEBUG:teuthology.orchestra.run.smithi152:> sudo stdin-killer -- python3 -c ' 2024-04-17T08:47:12.554 DEBUG:teuthology.orchestra.run.smithi152:> import glob 2024-04-17T08:47:12.555 DEBUG:teuthology.orchestra.run.smithi152:> import re 2024-04-17T08:47:12.555 DEBUG:teuthology.orchestra.run.smithi152:> import os 2024-04-17T08:47:12.555 DEBUG:teuthology.orchestra.run.smithi152:> import subprocess 2024-04-17T08:47:12.555 DEBUG:teuthology.orchestra.run.smithi152:> 2024-04-17T08:47:12.555 DEBUG:teuthology.orchestra.run.smithi152:> def _find_admin_socket(client_name): 2024-04-17T08:47:12.555 DEBUG:teuthology.orchestra.run.smithi152:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-04-17T08:47:12.555 DEBUG:teuthology.orchestra.run.smithi152:> files = glob.glob(asok_path) 2024-04-17T08:47:12.555 DEBUG:teuthology.orchestra.run.smithi152:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-04-17T08:47:12.555 DEBUG:teuthology.orchestra.run.smithi152:> 2024-04-17T08:47:12.555 DEBUG:teuthology.orchestra.run.smithi152:> # Given a non-glob path, it better be there 2024-04-17T08:47:12.555 DEBUG:teuthology.orchestra.run.smithi152:> if "*" not in asok_path: 2024-04-17T08:47:12.555 DEBUG:teuthology.orchestra.run.smithi152:> assert(len(files) == 1) 2024-04-17T08:47:12.555 DEBUG:teuthology.orchestra.run.smithi152:> return files[0] 2024-04-17T08:47:12.555 DEBUG:teuthology.orchestra.run.smithi152:> 2024-04-17T08:47:12.555 DEBUG:teuthology.orchestra.run.smithi152:> for f in files: 2024-04-17T08:47:12.555 DEBUG:teuthology.orchestra.run.smithi152:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-17T08:47:12.555 DEBUG:teuthology.orchestra.run.smithi152:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-17T08:47:12.556 DEBUG:teuthology.orchestra.run.smithi152:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-17T08:47:12.556 DEBUG:teuthology.orchestra.run.smithi152:> contents = proc_f.read() 2024-04-17T08:47:12.556 DEBUG:teuthology.orchestra.run.smithi152:> if mountpoint in contents: 2024-04-17T08:47:12.556 DEBUG:teuthology.orchestra.run.smithi152:> return f 2024-04-17T08:47:12.556 DEBUG:teuthology.orchestra.run.smithi152:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-17T08:47:12.556 DEBUG:teuthology.orchestra.run.smithi152:> 2024-04-17T08:47:12.556 DEBUG:teuthology.orchestra.run.smithi152:> print(_find_admin_socket("client.2")) 2024-04-17T08:47:12.556 DEBUG:teuthology.orchestra.run.smithi152:> ' 2024-04-17T08:47:12.676 INFO:teuthology.orchestra.run.smithi152.stdout:/var/run/ceph/ceph-client.2.35939.asok 2024-04-17T08:47:12.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T08:47:12.687 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.35939.asok 2024-04-17T08:47:12.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:12.688 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.35939.asok status 2024-04-17T08:47:12.860 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-17T08:47:12.860 INFO:teuthology.orchestra.run.smithi152.stdout: "metadata": { 2024-04-17T08:47:12.860 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_sha1": "a8c84f5997950fd7d008204839253291d52e6eda", 2024-04-17T08:47:12.860 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_version": "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)", 2024-04-17T08:47:12.860 INFO:teuthology.orchestra.run.smithi152.stdout: "entity_id": "2", 2024-04-17T08:47:12.860 INFO:teuthology.orchestra.run.smithi152.stdout: "hostname": "smithi152", 2024-04-17T08:47:12.860 INFO:teuthology.orchestra.run.smithi152.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-04-17T08:47:12.861 INFO:teuthology.orchestra.run.smithi152.stdout: "pid": "35939", 2024-04-17T08:47:12.861 INFO:teuthology.orchestra.run.smithi152.stdout: "root": "/" 2024-04-17T08:47:12.861 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-17T08:47:12.861 INFO:teuthology.orchestra.run.smithi152.stdout: "dentry_count": 0, 2024-04-17T08:47:12.861 INFO:teuthology.orchestra.run.smithi152.stdout: "dentry_pinned_count": 0, 2024-04-17T08:47:12.861 INFO:teuthology.orchestra.run.smithi152.stdout: "id": 4866, 2024-04-17T08:47:12.861 INFO:teuthology.orchestra.run.smithi152.stdout: "inst": { 2024-04-17T08:47:12.861 INFO:teuthology.orchestra.run.smithi152.stdout: "name": { 2024-04-17T08:47:12.861 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "client", 2024-04-17T08:47:12.861 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 4866 2024-04-17T08:47:12.861 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-17T08:47:12.861 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": { 2024-04-17T08:47:12.861 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2024-04-17T08:47:12.861 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "192.168.0.2:0", 2024-04-17T08:47:12.861 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 2298428161 2024-04-17T08:47:12.862 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-17T08:47:12.862 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-17T08:47:12.862 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": { 2024-04-17T08:47:12.862 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2024-04-17T08:47:12.862 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "192.168.0.2:0", 2024-04-17T08:47:12.862 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 2298428161 2024-04-17T08:47:12.862 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-17T08:47:12.862 INFO:teuthology.orchestra.run.smithi152.stdout: "inst_str": "client.4866 192.168.0.2:0/2298428161", 2024-04-17T08:47:12.862 INFO:teuthology.orchestra.run.smithi152.stdout: "addr_str": "192.168.0.2:0/2298428161", 2024-04-17T08:47:12.862 INFO:teuthology.orchestra.run.smithi152.stdout: "inode_count": 1, 2024-04-17T08:47:12.862 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_epoch": 9, 2024-04-17T08:47:12.862 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_epoch": 24, 2024-04-17T08:47:12.862 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_epoch_barrier": 0, 2024-04-17T08:47:12.862 INFO:teuthology.orchestra.run.smithi152.stdout: "blocklisted": false, 2024-04-17T08:47:12.862 INFO:teuthology.orchestra.run.smithi152.stdout: "fs_name": "cephfs" 2024-04-17T08:47:12.863 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-17T08:47:12.875 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-17T08:47:13.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.010+0000 7fcf56400640 1 Processor -- start 2024-04-17T08:47:13.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.010+0000 7fcf56400640 1 -- start start 2024-04-17T08:47:13.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.010+0000 7fcf56400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fcf5015e4b0 0x7fcf500cd250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:13.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.010+0000 7fcf56400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fcf5015e890 0x7fcf5006f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:13.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.010+0000 7fcf56400640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf500cf0c0 con 0x7fcf500cb8f0 2024-04-17T08:47:13.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.010+0000 7fcf56400640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fcf500cee70 con 0x7fcf5015e890 2024-04-17T08:47:13.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.010+0000 7fcf56400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fcf500cf3a0 con 0x7fcf5015e4b0 2024-04-17T08:47:13.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.010+0000 7fcf4fe00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fcf500cb8f0 0x7fcf50162260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:55612/0 (socket says 172.21.15.152:55612) 2024-04-17T08:47:13.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.010+0000 7fcf46a00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fcf5015e890 0x7fcf5006f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:13.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.010+0000 7fcf4fe00640 1 -- 172.21.15.152:0/4221213554 learned_addr learned my addr 172.21.15.152:0/4221213554 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:13.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.010+0000 7fcf4f400640 1 --2- 172.21.15.152:0/4221213554 >> v2:172.21.15.196:3300/0 conn(0x7fcf5015e4b0 0x7fcf500cd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:13.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.010+0000 7fcf4ea00640 1 -- 172.21.15.152:0/4221213554 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2619169179 0 0) 0x7fcf500cf0c0 con 0x7fcf500cb8f0 2024-04-17T08:47:13.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.010+0000 7fcf4ea00640 1 -- 172.21.15.152:0/4221213554 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf34003530 con 0x7fcf500cb8f0 2024-04-17T08:47:13.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.010+0000 7fcf46a00640 1 -- 172.21.15.152:0/4221213554 >> v2:172.21.15.196:3300/0 conn(0x7fcf5015e4b0 msgr2=0x7fcf500cd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:13.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.010+0000 7fcf46a00640 1 --2- 172.21.15.152:0/4221213554 >> v2:172.21.15.196:3300/0 conn(0x7fcf5015e4b0 0x7fcf500cd250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:13.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.010+0000 7fcf46a00640 1 -- 172.21.15.152:0/4221213554 >> v1:172.21.15.152:6789/0 conn(0x7fcf500cb8f0 legacy=0x7fcf50162260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:13.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.010+0000 7fcf46a00640 1 -- 172.21.15.152:0/4221213554 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf500cf680 con 0x7fcf5015e890 2024-04-17T08:47:13.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.014+0000 7fcf46a00640 1 --2- 172.21.15.152:0/4221213554 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf5015e890 0x7fcf5006f480 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fcf5006bd20 tx=0x7fcf3801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73390b617f51ed1e server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:13.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.014+0000 7fcf4ea00640 1 -- 172.21.15.152:0/4221213554 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf380b0070 con 0x7fcf5015e890 2024-04-17T08:47:13.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.014+0000 7fcf4ea00640 1 -- 172.21.15.152:0/4221213554 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf380ab600 con 0x7fcf5015e890 2024-04-17T08:47:13.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.014+0000 7fcf4ea00640 1 -- 172.21.15.152:0/4221213554 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf380ab9d0 con 0x7fcf5015e890 2024-04-17T08:47:13.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.014+0000 7fcf56400640 1 -- 172.21.15.152:0/4221213554 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf5015e890 msgr2=0x7fcf5006f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:13.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.014+0000 7fcf56400640 1 --2- 172.21.15.152:0/4221213554 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf5015e890 0x7fcf5006f480 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fcf5006bd20 tx=0x7fcf3801c3f0 comp rx=0 tx=0).stop 2024-04-17T08:47:13.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.014+0000 7fcf56400640 1 -- 172.21.15.152:0/4221213554 shutdown_connections 2024-04-17T08:47:13.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.014+0000 7fcf56400640 1 --2- 172.21.15.152:0/4221213554 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf5015e890 0x7fcf5006f480 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:13.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.014+0000 7fcf56400640 1 --2- 172.21.15.152:0/4221213554 >> v2:172.21.15.196:3300/0 conn(0x7fcf5015e4b0 0x7fcf500cd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:13.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.014+0000 7fcf56400640 1 -- 172.21.15.152:0/4221213554 >> 172.21.15.152:0/4221213554 conn(0x7fcf50072ca0 msgr2=0x7fcf50073080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:13.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.014+0000 7fcf56400640 1 -- 172.21.15.152:0/4221213554 shutdown_connections 2024-04-17T08:47:13.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.014+0000 7fcf56400640 1 -- 172.21.15.152:0/4221213554 wait complete. 2024-04-17T08:47:13.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.018+0000 7fcf56400640 1 Processor -- start 2024-04-17T08:47:13.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.018+0000 7fcf56400640 1 -- start start 2024-04-17T08:47:13.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.018+0000 7fcf56400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf500cb8f0 0x7fcf50152ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:13.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.018+0000 7fcf56400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf5015e4b0 0x7fcf50168dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:13.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.018+0000 7fcf56400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf5015e890 0x7fcf50150c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:13.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.018+0000 7fcf56400640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5016b570 con 0x7fcf500cb8f0 2024-04-17T08:47:13.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.018+0000 7fcf56400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5016b3f0 con 0x7fcf5015e4b0 2024-04-17T08:47:13.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.018+0000 7fcf56400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fcf5016b6f0 con 0x7fcf5015e890 2024-04-17T08:47:13.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.018+0000 7fcf4f400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf500cb8f0 0x7fcf50152ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:13.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.018+0000 7fcf4f400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf500cb8f0 0x7fcf50152ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46252/0 (socket says 172.21.15.152:46252) 2024-04-17T08:47:13.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.018+0000 7fcf4f400640 1 -- 172.21.15.152:0/2652086552 learned_addr learned my addr 172.21.15.152:0/2652086552 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:13.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.018+0000 7fcf46a00640 1 --2- 172.21.15.152:0/2652086552 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf5015e4b0 0x7fcf50168dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:13.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.018+0000 7fcf4fe00640 1 --2- 172.21.15.152:0/2652086552 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf5015e890 0x7fcf50150c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:13.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.018+0000 7fcf4f400640 1 -- 172.21.15.152:0/2652086552 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf5015e890 msgr2=0x7fcf50150c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:13.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.018+0000 7fcf4f400640 1 --2- 172.21.15.152:0/2652086552 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf5015e890 0x7fcf50150c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:13.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.018+0000 7fcf4f400640 1 -- 172.21.15.152:0/2652086552 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf5015e4b0 msgr2=0x7fcf50168dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:13.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.018+0000 7fcf4f400640 1 --2- 172.21.15.152:0/2652086552 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf5015e4b0 0x7fcf50168dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:13.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.018+0000 7fcf4f400640 1 -- 172.21.15.152:0/2652086552 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf500ae8c0 con 0x7fcf500cb8f0 2024-04-17T08:47:13.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.018+0000 7fcf4fe00640 1 --2- 172.21.15.152:0/2652086552 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf5015e890 0x7fcf50150c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:13.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.018+0000 7fcf4f400640 1 --2- 172.21.15.152:0/2652086552 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf500cb8f0 0x7fcf50152ae0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fcf4000e870 tx=0x7fcf4000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:13.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.018+0000 7fcf47e00640 1 -- 172.21.15.152:0/2652086552 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf40017070 con 0x7fcf500cb8f0 2024-04-17T08:47:13.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.018+0000 7fcf47e00640 1 -- 172.21.15.152:0/2652086552 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf4000c940 con 0x7fcf500cb8f0 2024-04-17T08:47:13.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.018+0000 7fcf47e00640 1 -- 172.21.15.152:0/2652086552 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf4000ccf0 con 0x7fcf500cb8f0 2024-04-17T08:47:13.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.018+0000 7fcf56400640 1 -- 172.21.15.152:0/2652086552 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf50152240 con 0x7fcf500cb8f0 2024-04-17T08:47:13.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.018+0000 7fcf56400640 1 -- 172.21.15.152:0/2652086552 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf50152800 con 0x7fcf500cb8f0 2024-04-17T08:47:13.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.018+0000 7fcf56400640 1 -- 172.21.15.152:0/2652086552 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf50068a30 con 0x7fcf500cb8f0 2024-04-17T08:47:13.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.022+0000 7fcf47e00640 1 -- 172.21.15.152:0/2652086552 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcf4001a070 con 0x7fcf500cb8f0 2024-04-17T08:47:13.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.022+0000 7fcf47e00640 1 --2- 172.21.15.152:0/2652086552 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fcf2c0683b0 0x7fcf2c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:13.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.022+0000 7fcf47e00640 1 -- 172.21.15.152:0/2652086552 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fcf40086b70 con 0x7fcf500cb8f0 2024-04-17T08:47:13.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.022+0000 7fcf46a00640 1 --2- 172.21.15.152:0/2652086552 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fcf2c0683b0 0x7fcf2c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:13.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.022+0000 7fcf46a00640 1 --2- 172.21.15.152:0/2652086552 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fcf2c0683b0 0x7fcf2c06a870 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcf380ad000 tx=0x7fcf38008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:13.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.026+0000 7fcf47e00640 1 -- 172.21.15.152:0/2652086552 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fcf40056700 con 0x7fcf500cb8f0 2024-04-17T08:47:13.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.222+0000 7fcf56400640 1 -- 172.21.15.152:0/2652086552 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fcf50070eb0 con 0x7fcf500cb8f0 2024-04-17T08:47:13.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.222+0000 7fcf47e00640 1 -- 172.21.15.152:0/2652086552 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7fcf4005aa00 con 0x7fcf500cb8f0 2024-04-17T08:47:13.222 INFO:teuthology.orchestra.run.smithi152.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-17T08:47:13.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.222+0000 7fcf56400640 1 -- 172.21.15.152:0/2652086552 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fcf2c0683b0 msgr2=0x7fcf2c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:13.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.222+0000 7fcf56400640 1 --2- 172.21.15.152:0/2652086552 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fcf2c0683b0 0x7fcf2c06a870 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcf380ad000 tx=0x7fcf38008040 comp rx=0 tx=0).stop 2024-04-17T08:47:13.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.222+0000 7fcf56400640 1 -- 172.21.15.152:0/2652086552 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf500cb8f0 msgr2=0x7fcf50152ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:13.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.222+0000 7fcf56400640 1 --2- 172.21.15.152:0/2652086552 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf500cb8f0 0x7fcf50152ae0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fcf4000e870 tx=0x7fcf4000ec70 comp rx=0 tx=0).stop 2024-04-17T08:47:13.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.222+0000 7fcf56400640 1 -- 172.21.15.152:0/2652086552 shutdown_connections 2024-04-17T08:47:13.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.222+0000 7fcf56400640 1 --2- 172.21.15.152:0/2652086552 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fcf2c0683b0 0x7fcf2c06a870 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:13.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.222+0000 7fcf56400640 1 --2- 172.21.15.152:0/2652086552 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf5015e890 0x7fcf50150c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:13.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.222+0000 7fcf56400640 1 --2- 172.21.15.152:0/2652086552 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf5015e4b0 0x7fcf50168dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:13.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.222+0000 7fcf56400640 1 --2- 172.21.15.152:0/2652086552 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf500cb8f0 0x7fcf50152ae0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:13.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.222+0000 7fcf56400640 1 -- 172.21.15.152:0/2652086552 >> 172.21.15.152:0/2652086552 conn(0x7fcf50072ca0 msgr2=0x7fcf500678e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:13.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.222+0000 7fcf56400640 1 -- 172.21.15.152:0/2652086552 shutdown_connections 2024-04-17T08:47:13.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:13.222+0000 7fcf56400640 1 -- 172.21.15.152:0/2652086552 wait complete. 2024-04-17T08:47:13.244 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-17T08:47:13.244 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-17T08:47:13.244 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi196.front.sepia.ceph.com 2024-04-17T08:47:13.244 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-17T08:47:13.244 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-17T08:47:13.244 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-17T08:47:13.244 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-17T08:47:13.244 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-17T08:47:13.244 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-17T08:47:13.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:13.245 DEBUG:teuthology.orchestra.run.smithi196:> ip addr 2024-04-17T08:47:13.254 INFO:teuthology.orchestra.run.smithi196.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-17T08:47:13.254 INFO:teuthology.orchestra.run.smithi196.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-17T08:47:13.254 INFO:teuthology.orchestra.run.smithi196.stdout: inet 127.0.0.1/8 scope host lo 2024-04-17T08:47:13.254 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2024-04-17T08:47:13.255 INFO:teuthology.orchestra.run.smithi196.stdout: inet6 ::1/128 scope host 2024-04-17T08:47:13.255 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2024-04-17T08:47:13.255 INFO:teuthology.orchestra.run.smithi196.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-17T08:47:13.255 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether 0c:c4:7a:d9:38:be brd ff:ff:ff:ff:ff:ff 2024-04-17T08:47:13.255 INFO:teuthology.orchestra.run.smithi196.stdout: altname enp7s0f0 2024-04-17T08:47:13.255 INFO:teuthology.orchestra.run.smithi196.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-17T08:47:13.255 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether 0c:c4:7a:d9:38:bf brd ff:ff:ff:ff:ff:ff 2024-04-17T08:47:13.255 INFO:teuthology.orchestra.run.smithi196.stdout: altname enp7s0f1 2024-04-17T08:47:13.255 INFO:teuthology.orchestra.run.smithi196.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-17T08:47:13.255 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether 0c:c4:7a:88:7f:46 brd ff:ff:ff:ff:ff:ff 2024-04-17T08:47:13.255 INFO:teuthology.orchestra.run.smithi196.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-17T08:47:13.255 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether 0c:c4:7a:88:7f:47 brd ff:ff:ff:ff:ff:ff 2024-04-17T08:47:13.255 INFO:teuthology.orchestra.run.smithi196.stdout: inet 172.21.15.196/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-17T08:47:13.255 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft 42389sec preferred_lft 42389sec 2024-04-17T08:47:13.255 INFO:teuthology.orchestra.run.smithi196.stdout: inet6 fe80::ec4:7aff:fe88:7f47/64 scope link 2024-04-17T08:47:13.256 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2024-04-17T08:47:13.256 INFO:teuthology.orchestra.run.smithi196.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-17T08:47:13.256 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether 02:42:50:1b:4c:d5 brd ff:ff:ff:ff:ff:ff 2024-04-17T08:47:13.256 INFO:teuthology.orchestra.run.smithi196.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-17T08:47:13.256 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2024-04-17T08:47:13.257 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-17T08:47:13.257 DEBUG:teuthology.orchestra.run.smithi196:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T08:47:13.257 DEBUG:teuthology.orchestra.run.smithi196:> set -e 2024-04-17T08:47:13.257 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip link add name ceph-brx type bridge 2024-04-17T08:47:13.257 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip addr flush dev ceph-brx 2024-04-17T08:47:13.257 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip link set ceph-brx up 2024-04-17T08:47:13.257 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-17T08:47:13.257 DEBUG:teuthology.orchestra.run.smithi196:> ') 2024-04-17T08:47:13.352 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:47:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T08:47:13.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:47:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T08:47:13.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:13.420 DEBUG:teuthology.orchestra.run.smithi196:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-17T08:47:13.438 INFO:teuthology.orchestra.run.smithi196.stdout:1 2024-04-17T08:47:13.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:13.440 DEBUG:teuthology.orchestra.run.smithi196:> route 2024-04-17T08:47:13.514 INFO:teuthology.orchestra.run.smithi196.stdout:Kernel IP routing table 2024-04-17T08:47:13.514 INFO:teuthology.orchestra.run.smithi196.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-17T08:47:13.514 INFO:teuthology.orchestra.run.smithi196.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-17T08:47:13.514 INFO:teuthology.orchestra.run.smithi196.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-17T08:47:13.515 INFO:teuthology.orchestra.run.smithi196.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-17T08:47:13.515 INFO:teuthology.orchestra.run.smithi196.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-17T08:47:13.515 INFO:teuthology.orchestra.run.smithi196.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-17T08:47:13.515 INFO:teuthology.orchestra.run.smithi196.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-17T08:47:13.515 INFO:teuthology.orchestra.run.smithi196.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-17T08:47:13.515 INFO:teuthology.orchestra.run.smithi196.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-17T08:47:13.515 INFO:teuthology.orchestra.run.smithi196.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-17T08:47:13.515 DEBUG:teuthology.orchestra.run.smithi196:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T08:47:13.515 DEBUG:teuthology.orchestra.run.smithi196:> set -e 2024-04-17T08:47:13.515 DEBUG:teuthology.orchestra.run.smithi196:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-17T08:47:13.515 DEBUG:teuthology.orchestra.run.smithi196:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-17T08:47:13.516 DEBUG:teuthology.orchestra.run.smithi196:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-17T08:47:13.516 DEBUG:teuthology.orchestra.run.smithi196:> ') 2024-04-17T08:47:13.601 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:47:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T08:47:13.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:47:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T08:47:13.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:13.648 DEBUG:teuthology.orchestra.run.smithi196:> ip netns list 2024-04-17T08:47:13.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:13.657 DEBUG:teuthology.orchestra.run.smithi196:> ip netns list-id 2024-04-17T08:47:13.708 DEBUG:teuthology.orchestra.run.smithi196:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T08:47:13.708 DEBUG:teuthology.orchestra.run.smithi196:> set -e 2024-04-17T08:47:13.708 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-17T08:47:13.708 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-17T08:47:13.708 DEBUG:teuthology.orchestra.run.smithi196:> ') 2024-04-17T08:47:13.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:47:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T08:47:13.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:47:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T08:47:13.834 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-17T08:47:13.835 DEBUG:teuthology.orchestra.run.smithi196:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T08:47:13.835 DEBUG:teuthology.orchestra.run.smithi196:> set -e 2024-04-17T08:47:13.835 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-17T08:47:13.835 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-17T08:47:13.835 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-17T08:47:13.835 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-17T08:47:13.835 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-17T08:47:13.835 DEBUG:teuthology.orchestra.run.smithi196:> ') 2024-04-17T08:47:13.926 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:47:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T08:47:14.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:47:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T08:47:14.048 DEBUG:teuthology.orchestra.run.smithi196:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T08:47:14.048 DEBUG:teuthology.orchestra.run.smithi196:> set -e 2024-04-17T08:47:14.049 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip link set brx.0 up 2024-04-17T08:47:14.049 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip link set dev brx.0 master ceph-brx 2024-04-17T08:47:14.049 DEBUG:teuthology.orchestra.run.smithi196:> ') 2024-04-17T08:47:14.095 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:47:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T08:47:14.125 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:47:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T08:47:14.132 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-04-17T08:47:14.132 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-17T08:47:14.132 DEBUG:teuthology.orchestra.run.smithi196:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-17T08:47:14.141 INFO:teuthology.orchestra.run.smithi196.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-17T08:47:14.141 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-17T08:47:14.142 DEBUG:teuthology.orchestra.run.smithi196:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-17T08:47:14.191 DEBUG:teuthology.orchestra.run.smithi196:> sudo modprobe fuse 2024-04-17T08:47:14.254 DEBUG:teuthology.orchestra.run.smithi196:> cat /proc/self/mounts | awk '{print $2}' 2024-04-17T08:47:14.305 INFO:teuthology.orchestra.run.smithi196.stdout:/sys 2024-04-17T08:47:14.305 INFO:teuthology.orchestra.run.smithi196.stdout:/proc 2024-04-17T08:47:14.305 INFO:teuthology.orchestra.run.smithi196.stdout:/dev 2024-04-17T08:47:14.305 INFO:teuthology.orchestra.run.smithi196.stdout:/dev/pts 2024-04-17T08:47:14.306 INFO:teuthology.orchestra.run.smithi196.stdout:/run 2024-04-17T08:47:14.306 INFO:teuthology.orchestra.run.smithi196.stdout:/ 2024-04-17T08:47:14.306 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/kernel/security 2024-04-17T08:47:14.306 INFO:teuthology.orchestra.run.smithi196.stdout:/dev/shm 2024-04-17T08:47:14.306 INFO:teuthology.orchestra.run.smithi196.stdout:/run/lock 2024-04-17T08:47:14.306 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/fs/cgroup 2024-04-17T08:47:14.306 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/fs/pstore 2024-04-17T08:47:14.306 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/fs/bpf 2024-04-17T08:47:14.306 INFO:teuthology.orchestra.run.smithi196.stdout:/proc/sys/fs/binfmt_misc 2024-04-17T08:47:14.306 INFO:teuthology.orchestra.run.smithi196.stdout:/dev/hugepages 2024-04-17T08:47:14.306 INFO:teuthology.orchestra.run.smithi196.stdout:/dev/mqueue 2024-04-17T08:47:14.306 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/kernel/debug 2024-04-17T08:47:14.306 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/kernel/tracing 2024-04-17T08:47:14.307 INFO:teuthology.orchestra.run.smithi196.stdout:/proc/fs/nfsd 2024-04-17T08:47:14.307 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/fs/fuse/connections 2024-04-17T08:47:14.307 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/kernel/config 2024-04-17T08:47:14.307 INFO:teuthology.orchestra.run.smithi196.stdout:/run/credentials/systemd-sysusers.service 2024-04-17T08:47:14.307 INFO:teuthology.orchestra.run.smithi196.stdout:/run/rpc_pipefs 2024-04-17T08:47:14.307 INFO:teuthology.orchestra.run.smithi196.stdout:/run/user/1000 2024-04-17T08:47:14.307 INFO:teuthology.orchestra.run.smithi196.stdout:/var/lib/ceph 2024-04-17T08:47:14.307 INFO:teuthology.orchestra.run.smithi196.stdout:/var/lib/ceph/osd/ceph-4 2024-04-17T08:47:14.307 INFO:teuthology.orchestra.run.smithi196.stdout:/var/lib/ceph/osd/ceph-5 2024-04-17T08:47:14.307 INFO:teuthology.orchestra.run.smithi196.stdout:/var/lib/ceph/osd/ceph-6 2024-04-17T08:47:14.307 INFO:teuthology.orchestra.run.smithi196.stdout:/var/lib/ceph/osd/ceph-7 2024-04-17T08:47:14.307 INFO:teuthology.orchestra.run.smithi196.stdout:/run/netns 2024-04-17T08:47:14.307 INFO:teuthology.orchestra.run.smithi196.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-17T08:47:14.307 INFO:teuthology.orchestra.run.smithi196.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-17T08:47:14.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:14.308 DEBUG:teuthology.orchestra.run.smithi196:> ls /sys/fs/fuse/connections 2024-04-17T08:47:14.363 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-17T08:47:14.364 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-04-17T08:47:14.410 DEBUG:teuthology.orchestra.run.smithi196:> sudo modprobe fuse 2024-04-17T08:47:14.431 DEBUG:teuthology.orchestra.run.smithi196:> cat /proc/self/mounts | awk '{print $2}' 2024-04-17T08:47:14.481 INFO:teuthology.orchestra.run.smithi196.stdout:/sys 2024-04-17T08:47:14.481 INFO:teuthology.orchestra.run.smithi196.stdout:/proc 2024-04-17T08:47:14.482 INFO:teuthology.orchestra.run.smithi196.stdout:/dev 2024-04-17T08:47:14.482 INFO:teuthology.orchestra.run.smithi196.stdout:/dev/pts 2024-04-17T08:47:14.482 INFO:teuthology.orchestra.run.smithi196.stdout:/run 2024-04-17T08:47:14.482 INFO:teuthology.orchestra.run.smithi196.stdout:/ 2024-04-17T08:47:14.482 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/kernel/security 2024-04-17T08:47:14.482 INFO:teuthology.orchestra.run.smithi196.stdout:/dev/shm 2024-04-17T08:47:14.482 INFO:teuthology.orchestra.run.smithi196.stdout:/run/lock 2024-04-17T08:47:14.482 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/fs/cgroup 2024-04-17T08:47:14.482 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/fs/pstore 2024-04-17T08:47:14.482 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/fs/bpf 2024-04-17T08:47:14.482 INFO:teuthology.orchestra.run.smithi196.stdout:/proc/sys/fs/binfmt_misc 2024-04-17T08:47:14.482 INFO:teuthology.orchestra.run.smithi196.stdout:/dev/hugepages 2024-04-17T08:47:14.482 INFO:teuthology.orchestra.run.smithi196.stdout:/dev/mqueue 2024-04-17T08:47:14.483 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/kernel/debug 2024-04-17T08:47:14.483 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/kernel/tracing 2024-04-17T08:47:14.483 INFO:teuthology.orchestra.run.smithi196.stdout:/proc/fs/nfsd 2024-04-17T08:47:14.483 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/fs/fuse/connections 2024-04-17T08:47:14.483 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/kernel/config 2024-04-17T08:47:14.483 INFO:teuthology.orchestra.run.smithi196.stdout:/run/credentials/systemd-sysusers.service 2024-04-17T08:47:14.483 INFO:teuthology.orchestra.run.smithi196.stdout:/run/rpc_pipefs 2024-04-17T08:47:14.483 INFO:teuthology.orchestra.run.smithi196.stdout:/run/user/1000 2024-04-17T08:47:14.483 INFO:teuthology.orchestra.run.smithi196.stdout:/var/lib/ceph 2024-04-17T08:47:14.483 INFO:teuthology.orchestra.run.smithi196.stdout:/var/lib/ceph/osd/ceph-4 2024-04-17T08:47:14.483 INFO:teuthology.orchestra.run.smithi196.stdout:/var/lib/ceph/osd/ceph-5 2024-04-17T08:47:14.483 INFO:teuthology.orchestra.run.smithi196.stdout:/var/lib/ceph/osd/ceph-6 2024-04-17T08:47:14.483 INFO:teuthology.orchestra.run.smithi196.stdout:/var/lib/ceph/osd/ceph-7 2024-04-17T08:47:14.483 INFO:teuthology.orchestra.run.smithi196.stdout:/run/netns 2024-04-17T08:47:14.483 INFO:teuthology.orchestra.run.smithi196.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-17T08:47:14.484 INFO:teuthology.orchestra.run.smithi196.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-17T08:47:14.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:14.485 DEBUG:teuthology.orchestra.run.smithi196:> ls /sys/fs/fuse/connections 2024-04-17T08:47:14.505 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi196.stderr:2024-04-17T08:47:14.502+0000 7fb66afa0580 -1 init, newargv = 0x564c406d5ce0 newargc=15 2024-04-17T08:47:14.505 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi196.stderr:ceph-fuse[33137]: starting ceph client 2024-04-17T08:47:14.513 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi196.stderr:ceph-fuse[33137]: starting fuse 2024-04-17T08:47:15.613 DEBUG:teuthology.orchestra.run.smithi196:> sudo modprobe fuse 2024-04-17T08:47:15.635 DEBUG:teuthology.orchestra.run.smithi196:> cat /proc/self/mounts | awk '{print $2}' 2024-04-17T08:47:15.686 INFO:teuthology.orchestra.run.smithi196.stdout:/sys 2024-04-17T08:47:15.686 INFO:teuthology.orchestra.run.smithi196.stdout:/proc 2024-04-17T08:47:15.686 INFO:teuthology.orchestra.run.smithi196.stdout:/dev 2024-04-17T08:47:15.686 INFO:teuthology.orchestra.run.smithi196.stdout:/dev/pts 2024-04-17T08:47:15.686 INFO:teuthology.orchestra.run.smithi196.stdout:/run 2024-04-17T08:47:15.686 INFO:teuthology.orchestra.run.smithi196.stdout:/ 2024-04-17T08:47:15.686 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/kernel/security 2024-04-17T08:47:15.686 INFO:teuthology.orchestra.run.smithi196.stdout:/dev/shm 2024-04-17T08:47:15.686 INFO:teuthology.orchestra.run.smithi196.stdout:/run/lock 2024-04-17T08:47:15.686 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/fs/cgroup 2024-04-17T08:47:15.686 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/fs/pstore 2024-04-17T08:47:15.686 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/fs/bpf 2024-04-17T08:47:15.687 INFO:teuthology.orchestra.run.smithi196.stdout:/proc/sys/fs/binfmt_misc 2024-04-17T08:47:15.687 INFO:teuthology.orchestra.run.smithi196.stdout:/dev/hugepages 2024-04-17T08:47:15.687 INFO:teuthology.orchestra.run.smithi196.stdout:/dev/mqueue 2024-04-17T08:47:15.687 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/kernel/debug 2024-04-17T08:47:15.687 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/kernel/tracing 2024-04-17T08:47:15.687 INFO:teuthology.orchestra.run.smithi196.stdout:/proc/fs/nfsd 2024-04-17T08:47:15.687 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/fs/fuse/connections 2024-04-17T08:47:15.687 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/kernel/config 2024-04-17T08:47:15.687 INFO:teuthology.orchestra.run.smithi196.stdout:/run/credentials/systemd-sysusers.service 2024-04-17T08:47:15.687 INFO:teuthology.orchestra.run.smithi196.stdout:/run/rpc_pipefs 2024-04-17T08:47:15.687 INFO:teuthology.orchestra.run.smithi196.stdout:/run/user/1000 2024-04-17T08:47:15.687 INFO:teuthology.orchestra.run.smithi196.stdout:/var/lib/ceph 2024-04-17T08:47:15.687 INFO:teuthology.orchestra.run.smithi196.stdout:/var/lib/ceph/osd/ceph-4 2024-04-17T08:47:15.687 INFO:teuthology.orchestra.run.smithi196.stdout:/var/lib/ceph/osd/ceph-5 2024-04-17T08:47:15.687 INFO:teuthology.orchestra.run.smithi196.stdout:/var/lib/ceph/osd/ceph-6 2024-04-17T08:47:15.688 INFO:teuthology.orchestra.run.smithi196.stdout:/var/lib/ceph/osd/ceph-7 2024-04-17T08:47:15.688 INFO:teuthology.orchestra.run.smithi196.stdout:/run/netns 2024-04-17T08:47:15.688 INFO:teuthology.orchestra.run.smithi196.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-17T08:47:15.688 INFO:teuthology.orchestra.run.smithi196.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-17T08:47:15.688 INFO:teuthology.orchestra.run.smithi196.stdout:/home/ubuntu/cephtest/mnt.1 2024-04-17T08:47:15.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:15.689 DEBUG:teuthology.orchestra.run.smithi196:> ls /sys/fs/fuse/connections 2024-04-17T08:47:15.740 INFO:teuthology.orchestra.run.smithi196.stdout:44 2024-04-17T08:47:15.740 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-04-17T08:47:15.740 DEBUG:teuthology.orchestra.run.smithi196:> sudo stdin-killer -- python3 -c ' 2024-04-17T08:47:15.740 DEBUG:teuthology.orchestra.run.smithi196:> import glob 2024-04-17T08:47:15.740 DEBUG:teuthology.orchestra.run.smithi196:> import re 2024-04-17T08:47:15.740 DEBUG:teuthology.orchestra.run.smithi196:> import os 2024-04-17T08:47:15.741 DEBUG:teuthology.orchestra.run.smithi196:> import subprocess 2024-04-17T08:47:15.741 DEBUG:teuthology.orchestra.run.smithi196:> 2024-04-17T08:47:15.741 DEBUG:teuthology.orchestra.run.smithi196:> def _find_admin_socket(client_name): 2024-04-17T08:47:15.741 DEBUG:teuthology.orchestra.run.smithi196:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-04-17T08:47:15.741 DEBUG:teuthology.orchestra.run.smithi196:> files = glob.glob(asok_path) 2024-04-17T08:47:15.741 DEBUG:teuthology.orchestra.run.smithi196:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-04-17T08:47:15.741 DEBUG:teuthology.orchestra.run.smithi196:> 2024-04-17T08:47:15.741 DEBUG:teuthology.orchestra.run.smithi196:> # Given a non-glob path, it better be there 2024-04-17T08:47:15.741 DEBUG:teuthology.orchestra.run.smithi196:> if "*" not in asok_path: 2024-04-17T08:47:15.741 DEBUG:teuthology.orchestra.run.smithi196:> assert(len(files) == 1) 2024-04-17T08:47:15.741 DEBUG:teuthology.orchestra.run.smithi196:> return files[0] 2024-04-17T08:47:15.741 DEBUG:teuthology.orchestra.run.smithi196:> 2024-04-17T08:47:15.741 DEBUG:teuthology.orchestra.run.smithi196:> for f in files: 2024-04-17T08:47:15.741 DEBUG:teuthology.orchestra.run.smithi196:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-17T08:47:15.741 DEBUG:teuthology.orchestra.run.smithi196:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-17T08:47:15.741 DEBUG:teuthology.orchestra.run.smithi196:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-17T08:47:15.741 DEBUG:teuthology.orchestra.run.smithi196:> contents = proc_f.read() 2024-04-17T08:47:15.741 DEBUG:teuthology.orchestra.run.smithi196:> if mountpoint in contents: 2024-04-17T08:47:15.741 DEBUG:teuthology.orchestra.run.smithi196:> return f 2024-04-17T08:47:15.742 DEBUG:teuthology.orchestra.run.smithi196:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-17T08:47:15.742 DEBUG:teuthology.orchestra.run.smithi196:> 2024-04-17T08:47:15.742 DEBUG:teuthology.orchestra.run.smithi196:> print(_find_admin_socket("client.1")) 2024-04-17T08:47:15.742 DEBUG:teuthology.orchestra.run.smithi196:> ' 2024-04-17T08:47:15.865 INFO:teuthology.orchestra.run.smithi196.stdout:/var/run/ceph/ceph-client.1.33137.asok 2024-04-17T08:47:15.869 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:47:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T08:47:15.877 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.33137.asok 2024-04-17T08:47:15.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:15.877 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.33137.asok status 2024-04-17T08:47:16.051 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-04-17T08:47:16.052 INFO:teuthology.orchestra.run.smithi196.stdout: "metadata": { 2024-04-17T08:47:16.052 INFO:teuthology.orchestra.run.smithi196.stdout: "ceph_sha1": "a8c84f5997950fd7d008204839253291d52e6eda", 2024-04-17T08:47:16.052 INFO:teuthology.orchestra.run.smithi196.stdout: "ceph_version": "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)", 2024-04-17T08:47:16.052 INFO:teuthology.orchestra.run.smithi196.stdout: "entity_id": "1", 2024-04-17T08:47:16.052 INFO:teuthology.orchestra.run.smithi196.stdout: "hostname": "smithi196", 2024-04-17T08:47:16.052 INFO:teuthology.orchestra.run.smithi196.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-04-17T08:47:16.052 INFO:teuthology.orchestra.run.smithi196.stdout: "pid": "33137", 2024-04-17T08:47:16.052 INFO:teuthology.orchestra.run.smithi196.stdout: "root": "/" 2024-04-17T08:47:16.052 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-17T08:47:16.052 INFO:teuthology.orchestra.run.smithi196.stdout: "dentry_count": 0, 2024-04-17T08:47:16.052 INFO:teuthology.orchestra.run.smithi196.stdout: "dentry_pinned_count": 0, 2024-04-17T08:47:16.052 INFO:teuthology.orchestra.run.smithi196.stdout: "id": 4577, 2024-04-17T08:47:16.052 INFO:teuthology.orchestra.run.smithi196.stdout: "inst": { 2024-04-17T08:47:16.053 INFO:teuthology.orchestra.run.smithi196.stdout: "name": { 2024-04-17T08:47:16.053 INFO:teuthology.orchestra.run.smithi196.stdout: "type": "client", 2024-04-17T08:47:16.053 INFO:teuthology.orchestra.run.smithi196.stdout: "num": 4577 2024-04-17T08:47:16.053 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-17T08:47:16.053 INFO:teuthology.orchestra.run.smithi196.stdout: "addr": { 2024-04-17T08:47:16.053 INFO:teuthology.orchestra.run.smithi196.stdout: "type": "v1", 2024-04-17T08:47:16.053 INFO:teuthology.orchestra.run.smithi196.stdout: "addr": "192.168.0.1:0", 2024-04-17T08:47:16.053 INFO:teuthology.orchestra.run.smithi196.stdout: "nonce": 3997694572 2024-04-17T08:47:16.053 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-04-17T08:47:16.053 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-17T08:47:16.053 INFO:teuthology.orchestra.run.smithi196.stdout: "addr": { 2024-04-17T08:47:16.053 INFO:teuthology.orchestra.run.smithi196.stdout: "type": "v1", 2024-04-17T08:47:16.053 INFO:teuthology.orchestra.run.smithi196.stdout: "addr": "192.168.0.1:0", 2024-04-17T08:47:16.053 INFO:teuthology.orchestra.run.smithi196.stdout: "nonce": 3997694572 2024-04-17T08:47:16.054 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-17T08:47:16.054 INFO:teuthology.orchestra.run.smithi196.stdout: "inst_str": "client.4577 192.168.0.1:0/3997694572", 2024-04-17T08:47:16.054 INFO:teuthology.orchestra.run.smithi196.stdout: "addr_str": "192.168.0.1:0/3997694572", 2024-04-17T08:47:16.054 INFO:teuthology.orchestra.run.smithi196.stdout: "inode_count": 1, 2024-04-17T08:47:16.054 INFO:teuthology.orchestra.run.smithi196.stdout: "mds_epoch": 9, 2024-04-17T08:47:16.054 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_epoch": 25, 2024-04-17T08:47:16.054 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_epoch_barrier": 0, 2024-04-17T08:47:16.054 INFO:teuthology.orchestra.run.smithi196.stdout: "blocklisted": false, 2024-04-17T08:47:16.054 INFO:teuthology.orchestra.run.smithi196.stdout: "fs_name": "cephfs" 2024-04-17T08:47:16.054 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-04-17T08:47:16.066 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-17T08:47:16.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.209+0000 7fa141400640 1 Processor -- start 2024-04-17T08:47:16.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.209+0000 7fa141400640 1 -- start start 2024-04-17T08:47:16.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.209+0000 7fa141400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa13c06b9b0 0x7fa13c06bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:16.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.209+0000 7fa141400640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa13c06c310 con 0x7fa13c158fe0 2024-04-17T08:47:16.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.209+0000 7fa141400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa13c0b4610 con 0x7fa13c070950 2024-04-17T08:47:16.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.209+0000 7fa141400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fa13c0cea60 con 0x7fa13c06b9b0 2024-04-17T08:47:16.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.209+0000 7fa13a800640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fa13c158fe0 0x7fa13c15f7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:55624/0 (socket says 172.21.15.152:55624) 2024-04-17T08:47:16.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.209+0000 7fa13a800640 1 -- 172.21.15.152:0/1348406955 learned_addr learned my addr 172.21.15.152:0/1348406955 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:16.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.209+0000 7fa13b200640 1 --2- 172.21.15.152:0/1348406955 >> v2:172.21.15.196:3300/0 conn(0x7fa13c06b9b0 0x7fa13c06bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:16.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.209+0000 7fa139400640 1 -- 172.21.15.152:0/1348406955 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 937360008 0 0) 0x7fa13c06c310 con 0x7fa13c158fe0 2024-04-17T08:47:16.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.209+0000 7fa139400640 1 -- 172.21.15.152:0/1348406955 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa120003530 con 0x7fa13c158fe0 2024-04-17T08:47:16.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.209+0000 7fa139400640 1 -- 172.21.15.152:0/1348406955 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1169883909 0 0) 0x7fa13c0b4610 con 0x7fa13c070950 2024-04-17T08:47:16.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.209+0000 7fa139400640 1 -- 172.21.15.152:0/1348406955 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa13c06c310 con 0x7fa13c070950 2024-04-17T08:47:16.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.209+0000 7fa13b200640 1 -- 172.21.15.152:0/1348406955 >> v1:172.21.15.196:6789/0 conn(0x7fa13c070950 legacy=0x7fa13c0b3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:16.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.209+0000 7fa13b200640 1 -- 172.21.15.152:0/1348406955 >> v1:172.21.15.152:6789/0 conn(0x7fa13c158fe0 legacy=0x7fa13c15f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:16.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.209+0000 7fa13b200640 1 -- 172.21.15.152:0/1348406955 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa13c0ced40 con 0x7fa13c06b9b0 2024-04-17T08:47:16.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.213+0000 7fa13b200640 1 --2- 172.21.15.152:0/1348406955 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa13c06b9b0 0x7fa13c06bdd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa134009d90 tx=0x7fa13401c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=117d2c391bd04711 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:16.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.213+0000 7fa139400640 1 -- 172.21.15.152:0/1348406955 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1340b2070 con 0x7fa13c06b9b0 2024-04-17T08:47:16.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.213+0000 7fa139400640 1 -- 172.21.15.152:0/1348406955 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1340a5a00 con 0x7fa13c06b9b0 2024-04-17T08:47:16.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.213+0000 7fa139400640 1 -- 172.21.15.152:0/1348406955 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1340a5db0 con 0x7fa13c06b9b0 2024-04-17T08:47:16.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.213+0000 7fa141400640 1 -- 172.21.15.152:0/1348406955 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa13c06b9b0 msgr2=0x7fa13c06bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:16.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.213+0000 7fa141400640 1 --2- 172.21.15.152:0/1348406955 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa13c06b9b0 0x7fa13c06bdd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa134009d90 tx=0x7fa13401c940 comp rx=0 tx=0).stop 2024-04-17T08:47:16.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.213+0000 7fa141400640 1 -- 172.21.15.152:0/1348406955 shutdown_connections 2024-04-17T08:47:16.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.213+0000 7fa141400640 1 --2- 172.21.15.152:0/1348406955 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa13c06b9b0 0x7fa13c06bdd0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:16.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.213+0000 7fa141400640 1 -- 172.21.15.152:0/1348406955 >> 172.21.15.152:0/1348406955 conn(0x7fa13c0cd540 msgr2=0x7fa13c0cd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:16.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.213+0000 7fa141400640 1 -- 172.21.15.152:0/1348406955 shutdown_connections 2024-04-17T08:47:16.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.213+0000 7fa141400640 1 -- 172.21.15.152:0/1348406955 wait complete. 2024-04-17T08:47:16.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.217+0000 7fa141400640 1 Processor -- start 2024-04-17T08:47:16.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.217+0000 7fa141400640 1 -- start start 2024-04-17T08:47:16.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.217+0000 7fa141400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa13c06b9b0 0x7fa13c0b0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:16.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.217+0000 7fa141400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa13c070950 0x7fa13c14ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:16.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.217+0000 7fa141400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa13c158fe0 0x7fa13c149e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:16.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.217+0000 7fa141400640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa13c16c550 con 0x7fa13c06b9b0 2024-04-17T08:47:16.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.217+0000 7fa141400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa13c16c3d0 con 0x7fa13c158fe0 2024-04-17T08:47:16.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.217+0000 7fa141400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fa13c16c6d0 con 0x7fa13c070950 2024-04-17T08:47:16.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.217+0000 7fa13a800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa13c06b9b0 0x7fa13c0b0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:16.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.217+0000 7fa13a800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa13c06b9b0 0x7fa13c0b0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46260/0 (socket says 172.21.15.152:46260) 2024-04-17T08:47:16.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.217+0000 7fa13a800640 1 -- 172.21.15.152:0/1670737209 learned_addr learned my addr 172.21.15.152:0/1670737209 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:16.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.217+0000 7fa139e00640 1 --2- 172.21.15.152:0/1670737209 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa13c070950 0x7fa13c14ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:16.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.217+0000 7fa13b200640 1 --2- 172.21.15.152:0/1670737209 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa13c158fe0 0x7fa13c149e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:16.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.217+0000 7fa13a800640 1 -- 172.21.15.152:0/1670737209 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa13c070950 msgr2=0x7fa13c14ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:16.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.217+0000 7fa13a800640 1 --2- 172.21.15.152:0/1670737209 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa13c070950 0x7fa13c14ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:16.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.217+0000 7fa13a800640 1 -- 172.21.15.152:0/1670737209 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa13c158fe0 msgr2=0x7fa13c149e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:16.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.217+0000 7fa13a800640 1 --2- 172.21.15.152:0/1670737209 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa13c158fe0 0x7fa13c149e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:16.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.217+0000 7fa13a800640 1 -- 172.21.15.152:0/1670737209 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa13c14c670 con 0x7fa13c06b9b0 2024-04-17T08:47:16.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.217+0000 7fa13b200640 1 --2- 172.21.15.152:0/1670737209 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa13c158fe0 0x7fa13c149e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:16.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.217+0000 7fa13a800640 1 --2- 172.21.15.152:0/1670737209 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa13c06b9b0 0x7fa13c0b0820 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa12c00c420 tx=0x7fa12c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:16.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.217+0000 7fa132a00640 1 -- 172.21.15.152:0/1670737209 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa12c017070 con 0x7fa13c06b9b0 2024-04-17T08:47:16.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.217+0000 7fa132a00640 1 -- 172.21.15.152:0/1670737209 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa12c005cf0 con 0x7fa13c06b9b0 2024-04-17T08:47:16.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.217+0000 7fa141400640 1 -- 172.21.15.152:0/1670737209 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa13c14a970 con 0x7fa13c06b9b0 2024-04-17T08:47:16.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.217+0000 7fa132a00640 1 -- 172.21.15.152:0/1670737209 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa12c007310 con 0x7fa13c06b9b0 2024-04-17T08:47:16.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.217+0000 7fa141400640 1 -- 172.21.15.152:0/1670737209 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa13c14af30 con 0x7fa13c06b9b0 2024-04-17T08:47:16.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.217+0000 7fa141400640 1 -- 172.21.15.152:0/1670737209 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa13c068a30 con 0x7fa13c06b9b0 2024-04-17T08:47:16.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.221+0000 7fa132a00640 1 -- 172.21.15.152:0/1670737209 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa12c01a070 con 0x7fa13c06b9b0 2024-04-17T08:47:16.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.221+0000 7fa132a00640 1 --2- 172.21.15.152:0/1670737209 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fa11c068380 0x7fa11c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:16.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.221+0000 7fa132a00640 1 -- 172.21.15.152:0/1670737209 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fa12c0861b0 con 0x7fa13c06b9b0 2024-04-17T08:47:16.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.221+0000 7fa139e00640 1 --2- 172.21.15.152:0/1670737209 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fa11c068380 0x7fa11c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:16.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.221+0000 7fa139e00640 1 --2- 172.21.15.152:0/1670737209 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fa11c068380 0x7fa11c06a840 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa128007fd0 tx=0x7fa128009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:16.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.225+0000 7fa132a00640 1 -- 172.21.15.152:0/1670737209 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fa12c056340 con 0x7fa13c06b9b0 2024-04-17T08:47:16.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.417+0000 7fa141400640 1 -- 172.21.15.152:0/1670737209 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa13c15fcb0 con 0x7fa13c06b9b0 2024-04-17T08:47:16.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.417+0000 7fa132a00640 1 -- 172.21.15.152:0/1670737209 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7fa12c055c40 con 0x7fa13c06b9b0 2024-04-17T08:47:16.423 INFO:teuthology.orchestra.run.smithi152.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-17T08:47:16.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.421+0000 7fa141400640 1 -- 172.21.15.152:0/1670737209 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fa11c068380 msgr2=0x7fa11c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:16.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.421+0000 7fa141400640 1 --2- 172.21.15.152:0/1670737209 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fa11c068380 0x7fa11c06a840 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa128007fd0 tx=0x7fa128009040 comp rx=0 tx=0).stop 2024-04-17T08:47:16.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.421+0000 7fa141400640 1 -- 172.21.15.152:0/1670737209 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa13c06b9b0 msgr2=0x7fa13c0b0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:16.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.421+0000 7fa141400640 1 --2- 172.21.15.152:0/1670737209 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa13c06b9b0 0x7fa13c0b0820 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa12c00c420 tx=0x7fa12c00c8e0 comp rx=0 tx=0).stop 2024-04-17T08:47:16.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.421+0000 7fa141400640 1 -- 172.21.15.152:0/1670737209 shutdown_connections 2024-04-17T08:47:16.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.421+0000 7fa141400640 1 --2- 172.21.15.152:0/1670737209 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa13c158fe0 0x7fa13c149e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:16.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.421+0000 7fa141400640 1 --2- 172.21.15.152:0/1670737209 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fa11c068380 0x7fa11c06a840 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:16.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.421+0000 7fa141400640 1 --2- 172.21.15.152:0/1670737209 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa13c070950 0x7fa13c14ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:16.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.421+0000 7fa141400640 1 --2- 172.21.15.152:0/1670737209 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa13c06b9b0 0x7fa13c0b0820 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:16.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.421+0000 7fa141400640 1 -- 172.21.15.152:0/1670737209 >> 172.21.15.152:0/1670737209 conn(0x7fa13c0cd540 msgr2=0x7fa13c067770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:16.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.421+0000 7fa141400640 1 -- 172.21.15.152:0/1670737209 shutdown_connections 2024-04-17T08:47:16.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:16.421+0000 7fa141400640 1 -- 172.21.15.152:0/1670737209 wait complete. 2024-04-17T08:47:16.442 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-17T08:47:16.442 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-17T08:47:16.442 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi196.front.sepia.ceph.com 2024-04-17T08:47:16.442 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-04-17T08:47:16.442 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-17T08:47:16.442 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-17T08:47:16.442 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-17T08:47:16.443 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-17T08:47:16.443 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-04-17T08:47:16.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:16.443 DEBUG:teuthology.orchestra.run.smithi196:> ip addr 2024-04-17T08:47:16.452 INFO:teuthology.orchestra.run.smithi196.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-17T08:47:16.452 INFO:teuthology.orchestra.run.smithi196.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-17T08:47:16.452 INFO:teuthology.orchestra.run.smithi196.stdout: inet 127.0.0.1/8 scope host lo 2024-04-17T08:47:16.452 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2024-04-17T08:47:16.452 INFO:teuthology.orchestra.run.smithi196.stdout: inet6 ::1/128 scope host 2024-04-17T08:47:16.452 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2024-04-17T08:47:16.452 INFO:teuthology.orchestra.run.smithi196.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-17T08:47:16.452 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether 0c:c4:7a:d9:38:be brd ff:ff:ff:ff:ff:ff 2024-04-17T08:47:16.452 INFO:teuthology.orchestra.run.smithi196.stdout: altname enp7s0f0 2024-04-17T08:47:16.452 INFO:teuthology.orchestra.run.smithi196.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-17T08:47:16.452 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether 0c:c4:7a:d9:38:bf brd ff:ff:ff:ff:ff:ff 2024-04-17T08:47:16.453 INFO:teuthology.orchestra.run.smithi196.stdout: altname enp7s0f1 2024-04-17T08:47:16.453 INFO:teuthology.orchestra.run.smithi196.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-17T08:47:16.453 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether 0c:c4:7a:88:7f:46 brd ff:ff:ff:ff:ff:ff 2024-04-17T08:47:16.453 INFO:teuthology.orchestra.run.smithi196.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-17T08:47:16.453 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether 0c:c4:7a:88:7f:47 brd ff:ff:ff:ff:ff:ff 2024-04-17T08:47:16.453 INFO:teuthology.orchestra.run.smithi196.stdout: inet 172.21.15.196/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-17T08:47:16.453 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft 42385sec preferred_lft 42385sec 2024-04-17T08:47:16.453 INFO:teuthology.orchestra.run.smithi196.stdout: inet6 fe80::ec4:7aff:fe88:7f47/64 scope link 2024-04-17T08:47:16.453 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2024-04-17T08:47:16.453 INFO:teuthology.orchestra.run.smithi196.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-17T08:47:16.453 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether 02:42:50:1b:4c:d5 brd ff:ff:ff:ff:ff:ff 2024-04-17T08:47:16.453 INFO:teuthology.orchestra.run.smithi196.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-17T08:47:16.453 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2024-04-17T08:47:16.453 INFO:teuthology.orchestra.run.smithi196.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-17T08:47:16.453 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-17T08:47:16.454 INFO:teuthology.orchestra.run.smithi196.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-17T08:47:16.454 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2024-04-17T08:47:16.454 INFO:teuthology.orchestra.run.smithi196.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-17T08:47:16.454 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2024-04-17T08:47:16.454 INFO:teuthology.orchestra.run.smithi196.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-17T08:47:16.454 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-17T08:47:16.454 INFO:teuthology.orchestra.run.smithi196.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-17T08:47:16.454 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2024-04-17T08:47:16.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:16.455 DEBUG:teuthology.orchestra.run.smithi196:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-17T08:47:16.513 INFO:teuthology.orchestra.run.smithi196.stdout:1 2024-04-17T08:47:16.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:16.516 DEBUG:teuthology.orchestra.run.smithi196:> route 2024-04-17T08:47:16.567 INFO:teuthology.orchestra.run.smithi196.stdout:Kernel IP routing table 2024-04-17T08:47:16.567 INFO:teuthology.orchestra.run.smithi196.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-17T08:47:16.567 INFO:teuthology.orchestra.run.smithi196.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-17T08:47:16.567 INFO:teuthology.orchestra.run.smithi196.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-17T08:47:16.567 INFO:teuthology.orchestra.run.smithi196.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-17T08:47:16.567 INFO:teuthology.orchestra.run.smithi196.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-17T08:47:16.567 INFO:teuthology.orchestra.run.smithi196.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-17T08:47:16.568 INFO:teuthology.orchestra.run.smithi196.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-17T08:47:16.568 INFO:teuthology.orchestra.run.smithi196.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-17T08:47:16.568 INFO:teuthology.orchestra.run.smithi196.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-17T08:47:16.568 INFO:teuthology.orchestra.run.smithi196.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-17T08:47:16.568 DEBUG:teuthology.orchestra.run.smithi196:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T08:47:16.568 DEBUG:teuthology.orchestra.run.smithi196:> set -e 2024-04-17T08:47:16.568 DEBUG:teuthology.orchestra.run.smithi196:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-17T08:47:16.568 DEBUG:teuthology.orchestra.run.smithi196:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-17T08:47:16.568 DEBUG:teuthology.orchestra.run.smithi196:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-17T08:47:16.568 DEBUG:teuthology.orchestra.run.smithi196:> ') 2024-04-17T08:47:16.653 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:47:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T08:47:16.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:47:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T08:47:16.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:16.700 DEBUG:teuthology.orchestra.run.smithi196:> ip netns list 2024-04-17T08:47:16.752 INFO:teuthology.orchestra.run.smithi196.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-17T08:47:16.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:16.753 DEBUG:teuthology.orchestra.run.smithi196:> ip netns list-id 2024-04-17T08:47:16.807 INFO:teuthology.orchestra.run.smithi196.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-04-17T08:47:16.808 DEBUG:teuthology.orchestra.run.smithi196:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T08:47:16.808 DEBUG:teuthology.orchestra.run.smithi196:> set -e 2024-04-17T08:47:16.808 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-17T08:47:16.808 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-04-17T08:47:16.809 DEBUG:teuthology.orchestra.run.smithi196:> ') 2024-04-17T08:47:16.902 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:47:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T08:47:16.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:47:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T08:47:16.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:16.938 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-17T08:47:16.958 INFO:teuthology.orchestra.run.smithi196.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-17T08:47:16.959 INFO:teuthology.orchestra.run.smithi196.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-17T08:47:16.959 INFO:teuthology.orchestra.run.smithi196.stdout: inet 127.0.0.1/8 scope host lo 2024-04-17T08:47:16.959 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2024-04-17T08:47:16.959 INFO:teuthology.orchestra.run.smithi196.stdout: inet6 ::1/128 scope host 2024-04-17T08:47:16.959 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2024-04-17T08:47:16.959 INFO:teuthology.orchestra.run.smithi196.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-17T08:47:16.959 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether 26:59:f0:92:b8:62 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-17T08:47:16.959 INFO:teuthology.orchestra.run.smithi196.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-17T08:47:16.959 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2024-04-17T08:47:16.959 INFO:teuthology.orchestra.run.smithi196.stdout: inet6 fe80::2459:f0ff:fe92:b862/64 scope link 2024-04-17T08:47:16.959 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2024-04-17T08:47:16.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:16.961 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-17T08:47:17.023 INFO:teuthology.orchestra.run.smithi196.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-17T08:47:17.023 INFO:teuthology.orchestra.run.smithi196.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-17T08:47:17.023 INFO:teuthology.orchestra.run.smithi196.stdout: inet 127.0.0.1/8 scope host lo 2024-04-17T08:47:17.023 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2024-04-17T08:47:17.023 INFO:teuthology.orchestra.run.smithi196.stdout: inet6 ::1/128 scope host 2024-04-17T08:47:17.023 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2024-04-17T08:47:17.023 INFO:teuthology.orchestra.run.smithi196.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-17T08:47:17.024 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether 26:59:f0:92:b8:62 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-17T08:47:17.024 INFO:teuthology.orchestra.run.smithi196.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-17T08:47:17.024 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2024-04-17T08:47:17.024 INFO:teuthology.orchestra.run.smithi196.stdout: inet6 fe80::2459:f0ff:fe92:b862/64 scope link 2024-04-17T08:47:17.024 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2024-04-17T08:47:17.025 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-04-17T08:47:17.025 DEBUG:teuthology.orchestra.run.smithi196:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T08:47:17.025 DEBUG:teuthology.orchestra.run.smithi196:> set -e 2024-04-17T08:47:17.025 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-04-17T08:47:17.026 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-17T08:47:17.026 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-04-17T08:47:17.026 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-04-17T08:47:17.026 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-04-17T08:47:17.026 DEBUG:teuthology.orchestra.run.smithi196:> ') 2024-04-17T08:47:17.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:47:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T08:47:17.196 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:47:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T08:47:17.202 DEBUG:teuthology.orchestra.run.smithi196:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T08:47:17.203 DEBUG:teuthology.orchestra.run.smithi196:> set -e 2024-04-17T08:47:17.203 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip link set brx.1 up 2024-04-17T08:47:17.203 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip link set dev brx.1 master ceph-brx 2024-04-17T08:47:17.203 DEBUG:teuthology.orchestra.run.smithi196:> ') 2024-04-17T08:47:17.294 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:47:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T08:47:17.324 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:47:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T08:47:17.330 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-04-17T08:47:17.331 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-17T08:47:17.331 DEBUG:teuthology.orchestra.run.smithi196:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-04-17T08:47:17.339 INFO:teuthology.orchestra.run.smithi196.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-04-17T08:47:17.339 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-17T08:47:17.339 DEBUG:teuthology.orchestra.run.smithi196:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-04-17T08:47:17.387 DEBUG:teuthology.orchestra.run.smithi196:> sudo modprobe fuse 2024-04-17T08:47:17.448 DEBUG:teuthology.orchestra.run.smithi196:> cat /proc/self/mounts | awk '{print $2}' 2024-04-17T08:47:17.501 INFO:teuthology.orchestra.run.smithi196.stdout:/sys 2024-04-17T08:47:17.501 INFO:teuthology.orchestra.run.smithi196.stdout:/proc 2024-04-17T08:47:17.501 INFO:teuthology.orchestra.run.smithi196.stdout:/dev 2024-04-17T08:47:17.501 INFO:teuthology.orchestra.run.smithi196.stdout:/dev/pts 2024-04-17T08:47:17.501 INFO:teuthology.orchestra.run.smithi196.stdout:/run 2024-04-17T08:47:17.502 INFO:teuthology.orchestra.run.smithi196.stdout:/ 2024-04-17T08:47:17.502 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/kernel/security 2024-04-17T08:47:17.502 INFO:teuthology.orchestra.run.smithi196.stdout:/dev/shm 2024-04-17T08:47:17.502 INFO:teuthology.orchestra.run.smithi196.stdout:/run/lock 2024-04-17T08:47:17.502 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/fs/cgroup 2024-04-17T08:47:17.502 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/fs/pstore 2024-04-17T08:47:17.502 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/fs/bpf 2024-04-17T08:47:17.502 INFO:teuthology.orchestra.run.smithi196.stdout:/proc/sys/fs/binfmt_misc 2024-04-17T08:47:17.502 INFO:teuthology.orchestra.run.smithi196.stdout:/dev/hugepages 2024-04-17T08:47:17.502 INFO:teuthology.orchestra.run.smithi196.stdout:/dev/mqueue 2024-04-17T08:47:17.502 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/kernel/debug 2024-04-17T08:47:17.502 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/kernel/tracing 2024-04-17T08:47:17.502 INFO:teuthology.orchestra.run.smithi196.stdout:/proc/fs/nfsd 2024-04-17T08:47:17.502 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/fs/fuse/connections 2024-04-17T08:47:17.503 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/kernel/config 2024-04-17T08:47:17.503 INFO:teuthology.orchestra.run.smithi196.stdout:/run/credentials/systemd-sysusers.service 2024-04-17T08:47:17.503 INFO:teuthology.orchestra.run.smithi196.stdout:/run/rpc_pipefs 2024-04-17T08:47:17.503 INFO:teuthology.orchestra.run.smithi196.stdout:/run/user/1000 2024-04-17T08:47:17.503 INFO:teuthology.orchestra.run.smithi196.stdout:/var/lib/ceph 2024-04-17T08:47:17.503 INFO:teuthology.orchestra.run.smithi196.stdout:/var/lib/ceph/osd/ceph-4 2024-04-17T08:47:17.503 INFO:teuthology.orchestra.run.smithi196.stdout:/var/lib/ceph/osd/ceph-5 2024-04-17T08:47:17.503 INFO:teuthology.orchestra.run.smithi196.stdout:/var/lib/ceph/osd/ceph-6 2024-04-17T08:47:17.503 INFO:teuthology.orchestra.run.smithi196.stdout:/var/lib/ceph/osd/ceph-7 2024-04-17T08:47:17.503 INFO:teuthology.orchestra.run.smithi196.stdout:/run/netns 2024-04-17T08:47:17.503 INFO:teuthology.orchestra.run.smithi196.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-17T08:47:17.503 INFO:teuthology.orchestra.run.smithi196.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-17T08:47:17.503 INFO:teuthology.orchestra.run.smithi196.stdout:/home/ubuntu/cephtest/mnt.1 2024-04-17T08:47:17.503 INFO:teuthology.orchestra.run.smithi196.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-17T08:47:17.503 INFO:teuthology.orchestra.run.smithi196.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-17T08:47:17.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:17.504 DEBUG:teuthology.orchestra.run.smithi196:> ls /sys/fs/fuse/connections 2024-04-17T08:47:17.556 INFO:teuthology.orchestra.run.smithi196.stdout:44 2024-04-17T08:47:17.556 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [44] 2024-04-17T08:47:17.556 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-04-17T08:47:17.599 DEBUG:teuthology.orchestra.run.smithi196:> sudo modprobe fuse 2024-04-17T08:47:17.619 DEBUG:teuthology.orchestra.run.smithi196:> cat /proc/self/mounts | awk '{print $2}' 2024-04-17T08:47:17.673 INFO:teuthology.orchestra.run.smithi196.stdout:/sys 2024-04-17T08:47:17.673 INFO:teuthology.orchestra.run.smithi196.stdout:/proc 2024-04-17T08:47:17.674 INFO:teuthology.orchestra.run.smithi196.stdout:/dev 2024-04-17T08:47:17.674 INFO:teuthology.orchestra.run.smithi196.stdout:/dev/pts 2024-04-17T08:47:17.674 INFO:teuthology.orchestra.run.smithi196.stdout:/run 2024-04-17T08:47:17.674 INFO:teuthology.orchestra.run.smithi196.stdout:/ 2024-04-17T08:47:17.674 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/kernel/security 2024-04-17T08:47:17.674 INFO:teuthology.orchestra.run.smithi196.stdout:/dev/shm 2024-04-17T08:47:17.674 INFO:teuthology.orchestra.run.smithi196.stdout:/run/lock 2024-04-17T08:47:17.674 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/fs/cgroup 2024-04-17T08:47:17.674 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/fs/pstore 2024-04-17T08:47:17.674 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/fs/bpf 2024-04-17T08:47:17.674 INFO:teuthology.orchestra.run.smithi196.stdout:/proc/sys/fs/binfmt_misc 2024-04-17T08:47:17.674 INFO:teuthology.orchestra.run.smithi196.stdout:/dev/hugepages 2024-04-17T08:47:17.674 INFO:teuthology.orchestra.run.smithi196.stdout:/dev/mqueue 2024-04-17T08:47:17.675 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/kernel/debug 2024-04-17T08:47:17.675 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/kernel/tracing 2024-04-17T08:47:17.675 INFO:teuthology.orchestra.run.smithi196.stdout:/proc/fs/nfsd 2024-04-17T08:47:17.675 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/fs/fuse/connections 2024-04-17T08:47:17.675 INFO:teuthology.orchestra.run.smithi196.stdout:/sys/kernel/config 2024-04-17T08:47:17.675 INFO:teuthology.orchestra.run.smithi196.stdout:/run/credentials/systemd-sysusers.service 2024-04-17T08:47:17.675 INFO:teuthology.orchestra.run.smithi196.stdout:/run/rpc_pipefs 2024-04-17T08:47:17.675 INFO:teuthology.orchestra.run.smithi196.stdout:/run/user/1000 2024-04-17T08:47:17.675 INFO:teuthology.orchestra.run.smithi196.stdout:/var/lib/ceph 2024-04-17T08:47:17.675 INFO:teuthology.orchestra.run.smithi196.stdout:/var/lib/ceph/osd/ceph-4 2024-04-17T08:47:17.675 INFO:teuthology.orchestra.run.smithi196.stdout:/var/lib/ceph/osd/ceph-5 2024-04-17T08:47:17.675 INFO:teuthology.orchestra.run.smithi196.stdout:/var/lib/ceph/osd/ceph-6 2024-04-17T08:47:17.675 INFO:teuthology.orchestra.run.smithi196.stdout:/var/lib/ceph/osd/ceph-7 2024-04-17T08:47:17.675 INFO:teuthology.orchestra.run.smithi196.stdout:/run/netns 2024-04-17T08:47:17.675 INFO:teuthology.orchestra.run.smithi196.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-17T08:47:17.676 INFO:teuthology.orchestra.run.smithi196.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-17T08:47:17.676 INFO:teuthology.orchestra.run.smithi196.stdout:/home/ubuntu/cephtest/mnt.1 2024-04-17T08:47:17.676 INFO:teuthology.orchestra.run.smithi196.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-17T08:47:17.676 INFO:teuthology.orchestra.run.smithi196.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-17T08:47:17.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:17.677 DEBUG:teuthology.orchestra.run.smithi196:> ls /sys/fs/fuse/connections 2024-04-17T08:47:17.693 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi196.stderr:2024-04-17T08:47:17.694+0000 7f19eadd7580 -1 init, newargv = 0x5634b5c87180 newargc=15 2024-04-17T08:47:17.693 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi196.stderr:ceph-fuse[33256]: starting ceph client 2024-04-17T08:47:17.701 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi196.stderr:ceph-fuse[33256]: starting fuse 2024-04-17T08:47:17.702 INFO:teuthology.orchestra.run.smithi196.stdout:44 2024-04-17T08:47:17.702 INFO:teuthology.orchestra.run.smithi196.stdout:45 2024-04-17T08:47:17.702 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44, 45] 2024-04-17T08:47:17.702 DEBUG:teuthology.orchestra.run.smithi196:> sudo stdin-killer -- python3 -c ' 2024-04-17T08:47:17.702 DEBUG:teuthology.orchestra.run.smithi196:> import glob 2024-04-17T08:47:17.702 DEBUG:teuthology.orchestra.run.smithi196:> import re 2024-04-17T08:47:17.702 DEBUG:teuthology.orchestra.run.smithi196:> import os 2024-04-17T08:47:17.702 DEBUG:teuthology.orchestra.run.smithi196:> import subprocess 2024-04-17T08:47:17.702 DEBUG:teuthology.orchestra.run.smithi196:> 2024-04-17T08:47:17.703 DEBUG:teuthology.orchestra.run.smithi196:> def _find_admin_socket(client_name): 2024-04-17T08:47:17.703 DEBUG:teuthology.orchestra.run.smithi196:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-04-17T08:47:17.703 DEBUG:teuthology.orchestra.run.smithi196:> files = glob.glob(asok_path) 2024-04-17T08:47:17.703 DEBUG:teuthology.orchestra.run.smithi196:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-04-17T08:47:17.703 DEBUG:teuthology.orchestra.run.smithi196:> 2024-04-17T08:47:17.703 DEBUG:teuthology.orchestra.run.smithi196:> # Given a non-glob path, it better be there 2024-04-17T08:47:17.703 DEBUG:teuthology.orchestra.run.smithi196:> if "*" not in asok_path: 2024-04-17T08:47:17.703 DEBUG:teuthology.orchestra.run.smithi196:> assert(len(files) == 1) 2024-04-17T08:47:17.703 DEBUG:teuthology.orchestra.run.smithi196:> return files[0] 2024-04-17T08:47:17.703 DEBUG:teuthology.orchestra.run.smithi196:> 2024-04-17T08:47:17.703 DEBUG:teuthology.orchestra.run.smithi196:> for f in files: 2024-04-17T08:47:17.703 DEBUG:teuthology.orchestra.run.smithi196:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-17T08:47:17.703 DEBUG:teuthology.orchestra.run.smithi196:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-17T08:47:17.703 DEBUG:teuthology.orchestra.run.smithi196:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-17T08:47:17.703 DEBUG:teuthology.orchestra.run.smithi196:> contents = proc_f.read() 2024-04-17T08:47:17.703 DEBUG:teuthology.orchestra.run.smithi196:> if mountpoint in contents: 2024-04-17T08:47:17.704 DEBUG:teuthology.orchestra.run.smithi196:> return f 2024-04-17T08:47:17.704 DEBUG:teuthology.orchestra.run.smithi196:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-17T08:47:17.704 DEBUG:teuthology.orchestra.run.smithi196:> 2024-04-17T08:47:17.704 DEBUG:teuthology.orchestra.run.smithi196:> print(_find_admin_socket("client.3")) 2024-04-17T08:47:17.704 DEBUG:teuthology.orchestra.run.smithi196:> ' 2024-04-17T08:47:17.828 INFO:teuthology.orchestra.run.smithi196.stdout:/var/run/ceph/ceph-client.3.33256.asok 2024-04-17T08:47:17.832 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-17T08:47:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T08:47:17.840 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.33256.asok 2024-04-17T08:47:17.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:17.840 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.33256.asok status 2024-04-17T08:47:18.010 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-04-17T08:47:18.010 INFO:teuthology.orchestra.run.smithi196.stdout: "metadata": { 2024-04-17T08:47:18.010 INFO:teuthology.orchestra.run.smithi196.stdout: "ceph_sha1": "a8c84f5997950fd7d008204839253291d52e6eda", 2024-04-17T08:47:18.010 INFO:teuthology.orchestra.run.smithi196.stdout: "ceph_version": "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)", 2024-04-17T08:47:18.010 INFO:teuthology.orchestra.run.smithi196.stdout: "entity_id": "3", 2024-04-17T08:47:18.011 INFO:teuthology.orchestra.run.smithi196.stdout: "hostname": "smithi196", 2024-04-17T08:47:18.011 INFO:teuthology.orchestra.run.smithi196.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-04-17T08:47:18.011 INFO:teuthology.orchestra.run.smithi196.stdout: "pid": "33256", 2024-04-17T08:47:18.011 INFO:teuthology.orchestra.run.smithi196.stdout: "root": "/" 2024-04-17T08:47:18.011 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-17T08:47:18.011 INFO:teuthology.orchestra.run.smithi196.stdout: "dentry_count": 0, 2024-04-17T08:47:18.011 INFO:teuthology.orchestra.run.smithi196.stdout: "dentry_pinned_count": 0, 2024-04-17T08:47:18.011 INFO:teuthology.orchestra.run.smithi196.stdout: "id": 4583, 2024-04-17T08:47:18.011 INFO:teuthology.orchestra.run.smithi196.stdout: "inst": { 2024-04-17T08:47:18.011 INFO:teuthology.orchestra.run.smithi196.stdout: "name": { 2024-04-17T08:47:18.011 INFO:teuthology.orchestra.run.smithi196.stdout: "type": "client", 2024-04-17T08:47:18.011 INFO:teuthology.orchestra.run.smithi196.stdout: "num": 4583 2024-04-17T08:47:18.011 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-17T08:47:18.011 INFO:teuthology.orchestra.run.smithi196.stdout: "addr": { 2024-04-17T08:47:18.011 INFO:teuthology.orchestra.run.smithi196.stdout: "type": "v1", 2024-04-17T08:47:18.011 INFO:teuthology.orchestra.run.smithi196.stdout: "addr": "192.168.0.2:0", 2024-04-17T08:47:18.011 INFO:teuthology.orchestra.run.smithi196.stdout: "nonce": 1297809050 2024-04-17T08:47:18.012 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-04-17T08:47:18.012 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-17T08:47:18.012 INFO:teuthology.orchestra.run.smithi196.stdout: "addr": { 2024-04-17T08:47:18.012 INFO:teuthology.orchestra.run.smithi196.stdout: "type": "v1", 2024-04-17T08:47:18.012 INFO:teuthology.orchestra.run.smithi196.stdout: "addr": "192.168.0.2:0", 2024-04-17T08:47:18.012 INFO:teuthology.orchestra.run.smithi196.stdout: "nonce": 1297809050 2024-04-17T08:47:18.012 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-04-17T08:47:18.012 INFO:teuthology.orchestra.run.smithi196.stdout: "inst_str": "client.4583 192.168.0.2:0/1297809050", 2024-04-17T08:47:18.012 INFO:teuthology.orchestra.run.smithi196.stdout: "addr_str": "192.168.0.2:0/1297809050", 2024-04-17T08:47:18.012 INFO:teuthology.orchestra.run.smithi196.stdout: "inode_count": 1, 2024-04-17T08:47:18.012 INFO:teuthology.orchestra.run.smithi196.stdout: "mds_epoch": 9, 2024-04-17T08:47:18.012 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_epoch": 26, 2024-04-17T08:47:18.012 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_epoch_barrier": 0, 2024-04-17T08:47:18.012 INFO:teuthology.orchestra.run.smithi196.stdout: "blocklisted": false, 2024-04-17T08:47:18.012 INFO:teuthology.orchestra.run.smithi196.stdout: "fs_name": "cephfs" 2024-04-17T08:47:18.012 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-04-17T08:47:18.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:18.025 DEBUG:teuthology.orchestra.run.smithi152:> stat --file-system '--printf=%T 2024-04-17T08:47:18.025 DEBUG:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-17T08:47:18.035 INFO:teuthology.orchestra.run.smithi152.stdout:fuseblk 2024-04-17T08:47:18.035 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-17T08:47:18.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:18.036 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-17T08:47:18.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:18.099 DEBUG:teuthology.orchestra.run.smithi152:> stat --file-system '--printf=%T 2024-04-17T08:47:18.099 DEBUG:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.2 2024-04-17T08:47:18.150 INFO:teuthology.orchestra.run.smithi152.stdout:fuseblk 2024-04-17T08:47:18.151 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-04-17T08:47:18.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:18.151 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-04-17T08:47:18.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:18.214 DEBUG:teuthology.orchestra.run.smithi196:> stat --file-system '--printf=%T 2024-04-17T08:47:18.214 DEBUG:teuthology.orchestra.run.smithi196:> ' -- /home/ubuntu/cephtest/mnt.1 2024-04-17T08:47:18.224 INFO:teuthology.orchestra.run.smithi196.stdout:fuseblk 2024-04-17T08:47:18.224 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-04-17T08:47:18.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:18.224 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-17T08:47:18.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:18.285 DEBUG:teuthology.orchestra.run.smithi196:> stat --file-system '--printf=%T 2024-04-17T08:47:18.285 DEBUG:teuthology.orchestra.run.smithi196:> ' -- /home/ubuntu/cephtest/mnt.3 2024-04-17T08:47:18.340 INFO:teuthology.orchestra.run.smithi196.stdout:fuseblk 2024-04-17T08:47:18.341 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-04-17T08:47:18.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:18.341 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-04-17T08:47:18.403 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-04-17T08:47:18.421 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T08:47:18.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.565+0000 7f42c6e00640 1 Processor -- start 2024-04-17T08:47:18.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.565+0000 7f42c6e00640 1 -- start start 2024-04-17T08:47:18.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.569+0000 7f42c6e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f42c00af670 0x7f42c015b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:18.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.569+0000 7f42c6e00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42c0072c40 con 0x7f42c00d0360 2024-04-17T08:47:18.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.569+0000 7f42c6e00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42c015c260 con 0x7f42c006f980 2024-04-17T08:47:18.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.569+0000 7f42c6e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f42c015c820 con 0x7f42c00af670 2024-04-17T08:47:18.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.569+0000 7f42c4e00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f42c00d0360 0x7f42c006dc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:52320/0 (socket says 172.21.15.152:52320) 2024-04-17T08:47:18.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.569+0000 7f42c4e00640 1 -- 172.21.15.152:0/4007613768 learned_addr learned my addr 172.21.15.152:0/4007613768 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:18.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.569+0000 7f42bfe00640 1 --2- 172.21.15.152:0/4007613768 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f42c00af670 0x7f42c015b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:18.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.569+0000 7f42bf400640 1 -- 172.21.15.152:0/4007613768 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3564582145 0 0) 0x7f42c0072c40 con 0x7f42c00d0360 2024-04-17T08:47:18.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.569+0000 7f42bf400640 1 -- 172.21.15.152:0/4007613768 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42a4003530 con 0x7f42c00d0360 2024-04-17T08:47:18.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.569+0000 7f42bf400640 1 -- 172.21.15.152:0/4007613768 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3846375005 0 0) 0x7f42c015c260 con 0x7f42c006f980 2024-04-17T08:47:18.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.569+0000 7f42bf400640 1 -- 172.21.15.152:0/4007613768 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42c0072c40 con 0x7f42c006f980 2024-04-17T08:47:18.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.569+0000 7f42bfe00640 1 -- 172.21.15.152:0/4007613768 >> v1:172.21.15.196:6789/0 conn(0x7f42c006f980 legacy=0x7f42c0072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:18.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.569+0000 7f42bfe00640 1 -- 172.21.15.152:0/4007613768 >> v1:172.21.15.152:6789/0 conn(0x7f42c00d0360 legacy=0x7f42c006dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:18.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.569+0000 7f42bfe00640 1 -- 172.21.15.152:0/4007613768 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42c015c540 con 0x7f42c00af670 2024-04-17T08:47:18.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.573+0000 7f42bfe00640 1 --2- 172.21.15.152:0/4007613768 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f42c00af670 0x7f42c015b8c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f42b0009dc0 tx=0x7f42b001c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5fca1b961cc7a94 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:18.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.573+0000 7f42bf400640 1 -- 172.21.15.152:0/4007613768 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b00b2070 con 0x7f42c00af670 2024-04-17T08:47:18.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.573+0000 7f42bf400640 1 -- 172.21.15.152:0/4007613768 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42b00a5890 con 0x7f42c00af670 2024-04-17T08:47:18.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.573+0000 7f42bf400640 1 -- 172.21.15.152:0/4007613768 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b00a5c60 con 0x7f42c00af670 2024-04-17T08:47:18.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.573+0000 7f42c6e00640 1 -- 172.21.15.152:0/4007613768 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f42c00af670 msgr2=0x7f42c015b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:18.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.573+0000 7f42c6e00640 1 --2- 172.21.15.152:0/4007613768 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f42c00af670 0x7f42c015b8c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f42b0009dc0 tx=0x7f42b001c8d0 comp rx=0 tx=0).stop 2024-04-17T08:47:18.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.573+0000 7f42c6e00640 1 -- 172.21.15.152:0/4007613768 shutdown_connections 2024-04-17T08:47:18.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.573+0000 7f42c6e00640 1 --2- 172.21.15.152:0/4007613768 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f42c00af670 0x7f42c015b8c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:18.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.573+0000 7f42c6e00640 1 -- 172.21.15.152:0/4007613768 >> 172.21.15.152:0/4007613768 conn(0x7f42c00b3350 msgr2=0x7f42c00b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:18.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.573+0000 7f42c6e00640 1 -- 172.21.15.152:0/4007613768 shutdown_connections 2024-04-17T08:47:18.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.573+0000 7f42c6e00640 1 -- 172.21.15.152:0/4007613768 wait complete. 2024-04-17T08:47:18.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.573+0000 7f42c6e00640 1 Processor -- start 2024-04-17T08:47:18.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.573+0000 7f42c6e00640 1 -- start start 2024-04-17T08:47:18.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.577+0000 7f42c6e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f42c006f980 0x7f42c01428b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:18.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.577+0000 7f42c6e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f42c00af670 0x7f42c00aff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:18.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.577+0000 7f42c6e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42c00d0360 0x7f42c01f79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:18.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.577+0000 7f42c6e00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f42c00d0b80 con 0x7f42c00d0360 2024-04-17T08:47:18.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.577+0000 7f42c6e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f42c015be00 con 0x7f42c00af670 2024-04-17T08:47:18.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.577+0000 7f42c6e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f42c0142420 con 0x7f42c006f980 2024-04-17T08:47:18.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.577+0000 7f42c4e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42c00d0360 0x7f42c01f79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:18.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.577+0000 7f42c4e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42c00d0360 0x7f42c01f79c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56676/0 (socket says 172.21.15.152:56676) 2024-04-17T08:47:18.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.577+0000 7f42c4e00640 1 -- 172.21.15.152:0/2964536451 learned_addr learned my addr 172.21.15.152:0/2964536451 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:18.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.577+0000 7f42b7400640 1 --2- 172.21.15.152:0/2964536451 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f42c00af670 0x7f42c00aff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:18.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.577+0000 7f42bfe00640 1 --2- 172.21.15.152:0/2964536451 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f42c006f980 0x7f42c01428b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:18.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.577+0000 7f42c4e00640 1 -- 172.21.15.152:0/2964536451 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f42c006f980 msgr2=0x7f42c01428b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:18.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.577+0000 7f42c4e00640 1 --2- 172.21.15.152:0/2964536451 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f42c006f980 0x7f42c01428b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:18.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.577+0000 7f42c4e00640 1 -- 172.21.15.152:0/2964536451 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f42c00af670 msgr2=0x7f42c00aff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:18.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.577+0000 7f42c4e00640 1 --2- 172.21.15.152:0/2964536451 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f42c00af670 0x7f42c00aff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:18.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.577+0000 7f42c4e00640 1 -- 172.21.15.152:0/2964536451 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42c01f8510 con 0x7f42c00d0360 2024-04-17T08:47:18.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.577+0000 7f42c4e00640 1 --2- 172.21.15.152:0/2964536451 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42c00d0360 0x7f42c01f79c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f42b800c3c0 tx=0x7f42b800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:18.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.577+0000 7f42bcc00640 1 -- 172.21.15.152:0/2964536451 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b8017070 con 0x7f42c00d0360 2024-04-17T08:47:18.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.577+0000 7f42bcc00640 1 -- 172.21.15.152:0/2964536451 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42b8005db0 con 0x7f42c00d0360 2024-04-17T08:47:18.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.577+0000 7f42c6e00640 1 -- 172.21.15.152:0/2964536451 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42c01f87f0 con 0x7f42c00d0360 2024-04-17T08:47:18.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.577+0000 7f42bcc00640 1 -- 172.21.15.152:0/2964536451 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b8007310 con 0x7f42c00d0360 2024-04-17T08:47:18.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.577+0000 7f42c6e00640 1 -- 172.21.15.152:0/2964536451 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42c00679a0 con 0x7f42c00d0360 2024-04-17T08:47:18.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.577+0000 7f42c6e00640 1 -- 172.21.15.152:0/2964536451 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42c0068a30 con 0x7f42c00d0360 2024-04-17T08:47:18.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.581+0000 7f42bcc00640 1 -- 172.21.15.152:0/2964536451 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f42b801a070 con 0x7f42c00d0360 2024-04-17T08:47:18.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.581+0000 7f42bcc00640 1 --2- 172.21.15.152:0/2964536451 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f429c0683b0 0x7f429c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:18.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.581+0000 7f42bcc00640 1 -- 172.21.15.152:0/2964536451 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f42b8086210 con 0x7f42c00d0360 2024-04-17T08:47:18.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.581+0000 7f42bfe00640 1 --2- 172.21.15.152:0/2964536451 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f429c0683b0 0x7f429c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:18.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.581+0000 7f42bfe00640 1 --2- 172.21.15.152:0/2964536451 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f429c0683b0 0x7f429c06a870 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f42b00af000 tx=0x7f42b00a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:18.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.585+0000 7f42bcc00640 1 -- 172.21.15.152:0/2964536451 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f42b8056310 con 0x7f42c00d0360 2024-04-17T08:47:18.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.741+0000 7f42c6e00640 1 -- 172.21.15.152:0/2964536451 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f42c006e150 con 0x7f42c00d0360 2024-04-17T08:47:18.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.741+0000 7f42bcc00640 1 -- 172.21.15.152:0/2964536451 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18972 (secure 0 0 0) 0x7f42b8055c10 con 0x7f42c00d0360 2024-04-17T08:47:18.745 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:47:18.746 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":26,"fsid":"ce68f82e-ec5f-4205-9fd5-bdfdf6ef31e2","created":"2024-04-17T08:46:08.353546+0000","modified":"2024-04-17T08:47:15.280634+0000","last_up_change":"2024-04-17T08:46:20.738799+0000","last_in_change":"2024-04-17T08:46:11.210050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T08:46:21.386856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T08:46:31.812460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T08:46:32.555559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T08:46:36.258078+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"682f0192-187c-404e-bc7a-b6b4e23825e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6819","nonce":3603799291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6823","nonce":3603799291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6831","nonce":3603799291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6827","nonce":3603799291}]},"public_addr":"172.21.15.152:6819/3603799291","cluster_addr":"172.21.15.152:6823/3603799291","heartbeat_back_addr":"172.21.15.152:6831/3603799291","heartbeat_front_addr":"172.21.15.152:6827/3603799291","state":["exists","up"]},{"osd":1,"uuid":"f0fe8fef-60ec-4a39-83b6-2fa6a5adb0f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6801","nonce":4133383142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6803","nonce":4133383142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6807","nonce":4133383142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6805","nonce":4133383142}]},"public_addr":"172.21.15.152:6801/4133383142","cluster_addr":"172.21.15.152:6803/4133383142","heartbeat_back_addr":"172.21.15.152:6807/4133383142","heartbeat_front_addr":"172.21.15.152:6805/4133383142","state":["exists","up"]},{"osd":2,"uuid":"35f36d9c-5245-4431-a618-f4df0fa380ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6809","nonce":3826143898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6811","nonce":3826143898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6815","nonce":3826143898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6813","nonce":3826143898}]},"public_addr":"172.21.15.152:6809/3826143898","cluster_addr":"172.21.15.152:6811/3826143898","heartbeat_back_addr":"172.21.15.152:6815/3826143898","heartbeat_front_addr":"172.21.15.152:6813/3826143898","state":["exists","up"]},{"osd":3,"uuid":"96e56ca5-15b4-4895-9b79-da2c92043159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6818","nonce":165717826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6822","nonce":165717826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6830","nonce":165717826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6826","nonce":165717826}]},"public_addr":"172.21.15.152:6818/165717826","cluster_addr":"172.21.15.152:6822/165717826","heartbeat_back_addr":"172.21.15.152:6830/165717826","heartbeat_front_addr":"172.21.15.152:6826/165717826","state":["exists","up"]},{"osd":4,"uuid":"f5aa10a4-9ff9-41fe-a5c9-15326f982cc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6817","nonce":4080159297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6819","nonce":4080159297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6823","nonce":4080159297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6821","nonce":4080159297}]},"public_addr":"172.21.15.196:6817/4080159297","cluster_addr":"172.21.15.196:6819/4080159297","heartbeat_back_addr":"172.21.15.196:6823/4080159297","heartbeat_front_addr":"172.21.15.196:6821/4080159297","state":["exists","up"]},{"osd":5,"uuid":"42bab884-3476-47ae-ac65-935fa6e0f055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6801","nonce":3519444232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6803","nonce":3519444232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6807","nonce":3519444232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6805","nonce":3519444232}]},"public_addr":"172.21.15.196:6801/3519444232","cluster_addr":"172.21.15.196:6803/3519444232","heartbeat_back_addr":"172.21.15.196:6807/3519444232","heartbeat_front_addr":"172.21.15.196:6805/3519444232","state":["exists","up"]},{"osd":6,"uuid":"460b6167-f57b-4224-9c92-cfc9b80bbe99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6809","nonce":275739834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6811","nonce":275739834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6815","nonce":275739834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6813","nonce":275739834}]},"public_addr":"172.21.15.196:6809/275739834","cluster_addr":"172.21.15.196:6811/275739834","heartbeat_back_addr":"172.21.15.196:6815/275739834","heartbeat_front_addr":"172.21.15.196:6813/275739834","state":["exists","up"]},{"osd":7,"uuid":"d695643f-5e07-4e2a-a646-c06bd97b6650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6825","nonce":307626968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6827","nonce":307626968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6831","nonce":307626968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6829","nonce":307626968}]},"public_addr":"172.21.15.196:6825/307626968","cluster_addr":"172.21.15.196:6827/307626968","heartbeat_back_addr":"172.21.15.196:6831/307626968","heartbeat_front_addr":"172.21.15.196:6829/307626968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.293257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.964533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.248895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.010000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.832554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.743704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930171+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930962+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T08:47:18.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.745+0000 7f42c6e00640 1 -- 172.21.15.152:0/2964536451 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f429c0683b0 msgr2=0x7f429c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:18.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.745+0000 7f42c6e00640 1 --2- 172.21.15.152:0/2964536451 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f429c0683b0 0x7f429c06a870 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f42b00af000 tx=0x7f42b00a7070 comp rx=0 tx=0).stop 2024-04-17T08:47:18.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.745+0000 7f42c6e00640 1 -- 172.21.15.152:0/2964536451 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42c00d0360 msgr2=0x7f42c01f79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:18.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.745+0000 7f42c6e00640 1 --2- 172.21.15.152:0/2964536451 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42c00d0360 0x7f42c01f79c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f42b800c3c0 tx=0x7f42b800c880 comp rx=0 tx=0).stop 2024-04-17T08:47:18.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.745+0000 7f42c6e00640 1 -- 172.21.15.152:0/2964536451 shutdown_connections 2024-04-17T08:47:18.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.745+0000 7f42c6e00640 1 --2- 172.21.15.152:0/2964536451 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42c00d0360 0x7f42c01f79c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:18.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.745+0000 7f42c6e00640 1 --2- 172.21.15.152:0/2964536451 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f42c00af670 0x7f42c00aff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:18.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.745+0000 7f42c6e00640 1 --2- 172.21.15.152:0/2964536451 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f429c0683b0 0x7f429c06a870 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:18.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.745+0000 7f42c6e00640 1 --2- 172.21.15.152:0/2964536451 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f42c006f980 0x7f42c01428b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:18.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.745+0000 7f42c6e00640 1 -- 172.21.15.152:0/2964536451 >> 172.21.15.152:0/2964536451 conn(0x7f42c00b3350 msgr2=0x7f42c015dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:18.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.745+0000 7f42c6e00640 1 -- 172.21.15.152:0/2964536451 shutdown_connections 2024-04-17T08:47:18.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.745+0000 7f42c6e00640 1 -- 172.21.15.152:0/2964536451 wait complete. 2024-04-17T08:47:18.766 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T08:46:21.386856+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-17T08:46:31.812460+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-17T08:46:32.555559+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-17T08:46:36.258078+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-17T08:47:18.767 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T08:47:18.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.901+0000 7f848f400640 1 Processor -- start 2024-04-17T08:47:18.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.901+0000 7f848f400640 1 -- start start 2024-04-17T08:47:18.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.905+0000 7f848f400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f848806d350 0x7f84880d0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:18.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.905+0000 7f848f400640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f848806d7e0 con 0x7f8488147a70 2024-04-17T08:47:18.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.905+0000 7f848f400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84881482f0 con 0x7f8488071790 2024-04-17T08:47:18.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.905+0000 7f848f400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f848806e660 con 0x7f848806d350 2024-04-17T08:47:18.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.905+0000 7f847fe00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f8488147a70 0x7f84880d0250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:52330/0 (socket says 172.21.15.152:52330) 2024-04-17T08:47:18.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.905+0000 7f847fe00640 1 -- 172.21.15.152:0/2543494104 learned_addr learned my addr 172.21.15.152:0/2543494104 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:18.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.905+0000 7f848d400640 1 --2- 172.21.15.152:0/2543494104 >> v2:172.21.15.196:3300/0 conn(0x7f848806d350 0x7f84880d0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:18.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.905+0000 7f848d400640 1 -- 172.21.15.152:0/2543494104 >> v1:172.21.15.196:6789/0 conn(0x7f8488071790 legacy=0x7f8488071b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:18.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.905+0000 7f848d400640 1 -- 172.21.15.152:0/2543494104 >> v1:172.21.15.152:6789/0 conn(0x7f8488147a70 legacy=0x7f84880d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:18.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.905+0000 7f848d400640 1 -- 172.21.15.152:0/2543494104 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f848806da50 con 0x7f848806d350 2024-04-17T08:47:18.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.905+0000 7f8487e00640 1 -- 172.21.15.152:0/2543494104 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3867673877 0 0) 0x7f848806d7e0 con 0x7f8488147a70 2024-04-17T08:47:18.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.909+0000 7f848d400640 1 --2- 172.21.15.152:0/2543494104 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f848806d350 0x7f84880d0960 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8480009d90 tx=0x7f848001c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51edb3e951c7d8a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:18.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.909+0000 7f8487e00640 1 -- 172.21.15.152:0/2543494104 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84800b2070 con 0x7f848806d350 2024-04-17T08:47:18.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.909+0000 7f8487e00640 1 -- 172.21.15.152:0/2543494104 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84800a5910 con 0x7f848806d350 2024-04-17T08:47:18.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.909+0000 7f8487e00640 1 -- 172.21.15.152:0/2543494104 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84800a5ce0 con 0x7f848806d350 2024-04-17T08:47:18.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.909+0000 7f848f400640 1 -- 172.21.15.152:0/2543494104 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f848806d350 msgr2=0x7f84880d0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:18.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.909+0000 7f848f400640 1 --2- 172.21.15.152:0/2543494104 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f848806d350 0x7f84880d0960 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8480009d90 tx=0x7f848001c940 comp rx=0 tx=0).stop 2024-04-17T08:47:18.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.909+0000 7f848f400640 1 -- 172.21.15.152:0/2543494104 shutdown_connections 2024-04-17T08:47:18.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.909+0000 7f848f400640 1 --2- 172.21.15.152:0/2543494104 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f848806d350 0x7f84880d0960 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:18.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.909+0000 7f848f400640 1 -- 172.21.15.152:0/2543494104 >> 172.21.15.152:0/2543494104 conn(0x7f84880d2350 msgr2=0x7f84880d2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:18.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.909+0000 7f848f400640 1 -- 172.21.15.152:0/2543494104 shutdown_connections 2024-04-17T08:47:18.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.909+0000 7f848f400640 1 -- 172.21.15.152:0/2543494104 wait complete. 2024-04-17T08:47:18.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.909+0000 7f848f400640 1 Processor -- start 2024-04-17T08:47:18.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.909+0000 7f848f400640 1 -- start start 2024-04-17T08:47:18.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.909+0000 7f848f400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f848806d350 0x7f8488145930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:18.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.909+0000 7f848f400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8488071790 0x7f8488161ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:18.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.909+0000 7f848f400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8488147a70 0x7f848813bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:18.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.909+0000 7f848f400640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8488147740 con 0x7f8488147a70 2024-04-17T08:47:18.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.909+0000 7f848f400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f848806ead0 con 0x7f848806d350 2024-04-17T08:47:18.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.909+0000 7f848f400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f8488146bb0 con 0x7f8488071790 2024-04-17T08:47:18.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.909+0000 7f848d400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8488147a70 0x7f848813bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:18.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.909+0000 7f848d400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8488147a70 0x7f848813bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56688/0 (socket says 172.21.15.152:56688) 2024-04-17T08:47:18.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.909+0000 7f848d400640 1 -- 172.21.15.152:0/3098554141 learned_addr learned my addr 172.21.15.152:0/3098554141 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:18.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.909+0000 7f848ca00640 1 --2- 172.21.15.152:0/3098554141 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f848806d350 0x7f8488145930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:18.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.909+0000 7f847fe00640 1 --2- 172.21.15.152:0/3098554141 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8488071790 0x7f8488161ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:18.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.913+0000 7f848d400640 1 -- 172.21.15.152:0/3098554141 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8488071790 msgr2=0x7f8488161ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:18.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.913+0000 7f848d400640 1 --2- 172.21.15.152:0/3098554141 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8488071790 0x7f8488161ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:18.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.913+0000 7f848d400640 1 -- 172.21.15.152:0/3098554141 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f848806d350 msgr2=0x7f8488145930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:18.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.913+0000 7f848d400640 1 --2- 172.21.15.152:0/3098554141 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f848806d350 0x7f8488145930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:18.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.913+0000 7f848d400640 1 -- 172.21.15.152:0/3098554141 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8488145fa0 con 0x7f8488147a70 2024-04-17T08:47:18.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.913+0000 7f847fe00640 1 --2- 172.21.15.152:0/3098554141 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8488071790 0x7f8488161ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:18.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.913+0000 7f848d400640 1 --2- 172.21.15.152:0/3098554141 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8488147a70 0x7f848813bb90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8480009d90 tx=0x7f84800196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:18.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.913+0000 7f8485600640 1 -- 172.21.15.152:0/3098554141 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84800bd020 con 0x7f8488147a70 2024-04-17T08:47:18.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.913+0000 7f8485600640 1 -- 172.21.15.152:0/3098554141 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84800b8670 con 0x7f8488147a70 2024-04-17T08:47:18.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.913+0000 7f848f400640 1 -- 172.21.15.152:0/3098554141 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8488146280 con 0x7f8488147a70 2024-04-17T08:47:18.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.913+0000 7f8485600640 1 -- 172.21.15.152:0/3098554141 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84800b2040 con 0x7f8488147a70 2024-04-17T08:47:18.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.913+0000 7f848f400640 1 -- 172.21.15.152:0/3098554141 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8488146840 con 0x7f8488147a70 2024-04-17T08:47:18.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.913+0000 7f848f400640 1 -- 172.21.15.152:0/3098554141 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8488146d30 con 0x7f8488147a70 2024-04-17T08:47:18.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.913+0000 7f8485600640 1 -- 172.21.15.152:0/3098554141 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f84800c0020 con 0x7f8488147a70 2024-04-17T08:47:18.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.913+0000 7f8485600640 1 --2- 172.21.15.152:0/3098554141 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8464068380 0x7f846406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:18.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.913+0000 7f8485600640 1 -- 172.21.15.152:0/3098554141 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f8480121e40 con 0x7f8488147a70 2024-04-17T08:47:18.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.917+0000 7f848ca00640 1 --2- 172.21.15.152:0/3098554141 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8464068380 0x7f846406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:18.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.917+0000 7f848ca00640 1 --2- 172.21.15.152:0/3098554141 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8464068380 0x7f846406a840 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f848813b950 tx=0x7f8478009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:18.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:18.921+0000 7f8485600640 1 -- 172.21.15.152:0/3098554141 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f84800c7030 con 0x7f8488147a70 2024-04-17T08:47:19.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.077+0000 7f848f400640 1 -- 172.21.15.152:0/3098554141 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8488068a30 con 0x7f8488147a70 2024-04-17T08:47:19.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.077+0000 7f8485600640 1 -- 172.21.15.152:0/3098554141 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f8480016560 con 0x7f8488147a70 2024-04-17T08:47:19.080 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2024-04-17T08:47:19.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.081+0000 7f848f400640 1 -- 172.21.15.152:0/3098554141 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8464068380 msgr2=0x7f846406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:19.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.081+0000 7f848f400640 1 --2- 172.21.15.152:0/3098554141 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8464068380 0x7f846406a840 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f848813b950 tx=0x7f8478009040 comp rx=0 tx=0).stop 2024-04-17T08:47:19.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.081+0000 7f848f400640 1 -- 172.21.15.152:0/3098554141 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8488147a70 msgr2=0x7f848813bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:19.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.081+0000 7f848f400640 1 --2- 172.21.15.152:0/3098554141 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8488147a70 0x7f848813bb90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8480009d90 tx=0x7f84800196e0 comp rx=0 tx=0).stop 2024-04-17T08:47:19.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.081+0000 7f848f400640 1 -- 172.21.15.152:0/3098554141 shutdown_connections 2024-04-17T08:47:19.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.081+0000 7f848f400640 1 --2- 172.21.15.152:0/3098554141 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8488147a70 0x7f848813bb90 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:19.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.081+0000 7f848f400640 1 --2- 172.21.15.152:0/3098554141 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8464068380 0x7f846406a840 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:19.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.081+0000 7f848f400640 1 --2- 172.21.15.152:0/3098554141 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8488071790 0x7f8488161ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:19.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.081+0000 7f848f400640 1 --2- 172.21.15.152:0/3098554141 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f848806d350 0x7f8488145930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:19.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.081+0000 7f848f400640 1 -- 172.21.15.152:0/3098554141 >> 172.21.15.152:0/3098554141 conn(0x7f84880d2350 msgr2=0x7f84880c7230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:19.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.081+0000 7f848f400640 1 -- 172.21.15.152:0/3098554141 shutdown_connections 2024-04-17T08:47:19.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.081+0000 7f848f400640 1 -- 172.21.15.152:0/3098554141 wait complete. 2024-04-17T08:47:19.101 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-17T08:47:19.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.237+0000 7f423b000640 1 Processor -- start 2024-04-17T08:47:19.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.237+0000 7f423b000640 1 -- start start 2024-04-17T08:47:19.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.237+0000 7f423b000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f42340af670 0x7f423415b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:19.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.237+0000 7f423b000640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f42340d0360 0x7f42340d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:19.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.237+0000 7f423b000640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4234072c40 con 0x7f423406f980 2024-04-17T08:47:19.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.237+0000 7f423b000640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f423415c820 con 0x7f42340d0360 2024-04-17T08:47:19.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.237+0000 7f423b000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f423415c260 con 0x7f42340af670 2024-04-17T08:47:19.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.237+0000 7f4239000640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f42340d0360 0x7f42340d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:19.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.237+0000 7f422b400640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f423406f980 0x7f4234072530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:52332/0 (socket says 172.21.15.152:52332) 2024-04-17T08:47:19.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.237+0000 7f422b400640 1 -- 172.21.15.152:0/3083963340 learned_addr learned my addr 172.21.15.152:0/3083963340 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:19.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.237+0000 7f4233e00640 1 --2- 172.21.15.152:0/3083963340 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f42340af670 0x7f423415b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:19.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.237+0000 7f4239000640 1 -- 172.21.15.152:0/3083963340 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f42340af670 msgr2=0x7f423415b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:19.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.237+0000 7f4239000640 1 --2- 172.21.15.152:0/3083963340 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f42340af670 0x7f423415b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:19.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.237+0000 7f4239000640 1 -- 172.21.15.152:0/3083963340 >> v1:172.21.15.152:6789/0 conn(0x7f423406f980 legacy=0x7f4234072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:19.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.237+0000 7f4239000640 1 -- 172.21.15.152:0/3083963340 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f423415c540 con 0x7f42340d0360 2024-04-17T08:47:19.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.241+0000 7f4239000640 1 --2- 172.21.15.152:0/3083963340 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42340d0360 0x7f42340d07f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f422c0097c0 tx=0x7f422c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=706a77f37a2a0271 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:19.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.241+0000 7f4233400640 1 -- 172.21.15.152:0/3083963340 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f422c0b0070 con 0x7f42340d0360 2024-04-17T08:47:19.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.241+0000 7f4233400640 1 -- 172.21.15.152:0/3083963340 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f422c0ab600 con 0x7f42340d0360 2024-04-17T08:47:19.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.241+0000 7f4233400640 1 -- 172.21.15.152:0/3083963340 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f422c0ab9d0 con 0x7f42340d0360 2024-04-17T08:47:19.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.241+0000 7f423b000640 1 -- 172.21.15.152:0/3083963340 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42340d0360 msgr2=0x7f42340d07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:19.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.241+0000 7f423b000640 1 --2- 172.21.15.152:0/3083963340 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42340d0360 0x7f42340d07f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f422c0097c0 tx=0x7f422c01c410 comp rx=0 tx=0).stop 2024-04-17T08:47:19.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.241+0000 7f423b000640 1 -- 172.21.15.152:0/3083963340 shutdown_connections 2024-04-17T08:47:19.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.241+0000 7f423b000640 1 --2- 172.21.15.152:0/3083963340 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42340d0360 0x7f42340d07f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:19.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.241+0000 7f423b000640 1 --2- 172.21.15.152:0/3083963340 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f42340af670 0x7f423415b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:19.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.241+0000 7f423b000640 1 -- 172.21.15.152:0/3083963340 >> 172.21.15.152:0/3083963340 conn(0x7f42340b3350 msgr2=0x7f42340b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:19.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.241+0000 7f423b000640 1 -- 172.21.15.152:0/3083963340 shutdown_connections 2024-04-17T08:47:19.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.241+0000 7f423b000640 1 -- 172.21.15.152:0/3083963340 wait complete. 2024-04-17T08:47:19.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.245+0000 7f423b000640 1 Processor -- start 2024-04-17T08:47:19.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.245+0000 7f423b000640 1 -- start start 2024-04-17T08:47:19.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.245+0000 7f423b000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f423406f980 0x7f4234155f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:19.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.245+0000 7f423b000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f42340af670 0x7f42341511f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:19.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.245+0000 7f423b000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f42340d0360 0x7f42341f70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:19.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.245+0000 7f423b000640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f423415bf80 con 0x7f423406f980 2024-04-17T08:47:19.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.245+0000 7f423b000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f423415be00 con 0x7f42340af670 2024-04-17T08:47:19.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.245+0000 7f423b000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f4234168050 con 0x7f42340d0360 2024-04-17T08:47:19.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.245+0000 7f4233e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f423406f980 0x7f4234155f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:19.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.245+0000 7f4233e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f423406f980 0x7f4234155f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56718/0 (socket says 172.21.15.152:56718) 2024-04-17T08:47:19.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.245+0000 7f4233e00640 1 -- 172.21.15.152:0/435586328 learned_addr learned my addr 172.21.15.152:0/435586328 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:19.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.245+0000 7f4233e00640 1 -- 172.21.15.152:0/435586328 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f42340d0360 msgr2=0x7f42341f70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:19.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.245+0000 7f4233e00640 1 --2- 172.21.15.152:0/435586328 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f42340d0360 0x7f42341f70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:19.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.245+0000 7f4233e00640 1 -- 172.21.15.152:0/435586328 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f42340af670 msgr2=0x7f42341511f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:19.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.245+0000 7f4233e00640 1 --2- 172.21.15.152:0/435586328 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f42340af670 0x7f42341511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:19.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.245+0000 7f4233e00640 1 -- 172.21.15.152:0/435586328 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42341f7a60 con 0x7f423406f980 2024-04-17T08:47:19.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.245+0000 7f4233e00640 1 --2- 172.21.15.152:0/435586328 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f423406f980 0x7f4234155f20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f422400e930 tx=0x7f422400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:19.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.245+0000 7f4230c00640 1 -- 172.21.15.152:0/435586328 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4224017070 con 0x7f423406f980 2024-04-17T08:47:19.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.245+0000 7f4230c00640 1 -- 172.21.15.152:0/435586328 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f422400ca00 con 0x7f423406f980 2024-04-17T08:47:19.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.245+0000 7f423b000640 1 -- 172.21.15.152:0/435586328 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42341f7d40 con 0x7f423406f980 2024-04-17T08:47:19.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.245+0000 7f4230c00640 1 -- 172.21.15.152:0/435586328 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f422400cdb0 con 0x7f423406f980 2024-04-17T08:47:19.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.245+0000 7f423b000640 1 -- 172.21.15.152:0/435586328 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42341596d0 con 0x7f423406f980 2024-04-17T08:47:19.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.245+0000 7f423b000640 1 -- 172.21.15.152:0/435586328 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4234068a30 con 0x7f423406f980 2024-04-17T08:47:19.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.249+0000 7f4230c00640 1 -- 172.21.15.152:0/435586328 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f422401a070 con 0x7f423406f980 2024-04-17T08:47:19.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.249+0000 7f4230c00640 1 --2- 172.21.15.152:0/435586328 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f4210068380 0x7f421006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:19.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.249+0000 7f4230c00640 1 -- 172.21.15.152:0/435586328 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f42240871c0 con 0x7f423406f980 2024-04-17T08:47:19.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.249+0000 7f422b400640 1 --2- 172.21.15.152:0/435586328 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f4210068380 0x7f421006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:19.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.249+0000 7f422b400640 1 --2- 172.21.15.152:0/435586328 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f4210068380 0x7f421006a840 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f421c0012f0 tx=0x7f421c001640 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:19.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.253+0000 7f4230c00640 1 -- 172.21.15.152:0/435586328 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f4224057410 con 0x7f423406f980 2024-04-17T08:47:19.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.413+0000 7f423b000640 1 -- 172.21.15.152:0/435586328 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f4234159480 con 0x7f423406f980 2024-04-17T08:47:19.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.413+0000 7f4230c00640 1 -- 172.21.15.152:0/435586328 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f4224056d10 con 0x7f423406f980 2024-04-17T08:47:19.415 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-04-17T08:47:19.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.413+0000 7f423b000640 1 -- 172.21.15.152:0/435586328 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f4210068380 msgr2=0x7f421006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:19.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.413+0000 7f423b000640 1 --2- 172.21.15.152:0/435586328 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f4210068380 0x7f421006a840 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f421c0012f0 tx=0x7f421c001640 comp rx=0 tx=0).stop 2024-04-17T08:47:19.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.413+0000 7f423b000640 1 -- 172.21.15.152:0/435586328 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f423406f980 msgr2=0x7f4234155f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:19.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.413+0000 7f423b000640 1 --2- 172.21.15.152:0/435586328 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f423406f980 0x7f4234155f20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f422400e930 tx=0x7f422400edf0 comp rx=0 tx=0).stop 2024-04-17T08:47:19.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.413+0000 7f423b000640 1 -- 172.21.15.152:0/435586328 shutdown_connections 2024-04-17T08:47:19.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.413+0000 7f423b000640 1 --2- 172.21.15.152:0/435586328 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f4210068380 0x7f421006a840 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:19.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.413+0000 7f423b000640 1 --2- 172.21.15.152:0/435586328 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f42340d0360 0x7f42341f70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:19.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.413+0000 7f423b000640 1 --2- 172.21.15.152:0/435586328 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f42340af670 0x7f42341511f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:19.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.413+0000 7f423b000640 1 --2- 172.21.15.152:0/435586328 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f423406f980 0x7f4234155f20 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:19.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.413+0000 7f423b000640 1 -- 172.21.15.152:0/435586328 >> 172.21.15.152:0/435586328 conn(0x7f42340b3350 msgr2=0x7f4234164640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:19.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.413+0000 7f423b000640 1 -- 172.21.15.152:0/435586328 shutdown_connections 2024-04-17T08:47:19.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.417+0000 7f423b000640 1 -- 172.21.15.152:0/435586328 wait complete. 2024-04-17T08:47:19.437 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-17T08:47:19.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.573+0000 7f9c03e00640 1 Processor -- start 2024-04-17T08:47:19.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.573+0000 7f9c03e00640 1 -- start start 2024-04-17T08:47:19.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.573+0000 7f9c03e00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f9bfc06b9b0 0x7f9bfc06bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:19.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.573+0000 7f9c03e00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bfc06c310 con 0x7f9bfc158fe0 2024-04-17T08:47:19.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.573+0000 7f9c03e00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bfc0b4610 con 0x7f9bfc070950 2024-04-17T08:47:19.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.573+0000 7f9c03e00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f9bfc0cea60 con 0x7f9bfc06b9b0 2024-04-17T08:47:19.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.573+0000 7f9c01400640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f9bfc158fe0 0x7f9bfc15f7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:52334/0 (socket says 172.21.15.152:52334) 2024-04-17T08:47:19.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.573+0000 7f9c01400640 1 -- 172.21.15.152:0/2789022110 learned_addr learned my addr 172.21.15.152:0/2789022110 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:19.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.573+0000 7f9c01e00640 1 --2- 172.21.15.152:0/2789022110 >> v2:172.21.15.152:3300/0 conn(0x7f9bfc06b9b0 0x7f9bfc06bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:19.578 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.577+0000 7f9c01e00640 1 -- 172.21.15.152:0/2789022110 >> v1:172.21.15.196:6789/0 conn(0x7f9bfc070950 legacy=0x7f9bfc0b3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:19.578 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.577+0000 7f9c01e00640 1 -- 172.21.15.152:0/2789022110 >> v1:172.21.15.152:6789/0 conn(0x7f9bfc158fe0 legacy=0x7f9bfc15f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:19.578 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.577+0000 7f9c01e00640 1 -- 172.21.15.152:0/2789022110 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bfc0ced40 con 0x7f9bfc06b9b0 2024-04-17T08:47:19.578 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.577+0000 7f9bfbe00640 1 -- 172.21.15.152:0/2789022110 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2966784972 0 0) 0x7f9bfc06c310 con 0x7f9bfc158fe0 2024-04-17T08:47:19.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.577+0000 7f9c01e00640 1 --2- 172.21.15.152:0/2789022110 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bfc06b9b0 0x7f9bfc06bdd0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4009d90 tx=0x7f9bf401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7241bc892a7c580b server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:19.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.577+0000 7f9bfbe00640 1 -- 172.21.15.152:0/2789022110 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf40b2070 con 0x7f9bfc06b9b0 2024-04-17T08:47:19.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.577+0000 7f9bfbe00640 1 -- 172.21.15.152:0/2789022110 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bf40a5a00 con 0x7f9bfc06b9b0 2024-04-17T08:47:19.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.577+0000 7f9bfbe00640 1 -- 172.21.15.152:0/2789022110 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf40a5dd0 con 0x7f9bfc06b9b0 2024-04-17T08:47:19.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.577+0000 7f9c03e00640 1 -- 172.21.15.152:0/2789022110 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bfc06b9b0 msgr2=0x7f9bfc06bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:19.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.577+0000 7f9c03e00640 1 --2- 172.21.15.152:0/2789022110 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bfc06b9b0 0x7f9bfc06bdd0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4009d90 tx=0x7f9bf401c940 comp rx=0 tx=0).stop 2024-04-17T08:47:19.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.577+0000 7f9c03e00640 1 -- 172.21.15.152:0/2789022110 shutdown_connections 2024-04-17T08:47:19.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.577+0000 7f9c03e00640 1 --2- 172.21.15.152:0/2789022110 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bfc06b9b0 0x7f9bfc06bdd0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:19.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.577+0000 7f9c03e00640 1 -- 172.21.15.152:0/2789022110 >> 172.21.15.152:0/2789022110 conn(0x7f9bfc0cd540 msgr2=0x7f9bfc0cd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:19.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.581+0000 7f9c03e00640 1 -- 172.21.15.152:0/2789022110 shutdown_connections 2024-04-17T08:47:19.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.581+0000 7f9c03e00640 1 -- 172.21.15.152:0/2789022110 wait complete. 2024-04-17T08:47:19.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.581+0000 7f9c03e00640 1 Processor -- start 2024-04-17T08:47:19.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.581+0000 7f9c03e00640 1 -- start start 2024-04-17T08:47:19.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.581+0000 7f9c03e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9bfc06b9b0 0x7f9bfc150170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:19.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.581+0000 7f9c03e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9bfc070950 0x7f9bfc13c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:19.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.581+0000 7f9c03e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bfc158fe0 0x7f9bfc153a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:19.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.581+0000 7f9c03e00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9bfc16c550 con 0x7f9bfc158fe0 2024-04-17T08:47:19.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.581+0000 7f9c03e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f9bfc16c3d0 con 0x7f9bfc070950 2024-04-17T08:47:19.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.581+0000 7f9c03e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f9bfc16c6d0 con 0x7f9bfc06b9b0 2024-04-17T08:47:19.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.581+0000 7f9c01e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bfc158fe0 0x7f9bfc153a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:19.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.581+0000 7f9c01e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bfc158fe0 0x7f9bfc153a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56730/0 (socket says 172.21.15.152:56730) 2024-04-17T08:47:19.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.581+0000 7f9c01e00640 1 -- 172.21.15.152:0/3225497835 learned_addr learned my addr 172.21.15.152:0/3225497835 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:19.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.581+0000 7f9c01400640 1 --2- 172.21.15.152:0/3225497835 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9bfc06b9b0 0x7f9bfc150170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:19.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.581+0000 7f9c00a00640 1 --2- 172.21.15.152:0/3225497835 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9bfc070950 0x7f9bfc13c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:19.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.581+0000 7f9c01e00640 1 -- 172.21.15.152:0/3225497835 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9bfc06b9b0 msgr2=0x7f9bfc150170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:19.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.581+0000 7f9c01e00640 1 --2- 172.21.15.152:0/3225497835 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9bfc06b9b0 0x7f9bfc150170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:19.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.581+0000 7f9c01e00640 1 -- 172.21.15.152:0/3225497835 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9bfc070950 msgr2=0x7f9bfc13c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:19.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.581+0000 7f9c01e00640 1 --2- 172.21.15.152:0/3225497835 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9bfc070950 0x7f9bfc13c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:19.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.581+0000 7f9c01e00640 1 -- 172.21.15.152:0/3225497835 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bfc14e030 con 0x7f9bfc158fe0 2024-04-17T08:47:19.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.581+0000 7f9c01400640 1 --2- 172.21.15.152:0/3225497835 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9bfc06b9b0 0x7f9bfc150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:19.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.581+0000 7f9c00a00640 1 --2- 172.21.15.152:0/3225497835 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9bfc070950 0x7f9bfc13c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:19.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.581+0000 7f9c01e00640 1 --2- 172.21.15.152:0/3225497835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bfc158fe0 0x7f9bfc153a40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9bf40b0040 tx=0x7f9bf40196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:19.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.581+0000 7f9bf9600640 1 -- 172.21.15.152:0/3225497835 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf40b2040 con 0x7f9bfc158fe0 2024-04-17T08:47:19.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.581+0000 7f9bf9600640 1 -- 172.21.15.152:0/3225497835 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bf40bf070 con 0x7f9bfc158fe0 2024-04-17T08:47:19.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.581+0000 7f9c03e00640 1 -- 172.21.15.152:0/3225497835 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bfc14e310 con 0x7f9bfc158fe0 2024-04-17T08:47:19.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.581+0000 7f9bf9600640 1 -- 172.21.15.152:0/3225497835 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf40adab0 con 0x7f9bfc158fe0 2024-04-17T08:47:19.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.581+0000 7f9c03e00640 1 -- 172.21.15.152:0/3225497835 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bfc14edf0 con 0x7f9bfc158fe0 2024-04-17T08:47:19.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.585+0000 7f9c03e00640 1 -- 172.21.15.152:0/3225497835 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bfc068a30 con 0x7f9bfc158fe0 2024-04-17T08:47:19.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.585+0000 7f9bf9600640 1 -- 172.21.15.152:0/3225497835 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9bf40adc50 con 0x7f9bfc158fe0 2024-04-17T08:47:19.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.585+0000 7f9bf9600640 1 --2- 172.21.15.152:0/3225497835 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9bdc068380 0x7f9bdc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:19.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.585+0000 7f9bf9600640 1 -- 172.21.15.152:0/3225497835 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f9bf41222a0 con 0x7f9bfc158fe0 2024-04-17T08:47:19.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.585+0000 7f9c01400640 1 --2- 172.21.15.152:0/3225497835 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9bdc068380 0x7f9bdc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:19.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.585+0000 7f9c01400640 1 --2- 172.21.15.152:0/3225497835 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9bdc068380 0x7f9bdc06a840 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0000f70 tx=0x7f9bf0007dd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:19.592 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.589+0000 7f9bf9600640 1 -- 172.21.15.152:0/3225497835 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f9bf4016560 con 0x7f9bfc158fe0 2024-04-17T08:47:19.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.745+0000 7f9c03e00640 1 -- 172.21.15.152:0/3225497835 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f9bfc067e50 con 0x7f9bfc158fe0 2024-04-17T08:47:19.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.745+0000 7f9bf9600640 1 -- 172.21.15.152:0/3225497835 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f9bf40ab340 con 0x7f9bfc158fe0 2024-04-17T08:47:19.748 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 64 2024-04-17T08:47:19.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.749+0000 7f9c03e00640 1 -- 172.21.15.152:0/3225497835 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9bdc068380 msgr2=0x7f9bdc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:19.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.749+0000 7f9c03e00640 1 --2- 172.21.15.152:0/3225497835 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9bdc068380 0x7f9bdc06a840 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0000f70 tx=0x7f9bf0007dd0 comp rx=0 tx=0).stop 2024-04-17T08:47:19.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.749+0000 7f9c03e00640 1 -- 172.21.15.152:0/3225497835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bfc158fe0 msgr2=0x7f9bfc153a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:19.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.749+0000 7f9c03e00640 1 --2- 172.21.15.152:0/3225497835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bfc158fe0 0x7f9bfc153a40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9bf40b0040 tx=0x7f9bf40196e0 comp rx=0 tx=0).stop 2024-04-17T08:47:19.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.749+0000 7f9c03e00640 1 -- 172.21.15.152:0/3225497835 shutdown_connections 2024-04-17T08:47:19.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.749+0000 7f9c03e00640 1 --2- 172.21.15.152:0/3225497835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bfc158fe0 0x7f9bfc153a40 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:19.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.749+0000 7f9c03e00640 1 --2- 172.21.15.152:0/3225497835 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9bfc070950 0x7f9bfc13c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:19.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.749+0000 7f9c03e00640 1 --2- 172.21.15.152:0/3225497835 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9bdc068380 0x7f9bdc06a840 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:19.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.749+0000 7f9c03e00640 1 --2- 172.21.15.152:0/3225497835 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9bfc06b9b0 0x7f9bfc150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:19.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.749+0000 7f9c03e00640 1 -- 172.21.15.152:0/3225497835 >> 172.21.15.152:0/3225497835 conn(0x7f9bfc0cd540 msgr2=0x7f9bfc15f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:19.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.749+0000 7f9c03e00640 1 -- 172.21.15.152:0/3225497835 shutdown_connections 2024-04-17T08:47:19.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.749+0000 7f9c03e00640 1 -- 172.21.15.152:0/3225497835 wait complete. 2024-04-17T08:47:19.769 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-17T08:47:19.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.905+0000 7fc326a00640 1 Processor -- start 2024-04-17T08:47:19.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.905+0000 7fc326a00640 1 -- start start 2024-04-17T08:47:19.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.905+0000 7fc326a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc32006f980 0x7fc320072530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:19.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.905+0000 7fc326a00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc3200d0360 0x7fc3200d07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:19.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.905+0000 7fc326a00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc32015bfd0 con 0x7fc3200af670 2024-04-17T08:47:19.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.905+0000 7fc326a00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fc3200d0cf0 con 0x7fc3200d0360 2024-04-17T08:47:19.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.905+0000 7fc326a00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fc32015c820 con 0x7fc32006f980 2024-04-17T08:47:19.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.905+0000 7fc324a00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc3200d0360 0x7fc3200d07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:19.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.905+0000 7fc324a00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc3200d0360 0x7fc3200d07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56746/0 (socket says 172.21.15.152:56746) 2024-04-17T08:47:19.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.905+0000 7fc324a00640 1 -- 172.21.15.152:0/4236127913 learned_addr learned my addr 172.21.15.152:0/4236127913 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:19.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.905+0000 7fc317400640 1 --2- 172.21.15.152:0/4236127913 >> v2:172.21.15.196:3300/0 conn(0x7fc32006f980 0x7fc320072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:19.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.905+0000 7fc324a00640 1 -- 172.21.15.152:0/4236127913 >> v2:172.21.15.196:3300/0 conn(0x7fc32006f980 msgr2=0x7fc320072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:19.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.905+0000 7fc324a00640 1 --2- 172.21.15.152:0/4236127913 >> v2:172.21.15.196:3300/0 conn(0x7fc32006f980 0x7fc320072530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:19.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.905+0000 7fc324a00640 1 -- 172.21.15.152:0/4236127913 >> v1:172.21.15.196:6789/0 conn(0x7fc3200af670 legacy=0x7fc32015b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:19.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.905+0000 7fc324a00640 1 -- 172.21.15.152:0/4236127913 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc32015c260 con 0x7fc3200d0360 2024-04-17T08:47:19.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.909+0000 7fc324a00640 1 --2- 172.21.15.152:0/4236127913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3200d0360 0x7fc3200d07b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc3200b41d0 tx=0x7fc31801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7c3b9d3e6ae90ae server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:19.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.909+0000 7fc31f400640 1 -- 172.21.15.152:0/4236127913 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3180a57f0 con 0x7fc3200d0360 2024-04-17T08:47:19.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.909+0000 7fc31f400640 1 -- 172.21.15.152:0/4236127913 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3180a5990 con 0x7fc3200d0360 2024-04-17T08:47:19.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.909+0000 7fc31f400640 1 -- 172.21.15.152:0/4236127913 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3180a5d60 con 0x7fc3200d0360 2024-04-17T08:47:19.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.909+0000 7fc326a00640 1 -- 172.21.15.152:0/4236127913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3200d0360 msgr2=0x7fc3200d07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:19.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.909+0000 7fc326a00640 1 --2- 172.21.15.152:0/4236127913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3200d0360 0x7fc3200d07b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc3200b41d0 tx=0x7fc31801c930 comp rx=0 tx=0).stop 2024-04-17T08:47:19.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.909+0000 7fc326a00640 1 -- 172.21.15.152:0/4236127913 shutdown_connections 2024-04-17T08:47:19.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.909+0000 7fc326a00640 1 --2- 172.21.15.152:0/4236127913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3200d0360 0x7fc3200d07b0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:19.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.909+0000 7fc326a00640 1 --2- 172.21.15.152:0/4236127913 >> v2:172.21.15.196:3300/0 conn(0x7fc32006f980 0x7fc320072530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:19.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.909+0000 7fc326a00640 1 -- 172.21.15.152:0/4236127913 >> 172.21.15.152:0/4236127913 conn(0x7fc3200b3350 msgr2=0x7fc3200b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:19.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.909+0000 7fc326a00640 1 -- 172.21.15.152:0/4236127913 shutdown_connections 2024-04-17T08:47:19.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.909+0000 7fc326a00640 1 -- 172.21.15.152:0/4236127913 wait complete. 2024-04-17T08:47:19.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.913+0000 7fc326a00640 1 Processor -- start 2024-04-17T08:47:19.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.913+0000 7fc326a00640 1 -- start start 2024-04-17T08:47:19.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.913+0000 7fc326a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc32006f980 0x7fc3200b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:19.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.913+0000 7fc326a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc3200af670 0x7fc320145830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:19.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.913+0000 7fc326a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3200d0360 0x7fc32014e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:19.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.913+0000 7fc326a00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc320072a70 con 0x7fc3200d0360 2024-04-17T08:47:19.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.913+0000 7fc326a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc3200afa50 con 0x7fc3200af670 2024-04-17T08:47:19.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.913+0000 7fc326a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fc320072bf0 con 0x7fc32006f980 2024-04-17T08:47:19.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.913+0000 7fc324a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3200d0360 0x7fc32014e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:19.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.913+0000 7fc324a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3200d0360 0x7fc32014e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56760/0 (socket says 172.21.15.152:56760) 2024-04-17T08:47:19.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.913+0000 7fc324a00640 1 -- 172.21.15.152:0/3593058637 learned_addr learned my addr 172.21.15.152:0/3593058637 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:19.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.913+0000 7fc317400640 1 --2- 172.21.15.152:0/3593058637 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc3200af670 0x7fc320145830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:19.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.913+0000 7fc31fe00640 1 --2- 172.21.15.152:0/3593058637 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc32006f980 0x7fc3200b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:19.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.913+0000 7fc324a00640 1 -- 172.21.15.152:0/3593058637 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc32006f980 msgr2=0x7fc3200b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:19.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.913+0000 7fc324a00640 1 --2- 172.21.15.152:0/3593058637 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc32006f980 0x7fc3200b25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:19.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.913+0000 7fc324a00640 1 -- 172.21.15.152:0/3593058637 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc3200af670 msgr2=0x7fc320145830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:19.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.913+0000 7fc324a00640 1 --2- 172.21.15.152:0/3593058637 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc3200af670 0x7fc320145830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:19.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.913+0000 7fc324a00640 1 -- 172.21.15.152:0/3593058637 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc32015df90 con 0x7fc3200d0360 2024-04-17T08:47:19.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.913+0000 7fc324a00640 1 --2- 172.21.15.152:0/3593058637 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3200d0360 0x7fc32014e200 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc3180af040 tx=0x7fc3180196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:19.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.913+0000 7fc31cc00640 1 -- 172.21.15.152:0/3593058637 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3180b8670 con 0x7fc3200d0360 2024-04-17T08:47:19.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.913+0000 7fc31cc00640 1 -- 172.21.15.152:0/3593058637 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3180be070 con 0x7fc3200d0360 2024-04-17T08:47:19.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.913+0000 7fc326a00640 1 -- 172.21.15.152:0/3593058637 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc32015e230 con 0x7fc3200d0360 2024-04-17T08:47:19.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.913+0000 7fc31cc00640 1 -- 172.21.15.152:0/3593058637 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3180b8a90 con 0x7fc3200d0360 2024-04-17T08:47:19.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.913+0000 7fc326a00640 1 -- 172.21.15.152:0/3593058637 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc320156130 con 0x7fc3200d0360 2024-04-17T08:47:19.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.913+0000 7fc326a00640 1 -- 172.21.15.152:0/3593058637 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc320155f20 con 0x7fc3200d0360 2024-04-17T08:47:19.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.917+0000 7fc31cc00640 1 -- 172.21.15.152:0/3593058637 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc3180b8c30 con 0x7fc3200d0360 2024-04-17T08:47:19.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.917+0000 7fc31cc00640 1 --2- 172.21.15.152:0/3593058637 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc2fc068380 0x7fc2fc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:19.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.917+0000 7fc31cc00640 1 -- 172.21.15.152:0/3593058637 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fc318121f30 con 0x7fc3200d0360 2024-04-17T08:47:19.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.917+0000 7fc31fe00640 1 --2- 172.21.15.152:0/3593058637 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc2fc068380 0x7fc2fc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:19.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.917+0000 7fc31fe00640 1 --2- 172.21.15.152:0/3593058637 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc2fc068380 0x7fc2fc06a840 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc310000f70 tx=0x7fc310009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:19.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:19.921+0000 7fc31cc00640 1 -- 172.21.15.152:0/3593058637 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fc3180165e0 con 0x7fc3200d0360 2024-04-17T08:47:20.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.077+0000 7fc326a00640 1 -- 172.21.15.152:0/3593058637 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fc320068a30 con 0x7fc3200d0360 2024-04-17T08:47:20.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.077+0000 7fc31cc00640 1 -- 172.21.15.152:0/3593058637 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7fc3180f20c0 con 0x7fc3200d0360 2024-04-17T08:47:20.081 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-04-17T08:47:20.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.081+0000 7fc326a00640 1 -- 172.21.15.152:0/3593058637 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc2fc068380 msgr2=0x7fc2fc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:20.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.081+0000 7fc326a00640 1 --2- 172.21.15.152:0/3593058637 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc2fc068380 0x7fc2fc06a840 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc310000f70 tx=0x7fc310009040 comp rx=0 tx=0).stop 2024-04-17T08:47:20.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.081+0000 7fc326a00640 1 -- 172.21.15.152:0/3593058637 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3200d0360 msgr2=0x7fc32014e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:20.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.081+0000 7fc326a00640 1 --2- 172.21.15.152:0/3593058637 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3200d0360 0x7fc32014e200 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc3180af040 tx=0x7fc3180196d0 comp rx=0 tx=0).stop 2024-04-17T08:47:20.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.081+0000 7fc326a00640 1 -- 172.21.15.152:0/3593058637 shutdown_connections 2024-04-17T08:47:20.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.081+0000 7fc326a00640 1 --2- 172.21.15.152:0/3593058637 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3200d0360 0x7fc32014e200 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:20.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.081+0000 7fc326a00640 1 --2- 172.21.15.152:0/3593058637 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc3200af670 0x7fc320145830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:20.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.081+0000 7fc326a00640 1 --2- 172.21.15.152:0/3593058637 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc2fc068380 0x7fc2fc06a840 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:20.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.081+0000 7fc326a00640 1 --2- 172.21.15.152:0/3593058637 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc32006f980 0x7fc3200b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:20.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.081+0000 7fc326a00640 1 -- 172.21.15.152:0/3593058637 >> 172.21.15.152:0/3593058637 conn(0x7fc3200b3350 msgr2=0x7fc3200aeb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:20.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.081+0000 7fc326a00640 1 -- 172.21.15.152:0/3593058637 shutdown_connections 2024-04-17T08:47:20.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.081+0000 7fc326a00640 1 -- 172.21.15.152:0/3593058637 wait complete. 2024-04-17T08:47:20.101 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T08:47:20.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.233+0000 7ff5dee00640 1 Processor -- start 2024-04-17T08:47:20.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.233+0000 7ff5dee00640 1 -- start start 2024-04-17T08:47:20.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.237+0000 7ff5dee00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff5d80af670 0x7ff5d815b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:20.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.237+0000 7ff5dee00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ff5d806f980 0x7ff5d8072530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:20.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.237+0000 7ff5dee00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5d815c260 con 0x7ff5d80d0360 2024-04-17T08:47:20.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.237+0000 7ff5dee00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7ff5d815c820 con 0x7ff5d80af670 2024-04-17T08:47:20.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.237+0000 7ff5dee00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7ff5d815c540 con 0x7ff5d806f980 2024-04-17T08:47:20.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.237+0000 7ff5d7e00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff5d80af670 0x7ff5d815b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:20.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.237+0000 7ff5d7e00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff5d80af670 0x7ff5d815b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56770/0 (socket says 172.21.15.152:56770) 2024-04-17T08:47:20.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.237+0000 7ff5d7e00640 1 -- 172.21.15.152:0/746007877 learned_addr learned my addr 172.21.15.152:0/746007877 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:20.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.237+0000 7ff5cf400640 1 --2- 172.21.15.152:0/746007877 >> v2:172.21.15.196:3300/0 conn(0x7ff5d806f980 0x7ff5d8072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:20.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.237+0000 7ff5d7e00640 1 -- 172.21.15.152:0/746007877 >> v2:172.21.15.196:3300/0 conn(0x7ff5d806f980 msgr2=0x7ff5d8072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:20.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.237+0000 7ff5d7e00640 1 --2- 172.21.15.152:0/746007877 >> v2:172.21.15.196:3300/0 conn(0x7ff5d806f980 0x7ff5d8072530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:20.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.237+0000 7ff5d7e00640 1 -- 172.21.15.152:0/746007877 >> v1:172.21.15.196:6789/0 conn(0x7ff5d80d0360 legacy=0x7ff5d806dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:20.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.237+0000 7ff5d7e00640 1 -- 172.21.15.152:0/746007877 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5d8071d30 con 0x7ff5d80af670 2024-04-17T08:47:20.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.237+0000 7ff5cf400640 1 --2- 172.21.15.152:0/746007877 >> v2:172.21.15.196:3300/0 conn(0x7ff5d806f980 0x7ff5d8072530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:47:20.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.237+0000 7ff5d7e00640 1 --2- 172.21.15.152:0/746007877 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5d80af670 0x7ff5d815b8c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff5d80b41d0 tx=0x7ff5c801c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1ed7f7cf6e694d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:20.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.241+0000 7ff5d7400640 1 -- 172.21.15.152:0/746007877 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c80a5740 con 0x7ff5d80af670 2024-04-17T08:47:20.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.241+0000 7ff5d7400640 1 -- 172.21.15.152:0/746007877 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5c80a58e0 con 0x7ff5d80af670 2024-04-17T08:47:20.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.241+0000 7ff5d7400640 1 -- 172.21.15.152:0/746007877 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c80a5cb0 con 0x7ff5d80af670 2024-04-17T08:47:20.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.241+0000 7ff5dee00640 1 -- 172.21.15.152:0/746007877 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5d80af670 msgr2=0x7ff5d815b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:20.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.241+0000 7ff5dee00640 1 --2- 172.21.15.152:0/746007877 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5d80af670 0x7ff5d815b8c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff5d80b41d0 tx=0x7ff5c801c8f0 comp rx=0 tx=0).stop 2024-04-17T08:47:20.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.241+0000 7ff5dee00640 1 -- 172.21.15.152:0/746007877 shutdown_connections 2024-04-17T08:47:20.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.241+0000 7ff5dee00640 1 --2- 172.21.15.152:0/746007877 >> v2:172.21.15.196:3300/0 conn(0x7ff5d806f980 0x7ff5d8072530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:20.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.241+0000 7ff5dee00640 1 --2- 172.21.15.152:0/746007877 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5d80af670 0x7ff5d815b8c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:20.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.241+0000 7ff5dee00640 1 -- 172.21.15.152:0/746007877 >> 172.21.15.152:0/746007877 conn(0x7ff5d80b3350 msgr2=0x7ff5d80b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:20.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.241+0000 7ff5dee00640 1 -- 172.21.15.152:0/746007877 shutdown_connections 2024-04-17T08:47:20.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.241+0000 7ff5dee00640 1 -- 172.21.15.152:0/746007877 wait complete. 2024-04-17T08:47:20.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.241+0000 7ff5dee00640 1 Processor -- start 2024-04-17T08:47:20.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.241+0000 7ff5dee00640 1 -- start start 2024-04-17T08:47:20.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.241+0000 7ff5dee00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5d806f980 0x7ff5d8156910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:20.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.241+0000 7ff5dee00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5d80af670 0x7ff5d8157300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:20.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.241+0000 7ff5dee00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5d80d0360 0x7ff5d8157840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:20.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.241+0000 7ff5dee00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d815bf80 con 0x7ff5d80af670 2024-04-17T08:47:20.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.241+0000 7ff5dee00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d815be00 con 0x7ff5d806f980 2024-04-17T08:47:20.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.241+0000 7ff5dee00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7ff5d8072a70 con 0x7ff5d80d0360 2024-04-17T08:47:20.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.241+0000 7ff5cf400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5d80af670 0x7ff5d8157300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:20.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.241+0000 7ff5cf400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5d80af670 0x7ff5d8157300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56776/0 (socket says 172.21.15.152:56776) 2024-04-17T08:47:20.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.241+0000 7ff5cf400640 1 -- 172.21.15.152:0/1561190086 learned_addr learned my addr 172.21.15.152:0/1561190086 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:20.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.241+0000 7ff5d7e00640 1 --2- 172.21.15.152:0/1561190086 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5d806f980 0x7ff5d8156910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:20.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.241+0000 7ff5dce00640 1 --2- 172.21.15.152:0/1561190086 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5d80d0360 0x7ff5d8157840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:20.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.245+0000 7ff5cf400640 1 -- 172.21.15.152:0/1561190086 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5d80d0360 msgr2=0x7ff5d8157840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:20.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.245+0000 7ff5cf400640 1 --2- 172.21.15.152:0/1561190086 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5d80d0360 0x7ff5d8157840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:20.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.245+0000 7ff5cf400640 1 -- 172.21.15.152:0/1561190086 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5d806f980 msgr2=0x7ff5d8156910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:20.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.245+0000 7ff5cf400640 1 --2- 172.21.15.152:0/1561190086 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5d806f980 0x7ff5d8156910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:20.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.245+0000 7ff5cf400640 1 -- 172.21.15.152:0/1561190086 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5d8156ef0 con 0x7ff5d80af670 2024-04-17T08:47:20.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.245+0000 7ff5d7e00640 1 --2- 172.21.15.152:0/1561190086 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5d806f980 0x7ff5d8156910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:20.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.245+0000 7ff5cf400640 1 --2- 172.21.15.152:0/1561190086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5d80af670 0x7ff5d8157300 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff5c000c820 tx=0x7ff5c000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:20.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.245+0000 7ff5d4c00640 1 -- 172.21.15.152:0/1561190086 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c0015070 con 0x7ff5d80af670 2024-04-17T08:47:20.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.245+0000 7ff5d4c00640 1 -- 172.21.15.152:0/1561190086 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5c0007a30 con 0x7ff5d80af670 2024-04-17T08:47:20.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.245+0000 7ff5dee00640 1 -- 172.21.15.152:0/1561190086 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5d8152320 con 0x7ff5d80af670 2024-04-17T08:47:20.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.245+0000 7ff5d4c00640 1 -- 172.21.15.152:0/1561190086 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c0007e00 con 0x7ff5d80af670 2024-04-17T08:47:20.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.245+0000 7ff5dee00640 1 -- 172.21.15.152:0/1561190086 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5d81528a0 con 0x7ff5d80af670 2024-04-17T08:47:20.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.245+0000 7ff5dee00640 1 -- 172.21.15.152:0/1561190086 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5d8068a30 con 0x7ff5d80af670 2024-04-17T08:47:20.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.245+0000 7ff5d4c00640 1 -- 172.21.15.152:0/1561190086 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff5c0018070 con 0x7ff5d80af670 2024-04-17T08:47:20.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.245+0000 7ff5d4c00640 1 --2- 172.21.15.152:0/1561190086 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7ff5b4068380 0x7ff5b406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:20.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.245+0000 7ff5d4c00640 1 -- 172.21.15.152:0/1561190086 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7ff5c0086c80 con 0x7ff5d80af670 2024-04-17T08:47:20.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.245+0000 7ff5d7e00640 1 --2- 172.21.15.152:0/1561190086 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7ff5b4068380 0x7ff5b406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:20.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.249+0000 7ff5d7e00640 1 --2- 172.21.15.152:0/1561190086 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7ff5b4068380 0x7ff5b406a840 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff5c80ae000 tx=0x7ff5c80a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:20.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.249+0000 7ff5d4c00640 1 -- 172.21.15.152:0/1561190086 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7ff5c00567c0 con 0x7ff5d80af670 2024-04-17T08:47:20.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.409+0000 7ff5dee00640 1 -- 172.21.15.152:0/1561190086 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff5d81570c0 con 0x7ff5d80af670 2024-04-17T08:47:20.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.409+0000 7ff5d4c00640 1 -- 172.21.15.152:0/1561190086 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18972 (secure 0 0 0) 0x7ff5c005aac0 con 0x7ff5d80af670 2024-04-17T08:47:20.413 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:47:20.413 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":26,"fsid":"ce68f82e-ec5f-4205-9fd5-bdfdf6ef31e2","created":"2024-04-17T08:46:08.353546+0000","modified":"2024-04-17T08:47:15.280634+0000","last_up_change":"2024-04-17T08:46:20.738799+0000","last_in_change":"2024-04-17T08:46:11.210050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T08:46:21.386856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T08:46:31.812460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T08:46:32.555559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T08:46:36.258078+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"682f0192-187c-404e-bc7a-b6b4e23825e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6819","nonce":3603799291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6823","nonce":3603799291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6831","nonce":3603799291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6827","nonce":3603799291}]},"public_addr":"172.21.15.152:6819/3603799291","cluster_addr":"172.21.15.152:6823/3603799291","heartbeat_back_addr":"172.21.15.152:6831/3603799291","heartbeat_front_addr":"172.21.15.152:6827/3603799291","state":["exists","up"]},{"osd":1,"uuid":"f0fe8fef-60ec-4a39-83b6-2fa6a5adb0f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6801","nonce":4133383142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6803","nonce":4133383142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6807","nonce":4133383142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6805","nonce":4133383142}]},"public_addr":"172.21.15.152:6801/4133383142","cluster_addr":"172.21.15.152:6803/4133383142","heartbeat_back_addr":"172.21.15.152:6807/4133383142","heartbeat_front_addr":"172.21.15.152:6805/4133383142","state":["exists","up"]},{"osd":2,"uuid":"35f36d9c-5245-4431-a618-f4df0fa380ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6809","nonce":3826143898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6811","nonce":3826143898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6815","nonce":3826143898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6813","nonce":3826143898}]},"public_addr":"172.21.15.152:6809/3826143898","cluster_addr":"172.21.15.152:6811/3826143898","heartbeat_back_addr":"172.21.15.152:6815/3826143898","heartbeat_front_addr":"172.21.15.152:6813/3826143898","state":["exists","up"]},{"osd":3,"uuid":"96e56ca5-15b4-4895-9b79-da2c92043159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6818","nonce":165717826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6822","nonce":165717826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6830","nonce":165717826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6826","nonce":165717826}]},"public_addr":"172.21.15.152:6818/165717826","cluster_addr":"172.21.15.152:6822/165717826","heartbeat_back_addr":"172.21.15.152:6830/165717826","heartbeat_front_addr":"172.21.15.152:6826/165717826","state":["exists","up"]},{"osd":4,"uuid":"f5aa10a4-9ff9-41fe-a5c9-15326f982cc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6817","nonce":4080159297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6819","nonce":4080159297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6823","nonce":4080159297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6821","nonce":4080159297}]},"public_addr":"172.21.15.196:6817/4080159297","cluster_addr":"172.21.15.196:6819/4080159297","heartbeat_back_addr":"172.21.15.196:6823/4080159297","heartbeat_front_addr":"172.21.15.196:6821/4080159297","state":["exists","up"]},{"osd":5,"uuid":"42bab884-3476-47ae-ac65-935fa6e0f055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6801","nonce":3519444232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6803","nonce":3519444232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6807","nonce":3519444232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6805","nonce":3519444232}]},"public_addr":"172.21.15.196:6801/3519444232","cluster_addr":"172.21.15.196:6803/3519444232","heartbeat_back_addr":"172.21.15.196:6807/3519444232","heartbeat_front_addr":"172.21.15.196:6805/3519444232","state":["exists","up"]},{"osd":6,"uuid":"460b6167-f57b-4224-9c92-cfc9b80bbe99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6809","nonce":275739834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6811","nonce":275739834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6815","nonce":275739834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6813","nonce":275739834}]},"public_addr":"172.21.15.196:6809/275739834","cluster_addr":"172.21.15.196:6811/275739834","heartbeat_back_addr":"172.21.15.196:6815/275739834","heartbeat_front_addr":"172.21.15.196:6813/275739834","state":["exists","up"]},{"osd":7,"uuid":"d695643f-5e07-4e2a-a646-c06bd97b6650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6825","nonce":307626968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6827","nonce":307626968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6831","nonce":307626968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6829","nonce":307626968}]},"public_addr":"172.21.15.196:6825/307626968","cluster_addr":"172.21.15.196:6827/307626968","heartbeat_back_addr":"172.21.15.196:6831/307626968","heartbeat_front_addr":"172.21.15.196:6829/307626968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.293257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.964533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.248895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.010000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.832554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.743704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930171+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930962+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T08:47:20.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.413+0000 7ff5dee00640 1 -- 172.21.15.152:0/1561190086 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7ff5b4068380 msgr2=0x7ff5b406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:20.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.413+0000 7ff5dee00640 1 --2- 172.21.15.152:0/1561190086 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7ff5b4068380 0x7ff5b406a840 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff5c80ae000 tx=0x7ff5c80a7070 comp rx=0 tx=0).stop 2024-04-17T08:47:20.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.413+0000 7ff5dee00640 1 -- 172.21.15.152:0/1561190086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5d80af670 msgr2=0x7ff5d8157300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:20.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.413+0000 7ff5dee00640 1 --2- 172.21.15.152:0/1561190086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5d80af670 0x7ff5d8157300 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff5c000c820 tx=0x7ff5c000cce0 comp rx=0 tx=0).stop 2024-04-17T08:47:20.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.413+0000 7ff5dee00640 1 -- 172.21.15.152:0/1561190086 shutdown_connections 2024-04-17T08:47:20.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.413+0000 7ff5dee00640 1 --2- 172.21.15.152:0/1561190086 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7ff5b4068380 0x7ff5b406a840 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:20.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.413+0000 7ff5dee00640 1 --2- 172.21.15.152:0/1561190086 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5d80d0360 0x7ff5d8157840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:20.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.413+0000 7ff5dee00640 1 --2- 172.21.15.152:0/1561190086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5d80af670 0x7ff5d8157300 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:20.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.413+0000 7ff5dee00640 1 --2- 172.21.15.152:0/1561190086 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5d806f980 0x7ff5d8156910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:20.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.413+0000 7ff5dee00640 1 -- 172.21.15.152:0/1561190086 >> 172.21.15.152:0/1561190086 conn(0x7ff5d80b3350 msgr2=0x7ff5d8164c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:20.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.413+0000 7ff5dee00640 1 -- 172.21.15.152:0/1561190086 shutdown_connections 2024-04-17T08:47:20.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.413+0000 7ff5dee00640 1 -- 172.21.15.152:0/1561190086 wait complete. 2024-04-17T08:47:20.434 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T08:46:21.386856+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-17T08:46:31.812460+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-17T08:46:32.555559+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-17T08:46:36.258078+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-17T08:47:20.435 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T08:47:20.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.573+0000 7f7a24a00640 1 Processor -- start 2024-04-17T08:47:20.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.573+0000 7f7a24a00640 1 -- start start 2024-04-17T08:47:20.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.573+0000 7f7a24a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f7a20162900 0x7f7a20072610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:20.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.573+0000 7f7a24a00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7a2006dc60 0x7f7a200d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:20.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.573+0000 7f7a24a00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a2006e0f0 con 0x7f7a2006f190 2024-04-17T08:47:20.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.573+0000 7f7a24a00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f7a2006e3d0 con 0x7f7a2006dc60 2024-04-17T08:47:20.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.573+0000 7f7a24a00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f7a2006e6b0 con 0x7f7a20162900 2024-04-17T08:47:20.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.573+0000 7f7a15400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7a2006dc60 0x7f7a200d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:20.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.573+0000 7f7a1e800640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f7a2006f190 0x7f7a2006b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:52336/0 (socket says 172.21.15.152:52336) 2024-04-17T08:47:20.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.573+0000 7f7a1e800640 1 -- 172.21.15.152:0/1897452225 learned_addr learned my addr 172.21.15.152:0/1897452225 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:20.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.573+0000 7f7a15400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7a2006dc60 0x7f7a200d0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56788/0 (socket says 172.21.15.152:56788) 2024-04-17T08:47:20.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.573+0000 7f7a1de00640 1 --2- 172.21.15.152:0/1897452225 >> v2:172.21.15.196:3300/0 conn(0x7f7a20162900 0x7f7a20072610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:20.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.573+0000 7f7a15400640 1 -- 172.21.15.152:0/1897452225 >> v2:172.21.15.196:3300/0 conn(0x7f7a20162900 msgr2=0x7f7a20072610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:20.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.573+0000 7f7a15400640 1 --2- 172.21.15.152:0/1897452225 >> v2:172.21.15.196:3300/0 conn(0x7f7a20162900 0x7f7a20072610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:20.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.573+0000 7f7a15400640 1 -- 172.21.15.152:0/1897452225 >> v1:172.21.15.152:6789/0 conn(0x7f7a2006f190 legacy=0x7f7a2006b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:20.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.573+0000 7f7a15400640 1 -- 172.21.15.152:0/1897452225 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a2006e990 con 0x7f7a2006dc60 2024-04-17T08:47:20.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.573+0000 7f7a1d400640 1 -- 172.21.15.152:0/1897452225 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2796016248 0 0) 0x7f7a2006e0f0 con 0x7f7a2006f190 2024-04-17T08:47:20.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.577+0000 7f7a15400640 1 --2- 172.21.15.152:0/1897452225 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a2006dc60 0x7f7a200d0360 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7a200b41a0 tx=0x7f7a0801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32c567bbb125a613 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:20.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.577+0000 7f7a1d400640 1 -- 172.21.15.152:0/1897452225 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a080b1070 con 0x7f7a2006dc60 2024-04-17T08:47:20.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.577+0000 7f7a1d400640 1 -- 172.21.15.152:0/1897452225 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a080ac5f0 con 0x7f7a2006dc60 2024-04-17T08:47:20.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.577+0000 7f7a1d400640 1 -- 172.21.15.152:0/1897452225 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a080ac9c0 con 0x7f7a2006dc60 2024-04-17T08:47:20.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.577+0000 7f7a24a00640 1 -- 172.21.15.152:0/1897452225 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a2006dc60 msgr2=0x7f7a200d0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:20.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.577+0000 7f7a24a00640 1 --2- 172.21.15.152:0/1897452225 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a2006dc60 0x7f7a200d0360 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7a200b41a0 tx=0x7f7a0801c480 comp rx=0 tx=0).stop 2024-04-17T08:47:20.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.577+0000 7f7a24a00640 1 -- 172.21.15.152:0/1897452225 shutdown_connections 2024-04-17T08:47:20.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.577+0000 7f7a24a00640 1 --2- 172.21.15.152:0/1897452225 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a2006dc60 0x7f7a200d0360 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:20.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.577+0000 7f7a24a00640 1 --2- 172.21.15.152:0/1897452225 >> v2:172.21.15.196:3300/0 conn(0x7f7a20162900 0x7f7a20072610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:20.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.577+0000 7f7a24a00640 1 -- 172.21.15.152:0/1897452225 >> 172.21.15.152:0/1897452225 conn(0x7f7a200b3350 msgr2=0x7f7a200b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:20.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.577+0000 7f7a24a00640 1 -- 172.21.15.152:0/1897452225 shutdown_connections 2024-04-17T08:47:20.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.577+0000 7f7a24a00640 1 -- 172.21.15.152:0/1897452225 wait complete. 2024-04-17T08:47:20.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.577+0000 7f7a24a00640 1 Processor -- start 2024-04-17T08:47:20.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.577+0000 7f7a24a00640 1 -- start start 2024-04-17T08:47:20.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.581+0000 7f7a24a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7a2006f190 0x7f7a20157210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:20.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.581+0000 7f7a24a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a20162900 0x7f7a200b0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:20.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.581+0000 7f7a24a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7a201554c0 0x7f7a2015f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:20.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.581+0000 7f7a24a00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7a2016f760 con 0x7f7a20162900 2024-04-17T08:47:20.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.581+0000 7f7a24a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f7a2016f5e0 con 0x7f7a2006f190 2024-04-17T08:47:20.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.581+0000 7f7a24a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f7a2016f8e0 con 0x7f7a201554c0 2024-04-17T08:47:20.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.581+0000 7f7a15400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a20162900 0x7f7a200b0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:20.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.581+0000 7f7a15400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a20162900 0x7f7a200b0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56794/0 (socket says 172.21.15.152:56794) 2024-04-17T08:47:20.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.581+0000 7f7a15400640 1 -- 172.21.15.152:0/2764188876 learned_addr learned my addr 172.21.15.152:0/2764188876 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:20.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.581+0000 7f7a1de00640 1 --2- 172.21.15.152:0/2764188876 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7a2006f190 0x7f7a20157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:20.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.581+0000 7f7a1e800640 1 --2- 172.21.15.152:0/2764188876 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7a201554c0 0x7f7a2015f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:20.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.581+0000 7f7a15400640 1 -- 172.21.15.152:0/2764188876 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7a201554c0 msgr2=0x7f7a2015f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:20.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.581+0000 7f7a15400640 1 --2- 172.21.15.152:0/2764188876 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7a201554c0 0x7f7a2015f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:20.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.581+0000 7f7a15400640 1 -- 172.21.15.152:0/2764188876 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7a2006f190 msgr2=0x7f7a20157210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:20.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.581+0000 7f7a15400640 1 --2- 172.21.15.152:0/2764188876 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7a2006f190 0x7f7a20157210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:20.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.581+0000 7f7a15400640 1 -- 172.21.15.152:0/2764188876 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a200b0dd0 con 0x7f7a20162900 2024-04-17T08:47:20.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.581+0000 7f7a1de00640 1 --2- 172.21.15.152:0/2764188876 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7a2006f190 0x7f7a20157210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:20.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.581+0000 7f7a15400640 1 --2- 172.21.15.152:0/2764188876 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a20162900 0x7f7a200b0680 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7a0801ab30 tx=0x7f7a08019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:20.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.581+0000 7f7a16a00640 1 -- 172.21.15.152:0/2764188876 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a080b1040 con 0x7f7a20162900 2024-04-17T08:47:20.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.581+0000 7f7a16a00640 1 -- 172.21.15.152:0/2764188876 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a080bb070 con 0x7f7a20162900 2024-04-17T08:47:20.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.581+0000 7f7a16a00640 1 -- 172.21.15.152:0/2764188876 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a08006e20 con 0x7f7a20162900 2024-04-17T08:47:20.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.581+0000 7f7a24a00640 1 -- 172.21.15.152:0/2764188876 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a200b10b0 con 0x7f7a20162900 2024-04-17T08:47:20.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.581+0000 7f7a24a00640 1 -- 172.21.15.152:0/2764188876 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a200b1670 con 0x7f7a20162900 2024-04-17T08:47:20.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.581+0000 7f7a24a00640 1 -- 172.21.15.152:0/2764188876 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a20163100 con 0x7f7a20162900 2024-04-17T08:47:20.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.581+0000 7f7a16a00640 1 -- 172.21.15.152:0/2764188876 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7a080b5630 con 0x7f7a20162900 2024-04-17T08:47:20.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.585+0000 7f7a16a00640 1 --2- 172.21.15.152:0/2764188876 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f79fc0683b0 0x7f79fc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:20.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.585+0000 7f7a16a00640 1 -- 172.21.15.152:0/2764188876 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f7a08120a80 con 0x7f7a20162900 2024-04-17T08:47:20.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.585+0000 7f7a1de00640 1 --2- 172.21.15.152:0/2764188876 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f79fc0683b0 0x7f79fc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:20.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.585+0000 7f7a1de00640 1 --2- 172.21.15.152:0/2764188876 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f79fc0683b0 0x7f79fc06a870 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7a10003fd0 tx=0x7f7a100039e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:20.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.589+0000 7f7a16a00640 1 -- 172.21.15.152:0/2764188876 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f7a08122e20 con 0x7f7a20162900 2024-04-17T08:47:20.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.741+0000 7f7a24a00640 1 -- 172.21.15.152:0/2764188876 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7a20068a30 con 0x7f7a20162900 2024-04-17T08:47:20.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.745+0000 7f7a16a00640 1 -- 172.21.15.152:0/2764188876 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f7a080a9070 con 0x7f7a20162900 2024-04-17T08:47:20.746 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2024-04-17T08:47:20.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.745+0000 7f7a24a00640 1 -- 172.21.15.152:0/2764188876 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f79fc0683b0 msgr2=0x7f79fc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:20.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.745+0000 7f7a24a00640 1 --2- 172.21.15.152:0/2764188876 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f79fc0683b0 0x7f79fc06a870 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7a10003fd0 tx=0x7f7a100039e0 comp rx=0 tx=0).stop 2024-04-17T08:47:20.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.745+0000 7f7a24a00640 1 -- 172.21.15.152:0/2764188876 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a20162900 msgr2=0x7f7a200b0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:20.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.745+0000 7f7a24a00640 1 --2- 172.21.15.152:0/2764188876 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a20162900 0x7f7a200b0680 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7a0801ab30 tx=0x7f7a08019220 comp rx=0 tx=0).stop 2024-04-17T08:47:20.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.745+0000 7f7a24a00640 1 -- 172.21.15.152:0/2764188876 shutdown_connections 2024-04-17T08:47:20.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.745+0000 7f7a24a00640 1 --2- 172.21.15.152:0/2764188876 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f79fc0683b0 0x7f79fc06a870 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:20.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.745+0000 7f7a24a00640 1 --2- 172.21.15.152:0/2764188876 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7a201554c0 0x7f7a2015f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:20.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.745+0000 7f7a24a00640 1 --2- 172.21.15.152:0/2764188876 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a20162900 0x7f7a200b0680 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:20.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.745+0000 7f7a24a00640 1 --2- 172.21.15.152:0/2764188876 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7a2006f190 0x7f7a20157210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:20.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.745+0000 7f7a24a00640 1 -- 172.21.15.152:0/2764188876 >> 172.21.15.152:0/2764188876 conn(0x7f7a200b3350 msgr2=0x7f7a2015d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:20.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.745+0000 7f7a24a00640 1 -- 172.21.15.152:0/2764188876 shutdown_connections 2024-04-17T08:47:20.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.745+0000 7f7a24a00640 1 -- 172.21.15.152:0/2764188876 wait complete. 2024-04-17T08:47:20.767 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-17T08:47:20.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.901+0000 7f93e4a00640 1 Processor -- start 2024-04-17T08:47:20.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.905+0000 7f93e4a00640 1 -- start start 2024-04-17T08:47:20.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.905+0000 7f93e4a00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f93e00d0a70 0x7f93e0160010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:20.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.905+0000 7f93e4a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93e015d710 0x7f93e0160550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:20.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.905+0000 7f93e4a00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93e0160a90 con 0x7f93e015a010 2024-04-17T08:47:20.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.905+0000 7f93e4a00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f93e015d280 con 0x7f93e00d0a70 2024-04-17T08:47:20.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.905+0000 7f93e4a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f93e015c9d0 con 0x7f93e015d710 2024-04-17T08:47:20.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.905+0000 7f93d5400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f93e00d0a70 0x7f93e0160010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:20.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.905+0000 7f93d5400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f93e00d0a70 0x7f93e0160010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56808/0 (socket says 172.21.15.152:56808) 2024-04-17T08:47:20.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.905+0000 7f93d5400640 1 -- 172.21.15.152:0/254200513 learned_addr learned my addr 172.21.15.152:0/254200513 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:20.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.905+0000 7f93dde00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f93e015a010 0x7f93e00d0360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:52342/0 (socket says 172.21.15.152:52342) 2024-04-17T08:47:20.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.905+0000 7f93de800640 1 --2- 172.21.15.152:0/254200513 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93e015d710 0x7f93e0160550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:20.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.905+0000 7f93d5400640 1 -- 172.21.15.152:0/254200513 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93e015d710 msgr2=0x7f93e0160550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:20.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.905+0000 7f93d5400640 1 --2- 172.21.15.152:0/254200513 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93e015d710 0x7f93e0160550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:20.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.905+0000 7f93d5400640 1 -- 172.21.15.152:0/254200513 >> v1:172.21.15.152:6789/0 conn(0x7f93e015a010 legacy=0x7f93e00d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:20.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.905+0000 7f93d5400640 1 -- 172.21.15.152:0/254200513 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93e0160d20 con 0x7f93e00d0a70 2024-04-17T08:47:20.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.905+0000 7f93dd400640 1 -- 172.21.15.152:0/254200513 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 974002649 0 0) 0x7f93e0160a90 con 0x7f93e015a010 2024-04-17T08:47:20.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.909+0000 7f93d5400640 1 --2- 172.21.15.152:0/254200513 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93e00d0a70 0x7f93e0160010 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f93e015d400 tx=0x7f93c801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=673ca9466229725f server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:20.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.909+0000 7f93dd400640 1 -- 172.21.15.152:0/254200513 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c80b1070 con 0x7f93e00d0a70 2024-04-17T08:47:20.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.909+0000 7f93dd400640 1 -- 172.21.15.152:0/254200513 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93c80ac600 con 0x7f93e00d0a70 2024-04-17T08:47:20.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.909+0000 7f93dd400640 1 -- 172.21.15.152:0/254200513 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c80ac9d0 con 0x7f93e00d0a70 2024-04-17T08:47:20.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.909+0000 7f93e4a00640 1 -- 172.21.15.152:0/254200513 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93e00d0a70 msgr2=0x7f93e0160010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:20.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.909+0000 7f93e4a00640 1 --2- 172.21.15.152:0/254200513 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93e00d0a70 0x7f93e0160010 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f93e015d400 tx=0x7f93c801c4b0 comp rx=0 tx=0).stop 2024-04-17T08:47:20.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.909+0000 7f93e4a00640 1 -- 172.21.15.152:0/254200513 shutdown_connections 2024-04-17T08:47:20.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.909+0000 7f93e4a00640 1 --2- 172.21.15.152:0/254200513 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93e015d710 0x7f93e0160550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:20.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.909+0000 7f93e4a00640 1 --2- 172.21.15.152:0/254200513 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93e00d0a70 0x7f93e0160010 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:20.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.909+0000 7f93e4a00640 1 -- 172.21.15.152:0/254200513 >> 172.21.15.152:0/254200513 conn(0x7f93e00b3350 msgr2=0x7f93e00b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:20.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.909+0000 7f93e4a00640 1 -- 172.21.15.152:0/254200513 shutdown_connections 2024-04-17T08:47:20.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.909+0000 7f93e4a00640 1 -- 172.21.15.152:0/254200513 wait complete. 2024-04-17T08:47:20.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.909+0000 7f93e4a00640 1 Processor -- start 2024-04-17T08:47:20.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.909+0000 7f93e4a00640 1 -- start start 2024-04-17T08:47:20.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.913+0000 7f93e4a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f93e00d0a70 0x7f93e015b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:20.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.913+0000 7f93e4a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93e015a010 0x7f93e006e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:20.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.913+0000 7f93e4a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93e015d710 0x7f93e0099060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:20.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.913+0000 7f93e4a00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f93e015e570 con 0x7f93e015d710 2024-04-17T08:47:20.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.913+0000 7f93e4a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f93e015e3f0 con 0x7f93e00d0a70 2024-04-17T08:47:20.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.913+0000 7f93e4a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f93e015e6f0 con 0x7f93e015a010 2024-04-17T08:47:20.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.913+0000 7f93de800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93e015d710 0x7f93e0099060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:20.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.913+0000 7f93de800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93e015d710 0x7f93e0099060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56812/0 (socket says 172.21.15.152:56812) 2024-04-17T08:47:20.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.913+0000 7f93de800640 1 -- 172.21.15.152:0/2086182682 learned_addr learned my addr 172.21.15.152:0/2086182682 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:20.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.913+0000 7f93dde00640 1 --2- 172.21.15.152:0/2086182682 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f93e00d0a70 0x7f93e015b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:20.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.913+0000 7f93d5400640 1 --2- 172.21.15.152:0/2086182682 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93e015a010 0x7f93e006e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:20.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.913+0000 7f93de800640 1 -- 172.21.15.152:0/2086182682 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93e015a010 msgr2=0x7f93e006e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:20.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.913+0000 7f93de800640 1 --2- 172.21.15.152:0/2086182682 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93e015a010 0x7f93e006e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:20.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.913+0000 7f93de800640 1 -- 172.21.15.152:0/2086182682 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f93e00d0a70 msgr2=0x7f93e015b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:20.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.913+0000 7f93de800640 1 --2- 172.21.15.152:0/2086182682 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f93e00d0a70 0x7f93e015b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:20.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.913+0000 7f93de800640 1 -- 172.21.15.152:0/2086182682 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93e015b980 con 0x7f93e015d710 2024-04-17T08:47:20.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.913+0000 7f93d5400640 1 --2- 172.21.15.152:0/2086182682 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93e015a010 0x7f93e006e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:20.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.913+0000 7f93de800640 1 --2- 172.21.15.152:0/2086182682 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93e015d710 0x7f93e0099060 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f93d8007e60 tx=0x7f93d800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:20.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.913+0000 7f93d6a00640 1 -- 172.21.15.152:0/2086182682 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d8014420 con 0x7f93e015d710 2024-04-17T08:47:20.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.913+0000 7f93d6a00640 1 -- 172.21.15.152:0/2086182682 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93d8019070 con 0x7f93e015d710 2024-04-17T08:47:20.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.913+0000 7f93d6a00640 1 -- 172.21.15.152:0/2086182682 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d8014820 con 0x7f93e015d710 2024-04-17T08:47:20.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.913+0000 7f93e4a00640 1 -- 172.21.15.152:0/2086182682 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93e015bfc0 con 0x7f93e015d710 2024-04-17T08:47:20.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.913+0000 7f93e4a00640 1 -- 172.21.15.152:0/2086182682 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93e006de00 con 0x7f93e015d710 2024-04-17T08:47:20.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.913+0000 7f93e4a00640 1 -- 172.21.15.152:0/2086182682 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93e0068a30 con 0x7f93e015d710 2024-04-17T08:47:20.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.913+0000 7f93d6a00640 1 -- 172.21.15.152:0/2086182682 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f93d80149c0 con 0x7f93e015d710 2024-04-17T08:47:20.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.917+0000 7f93d6a00640 1 --2- 172.21.15.152:0/2086182682 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f93bc068380 0x7f93bc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:20.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.917+0000 7f93d6a00640 1 -- 172.21.15.152:0/2086182682 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f93d8087610 con 0x7f93e015d710 2024-04-17T08:47:20.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.917+0000 7f93dde00640 1 --2- 172.21.15.152:0/2086182682 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f93bc068380 0x7f93bc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:20.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.917+0000 7f93dde00640 1 --2- 172.21.15.152:0/2086182682 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f93bc068380 0x7f93bc06a840 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f93d0007fd0 tx=0x7f93d0007d60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:20.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:20.921+0000 7f93d6a00640 1 -- 172.21.15.152:0/2086182682 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f93d8057710 con 0x7f93e015d710 2024-04-17T08:47:21.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.077+0000 7f93e4a00640 1 -- 172.21.15.152:0/2086182682 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f93e01655f0 con 0x7f93e015d710 2024-04-17T08:47:21.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.077+0000 7f93d6a00640 1 -- 172.21.15.152:0/2086182682 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f93d8057010 con 0x7f93e015d710 2024-04-17T08:47:21.079 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-04-17T08:47:21.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.077+0000 7f93e4a00640 1 -- 172.21.15.152:0/2086182682 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f93bc068380 msgr2=0x7f93bc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:21.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.077+0000 7f93e4a00640 1 --2- 172.21.15.152:0/2086182682 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f93bc068380 0x7f93bc06a840 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f93d0007fd0 tx=0x7f93d0007d60 comp rx=0 tx=0).stop 2024-04-17T08:47:21.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.077+0000 7f93e4a00640 1 -- 172.21.15.152:0/2086182682 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93e015d710 msgr2=0x7f93e0099060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:21.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.077+0000 7f93e4a00640 1 --2- 172.21.15.152:0/2086182682 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93e015d710 0x7f93e0099060 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f93d8007e60 tx=0x7f93d800e4b0 comp rx=0 tx=0).stop 2024-04-17T08:47:21.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.077+0000 7f93e4a00640 1 -- 172.21.15.152:0/2086182682 shutdown_connections 2024-04-17T08:47:21.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.077+0000 7f93e4a00640 1 --2- 172.21.15.152:0/2086182682 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93e015d710 0x7f93e0099060 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:21.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.077+0000 7f93e4a00640 1 --2- 172.21.15.152:0/2086182682 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f93bc068380 0x7f93bc06a840 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:21.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.077+0000 7f93e4a00640 1 --2- 172.21.15.152:0/2086182682 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93e015a010 0x7f93e006e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:21.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.077+0000 7f93e4a00640 1 --2- 172.21.15.152:0/2086182682 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f93e00d0a70 0x7f93e015b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:21.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.077+0000 7f93e4a00640 1 -- 172.21.15.152:0/2086182682 >> 172.21.15.152:0/2086182682 conn(0x7f93e00b3350 msgr2=0x7f93e0165e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:21.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.077+0000 7f93e4a00640 1 -- 172.21.15.152:0/2086182682 shutdown_connections 2024-04-17T08:47:21.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.077+0000 7f93e4a00640 1 -- 172.21.15.152:0/2086182682 wait complete. 2024-04-17T08:47:21.100 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-17T08:47:21.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.237+0000 7f0ca9000640 1 Processor -- start 2024-04-17T08:47:21.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.237+0000 7f0ca9000640 1 -- start start 2024-04-17T08:47:21.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.237+0000 7f0ca9000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ca415e710 0x7f0ca4162b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:21.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.237+0000 7f0ca9000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0ca406be80 0x7f0ca406c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:21.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.237+0000 7f0ca9000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ca4163050 con 0x7f0ca40b3820 2024-04-17T08:47:21.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.237+0000 7f0ca9000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f0ca415faa0 con 0x7f0ca406be80 2024-04-17T08:47:21.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.237+0000 7f0ca9000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f0ca406c800 con 0x7f0ca415e710 2024-04-17T08:47:21.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.237+0000 7f0ca3e00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f0ca40b3820 0x7f0ca40b3cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.152:34466/0 (socket says 172.21.15.152:34466) 2024-04-17T08:47:21.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.237+0000 7f0ca3e00640 1 -- 172.21.15.152:0/3926057195 learned_addr learned my addr 172.21.15.152:0/3926057195 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:21.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.237+0000 7f0ca3400640 1 --2- 172.21.15.152:0/3926057195 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ca415e710 0x7f0ca4162b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:21.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.237+0000 7f0ca2a00640 1 --2- 172.21.15.152:0/3926057195 >> v2:172.21.15.196:3300/0 conn(0x7f0ca406be80 0x7f0ca406c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:21.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.237+0000 7f0ca3400640 1 -- 172.21.15.152:0/3926057195 >> v2:172.21.15.196:3300/0 conn(0x7f0ca406be80 msgr2=0x7f0ca406c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:21.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.237+0000 7f0ca3400640 1 --2- 172.21.15.152:0/3926057195 >> v2:172.21.15.196:3300/0 conn(0x7f0ca406be80 0x7f0ca406c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:21.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.237+0000 7f0ca3400640 1 -- 172.21.15.152:0/3926057195 >> v1:172.21.15.196:6789/0 conn(0x7f0ca40b3820 legacy=0x7f0ca40b3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:21.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.237+0000 7f0ca3400640 1 -- 172.21.15.152:0/3926057195 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ca415ef20 con 0x7f0ca415e710 2024-04-17T08:47:21.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.237+0000 7f0ca2a00640 1 --2- 172.21.15.152:0/3926057195 >> v2:172.21.15.196:3300/0 conn(0x7f0ca406be80 0x7f0ca406c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T08:47:21.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.241+0000 7f0ca3400640 1 --2- 172.21.15.152:0/3926057195 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ca415e710 0x7f0ca4162b10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0c940097c0 tx=0x7f0c9401c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e99f88172ac4dd6c server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:21.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.241+0000 7f0ca2000640 1 -- 172.21.15.152:0/3926057195 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c940a7070 con 0x7f0ca415e710 2024-04-17T08:47:21.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.241+0000 7f0ca2000640 1 -- 172.21.15.152:0/3926057195 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c940b0070 con 0x7f0ca415e710 2024-04-17T08:47:21.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.241+0000 7f0ca2000640 1 -- 172.21.15.152:0/3926057195 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c940ab890 con 0x7f0ca415e710 2024-04-17T08:47:21.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.241+0000 7f0ca9000640 1 -- 172.21.15.152:0/3926057195 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ca415e710 msgr2=0x7f0ca4162b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:21.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.241+0000 7f0ca9000640 1 --2- 172.21.15.152:0/3926057195 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ca415e710 0x7f0ca4162b10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0c940097c0 tx=0x7f0c9401c470 comp rx=0 tx=0).stop 2024-04-17T08:47:21.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.241+0000 7f0ca9000640 1 -- 172.21.15.152:0/3926057195 shutdown_connections 2024-04-17T08:47:21.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.241+0000 7f0ca9000640 1 --2- 172.21.15.152:0/3926057195 >> v2:172.21.15.196:3300/0 conn(0x7f0ca406be80 0x7f0ca406c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:21.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.241+0000 7f0ca9000640 1 --2- 172.21.15.152:0/3926057195 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ca415e710 0x7f0ca4162b10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:21.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.241+0000 7f0ca9000640 1 -- 172.21.15.152:0/3926057195 >> 172.21.15.152:0/3926057195 conn(0x7f0ca40d0890 msgr2=0x7f0ca40d0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:21.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.241+0000 7f0ca9000640 1 -- 172.21.15.152:0/3926057195 shutdown_connections 2024-04-17T08:47:21.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.241+0000 7f0ca9000640 1 -- 172.21.15.152:0/3926057195 wait complete. 2024-04-17T08:47:21.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.245+0000 7f0ca9000640 1 Processor -- start 2024-04-17T08:47:21.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.245+0000 7f0ca9000640 1 -- start start 2024-04-17T08:47:21.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.245+0000 7f0ca9000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0ca406be80 0x7f0ca4159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:21.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.245+0000 7f0ca9000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ca40b3820 0x7f0ca4151400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:21.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.245+0000 7f0ca9000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ca415e710 0x7f0ca4151940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:21.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.245+0000 7f0ca9000640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca415eaf0 con 0x7f0ca40b3820 2024-04-17T08:47:21.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.245+0000 7f0ca9000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca406cc60 con 0x7f0ca406be80 2024-04-17T08:47:21.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.245+0000 7f0ca9000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f0ca415ec70 con 0x7f0ca415e710 2024-04-17T08:47:21.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.245+0000 7f0ca2a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ca40b3820 0x7f0ca4151400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:21.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.245+0000 7f0ca2a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ca40b3820 0x7f0ca4151400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56826/0 (socket says 172.21.15.152:56826) 2024-04-17T08:47:21.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.245+0000 7f0ca2a00640 1 -- 172.21.15.152:0/3162051250 learned_addr learned my addr 172.21.15.152:0/3162051250 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:21.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.245+0000 7f0ca3400640 1 --2- 172.21.15.152:0/3162051250 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0ca406be80 0x7f0ca4159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:21.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.245+0000 7f0ca3e00640 1 --2- 172.21.15.152:0/3162051250 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ca415e710 0x7f0ca4151940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:21.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.245+0000 7f0ca2a00640 1 -- 172.21.15.152:0/3162051250 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ca415e710 msgr2=0x7f0ca4151940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:21.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.245+0000 7f0ca2a00640 1 --2- 172.21.15.152:0/3162051250 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ca415e710 0x7f0ca4151940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:21.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.245+0000 7f0ca2a00640 1 -- 172.21.15.152:0/3162051250 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0ca406be80 msgr2=0x7f0ca4159ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:21.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.245+0000 7f0ca2a00640 1 --2- 172.21.15.152:0/3162051250 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0ca406be80 0x7f0ca4159ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:21.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.245+0000 7f0ca2a00640 1 -- 172.21.15.152:0/3162051250 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ca415b520 con 0x7f0ca40b3820 2024-04-17T08:47:21.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.245+0000 7f0ca3400640 1 --2- 172.21.15.152:0/3162051250 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0ca406be80 0x7f0ca4159ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:21.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.245+0000 7f0ca2a00640 1 --2- 172.21.15.152:0/3162051250 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ca40b3820 0x7f0ca4151400 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0c9000e990 tx=0x7f0c9000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:21.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.245+0000 7f0c9b400640 1 -- 172.21.15.152:0/3162051250 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c900059a0 con 0x7f0ca40b3820 2024-04-17T08:47:21.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.245+0000 7f0c9b400640 1 -- 172.21.15.152:0/3162051250 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c90005b40 con 0x7f0ca40b3820 2024-04-17T08:47:21.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.245+0000 7f0c9b400640 1 -- 172.21.15.152:0/3162051250 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c9000c9e0 con 0x7f0ca40b3820 2024-04-17T08:47:21.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.245+0000 7f0ca9000640 1 -- 172.21.15.152:0/3162051250 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ca4151e80 con 0x7f0ca40b3820 2024-04-17T08:47:21.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.245+0000 7f0ca9000640 1 -- 172.21.15.152:0/3162051250 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ca415bd80 con 0x7f0ca40b3820 2024-04-17T08:47:21.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.245+0000 7f0ca9000640 1 -- 172.21.15.152:0/3162051250 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ca4075be0 con 0x7f0ca40b3820 2024-04-17T08:47:21.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.249+0000 7f0c9b400640 1 -- 172.21.15.152:0/3162051250 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0c9000cb80 con 0x7f0ca40b3820 2024-04-17T08:47:21.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.249+0000 7f0c9b400640 1 --2- 172.21.15.152:0/3162051250 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0c84068380 0x7f0c8406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:21.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.249+0000 7f0c9b400640 1 -- 172.21.15.152:0/3162051250 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f0c900870c0 con 0x7f0ca40b3820 2024-04-17T08:47:21.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.249+0000 7f0ca3400640 1 --2- 172.21.15.152:0/3162051250 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0c84068380 0x7f0c8406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:21.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.249+0000 7f0ca3400640 1 --2- 172.21.15.152:0/3162051250 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0c84068380 0x7f0c8406a840 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0c940af000 tx=0x7f0c940a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:21.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.253+0000 7f0c9b400640 1 -- 172.21.15.152:0/3162051250 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f0c90017020 con 0x7f0ca40b3820 2024-04-17T08:47:21.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.413+0000 7f0ca9000640 1 -- 172.21.15.152:0/3162051250 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f0ca40d17a0 con 0x7f0ca40b3820 2024-04-17T08:47:21.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.413+0000 7f0c9b400640 1 -- 172.21.15.152:0/3162051250 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f0c900572f0 con 0x7f0ca40b3820 2024-04-17T08:47:21.416 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 64 2024-04-17T08:47:21.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.417+0000 7f0ca9000640 1 -- 172.21.15.152:0/3162051250 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0c84068380 msgr2=0x7f0c8406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:21.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.417+0000 7f0ca9000640 1 --2- 172.21.15.152:0/3162051250 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0c84068380 0x7f0c8406a840 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0c940af000 tx=0x7f0c940a7000 comp rx=0 tx=0).stop 2024-04-17T08:47:21.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.417+0000 7f0ca9000640 1 -- 172.21.15.152:0/3162051250 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ca40b3820 msgr2=0x7f0ca4151400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:21.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.417+0000 7f0ca9000640 1 --2- 172.21.15.152:0/3162051250 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ca40b3820 0x7f0ca4151400 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0c9000e990 tx=0x7f0c9000ee50 comp rx=0 tx=0).stop 2024-04-17T08:47:21.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.417+0000 7f0ca9000640 1 -- 172.21.15.152:0/3162051250 shutdown_connections 2024-04-17T08:47:21.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.417+0000 7f0ca9000640 1 --2- 172.21.15.152:0/3162051250 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0c84068380 0x7f0c8406a840 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:21.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.417+0000 7f0ca9000640 1 --2- 172.21.15.152:0/3162051250 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ca415e710 0x7f0ca4151940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:21.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.417+0000 7f0ca9000640 1 --2- 172.21.15.152:0/3162051250 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ca40b3820 0x7f0ca4151400 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:21.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.417+0000 7f0ca9000640 1 --2- 172.21.15.152:0/3162051250 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0ca406be80 0x7f0ca4159ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:21.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.417+0000 7f0ca9000640 1 -- 172.21.15.152:0/3162051250 >> 172.21.15.152:0/3162051250 conn(0x7f0ca40d0890 msgr2=0x7f0ca4162130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:21.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.417+0000 7f0ca9000640 1 -- 172.21.15.152:0/3162051250 shutdown_connections 2024-04-17T08:47:21.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.417+0000 7f0ca9000640 1 -- 172.21.15.152:0/3162051250 wait complete. 2024-04-17T08:47:21.437 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-17T08:47:21.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.573+0000 7f157d000640 1 Processor -- start 2024-04-17T08:47:21.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.573+0000 7f157d000640 1 -- start start 2024-04-17T08:47:21.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.573+0000 7f157d000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f15780af670 0x7f157815b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:21.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.573+0000 7f157d000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f15780d0360 0x7f15780d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:21.578 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.573+0000 7f157d000640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1578072c40 con 0x7f157806f980 2024-04-17T08:47:21.578 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.573+0000 7f157d000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f157815c820 con 0x7f15780d0360 2024-04-17T08:47:21.578 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.573+0000 7f157d000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f157815c260 con 0x7f15780af670 2024-04-17T08:47:21.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.577+0000 7f156d400640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f157806f980 0x7f1578072530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:52346/0 (socket says 172.21.15.152:52346) 2024-04-17T08:47:21.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.577+0000 7f156d400640 1 -- 172.21.15.152:0/2853104094 learned_addr learned my addr 172.21.15.152:0/2853104094 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:21.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.577+0000 7f1575400640 1 -- 172.21.15.152:0/2853104094 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3996187287 0 0) 0x7f1578072c40 con 0x7f157806f980 2024-04-17T08:47:21.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.577+0000 7f1576800640 1 --2- 172.21.15.152:0/2853104094 >> v2:172.21.15.196:3300/0 conn(0x7f15780d0360 0x7f15780d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:21.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.577+0000 7f1575e00640 1 --2- 172.21.15.152:0/2853104094 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f15780af670 0x7f157815b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:21.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.577+0000 7f1575400640 1 -- 172.21.15.152:0/2853104094 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f155c003530 con 0x7f157806f980 2024-04-17T08:47:21.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.577+0000 7f1575400640 1 -- 172.21.15.152:0/2853104094 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 83383853 0 0) 0x7f155c003530 con 0x7f157806f980 2024-04-17T08:47:21.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.577+0000 7f1575400640 1 -- 172.21.15.152:0/2853104094 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f15780af670 msgr2=0x7f157815b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:21.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.577+0000 7f1575400640 1 --2- 172.21.15.152:0/2853104094 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f15780af670 0x7f157815b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:21.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.577+0000 7f1575400640 1 -- 172.21.15.152:0/2853104094 >> v2:172.21.15.196:3300/0 conn(0x7f15780d0360 msgr2=0x7f15780d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:21.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.577+0000 7f1575400640 1 --2- 172.21.15.152:0/2853104094 >> v2:172.21.15.196:3300/0 conn(0x7f15780d0360 0x7f15780d07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:21.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.577+0000 7f1575400640 1 -- 172.21.15.152:0/2853104094 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f157815c540 con 0x7f157806f980 2024-04-17T08:47:21.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.577+0000 7f1575400640 1 -- 172.21.15.152:0/2853104094 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2973887244 0 0) 0x7f1560001680 con 0x7f157806f980 2024-04-17T08:47:21.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.577+0000 7f1575400640 1 -- 172.21.15.152:0/2853104094 >> v1:172.21.15.152:6789/0 conn(0x7f157806f980 legacy=0x7f1578072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:21.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.577+0000 7f1575400640 1 --2- 172.21.15.152:0/2853104094 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f155c0039c0 0x7f155c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:21.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.577+0000 7f1575400640 1 --2- 172.21.15.152:0/2853104094 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f155c004810 0x7f155c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:21.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.577+0000 7f1575400640 1 --2- 172.21.15.152:0/2853104094 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f15780af670 0x7f155c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:21.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.577+0000 7f1575400640 1 -- 172.21.15.152:0/2853104094 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f157815c820 con 0x7f155c0039c0 2024-04-17T08:47:21.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.577+0000 7f1575400640 1 -- 172.21.15.152:0/2853104094 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f157815c260 con 0x7f155c004810 2024-04-17T08:47:21.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.577+0000 7f1575400640 1 -- 172.21.15.152:0/2853104094 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f155c00ba20 con 0x7f15780af670 2024-04-17T08:47:21.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.577+0000 7f1575e00640 1 --2- 172.21.15.152:0/2853104094 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f155c0039c0 0x7f155c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:21.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.577+0000 7f156d400640 1 --2- 172.21.15.152:0/2853104094 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f155c004810 0x7f155c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:21.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.577+0000 7f1576800640 1 --2- 172.21.15.152:0/2853104094 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f15780af670 0x7f155c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:21.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.577+0000 7f1575e00640 1 -- 172.21.15.152:0/2853104094 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f15780af670 msgr2=0x7f155c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:21.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.577+0000 7f1575e00640 1 --2- 172.21.15.152:0/2853104094 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f15780af670 0x7f155c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:21.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.577+0000 7f1575e00640 1 -- 172.21.15.152:0/2853104094 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f155c004810 msgr2=0x7f155c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:21.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.577+0000 7f1575e00640 1 --2- 172.21.15.152:0/2853104094 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f155c004810 0x7f155c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:21.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.577+0000 7f1575e00640 1 -- 172.21.15.152:0/2853104094 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f155c003530 con 0x7f155c0039c0 2024-04-17T08:47:21.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.581+0000 7f1575e00640 1 --2- 172.21.15.152:0/2853104094 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f155c0039c0 0x7f155c003de0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1568009b10 tx=0x7f156801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d47e4e060e7bc24 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:21.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.581+0000 7f1575400640 1 -- 172.21.15.152:0/2853104094 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15680096b0 con 0x7f155c0039c0 2024-04-17T08:47:21.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.581+0000 7f1575400640 1 -- 172.21.15.152:0/2853104094 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15680a9460 con 0x7f155c0039c0 2024-04-17T08:47:21.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.581+0000 7f1575400640 1 -- 172.21.15.152:0/2853104094 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15680a9850 con 0x7f155c0039c0 2024-04-17T08:47:21.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.581+0000 7f157d000640 1 -- 172.21.15.152:0/2853104094 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f155c0039c0 msgr2=0x7f155c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:21.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.581+0000 7f157d000640 1 --2- 172.21.15.152:0/2853104094 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f155c0039c0 0x7f155c003de0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1568009b10 tx=0x7f156801ca70 comp rx=0 tx=0).stop 2024-04-17T08:47:21.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.581+0000 7f1576800640 1 -- 172.21.15.152:0/2853104094 reap_dead start 2024-04-17T08:47:21.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.581+0000 7f157d000640 1 -- 172.21.15.152:0/2853104094 shutdown_connections 2024-04-17T08:47:21.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.581+0000 7f157d000640 1 -- 172.21.15.152:0/2853104094 >> 172.21.15.152:0/2853104094 conn(0x7f15780b3350 msgr2=0x7f15780b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:21.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.581+0000 7f157d000640 1 -- 172.21.15.152:0/2853104094 shutdown_connections 2024-04-17T08:47:21.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.581+0000 7f157d000640 1 -- 172.21.15.152:0/2853104094 wait complete. 2024-04-17T08:47:21.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.581+0000 7f157d000640 1 Processor -- start 2024-04-17T08:47:21.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.581+0000 7f157d000640 1 -- start start 2024-04-17T08:47:21.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.585+0000 7f157d000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1578157e50 0x7f157814d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:21.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.585+0000 7f157d000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1578158230 0x7f157814a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:21.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.585+0000 7f157d000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f157814a840 0x7f157814afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:21.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.585+0000 7f157d000640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f157806dde0 con 0x7f157814a840 2024-04-17T08:47:21.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.585+0000 7f157d000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f157806dc60 con 0x7f1578157e50 2024-04-17T08:47:21.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.585+0000 7f157d000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f157806df60 con 0x7f1578158230 2024-04-17T08:47:21.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.585+0000 7f1576800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f157814a840 0x7f157814afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:21.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.585+0000 7f1576800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f157814a840 0x7f157814afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56844/0 (socket says 172.21.15.152:56844) 2024-04-17T08:47:21.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.585+0000 7f1576800640 1 -- 172.21.15.152:0/291144032 learned_addr learned my addr 172.21.15.152:0/291144032 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:21.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.585+0000 7f1575e00640 1 --2- 172.21.15.152:0/291144032 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1578157e50 0x7f157814d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:21.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.585+0000 7f156d400640 1 --2- 172.21.15.152:0/291144032 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1578158230 0x7f157814a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:21.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.585+0000 7f1576800640 1 -- 172.21.15.152:0/291144032 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1578158230 msgr2=0x7f157814a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:21.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.585+0000 7f1576800640 1 --2- 172.21.15.152:0/291144032 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1578158230 0x7f157814a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:21.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.585+0000 7f1576800640 1 -- 172.21.15.152:0/291144032 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1578157e50 msgr2=0x7f157814d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:21.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.585+0000 7f1576800640 1 --2- 172.21.15.152:0/291144032 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1578157e50 0x7f157814d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:21.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.585+0000 7f1576800640 1 -- 172.21.15.152:0/291144032 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f157814dc70 con 0x7f157814a840 2024-04-17T08:47:21.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.585+0000 7f1576800640 1 --2- 172.21.15.152:0/291144032 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f157814a840 0x7f157814afb0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f15780d10a0 tx=0x7f157000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:21.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.585+0000 7f156ea00640 1 -- 172.21.15.152:0/291144032 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f157000fde0 con 0x7f157814a840 2024-04-17T08:47:21.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.585+0000 7f156ea00640 1 -- 172.21.15.152:0/291144032 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f157001d070 con 0x7f157814a840 2024-04-17T08:47:21.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.585+0000 7f156ea00640 1 -- 172.21.15.152:0/291144032 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1570015670 con 0x7f157814a840 2024-04-17T08:47:21.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.585+0000 7f157d000640 1 -- 172.21.15.152:0/291144032 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f157814bd20 con 0x7f157814a840 2024-04-17T08:47:21.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.585+0000 7f157d000640 1 -- 172.21.15.152:0/291144032 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f157814cc50 con 0x7f157814a840 2024-04-17T08:47:21.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.585+0000 7f157d000640 1 -- 172.21.15.152:0/291144032 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1578068a30 con 0x7f157814a840 2024-04-17T08:47:21.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.585+0000 7f156ea00640 1 -- 172.21.15.152:0/291144032 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1570015810 con 0x7f157814a840 2024-04-17T08:47:21.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.589+0000 7f156ea00640 1 --2- 172.21.15.152:0/291144032 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1554068350 0x7f155406a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:21.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.589+0000 7f156ea00640 1 -- 172.21.15.152:0/291144032 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f1570087620 con 0x7f157814a840 2024-04-17T08:47:21.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.589+0000 7f1575e00640 1 --2- 172.21.15.152:0/291144032 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1554068350 0x7f155406a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:21.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.589+0000 7f1575e00640 1 --2- 172.21.15.152:0/291144032 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1554068350 0x7f155406a810 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f15680ae000 tx=0x7f15680b3040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:21.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.593+0000 7f156ea00640 1 -- 172.21.15.152:0/291144032 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f1570010040 con 0x7f157814a840 2024-04-17T08:47:21.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.745+0000 7f157d000640 1 -- 172.21.15.152:0/291144032 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f157815dbd0 con 0x7f157814a840 2024-04-17T08:47:21.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.749+0000 7f156ea00640 1 -- 172.21.15.152:0/291144032 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f15700570d0 con 0x7f157814a840 2024-04-17T08:47:21.750 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-04-17T08:47:21.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.749+0000 7f157d000640 1 -- 172.21.15.152:0/291144032 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1554068350 msgr2=0x7f155406a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:21.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.749+0000 7f157d000640 1 --2- 172.21.15.152:0/291144032 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1554068350 0x7f155406a810 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f15680ae000 tx=0x7f15680b3040 comp rx=0 tx=0).stop 2024-04-17T08:47:21.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.749+0000 7f157d000640 1 -- 172.21.15.152:0/291144032 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f157814a840 msgr2=0x7f157814afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:21.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.749+0000 7f157d000640 1 --2- 172.21.15.152:0/291144032 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f157814a840 0x7f157814afb0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f15780d10a0 tx=0x7f157000f580 comp rx=0 tx=0).stop 2024-04-17T08:47:21.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.749+0000 7f157d000640 1 -- 172.21.15.152:0/291144032 shutdown_connections 2024-04-17T08:47:21.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.749+0000 7f157d000640 1 --2- 172.21.15.152:0/291144032 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f157814a840 0x7f157814afb0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:21.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.749+0000 7f157d000640 1 --2- 172.21.15.152:0/291144032 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1554068350 0x7f155406a810 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:21.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.749+0000 7f157d000640 1 --2- 172.21.15.152:0/291144032 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1578158230 0x7f157814a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:21.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.749+0000 7f157d000640 1 --2- 172.21.15.152:0/291144032 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1578157e50 0x7f157814d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:21.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.749+0000 7f157d000640 1 -- 172.21.15.152:0/291144032 >> 172.21.15.152:0/291144032 conn(0x7f15780b3350 msgr2=0x7f157815f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:21.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.749+0000 7f157d000640 1 -- 172.21.15.152:0/291144032 shutdown_connections 2024-04-17T08:47:21.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.749+0000 7f157d000640 1 -- 172.21.15.152:0/291144032 wait complete. 2024-04-17T08:47:21.772 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T08:47:21.792 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T08:47:21.821 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T08:47:21.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.905+0000 7fa55c600640 1 Processor -- start 2024-04-17T08:47:21.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.905+0000 7fa55c600640 1 -- start start 2024-04-17T08:47:21.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.909+0000 7fa55c600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa55415a010 0x7fa5540d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:21.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.909+0000 7fa55c600640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa554160720 0x7fa5540d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:21.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.909+0000 7fa55c600640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa554160d20 con 0x7fa55415d710 2024-04-17T08:47:21.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.909+0000 7fa55c600640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fa55415d280 con 0x7fa554160720 2024-04-17T08:47:21.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.909+0000 7fa55c600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fa55415c9d0 con 0x7fa55415a010 2024-04-17T08:47:21.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.909+0000 7fa559200640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fa55415d710 0x7fa554160010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:52360/0 (socket says 172.21.15.152:52360) 2024-04-17T08:47:21.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.909+0000 7fa55a600640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa554160720 0x7fa5540d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:21.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.909+0000 7fa559200640 1 -- 172.21.15.152:0/2910731032 learned_addr learned my addr 172.21.15.152:0/2910731032 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:21.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.909+0000 7fa559c00640 1 --2- 172.21.15.152:0/2910731032 >> v2:172.21.15.196:3300/0 conn(0x7fa55415a010 0x7fa5540d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:21.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.909+0000 7fa55a600640 1 -- 172.21.15.152:0/2910731032 >> v2:172.21.15.196:3300/0 conn(0x7fa55415a010 msgr2=0x7fa5540d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:21.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.909+0000 7fa55a600640 1 --2- 172.21.15.152:0/2910731032 >> v2:172.21.15.196:3300/0 conn(0x7fa55415a010 0x7fa5540d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:21.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.909+0000 7fa55a600640 1 -- 172.21.15.152:0/2910731032 >> v1:172.21.15.152:6789/0 conn(0x7fa55415d710 legacy=0x7fa554160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:21.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.909+0000 7fa55a600640 1 -- 172.21.15.152:0/2910731032 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa55415cc30 con 0x7fa554160720 2024-04-17T08:47:21.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.909+0000 7fa559c00640 1 --2- 172.21.15.152:0/2910731032 >> v2:172.21.15.196:3300/0 conn(0x7fa55415a010 0x7fa5540d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:21.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.909+0000 7fa553e00640 1 -- 172.21.15.152:0/2910731032 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 145534117 0 0) 0x7fa554160d20 con 0x7fa55415d710 2024-04-17T08:47:21.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.913+0000 7fa55a600640 1 --2- 172.21.15.152:0/2910731032 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa554160720 0x7fa5540d08a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa55406d9d0 tx=0x7fa54c01c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95f2f254aa3df0ed server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:21.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.913+0000 7fa553e00640 1 -- 172.21.15.152:0/2910731032 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa54c0b2070 con 0x7fa554160720 2024-04-17T08:47:21.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.913+0000 7fa553e00640 1 -- 172.21.15.152:0/2910731032 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa54c0a5870 con 0x7fa554160720 2024-04-17T08:47:21.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.913+0000 7fa553e00640 1 -- 172.21.15.152:0/2910731032 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa54c0a5c40 con 0x7fa554160720 2024-04-17T08:47:21.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.913+0000 7fa55c600640 1 -- 172.21.15.152:0/2910731032 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa554160720 msgr2=0x7fa5540d08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:21.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.913+0000 7fa55c600640 1 --2- 172.21.15.152:0/2910731032 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa554160720 0x7fa5540d08a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa55406d9d0 tx=0x7fa54c01c8a0 comp rx=0 tx=0).stop 2024-04-17T08:47:21.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.913+0000 7fa55c600640 1 -- 172.21.15.152:0/2910731032 shutdown_connections 2024-04-17T08:47:21.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.913+0000 7fa55c600640 1 --2- 172.21.15.152:0/2910731032 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa554160720 0x7fa5540d08a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:21.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.913+0000 7fa55c600640 1 --2- 172.21.15.152:0/2910731032 >> v2:172.21.15.196:3300/0 conn(0x7fa55415a010 0x7fa5540d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:21.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.913+0000 7fa55c600640 1 -- 172.21.15.152:0/2910731032 >> 172.21.15.152:0/2910731032 conn(0x7fa5540b3350 msgr2=0x7fa5540b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:21.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.913+0000 7fa55c600640 1 -- 172.21.15.152:0/2910731032 shutdown_connections 2024-04-17T08:47:21.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.913+0000 7fa55c600640 1 -- 172.21.15.152:0/2910731032 wait complete. 2024-04-17T08:47:21.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.913+0000 7fa55c600640 1 Processor -- start 2024-04-17T08:47:21.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.913+0000 7fa55c600640 1 -- start start 2024-04-17T08:47:21.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.913+0000 7fa55c600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa55415a010 0x7fa5540ceef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:21.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.913+0000 7fa55c600640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa55415d710 0x7fa5540998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:21.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.913+0000 7fa55c600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa554160720 0x7fa5540ce000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:21.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.913+0000 7fa55c600640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa55415e780 con 0x7fa55415d710 2024-04-17T08:47:21.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.913+0000 7fa55c600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa55415e600 con 0x7fa55415a010 2024-04-17T08:47:21.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.913+0000 7fa55c600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fa55415e900 con 0x7fa554160720 2024-04-17T08:47:21.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.917+0000 7fa559200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa55415d710 0x7fa5540998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:21.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.917+0000 7fa559200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa55415d710 0x7fa5540998b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56874/0 (socket says 172.21.15.152:56874) 2024-04-17T08:47:21.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.917+0000 7fa559200640 1 -- 172.21.15.152:0/4274835936 learned_addr learned my addr 172.21.15.152:0/4274835936 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:21.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.917+0000 7fa559c00640 1 --2- 172.21.15.152:0/4274835936 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa55415a010 0x7fa5540ceef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:21.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.917+0000 7fa55a600640 1 --2- 172.21.15.152:0/4274835936 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa554160720 0x7fa5540ce000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:21.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.917+0000 7fa559200640 1 -- 172.21.15.152:0/4274835936 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa554160720 msgr2=0x7fa5540ce000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:21.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.917+0000 7fa559200640 1 --2- 172.21.15.152:0/4274835936 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa554160720 0x7fa5540ce000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:21.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.917+0000 7fa559200640 1 -- 172.21.15.152:0/4274835936 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa55415a010 msgr2=0x7fa5540ceef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:21.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.917+0000 7fa559200640 1 --2- 172.21.15.152:0/4274835936 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa55415a010 0x7fa5540ceef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:21.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.917+0000 7fa559200640 1 -- 172.21.15.152:0/4274835936 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa554151a60 con 0x7fa55415d710 2024-04-17T08:47:21.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.917+0000 7fa559200640 1 --2- 172.21.15.152:0/4274835936 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa55415d710 0x7fa5540998b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa5400011f0 tx=0x7fa54000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:21.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.917+0000 7fa551600640 1 -- 172.21.15.152:0/4274835936 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa540018070 con 0x7fa55415d710 2024-04-17T08:47:21.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.917+0000 7fa551600640 1 -- 172.21.15.152:0/4274835936 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5400074e0 con 0x7fa55415d710 2024-04-17T08:47:21.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.917+0000 7fa551600640 1 -- 172.21.15.152:0/4274835936 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa540004a10 con 0x7fa55415d710 2024-04-17T08:47:21.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.917+0000 7fa55c600640 1 -- 172.21.15.152:0/4274835936 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5540cfc90 con 0x7fa55415d710 2024-04-17T08:47:21.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.917+0000 7fa55c600640 1 -- 172.21.15.152:0/4274835936 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa554152cf0 con 0x7fa55415d710 2024-04-17T08:47:21.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.917+0000 7fa55c600640 1 -- 172.21.15.152:0/4274835936 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5540cfa80 con 0x7fa55415d710 2024-04-17T08:47:21.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.917+0000 7fa551600640 1 -- 172.21.15.152:0/4274835936 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa540004bb0 con 0x7fa55415d710 2024-04-17T08:47:21.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.917+0000 7fa551600640 1 --2- 172.21.15.152:0/4274835936 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fa5340683b0 0x7fa53406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:21.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.921+0000 7fa551600640 1 -- 172.21.15.152:0/4274835936 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fa540086080 con 0x7fa55415d710 2024-04-17T08:47:21.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.921+0000 7fa559c00640 1 --2- 172.21.15.152:0/4274835936 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fa5340683b0 0x7fa53406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:21.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.921+0000 7fa559c00640 1 --2- 172.21.15.152:0/4274835936 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fa5340683b0 0x7fa53406a870 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa5480098b0 tx=0x7fa548008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:21.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:21.921+0000 7fa551600640 1 -- 172.21.15.152:0/4274835936 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fa540056180 con 0x7fa55415d710 2024-04-17T08:47:22.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.081+0000 7fa55c600640 1 -- 172.21.15.152:0/4274835936 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa554068a30 con 0x7fa55415d710 2024-04-17T08:47:22.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.081+0000 7fa551600640 1 -- 172.21.15.152:0/4274835936 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18972 (secure 0 0 0) 0x7fa540055a80 con 0x7fa55415d710 2024-04-17T08:47:22.084 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:47:22.084 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":26,"fsid":"ce68f82e-ec5f-4205-9fd5-bdfdf6ef31e2","created":"2024-04-17T08:46:08.353546+0000","modified":"2024-04-17T08:47:15.280634+0000","last_up_change":"2024-04-17T08:46:20.738799+0000","last_in_change":"2024-04-17T08:46:11.210050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T08:46:21.386856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T08:46:31.812460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T08:46:32.555559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T08:46:36.258078+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"682f0192-187c-404e-bc7a-b6b4e23825e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6819","nonce":3603799291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6823","nonce":3603799291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6831","nonce":3603799291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6827","nonce":3603799291}]},"public_addr":"172.21.15.152:6819/3603799291","cluster_addr":"172.21.15.152:6823/3603799291","heartbeat_back_addr":"172.21.15.152:6831/3603799291","heartbeat_front_addr":"172.21.15.152:6827/3603799291","state":["exists","up"]},{"osd":1,"uuid":"f0fe8fef-60ec-4a39-83b6-2fa6a5adb0f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6801","nonce":4133383142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6803","nonce":4133383142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6807","nonce":4133383142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6805","nonce":4133383142}]},"public_addr":"172.21.15.152:6801/4133383142","cluster_addr":"172.21.15.152:6803/4133383142","heartbeat_back_addr":"172.21.15.152:6807/4133383142","heartbeat_front_addr":"172.21.15.152:6805/4133383142","state":["exists","up"]},{"osd":2,"uuid":"35f36d9c-5245-4431-a618-f4df0fa380ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6809","nonce":3826143898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6811","nonce":3826143898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6815","nonce":3826143898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6813","nonce":3826143898}]},"public_addr":"172.21.15.152:6809/3826143898","cluster_addr":"172.21.15.152:6811/3826143898","heartbeat_back_addr":"172.21.15.152:6815/3826143898","heartbeat_front_addr":"172.21.15.152:6813/3826143898","state":["exists","up"]},{"osd":3,"uuid":"96e56ca5-15b4-4895-9b79-da2c92043159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6818","nonce":165717826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6822","nonce":165717826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6830","nonce":165717826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6826","nonce":165717826}]},"public_addr":"172.21.15.152:6818/165717826","cluster_addr":"172.21.15.152:6822/165717826","heartbeat_back_addr":"172.21.15.152:6830/165717826","heartbeat_front_addr":"172.21.15.152:6826/165717826","state":["exists","up"]},{"osd":4,"uuid":"f5aa10a4-9ff9-41fe-a5c9-15326f982cc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6817","nonce":4080159297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6819","nonce":4080159297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6823","nonce":4080159297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6821","nonce":4080159297}]},"public_addr":"172.21.15.196:6817/4080159297","cluster_addr":"172.21.15.196:6819/4080159297","heartbeat_back_addr":"172.21.15.196:6823/4080159297","heartbeat_front_addr":"172.21.15.196:6821/4080159297","state":["exists","up"]},{"osd":5,"uuid":"42bab884-3476-47ae-ac65-935fa6e0f055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6801","nonce":3519444232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6803","nonce":3519444232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6807","nonce":3519444232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6805","nonce":3519444232}]},"public_addr":"172.21.15.196:6801/3519444232","cluster_addr":"172.21.15.196:6803/3519444232","heartbeat_back_addr":"172.21.15.196:6807/3519444232","heartbeat_front_addr":"172.21.15.196:6805/3519444232","state":["exists","up"]},{"osd":6,"uuid":"460b6167-f57b-4224-9c92-cfc9b80bbe99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6809","nonce":275739834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6811","nonce":275739834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6815","nonce":275739834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6813","nonce":275739834}]},"public_addr":"172.21.15.196:6809/275739834","cluster_addr":"172.21.15.196:6811/275739834","heartbeat_back_addr":"172.21.15.196:6815/275739834","heartbeat_front_addr":"172.21.15.196:6813/275739834","state":["exists","up"]},{"osd":7,"uuid":"d695643f-5e07-4e2a-a646-c06bd97b6650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6825","nonce":307626968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6827","nonce":307626968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6831","nonce":307626968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6829","nonce":307626968}]},"public_addr":"172.21.15.196:6825/307626968","cluster_addr":"172.21.15.196:6827/307626968","heartbeat_back_addr":"172.21.15.196:6831/307626968","heartbeat_front_addr":"172.21.15.196:6829/307626968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.293257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.964533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.248895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.010000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.832554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.743704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930171+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930962+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T08:47:22.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.085+0000 7fa55c600640 1 -- 172.21.15.152:0/4274835936 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fa5340683b0 msgr2=0x7fa53406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:22.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.085+0000 7fa55c600640 1 --2- 172.21.15.152:0/4274835936 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fa5340683b0 0x7fa53406a870 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa5480098b0 tx=0x7fa548008040 comp rx=0 tx=0).stop 2024-04-17T08:47:22.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.085+0000 7fa55c600640 1 -- 172.21.15.152:0/4274835936 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa55415d710 msgr2=0x7fa5540998b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:22.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.085+0000 7fa55c600640 1 --2- 172.21.15.152:0/4274835936 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa55415d710 0x7fa5540998b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa5400011f0 tx=0x7fa54000c9b0 comp rx=0 tx=0).stop 2024-04-17T08:47:22.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.085+0000 7fa55c600640 1 -- 172.21.15.152:0/4274835936 shutdown_connections 2024-04-17T08:47:22.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.085+0000 7fa55c600640 1 --2- 172.21.15.152:0/4274835936 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fa5340683b0 0x7fa53406a870 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:22.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.085+0000 7fa55c600640 1 --2- 172.21.15.152:0/4274835936 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa554160720 0x7fa5540ce000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:22.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.085+0000 7fa55c600640 1 --2- 172.21.15.152:0/4274835936 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa55415d710 0x7fa5540998b0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:22.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.085+0000 7fa55c600640 1 --2- 172.21.15.152:0/4274835936 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa55415a010 0x7fa5540ceef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:22.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.085+0000 7fa55c600640 1 -- 172.21.15.152:0/4274835936 >> 172.21.15.152:0/4274835936 conn(0x7fa5540b3350 msgr2=0x7fa5540733c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:22.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.085+0000 7fa55c600640 1 -- 172.21.15.152:0/4274835936 shutdown_connections 2024-04-17T08:47:22.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.085+0000 7fa55c600640 1 -- 172.21.15.152:0/4274835936 wait complete. 2024-04-17T08:47:22.106 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T08:46:21.386856+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-17T08:46:31.812460+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-17T08:46:32.555559+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-17T08:46:36.258078+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-17T08:47:22.107 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T08:47:22.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.245+0000 7f9093200640 1 Processor -- start 2024-04-17T08:47:22.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.245+0000 7f9093200640 1 -- start start 2024-04-17T08:47:22.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.245+0000 7f9093200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f909415ff30 0x7f909415d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:22.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.245+0000 7f9093200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f90940b2d60 0x7f90940d14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:22.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.245+0000 7f9093200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f909415d900 con 0x7f90940b2980 2024-04-17T08:47:22.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.245+0000 7f9093200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f90940ccb80 con 0x7f90940b2d60 2024-04-17T08:47:22.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.245+0000 7f9093200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f90940ce4f0 con 0x7f909415ff30 2024-04-17T08:47:22.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.249+0000 7f9091e00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f90940b2980 0x7f90940b1ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.152:34470/0 (socket says 172.21.15.152:34470) 2024-04-17T08:47:22.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.249+0000 7f9091e00640 1 -- 172.21.15.152:0/2174291292 learned_addr learned my addr 172.21.15.152:0/2174291292 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:22.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.249+0000 7f9092800640 1 --2- 172.21.15.152:0/2174291292 >> v2:172.21.15.196:3300/0 conn(0x7f90940b2d60 0x7f90940d14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:22.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.249+0000 7f9091400640 1 --2- 172.21.15.152:0/2174291292 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f909415ff30 0x7f909415d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:22.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.249+0000 7f9090a00640 1 -- 172.21.15.152:0/2174291292 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 686408423 0 0) 0x7f9084001120 con 0x7f90940b2980 2024-04-17T08:47:22.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.249+0000 7f9090a00640 1 -- 172.21.15.152:0/2174291292 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9078003530 con 0x7f90940b2980 2024-04-17T08:47:22.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.249+0000 7f9092800640 1 -- 172.21.15.152:0/2174291292 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f909415ff30 msgr2=0x7f909415d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:22.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.249+0000 7f9092800640 1 --2- 172.21.15.152:0/2174291292 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f909415ff30 0x7f909415d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:22.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.249+0000 7f9092800640 1 -- 172.21.15.152:0/2174291292 >> v1:172.21.15.196:6789/0 conn(0x7f90940b2980 legacy=0x7f90940b1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:22.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.249+0000 7f9092800640 1 -- 172.21.15.152:0/2174291292 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90941603b0 con 0x7f90940b2d60 2024-04-17T08:47:22.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.249+0000 7f9092800640 1 --2- 172.21.15.152:0/2174291292 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f90940b2d60 0x7f90940d14b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f908c009d90 tx=0x7f908c01c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99bfbf739067db23 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:22.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.253+0000 7f9090a00640 1 -- 172.21.15.152:0/2174291292 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f908c0b2070 con 0x7f90940b2d60 2024-04-17T08:47:22.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.253+0000 7f9090a00640 1 -- 172.21.15.152:0/2174291292 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f908c0a57a0 con 0x7f90940b2d60 2024-04-17T08:47:22.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.253+0000 7f9090a00640 1 -- 172.21.15.152:0/2174291292 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f908c0a5b70 con 0x7f90940b2d60 2024-04-17T08:47:22.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.253+0000 7f9093200640 1 -- 172.21.15.152:0/2174291292 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f90940b2d60 msgr2=0x7f90940d14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:22.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.253+0000 7f9093200640 1 --2- 172.21.15.152:0/2174291292 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f90940b2d60 0x7f90940d14b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f908c009d90 tx=0x7f908c01c8e0 comp rx=0 tx=0).stop 2024-04-17T08:47:22.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.253+0000 7f9093200640 1 -- 172.21.15.152:0/2174291292 shutdown_connections 2024-04-17T08:47:22.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.253+0000 7f9093200640 1 --2- 172.21.15.152:0/2174291292 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f90940b2d60 0x7f90940d14b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:22.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.253+0000 7f9093200640 1 --2- 172.21.15.152:0/2174291292 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f909415ff30 0x7f909415d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:22.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.253+0000 7f9093200640 1 -- 172.21.15.152:0/2174291292 >> 172.21.15.152:0/2174291292 conn(0x7f90940b3dd0 msgr2=0x7f90940b41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:22.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.253+0000 7f9093200640 1 -- 172.21.15.152:0/2174291292 shutdown_connections 2024-04-17T08:47:22.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.253+0000 7f9093200640 1 -- 172.21.15.152:0/2174291292 wait complete. 2024-04-17T08:47:22.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.253+0000 7f9093200640 1 Processor -- start 2024-04-17T08:47:22.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.253+0000 7f9093200640 1 -- start start 2024-04-17T08:47:22.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.253+0000 7f9093200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90940b2980 0x7f909414e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:22.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.253+0000 7f9093200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f909415ff30 0x7f90940b7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:22.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.253+0000 7f9093200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90940c7dc0 0x7f90940c8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:22.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.253+0000 7f9093200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f90940cf360 con 0x7f90940c7dc0 2024-04-17T08:47:22.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.253+0000 7f9093200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f90940cf1e0 con 0x7f909415ff30 2024-04-17T08:47:22.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.253+0000 7f9093200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f90940cf4e0 con 0x7f90940b2980 2024-04-17T08:47:22.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.253+0000 7f9092800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90940c7dc0 0x7f90940c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:22.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.253+0000 7f9092800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90940c7dc0 0x7f90940c8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56884/0 (socket says 172.21.15.152:56884) 2024-04-17T08:47:22.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.253+0000 7f9092800640 1 -- 172.21.15.152:0/3610911833 learned_addr learned my addr 172.21.15.152:0/3610911833 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:22.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.253+0000 7f9091e00640 1 --2- 172.21.15.152:0/3610911833 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90940b2980 0x7f909414e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:22.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.253+0000 7f9091400640 1 --2- 172.21.15.152:0/3610911833 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f909415ff30 0x7f90940b7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:22.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.257+0000 7f9092800640 1 -- 172.21.15.152:0/3610911833 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90940b2980 msgr2=0x7f909414e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:22.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.257+0000 7f9092800640 1 --2- 172.21.15.152:0/3610911833 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90940b2980 0x7f909414e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:22.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.257+0000 7f9092800640 1 -- 172.21.15.152:0/3610911833 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f909415ff30 msgr2=0x7f90940b7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:22.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.257+0000 7f9092800640 1 --2- 172.21.15.152:0/3610911833 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f909415ff30 0x7f90940b7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:22.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.257+0000 7f9092800640 1 -- 172.21.15.152:0/3610911833 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90940b2550 con 0x7f90940c7dc0 2024-04-17T08:47:22.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.257+0000 7f9091e00640 1 --2- 172.21.15.152:0/3610911833 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90940b2980 0x7f909414e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:22.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.257+0000 7f9092800640 1 --2- 172.21.15.152:0/3610911833 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90940c7dc0 0x7f90940c8270 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f908c01af90 tx=0x7f908c019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:22.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.257+0000 7f908a000640 1 -- 172.21.15.152:0/3610911833 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f908c0b2050 con 0x7f90940c7dc0 2024-04-17T08:47:22.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.257+0000 7f908a000640 1 -- 172.21.15.152:0/3610911833 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f908c0be070 con 0x7f90940c7dc0 2024-04-17T08:47:22.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.257+0000 7f9093200640 1 -- 172.21.15.152:0/3610911833 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f909414e940 con 0x7f90940c7dc0 2024-04-17T08:47:22.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.257+0000 7f908a000640 1 -- 172.21.15.152:0/3610911833 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f908c0ad850 con 0x7f90940c7dc0 2024-04-17T08:47:22.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.257+0000 7f9093200640 1 -- 172.21.15.152:0/3610911833 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90940cb620 con 0x7f90940c7dc0 2024-04-17T08:47:22.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.257+0000 7f9093200640 1 -- 172.21.15.152:0/3610911833 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9094075be0 con 0x7f90940c7dc0 2024-04-17T08:47:22.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.257+0000 7f908a000640 1 -- 172.21.15.152:0/3610911833 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f908c0ad9f0 con 0x7f90940c7dc0 2024-04-17T08:47:22.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.257+0000 7f908a000640 1 --2- 172.21.15.152:0/3610911833 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9070068380 0x7f907006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:22.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.257+0000 7f908a000640 1 -- 172.21.15.152:0/3610911833 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f908c122090 con 0x7f90940c7dc0 2024-04-17T08:47:22.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.257+0000 7f9091e00640 1 --2- 172.21.15.152:0/3610911833 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9070068380 0x7f907006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:22.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.261+0000 7f9091e00640 1 --2- 172.21.15.152:0/3610911833 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9070068380 0x7f907006a840 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f90840012c0 tx=0x7f9084009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:22.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.261+0000 7f908a000640 1 -- 172.21.15.152:0/3610911833 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f909414e940 con 0x7f90940c7dc0 2024-04-17T08:47:22.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.425+0000 7f9093200640 1 -- 172.21.15.152:0/3610911833 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f90940b3560 con 0x7f90940c7dc0 2024-04-17T08:47:22.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.425+0000 7f908a000640 1 -- 172.21.15.152:0/3610911833 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f908c016560 con 0x7f90940c7dc0 2024-04-17T08:47:22.428 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2024-04-17T08:47:22.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.429+0000 7f9093200640 1 -- 172.21.15.152:0/3610911833 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9070068380 msgr2=0x7f907006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:22.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.429+0000 7f9093200640 1 --2- 172.21.15.152:0/3610911833 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9070068380 0x7f907006a840 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f90840012c0 tx=0x7f9084009040 comp rx=0 tx=0).stop 2024-04-17T08:47:22.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.429+0000 7f9093200640 1 -- 172.21.15.152:0/3610911833 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90940c7dc0 msgr2=0x7f90940c8270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:22.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.429+0000 7f9093200640 1 --2- 172.21.15.152:0/3610911833 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90940c7dc0 0x7f90940c8270 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f908c01af90 tx=0x7f908c019680 comp rx=0 tx=0).stop 2024-04-17T08:47:22.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.429+0000 7f9093200640 1 -- 172.21.15.152:0/3610911833 shutdown_connections 2024-04-17T08:47:22.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.429+0000 7f9093200640 1 --2- 172.21.15.152:0/3610911833 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90940c7dc0 0x7f90940c8270 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:22.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.429+0000 7f9093200640 1 --2- 172.21.15.152:0/3610911833 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f909415ff30 0x7f90940b7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:22.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.429+0000 7f9093200640 1 --2- 172.21.15.152:0/3610911833 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9070068380 0x7f907006a840 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:22.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.429+0000 7f9093200640 1 --2- 172.21.15.152:0/3610911833 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90940b2980 0x7f909414e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:22.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.429+0000 7f9093200640 1 -- 172.21.15.152:0/3610911833 >> 172.21.15.152:0/3610911833 conn(0x7f90940b3dd0 msgr2=0x7f909415ec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:22.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.429+0000 7f9093200640 1 -- 172.21.15.152:0/3610911833 shutdown_connections 2024-04-17T08:47:22.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.429+0000 7f9093200640 1 -- 172.21.15.152:0/3610911833 wait complete. 2024-04-17T08:47:22.449 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-17T08:47:22.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.585+0000 7f7766c00640 1 Processor -- start 2024-04-17T08:47:22.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.585+0000 7f7766c00640 1 -- start start 2024-04-17T08:47:22.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.585+0000 7f7766c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f77600d0a70 0x7f7760160010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:22.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.585+0000 7f7766c00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f776015d710 0x7f7760160550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:22.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.585+0000 7f7766c00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7760160a90 con 0x7f776015a010 2024-04-17T08:47:22.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.585+0000 7f7766c00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f776015d280 con 0x7f776015d710 2024-04-17T08:47:22.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.585+0000 7f7766c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f776015c9d0 con 0x7f77600d0a70 2024-04-17T08:47:22.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.585+0000 7f7764c00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f776015d710 0x7f7760160550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:22.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.585+0000 7f775fe00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f776015a010 0x7f77600d0360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:52370/0 (socket says 172.21.15.152:52370) 2024-04-17T08:47:22.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.585+0000 7f775fe00640 1 -- 172.21.15.152:0/216191522 learned_addr learned my addr 172.21.15.152:0/216191522 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:22.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.589+0000 7f7764c00640 1 -- 172.21.15.152:0/216191522 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f77600d0a70 msgr2=0x7f7760160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:22.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.589+0000 7f7757400640 1 --2- 172.21.15.152:0/216191522 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f77600d0a70 0x7f7760160010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:22.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.589+0000 7f7764c00640 1 --2- 172.21.15.152:0/216191522 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f77600d0a70 0x7f7760160010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:22.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.589+0000 7f7764c00640 1 -- 172.21.15.152:0/216191522 >> v1:172.21.15.152:6789/0 conn(0x7f776015a010 legacy=0x7f77600d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:22.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.589+0000 7f775f400640 1 -- 172.21.15.152:0/216191522 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2400006633 0 0) 0x7f7760160a90 con 0x7f776015a010 2024-04-17T08:47:22.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.589+0000 7f7764c00640 1 -- 172.21.15.152:0/216191522 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7760160d20 con 0x7f776015d710 2024-04-17T08:47:22.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.589+0000 7f7757400640 1 --2- 172.21.15.152:0/216191522 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f77600d0a70 0x7f7760160010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:47:22.592 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.589+0000 7f7764c00640 1 --2- 172.21.15.152:0/216191522 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f776015d710 0x7f7760160550 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7758009d90 tx=0x7f775801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c864617f4b0f709 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:22.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.589+0000 7f775f400640 1 -- 172.21.15.152:0/216191522 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77580b2070 con 0x7f776015d710 2024-04-17T08:47:22.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.589+0000 7f775f400640 1 -- 172.21.15.152:0/216191522 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77580a5890 con 0x7f776015d710 2024-04-17T08:47:22.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.589+0000 7f775f400640 1 -- 172.21.15.152:0/216191522 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77580a5c60 con 0x7f776015d710 2024-04-17T08:47:22.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.589+0000 7f7766c00640 1 -- 172.21.15.152:0/216191522 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f776015d710 msgr2=0x7f7760160550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:22.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.589+0000 7f7766c00640 1 --2- 172.21.15.152:0/216191522 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f776015d710 0x7f7760160550 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7758009d90 tx=0x7f775801c8e0 comp rx=0 tx=0).stop 2024-04-17T08:47:22.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.589+0000 7f7766c00640 1 -- 172.21.15.152:0/216191522 shutdown_connections 2024-04-17T08:47:22.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.589+0000 7f7766c00640 1 --2- 172.21.15.152:0/216191522 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f77600d0a70 0x7f7760160010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:22.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.589+0000 7f7766c00640 1 --2- 172.21.15.152:0/216191522 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f776015d710 0x7f7760160550 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:22.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.589+0000 7f7766c00640 1 -- 172.21.15.152:0/216191522 >> 172.21.15.152:0/216191522 conn(0x7f77600b3350 msgr2=0x7f77600b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:22.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.589+0000 7f7766c00640 1 -- 172.21.15.152:0/216191522 shutdown_connections 2024-04-17T08:47:22.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.593+0000 7f7766c00640 1 -- 172.21.15.152:0/216191522 wait complete. 2024-04-17T08:47:22.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.593+0000 7f7766c00640 1 Processor -- start 2024-04-17T08:47:22.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.593+0000 7f7766c00640 1 -- start start 2024-04-17T08:47:22.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.593+0000 7f7766c00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77600d0a70 0x7f77600cfa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:22.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.593+0000 7f7766c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f776015a010 0x7f776006c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:22.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.593+0000 7f7766c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f776015d710 0x7f7760151210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:22.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.593+0000 7f7766c00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f776015e570 con 0x7f77600d0a70 2024-04-17T08:47:22.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.593+0000 7f7766c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f776015e3f0 con 0x7f776015d710 2024-04-17T08:47:22.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.593+0000 7f7766c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f776015e6f0 con 0x7f776015a010 2024-04-17T08:47:22.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.593+0000 7f775fe00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77600d0a70 0x7f77600cfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:22.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.593+0000 7f775fe00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77600d0a70 0x7f77600cfa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56894/0 (socket says 172.21.15.152:56894) 2024-04-17T08:47:22.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.593+0000 7f775fe00640 1 -- 172.21.15.152:0/2272403004 learned_addr learned my addr 172.21.15.152:0/2272403004 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:22.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.593+0000 7f7757400640 1 --2- 172.21.15.152:0/2272403004 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f776015a010 0x7f776006c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:22.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.593+0000 7f7764c00640 1 --2- 172.21.15.152:0/2272403004 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f776015d710 0x7f7760151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:22.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.593+0000 7f775fe00640 1 -- 172.21.15.152:0/2272403004 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f776015a010 msgr2=0x7f776006c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:22.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.593+0000 7f775fe00640 1 --2- 172.21.15.152:0/2272403004 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f776015a010 0x7f776006c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:22.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.593+0000 7f775fe00640 1 -- 172.21.15.152:0/2272403004 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f776015d710 msgr2=0x7f7760151210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:22.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.593+0000 7f775fe00640 1 --2- 172.21.15.152:0/2272403004 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f776015d710 0x7f7760151210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:22.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.593+0000 7f775fe00640 1 -- 172.21.15.152:0/2272403004 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7760156df0 con 0x7f77600d0a70 2024-04-17T08:47:22.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.593+0000 7f775fe00640 1 --2- 172.21.15.152:0/2272403004 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77600d0a70 0x7f77600cfa20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f77500011f0 tx=0x7f775000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:22.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.593+0000 7f775cc00640 1 -- 172.21.15.152:0/2272403004 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7750018070 con 0x7f77600d0a70 2024-04-17T08:47:22.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.593+0000 7f775cc00640 1 -- 172.21.15.152:0/2272403004 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77500074e0 con 0x7f77600d0a70 2024-04-17T08:47:22.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.593+0000 7f775cc00640 1 -- 172.21.15.152:0/2272403004 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7750004a10 con 0x7f77600d0a70 2024-04-17T08:47:22.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.593+0000 7f7766c00640 1 -- 172.21.15.152:0/2272403004 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7760158cd0 con 0x7f77600d0a70 2024-04-17T08:47:22.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.593+0000 7f7766c00640 1 -- 172.21.15.152:0/2272403004 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7760157370 con 0x7f77600d0a70 2024-04-17T08:47:22.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.597+0000 7f7766c00640 1 -- 172.21.15.152:0/2272403004 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7760068a30 con 0x7f77600d0a70 2024-04-17T08:47:22.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.597+0000 7f775cc00640 1 -- 172.21.15.152:0/2272403004 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7750004bb0 con 0x7f77600d0a70 2024-04-17T08:47:22.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.597+0000 7f775cc00640 1 --2- 172.21.15.152:0/2272403004 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f773c068380 0x7f773c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:22.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.597+0000 7f775cc00640 1 -- 172.21.15.152:0/2272403004 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f77500861c0 con 0x7f77600d0a70 2024-04-17T08:47:22.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.597+0000 7f7757400640 1 --2- 172.21.15.152:0/2272403004 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f773c068380 0x7f773c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:22.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.597+0000 7f7757400640 1 --2- 172.21.15.152:0/2272403004 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f773c068380 0x7f773c06a840 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f77600cff60 tx=0x7f7748008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:22.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.601+0000 7f775cc00640 1 -- 172.21.15.152:0/2272403004 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f7750056350 con 0x7f77600d0a70 2024-04-17T08:47:22.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.757+0000 7f7766c00640 1 -- 172.21.15.152:0/2272403004 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f776015a600 con 0x7f77600d0a70 2024-04-17T08:47:22.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.757+0000 7f775cc00640 1 -- 172.21.15.152:0/2272403004 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f7750055c50 con 0x7f77600d0a70 2024-04-17T08:47:22.761 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-04-17T08:47:22.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.761+0000 7f7766c00640 1 -- 172.21.15.152:0/2272403004 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f773c068380 msgr2=0x7f773c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:22.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.761+0000 7f7766c00640 1 --2- 172.21.15.152:0/2272403004 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f773c068380 0x7f773c06a840 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f77600cff60 tx=0x7f7748008040 comp rx=0 tx=0).stop 2024-04-17T08:47:22.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.761+0000 7f7766c00640 1 -- 172.21.15.152:0/2272403004 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77600d0a70 msgr2=0x7f77600cfa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:22.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.761+0000 7f7766c00640 1 --2- 172.21.15.152:0/2272403004 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77600d0a70 0x7f77600cfa20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f77500011f0 tx=0x7f775000c9b0 comp rx=0 tx=0).stop 2024-04-17T08:47:22.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.761+0000 7f7766c00640 1 -- 172.21.15.152:0/2272403004 shutdown_connections 2024-04-17T08:47:22.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.761+0000 7f7766c00640 1 --2- 172.21.15.152:0/2272403004 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f776015d710 0x7f7760151210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:22.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.761+0000 7f7766c00640 1 --2- 172.21.15.152:0/2272403004 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f773c068380 0x7f773c06a840 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:22.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.761+0000 7f7766c00640 1 --2- 172.21.15.152:0/2272403004 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f776015a010 0x7f776006c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:22.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.761+0000 7f7766c00640 1 --2- 172.21.15.152:0/2272403004 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77600d0a70 0x7f77600cfa20 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:22.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.761+0000 7f7766c00640 1 -- 172.21.15.152:0/2272403004 >> 172.21.15.152:0/2272403004 conn(0x7f77600b3350 msgr2=0x7f7760071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:22.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.761+0000 7f7766c00640 1 -- 172.21.15.152:0/2272403004 shutdown_connections 2024-04-17T08:47:22.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.761+0000 7f7766c00640 1 -- 172.21.15.152:0/2272403004 wait complete. 2024-04-17T08:47:22.782 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-17T08:47:22.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.917+0000 7f3013000640 1 Processor -- start 2024-04-17T08:47:22.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.917+0000 7f3013000640 1 -- start start 2024-04-17T08:47:22.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.917+0000 7f3013000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f300c15ec10 0x7f300c06fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:22.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.917+0000 7f3013000640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f300c06ea20 con 0x7f300c15e830 2024-04-17T08:47:22.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.917+0000 7f3013000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f300c06ed00 con 0x7f300c15b840 2024-04-17T08:47:22.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.917+0000 7f3013000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f300c06f630 con 0x7f300c15ec10 2024-04-17T08:47:22.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.917+0000 7f300be00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f300c15e830 0x7f300c072a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:52374/0 (socket says 172.21.15.152:52374) 2024-04-17T08:47:22.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.917+0000 7f300be00640 1 -- 172.21.15.152:0/3407340849 learned_addr learned my addr 172.21.15.152:0/3407340849 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:22.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.917+0000 7f3003400640 1 --2- 172.21.15.152:0/3407340849 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f300c15ec10 0x7f300c06fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:22.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.921+0000 7f300b400640 1 -- 172.21.15.152:0/3407340849 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1343795687 0 0) 0x7f300c06ea20 con 0x7f300c15e830 2024-04-17T08:47:22.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.921+0000 7f300b400640 1 -- 172.21.15.152:0/3407340849 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ff0004640 con 0x7f300c15e830 2024-04-17T08:47:22.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.921+0000 7f300b400640 1 -- 172.21.15.152:0/3407340849 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 381028355 0 0) 0x7f300c06ed00 con 0x7f300c15b840 2024-04-17T08:47:22.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.921+0000 7f300b400640 1 -- 172.21.15.152:0/3407340849 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f300c06ea20 con 0x7f300c15b840 2024-04-17T08:47:22.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.921+0000 7f3003400640 1 -- 172.21.15.152:0/3407340849 >> v1:172.21.15.196:6789/0 conn(0x7f300c15b840 legacy=0x7f300c06b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:22.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.921+0000 7f300b400640 1 -- 172.21.15.152:0/3407340849 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4103442028 0 0) 0x7f2ff0004640 con 0x7f300c15e830 2024-04-17T08:47:22.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.921+0000 7f3003400640 1 -- 172.21.15.152:0/3407340849 >> v1:172.21.15.152:6789/0 conn(0x7f300c15e830 legacy=0x7f300c072a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:22.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.921+0000 7f3003400640 1 -- 172.21.15.152:0/3407340849 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f300c06efe0 con 0x7f300c15ec10 2024-04-17T08:47:22.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.921+0000 7f3003400640 1 --2- 172.21.15.152:0/3407340849 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f300c15ec10 0x7f300c06fac0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2ff40097f0 tx=0x7f300c06c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da40805e985928d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:22.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.921+0000 7f300b400640 1 -- 172.21.15.152:0/3407340849 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff40ab5f0 con 0x7f300c15ec10 2024-04-17T08:47:22.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.921+0000 7f300b400640 1 -- 172.21.15.152:0/3407340849 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ff40b0070 con 0x7f300c15ec10 2024-04-17T08:47:22.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.921+0000 7f300b400640 1 -- 172.21.15.152:0/3407340849 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff40ab990 con 0x7f300c15ec10 2024-04-17T08:47:22.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.925+0000 7f3013000640 1 -- 172.21.15.152:0/3407340849 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f300c15ec10 msgr2=0x7f300c06fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:22.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.925+0000 7f3013000640 1 --2- 172.21.15.152:0/3407340849 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f300c15ec10 0x7f300c06fac0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2ff40097f0 tx=0x7f300c06c8d0 comp rx=0 tx=0).stop 2024-04-17T08:47:22.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.925+0000 7f3013000640 1 -- 172.21.15.152:0/3407340849 shutdown_connections 2024-04-17T08:47:22.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.925+0000 7f3013000640 1 --2- 172.21.15.152:0/3407340849 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f300c15ec10 0x7f300c06fac0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:22.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.925+0000 7f3013000640 1 -- 172.21.15.152:0/3407340849 >> 172.21.15.152:0/3407340849 conn(0x7f300c0b3350 msgr2=0x7f300c0b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:22.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.925+0000 7f3013000640 1 -- 172.21.15.152:0/3407340849 shutdown_connections 2024-04-17T08:47:22.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.925+0000 7f3013000640 1 -- 172.21.15.152:0/3407340849 wait complete. 2024-04-17T08:47:22.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.925+0000 7f3013000640 1 Processor -- start 2024-04-17T08:47:22.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.925+0000 7f3013000640 1 -- start start 2024-04-17T08:47:22.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.925+0000 7f3013000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f300c15b840 0x7f300c0b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:22.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.925+0000 7f3013000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f300c15e830 0x7f300c0cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:22.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.925+0000 7f3013000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f300c15ec10 0x7f300c0b16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:22.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.925+0000 7f3013000640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f300c0d04e0 con 0x7f300c15b840 2024-04-17T08:47:22.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.925+0000 7f3013000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f300c0d0360 con 0x7f300c15e830 2024-04-17T08:47:22.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.925+0000 7f3013000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f300c0d0660 con 0x7f300c15ec10 2024-04-17T08:47:22.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.925+0000 7f300be00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f300c15b840 0x7f300c0b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:22.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.925+0000 7f300be00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f300c15b840 0x7f300c0b02d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56910/0 (socket says 172.21.15.152:56910) 2024-04-17T08:47:22.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.925+0000 7f300be00640 1 -- 172.21.15.152:0/2034220866 learned_addr learned my addr 172.21.15.152:0/2034220866 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:22.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.925+0000 7f300be00640 1 -- 172.21.15.152:0/2034220866 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f300c15ec10 msgr2=0x7f300c0b16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:22.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.925+0000 7f300be00640 1 --2- 172.21.15.152:0/2034220866 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f300c15ec10 0x7f300c0b16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:22.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.925+0000 7f300be00640 1 -- 172.21.15.152:0/2034220866 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f300c15e830 msgr2=0x7f300c0cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:22.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.925+0000 7f300be00640 1 --2- 172.21.15.152:0/2034220866 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f300c15e830 0x7f300c0cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:22.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.925+0000 7f300be00640 1 -- 172.21.15.152:0/2034220866 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f300c15e360 con 0x7f300c15b840 2024-04-17T08:47:22.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.929+0000 7f300be00640 1 --2- 172.21.15.152:0/2034220866 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f300c15b840 0x7f300c0b02d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc00cb80 tx=0x7f2ffc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:22.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.929+0000 7f3008c00640 1 -- 172.21.15.152:0/2034220866 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ffc017070 con 0x7f300c15b840 2024-04-17T08:47:22.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.929+0000 7f3008c00640 1 -- 172.21.15.152:0/2034220866 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ffc00ad40 con 0x7f300c15b840 2024-04-17T08:47:22.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.929+0000 7f3008c00640 1 -- 172.21.15.152:0/2034220866 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ffc012620 con 0x7f300c15b840 2024-04-17T08:47:22.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.929+0000 7f3013000640 1 -- 172.21.15.152:0/2034220866 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f300c163c40 con 0x7f300c15b840 2024-04-17T08:47:22.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.929+0000 7f3013000640 1 -- 172.21.15.152:0/2034220866 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f300c164200 con 0x7f300c15b840 2024-04-17T08:47:22.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.929+0000 7f3013000640 1 -- 172.21.15.152:0/2034220866 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f300c068a30 con 0x7f300c15b840 2024-04-17T08:47:22.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.929+0000 7f3008c00640 1 -- 172.21.15.152:0/2034220866 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2ffc01a070 con 0x7f300c15b840 2024-04-17T08:47:22.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.929+0000 7f3008c00640 1 --2- 172.21.15.152:0/2034220866 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f2fe80683b0 0x7f2fe806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:22.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.929+0000 7f3008c00640 1 -- 172.21.15.152:0/2034220866 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f2ffc086cb0 con 0x7f300c15b840 2024-04-17T08:47:22.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.929+0000 7f3003400640 1 --2- 172.21.15.152:0/2034220866 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f2fe80683b0 0x7f2fe806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:22.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.933+0000 7f3003400640 1 --2- 172.21.15.152:0/2034220866 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f2fe80683b0 0x7f2fe806a870 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2ff40af000 tx=0x7f2ff40046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:22.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:22.933+0000 7f3008c00640 1 -- 172.21.15.152:0/2034220866 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f2ffc056db0 con 0x7f300c15b840 2024-04-17T08:47:23.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.093+0000 7f3013000640 1 -- 172.21.15.152:0/2034220866 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f300c159360 con 0x7f300c15b840 2024-04-17T08:47:23.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.093+0000 7f3008c00640 1 -- 172.21.15.152:0/2034220866 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f2ffc0566b0 con 0x7f300c15b840 2024-04-17T08:47:23.095 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 64 2024-04-17T08:47:23.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.093+0000 7f3013000640 1 -- 172.21.15.152:0/2034220866 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f2fe80683b0 msgr2=0x7f2fe806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:23.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.093+0000 7f3013000640 1 --2- 172.21.15.152:0/2034220866 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f2fe80683b0 0x7f2fe806a870 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2ff40af000 tx=0x7f2ff40046d0 comp rx=0 tx=0).stop 2024-04-17T08:47:23.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.093+0000 7f3013000640 1 -- 172.21.15.152:0/2034220866 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f300c15b840 msgr2=0x7f300c0b02d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:23.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.093+0000 7f3013000640 1 --2- 172.21.15.152:0/2034220866 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f300c15b840 0x7f300c0b02d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc00cb80 tx=0x7f2ffc00a430 comp rx=0 tx=0).stop 2024-04-17T08:47:23.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.093+0000 7f3013000640 1 -- 172.21.15.152:0/2034220866 shutdown_connections 2024-04-17T08:47:23.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.093+0000 7f3013000640 1 --2- 172.21.15.152:0/2034220866 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f2fe80683b0 0x7f2fe806a870 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:23.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.093+0000 7f3013000640 1 --2- 172.21.15.152:0/2034220866 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f300c15ec10 0x7f300c0b16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:23.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.093+0000 7f3013000640 1 --2- 172.21.15.152:0/2034220866 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f300c15e830 0x7f300c0cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:23.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.093+0000 7f3013000640 1 --2- 172.21.15.152:0/2034220866 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f300c15b840 0x7f300c0b02d0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:23.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.093+0000 7f3013000640 1 -- 172.21.15.152:0/2034220866 >> 172.21.15.152:0/2034220866 conn(0x7f300c0b3350 msgr2=0x7f300c15cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:23.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.093+0000 7f3013000640 1 -- 172.21.15.152:0/2034220866 shutdown_connections 2024-04-17T08:47:23.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.093+0000 7f3013000640 1 -- 172.21.15.152:0/2034220866 wait complete. 2024-04-17T08:47:23.117 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-17T08:47:23.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.253+0000 7fc1e5600640 1 Processor -- start 2024-04-17T08:47:23.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.253+0000 7fc1e5600640 1 -- start start 2024-04-17T08:47:23.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.253+0000 7fc1e5600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc1e00d0a70 0x7fc1e0160010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:23.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.253+0000 7fc1e5600640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1e0160d20 con 0x7fc1e015d710 2024-04-17T08:47:23.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.253+0000 7fc1e5600640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1e015cc30 con 0x7fc1e015a010 2024-04-17T08:47:23.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.253+0000 7fc1e5600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fc1e015d280 con 0x7fc1e00d0a70 2024-04-17T08:47:23.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.253+0000 7fc1df400640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fc1e015d710 0x7fc1e0160550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:52376/0 (socket says 172.21.15.152:52376) 2024-04-17T08:47:23.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.253+0000 7fc1df400640 1 -- 172.21.15.152:0/392496457 learned_addr learned my addr 172.21.15.152:0/392496457 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:23.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.253+0000 7fc1d6000640 1 --2- 172.21.15.152:0/392496457 >> v2:172.21.15.196:3300/0 conn(0x7fc1e00d0a70 0x7fc1e0160010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:23.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.257+0000 7fc1de000640 1 -- 172.21.15.152:0/392496457 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 452257617 0 0) 0x7fc1e0160d20 con 0x7fc1e015d710 2024-04-17T08:47:23.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.257+0000 7fc1de000640 1 -- 172.21.15.152:0/392496457 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1c4003530 con 0x7fc1e015d710 2024-04-17T08:47:23.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.257+0000 7fc1d6000640 1 -- 172.21.15.152:0/392496457 >> v1:172.21.15.196:6789/0 conn(0x7fc1e015a010 legacy=0x7fc1e00d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:23.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.257+0000 7fc1d6000640 1 -- 172.21.15.152:0/392496457 >> v1:172.21.15.152:6789/0 conn(0x7fc1e015d710 legacy=0x7fc1e0160550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:23.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.257+0000 7fc1d6000640 1 -- 172.21.15.152:0/392496457 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1e015cf10 con 0x7fc1e00d0a70 2024-04-17T08:47:23.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.257+0000 7fc1d6000640 1 --2- 172.21.15.152:0/392496457 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc1e00d0a70 0x7fc1e0160010 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc1c80097c0 tx=0x7fc1c801c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=930c435ac8056baf server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:23.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.257+0000 7fc1de000640 1 -- 172.21.15.152:0/392496457 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c80b0070 con 0x7fc1e00d0a70 2024-04-17T08:47:23.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.257+0000 7fc1de000640 1 -- 172.21.15.152:0/392496457 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1c80ab600 con 0x7fc1e00d0a70 2024-04-17T08:47:23.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.257+0000 7fc1de000640 1 -- 172.21.15.152:0/392496457 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c80ab9d0 con 0x7fc1e00d0a70 2024-04-17T08:47:23.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.257+0000 7fc1e5600640 1 -- 172.21.15.152:0/392496457 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc1e00d0a70 msgr2=0x7fc1e0160010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:23.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.257+0000 7fc1e5600640 1 --2- 172.21.15.152:0/392496457 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc1e00d0a70 0x7fc1e0160010 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc1c80097c0 tx=0x7fc1c801c410 comp rx=0 tx=0).stop 2024-04-17T08:47:23.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.261+0000 7fc1e5600640 1 -- 172.21.15.152:0/392496457 shutdown_connections 2024-04-17T08:47:23.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.261+0000 7fc1e5600640 1 --2- 172.21.15.152:0/392496457 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc1e00d0a70 0x7fc1e0160010 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:23.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.261+0000 7fc1e5600640 1 -- 172.21.15.152:0/392496457 >> 172.21.15.152:0/392496457 conn(0x7fc1e00b3350 msgr2=0x7fc1e00b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:23.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.261+0000 7fc1e5600640 1 -- 172.21.15.152:0/392496457 shutdown_connections 2024-04-17T08:47:23.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.261+0000 7fc1e5600640 1 -- 172.21.15.152:0/392496457 wait complete. 2024-04-17T08:47:23.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.261+0000 7fc1e5600640 1 Processor -- start 2024-04-17T08:47:23.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.261+0000 7fc1e5600640 1 -- start start 2024-04-17T08:47:23.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.261+0000 7fc1e5600640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1e00d0a70 0x7fc1e0166c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:23.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.261+0000 7fc1e5600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1e015a010 0x7fc1e015f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:23.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.261+0000 7fc1e5600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc1e015d710 0x7fc1e0099540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:23.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.261+0000 7fc1e5600640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e0169f50 con 0x7fc1e00d0a70 2024-04-17T08:47:23.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.261+0000 7fc1e5600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e0169dd0 con 0x7fc1e015d710 2024-04-17T08:47:23.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.261+0000 7fc1e5600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fc1e016a0d0 con 0x7fc1e015a010 2024-04-17T08:47:23.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.261+0000 7fc1dea00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1e00d0a70 0x7fc1e0166c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:23.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.261+0000 7fc1dea00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1e00d0a70 0x7fc1e0166c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56922/0 (socket says 172.21.15.152:56922) 2024-04-17T08:47:23.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.261+0000 7fc1dea00640 1 -- 172.21.15.152:0/1938840282 learned_addr learned my addr 172.21.15.152:0/1938840282 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:23.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.261+0000 7fc1df400640 1 --2- 172.21.15.152:0/1938840282 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc1e015d710 0x7fc1e0099540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:23.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.261+0000 7fc1d6000640 1 --2- 172.21.15.152:0/1938840282 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1e015a010 0x7fc1e015f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:23.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.261+0000 7fc1dea00640 1 -- 172.21.15.152:0/1938840282 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1e015a010 msgr2=0x7fc1e015f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:23.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.261+0000 7fc1dea00640 1 --2- 172.21.15.152:0/1938840282 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1e015a010 0x7fc1e015f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:23.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.261+0000 7fc1dea00640 1 -- 172.21.15.152:0/1938840282 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc1e015d710 msgr2=0x7fc1e0099540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:23.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.261+0000 7fc1dea00640 1 --2- 172.21.15.152:0/1938840282 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc1e015d710 0x7fc1e0099540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:23.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.261+0000 7fc1dea00640 1 -- 172.21.15.152:0/1938840282 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1e0150ad0 con 0x7fc1e00d0a70 2024-04-17T08:47:23.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.261+0000 7fc1df400640 1 --2- 172.21.15.152:0/1938840282 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc1e015d710 0x7fc1e0099540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:23.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.261+0000 7fc1dea00640 1 --2- 172.21.15.152:0/1938840282 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1e00d0a70 0x7fc1e0166c30 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc1d000c420 tx=0x7fc1d000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:23.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.265+0000 7fc1d7400640 1 -- 172.21.15.152:0/1938840282 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d00052d0 con 0x7fc1e00d0a70 2024-04-17T08:47:23.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.265+0000 7fc1d7400640 1 -- 172.21.15.152:0/1938840282 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1d0005470 con 0x7fc1e00d0a70 2024-04-17T08:47:23.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.265+0000 7fc1e5600640 1 -- 172.21.15.152:0/1938840282 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1e0167170 con 0x7fc1e00d0a70 2024-04-17T08:47:23.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.265+0000 7fc1d7400640 1 -- 172.21.15.152:0/1938840282 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d0007260 con 0x7fc1e00d0a70 2024-04-17T08:47:23.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.265+0000 7fc1e5600640 1 -- 172.21.15.152:0/1938840282 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1e0150d40 con 0x7fc1e00d0a70 2024-04-17T08:47:23.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.265+0000 7fc1e5600640 1 -- 172.21.15.152:0/1938840282 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1e0068a30 con 0x7fc1e00d0a70 2024-04-17T08:47:23.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.265+0000 7fc1d7400640 1 -- 172.21.15.152:0/1938840282 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc1d0007400 con 0x7fc1e00d0a70 2024-04-17T08:47:23.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.265+0000 7fc1d7400640 1 --2- 172.21.15.152:0/1938840282 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc1bc0683b0 0x7fc1bc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:23.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.265+0000 7fc1d7400640 1 -- 172.21.15.152:0/1938840282 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fc1d00862b0 con 0x7fc1e00d0a70 2024-04-17T08:47:23.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.265+0000 7fc1d6000640 1 --2- 172.21.15.152:0/1938840282 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc1bc0683b0 0x7fc1bc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:23.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.265+0000 7fc1d6000640 1 --2- 172.21.15.152:0/1938840282 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc1bc0683b0 0x7fc1bc06a870 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc1c80ad000 tx=0x7fc1c8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:23.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.269+0000 7fc1d7400640 1 -- 172.21.15.152:0/1938840282 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fc1d0056440 con 0x7fc1e00d0a70 2024-04-17T08:47:23.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.429+0000 7fc1e5600640 1 -- 172.21.15.152:0/1938840282 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fc1e00b3ae0 con 0x7fc1e00d0a70 2024-04-17T08:47:23.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.429+0000 7fc1d7400640 1 -- 172.21.15.152:0/1938840282 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7fc1d0055d40 con 0x7fc1e00d0a70 2024-04-17T08:47:23.434 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-04-17T08:47:23.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.433+0000 7fc1e5600640 1 -- 172.21.15.152:0/1938840282 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc1bc0683b0 msgr2=0x7fc1bc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:23.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.433+0000 7fc1e5600640 1 --2- 172.21.15.152:0/1938840282 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc1bc0683b0 0x7fc1bc06a870 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc1c80ad000 tx=0x7fc1c8008040 comp rx=0 tx=0).stop 2024-04-17T08:47:23.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.433+0000 7fc1e5600640 1 -- 172.21.15.152:0/1938840282 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1e00d0a70 msgr2=0x7fc1e0166c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:23.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.433+0000 7fc1e5600640 1 --2- 172.21.15.152:0/1938840282 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1e00d0a70 0x7fc1e0166c30 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc1d000c420 tx=0x7fc1d000c8e0 comp rx=0 tx=0).stop 2024-04-17T08:47:23.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.433+0000 7fc1e5600640 1 -- 172.21.15.152:0/1938840282 shutdown_connections 2024-04-17T08:47:23.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.433+0000 7fc1e5600640 1 --2- 172.21.15.152:0/1938840282 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc1e015d710 0x7fc1e0099540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:23.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.433+0000 7fc1e5600640 1 --2- 172.21.15.152:0/1938840282 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc1bc0683b0 0x7fc1bc06a870 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:23.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.433+0000 7fc1e5600640 1 --2- 172.21.15.152:0/1938840282 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1e015a010 0x7fc1e015f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:23.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.433+0000 7fc1e5600640 1 --2- 172.21.15.152:0/1938840282 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1e00d0a70 0x7fc1e0166c30 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:23.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.433+0000 7fc1e5600640 1 -- 172.21.15.152:0/1938840282 >> 172.21.15.152:0/1938840282 conn(0x7fc1e00b3350 msgr2=0x7fc1e0151620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:23.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.433+0000 7fc1e5600640 1 -- 172.21.15.152:0/1938840282 shutdown_connections 2024-04-17T08:47:23.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.433+0000 7fc1e5600640 1 -- 172.21.15.152:0/1938840282 wait complete. 2024-04-17T08:47:23.455 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T08:47:23.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.585+0000 7f5095400640 1 Processor -- start 2024-04-17T08:47:23.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.585+0000 7f5095400640 1 -- start start 2024-04-17T08:47:23.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.589+0000 7f5095400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5090158880 0x7f50900cdb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:23.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.589+0000 7f5095400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f5090158c60 0x7f50900cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:23.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.589+0000 7f5095400640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50900ce620 con 0x7f50900ce0a0 2024-04-17T08:47:23.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.589+0000 7f5095400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f50900ce900 con 0x7f5090158c60 2024-04-17T08:47:23.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.589+0000 7f5095400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f50900cebe0 con 0x7f5090158880 2024-04-17T08:47:23.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.589+0000 7f5094a00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f50900ce0a0 0x7f50900b0070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:52384/0 (socket says 172.21.15.152:52384) 2024-04-17T08:47:23.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.589+0000 7f5094a00640 1 -- 172.21.15.152:0/250351891 learned_addr learned my addr 172.21.15.152:0/250351891 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:23.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.589+0000 7f5087400640 1 --2- 172.21.15.152:0/250351891 >> v2:172.21.15.196:3300/0 conn(0x7f5090158c60 0x7f50900cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:23.592 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.589+0000 7f508fe00640 1 --2- 172.21.15.152:0/250351891 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5090158880 0x7f50900cdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:23.592 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.589+0000 7f508f400640 1 -- 172.21.15.152:0/250351891 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2112103682 0 0) 0x7f50900ce620 con 0x7f50900ce0a0 2024-04-17T08:47:23.592 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.589+0000 7f508f400640 1 -- 172.21.15.152:0/250351891 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5074003530 con 0x7f50900ce0a0 2024-04-17T08:47:23.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.589+0000 7f508f400640 1 -- 172.21.15.152:0/250351891 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2395558451 0 0) 0x7f5074003530 con 0x7f50900ce0a0 2024-04-17T08:47:23.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.589+0000 7f508f400640 1 -- 172.21.15.152:0/250351891 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5090158880 msgr2=0x7f50900cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:23.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.589+0000 7f508f400640 1 --2- 172.21.15.152:0/250351891 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5090158880 0x7f50900cdb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:23.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.589+0000 7f508f400640 1 -- 172.21.15.152:0/250351891 >> v2:172.21.15.196:3300/0 conn(0x7f5090158c60 msgr2=0x7f50900cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:23.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.589+0000 7f508f400640 1 --2- 172.21.15.152:0/250351891 >> v2:172.21.15.196:3300/0 conn(0x7f5090158c60 0x7f50900cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:23.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.589+0000 7f508f400640 1 -- 172.21.15.152:0/250351891 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50900b41f0 con 0x7f50900ce0a0 2024-04-17T08:47:23.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.589+0000 7f508f400640 1 -- 172.21.15.152:0/250351891 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2973887244 0 0) 0x7f5088001a00 con 0x7f50900ce0a0 2024-04-17T08:47:23.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.589+0000 7f5087400640 1 --2- 172.21.15.152:0/250351891 >> v2:172.21.15.196:3300/0 conn(0x7f5090158c60 0x7f50900cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T08:47:23.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.589+0000 7f508f400640 1 -- 172.21.15.152:0/250351891 >> v1:172.21.15.152:6789/0 conn(0x7f50900ce0a0 legacy=0x7f50900b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:23.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.589+0000 7f508f400640 1 --2- 172.21.15.152:0/250351891 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50740039c0 0x7f5074003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:23.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.589+0000 7f508f400640 1 --2- 172.21.15.152:0/250351891 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5074004810 0x7f5074004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:23.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.589+0000 7f508f400640 1 --2- 172.21.15.152:0/250351891 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f50740051d0 0x7f507400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:23.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.589+0000 7f508f400640 1 -- 172.21.15.152:0/250351891 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f50900ce900 con 0x7f50740039c0 2024-04-17T08:47:23.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.589+0000 7f508f400640 1 -- 172.21.15.152:0/250351891 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f50900cebe0 con 0x7f50740051d0 2024-04-17T08:47:23.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.589+0000 7f508f400640 1 -- 172.21.15.152:0/250351891 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f507400bf10 con 0x7f5074004810 2024-04-17T08:47:23.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.589+0000 7f508fe00640 1 --2- 172.21.15.152:0/250351891 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5090158880 0x7f50900cdb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T08:47:23.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.589+0000 7f508fe00640 1 --2- 172.21.15.152:0/250351891 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50740039c0 0x7f5074003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:23.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.589+0000 7f5087400640 1 --2- 172.21.15.152:0/250351891 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5074004810 0x7f5074004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:23.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.589+0000 7f5094a00640 1 --2- 172.21.15.152:0/250351891 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f50740051d0 0x7f507400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:23.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.589+0000 7f508fe00640 1 -- 172.21.15.152:0/250351891 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5074004810 msgr2=0x7f5074004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:23.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.589+0000 7f508fe00640 1 --2- 172.21.15.152:0/250351891 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5074004810 0x7f5074004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:23.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.589+0000 7f508fe00640 1 -- 172.21.15.152:0/250351891 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f50740051d0 msgr2=0x7f507400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:23.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.589+0000 7f508fe00640 1 --2- 172.21.15.152:0/250351891 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f50740051d0 0x7f507400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:23.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.589+0000 7f508fe00640 1 -- 172.21.15.152:0/250351891 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5074003530 con 0x7f50740039c0 2024-04-17T08:47:23.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.593+0000 7f508fe00640 1 --2- 172.21.15.152:0/250351891 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50740039c0 0x7f5074003de0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5080009b20 tx=0x7f508001ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3744714bfffc4df server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:23.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.593+0000 7f508f400640 1 -- 172.21.15.152:0/250351891 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50800097f0 con 0x7f50740039c0 2024-04-17T08:47:23.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.593+0000 7f508f400640 1 -- 172.21.15.152:0/250351891 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5080004030 con 0x7f50740039c0 2024-04-17T08:47:23.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.593+0000 7f508f400640 1 -- 172.21.15.152:0/250351891 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5080004400 con 0x7f50740039c0 2024-04-17T08:47:23.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.593+0000 7f5095400640 1 -- 172.21.15.152:0/250351891 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50740039c0 msgr2=0x7f5074003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:23.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.593+0000 7f5095400640 1 --2- 172.21.15.152:0/250351891 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50740039c0 0x7f5074003de0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5080009b20 tx=0x7f508001ca80 comp rx=0 tx=0).stop 2024-04-17T08:47:23.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.593+0000 7f5094a00640 1 -- 172.21.15.152:0/250351891 reap_dead start 2024-04-17T08:47:23.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.593+0000 7f5095400640 1 -- 172.21.15.152:0/250351891 shutdown_connections 2024-04-17T08:47:23.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.593+0000 7f5095400640 1 -- 172.21.15.152:0/250351891 >> 172.21.15.152:0/250351891 conn(0x7f5090072bb0 msgr2=0x7f5090072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:23.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.593+0000 7f5095400640 1 -- 172.21.15.152:0/250351891 shutdown_connections 2024-04-17T08:47:23.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.593+0000 7f5095400640 1 -- 172.21.15.152:0/250351891 wait complete. 2024-04-17T08:47:23.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.597+0000 7f5095400640 1 Processor -- start 2024-04-17T08:47:23.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.597+0000 7f5095400640 1 -- start start 2024-04-17T08:47:23.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.597+0000 7f5095400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f50740039c0 0x7f50901ebc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:23.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.597+0000 7f5095400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f50901ec160 0x7f50901ec5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:23.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.597+0000 7f5095400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50901ecb00 0x7f50901562e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:23.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.597+0000 7f5095400640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f50900b0b10 con 0x7f50901ecb00 2024-04-17T08:47:23.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.597+0000 7f5095400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f50900b0990 con 0x7f50740039c0 2024-04-17T08:47:23.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.597+0000 7f5095400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f50900b0c90 con 0x7f50901ec160 2024-04-17T08:47:23.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.597+0000 7f5094a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50901ecb00 0x7f50901562e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:23.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.597+0000 7f5094a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50901ecb00 0x7f50901562e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56946/0 (socket says 172.21.15.152:56946) 2024-04-17T08:47:23.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.597+0000 7f5094a00640 1 -- 172.21.15.152:0/1610570219 learned_addr learned my addr 172.21.15.152:0/1610570219 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:23.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.597+0000 7f508fe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f50740039c0 0x7f50901ebc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:23.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.597+0000 7f5087400640 1 --2- 172.21.15.152:0/1610570219 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f50901ec160 0x7f50901ec5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:23.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.597+0000 7f5094a00640 1 -- 172.21.15.152:0/1610570219 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f50901ec160 msgr2=0x7f50901ec5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:23.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.597+0000 7f5094a00640 1 --2- 172.21.15.152:0/1610570219 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f50901ec160 0x7f50901ec5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:23.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.597+0000 7f5094a00640 1 -- 172.21.15.152:0/1610570219 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f50740039c0 msgr2=0x7f50901ebc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:23.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.597+0000 7f5094a00640 1 --2- 172.21.15.152:0/1610570219 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f50740039c0 0x7f50901ebc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:23.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.597+0000 7f5094a00640 1 -- 172.21.15.152:0/1610570219 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50901ed150 con 0x7f50901ecb00 2024-04-17T08:47:23.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.597+0000 7f5094a00640 1 --2- 172.21.15.152:0/1610570219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50901ecb00 0x7f50901562e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5088007730 tx=0x7f5088007bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:23.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.597+0000 7f508cc00640 1 -- 172.21.15.152:0/1610570219 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508800eb30 con 0x7f50901ecb00 2024-04-17T08:47:23.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.597+0000 7f508cc00640 1 -- 172.21.15.152:0/1610570219 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f508800ecd0 con 0x7f50901ecb00 2024-04-17T08:47:23.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.597+0000 7f508cc00640 1 -- 172.21.15.152:0/1610570219 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5088014650 con 0x7f50901ecb00 2024-04-17T08:47:23.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.597+0000 7f5095400640 1 -- 172.21.15.152:0/1610570219 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5090155800 con 0x7f50901ecb00 2024-04-17T08:47:23.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.597+0000 7f5095400640 1 -- 172.21.15.152:0/1610570219 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5090155dc0 con 0x7f50901ecb00 2024-04-17T08:47:23.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.597+0000 7f5095400640 1 -- 172.21.15.152:0/1610570219 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5090155fc0 con 0x7f50901ecb00 2024-04-17T08:47:23.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.601+0000 7f508cc00640 1 -- 172.21.15.152:0/1610570219 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f50880147f0 con 0x7f50901ecb00 2024-04-17T08:47:23.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.601+0000 7f508cc00640 1 --2- 172.21.15.152:0/1610570219 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f506c068380 0x7f506c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:23.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.601+0000 7f508cc00640 1 -- 172.21.15.152:0/1610570219 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f5088086af0 con 0x7f50901ecb00 2024-04-17T08:47:23.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.601+0000 7f508fe00640 1 --2- 172.21.15.152:0/1610570219 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f506c068380 0x7f506c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:23.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.601+0000 7f508fe00640 1 --2- 172.21.15.152:0/1610570219 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f506c068380 0x7f506c06a840 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f50800ad000 tx=0x7f50800046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:23.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.605+0000 7f508cc00640 1 -- 172.21.15.152:0/1610570219 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f5090155fc0 con 0x7f50901ecb00 2024-04-17T08:47:23.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.761+0000 7f5095400640 1 -- 172.21.15.152:0/1610570219 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f50901641d0 con 0x7f50901ecb00 2024-04-17T08:47:23.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.765+0000 7f508cc00640 1 -- 172.21.15.152:0/1610570219 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18972 (secure 0 0 0) 0x7f5088056590 con 0x7f50901ecb00 2024-04-17T08:47:23.767 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:47:23.767 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":26,"fsid":"ce68f82e-ec5f-4205-9fd5-bdfdf6ef31e2","created":"2024-04-17T08:46:08.353546+0000","modified":"2024-04-17T08:47:15.280634+0000","last_up_change":"2024-04-17T08:46:20.738799+0000","last_in_change":"2024-04-17T08:46:11.210050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T08:46:21.386856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T08:46:31.812460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T08:46:32.555559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T08:46:36.258078+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"682f0192-187c-404e-bc7a-b6b4e23825e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6819","nonce":3603799291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6823","nonce":3603799291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6831","nonce":3603799291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6827","nonce":3603799291}]},"public_addr":"172.21.15.152:6819/3603799291","cluster_addr":"172.21.15.152:6823/3603799291","heartbeat_back_addr":"172.21.15.152:6831/3603799291","heartbeat_front_addr":"172.21.15.152:6827/3603799291","state":["exists","up"]},{"osd":1,"uuid":"f0fe8fef-60ec-4a39-83b6-2fa6a5adb0f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6801","nonce":4133383142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6803","nonce":4133383142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6807","nonce":4133383142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6805","nonce":4133383142}]},"public_addr":"172.21.15.152:6801/4133383142","cluster_addr":"172.21.15.152:6803/4133383142","heartbeat_back_addr":"172.21.15.152:6807/4133383142","heartbeat_front_addr":"172.21.15.152:6805/4133383142","state":["exists","up"]},{"osd":2,"uuid":"35f36d9c-5245-4431-a618-f4df0fa380ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6809","nonce":3826143898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6811","nonce":3826143898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6815","nonce":3826143898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6813","nonce":3826143898}]},"public_addr":"172.21.15.152:6809/3826143898","cluster_addr":"172.21.15.152:6811/3826143898","heartbeat_back_addr":"172.21.15.152:6815/3826143898","heartbeat_front_addr":"172.21.15.152:6813/3826143898","state":["exists","up"]},{"osd":3,"uuid":"96e56ca5-15b4-4895-9b79-da2c92043159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6818","nonce":165717826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6822","nonce":165717826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6830","nonce":165717826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6826","nonce":165717826}]},"public_addr":"172.21.15.152:6818/165717826","cluster_addr":"172.21.15.152:6822/165717826","heartbeat_back_addr":"172.21.15.152:6830/165717826","heartbeat_front_addr":"172.21.15.152:6826/165717826","state":["exists","up"]},{"osd":4,"uuid":"f5aa10a4-9ff9-41fe-a5c9-15326f982cc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6817","nonce":4080159297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6819","nonce":4080159297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6823","nonce":4080159297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6821","nonce":4080159297}]},"public_addr":"172.21.15.196:6817/4080159297","cluster_addr":"172.21.15.196:6819/4080159297","heartbeat_back_addr":"172.21.15.196:6823/4080159297","heartbeat_front_addr":"172.21.15.196:6821/4080159297","state":["exists","up"]},{"osd":5,"uuid":"42bab884-3476-47ae-ac65-935fa6e0f055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6801","nonce":3519444232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6803","nonce":3519444232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6807","nonce":3519444232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6805","nonce":3519444232}]},"public_addr":"172.21.15.196:6801/3519444232","cluster_addr":"172.21.15.196:6803/3519444232","heartbeat_back_addr":"172.21.15.196:6807/3519444232","heartbeat_front_addr":"172.21.15.196:6805/3519444232","state":["exists","up"]},{"osd":6,"uuid":"460b6167-f57b-4224-9c92-cfc9b80bbe99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6809","nonce":275739834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6811","nonce":275739834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6815","nonce":275739834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6813","nonce":275739834}]},"public_addr":"172.21.15.196:6809/275739834","cluster_addr":"172.21.15.196:6811/275739834","heartbeat_back_addr":"172.21.15.196:6815/275739834","heartbeat_front_addr":"172.21.15.196:6813/275739834","state":["exists","up"]},{"osd":7,"uuid":"d695643f-5e07-4e2a-a646-c06bd97b6650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6825","nonce":307626968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6827","nonce":307626968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6831","nonce":307626968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6829","nonce":307626968}]},"public_addr":"172.21.15.196:6825/307626968","cluster_addr":"172.21.15.196:6827/307626968","heartbeat_back_addr":"172.21.15.196:6831/307626968","heartbeat_front_addr":"172.21.15.196:6829/307626968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.293257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.964533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.248895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.010000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.832554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.743704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930171+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930962+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T08:47:23.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.765+0000 7f5095400640 1 -- 172.21.15.152:0/1610570219 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f506c068380 msgr2=0x7f506c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:23.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.765+0000 7f5095400640 1 --2- 172.21.15.152:0/1610570219 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f506c068380 0x7f506c06a840 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f50800ad000 tx=0x7f50800046d0 comp rx=0 tx=0).stop 2024-04-17T08:47:23.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.765+0000 7f5095400640 1 -- 172.21.15.152:0/1610570219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50901ecb00 msgr2=0x7f50901562e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:23.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.765+0000 7f5095400640 1 --2- 172.21.15.152:0/1610570219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50901ecb00 0x7f50901562e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5088007730 tx=0x7f5088007bf0 comp rx=0 tx=0).stop 2024-04-17T08:47:23.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.765+0000 7f5095400640 1 -- 172.21.15.152:0/1610570219 shutdown_connections 2024-04-17T08:47:23.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.765+0000 7f5095400640 1 --2- 172.21.15.152:0/1610570219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50901ecb00 0x7f50901562e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:23.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.765+0000 7f5095400640 1 --2- 172.21.15.152:0/1610570219 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f506c068380 0x7f506c06a840 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:23.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.765+0000 7f5095400640 1 --2- 172.21.15.152:0/1610570219 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f50901ec160 0x7f50901ec5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:23.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.765+0000 7f5095400640 1 --2- 172.21.15.152:0/1610570219 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f50740039c0 0x7f50901ebc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:23.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.765+0000 7f5095400640 1 -- 172.21.15.152:0/1610570219 >> 172.21.15.152:0/1610570219 conn(0x7f5090072bb0 msgr2=0x7f50900b0010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:23.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.765+0000 7f5095400640 1 -- 172.21.15.152:0/1610570219 shutdown_connections 2024-04-17T08:47:23.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.765+0000 7f5095400640 1 -- 172.21.15.152:0/1610570219 wait complete. 2024-04-17T08:47:23.788 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T08:46:21.386856+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-17T08:46:31.812460+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-17T08:46:32.555559+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-17T08:46:36.258078+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-17T08:47:23.789 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T08:47:23.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.925+0000 7f63a5800640 1 Processor -- start 2024-04-17T08:47:23.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.925+0000 7f63a5800640 1 -- start start 2024-04-17T08:47:23.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.925+0000 7f63a5800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f63a015a010 0x7f63a00d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:23.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.925+0000 7f63a5800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63a015d710 0x7f63a00d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:23.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.925+0000 7f63a5800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63a0160d20 con 0x7f63a0160010 2024-04-17T08:47:23.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.925+0000 7f63a5800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f63a015d280 con 0x7f63a015a010 2024-04-17T08:47:23.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.925+0000 7f63a5800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f63a015c9d0 con 0x7f63a015d710 2024-04-17T08:47:23.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.929+0000 7f639f400640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f63a0160010 0x7f63a0160480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.152:34492/0 (socket says 172.21.15.152:34492) 2024-04-17T08:47:23.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.929+0000 7f639e000640 1 --2- 172.21.15.152:0/303217548 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63a015d710 0x7f63a00d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:23.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.929+0000 7f639f400640 1 -- 172.21.15.152:0/303217548 learned_addr learned my addr 172.21.15.152:0/303217548 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:23.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.929+0000 7f639ea00640 1 --2- 172.21.15.152:0/303217548 >> v2:172.21.15.196:3300/0 conn(0x7f63a015a010 0x7f63a00d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:23.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.929+0000 7f639e000640 1 -- 172.21.15.152:0/303217548 >> v2:172.21.15.196:3300/0 conn(0x7f63a015a010 msgr2=0x7f63a00d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:23.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.929+0000 7f639e000640 1 --2- 172.21.15.152:0/303217548 >> v2:172.21.15.196:3300/0 conn(0x7f63a015a010 0x7f63a00d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:23.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.929+0000 7f639e000640 1 -- 172.21.15.152:0/303217548 >> v1:172.21.15.196:6789/0 conn(0x7f63a0160010 legacy=0x7f63a0160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:23.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.929+0000 7f639e000640 1 -- 172.21.15.152:0/303217548 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63a015cc30 con 0x7f63a015d710 2024-04-17T08:47:23.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.929+0000 7f639d600640 1 -- 172.21.15.152:0/303217548 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1424210893 0 0) 0x7f63a0160d20 con 0x7f63a0160010 2024-04-17T08:47:23.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.929+0000 7f639e000640 1 --2- 172.21.15.152:0/303217548 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63a015d710 0x7f63a00d08a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f638c0097c0 tx=0x7f638c01c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4845771f700ade56 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:23.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.929+0000 7f639d600640 1 -- 172.21.15.152:0/303217548 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f638c0b0070 con 0x7f63a015d710 2024-04-17T08:47:23.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.933+0000 7f639d600640 1 -- 172.21.15.152:0/303217548 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f638c0ab600 con 0x7f63a015d710 2024-04-17T08:47:23.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.933+0000 7f639d600640 1 -- 172.21.15.152:0/303217548 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f638c0ab9d0 con 0x7f63a015d710 2024-04-17T08:47:23.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.933+0000 7f63a5800640 1 -- 172.21.15.152:0/303217548 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63a015d710 msgr2=0x7f63a00d08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:23.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.933+0000 7f63a5800640 1 --2- 172.21.15.152:0/303217548 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63a015d710 0x7f63a00d08a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f638c0097c0 tx=0x7f638c01c410 comp rx=0 tx=0).stop 2024-04-17T08:47:23.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.933+0000 7f63a5800640 1 -- 172.21.15.152:0/303217548 shutdown_connections 2024-04-17T08:47:23.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.933+0000 7f63a5800640 1 --2- 172.21.15.152:0/303217548 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63a015d710 0x7f63a00d08a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:23.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.933+0000 7f63a5800640 1 --2- 172.21.15.152:0/303217548 >> v2:172.21.15.196:3300/0 conn(0x7f63a015a010 0x7f63a00d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:23.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.933+0000 7f63a5800640 1 -- 172.21.15.152:0/303217548 >> 172.21.15.152:0/303217548 conn(0x7f63a00b3350 msgr2=0x7f63a00b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:23.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.933+0000 7f63a5800640 1 -- 172.21.15.152:0/303217548 shutdown_connections 2024-04-17T08:47:23.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.933+0000 7f63a5800640 1 -- 172.21.15.152:0/303217548 wait complete. 2024-04-17T08:47:23.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.933+0000 7f63a5800640 1 Processor -- start 2024-04-17T08:47:23.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.933+0000 7f63a5800640 1 -- start start 2024-04-17T08:47:23.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.933+0000 7f63a5800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63a015a010 0x7f63a00b17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:23.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.933+0000 7f63a5800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f63a015d710 0x7f63a006f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:23.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.933+0000 7f63a5800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63a0160010 0x7f63a0158290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:23.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.933+0000 7f63a5800640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f63a015e780 con 0x7f63a015a010 2024-04-17T08:47:23.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.933+0000 7f63a5800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f63a015e600 con 0x7f63a015d710 2024-04-17T08:47:23.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.933+0000 7f63a5800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f63a015e900 con 0x7f63a0160010 2024-04-17T08:47:23.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.933+0000 7f639ea00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63a015a010 0x7f63a00b17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:23.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.933+0000 7f639ea00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63a015a010 0x7f63a00b17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56948/0 (socket says 172.21.15.152:56948) 2024-04-17T08:47:23.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.933+0000 7f639ea00640 1 -- 172.21.15.152:0/2687103455 learned_addr learned my addr 172.21.15.152:0/2687103455 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:23.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.933+0000 7f639f400640 1 --2- 172.21.15.152:0/2687103455 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63a0160010 0x7f63a0158290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:23.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.933+0000 7f639e000640 1 --2- 172.21.15.152:0/2687103455 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f63a015d710 0x7f63a006f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:23.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.933+0000 7f639ea00640 1 -- 172.21.15.152:0/2687103455 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63a0160010 msgr2=0x7f63a0158290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:23.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.933+0000 7f639ea00640 1 --2- 172.21.15.152:0/2687103455 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63a0160010 0x7f63a0158290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:23.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.933+0000 7f639ea00640 1 -- 172.21.15.152:0/2687103455 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f63a015d710 msgr2=0x7f63a006f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:23.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.933+0000 7f639ea00640 1 --2- 172.21.15.152:0/2687103455 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f63a015d710 0x7f63a006f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:23.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.933+0000 7f639ea00640 1 -- 172.21.15.152:0/2687103455 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63a014f470 con 0x7f63a015a010 2024-04-17T08:47:23.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.937+0000 7f639ea00640 1 --2- 172.21.15.152:0/2687103455 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63a015a010 0x7f63a00b17c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f639000efc0 tx=0x7f639000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:23.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.937+0000 7f6396a00640 1 -- 172.21.15.152:0/2687103455 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6390018020 con 0x7f63a015a010 2024-04-17T08:47:23.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.937+0000 7f6396a00640 1 -- 172.21.15.152:0/2687103455 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6390014480 con 0x7f63a015a010 2024-04-17T08:47:23.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.937+0000 7f6396a00640 1 -- 172.21.15.152:0/2687103455 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6390014850 con 0x7f63a015a010 2024-04-17T08:47:23.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.937+0000 7f63a5800640 1 -- 172.21.15.152:0/2687103455 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63a014f750 con 0x7f63a015a010 2024-04-17T08:47:23.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.937+0000 7f63a5800640 1 -- 172.21.15.152:0/2687103455 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63a014fd30 con 0x7f63a015a010 2024-04-17T08:47:23.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.937+0000 7f63a5800640 1 -- 172.21.15.152:0/2687103455 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63a0068a30 con 0x7f63a015a010 2024-04-17T08:47:23.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.937+0000 7f6396a00640 1 -- 172.21.15.152:0/2687103455 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f639001b020 con 0x7f63a015a010 2024-04-17T08:47:23.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.937+0000 7f6396a00640 1 --2- 172.21.15.152:0/2687103455 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f63800683b0 0x7f638006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:23.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.941+0000 7f6396a00640 1 -- 172.21.15.152:0/2687103455 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f6390087aa0 con 0x7f63a015a010 2024-04-17T08:47:23.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.941+0000 7f639e000640 1 --2- 172.21.15.152:0/2687103455 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f63800683b0 0x7f638006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:23.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.941+0000 7f639e000640 1 --2- 172.21.15.152:0/2687103455 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f63800683b0 0x7f638006a870 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f638c0ad000 tx=0x7f638c0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:23.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:23.945+0000 7f6396a00640 1 -- 172.21.15.152:0/2687103455 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f6390022030 con 0x7f63a015a010 2024-04-17T08:47:24.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.101+0000 7f63a5800640 1 -- 172.21.15.152:0/2687103455 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f63a006d660 con 0x7f63a015a010 2024-04-17T08:47:24.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.101+0000 7f6396a00640 1 -- 172.21.15.152:0/2687103455 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f6390010040 con 0x7f63a015a010 2024-04-17T08:47:24.103 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2024-04-17T08:47:24.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.101+0000 7f63a5800640 1 -- 172.21.15.152:0/2687103455 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f63800683b0 msgr2=0x7f638006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:24.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.101+0000 7f63a5800640 1 --2- 172.21.15.152:0/2687103455 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f63800683b0 0x7f638006a870 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f638c0ad000 tx=0x7f638c0a6000 comp rx=0 tx=0).stop 2024-04-17T08:47:24.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.101+0000 7f63a5800640 1 -- 172.21.15.152:0/2687103455 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63a015a010 msgr2=0x7f63a00b17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:24.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.101+0000 7f63a5800640 1 --2- 172.21.15.152:0/2687103455 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63a015a010 0x7f63a00b17c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f639000efc0 tx=0x7f639000c490 comp rx=0 tx=0).stop 2024-04-17T08:47:24.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.101+0000 7f63a5800640 1 -- 172.21.15.152:0/2687103455 shutdown_connections 2024-04-17T08:47:24.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.101+0000 7f63a5800640 1 --2- 172.21.15.152:0/2687103455 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f63800683b0 0x7f638006a870 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:24.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.101+0000 7f63a5800640 1 --2- 172.21.15.152:0/2687103455 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63a0160010 0x7f63a0158290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:24.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.101+0000 7f63a5800640 1 --2- 172.21.15.152:0/2687103455 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f63a015d710 0x7f63a006f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:24.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.101+0000 7f63a5800640 1 --2- 172.21.15.152:0/2687103455 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63a015a010 0x7f63a00b17c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:24.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.101+0000 7f63a5800640 1 -- 172.21.15.152:0/2687103455 >> 172.21.15.152:0/2687103455 conn(0x7f63a00b3350 msgr2=0x7f63a0165ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:24.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.101+0000 7f63a5800640 1 -- 172.21.15.152:0/2687103455 shutdown_connections 2024-04-17T08:47:24.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.101+0000 7f63a5800640 1 -- 172.21.15.152:0/2687103455 wait complete. 2024-04-17T08:47:24.124 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-17T08:47:24.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.257+0000 7fcb76800640 1 Processor -- start 2024-04-17T08:47:24.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.257+0000 7fcb76800640 1 -- start start 2024-04-17T08:47:24.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.261+0000 7fcb76800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcb7015a010 0x7fcb700d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:24.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.261+0000 7fcb76800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fcb70160720 0x7fcb700d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:24.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.261+0000 7fcb76800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb70160d20 con 0x7fcb7015d710 2024-04-17T08:47:24.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.261+0000 7fcb76800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fcb7015d280 con 0x7fcb70160720 2024-04-17T08:47:24.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.261+0000 7fcb76800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fcb7015c9d0 con 0x7fcb7015a010 2024-04-17T08:47:24.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.261+0000 7fcb6fe00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fcb70160720 0x7fcb700d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:24.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.261+0000 7fcb6f400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcb7015a010 0x7fcb700d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:24.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.261+0000 7fcb6fe00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fcb70160720 0x7fcb700d08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.152:55806/0 (socket says 172.21.15.152:55806) 2024-04-17T08:47:24.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.261+0000 7fcb6f400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcb7015a010 0x7fcb700d0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.152:39162/0 (socket says 172.21.15.152:39162) 2024-04-17T08:47:24.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.261+0000 7fcb6fe00640 1 -- 172.21.15.152:0/2105664029 learned_addr learned my addr 172.21.15.152:0/2105664029 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:24.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.261+0000 7fcb66a00640 1 --1- 172.21.15.152:0/2105664029 >> v1:172.21.15.196:6789/0 conn(0x7fcb7015d710 0x7fcb70160010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.152:34494/0 (socket says 172.21.15.152:34494) 2024-04-17T08:47:24.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.261+0000 7fcb6f400640 1 -- 172.21.15.152:0/2105664029 >> v2:172.21.15.196:3300/0 conn(0x7fcb70160720 msgr2=0x7fcb700d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:24.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.261+0000 7fcb6f400640 1 --2- 172.21.15.152:0/2105664029 >> v2:172.21.15.196:3300/0 conn(0x7fcb70160720 0x7fcb700d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:24.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.261+0000 7fcb6f400640 1 -- 172.21.15.152:0/2105664029 >> v1:172.21.15.196:6789/0 conn(0x7fcb7015d710 legacy=0x7fcb70160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:24.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.261+0000 7fcb6f400640 1 -- 172.21.15.152:0/2105664029 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb7015cc30 con 0x7fcb7015a010 2024-04-17T08:47:24.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.265+0000 7fcb6f400640 1 --2- 172.21.15.152:0/2105664029 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcb7015a010 0x7fcb700d0360 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcb600097c0 tx=0x7fcb6001c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84c449e1528dd1c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:24.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.265+0000 7fcb6ea00640 1 -- 172.21.15.152:0/2105664029 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb600b0070 con 0x7fcb7015a010 2024-04-17T08:47:24.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.265+0000 7fcb6ea00640 1 -- 172.21.15.152:0/2105664029 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb600ab600 con 0x7fcb7015a010 2024-04-17T08:47:24.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.265+0000 7fcb6ea00640 1 -- 172.21.15.152:0/2105664029 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb600ab9d0 con 0x7fcb7015a010 2024-04-17T08:47:24.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.265+0000 7fcb76800640 1 -- 172.21.15.152:0/2105664029 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcb7015a010 msgr2=0x7fcb700d0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:24.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.265+0000 7fcb76800640 1 --2- 172.21.15.152:0/2105664029 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcb7015a010 0x7fcb700d0360 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcb600097c0 tx=0x7fcb6001c410 comp rx=0 tx=0).stop 2024-04-17T08:47:24.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.265+0000 7fcb76800640 1 -- 172.21.15.152:0/2105664029 shutdown_connections 2024-04-17T08:47:24.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.265+0000 7fcb76800640 1 --2- 172.21.15.152:0/2105664029 >> v2:172.21.15.196:3300/0 conn(0x7fcb70160720 0x7fcb700d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:24.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.265+0000 7fcb76800640 1 --2- 172.21.15.152:0/2105664029 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcb7015a010 0x7fcb700d0360 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:24.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.265+0000 7fcb76800640 1 -- 172.21.15.152:0/2105664029 >> 172.21.15.152:0/2105664029 conn(0x7fcb700b3350 msgr2=0x7fcb700b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:24.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.265+0000 7fcb76800640 1 -- 172.21.15.152:0/2105664029 shutdown_connections 2024-04-17T08:47:24.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.265+0000 7fcb76800640 1 -- 172.21.15.152:0/2105664029 wait complete. 2024-04-17T08:47:24.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.265+0000 7fcb76800640 1 Processor -- start 2024-04-17T08:47:24.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.265+0000 7fcb76800640 1 -- start start 2024-04-17T08:47:24.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.269+0000 7fcb76800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcb7015a010 0x7fcb7015bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:24.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.269+0000 7fcb76800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcb7015d710 0x7fcb70155bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:24.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.269+0000 7fcb76800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb70160720 0x7fcb70098ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:24.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.269+0000 7fcb76800640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7015e780 con 0x7fcb70160720 2024-04-17T08:47:24.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.269+0000 7fcb76800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7015e600 con 0x7fcb7015d710 2024-04-17T08:47:24.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.269+0000 7fcb76800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fcb7015e900 con 0x7fcb7015a010 2024-04-17T08:47:24.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.269+0000 7fcb6fe00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb70160720 0x7fcb70098ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:24.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.269+0000 7fcb6fe00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb70160720 0x7fcb70098ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56954/0 (socket says 172.21.15.152:56954) 2024-04-17T08:47:24.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.269+0000 7fcb6fe00640 1 -- 172.21.15.152:0/1097328869 learned_addr learned my addr 172.21.15.152:0/1097328869 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:24.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.269+0000 7fcb6f400640 1 --2- 172.21.15.152:0/1097328869 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcb7015a010 0x7fcb7015bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:24.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.269+0000 7fcb66a00640 1 --2- 172.21.15.152:0/1097328869 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcb7015d710 0x7fcb70155bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:24.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.269+0000 7fcb6fe00640 1 -- 172.21.15.152:0/1097328869 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcb7015a010 msgr2=0x7fcb7015bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:24.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.269+0000 7fcb6fe00640 1 --2- 172.21.15.152:0/1097328869 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcb7015a010 0x7fcb7015bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:24.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.269+0000 7fcb6fe00640 1 -- 172.21.15.152:0/1097328869 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcb7015d710 msgr2=0x7fcb70155bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:24.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.269+0000 7fcb6fe00640 1 --2- 172.21.15.152:0/1097328869 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcb7015d710 0x7fcb70155bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:24.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.269+0000 7fcb6fe00640 1 -- 172.21.15.152:0/1097328869 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb7015c510 con 0x7fcb70160720 2024-04-17T08:47:24.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.269+0000 7fcb6fe00640 1 --2- 172.21.15.152:0/1097328869 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb70160720 0x7fcb70098ef0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fcb6800efc0 tx=0x7fcb6800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:24.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.269+0000 7fcb67e00640 1 -- 172.21.15.152:0/1097328869 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb6800cd20 con 0x7fcb70160720 2024-04-17T08:47:24.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.269+0000 7fcb67e00640 1 -- 172.21.15.152:0/1097328869 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb680039a0 con 0x7fcb70160720 2024-04-17T08:47:24.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.269+0000 7fcb76800640 1 -- 172.21.15.152:0/1097328869 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb70157e00 con 0x7fcb70160720 2024-04-17T08:47:24.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.269+0000 7fcb67e00640 1 -- 172.21.15.152:0/1097328869 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb68003d90 con 0x7fcb70160720 2024-04-17T08:47:24.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.269+0000 7fcb76800640 1 -- 172.21.15.152:0/1097328869 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb70157b20 con 0x7fcb70160720 2024-04-17T08:47:24.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.269+0000 7fcb76800640 1 -- 172.21.15.152:0/1097328869 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb70068a30 con 0x7fcb70160720 2024-04-17T08:47:24.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.269+0000 7fcb67e00640 1 -- 172.21.15.152:0/1097328869 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcb68012050 con 0x7fcb70160720 2024-04-17T08:47:24.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.273+0000 7fcb67e00640 1 --2- 172.21.15.152:0/1097328869 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fcb4c0683b0 0x7fcb4c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:24.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.273+0000 7fcb67e00640 1 -- 172.21.15.152:0/1097328869 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fcb680871f0 con 0x7fcb70160720 2024-04-17T08:47:24.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.273+0000 7fcb6f400640 1 --2- 172.21.15.152:0/1097328869 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fcb4c0683b0 0x7fcb4c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:24.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.273+0000 7fcb6f400640 1 --2- 172.21.15.152:0/1097328869 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fcb4c0683b0 0x7fcb4c06a870 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcb600ad000 tx=0x7fcb600a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:24.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.277+0000 7fcb67e00640 1 -- 172.21.15.152:0/1097328869 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fcb68022020 con 0x7fcb70160720 2024-04-17T08:47:24.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.433+0000 7fcb76800640 1 -- 172.21.15.152:0/1097328869 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fcb7006d660 con 0x7fcb70160720 2024-04-17T08:47:24.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.433+0000 7fcb67e00640 1 -- 172.21.15.152:0/1097328869 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7fcb68010040 con 0x7fcb70160720 2024-04-17T08:47:24.437 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-04-17T08:47:24.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.437+0000 7fcb76800640 1 -- 172.21.15.152:0/1097328869 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fcb4c0683b0 msgr2=0x7fcb4c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:24.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.437+0000 7fcb76800640 1 --2- 172.21.15.152:0/1097328869 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fcb4c0683b0 0x7fcb4c06a870 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcb600ad000 tx=0x7fcb600a6000 comp rx=0 tx=0).stop 2024-04-17T08:47:24.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.437+0000 7fcb76800640 1 -- 172.21.15.152:0/1097328869 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb70160720 msgr2=0x7fcb70098ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:24.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.437+0000 7fcb76800640 1 --2- 172.21.15.152:0/1097328869 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb70160720 0x7fcb70098ef0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fcb6800efc0 tx=0x7fcb6800c490 comp rx=0 tx=0).stop 2024-04-17T08:47:24.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.437+0000 7fcb76800640 1 -- 172.21.15.152:0/1097328869 shutdown_connections 2024-04-17T08:47:24.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.437+0000 7fcb76800640 1 --2- 172.21.15.152:0/1097328869 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb70160720 0x7fcb70098ef0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:24.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.437+0000 7fcb76800640 1 --2- 172.21.15.152:0/1097328869 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcb7015d710 0x7fcb70155bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:24.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.437+0000 7fcb76800640 1 --2- 172.21.15.152:0/1097328869 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fcb4c0683b0 0x7fcb4c06a870 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:24.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.437+0000 7fcb76800640 1 --2- 172.21.15.152:0/1097328869 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcb7015a010 0x7fcb7015bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:24.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.437+0000 7fcb76800640 1 -- 172.21.15.152:0/1097328869 >> 172.21.15.152:0/1097328869 conn(0x7fcb700b3350 msgr2=0x7fcb70158020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:24.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.437+0000 7fcb76800640 1 -- 172.21.15.152:0/1097328869 shutdown_connections 2024-04-17T08:47:24.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.437+0000 7fcb76800640 1 -- 172.21.15.152:0/1097328869 wait complete. 2024-04-17T08:47:24.459 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-17T08:47:24.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.593+0000 7f7cada00640 1 Processor -- start 2024-04-17T08:47:24.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.593+0000 7f7cada00640 1 -- start start 2024-04-17T08:47:24.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.597+0000 7f7cada00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7ca815c170 0x7f7ca80ad100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:24.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.597+0000 7f7cada00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7ca80d0810 0x7f7ca806b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:24.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.597+0000 7f7cada00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ca815fe90 con 0x7f7ca80af7d0 2024-04-17T08:47:24.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.597+0000 7f7cada00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f7ca806ff70 con 0x7f7ca80d0810 2024-04-17T08:47:24.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.597+0000 7f7cada00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f7ca81607c0 con 0x7f7ca815c170 2024-04-17T08:47:24.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.597+0000 7f7cad000640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7ca80d0810 0x7f7ca806b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:24.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.597+0000 7f7cad000640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7ca80d0810 0x7f7ca806b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56964/0 (socket says 172.21.15.152:56964) 2024-04-17T08:47:24.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.597+0000 7f7cad000640 1 -- 172.21.15.152:0/1183725678 learned_addr learned my addr 172.21.15.152:0/1183725678 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:24.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.597+0000 7f7ca7e00640 1 --2- 172.21.15.152:0/1183725678 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7ca815c170 0x7f7ca80ad100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:24.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.597+0000 7f7cad000640 1 -- 172.21.15.152:0/1183725678 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7ca815c170 msgr2=0x7f7ca80ad100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:24.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.597+0000 7f7cad000640 1 --2- 172.21.15.152:0/1183725678 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7ca815c170 0x7f7ca80ad100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:24.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.597+0000 7f7cad000640 1 -- 172.21.15.152:0/1183725678 >> v1:172.21.15.196:6789/0 conn(0x7f7ca80af7d0 legacy=0x7f7ca80d0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:24.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.597+0000 7f7cad000640 1 -- 172.21.15.152:0/1183725678 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ca8160170 con 0x7f7ca80d0810 2024-04-17T08:47:24.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.597+0000 7f7ca7e00640 1 --2- 172.21.15.152:0/1183725678 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7ca815c170 0x7f7ca80ad100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:24.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.597+0000 7f7cad000640 1 --2- 172.21.15.152:0/1183725678 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ca80d0810 0x7f7ca806b9b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0009870 tx=0x7f7ca001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efb13ed6fc67f726 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:24.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.601+0000 7f7ca6a00640 1 -- 172.21.15.152:0/1183725678 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca00a7070 con 0x7f7ca80d0810 2024-04-17T08:47:24.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.601+0000 7f7ca6a00640 1 -- 172.21.15.152:0/1183725678 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ca00b0070 con 0x7f7ca80d0810 2024-04-17T08:47:24.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.601+0000 7f7ca6a00640 1 -- 172.21.15.152:0/1183725678 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca00ab890 con 0x7f7ca80d0810 2024-04-17T08:47:24.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.601+0000 7f7cada00640 1 -- 172.21.15.152:0/1183725678 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ca80d0810 msgr2=0x7f7ca806b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:24.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.601+0000 7f7cada00640 1 --2- 172.21.15.152:0/1183725678 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ca80d0810 0x7f7ca806b9b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0009870 tx=0x7f7ca001c560 comp rx=0 tx=0).stop 2024-04-17T08:47:24.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.601+0000 7f7cada00640 1 -- 172.21.15.152:0/1183725678 shutdown_connections 2024-04-17T08:47:24.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.601+0000 7f7cada00640 1 --2- 172.21.15.152:0/1183725678 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ca80d0810 0x7f7ca806b9b0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:24.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.601+0000 7f7cada00640 1 --2- 172.21.15.152:0/1183725678 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7ca815c170 0x7f7ca80ad100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:24.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.601+0000 7f7cada00640 1 -- 172.21.15.152:0/1183725678 >> 172.21.15.152:0/1183725678 conn(0x7f7ca80b5280 msgr2=0x7f7ca80b3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:24.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.601+0000 7f7cada00640 1 -- 172.21.15.152:0/1183725678 shutdown_connections 2024-04-17T08:47:24.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.601+0000 7f7cada00640 1 -- 172.21.15.152:0/1183725678 wait complete. 2024-04-17T08:47:24.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.601+0000 7f7cada00640 1 Processor -- start 2024-04-17T08:47:24.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.601+0000 7f7cada00640 1 -- start start 2024-04-17T08:47:24.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.601+0000 7f7cada00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ca80af7d0 0x7f7ca80998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:24.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.601+0000 7f7cada00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ca80d0810 0x7f7ca814fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:24.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.601+0000 7f7cada00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7ca815c170 0x7f7ca81500d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:24.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.601+0000 7f7cada00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7ca80ad860 con 0x7f7ca80d0810 2024-04-17T08:47:24.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.601+0000 7f7cada00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f7ca80ad6e0 con 0x7f7ca80af7d0 2024-04-17T08:47:24.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.601+0000 7f7cada00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f7ca806c700 con 0x7f7ca815c170 2024-04-17T08:47:24.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.601+0000 7f7ca7400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ca80d0810 0x7f7ca814fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:24.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.601+0000 7f7ca7400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ca80d0810 0x7f7ca814fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56980/0 (socket says 172.21.15.152:56980) 2024-04-17T08:47:24.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.601+0000 7f7ca7400640 1 -- 172.21.15.152:0/1154696693 learned_addr learned my addr 172.21.15.152:0/1154696693 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:24.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.601+0000 7f7ca7e00640 1 --2- 172.21.15.152:0/1154696693 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ca80af7d0 0x7f7ca80998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:24.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.605+0000 7f7cad000640 1 --2- 172.21.15.152:0/1154696693 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7ca815c170 0x7f7ca81500d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:24.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.605+0000 7f7ca7400640 1 -- 172.21.15.152:0/1154696693 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7ca815c170 msgr2=0x7f7ca81500d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:24.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.605+0000 7f7ca7400640 1 --2- 172.21.15.152:0/1154696693 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7ca815c170 0x7f7ca81500d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:24.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.605+0000 7f7ca7400640 1 -- 172.21.15.152:0/1154696693 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ca80af7d0 msgr2=0x7f7ca80998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:24.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.605+0000 7f7ca7400640 1 --2- 172.21.15.152:0/1154696693 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ca80af7d0 0x7f7ca80998d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:24.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.605+0000 7f7ca7400640 1 -- 172.21.15.152:0/1154696693 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ca815a450 con 0x7f7ca80d0810 2024-04-17T08:47:24.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.605+0000 7f7ca7e00640 1 --2- 172.21.15.152:0/1154696693 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ca80af7d0 0x7f7ca80998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:24.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.605+0000 7f7ca7400640 1 --2- 172.21.15.152:0/1154696693 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ca80d0810 0x7f7ca814fb90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7c9400c450 tx=0x7f7c9400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:24.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.605+0000 7f7c9fe00640 1 -- 172.21.15.152:0/1154696693 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c94016020 con 0x7f7ca80d0810 2024-04-17T08:47:24.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.605+0000 7f7c9fe00640 1 -- 172.21.15.152:0/1154696693 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c940052d0 con 0x7f7ca80d0810 2024-04-17T08:47:24.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.605+0000 7f7cada00640 1 -- 172.21.15.152:0/1154696693 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ca815a730 con 0x7f7ca80d0810 2024-04-17T08:47:24.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.605+0000 7f7c9fe00640 1 -- 172.21.15.152:0/1154696693 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c94007260 con 0x7f7ca80d0810 2024-04-17T08:47:24.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.605+0000 7f7cada00640 1 -- 172.21.15.152:0/1154696693 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ca815acf0 con 0x7f7ca80d0810 2024-04-17T08:47:24.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.605+0000 7f7cada00640 1 -- 172.21.15.152:0/1154696693 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ca8075be0 con 0x7f7ca80d0810 2024-04-17T08:47:24.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.605+0000 7f7c9fe00640 1 -- 172.21.15.152:0/1154696693 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7c94007400 con 0x7f7ca80d0810 2024-04-17T08:47:24.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.605+0000 7f7c9fe00640 1 --2- 172.21.15.152:0/1154696693 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f7c880683b0 0x7f7c8806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:24.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.605+0000 7f7c9fe00640 1 -- 172.21.15.152:0/1154696693 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f7c940867b0 con 0x7f7ca80d0810 2024-04-17T08:47:24.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.605+0000 7f7ca7e00640 1 --2- 172.21.15.152:0/1154696693 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f7c880683b0 0x7f7c8806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:24.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.609+0000 7f7ca7e00640 1 --2- 172.21.15.152:0/1154696693 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f7c880683b0 0x7f7c8806a870 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7c980044f0 tx=0x7f7c98003a40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:24.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.609+0000 7f7c9fe00640 1 -- 172.21.15.152:0/1154696693 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f7c94020020 con 0x7f7ca80d0810 2024-04-17T08:47:24.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.765+0000 7f7cada00640 1 -- 172.21.15.152:0/1154696693 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f7ca80cfb50 con 0x7f7ca80d0810 2024-04-17T08:47:24.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.765+0000 7f7c9fe00640 1 -- 172.21.15.152:0/1154696693 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f7c94005480 con 0x7f7ca80d0810 2024-04-17T08:47:24.769 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 64 2024-04-17T08:47:24.771 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.769+0000 7f7cada00640 1 -- 172.21.15.152:0/1154696693 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f7c880683b0 msgr2=0x7f7c8806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:24.771 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.769+0000 7f7cada00640 1 --2- 172.21.15.152:0/1154696693 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f7c880683b0 0x7f7c8806a870 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7c980044f0 tx=0x7f7c98003a40 comp rx=0 tx=0).stop 2024-04-17T08:47:24.771 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.769+0000 7f7cada00640 1 -- 172.21.15.152:0/1154696693 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ca80d0810 msgr2=0x7f7ca814fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:24.771 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.769+0000 7f7cada00640 1 --2- 172.21.15.152:0/1154696693 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ca80d0810 0x7f7ca814fb90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7c9400c450 tx=0x7f7c9400c910 comp rx=0 tx=0).stop 2024-04-17T08:47:24.771 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.769+0000 7f7cada00640 1 -- 172.21.15.152:0/1154696693 shutdown_connections 2024-04-17T08:47:24.771 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.769+0000 7f7cada00640 1 --2- 172.21.15.152:0/1154696693 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f7c880683b0 0x7f7c8806a870 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:24.772 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.769+0000 7f7cada00640 1 --2- 172.21.15.152:0/1154696693 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7ca815c170 0x7f7ca81500d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:24.772 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.769+0000 7f7cada00640 1 --2- 172.21.15.152:0/1154696693 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ca80d0810 0x7f7ca814fb90 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:24.772 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.769+0000 7f7cada00640 1 --2- 172.21.15.152:0/1154696693 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ca80af7d0 0x7f7ca80998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:24.772 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.769+0000 7f7cada00640 1 -- 172.21.15.152:0/1154696693 >> 172.21.15.152:0/1154696693 conn(0x7f7ca80b5280 msgr2=0x7f7ca815c840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:24.772 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.769+0000 7f7cada00640 1 -- 172.21.15.152:0/1154696693 shutdown_connections 2024-04-17T08:47:24.772 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.769+0000 7f7cada00640 1 -- 172.21.15.152:0/1154696693 wait complete. 2024-04-17T08:47:24.790 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-17T08:47:24.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.925+0000 7f8dff000640 1 Processor -- start 2024-04-17T08:47:24.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.925+0000 7f8dff000640 1 -- start start 2024-04-17T08:47:24.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.929+0000 7f8dff000640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f8df815a010 0x7f8df80d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:24.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.929+0000 7f8dff000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8df8160720 0x7f8df80d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:24.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.929+0000 7f8dff000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8df8160d20 con 0x7f8df815d710 2024-04-17T08:47:24.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.929+0000 7f8dff000640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f8df815d280 con 0x7f8df815a010 2024-04-17T08:47:24.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.929+0000 7f8dff000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f8df815c9d0 con 0x7f8df8160720 2024-04-17T08:47:24.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.929+0000 7f8df7e00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f8df815a010 0x7f8df80d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:24.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.929+0000 7f8df7e00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f8df815a010 0x7f8df80d0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56996/0 (socket says 172.21.15.152:56996) 2024-04-17T08:47:24.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.929+0000 7f8df7e00640 1 -- 172.21.15.152:0/3609168745 learned_addr learned my addr 172.21.15.152:0/3609168745 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:24.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.929+0000 7f8dfd000640 1 --2- 172.21.15.152:0/3609168745 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8df8160720 0x7f8df80d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:24.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.929+0000 7f8df7e00640 1 -- 172.21.15.152:0/3609168745 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8df8160720 msgr2=0x7f8df80d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:24.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.929+0000 7f8df7e00640 1 --2- 172.21.15.152:0/3609168745 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8df8160720 0x7f8df80d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:24.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.929+0000 7f8df7e00640 1 -- 172.21.15.152:0/3609168745 >> v1:172.21.15.196:6789/0 conn(0x7f8df815d710 legacy=0x7f8df8160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:24.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.929+0000 7f8df7e00640 1 -- 172.21.15.152:0/3609168745 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8df815cc30 con 0x7f8df815a010 2024-04-17T08:47:24.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.929+0000 7f8dfd000640 1 --2- 172.21.15.152:0/3609168745 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8df8160720 0x7f8df80d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:24.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.933+0000 7f8df7e00640 1 --2- 172.21.15.152:0/3609168745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8df815a010 0x7f8df80d0360 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8de0009870 tx=0x7f8de001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93370d6e39cbcffe server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:24.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.933+0000 7f8df6a00640 1 -- 172.21.15.152:0/3609168745 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de00b0070 con 0x7f8df815a010 2024-04-17T08:47:24.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.933+0000 7f8df6a00640 1 -- 172.21.15.152:0/3609168745 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8de00ab600 con 0x7f8df815a010 2024-04-17T08:47:24.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.933+0000 7f8df6a00640 1 -- 172.21.15.152:0/3609168745 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de00ab9d0 con 0x7f8df815a010 2024-04-17T08:47:24.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.933+0000 7f8dff000640 1 -- 172.21.15.152:0/3609168745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8df815a010 msgr2=0x7f8df80d0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:24.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.933+0000 7f8dff000640 1 --2- 172.21.15.152:0/3609168745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8df815a010 0x7f8df80d0360 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8de0009870 tx=0x7f8de001c4d0 comp rx=0 tx=0).stop 2024-04-17T08:47:24.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.933+0000 7f8dff000640 1 -- 172.21.15.152:0/3609168745 shutdown_connections 2024-04-17T08:47:24.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.933+0000 7f8dff000640 1 --2- 172.21.15.152:0/3609168745 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8df8160720 0x7f8df80d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:24.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.933+0000 7f8dff000640 1 --2- 172.21.15.152:0/3609168745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8df815a010 0x7f8df80d0360 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:24.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.933+0000 7f8dff000640 1 -- 172.21.15.152:0/3609168745 >> 172.21.15.152:0/3609168745 conn(0x7f8df80b3350 msgr2=0x7f8df80b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:24.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.933+0000 7f8dff000640 1 -- 172.21.15.152:0/3609168745 shutdown_connections 2024-04-17T08:47:24.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.933+0000 7f8dff000640 1 -- 172.21.15.152:0/3609168745 wait complete. 2024-04-17T08:47:24.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.933+0000 7f8dff000640 1 Processor -- start 2024-04-17T08:47:24.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.933+0000 7f8dff000640 1 -- start start 2024-04-17T08:47:24.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.933+0000 7f8dff000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8df815a010 0x7f8df80ad510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:24.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.933+0000 7f8dff000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8df815d710 0x7f8df8099440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:24.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.933+0000 7f8dff000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8df8160720 0x7f8df806dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:24.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.933+0000 7f8dff000640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8df815e780 con 0x7f8df8160720 2024-04-17T08:47:24.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.933+0000 7f8dff000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8df815e600 con 0x7f8df815a010 2024-04-17T08:47:24.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.933+0000 7f8dff000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f8df815e900 con 0x7f8df815d710 2024-04-17T08:47:24.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.933+0000 7f8dfd000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8df8160720 0x7f8df806dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:24.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.933+0000 7f8dfd000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8df8160720 0x7f8df806dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56998/0 (socket says 172.21.15.152:56998) 2024-04-17T08:47:24.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.933+0000 7f8dfd000640 1 -- 172.21.15.152:0/2909206525 learned_addr learned my addr 172.21.15.152:0/2909206525 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:24.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.937+0000 7f8df7e00640 1 --2- 172.21.15.152:0/2909206525 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8df815a010 0x7f8df80ad510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:24.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.937+0000 7f8df7400640 1 --2- 172.21.15.152:0/2909206525 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8df815d710 0x7f8df8099440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:24.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.937+0000 7f8dfd000640 1 -- 172.21.15.152:0/2909206525 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8df815d710 msgr2=0x7f8df8099440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:24.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.937+0000 7f8dfd000640 1 --2- 172.21.15.152:0/2909206525 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8df815d710 0x7f8df8099440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:24.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.937+0000 7f8dfd000640 1 -- 172.21.15.152:0/2909206525 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8df815a010 msgr2=0x7f8df80ad510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:24.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.937+0000 7f8dfd000640 1 --2- 172.21.15.152:0/2909206525 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8df815a010 0x7f8df80ad510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:24.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.937+0000 7f8dfd000640 1 -- 172.21.15.152:0/2909206525 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8df815b790 con 0x7f8df8160720 2024-04-17T08:47:24.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.937+0000 7f8df7400640 1 --2- 172.21.15.152:0/2909206525 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8df815d710 0x7f8df8099440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:24.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.937+0000 7f8dfd000640 1 --2- 172.21.15.152:0/2909206525 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8df8160720 0x7f8df806dc60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8df0007e70 tx=0x7f8df000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:24.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.937+0000 7f8defe00640 1 -- 172.21.15.152:0/2909206525 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df001a070 con 0x7f8df8160720 2024-04-17T08:47:24.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.937+0000 7f8defe00640 1 -- 172.21.15.152:0/2909206525 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8df0003bc0 con 0x7f8df8160720 2024-04-17T08:47:24.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.937+0000 7f8defe00640 1 -- 172.21.15.152:0/2909206525 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df0004030 con 0x7f8df8160720 2024-04-17T08:47:24.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.937+0000 7f8dff000640 1 -- 172.21.15.152:0/2909206525 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8df815ba70 con 0x7f8df8160720 2024-04-17T08:47:24.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.937+0000 7f8dff000640 1 -- 172.21.15.152:0/2909206525 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8df8099980 con 0x7f8df8160720 2024-04-17T08:47:24.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.937+0000 7f8dff000640 1 -- 172.21.15.152:0/2909206525 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8df815c530 con 0x7f8df8160720 2024-04-17T08:47:24.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.937+0000 7f8defe00640 1 -- 172.21.15.152:0/2909206525 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8df001d070 con 0x7f8df8160720 2024-04-17T08:47:24.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.937+0000 7f8defe00640 1 --2- 172.21.15.152:0/2909206525 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8dd4068380 0x7f8dd406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:24.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.941+0000 7f8defe00640 1 -- 172.21.15.152:0/2909206525 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f8df0086ff0 con 0x7f8df8160720 2024-04-17T08:47:24.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.941+0000 7f8df7e00640 1 --2- 172.21.15.152:0/2909206525 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8dd4068380 0x7f8dd406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:24.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.941+0000 7f8df7e00640 1 --2- 172.21.15.152:0/2909206525 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8dd4068380 0x7f8dd406a840 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8de00ad000 tx=0x7f8de00a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:24.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:24.941+0000 7f8defe00640 1 -- 172.21.15.152:0/2909206525 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f8df815c530 con 0x7f8df8160720 2024-04-17T08:47:25.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.101+0000 7f8dff000640 1 -- 172.21.15.152:0/2909206525 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f8df8068a30 con 0x7f8df8160720 2024-04-17T08:47:25.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.101+0000 7f8defe00640 1 -- 172.21.15.152:0/2909206525 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f8df0010070 con 0x7f8df8160720 2024-04-17T08:47:25.102 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-04-17T08:47:25.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.101+0000 7f8dff000640 1 -- 172.21.15.152:0/2909206525 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8dd4068380 msgr2=0x7f8dd406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:25.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.101+0000 7f8dff000640 1 --2- 172.21.15.152:0/2909206525 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8dd4068380 0x7f8dd406a840 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8de00ad000 tx=0x7f8de00a6000 comp rx=0 tx=0).stop 2024-04-17T08:47:25.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.101+0000 7f8dff000640 1 -- 172.21.15.152:0/2909206525 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8df8160720 msgr2=0x7f8df806dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:25.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.101+0000 7f8dff000640 1 --2- 172.21.15.152:0/2909206525 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8df8160720 0x7f8df806dc60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8df0007e70 tx=0x7f8df000d4a0 comp rx=0 tx=0).stop 2024-04-17T08:47:25.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.101+0000 7f8dff000640 1 -- 172.21.15.152:0/2909206525 shutdown_connections 2024-04-17T08:47:25.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.101+0000 7f8dff000640 1 --2- 172.21.15.152:0/2909206525 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8df8160720 0x7f8df806dc60 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:25.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.101+0000 7f8dff000640 1 --2- 172.21.15.152:0/2909206525 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8dd4068380 0x7f8dd406a840 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:25.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.101+0000 7f8dff000640 1 --2- 172.21.15.152:0/2909206525 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8df815d710 0x7f8df8099440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:25.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.101+0000 7f8dff000640 1 --2- 172.21.15.152:0/2909206525 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8df815a010 0x7f8df80ad510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:25.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.101+0000 7f8dff000640 1 -- 172.21.15.152:0/2909206525 >> 172.21.15.152:0/2909206525 conn(0x7f8df80b3350 msgr2=0x7f8df80aeeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:25.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.101+0000 7f8dff000640 1 -- 172.21.15.152:0/2909206525 shutdown_connections 2024-04-17T08:47:25.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.101+0000 7f8dff000640 1 -- 172.21.15.152:0/2909206525 wait complete. 2024-04-17T08:47:25.147 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-04-17T08:47:25.148 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T08:47:25.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.281+0000 7f7938600640 1 Processor -- start 2024-04-17T08:47:25.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.281+0000 7f7938600640 1 -- start start 2024-04-17T08:47:25.284 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.281+0000 7f7938600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7930153610 0x7f793015c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:25.284 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.281+0000 7f7938600640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f793006f600 con 0x7f79300d18a0 2024-04-17T08:47:25.284 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.281+0000 7f7938600640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f793015cff0 con 0x7f7930153230 2024-04-17T08:47:25.284 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.281+0000 7f7938600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f793015d2d0 con 0x7f7930153610 2024-04-17T08:47:25.284 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.281+0000 7f7936600640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f79300d18a0 0x7f793006fae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:52398/0 (socket says 172.21.15.152:52398) 2024-04-17T08:47:25.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.281+0000 7f7936600640 1 -- 172.21.15.152:0/3412996387 learned_addr learned my addr 172.21.15.152:0/3412996387 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:25.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.281+0000 7f792fe00640 1 -- 172.21.15.152:0/3412996387 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2875146594 0 0) 0x7f793006f600 con 0x7f79300d18a0 2024-04-17T08:47:25.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.281+0000 7f792fe00640 1 -- 172.21.15.152:0/3412996387 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7918003530 con 0x7f79300d18a0 2024-04-17T08:47:25.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.281+0000 7f7935200640 1 --2- 172.21.15.152:0/3412996387 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7930153610 0x7f793015c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:25.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.281+0000 7f792fe00640 1 -- 172.21.15.152:0/3412996387 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 930781040 0 0) 0x7f7918003530 con 0x7f79300d18a0 2024-04-17T08:47:25.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.281+0000 7f792fe00640 1 -- 172.21.15.152:0/3412996387 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7930153610 msgr2=0x7f793015c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:25.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.281+0000 7f792fe00640 1 --2- 172.21.15.152:0/3412996387 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7930153610 0x7f793015c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:25.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.281+0000 7f792fe00640 1 -- 172.21.15.152:0/3412996387 >> v1:172.21.15.196:6789/0 conn(0x7f7930153230 legacy=0x7f79300ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:25.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.281+0000 7f792fe00640 1 -- 172.21.15.152:0/3412996387 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f793015d5b0 con 0x7f79300d18a0 2024-04-17T08:47:25.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.281+0000 7f792fe00640 1 -- 172.21.15.152:0/3412996387 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2973887244 0 0) 0x7f7928001a00 con 0x7f79300d18a0 2024-04-17T08:47:25.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.281+0000 7f792fe00640 1 -- 172.21.15.152:0/3412996387 >> v1:172.21.15.152:6789/0 conn(0x7f79300d18a0 legacy=0x7f793006fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:25.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.281+0000 7f792fe00640 1 --2- 172.21.15.152:0/3412996387 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f79180039f0 0x7f7918003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:25.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.281+0000 7f792fe00640 1 --2- 172.21.15.152:0/3412996387 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7930153610 0x7f7918004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:25.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.281+0000 7f792fe00640 1 --2- 172.21.15.152:0/3412996387 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7918004d50 0x7f79180051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:25.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.281+0000 7f792fe00640 1 -- 172.21.15.152:0/3412996387 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f793015d2d0 con 0x7f7918004d50 2024-04-17T08:47:25.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.281+0000 7f792fe00640 1 -- 172.21.15.152:0/3412996387 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f791800bbb0 con 0x7f79180039f0 2024-04-17T08:47:25.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.281+0000 7f792fe00640 1 -- 172.21.15.152:0/3412996387 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f791800bdb0 con 0x7f7930153610 2024-04-17T08:47:25.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.285+0000 7f7936600640 1 --2- 172.21.15.152:0/3412996387 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7918004d50 0x7f79180051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:25.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.285+0000 7f7935200640 1 --2- 172.21.15.152:0/3412996387 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7930153610 0x7f7918004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:25.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.285+0000 7f7935c00640 1 --2- 172.21.15.152:0/3412996387 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f79180039f0 0x7f7918003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:25.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.285+0000 7f7936600640 1 -- 172.21.15.152:0/3412996387 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7930153610 msgr2=0x7f7918004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:25.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.285+0000 7f7936600640 1 --2- 172.21.15.152:0/3412996387 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7930153610 0x7f7918004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:25.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.285+0000 7f7936600640 1 -- 172.21.15.152:0/3412996387 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f79180039f0 msgr2=0x7f7918003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:25.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.285+0000 7f7936600640 1 --2- 172.21.15.152:0/3412996387 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f79180039f0 0x7f7918003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:25.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.285+0000 7f7936600640 1 -- 172.21.15.152:0/3412996387 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7918003530 con 0x7f7918004d50 2024-04-17T08:47:25.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.285+0000 7f7936600640 1 --2- 172.21.15.152:0/3412996387 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7918004d50 0x7f79180051d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f792800a7b0 tx=0x7f792801d2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0d6023280ff2c44 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:25.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.285+0000 7f792fe00640 1 -- 172.21.15.152:0/3412996387 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792800a3d0 con 0x7f7918004d50 2024-04-17T08:47:25.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.285+0000 7f792fe00640 1 -- 172.21.15.152:0/3412996387 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79280ad650 con 0x7f7918004d50 2024-04-17T08:47:25.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.285+0000 7f792fe00640 1 -- 172.21.15.152:0/3412996387 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79280ada80 con 0x7f7918004d50 2024-04-17T08:47:25.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.285+0000 7f7938600640 1 -- 172.21.15.152:0/3412996387 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7918004d50 msgr2=0x7f79180051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:25.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.285+0000 7f7938600640 1 --2- 172.21.15.152:0/3412996387 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7918004d50 0x7f79180051d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f792800a7b0 tx=0x7f792801d2e0 comp rx=0 tx=0).stop 2024-04-17T08:47:25.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.285+0000 7f7936600640 1 -- 172.21.15.152:0/3412996387 reap_dead start 2024-04-17T08:47:25.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.289+0000 7f7938600640 1 -- 172.21.15.152:0/3412996387 shutdown_connections 2024-04-17T08:47:25.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.289+0000 7f7938600640 1 -- 172.21.15.152:0/3412996387 >> 172.21.15.152:0/3412996387 conn(0x7f79300cf060 msgr2=0x7f79300cf470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:25.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.289+0000 7f7938600640 1 -- 172.21.15.152:0/3412996387 shutdown_connections 2024-04-17T08:47:25.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.289+0000 7f7938600640 1 -- 172.21.15.152:0/3412996387 wait complete. 2024-04-17T08:47:25.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.289+0000 7f7938600640 1 Processor -- start 2024-04-17T08:47:25.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.289+0000 7f7938600640 1 -- start start 2024-04-17T08:47:25.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.289+0000 7f7938600640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7918004d50 0x7f79300c8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:25.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.289+0000 7f7938600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f79300c4b70 0x7f79300cbc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:25.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.289+0000 7f7938600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f793015eee0 0x7f793015f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:25.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.289+0000 7f7938600640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7930070370 con 0x7f7918004d50 2024-04-17T08:47:25.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.289+0000 7f7938600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f79300701f0 con 0x7f79300c4b70 2024-04-17T08:47:25.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.289+0000 7f7938600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f793015c9e0 con 0x7f793015eee0 2024-04-17T08:47:25.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.289+0000 7f7935c00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7918004d50 0x7f79300c8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:25.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.289+0000 7f7935c00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7918004d50 0x7f79300c8820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57010/0 (socket says 172.21.15.152:57010) 2024-04-17T08:47:25.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.289+0000 7f7935c00640 1 -- 172.21.15.152:0/297230369 learned_addr learned my addr 172.21.15.152:0/297230369 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:25.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.289+0000 7f7936600640 1 --2- 172.21.15.152:0/297230369 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f793015eee0 0x7f793015f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:25.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.289+0000 7f7935200640 1 --2- 172.21.15.152:0/297230369 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f79300c4b70 0x7f79300cbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:25.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.289+0000 7f7935c00640 1 -- 172.21.15.152:0/297230369 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f793015eee0 msgr2=0x7f793015f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:25.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.289+0000 7f7935c00640 1 --2- 172.21.15.152:0/297230369 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f793015eee0 0x7f793015f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:25.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.289+0000 7f7935c00640 1 -- 172.21.15.152:0/297230369 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f79300c4b70 msgr2=0x7f79300cbc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:25.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.289+0000 7f7935c00640 1 --2- 172.21.15.152:0/297230369 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f79300c4b70 0x7f79300cbc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:25.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.289+0000 7f7935c00640 1 -- 172.21.15.152:0/297230369 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79300cabf0 con 0x7f7918004d50 2024-04-17T08:47:25.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.289+0000 7f7935200640 1 --2- 172.21.15.152:0/297230369 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f79300c4b70 0x7f79300cbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:25.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.289+0000 7f7935c00640 1 --2- 172.21.15.152:0/297230369 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7918004d50 0x7f79300c8820 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f792400f820 tx=0x7f792400fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:25.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.289+0000 7f792d600640 1 -- 172.21.15.152:0/297230369 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7924001cf0 con 0x7f7918004d50 2024-04-17T08:47:25.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.289+0000 7f792d600640 1 -- 172.21.15.152:0/297230369 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7924018070 con 0x7f7918004d50 2024-04-17T08:47:25.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.289+0000 7f7938600640 1 -- 172.21.15.152:0/297230369 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79300caed0 con 0x7f7918004d50 2024-04-17T08:47:25.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.289+0000 7f792d600640 1 -- 172.21.15.152:0/297230369 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792400d730 con 0x7f7918004d50 2024-04-17T08:47:25.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.293+0000 7f7938600640 1 -- 172.21.15.152:0/297230369 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79300cb490 con 0x7f7918004d50 2024-04-17T08:47:25.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.293+0000 7f7938600640 1 -- 172.21.15.152:0/297230369 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f793015f8a0 con 0x7f7918004d50 2024-04-17T08:47:25.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.293+0000 7f792d600640 1 -- 172.21.15.152:0/297230369 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f792400d8d0 con 0x7f7918004d50 2024-04-17T08:47:25.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.293+0000 7f792d600640 1 --2- 172.21.15.152:0/297230369 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f79100683b0 0x7f791006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:25.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.293+0000 7f792d600640 1 -- 172.21.15.152:0/297230369 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f7924086cd0 con 0x7f7918004d50 2024-04-17T08:47:25.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.293+0000 7f7935200640 1 --2- 172.21.15.152:0/297230369 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f79100683b0 0x7f791006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:25.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.293+0000 7f7935200640 1 --2- 172.21.15.152:0/297230369 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f79100683b0 0x7f791006a870 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f79300cd560 tx=0x7f791c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:25.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.297+0000 7f792d600640 1 -- 172.21.15.152:0/297230369 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f7924056dd0 con 0x7f7918004d50 2024-04-17T08:47:25.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.457+0000 7f7938600640 1 -- 172.21.15.152:0/297230369 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7930068a30 con 0x7f7918004d50 2024-04-17T08:47:25.462 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.461+0000 7f792d600640 1 -- 172.21.15.152:0/297230369 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18972 (secure 0 0 0) 0x7f79240566d0 con 0x7f7918004d50 2024-04-17T08:47:25.463 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:47:25.463 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":26,"fsid":"ce68f82e-ec5f-4205-9fd5-bdfdf6ef31e2","created":"2024-04-17T08:46:08.353546+0000","modified":"2024-04-17T08:47:15.280634+0000","last_up_change":"2024-04-17T08:46:20.738799+0000","last_in_change":"2024-04-17T08:46:11.210050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T08:46:21.386856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T08:46:31.812460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T08:46:32.555559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T08:46:36.258078+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"682f0192-187c-404e-bc7a-b6b4e23825e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6819","nonce":3603799291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6823","nonce":3603799291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6831","nonce":3603799291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6827","nonce":3603799291}]},"public_addr":"172.21.15.152:6819/3603799291","cluster_addr":"172.21.15.152:6823/3603799291","heartbeat_back_addr":"172.21.15.152:6831/3603799291","heartbeat_front_addr":"172.21.15.152:6827/3603799291","state":["exists","up"]},{"osd":1,"uuid":"f0fe8fef-60ec-4a39-83b6-2fa6a5adb0f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6801","nonce":4133383142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6803","nonce":4133383142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6807","nonce":4133383142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6805","nonce":4133383142}]},"public_addr":"172.21.15.152:6801/4133383142","cluster_addr":"172.21.15.152:6803/4133383142","heartbeat_back_addr":"172.21.15.152:6807/4133383142","heartbeat_front_addr":"172.21.15.152:6805/4133383142","state":["exists","up"]},{"osd":2,"uuid":"35f36d9c-5245-4431-a618-f4df0fa380ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6809","nonce":3826143898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6811","nonce":3826143898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6815","nonce":3826143898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6813","nonce":3826143898}]},"public_addr":"172.21.15.152:6809/3826143898","cluster_addr":"172.21.15.152:6811/3826143898","heartbeat_back_addr":"172.21.15.152:6815/3826143898","heartbeat_front_addr":"172.21.15.152:6813/3826143898","state":["exists","up"]},{"osd":3,"uuid":"96e56ca5-15b4-4895-9b79-da2c92043159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6818","nonce":165717826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6822","nonce":165717826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6830","nonce":165717826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6826","nonce":165717826}]},"public_addr":"172.21.15.152:6818/165717826","cluster_addr":"172.21.15.152:6822/165717826","heartbeat_back_addr":"172.21.15.152:6830/165717826","heartbeat_front_addr":"172.21.15.152:6826/165717826","state":["exists","up"]},{"osd":4,"uuid":"f5aa10a4-9ff9-41fe-a5c9-15326f982cc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6817","nonce":4080159297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6819","nonce":4080159297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6823","nonce":4080159297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6821","nonce":4080159297}]},"public_addr":"172.21.15.196:6817/4080159297","cluster_addr":"172.21.15.196:6819/4080159297","heartbeat_back_addr":"172.21.15.196:6823/4080159297","heartbeat_front_addr":"172.21.15.196:6821/4080159297","state":["exists","up"]},{"osd":5,"uuid":"42bab884-3476-47ae-ac65-935fa6e0f055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6801","nonce":3519444232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6803","nonce":3519444232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6807","nonce":3519444232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6805","nonce":3519444232}]},"public_addr":"172.21.15.196:6801/3519444232","cluster_addr":"172.21.15.196:6803/3519444232","heartbeat_back_addr":"172.21.15.196:6807/3519444232","heartbeat_front_addr":"172.21.15.196:6805/3519444232","state":["exists","up"]},{"osd":6,"uuid":"460b6167-f57b-4224-9c92-cfc9b80bbe99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6809","nonce":275739834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6811","nonce":275739834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6815","nonce":275739834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6813","nonce":275739834}]},"public_addr":"172.21.15.196:6809/275739834","cluster_addr":"172.21.15.196:6811/275739834","heartbeat_back_addr":"172.21.15.196:6815/275739834","heartbeat_front_addr":"172.21.15.196:6813/275739834","state":["exists","up"]},{"osd":7,"uuid":"d695643f-5e07-4e2a-a646-c06bd97b6650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6825","nonce":307626968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6827","nonce":307626968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6831","nonce":307626968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6829","nonce":307626968}]},"public_addr":"172.21.15.196:6825/307626968","cluster_addr":"172.21.15.196:6827/307626968","heartbeat_back_addr":"172.21.15.196:6831/307626968","heartbeat_front_addr":"172.21.15.196:6829/307626968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.293257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.964533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.248895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.010000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.832554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.743704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930171+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930962+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T08:47:25.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.461+0000 7f7938600640 1 -- 172.21.15.152:0/297230369 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f79100683b0 msgr2=0x7f791006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:25.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.461+0000 7f7938600640 1 --2- 172.21.15.152:0/297230369 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f79100683b0 0x7f791006a870 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f79300cd560 tx=0x7f791c008040 comp rx=0 tx=0).stop 2024-04-17T08:47:25.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.461+0000 7f7938600640 1 -- 172.21.15.152:0/297230369 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7918004d50 msgr2=0x7f79300c8820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:25.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.461+0000 7f7938600640 1 --2- 172.21.15.152:0/297230369 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7918004d50 0x7f79300c8820 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f792400f820 tx=0x7f792400fce0 comp rx=0 tx=0).stop 2024-04-17T08:47:25.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.461+0000 7f7938600640 1 -- 172.21.15.152:0/297230369 shutdown_connections 2024-04-17T08:47:25.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.461+0000 7f7938600640 1 --2- 172.21.15.152:0/297230369 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f79100683b0 0x7f791006a870 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:25.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.461+0000 7f7938600640 1 --2- 172.21.15.152:0/297230369 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f793015eee0 0x7f793015f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:25.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.461+0000 7f7938600640 1 --2- 172.21.15.152:0/297230369 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f79300c4b70 0x7f79300cbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:25.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.461+0000 7f7938600640 1 --2- 172.21.15.152:0/297230369 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7918004d50 0x7f79300c8820 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:25.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.461+0000 7f7938600640 1 -- 172.21.15.152:0/297230369 >> 172.21.15.152:0/297230369 conn(0x7f79300cf060 msgr2=0x7f793015ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:25.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.461+0000 7f7938600640 1 -- 172.21.15.152:0/297230369 shutdown_connections 2024-04-17T08:47:25.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.461+0000 7f7938600640 1 -- 172.21.15.152:0/297230369 wait complete. 2024-04-17T08:47:25.483 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T08:46:21.386856+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-17T08:46:31.812460+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-17T08:46:32.555559+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-17T08:46:36.258078+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-17T08:47:25.484 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T08:47:25.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.621+0000 7fdab5c00640 1 Processor -- start 2024-04-17T08:47:25.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.621+0000 7fdab5c00640 1 -- start start 2024-04-17T08:47:25.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.621+0000 7fdab5c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdab015c050 0x7fdab00cfdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:25.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.621+0000 7fdab5c00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fdab00d0310 0x7fdab006d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:25.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.621+0000 7fdab5c00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fdab006d940 0x7fdab0162100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:25.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.621+0000 7fdab5c00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fdab006edb0 con 0x7fdab00d0310 2024-04-17T08:47:25.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.621+0000 7fdab5c00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fdab006e1a0 con 0x7fdab006d940 2024-04-17T08:47:25.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.621+0000 7fdab5c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fdab006e480 con 0x7fdab015c050 2024-04-17T08:47:25.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.621+0000 7fdaa7400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fdab00d0310 0x7fdab006d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:25.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.621+0000 7fdaa7400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fdab00d0310 0x7fdab006d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57014/0 (socket says 172.21.15.152:57014) 2024-04-17T08:47:25.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.621+0000 7fdaa7400640 1 -- 172.21.15.152:0/115326190 learned_addr learned my addr 172.21.15.152:0/115326190 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:25.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.621+0000 7fdab5200640 1 --2- 172.21.15.152:0/115326190 >> v2:172.21.15.196:3300/0 conn(0x7fdab006d940 0x7fdab0162100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:25.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.621+0000 7fdaafe00640 1 --2- 172.21.15.152:0/115326190 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdab015c050 0x7fdab00cfdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:25.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.621+0000 7fdaa7400640 1 -- 172.21.15.152:0/115326190 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdab015c050 msgr2=0x7fdab00cfdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:25.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.621+0000 7fdaa7400640 1 --2- 172.21.15.152:0/115326190 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdab015c050 0x7fdab00cfdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:25.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.621+0000 7fdaa7400640 1 -- 172.21.15.152:0/115326190 >> v2:172.21.15.196:3300/0 conn(0x7fdab006d940 msgr2=0x7fdab0162100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:25.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.621+0000 7fdaa7400640 1 --2- 172.21.15.152:0/115326190 >> v2:172.21.15.196:3300/0 conn(0x7fdab006d940 0x7fdab0162100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:25.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.621+0000 7fdaa7400640 1 -- 172.21.15.152:0/115326190 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdab006e760 con 0x7fdab00d0310 2024-04-17T08:47:25.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.625+0000 7fdaa7400640 1 --2- 172.21.15.152:0/115326190 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdab00d0310 0x7fdab006d400 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fdab00d21d0 tx=0x7fda9801c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b56ef7653aaf3b23 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:25.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.625+0000 7fdaaf400640 1 -- 172.21.15.152:0/115326190 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda980b0070 con 0x7fdab00d0310 2024-04-17T08:47:25.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.625+0000 7fdaaf400640 1 -- 172.21.15.152:0/115326190 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda980ab600 con 0x7fdab00d0310 2024-04-17T08:47:25.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.625+0000 7fdaaf400640 1 -- 172.21.15.152:0/115326190 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda980ab9d0 con 0x7fdab00d0310 2024-04-17T08:47:25.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.625+0000 7fdab5c00640 1 -- 172.21.15.152:0/115326190 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdab00d0310 msgr2=0x7fdab006d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:25.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.625+0000 7fdab5c00640 1 --2- 172.21.15.152:0/115326190 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdab00d0310 0x7fdab006d400 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fdab00d21d0 tx=0x7fda9801c260 comp rx=0 tx=0).stop 2024-04-17T08:47:25.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.625+0000 7fdab5c00640 1 -- 172.21.15.152:0/115326190 shutdown_connections 2024-04-17T08:47:25.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.625+0000 7fdab5c00640 1 --2- 172.21.15.152:0/115326190 >> v2:172.21.15.196:3300/0 conn(0x7fdab006d940 0x7fdab0162100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:25.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.625+0000 7fdab5c00640 1 --2- 172.21.15.152:0/115326190 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdab00d0310 0x7fdab006d400 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:25.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.625+0000 7fdab5c00640 1 --2- 172.21.15.152:0/115326190 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdab015c050 0x7fdab00cfdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:25.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.625+0000 7fdab5c00640 1 -- 172.21.15.152:0/115326190 >> 172.21.15.152:0/115326190 conn(0x7fdab00b3dd0 msgr2=0x7fdab00b41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:25.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.625+0000 7fdab5c00640 1 -- 172.21.15.152:0/115326190 shutdown_connections 2024-04-17T08:47:25.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.625+0000 7fdab5c00640 1 -- 172.21.15.152:0/115326190 wait complete. 2024-04-17T08:47:25.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.629+0000 7fdab5c00640 1 Processor -- start 2024-04-17T08:47:25.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.629+0000 7fdab5c00640 1 -- start start 2024-04-17T08:47:25.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.629+0000 7fdab5c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdab006d940 0x7fdab0158c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:25.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.629+0000 7fdab5c00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdab00d0310 0x7fdab0161250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:25.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.629+0000 7fdab5c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdab015c050 0x7fdab0161790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:25.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.629+0000 7fdab5c00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdab006dea0 con 0x7fdab00d0310 2024-04-17T08:47:25.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.629+0000 7fdab5c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fdab006dd20 con 0x7fdab015c050 2024-04-17T08:47:25.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.629+0000 7fdab5c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fdab015fc20 con 0x7fdab006d940 2024-04-17T08:47:25.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.629+0000 7fdaa7400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdab00d0310 0x7fdab0161250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:25.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.629+0000 7fdaa7400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdab00d0310 0x7fdab0161250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57024/0 (socket says 172.21.15.152:57024) 2024-04-17T08:47:25.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.629+0000 7fdaa7400640 1 -- 172.21.15.152:0/803161266 learned_addr learned my addr 172.21.15.152:0/803161266 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:25.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.629+0000 7fdaa7400640 1 -- 172.21.15.152:0/803161266 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdab006d940 msgr2=0x7fdab0158c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:25.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.629+0000 7fdaa7400640 1 --2- 172.21.15.152:0/803161266 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdab006d940 0x7fdab0158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:25.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.629+0000 7fdaa7400640 1 -- 172.21.15.152:0/803161266 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdab015c050 msgr2=0x7fdab0161790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:25.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.629+0000 7fdaa7400640 1 --2- 172.21.15.152:0/803161266 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdab015c050 0x7fdab0161790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:25.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.629+0000 7fdaa7400640 1 -- 172.21.15.152:0/803161266 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdab00c34d0 con 0x7fdab00d0310 2024-04-17T08:47:25.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.629+0000 7fdaa7400640 1 --2- 172.21.15.152:0/803161266 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdab00d0310 0x7fdab0161250 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fda9801cb00 tx=0x7fda98019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:25.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.629+0000 7fdaacc00640 1 -- 172.21.15.152:0/803161266 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda980ba070 con 0x7fdab00d0310 2024-04-17T08:47:25.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.629+0000 7fdaacc00640 1 -- 172.21.15.152:0/803161266 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda980b4420 con 0x7fdab00d0310 2024-04-17T08:47:25.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.629+0000 7fdaacc00640 1 -- 172.21.15.152:0/803161266 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda980b0040 con 0x7fdab00d0310 2024-04-17T08:47:25.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.629+0000 7fdab5c00640 1 -- 172.21.15.152:0/803161266 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdab00c37b0 con 0x7fdab00d0310 2024-04-17T08:47:25.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.629+0000 7fdab5c00640 1 -- 172.21.15.152:0/803161266 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdab00c3d70 con 0x7fdab00d0310 2024-04-17T08:47:25.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.629+0000 7fdab5c00640 1 -- 172.21.15.152:0/803161266 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdab0075be0 con 0x7fdab00d0310 2024-04-17T08:47:25.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.633+0000 7fdaacc00640 1 -- 172.21.15.152:0/803161266 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fda980bd070 con 0x7fdab00d0310 2024-04-17T08:47:25.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.633+0000 7fdaacc00640 1 --2- 172.21.15.152:0/803161266 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fda8c068380 0x7fda8c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:25.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.633+0000 7fdaacc00640 1 -- 172.21.15.152:0/803161266 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fda9811ffe0 con 0x7fdab00d0310 2024-04-17T08:47:25.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.633+0000 7fdaafe00640 1 --2- 172.21.15.152:0/803161266 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fda8c068380 0x7fda8c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:25.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.633+0000 7fdaafe00640 1 --2- 172.21.15.152:0/803161266 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fda8c068380 0x7fda8c06a840 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdaa000b850 tx=0x7fdaa0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:25.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.637+0000 7fdaacc00640 1 -- 172.21.15.152:0/803161266 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fda98016110 con 0x7fdab00d0310 2024-04-17T08:47:25.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.793+0000 7fdab5c00640 1 -- 172.21.15.152:0/803161266 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdab015f2f0 con 0x7fdab00d0310 2024-04-17T08:47:25.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.793+0000 7fdaacc00640 1 -- 172.21.15.152:0/803161266 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7fda980f0170 con 0x7fdab00d0310 2024-04-17T08:47:25.797 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2024-04-17T08:47:25.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.797+0000 7fdab5c00640 1 -- 172.21.15.152:0/803161266 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fda8c068380 msgr2=0x7fda8c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:25.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.797+0000 7fdab5c00640 1 --2- 172.21.15.152:0/803161266 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fda8c068380 0x7fda8c06a840 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdaa000b850 tx=0x7fdaa0008040 comp rx=0 tx=0).stop 2024-04-17T08:47:25.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.797+0000 7fdab5c00640 1 -- 172.21.15.152:0/803161266 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdab00d0310 msgr2=0x7fdab0161250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:25.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.797+0000 7fdab5c00640 1 --2- 172.21.15.152:0/803161266 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdab00d0310 0x7fdab0161250 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fda9801cb00 tx=0x7fda98019000 comp rx=0 tx=0).stop 2024-04-17T08:47:25.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.797+0000 7fdab5c00640 1 -- 172.21.15.152:0/803161266 shutdown_connections 2024-04-17T08:47:25.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.797+0000 7fdab5c00640 1 --2- 172.21.15.152:0/803161266 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdab015c050 0x7fdab0161790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:25.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.797+0000 7fdab5c00640 1 --2- 172.21.15.152:0/803161266 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdab00d0310 0x7fdab0161250 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:25.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.797+0000 7fdab5c00640 1 --2- 172.21.15.152:0/803161266 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fda8c068380 0x7fda8c06a840 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:25.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.797+0000 7fdab5c00640 1 --2- 172.21.15.152:0/803161266 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdab006d940 0x7fdab0158c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:25.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.797+0000 7fdab5c00640 1 -- 172.21.15.152:0/803161266 >> 172.21.15.152:0/803161266 conn(0x7fdab00b3dd0 msgr2=0x7fdab00c8630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:25.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.797+0000 7fdab5c00640 1 -- 172.21.15.152:0/803161266 shutdown_connections 2024-04-17T08:47:25.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.797+0000 7fdab5c00640 1 -- 172.21.15.152:0/803161266 wait complete. 2024-04-17T08:47:25.818 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-17T08:47:25.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.953+0000 7f7a01200640 1 Processor -- start 2024-04-17T08:47:25.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.953+0000 7f7a01200640 1 -- start start 2024-04-17T08:47:25.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.953+0000 7f7a01200640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f79fc15a010 0x7f79fc0d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:25.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.953+0000 7f7a01200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f79fc15d710 0x7f79fc0d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:25.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.953+0000 7f7a01200640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79fc160d20 con 0x7f79fc160010 2024-04-17T08:47:25.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.957+0000 7f7a01200640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f79fc15d280 con 0x7f79fc15a010 2024-04-17T08:47:25.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.957+0000 7f7a01200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f79fc15c9d0 con 0x7f79fc15d710 2024-04-17T08:47:25.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.957+0000 7f79f9e00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f79fc15a010 0x7f79fc0d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:25.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.957+0000 7f79fa800640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f79fc160010 0x7f79fc160450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:52410/0 (socket says 172.21.15.152:52410) 2024-04-17T08:47:25.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.957+0000 7f79fa800640 1 -- 172.21.15.152:0/2067362559 learned_addr learned my addr 172.21.15.152:0/2067362559 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:25.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.957+0000 7f79f9400640 1 --2- 172.21.15.152:0/2067362559 >> v2:172.21.15.196:3300/0 conn(0x7f79fc15d710 0x7f79fc0d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:25.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.957+0000 7f79f9e00640 1 -- 172.21.15.152:0/2067362559 >> v2:172.21.15.196:3300/0 conn(0x7f79fc15d710 msgr2=0x7f79fc0d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:25.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.957+0000 7f79f9e00640 1 --2- 172.21.15.152:0/2067362559 >> v2:172.21.15.196:3300/0 conn(0x7f79fc15d710 0x7f79fc0d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:25.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.957+0000 7f79f9e00640 1 -- 172.21.15.152:0/2067362559 >> v1:172.21.15.152:6789/0 conn(0x7f79fc160010 legacy=0x7f79fc160450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:25.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.957+0000 7f79f9e00640 1 -- 172.21.15.152:0/2067362559 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79fc15cc30 con 0x7f79fc15a010 2024-04-17T08:47:25.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.957+0000 7f79f8a00640 1 -- 172.21.15.152:0/2067362559 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1051678537 0 0) 0x7f79fc160d20 con 0x7f79fc160010 2024-04-17T08:47:25.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.957+0000 7f79f9400640 1 --2- 172.21.15.152:0/2067362559 >> v2:172.21.15.196:3300/0 conn(0x7f79fc15d710 0x7f79fc0d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:25.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.957+0000 7f79f9e00640 1 --2- 172.21.15.152:0/2067362559 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79fc15a010 0x7f79fc0d0360 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f79fc0b1d10 tx=0x7f79ec01c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b330c039be7803c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:25.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.957+0000 7f79f8a00640 1 -- 172.21.15.152:0/2067362559 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79ec0b2070 con 0x7f79fc15a010 2024-04-17T08:47:25.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.957+0000 7f79f8a00640 1 -- 172.21.15.152:0/2067362559 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79ec0a5870 con 0x7f79fc15a010 2024-04-17T08:47:25.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.957+0000 7f79f8a00640 1 -- 172.21.15.152:0/2067362559 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79ec0a5c40 con 0x7f79fc15a010 2024-04-17T08:47:25.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.961+0000 7f7a01200640 1 -- 172.21.15.152:0/2067362559 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79fc15a010 msgr2=0x7f79fc0d0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:25.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.961+0000 7f7a01200640 1 --2- 172.21.15.152:0/2067362559 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79fc15a010 0x7f79fc0d0360 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f79fc0b1d10 tx=0x7f79ec01c8a0 comp rx=0 tx=0).stop 2024-04-17T08:47:25.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.961+0000 7f7a01200640 1 -- 172.21.15.152:0/2067362559 shutdown_connections 2024-04-17T08:47:25.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.961+0000 7f7a01200640 1 --2- 172.21.15.152:0/2067362559 >> v2:172.21.15.196:3300/0 conn(0x7f79fc15d710 0x7f79fc0d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:25.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.961+0000 7f7a01200640 1 --2- 172.21.15.152:0/2067362559 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79fc15a010 0x7f79fc0d0360 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:25.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.961+0000 7f7a01200640 1 -- 172.21.15.152:0/2067362559 >> 172.21.15.152:0/2067362559 conn(0x7f79fc0b3350 msgr2=0x7f79fc0b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:25.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.961+0000 7f7a01200640 1 -- 172.21.15.152:0/2067362559 shutdown_connections 2024-04-17T08:47:25.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.961+0000 7f7a01200640 1 -- 172.21.15.152:0/2067362559 wait complete. 2024-04-17T08:47:25.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.961+0000 7f7a01200640 1 Processor -- start 2024-04-17T08:47:25.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.961+0000 7f7a01200640 1 -- start start 2024-04-17T08:47:25.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.961+0000 7f7a01200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79fc15a010 0x7f79fc1570c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:25.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.961+0000 7f7a01200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f79fc15d710 0x7f79fc1580a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:25.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.961+0000 7f7a01200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f79fc160010 0x7f79fc14fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:25.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.961+0000 7f7a01200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f79fc15e780 con 0x7f79fc15a010 2024-04-17T08:47:25.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.961+0000 7f7a01200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f79fc15e600 con 0x7f79fc15d710 2024-04-17T08:47:25.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.961+0000 7f7a01200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f79fc15e900 con 0x7f79fc160010 2024-04-17T08:47:25.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.961+0000 7f79f9e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79fc15a010 0x7f79fc1570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:25.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.961+0000 7f79f9e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79fc15a010 0x7f79fc1570c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57044/0 (socket says 172.21.15.152:57044) 2024-04-17T08:47:25.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.961+0000 7f79f9e00640 1 -- 172.21.15.152:0/3927836442 learned_addr learned my addr 172.21.15.152:0/3927836442 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:25.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.961+0000 7f79fa800640 1 --2- 172.21.15.152:0/3927836442 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f79fc160010 0x7f79fc14fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:25.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.961+0000 7f79f9400640 1 --2- 172.21.15.152:0/3927836442 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f79fc15d710 0x7f79fc1580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:25.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.961+0000 7f79f9e00640 1 -- 172.21.15.152:0/3927836442 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f79fc160010 msgr2=0x7f79fc14fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:25.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.961+0000 7f79f9e00640 1 --2- 172.21.15.152:0/3927836442 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f79fc160010 0x7f79fc14fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:25.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.961+0000 7f79f9e00640 1 -- 172.21.15.152:0/3927836442 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f79fc15d710 msgr2=0x7f79fc1580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:25.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.961+0000 7f79f9e00640 1 --2- 172.21.15.152:0/3927836442 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f79fc15d710 0x7f79fc1580a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:25.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.961+0000 7f79f9e00640 1 -- 172.21.15.152:0/3927836442 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79fc1585e0 con 0x7f79fc15a010 2024-04-17T08:47:25.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.965+0000 7f79f9e00640 1 --2- 172.21.15.152:0/3927836442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79fc15a010 0x7f79fc1570c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f79ec0b0040 tx=0x7f79ec019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:25.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.965+0000 7f79f2000640 1 -- 172.21.15.152:0/3927836442 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79ec0bd070 con 0x7f79fc15a010 2024-04-17T08:47:25.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.965+0000 7f79f2000640 1 -- 172.21.15.152:0/3927836442 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79ec003ba0 con 0x7f79fc15a010 2024-04-17T08:47:25.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.965+0000 7f79f2000640 1 -- 172.21.15.152:0/3927836442 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79ec0b2040 con 0x7f79fc15a010 2024-04-17T08:47:25.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.965+0000 7f7a01200640 1 -- 172.21.15.152:0/3927836442 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79fc158850 con 0x7f79fc15a010 2024-04-17T08:47:25.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.965+0000 7f7a01200640 1 -- 172.21.15.152:0/3927836442 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79fc15af80 con 0x7f79fc15a010 2024-04-17T08:47:25.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.965+0000 7f7a01200640 1 -- 172.21.15.152:0/3927836442 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79fc068a30 con 0x7f79fc15a010 2024-04-17T08:47:25.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.965+0000 7f79f2000640 1 -- 172.21.15.152:0/3927836442 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f79ec003f70 con 0x7f79fc15a010 2024-04-17T08:47:25.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.965+0000 7f79f2000640 1 --2- 172.21.15.152:0/3927836442 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f79dc068380 0x7f79dc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:25.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.965+0000 7f79f2000640 1 -- 172.21.15.152:0/3927836442 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f79ec121ce0 con 0x7f79fc15a010 2024-04-17T08:47:25.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.965+0000 7f79f9400640 1 --2- 172.21.15.152:0/3927836442 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f79dc068380 0x7f79dc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:25.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.965+0000 7f79f9400640 1 --2- 172.21.15.152:0/3927836442 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f79dc068380 0x7f79dc06a840 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f79fc0b1d10 tx=0x7f79e8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:25.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:25.969+0000 7f79f2000640 1 -- 172.21.15.152:0/3927836442 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f79ec016520 con 0x7f79fc15a010 2024-04-17T08:47:26.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.125+0000 7f7a01200640 1 -- 172.21.15.152:0/3927836442 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f79fc06d660 con 0x7f79fc15a010 2024-04-17T08:47:26.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.125+0000 7f79f2000640 1 -- 172.21.15.152:0/3927836442 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f79ec0f1e80 con 0x7f79fc15a010 2024-04-17T08:47:26.129 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-04-17T08:47:26.131 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.129+0000 7f7a01200640 1 -- 172.21.15.152:0/3927836442 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f79dc068380 msgr2=0x7f79dc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:26.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.129+0000 7f7a01200640 1 --2- 172.21.15.152:0/3927836442 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f79dc068380 0x7f79dc06a840 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f79fc0b1d10 tx=0x7f79e8008040 comp rx=0 tx=0).stop 2024-04-17T08:47:26.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.129+0000 7f7a01200640 1 -- 172.21.15.152:0/3927836442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79fc15a010 msgr2=0x7f79fc1570c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:26.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.129+0000 7f7a01200640 1 --2- 172.21.15.152:0/3927836442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79fc15a010 0x7f79fc1570c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f79ec0b0040 tx=0x7f79ec019640 comp rx=0 tx=0).stop 2024-04-17T08:47:26.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.129+0000 7f7a01200640 1 -- 172.21.15.152:0/3927836442 shutdown_connections 2024-04-17T08:47:26.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.129+0000 7f7a01200640 1 --2- 172.21.15.152:0/3927836442 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f79dc068380 0x7f79dc06a840 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:26.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.129+0000 7f7a01200640 1 --2- 172.21.15.152:0/3927836442 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f79fc160010 0x7f79fc14fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:26.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.129+0000 7f7a01200640 1 --2- 172.21.15.152:0/3927836442 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f79fc15d710 0x7f79fc1580a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:26.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.129+0000 7f7a01200640 1 --2- 172.21.15.152:0/3927836442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79fc15a010 0x7f79fc1570c0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:26.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.129+0000 7f7a01200640 1 -- 172.21.15.152:0/3927836442 >> 172.21.15.152:0/3927836442 conn(0x7f79fc0b3350 msgr2=0x7f79fc0aee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:26.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.129+0000 7f7a01200640 1 -- 172.21.15.152:0/3927836442 shutdown_connections 2024-04-17T08:47:26.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.129+0000 7f7a01200640 1 -- 172.21.15.152:0/3927836442 wait complete. 2024-04-17T08:47:26.150 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-17T08:47:26.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.285+0000 7fc8a9000640 1 Processor -- start 2024-04-17T08:47:26.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.289+0000 7fc8a9000640 1 -- start start 2024-04-17T08:47:26.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.289+0000 7fc8a9000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc8a415e710 0x7fc8a4162b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:26.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.289+0000 7fc8a9000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc8a406f610 0x7fc8a406c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:26.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.289+0000 7fc8a9000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8a4163050 con 0x7fc8a406be80 2024-04-17T08:47:26.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.289+0000 7fc8a9000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fc8a415faa0 con 0x7fc8a415e710 2024-04-17T08:47:26.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.289+0000 7fc8a9000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fc8a406c800 con 0x7fc8a406f610 2024-04-17T08:47:26.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.289+0000 7fc8a3400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc8a415e710 0x7fc8a4162b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:26.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.289+0000 7fc8a3e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc8a406f610 0x7fc8a406c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:26.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.289+0000 7fc8a3400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc8a415e710 0x7fc8a4162b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.152:55900/0 (socket says 172.21.15.152:55900) 2024-04-17T08:47:26.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.289+0000 7fc8a3400640 1 -- 172.21.15.152:0/2532953520 learned_addr learned my addr 172.21.15.152:0/2532953520 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:26.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.289+0000 7fc8a3e00640 1 -- 172.21.15.152:0/2532953520 >> v2:172.21.15.196:3300/0 conn(0x7fc8a415e710 msgr2=0x7fc8a4162b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:26.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.289+0000 7fc8a3e00640 1 --2- 172.21.15.152:0/2532953520 >> v2:172.21.15.196:3300/0 conn(0x7fc8a415e710 0x7fc8a4162b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:26.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.289+0000 7fc8a3e00640 1 -- 172.21.15.152:0/2532953520 >> v1:172.21.15.196:6789/0 conn(0x7fc8a406be80 legacy=0x7fc8a40b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:26.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.289+0000 7fc8a3e00640 1 -- 172.21.15.152:0/2532953520 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8a415ef20 con 0x7fc8a406f610 2024-04-17T08:47:26.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.289+0000 7fc8a2000640 1 -- 172.21.15.152:0/2532953520 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2640486721 0 0) 0x7fc8a4163050 con 0x7fc8a406be80 2024-04-17T08:47:26.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.289+0000 7fc8a3400640 1 --2- 172.21.15.152:0/2532953520 >> v2:172.21.15.196:3300/0 conn(0x7fc8a415e710 0x7fc8a4162b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T08:47:26.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.293+0000 7fc8a3e00640 1 --2- 172.21.15.152:0/2532953520 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc8a406f610 0x7fc8a406c2c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc89c009d90 tx=0x7fc89c01c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20302fabf6532e63 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:26.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.293+0000 7fc8a2000640 1 -- 172.21.15.152:0/2532953520 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc89c0b2070 con 0x7fc8a406f610 2024-04-17T08:47:26.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.293+0000 7fc8a2000640 1 -- 172.21.15.152:0/2532953520 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc89c0a5920 con 0x7fc8a406f610 2024-04-17T08:47:26.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.293+0000 7fc8a2000640 1 -- 172.21.15.152:0/2532953520 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc89c0a5cf0 con 0x7fc8a406f610 2024-04-17T08:47:26.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.293+0000 7fc8a9000640 1 -- 172.21.15.152:0/2532953520 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc8a406f610 msgr2=0x7fc8a406c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:26.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.293+0000 7fc8a9000640 1 --2- 172.21.15.152:0/2532953520 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc8a406f610 0x7fc8a406c2c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc89c009d90 tx=0x7fc89c01c940 comp rx=0 tx=0).stop 2024-04-17T08:47:26.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.293+0000 7fc8a9000640 1 -- 172.21.15.152:0/2532953520 shutdown_connections 2024-04-17T08:47:26.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.293+0000 7fc8a9000640 1 --2- 172.21.15.152:0/2532953520 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc8a406f610 0x7fc8a406c2c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:26.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.293+0000 7fc8a9000640 1 --2- 172.21.15.152:0/2532953520 >> v2:172.21.15.196:3300/0 conn(0x7fc8a415e710 0x7fc8a4162b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:26.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.293+0000 7fc8a9000640 1 -- 172.21.15.152:0/2532953520 >> 172.21.15.152:0/2532953520 conn(0x7fc8a40d0890 msgr2=0x7fc8a40d0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:26.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.293+0000 7fc8a9000640 1 -- 172.21.15.152:0/2532953520 shutdown_connections 2024-04-17T08:47:26.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.293+0000 7fc8a9000640 1 -- 172.21.15.152:0/2532953520 wait complete. 2024-04-17T08:47:26.298 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.297+0000 7fc8a9000640 1 Processor -- start 2024-04-17T08:47:26.298 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.297+0000 7fc8a9000640 1 -- start start 2024-04-17T08:47:26.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.297+0000 7fc8a9000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8a406be80 0x7fc8a41433d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:26.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.297+0000 7fc8a9000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc8a406f610 0x7fc8a4162b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:26.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.297+0000 7fc8a9000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc8a415e710 0x7fc8a4163050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:26.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.297+0000 7fc8a9000640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a415eaf0 con 0x7fc8a406be80 2024-04-17T08:47:26.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.297+0000 7fc8a9000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a406cc60 con 0x7fc8a415e710 2024-04-17T08:47:26.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.297+0000 7fc8a9000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fc8a415ec70 con 0x7fc8a406f610 2024-04-17T08:47:26.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.297+0000 7fc8a3400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8a406be80 0x7fc8a41433d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:26.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.297+0000 7fc8a3400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8a406be80 0x7fc8a41433d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57054/0 (socket says 172.21.15.152:57054) 2024-04-17T08:47:26.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.297+0000 7fc8a3400640 1 -- 172.21.15.152:0/3748492855 learned_addr learned my addr 172.21.15.152:0/3748492855 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:26.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.297+0000 7fc8a3e00640 1 --2- 172.21.15.152:0/3748492855 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc8a415e710 0x7fc8a4163050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:26.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.297+0000 7fc8a2a00640 1 --2- 172.21.15.152:0/3748492855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc8a406f610 0x7fc8a4162b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:26.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.297+0000 7fc8a3400640 1 -- 172.21.15.152:0/3748492855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc8a406f610 msgr2=0x7fc8a4162b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:26.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.297+0000 7fc8a3400640 1 --2- 172.21.15.152:0/3748492855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc8a406f610 0x7fc8a4162b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:26.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.297+0000 7fc8a3400640 1 -- 172.21.15.152:0/3748492855 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc8a415e710 msgr2=0x7fc8a4163050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:26.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.297+0000 7fc8a3400640 1 --2- 172.21.15.152:0/3748492855 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc8a415e710 0x7fc8a4163050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:26.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.297+0000 7fc8a3400640 1 -- 172.21.15.152:0/3748492855 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8a4143910 con 0x7fc8a406be80 2024-04-17T08:47:26.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.297+0000 7fc8a3400640 1 --2- 172.21.15.152:0/3748492855 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8a406be80 0x7fc8a41433d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc89400ea00 tx=0x7fc89400eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:26.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.297+0000 7fc89b400640 1 -- 172.21.15.152:0/3748492855 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc894017070 con 0x7fc8a406be80 2024-04-17T08:47:26.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.297+0000 7fc89b400640 1 -- 172.21.15.152:0/3748492855 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc89400ca60 con 0x7fc8a406be80 2024-04-17T08:47:26.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.297+0000 7fc8a9000640 1 -- 172.21.15.152:0/3748492855 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8a4144c60 con 0x7fc8a406be80 2024-04-17T08:47:26.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.297+0000 7fc89b400640 1 -- 172.21.15.152:0/3748492855 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc89400ce10 con 0x7fc8a406be80 2024-04-17T08:47:26.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.297+0000 7fc8a9000640 1 -- 172.21.15.152:0/3748492855 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8a4145220 con 0x7fc8a406be80 2024-04-17T08:47:26.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.297+0000 7fc8a9000640 1 -- 172.21.15.152:0/3748492855 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8a4075be0 con 0x7fc8a406be80 2024-04-17T08:47:26.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.301+0000 7fc89b400640 1 -- 172.21.15.152:0/3748492855 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc89401a070 con 0x7fc8a406be80 2024-04-17T08:47:26.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.301+0000 7fc89b400640 1 --2- 172.21.15.152:0/3748492855 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc884068380 0x7fc88406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:26.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.301+0000 7fc89b400640 1 -- 172.21.15.152:0/3748492855 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fc894087070 con 0x7fc8a406be80 2024-04-17T08:47:26.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.301+0000 7fc8a2a00640 1 --2- 172.21.15.152:0/3748492855 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc884068380 0x7fc88406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:26.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.301+0000 7fc8a2a00640 1 --2- 172.21.15.152:0/3748492855 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc884068380 0x7fc88406a840 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4159b10 tx=0x7fc890009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:26.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.305+0000 7fc89b400640 1 -- 172.21.15.152:0/3748492855 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fc894056bb0 con 0x7fc8a406be80 2024-04-17T08:47:26.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.465+0000 7fc8a9000640 1 -- 172.21.15.152:0/3748492855 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc8a406d8d0 con 0x7fc8a406be80 2024-04-17T08:47:26.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.465+0000 7fc89b400640 1 -- 172.21.15.152:0/3748492855 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7fc89405aeb0 con 0x7fc8a406be80 2024-04-17T08:47:26.466 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 64 2024-04-17T08:47:26.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.465+0000 7fc8a9000640 1 -- 172.21.15.152:0/3748492855 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc884068380 msgr2=0x7fc88406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:26.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.465+0000 7fc8a9000640 1 --2- 172.21.15.152:0/3748492855 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc884068380 0x7fc88406a840 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4159b10 tx=0x7fc890009040 comp rx=0 tx=0).stop 2024-04-17T08:47:26.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.465+0000 7fc8a9000640 1 -- 172.21.15.152:0/3748492855 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8a406be80 msgr2=0x7fc8a41433d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:26.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.465+0000 7fc8a9000640 1 --2- 172.21.15.152:0/3748492855 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8a406be80 0x7fc8a41433d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc89400ea00 tx=0x7fc89400eec0 comp rx=0 tx=0).stop 2024-04-17T08:47:26.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.465+0000 7fc8a9000640 1 -- 172.21.15.152:0/3748492855 shutdown_connections 2024-04-17T08:47:26.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.465+0000 7fc8a9000640 1 --2- 172.21.15.152:0/3748492855 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc8a415e710 0x7fc8a4163050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:26.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.465+0000 7fc8a9000640 1 --2- 172.21.15.152:0/3748492855 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc884068380 0x7fc88406a840 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:26.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.465+0000 7fc8a9000640 1 --2- 172.21.15.152:0/3748492855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc8a406f610 0x7fc8a4162b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:26.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.465+0000 7fc8a9000640 1 --2- 172.21.15.152:0/3748492855 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8a406be80 0x7fc8a41433d0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:26.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.465+0000 7fc8a9000640 1 -- 172.21.15.152:0/3748492855 >> 172.21.15.152:0/3748492855 conn(0x7fc8a40d0890 msgr2=0x7fc8a406e600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:26.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.465+0000 7fc8a9000640 1 -- 172.21.15.152:0/3748492855 shutdown_connections 2024-04-17T08:47:26.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.465+0000 7fc8a9000640 1 -- 172.21.15.152:0/3748492855 wait complete. 2024-04-17T08:47:26.488 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-17T08:47:26.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.625+0000 7f5af9000640 1 Processor -- start 2024-04-17T08:47:26.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.625+0000 7f5af9000640 1 -- start start 2024-04-17T08:47:26.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.625+0000 7f5af9000640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f5af415a010 0x7f5af40d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:26.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.625+0000 7f5af9000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5af4160720 0x7f5af40d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:26.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.625+0000 7f5af9000640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5af4160d20 con 0x7f5af415d710 2024-04-17T08:47:26.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.625+0000 7f5af9000640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f5af415d280 con 0x7f5af415a010 2024-04-17T08:47:26.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.625+0000 7f5af9000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f5af415c9d0 con 0x7f5af4160720 2024-04-17T08:47:26.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.625+0000 7f5af1e00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f5af415a010 0x7f5af40d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:26.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.625+0000 7f5ae9400640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f5af415d710 0x7f5af4160010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:52422/0 (socket says 172.21.15.152:52422) 2024-04-17T08:47:26.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.625+0000 7f5ae9400640 1 -- 172.21.15.152:0/3471875607 learned_addr learned my addr 172.21.15.152:0/3471875607 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:26.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.625+0000 7f5af2800640 1 --2- 172.21.15.152:0/3471875607 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5af4160720 0x7f5af40d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:26.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.625+0000 7f5af1e00640 1 -- 172.21.15.152:0/3471875607 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5af4160720 msgr2=0x7f5af40d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:26.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.625+0000 7f5af1e00640 1 --2- 172.21.15.152:0/3471875607 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5af4160720 0x7f5af40d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:26.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.625+0000 7f5af1e00640 1 -- 172.21.15.152:0/3471875607 >> v1:172.21.15.152:6789/0 conn(0x7f5af415d710 legacy=0x7f5af4160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:26.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.625+0000 7f5af1e00640 1 -- 172.21.15.152:0/3471875607 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5af415cc30 con 0x7f5af415a010 2024-04-17T08:47:26.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.625+0000 7f5af1400640 1 -- 172.21.15.152:0/3471875607 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2091622714 0 0) 0x7f5af4160d20 con 0x7f5af415d710 2024-04-17T08:47:26.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.629+0000 7f5af1e00640 1 --2- 172.21.15.152:0/3471875607 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5af415a010 0x7f5af40d0360 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4009d90 tx=0x7f5ae401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0947850047f8009 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:26.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.629+0000 7f5af1400640 1 -- 172.21.15.152:0/3471875607 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae40b2070 con 0x7f5af415a010 2024-04-17T08:47:26.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.629+0000 7f5af1400640 1 -- 172.21.15.152:0/3471875607 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ae40a57a0 con 0x7f5af415a010 2024-04-17T08:47:26.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.629+0000 7f5af1400640 1 -- 172.21.15.152:0/3471875607 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae40a5b70 con 0x7f5af415a010 2024-04-17T08:47:26.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.629+0000 7f5af9000640 1 -- 172.21.15.152:0/3471875607 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5af415a010 msgr2=0x7f5af40d0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:26.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.629+0000 7f5af9000640 1 --2- 172.21.15.152:0/3471875607 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5af415a010 0x7f5af40d0360 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4009d90 tx=0x7f5ae401c8e0 comp rx=0 tx=0).stop 2024-04-17T08:47:26.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.629+0000 7f5af9000640 1 -- 172.21.15.152:0/3471875607 shutdown_connections 2024-04-17T08:47:26.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.629+0000 7f5af9000640 1 --2- 172.21.15.152:0/3471875607 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5af4160720 0x7f5af40d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:26.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.629+0000 7f5af9000640 1 --2- 172.21.15.152:0/3471875607 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5af415a010 0x7f5af40d0360 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:26.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.629+0000 7f5af9000640 1 -- 172.21.15.152:0/3471875607 >> 172.21.15.152:0/3471875607 conn(0x7f5af40b3350 msgr2=0x7f5af40b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:26.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.629+0000 7f5af9000640 1 -- 172.21.15.152:0/3471875607 shutdown_connections 2024-04-17T08:47:26.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.629+0000 7f5af9000640 1 -- 172.21.15.152:0/3471875607 wait complete. 2024-04-17T08:47:26.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.633+0000 7f5af9000640 1 Processor -- start 2024-04-17T08:47:26.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.633+0000 7f5af9000640 1 -- start start 2024-04-17T08:47:26.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.633+0000 7f5af9000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5af415a010 0x7f5af4099890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:26.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.633+0000 7f5af9000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5af415d710 0x7f5af4166b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:26.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.633+0000 7f5af9000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5af4160720 0x7f5af40b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:26.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.633+0000 7f5af9000640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5af415e780 con 0x7f5af415d710 2024-04-17T08:47:26.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.633+0000 7f5af9000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f5af415e600 con 0x7f5af4160720 2024-04-17T08:47:26.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.633+0000 7f5af9000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f5af415e900 con 0x7f5af415a010 2024-04-17T08:47:26.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.633+0000 7f5ae9400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5af415d710 0x7f5af4166b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:26.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.633+0000 7f5ae9400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5af415d710 0x7f5af4166b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57066/0 (socket says 172.21.15.152:57066) 2024-04-17T08:47:26.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.633+0000 7f5ae9400640 1 -- 172.21.15.152:0/674807497 learned_addr learned my addr 172.21.15.152:0/674807497 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:26.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.633+0000 7f5af1e00640 1 --2- 172.21.15.152:0/674807497 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5af415a010 0x7f5af4099890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:26.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.633+0000 7f5af2800640 1 --2- 172.21.15.152:0/674807497 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5af4160720 0x7f5af40b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:26.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.633+0000 7f5ae9400640 1 -- 172.21.15.152:0/674807497 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5af415a010 msgr2=0x7f5af4099890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:26.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.633+0000 7f5ae9400640 1 --2- 172.21.15.152:0/674807497 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5af415a010 0x7f5af4099890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:26.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.633+0000 7f5ae9400640 1 -- 172.21.15.152:0/674807497 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5af4160720 msgr2=0x7f5af40b0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:26.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.633+0000 7f5ae9400640 1 --2- 172.21.15.152:0/674807497 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5af4160720 0x7f5af40b0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:26.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.633+0000 7f5ae9400640 1 -- 172.21.15.152:0/674807497 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5af4155750 con 0x7f5af415d710 2024-04-17T08:47:26.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.633+0000 7f5ae9400640 1 --2- 172.21.15.152:0/674807497 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5af415d710 0x7f5af4166b00 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5adc00c550 tx=0x7f5adc00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:26.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.633+0000 7f5aeaa00640 1 -- 172.21.15.152:0/674807497 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5adc017070 con 0x7f5af415d710 2024-04-17T08:47:26.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.633+0000 7f5aeaa00640 1 -- 172.21.15.152:0/674807497 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5adc005d10 con 0x7f5af415d710 2024-04-17T08:47:26.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.633+0000 7f5aeaa00640 1 -- 172.21.15.152:0/674807497 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5adc007330 con 0x7f5af415d710 2024-04-17T08:47:26.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.633+0000 7f5af9000640 1 -- 172.21.15.152:0/674807497 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5af4153b60 con 0x7f5af415d710 2024-04-17T08:47:26.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.633+0000 7f5af9000640 1 -- 172.21.15.152:0/674807497 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5af4099dd0 con 0x7f5af415d710 2024-04-17T08:47:26.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.637+0000 7f5af9000640 1 -- 172.21.15.152:0/674807497 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5af4068a30 con 0x7f5af415d710 2024-04-17T08:47:26.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.637+0000 7f5aeaa00640 1 -- 172.21.15.152:0/674807497 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5adc01a070 con 0x7f5af415d710 2024-04-17T08:47:26.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.637+0000 7f5aeaa00640 1 --2- 172.21.15.152:0/674807497 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5ad0068380 0x7f5ad006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:26.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.637+0000 7f5aeaa00640 1 -- 172.21.15.152:0/674807497 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f5adc086260 con 0x7f5af415d710 2024-04-17T08:47:26.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.637+0000 7f5af1e00640 1 --2- 172.21.15.152:0/674807497 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5ad0068380 0x7f5ad006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:26.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.637+0000 7f5af1e00640 1 --2- 172.21.15.152:0/674807497 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5ad0068380 0x7f5ad006a840 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5ae40af000 tx=0x7f5ae40a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:26.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.641+0000 7f5aeaa00640 1 -- 172.21.15.152:0/674807497 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f5adc0563f0 con 0x7f5af415d710 2024-04-17T08:47:26.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.801+0000 7f5af9000640 1 -- 172.21.15.152:0/674807497 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f5af40adf00 con 0x7f5af415d710 2024-04-17T08:47:26.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.801+0000 7f5aeaa00640 1 -- 172.21.15.152:0/674807497 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f5adc055cf0 con 0x7f5af415d710 2024-04-17T08:47:26.803 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-04-17T08:47:26.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.801+0000 7f5af9000640 1 -- 172.21.15.152:0/674807497 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5ad0068380 msgr2=0x7f5ad006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:26.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.801+0000 7f5af9000640 1 --2- 172.21.15.152:0/674807497 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5ad0068380 0x7f5ad006a840 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5ae40af000 tx=0x7f5ae40a7070 comp rx=0 tx=0).stop 2024-04-17T08:47:26.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.801+0000 7f5af9000640 1 -- 172.21.15.152:0/674807497 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5af415d710 msgr2=0x7f5af4166b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:26.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.801+0000 7f5af9000640 1 --2- 172.21.15.152:0/674807497 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5af415d710 0x7f5af4166b00 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5adc00c550 tx=0x7f5adc00ca10 comp rx=0 tx=0).stop 2024-04-17T08:47:26.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.801+0000 7f5af9000640 1 -- 172.21.15.152:0/674807497 shutdown_connections 2024-04-17T08:47:26.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.801+0000 7f5af9000640 1 --2- 172.21.15.152:0/674807497 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5af4160720 0x7f5af40b0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:26.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.801+0000 7f5af9000640 1 --2- 172.21.15.152:0/674807497 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5af415d710 0x7f5af4166b00 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:26.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.801+0000 7f5af9000640 1 --2- 172.21.15.152:0/674807497 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5ad0068380 0x7f5ad006a840 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:26.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.801+0000 7f5af9000640 1 --2- 172.21.15.152:0/674807497 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5af415a010 0x7f5af4099890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:26.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.801+0000 7f5af9000640 1 -- 172.21.15.152:0/674807497 >> 172.21.15.152:0/674807497 conn(0x7f5af40b3350 msgr2=0x7f5af4072990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:26.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.801+0000 7f5af9000640 1 -- 172.21.15.152:0/674807497 shutdown_connections 2024-04-17T08:47:26.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.801+0000 7f5af9000640 1 -- 172.21.15.152:0/674807497 wait complete. 2024-04-17T08:47:26.824 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2024-04-17T08:47:26.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.957+0000 7f59c8000640 1 Processor -- start 2024-04-17T08:47:26.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.957+0000 7f59c8000640 1 -- start start 2024-04-17T08:47:26.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.957+0000 7f59c8000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f59c015d710 0x7f59c0160720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:26.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.957+0000 7f59c8000640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59c0160d20 con 0x7f59c015a010 2024-04-17T08:47:26.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.957+0000 7f59c8000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59c015cc30 con 0x7f59c00d0a70 2024-04-17T08:47:26.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.957+0000 7f59c8000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f59c015d280 con 0x7f59c015d710 2024-04-17T08:47:26.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.957+0000 7f59c5600640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f59c015a010 0x7f59c00d0360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:52430/0 (socket says 172.21.15.152:52430) 2024-04-17T08:47:26.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.957+0000 7f59c5600640 1 -- 172.21.15.152:0/4115731776 learned_addr learned my addr 172.21.15.152:0/4115731776 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:26.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.957+0000 7f59c6000640 1 --2- 172.21.15.152:0/4115731776 >> v2:172.21.15.196:3300/0 conn(0x7f59c015d710 0x7f59c0160720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:26.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.957+0000 7f59bfe00640 1 -- 172.21.15.152:0/4115731776 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1772316440 0 0) 0x7f59c0160d20 con 0x7f59c015a010 2024-04-17T08:47:26.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.957+0000 7f59bfe00640 1 -- 172.21.15.152:0/4115731776 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59a8003530 con 0x7f59c015a010 2024-04-17T08:47:26.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.957+0000 7f59bfe00640 1 -- 172.21.15.152:0/4115731776 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2900330153 0 0) 0x7f59a8003530 con 0x7f59c015a010 2024-04-17T08:47:26.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.957+0000 7f59bfe00640 1 -- 172.21.15.152:0/4115731776 >> v2:172.21.15.196:3300/0 conn(0x7f59c015d710 msgr2=0x7f59c0160720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:26.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.957+0000 7f59bfe00640 1 --2- 172.21.15.152:0/4115731776 >> v2:172.21.15.196:3300/0 conn(0x7f59c015d710 0x7f59c0160720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:26.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.957+0000 7f59bfe00640 1 -- 172.21.15.152:0/4115731776 >> v1:172.21.15.196:6789/0 conn(0x7f59c00d0a70 legacy=0x7f59c0160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:26.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.957+0000 7f59bfe00640 1 -- 172.21.15.152:0/4115731776 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59c015cf10 con 0x7f59c015a010 2024-04-17T08:47:26.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.957+0000 7f59bfe00640 1 -- 172.21.15.152:0/4115731776 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2973887244 0 0) 0x7f59b4001a00 con 0x7f59c015a010 2024-04-17T08:47:26.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.957+0000 7f59bfe00640 1 -- 172.21.15.152:0/4115731776 >> v1:172.21.15.152:6789/0 conn(0x7f59c015a010 legacy=0x7f59c00d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:26.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.957+0000 7f59bfe00640 1 --2- 172.21.15.152:0/4115731776 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f59a80039c0 0x7f59a8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:26.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.957+0000 7f59bfe00640 1 --2- 172.21.15.152:0/4115731776 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f59a8004810 0x7f59a8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:26.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.957+0000 7f59bfe00640 1 --2- 172.21.15.152:0/4115731776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59a80051d0 0x7f59a800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:26.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.961+0000 7f59bfe00640 1 -- 172.21.15.152:0/4115731776 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f59c015d280 con 0x7f59a80051d0 2024-04-17T08:47:26.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.961+0000 7f59bfe00640 1 -- 172.21.15.152:0/4115731776 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f59a800c170 con 0x7f59a8004810 2024-04-17T08:47:26.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.961+0000 7f59bfe00640 1 -- 172.21.15.152:0/4115731776 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f59a800c370 con 0x7f59a80039c0 2024-04-17T08:47:26.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.961+0000 7f59c6000640 1 --2- 172.21.15.152:0/4115731776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59a80051d0 0x7f59a800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:26.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.961+0000 7f59c4c00640 1 --2- 172.21.15.152:0/4115731776 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f59a8004810 0x7f59a8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:26.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.961+0000 7f59c5600640 1 --2- 172.21.15.152:0/4115731776 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f59a80039c0 0x7f59a8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:26.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.961+0000 7f59c6000640 1 -- 172.21.15.152:0/4115731776 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f59a80039c0 msgr2=0x7f59a8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:26.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.961+0000 7f59c6000640 1 --2- 172.21.15.152:0/4115731776 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f59a80039c0 0x7f59a8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:26.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.961+0000 7f59c6000640 1 -- 172.21.15.152:0/4115731776 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f59a8004810 msgr2=0x7f59a8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:26.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.961+0000 7f59c6000640 1 --2- 172.21.15.152:0/4115731776 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f59a8004810 0x7f59a8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:26.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.961+0000 7f59c6000640 1 -- 172.21.15.152:0/4115731776 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a8003530 con 0x7f59a80051d0 2024-04-17T08:47:26.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.961+0000 7f59c6000640 1 -- 172.21.15.152:0/4115731776 reap_dead start 2024-04-17T08:47:26.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.961+0000 7f59c6000640 1 --2- 172.21.15.152:0/4115731776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59a80051d0 0x7f59a800b9d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f59b8009ae0 tx=0x7f59b801cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a015887b4b1315f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:26.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.961+0000 7f59bfe00640 1 -- 172.21.15.152:0/4115731776 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b80096b0 con 0x7f59a80051d0 2024-04-17T08:47:26.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.961+0000 7f59bfe00640 1 -- 172.21.15.152:0/4115731776 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59b8004020 con 0x7f59a80051d0 2024-04-17T08:47:26.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.961+0000 7f59bfe00640 1 -- 172.21.15.152:0/4115731776 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b8004410 con 0x7f59a80051d0 2024-04-17T08:47:26.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.965+0000 7f59c8000640 1 -- 172.21.15.152:0/4115731776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59a80051d0 msgr2=0x7f59a800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:26.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.965+0000 7f59c8000640 1 --2- 172.21.15.152:0/4115731776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59a80051d0 0x7f59a800b9d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f59b8009ae0 tx=0x7f59b801cab0 comp rx=0 tx=0).stop 2024-04-17T08:47:26.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.965+0000 7f59c8000640 1 -- 172.21.15.152:0/4115731776 shutdown_connections 2024-04-17T08:47:26.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.965+0000 7f59c8000640 1 --2- 172.21.15.152:0/4115731776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59a80051d0 0x7f59a800b9d0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:26.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.965+0000 7f59c8000640 1 -- 172.21.15.152:0/4115731776 >> 172.21.15.152:0/4115731776 conn(0x7f59c00b3350 msgr2=0x7f59c00b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:26.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.965+0000 7f59c8000640 1 -- 172.21.15.152:0/4115731776 shutdown_connections 2024-04-17T08:47:26.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.965+0000 7f59c8000640 1 -- 172.21.15.152:0/4115731776 wait complete. 2024-04-17T08:47:26.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.965+0000 7f59c8000640 1 Processor -- start 2024-04-17T08:47:26.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.965+0000 7f59c8000640 1 -- start start 2024-04-17T08:47:26.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.965+0000 7f59c8000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59a80051d0 0x7f59c00ce5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:26.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.965+0000 7f59c8000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f59c01f6310 0x7f59c0072dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:26.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.965+0000 7f59c8000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f59c0151370 0x7f59c0151820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:26.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.965+0000 7f59c8000640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f59c00d0360 con 0x7f59a80051d0 2024-04-17T08:47:26.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.965+0000 7f59c8000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f59c015c9d0 con 0x7f59c01f6310 2024-04-17T08:47:26.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.965+0000 7f59c8000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f59c00d04e0 con 0x7f59c0151370 2024-04-17T08:47:26.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.965+0000 7f59c5600640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59a80051d0 0x7f59c00ce5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:26.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.965+0000 7f59c5600640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59a80051d0 0x7f59c00ce5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57082/0 (socket says 172.21.15.152:57082) 2024-04-17T08:47:26.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.965+0000 7f59c5600640 1 -- 172.21.15.152:0/1348563358 learned_addr learned my addr 172.21.15.152:0/1348563358 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:26.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.965+0000 7f59c4c00640 1 --2- 172.21.15.152:0/1348563358 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f59c01f6310 0x7f59c0072dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:26.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.965+0000 7f59c6000640 1 --2- 172.21.15.152:0/1348563358 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f59c0151370 0x7f59c0151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:26.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.965+0000 7f59c5600640 1 -- 172.21.15.152:0/1348563358 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f59c0151370 msgr2=0x7f59c0151820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:26.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.965+0000 7f59c5600640 1 --2- 172.21.15.152:0/1348563358 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f59c0151370 0x7f59c0151820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:26.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.965+0000 7f59c5600640 1 -- 172.21.15.152:0/1348563358 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f59c01f6310 msgr2=0x7f59c0072dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:26.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.965+0000 7f59c5600640 1 --2- 172.21.15.152:0/1348563358 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f59c01f6310 0x7f59c0072dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:26.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.965+0000 7f59c5600640 1 -- 172.21.15.152:0/1348563358 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59c00cee90 con 0x7f59a80051d0 2024-04-17T08:47:26.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.965+0000 7f59c5600640 1 --2- 172.21.15.152:0/1348563358 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59a80051d0 0x7f59c00ce5f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f59b40118b0 tx=0x7f59b4011d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:26.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.969+0000 7f59bd600640 1 -- 172.21.15.152:0/1348563358 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b4010040 con 0x7f59a80051d0 2024-04-17T08:47:26.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.969+0000 7f59bd600640 1 -- 172.21.15.152:0/1348563358 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59b401a070 con 0x7f59a80051d0 2024-04-17T08:47:26.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.969+0000 7f59c8000640 1 -- 172.21.15.152:0/1348563358 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59c01f22e0 con 0x7f59a80051d0 2024-04-17T08:47:26.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.969+0000 7f59bd600640 1 -- 172.21.15.152:0/1348563358 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b400fd80 con 0x7f59a80051d0 2024-04-17T08:47:26.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.969+0000 7f59c8000640 1 -- 172.21.15.152:0/1348563358 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59c01f28a0 con 0x7f59a80051d0 2024-04-17T08:47:26.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.969+0000 7f59c8000640 1 -- 172.21.15.152:0/1348563358 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59c01f20f0 con 0x7f59a80051d0 2024-04-17T08:47:26.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.969+0000 7f59bd600640 1 -- 172.21.15.152:0/1348563358 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f59b401f460 con 0x7f59a80051d0 2024-04-17T08:47:26.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.969+0000 7f59bd600640 1 --2- 172.21.15.152:0/1348563358 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f59a0068380 0x7f59a006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:26.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.969+0000 7f59bd600640 1 -- 172.21.15.152:0/1348563358 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f59b4089f50 con 0x7f59a80051d0 2024-04-17T08:47:26.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.969+0000 7f59c4c00640 1 --2- 172.21.15.152:0/1348563358 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f59a0068380 0x7f59a006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:26.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.969+0000 7f59c4c00640 1 --2- 172.21.15.152:0/1348563358 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f59a0068380 0x7f59a006a840 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f59ac000c10 tx=0x7f59ac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:26.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:26.973+0000 7f59bd600640 1 -- 172.21.15.152:0/1348563358 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f59b4059a00 con 0x7f59a80051d0 2024-04-17T08:47:27.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.185+0000 7f59c8000640 1 -- 172.21.15.152:0/1348563358 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) -- 0x7f59c0068a30 con 0x7f59a80051d0 2024-04-17T08:47:27.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.329+0000 7f59bd600640 1 -- 172.21.15.152:0/1348563358 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v74) ==== 147+0+0 (secure 0 0 0) 0x7f59b405dd00 con 0x7f59a80051d0 2024-04-17T08:47:27.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.333+0000 7f59c8000640 1 -- 172.21.15.152:0/1348563358 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f59a0068380 msgr2=0x7f59a006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:27.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.333+0000 7f59c8000640 1 --2- 172.21.15.152:0/1348563358 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f59a0068380 0x7f59a006a840 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f59ac000c10 tx=0x7f59ac009040 comp rx=0 tx=0).stop 2024-04-17T08:47:27.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.333+0000 7f59c8000640 1 -- 172.21.15.152:0/1348563358 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59a80051d0 msgr2=0x7f59c00ce5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:27.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.333+0000 7f59c8000640 1 --2- 172.21.15.152:0/1348563358 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59a80051d0 0x7f59c00ce5f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f59b40118b0 tx=0x7f59b4011d70 comp rx=0 tx=0).stop 2024-04-17T08:47:27.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.333+0000 7f59c8000640 1 -- 172.21.15.152:0/1348563358 shutdown_connections 2024-04-17T08:47:27.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.333+0000 7f59c8000640 1 --2- 172.21.15.152:0/1348563358 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f59a0068380 0x7f59a006a840 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:27.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.333+0000 7f59c8000640 1 --2- 172.21.15.152:0/1348563358 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f59c0151370 0x7f59c0151820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:27.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.333+0000 7f59c8000640 1 --2- 172.21.15.152:0/1348563358 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f59c01f6310 0x7f59c0072dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:27.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.333+0000 7f59c8000640 1 --2- 172.21.15.152:0/1348563358 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59a80051d0 0x7f59c00ce5f0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:27.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.333+0000 7f59c8000640 1 -- 172.21.15.152:0/1348563358 >> 172.21.15.152:0/1348563358 conn(0x7f59c00b3350 msgr2=0x7f59c00afcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:27.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.333+0000 7f59c8000640 1 -- 172.21.15.152:0/1348563358 shutdown_connections 2024-04-17T08:47:27.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.333+0000 7f59c8000640 1 -- 172.21.15.152:0/1348563358 wait complete. 2024-04-17T08:47:27.355 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-17T08:47:27.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.493+0000 7f88c9200640 1 Processor -- start 2024-04-17T08:47:27.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.493+0000 7f88c9200640 1 -- start start 2024-04-17T08:47:27.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.493+0000 7f88c9200640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f88c4147a90 0x7f88c4071790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:27.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.493+0000 7f88c9200640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88c4162aa0 con 0x7f88c4147690 2024-04-17T08:47:27.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.493+0000 7f88c9200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88c4162d80 con 0x7f88c4071cd0 2024-04-17T08:47:27.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.493+0000 7f88c9200640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f88c4163060 con 0x7f88c4147a90 2024-04-17T08:47:27.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.493+0000 7f88bbe00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f88c4147a90 0x7f88c4071790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:27.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.493+0000 7f88c1e00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f88c4147690 0x7f88c41622e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:52446/0 (socket says 172.21.15.152:52446) 2024-04-17T08:47:27.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.493+0000 7f88c1e00640 1 -- 172.21.15.152:0/758935790 learned_addr learned my addr 172.21.15.152:0/758935790 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:27.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.493+0000 7f88bbe00640 1 -- 172.21.15.152:0/758935790 >> v1:172.21.15.196:6789/0 conn(0x7f88c4071cd0 legacy=0x7f88c406da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:27.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.493+0000 7f88bbe00640 1 -- 172.21.15.152:0/758935790 >> v1:172.21.15.152:6789/0 conn(0x7f88c4147690 legacy=0x7f88c41622e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:27.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.493+0000 7f88bbe00640 1 -- 172.21.15.152:0/758935790 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88c406d560 con 0x7f88c4147a90 2024-04-17T08:47:27.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.493+0000 7f88c1400640 1 -- 172.21.15.152:0/758935790 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4274952712 0 0) 0x7f88c4162aa0 con 0x7f88c4147690 2024-04-17T08:47:27.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.497+0000 7f88bbe00640 1 --2- 172.21.15.152:0/758935790 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88c4147a90 0x7f88c4071790 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f88ac0097c0 tx=0x7f88ac01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=788e207c13b69bbf server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:27.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.497+0000 7f88c1400640 1 -- 172.21.15.152:0/758935790 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ac0b0070 con 0x7f88c4147a90 2024-04-17T08:47:27.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.497+0000 7f88c1400640 1 -- 172.21.15.152:0/758935790 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88ac0ab600 con 0x7f88c4147a90 2024-04-17T08:47:27.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.497+0000 7f88c1400640 1 -- 172.21.15.152:0/758935790 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ac0ab9d0 con 0x7f88c4147a90 2024-04-17T08:47:27.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.497+0000 7f88c9200640 1 -- 172.21.15.152:0/758935790 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88c4147a90 msgr2=0x7f88c4071790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:27.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.497+0000 7f88c9200640 1 --2- 172.21.15.152:0/758935790 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88c4147a90 0x7f88c4071790 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f88ac0097c0 tx=0x7f88ac01c460 comp rx=0 tx=0).stop 2024-04-17T08:47:27.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.497+0000 7f88c9200640 1 -- 172.21.15.152:0/758935790 shutdown_connections 2024-04-17T08:47:27.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.497+0000 7f88c9200640 1 --2- 172.21.15.152:0/758935790 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88c4147a90 0x7f88c4071790 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:27.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.497+0000 7f88c9200640 1 -- 172.21.15.152:0/758935790 >> 172.21.15.152:0/758935790 conn(0x7f88c40d2350 msgr2=0x7f88c40d2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:27.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.497+0000 7f88c9200640 1 -- 172.21.15.152:0/758935790 shutdown_connections 2024-04-17T08:47:27.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.497+0000 7f88c9200640 1 -- 172.21.15.152:0/758935790 wait complete. 2024-04-17T08:47:27.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.497+0000 7f88c9200640 1 Processor -- start 2024-04-17T08:47:27.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.497+0000 7f88c9200640 1 -- start start 2024-04-17T08:47:27.503 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.501+0000 7f88c9200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f88c4071cd0 0x7f88c415e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:27.503 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.501+0000 7f88c9200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f88c4147690 0x7f88c413a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:27.503 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.501+0000 7f88c9200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88c4147a90 0x7f88c41402e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:27.503 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.501+0000 7f88c9200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f88c406ed30 con 0x7f88c4147a90 2024-04-17T08:47:27.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.501+0000 7f88c9200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f88c406ebb0 con 0x7f88c4071cd0 2024-04-17T08:47:27.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.501+0000 7f88c9200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f88c416c690 con 0x7f88c4147690 2024-04-17T08:47:27.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.501+0000 7f88c2800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88c4147a90 0x7f88c41402e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:27.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.501+0000 7f88c2800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88c4147a90 0x7f88c41402e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57110/0 (socket says 172.21.15.152:57110) 2024-04-17T08:47:27.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.501+0000 7f88c2800640 1 -- 172.21.15.152:0/1850005861 learned_addr learned my addr 172.21.15.152:0/1850005861 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:27.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.501+0000 7f88c1e00640 1 --2- 172.21.15.152:0/1850005861 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f88c4071cd0 0x7f88c415e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:27.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.501+0000 7f88bbe00640 1 --2- 172.21.15.152:0/1850005861 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f88c4147690 0x7f88c413a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:27.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.501+0000 7f88c2800640 1 -- 172.21.15.152:0/1850005861 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f88c4147690 msgr2=0x7f88c413a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:27.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.501+0000 7f88c2800640 1 --2- 172.21.15.152:0/1850005861 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f88c4147690 0x7f88c413a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:27.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.501+0000 7f88c2800640 1 -- 172.21.15.152:0/1850005861 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f88c4071cd0 msgr2=0x7f88c415e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:27.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.501+0000 7f88c2800640 1 --2- 172.21.15.152:0/1850005861 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f88c4071cd0 0x7f88c415e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:27.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.501+0000 7f88c2800640 1 -- 172.21.15.152:0/1850005861 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88c413f240 con 0x7f88c4147a90 2024-04-17T08:47:27.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.501+0000 7f88bbe00640 1 --2- 172.21.15.152:0/1850005861 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f88c4147690 0x7f88c413a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:27.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.501+0000 7f88c2800640 1 --2- 172.21.15.152:0/1850005861 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88c4147a90 0x7f88c41402e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f88bc00b970 tx=0x7f88bc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:27.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.501+0000 7f88ba000640 1 -- 172.21.15.152:0/1850005861 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88bc019070 con 0x7f88c4147a90 2024-04-17T08:47:27.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.501+0000 7f88ba000640 1 -- 172.21.15.152:0/1850005861 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88bc00cb40 con 0x7f88c4147a90 2024-04-17T08:47:27.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.501+0000 7f88c9200640 1 -- 172.21.15.152:0/1850005861 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88c413f520 con 0x7f88c4147a90 2024-04-17T08:47:27.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.501+0000 7f88ba000640 1 -- 172.21.15.152:0/1850005861 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88bc014440 con 0x7f88c4147a90 2024-04-17T08:47:27.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.501+0000 7f88c9200640 1 -- 172.21.15.152:0/1850005861 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88c413fae0 con 0x7f88c4147a90 2024-04-17T08:47:27.506 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.501+0000 7f88c9200640 1 -- 172.21.15.152:0/1850005861 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88c4068a30 con 0x7f88c4147a90 2024-04-17T08:47:27.506 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.505+0000 7f88ba000640 1 -- 172.21.15.152:0/1850005861 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f88bc01c070 con 0x7f88c4147a90 2024-04-17T08:47:27.506 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.505+0000 7f88ba000640 1 --2- 172.21.15.152:0/1850005861 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f88a00683b0 0x7f88a006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:27.506 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.505+0000 7f88ba000640 1 -- 172.21.15.152:0/1850005861 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f88bc0869d0 con 0x7f88c4147a90 2024-04-17T08:47:27.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.505+0000 7f88c1e00640 1 --2- 172.21.15.152:0/1850005861 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f88a00683b0 0x7f88a006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:27.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.505+0000 7f88c1e00640 1 --2- 172.21.15.152:0/1850005861 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f88a00683b0 0x7f88a006a870 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f88b4007fd0 tx=0x7f88b4007d60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:27.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.509+0000 7f88ba000640 1 -- 172.21.15.152:0/1850005861 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f88bc056480 con 0x7f88c4147a90 2024-04-17T08:47:27.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.665+0000 7f88c9200640 1 -- 172.21.15.152:0/1850005861 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f88c41627c0 con 0x7f88c4147a90 2024-04-17T08:47:27.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.669+0000 7f88ba000640 1 -- 172.21.15.152:0/1850005861 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f88bc05a780 con 0x7f88c4147a90 2024-04-17T08:47:27.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.673+0000 7f88c9200640 1 -- 172.21.15.152:0/1850005861 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f88a00683b0 msgr2=0x7f88a006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:27.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.673+0000 7f88c9200640 1 --2- 172.21.15.152:0/1850005861 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f88a00683b0 0x7f88a006a870 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f88b4007fd0 tx=0x7f88b4007d60 comp rx=0 tx=0).stop 2024-04-17T08:47:27.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.673+0000 7f88c9200640 1 -- 172.21.15.152:0/1850005861 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88c4147a90 msgr2=0x7f88c41402e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:27.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.673+0000 7f88c9200640 1 --2- 172.21.15.152:0/1850005861 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88c4147a90 0x7f88c41402e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f88bc00b970 tx=0x7f88bc00be30 comp rx=0 tx=0).stop 2024-04-17T08:47:27.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.673+0000 7f88c9200640 1 -- 172.21.15.152:0/1850005861 shutdown_connections 2024-04-17T08:47:27.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.673+0000 7f88c9200640 1 --2- 172.21.15.152:0/1850005861 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88c4147a90 0x7f88c41402e0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:27.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.673+0000 7f88c9200640 1 --2- 172.21.15.152:0/1850005861 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f88a00683b0 0x7f88a006a870 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:27.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.673+0000 7f88c9200640 1 --2- 172.21.15.152:0/1850005861 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f88c4147690 0x7f88c413a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:27.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.673+0000 7f88c9200640 1 --2- 172.21.15.152:0/1850005861 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f88c4071cd0 0x7f88c415e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:27.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.673+0000 7f88c9200640 1 -- 172.21.15.152:0/1850005861 >> 172.21.15.152:0/1850005861 conn(0x7f88c40d2350 msgr2=0x7f88c40cedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:27.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.673+0000 7f88c9200640 1 -- 172.21.15.152:0/1850005861 shutdown_connections 2024-04-17T08:47:27.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:27.673+0000 7f88c9200640 1 -- 172.21.15.152:0/1850005861 wait complete. 2024-04-17T08:47:27.694 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-17T08:47:27.694 DEBUG:teuthology.orchestra.run.smithi152:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-17T08:47:27.752 DEBUG:teuthology.orchestra.run.smithi196:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-17T08:47:27.800 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-17T08:47:27.800 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-17T08:47:27.800 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-17T08:47:27.808 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-17T08:47:27.808 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-17T08:47:27.857 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T08:47:28.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.033+0000 7f0d31400640 1 Processor -- start 2024-04-17T08:47:28.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.033+0000 7f0d31400640 1 -- start start 2024-04-17T08:47:28.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.033+0000 7f0d31400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0d2c15b8c0 0x7f0d2c071d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:28.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.033+0000 7f0d31400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f0d2c072280 0x7f0d2c0b2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:28.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.033+0000 7f0d31400640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d2c0b4620 con 0x7f0d2c15b4e0 2024-04-17T08:47:28.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.033+0000 7f0d31400640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f0d2c0b4900 con 0x7f0d2c072280 2024-04-17T08:47:28.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.033+0000 7f0d31400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f0d2c06e3e0 con 0x7f0d2c15b8c0 2024-04-17T08:47:28.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.033+0000 7f0d30a00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f0d2c072280 0x7f0d2c0b2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:28.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.033+0000 7f0d30a00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f0d2c072280 0x7f0d2c0b2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57118/0 (socket says 172.21.15.152:57118) 2024-04-17T08:47:28.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.033+0000 7f0d30a00640 1 -- 172.21.15.152:0/3038642624 learned_addr learned my addr 172.21.15.152:0/3038642624 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:28.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.033+0000 7f0d2b400640 1 --2- 172.21.15.152:0/3038642624 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0d2c15b8c0 0x7f0d2c071d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:28.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.033+0000 7f0d30a00640 1 -- 172.21.15.152:0/3038642624 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0d2c15b8c0 msgr2=0x7f0d2c071d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:28.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.033+0000 7f0d30a00640 1 --2- 172.21.15.152:0/3038642624 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0d2c15b8c0 0x7f0d2c071d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:28.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.033+0000 7f0d30a00640 1 -- 172.21.15.152:0/3038642624 >> v1:172.21.15.152:6789/0 conn(0x7f0d2c15b4e0 legacy=0x7f0d2c06cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:28.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.033+0000 7f0d30a00640 1 -- 172.21.15.152:0/3038642624 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d2c06e6c0 con 0x7f0d2c072280 2024-04-17T08:47:28.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.037+0000 7f0d30a00640 1 --2- 172.21.15.152:0/3038642624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d2c072280 0x7f0d2c0b2f80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0d24009e50 tx=0x7f0d2401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2384728f0b1a2ea server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:28.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.037+0000 7f0d2aa00640 1 -- 172.21.15.152:0/3038642624 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d240a5770 con 0x7f0d2c072280 2024-04-17T08:47:28.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.037+0000 7f0d2aa00640 1 -- 172.21.15.152:0/3038642624 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d240a5910 con 0x7f0d2c072280 2024-04-17T08:47:28.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.037+0000 7f0d2aa00640 1 -- 172.21.15.152:0/3038642624 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d240a5ce0 con 0x7f0d2c072280 2024-04-17T08:47:28.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.037+0000 7f0d31400640 1 -- 172.21.15.152:0/3038642624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d2c072280 msgr2=0x7f0d2c0b2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:28.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.037+0000 7f0d31400640 1 --2- 172.21.15.152:0/3038642624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d2c072280 0x7f0d2c0b2f80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0d24009e50 tx=0x7f0d2401c9a0 comp rx=0 tx=0).stop 2024-04-17T08:47:28.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.037+0000 7f0d31400640 1 -- 172.21.15.152:0/3038642624 shutdown_connections 2024-04-17T08:47:28.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.037+0000 7f0d31400640 1 --2- 172.21.15.152:0/3038642624 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0d2c15b8c0 0x7f0d2c071d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:28.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.037+0000 7f0d31400640 1 --2- 172.21.15.152:0/3038642624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d2c072280 0x7f0d2c0b2f80 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:28.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.037+0000 7f0d31400640 1 -- 172.21.15.152:0/3038642624 >> 172.21.15.152:0/3038642624 conn(0x7f0d2c0d0050 msgr2=0x7f0d2c0d0460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:28.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.037+0000 7f0d31400640 1 -- 172.21.15.152:0/3038642624 shutdown_connections 2024-04-17T08:47:28.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.037+0000 7f0d31400640 1 -- 172.21.15.152:0/3038642624 wait complete. 2024-04-17T08:47:28.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.037+0000 7f0d31400640 1 Processor -- start 2024-04-17T08:47:28.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.037+0000 7f0d31400640 1 -- start start 2024-04-17T08:47:28.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.041+0000 7f0d31400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0d2c072280 0x7f0d2c14f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:28.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.041+0000 7f0d31400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0d2c15b4e0 0x7f0d2c14ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:28.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.041+0000 7f0d31400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d2c15b8c0 0x7f0d2c0afba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:28.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.041+0000 7f0d31400640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0d2c0b40a0 con 0x7f0d2c15b8c0 2024-04-17T08:47:28.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.041+0000 7f0d31400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0d2c0b3f20 con 0x7f0d2c072280 2024-04-17T08:47:28.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.041+0000 7f0d31400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f0d2c0b4220 con 0x7f0d2c15b4e0 2024-04-17T08:47:28.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.041+0000 7f0d30a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d2c15b8c0 0x7f0d2c0afba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:28.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.041+0000 7f0d30a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d2c15b8c0 0x7f0d2c0afba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57132/0 (socket says 172.21.15.152:57132) 2024-04-17T08:47:28.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.041+0000 7f0d30a00640 1 -- 172.21.15.152:0/1567119234 learned_addr learned my addr 172.21.15.152:0/1567119234 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:28.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.041+0000 7f0d2b400640 1 --2- 172.21.15.152:0/1567119234 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0d2c15b4e0 0x7f0d2c14ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:28.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.041+0000 7f0d2be00640 1 --2- 172.21.15.152:0/1567119234 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0d2c072280 0x7f0d2c14f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:28.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.041+0000 7f0d30a00640 1 -- 172.21.15.152:0/1567119234 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0d2c15b4e0 msgr2=0x7f0d2c14ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:28.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.041+0000 7f0d30a00640 1 --2- 172.21.15.152:0/1567119234 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0d2c15b4e0 0x7f0d2c14ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:28.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.041+0000 7f0d30a00640 1 -- 172.21.15.152:0/1567119234 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0d2c072280 msgr2=0x7f0d2c14f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:28.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.041+0000 7f0d30a00640 1 --2- 172.21.15.152:0/1567119234 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0d2c072280 0x7f0d2c14f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:28.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.041+0000 7f0d30a00640 1 -- 172.21.15.152:0/1567119234 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d2c06fbc0 con 0x7f0d2c15b8c0 2024-04-17T08:47:28.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.041+0000 7f0d30a00640 1 --2- 172.21.15.152:0/1567119234 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d2c15b8c0 0x7f0d2c0afba0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0d240af040 tx=0x7f0d24019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:28.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.041+0000 7f0d23e00640 1 -- 172.21.15.152:0/1567119234 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d240bc020 con 0x7f0d2c15b8c0 2024-04-17T08:47:28.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.041+0000 7f0d23e00640 1 -- 172.21.15.152:0/1567119234 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d240b8880 con 0x7f0d2c15b8c0 2024-04-17T08:47:28.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.041+0000 7f0d23e00640 1 -- 172.21.15.152:0/1567119234 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d240a5770 con 0x7f0d2c15b8c0 2024-04-17T08:47:28.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.041+0000 7f0d31400640 1 -- 172.21.15.152:0/1567119234 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d2c15bdb0 con 0x7f0d2c15b8c0 2024-04-17T08:47:28.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.041+0000 7f0d31400640 1 -- 172.21.15.152:0/1567119234 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d2c0b0800 con 0x7f0d2c15b8c0 2024-04-17T08:47:28.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.041+0000 7f0d31400640 1 -- 172.21.15.152:0/1567119234 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d2c075c10 con 0x7f0d2c15b8c0 2024-04-17T08:47:28.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.041+0000 7f0d23e00640 1 -- 172.21.15.152:0/1567119234 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0d240bf020 con 0x7f0d2c15b8c0 2024-04-17T08:47:28.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.045+0000 7f0d23e00640 1 --2- 172.21.15.152:0/1567119234 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0d0c0683b0 0x7f0d0c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:28.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.045+0000 7f0d23e00640 1 -- 172.21.15.152:0/1567119234 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f0d24121680 con 0x7f0d2c15b8c0 2024-04-17T08:47:28.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.045+0000 7f0d2be00640 1 --2- 172.21.15.152:0/1567119234 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0d0c0683b0 0x7f0d0c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:28.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.045+0000 7f0d2be00640 1 --2- 172.21.15.152:0/1567119234 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0d0c0683b0 0x7f0d0c06a870 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c09e250 tx=0x7f0d1c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:28.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.049+0000 7f0d23e00640 1 -- 172.21.15.152:0/1567119234 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f0d240c7020 con 0x7f0d2c15b8c0 2024-04-17T08:47:28.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.205+0000 7f0d31400640 1 -- 172.21.15.152:0/1567119234 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0d2c0b09d0 con 0x7f0d2c15b8c0 2024-04-17T08:47:28.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.205+0000 7f0d23e00640 1 -- 172.21.15.152:0/1567119234 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18972 (secure 0 0 0) 0x7f0d24016620 con 0x7f0d2c15b8c0 2024-04-17T08:47:28.210 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:47:28.210 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":26,"fsid":"ce68f82e-ec5f-4205-9fd5-bdfdf6ef31e2","created":"2024-04-17T08:46:08.353546+0000","modified":"2024-04-17T08:47:15.280634+0000","last_up_change":"2024-04-17T08:46:20.738799+0000","last_in_change":"2024-04-17T08:46:11.210050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T08:46:21.386856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T08:46:31.812460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T08:46:32.555559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T08:46:36.258078+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"682f0192-187c-404e-bc7a-b6b4e23825e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6819","nonce":3603799291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6823","nonce":3603799291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6831","nonce":3603799291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6827","nonce":3603799291}]},"public_addr":"172.21.15.152:6819/3603799291","cluster_addr":"172.21.15.152:6823/3603799291","heartbeat_back_addr":"172.21.15.152:6831/3603799291","heartbeat_front_addr":"172.21.15.152:6827/3603799291","state":["exists","up"]},{"osd":1,"uuid":"f0fe8fef-60ec-4a39-83b6-2fa6a5adb0f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6801","nonce":4133383142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6803","nonce":4133383142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6807","nonce":4133383142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6805","nonce":4133383142}]},"public_addr":"172.21.15.152:6801/4133383142","cluster_addr":"172.21.15.152:6803/4133383142","heartbeat_back_addr":"172.21.15.152:6807/4133383142","heartbeat_front_addr":"172.21.15.152:6805/4133383142","state":["exists","up"]},{"osd":2,"uuid":"35f36d9c-5245-4431-a618-f4df0fa380ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6809","nonce":3826143898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6811","nonce":3826143898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6815","nonce":3826143898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6813","nonce":3826143898}]},"public_addr":"172.21.15.152:6809/3826143898","cluster_addr":"172.21.15.152:6811/3826143898","heartbeat_back_addr":"172.21.15.152:6815/3826143898","heartbeat_front_addr":"172.21.15.152:6813/3826143898","state":["exists","up"]},{"osd":3,"uuid":"96e56ca5-15b4-4895-9b79-da2c92043159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6818","nonce":165717826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6822","nonce":165717826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6830","nonce":165717826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6826","nonce":165717826}]},"public_addr":"172.21.15.152:6818/165717826","cluster_addr":"172.21.15.152:6822/165717826","heartbeat_back_addr":"172.21.15.152:6830/165717826","heartbeat_front_addr":"172.21.15.152:6826/165717826","state":["exists","up"]},{"osd":4,"uuid":"f5aa10a4-9ff9-41fe-a5c9-15326f982cc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6817","nonce":4080159297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6819","nonce":4080159297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6823","nonce":4080159297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6821","nonce":4080159297}]},"public_addr":"172.21.15.196:6817/4080159297","cluster_addr":"172.21.15.196:6819/4080159297","heartbeat_back_addr":"172.21.15.196:6823/4080159297","heartbeat_front_addr":"172.21.15.196:6821/4080159297","state":["exists","up"]},{"osd":5,"uuid":"42bab884-3476-47ae-ac65-935fa6e0f055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6801","nonce":3519444232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6803","nonce":3519444232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6807","nonce":3519444232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6805","nonce":3519444232}]},"public_addr":"172.21.15.196:6801/3519444232","cluster_addr":"172.21.15.196:6803/3519444232","heartbeat_back_addr":"172.21.15.196:6807/3519444232","heartbeat_front_addr":"172.21.15.196:6805/3519444232","state":["exists","up"]},{"osd":6,"uuid":"460b6167-f57b-4224-9c92-cfc9b80bbe99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6809","nonce":275739834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6811","nonce":275739834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6815","nonce":275739834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6813","nonce":275739834}]},"public_addr":"172.21.15.196:6809/275739834","cluster_addr":"172.21.15.196:6811/275739834","heartbeat_back_addr":"172.21.15.196:6815/275739834","heartbeat_front_addr":"172.21.15.196:6813/275739834","state":["exists","up"]},{"osd":7,"uuid":"d695643f-5e07-4e2a-a646-c06bd97b6650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6825","nonce":307626968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6827","nonce":307626968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6831","nonce":307626968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6829","nonce":307626968}]},"public_addr":"172.21.15.196:6825/307626968","cluster_addr":"172.21.15.196:6827/307626968","heartbeat_back_addr":"172.21.15.196:6831/307626968","heartbeat_front_addr":"172.21.15.196:6829/307626968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.293257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.964533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.248895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.010000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.832554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.743704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930171+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930962+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T08:47:28.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.209+0000 7f0d31400640 1 -- 172.21.15.152:0/1567119234 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0d0c0683b0 msgr2=0x7f0d0c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:28.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.209+0000 7f0d31400640 1 --2- 172.21.15.152:0/1567119234 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0d0c0683b0 0x7f0d0c06a870 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c09e250 tx=0x7f0d1c009040 comp rx=0 tx=0).stop 2024-04-17T08:47:28.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.209+0000 7f0d31400640 1 -- 172.21.15.152:0/1567119234 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d2c15b8c0 msgr2=0x7f0d2c0afba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:28.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.209+0000 7f0d31400640 1 --2- 172.21.15.152:0/1567119234 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d2c15b8c0 0x7f0d2c0afba0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0d240af040 tx=0x7f0d24019740 comp rx=0 tx=0).stop 2024-04-17T08:47:28.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.209+0000 7f0d31400640 1 -- 172.21.15.152:0/1567119234 shutdown_connections 2024-04-17T08:47:28.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.209+0000 7f0d31400640 1 --2- 172.21.15.152:0/1567119234 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d2c15b8c0 0x7f0d2c0afba0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:28.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.209+0000 7f0d31400640 1 --2- 172.21.15.152:0/1567119234 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0d0c0683b0 0x7f0d0c06a870 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:28.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.209+0000 7f0d31400640 1 --2- 172.21.15.152:0/1567119234 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0d2c15b4e0 0x7f0d2c14ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:28.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.209+0000 7f0d31400640 1 --2- 172.21.15.152:0/1567119234 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0d2c072280 0x7f0d2c14f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:28.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.209+0000 7f0d31400640 1 -- 172.21.15.152:0/1567119234 >> 172.21.15.152:0/1567119234 conn(0x7f0d2c0d0050 msgr2=0x7f0d2c15a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:28.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.209+0000 7f0d31400640 1 -- 172.21.15.152:0/1567119234 shutdown_connections 2024-04-17T08:47:28.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.209+0000 7f0d31400640 1 -- 172.21.15.152:0/1567119234 wait complete. 2024-04-17T08:47:28.232 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T08:46:21.386856+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-17T08:46:31.812460+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-17T08:46:32.555559+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-17T08:46:36.258078+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-17T08:47:28.232 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T08:47:28.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.369+0000 7f80df000640 1 Processor -- start 2024-04-17T08:47:28.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.369+0000 7f80df000640 1 -- start start 2024-04-17T08:47:28.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.369+0000 7f80df000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f80d815a010 0x7f80d80d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:28.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.369+0000 7f80df000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f80d815d710 0x7f80d80d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:28.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.369+0000 7f80df000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80d8160d20 con 0x7f80d8160010 2024-04-17T08:47:28.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.369+0000 7f80df000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f80d815d280 con 0x7f80d815d710 2024-04-17T08:47:28.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.369+0000 7f80df000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f80d815c9d0 con 0x7f80d815a010 2024-04-17T08:47:28.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.373+0000 7f80cf400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f80d815d710 0x7f80d80d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:28.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.373+0000 7f80d7e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f80d815a010 0x7f80d80d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:28.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.373+0000 7f80cf400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f80d815d710 0x7f80d80d08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.152:57006/0 (socket says 172.21.15.152:57006) 2024-04-17T08:47:28.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.373+0000 7f80cf400640 1 -- 172.21.15.152:0/2236646153 learned_addr learned my addr 172.21.15.152:0/2236646153 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:28.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.373+0000 7f80cf400640 1 -- 172.21.15.152:0/2236646153 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f80d815a010 msgr2=0x7f80d80d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:28.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.373+0000 7f80cf400640 1 --2- 172.21.15.152:0/2236646153 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f80d815a010 0x7f80d80d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:28.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.373+0000 7f80cf400640 1 -- 172.21.15.152:0/2236646153 >> v1:172.21.15.196:6789/0 conn(0x7f80d8160010 legacy=0x7f80d8160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:28.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.373+0000 7f80cf400640 1 -- 172.21.15.152:0/2236646153 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80d815cc30 con 0x7f80d815d710 2024-04-17T08:47:28.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.373+0000 7f80cf400640 1 --2- 172.21.15.152:0/2236646153 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f80d815d710 0x7f80d80d08a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f80c0009870 tx=0x7f80c001c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=950bc7b09c996ef2 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:28.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.373+0000 7f80d7400640 1 -- 172.21.15.152:0/2236646153 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80c00b1070 con 0x7f80d815d710 2024-04-17T08:47:28.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.377+0000 7f80d7400640 1 -- 172.21.15.152:0/2236646153 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80c00ac600 con 0x7f80d815d710 2024-04-17T08:47:28.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.377+0000 7f80d7400640 1 -- 172.21.15.152:0/2236646153 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80c00ac9d0 con 0x7f80d815d710 2024-04-17T08:47:28.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.377+0000 7f80df000640 1 -- 172.21.15.152:0/2236646153 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f80d815d710 msgr2=0x7f80d80d08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:28.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.377+0000 7f80df000640 1 --2- 172.21.15.152:0/2236646153 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f80d815d710 0x7f80d80d08a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f80c0009870 tx=0x7f80c001c4d0 comp rx=0 tx=0).stop 2024-04-17T08:47:28.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.377+0000 7f80df000640 1 -- 172.21.15.152:0/2236646153 shutdown_connections 2024-04-17T08:47:28.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.377+0000 7f80df000640 1 --2- 172.21.15.152:0/2236646153 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f80d815d710 0x7f80d80d08a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:28.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.377+0000 7f80df000640 1 --2- 172.21.15.152:0/2236646153 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f80d815a010 0x7f80d80d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:28.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.377+0000 7f80df000640 1 -- 172.21.15.152:0/2236646153 >> 172.21.15.152:0/2236646153 conn(0x7f80d80b3350 msgr2=0x7f80d80b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:28.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.377+0000 7f80df000640 1 -- 172.21.15.152:0/2236646153 shutdown_connections 2024-04-17T08:47:28.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.377+0000 7f80df000640 1 -- 172.21.15.152:0/2236646153 wait complete. 2024-04-17T08:47:28.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.377+0000 7f80df000640 1 Processor -- start 2024-04-17T08:47:28.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.377+0000 7f80df000640 1 -- start start 2024-04-17T08:47:28.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.377+0000 7f80df000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80d815a010 0x7f80d80997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:28.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.377+0000 7f80df000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f80d815d710 0x7f80d80b0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:28.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.377+0000 7f80df000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f80d8160010 0x7f80d80b1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:28.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.377+0000 7f80df000640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f80d815e780 con 0x7f80d815a010 2024-04-17T08:47:28.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.377+0000 7f80df000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f80d815e600 con 0x7f80d815d710 2024-04-17T08:47:28.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.377+0000 7f80df000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f80d815e900 con 0x7f80d8160010 2024-04-17T08:47:28.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.377+0000 7f80d7e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80d815a010 0x7f80d80997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:28.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.377+0000 7f80d7e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80d815a010 0x7f80d80997f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32848/0 (socket says 172.21.15.152:32848) 2024-04-17T08:47:28.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.377+0000 7f80d7e00640 1 -- 172.21.15.152:0/3259436426 learned_addr learned my addr 172.21.15.152:0/3259436426 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:28.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.377+0000 7f80cf400640 1 --2- 172.21.15.152:0/3259436426 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f80d815d710 0x7f80d80b0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:28.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.377+0000 7f80dd000640 1 --2- 172.21.15.152:0/3259436426 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f80d8160010 0x7f80d80b1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:28.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.381+0000 7f80d7e00640 1 -- 172.21.15.152:0/3259436426 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f80d8160010 msgr2=0x7f80d80b1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:28.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.381+0000 7f80d7e00640 1 --2- 172.21.15.152:0/3259436426 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f80d8160010 0x7f80d80b1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:28.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.381+0000 7f80d7e00640 1 -- 172.21.15.152:0/3259436426 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f80d815d710 msgr2=0x7f80d80b0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:28.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.381+0000 7f80d7e00640 1 --2- 172.21.15.152:0/3259436426 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f80d815d710 0x7f80d80b0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:28.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.381+0000 7f80d7e00640 1 -- 172.21.15.152:0/3259436426 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80d815bfb0 con 0x7f80d815a010 2024-04-17T08:47:28.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.381+0000 7f80d7e00640 1 --2- 172.21.15.152:0/3259436426 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80d815a010 0x7f80d80997f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f80c800e930 tx=0x7f80c800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:28.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.381+0000 7f80d4c00640 1 -- 172.21.15.152:0/3259436426 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80c8017070 con 0x7f80d815a010 2024-04-17T08:47:28.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.381+0000 7f80d4c00640 1 -- 172.21.15.152:0/3259436426 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80c800ca00 con 0x7f80d815a010 2024-04-17T08:47:28.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.381+0000 7f80d4c00640 1 -- 172.21.15.152:0/3259436426 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80c800cdb0 con 0x7f80d815a010 2024-04-17T08:47:28.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.381+0000 7f80df000640 1 -- 172.21.15.152:0/3259436426 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80d815bcd0 con 0x7f80d815a010 2024-04-17T08:47:28.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.381+0000 7f80df000640 1 -- 172.21.15.152:0/3259436426 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80d806f160 con 0x7f80d815a010 2024-04-17T08:47:28.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.381+0000 7f80df000640 1 -- 172.21.15.152:0/3259436426 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80d8068a30 con 0x7f80d815a010 2024-04-17T08:47:28.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.381+0000 7f80d4c00640 1 -- 172.21.15.152:0/3259436426 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f80c801a070 con 0x7f80d815a010 2024-04-17T08:47:28.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.381+0000 7f80d4c00640 1 --2- 172.21.15.152:0/3259436426 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f80b4068380 0x7f80b406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:28.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.385+0000 7f80d4c00640 1 -- 172.21.15.152:0/3259436426 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f80c8086de0 con 0x7f80d815a010 2024-04-17T08:47:28.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.385+0000 7f80cf400640 1 --2- 172.21.15.152:0/3259436426 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f80b4068380 0x7f80b406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:28.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.385+0000 7f80cf400640 1 --2- 172.21.15.152:0/3259436426 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f80b4068380 0x7f80b406a840 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f80c00ae000 tx=0x7f80c00a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:28.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.389+0000 7f80d4c00640 1 -- 172.21.15.152:0/3259436426 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f80c8056950 con 0x7f80d815a010 2024-04-17T08:47:28.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.545+0000 7f80df000640 1 -- 172.21.15.152:0/3259436426 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f80d80adf00 con 0x7f80d815a010 2024-04-17T08:47:28.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.545+0000 7f80d4c00640 1 -- 172.21.15.152:0/3259436426 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f80c805ac50 con 0x7f80d815a010 2024-04-17T08:47:28.548 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2024-04-17T08:47:28.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.545+0000 7f80df000640 1 -- 172.21.15.152:0/3259436426 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f80b4068380 msgr2=0x7f80b406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:28.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.545+0000 7f80df000640 1 --2- 172.21.15.152:0/3259436426 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f80b4068380 0x7f80b406a840 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f80c00ae000 tx=0x7f80c00a7000 comp rx=0 tx=0).stop 2024-04-17T08:47:28.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.545+0000 7f80df000640 1 -- 172.21.15.152:0/3259436426 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80d815a010 msgr2=0x7f80d80997f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:28.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.545+0000 7f80df000640 1 --2- 172.21.15.152:0/3259436426 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80d815a010 0x7f80d80997f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f80c800e930 tx=0x7f80c800edf0 comp rx=0 tx=0).stop 2024-04-17T08:47:28.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.545+0000 7f80df000640 1 -- 172.21.15.152:0/3259436426 shutdown_connections 2024-04-17T08:47:28.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.545+0000 7f80df000640 1 --2- 172.21.15.152:0/3259436426 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f80b4068380 0x7f80b406a840 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:28.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.545+0000 7f80df000640 1 --2- 172.21.15.152:0/3259436426 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f80d8160010 0x7f80d80b1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:28.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.545+0000 7f80df000640 1 --2- 172.21.15.152:0/3259436426 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f80d815d710 0x7f80d80b0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:28.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.545+0000 7f80df000640 1 --2- 172.21.15.152:0/3259436426 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80d815a010 0x7f80d80997f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:28.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.549+0000 7f80df000640 1 -- 172.21.15.152:0/3259436426 >> 172.21.15.152:0/3259436426 conn(0x7f80d80b3350 msgr2=0x7f80d80b29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:28.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.549+0000 7f80df000640 1 -- 172.21.15.152:0/3259436426 shutdown_connections 2024-04-17T08:47:28.551 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.549+0000 7f80df000640 1 -- 172.21.15.152:0/3259436426 wait complete. 2024-04-17T08:47:28.569 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-17T08:47:28.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.705+0000 7f6332a00640 1 Processor -- start 2024-04-17T08:47:28.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.705+0000 7f6332a00640 1 -- start start 2024-04-17T08:47:28.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.705+0000 7f6332a00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f632c06f980 0x7f632c072530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:28.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.705+0000 7f6332a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f632c0d0360 0x7f632c0d07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:28.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.705+0000 7f6332a00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f632c15bfd0 con 0x7f632c0af670 2024-04-17T08:47:28.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.705+0000 7f6332a00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f632c0d0cf0 con 0x7f632c06f980 2024-04-17T08:47:28.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.705+0000 7f6332a00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f632c15c820 con 0x7f632c0d0360 2024-04-17T08:47:28.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.705+0000 7f632be00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f632c0af670 0x7f632c15b8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:60452/0 (socket says 172.21.15.152:60452) 2024-04-17T08:47:28.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.705+0000 7f632be00640 1 -- 172.21.15.152:0/733479680 learned_addr learned my addr 172.21.15.152:0/733479680 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:28.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.705+0000 7f632b400640 1 --2- 172.21.15.152:0/733479680 >> v2:172.21.15.152:3300/0 conn(0x7f632c06f980 0x7f632c072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:28.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.705+0000 7f6330a00640 1 --2- 172.21.15.152:0/733479680 >> v2:172.21.15.196:3300/0 conn(0x7f632c0d0360 0x7f632c0d07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:28.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.705+0000 7f632b400640 1 -- 172.21.15.152:0/733479680 >> v2:172.21.15.196:3300/0 conn(0x7f632c0d0360 msgr2=0x7f632c0d07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:28.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.705+0000 7f632b400640 1 --2- 172.21.15.152:0/733479680 >> v2:172.21.15.196:3300/0 conn(0x7f632c0d0360 0x7f632c0d07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:28.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.705+0000 7f632b400640 1 -- 172.21.15.152:0/733479680 >> v1:172.21.15.152:6789/0 conn(0x7f632c0af670 legacy=0x7f632c15b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:28.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.705+0000 7f632b400640 1 -- 172.21.15.152:0/733479680 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f632c15c260 con 0x7f632c06f980 2024-04-17T08:47:28.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.709+0000 7f632b400640 1 --2- 172.21.15.152:0/733479680 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f632c06f980 0x7f632c072530 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f632c06d680 tx=0x7f631801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9af988e5fd31aefe server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:28.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.709+0000 7f632aa00640 1 -- 172.21.15.152:0/733479680 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63180b1070 con 0x7f632c06f980 2024-04-17T08:47:28.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.709+0000 7f632aa00640 1 -- 172.21.15.152:0/733479680 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63180ac620 con 0x7f632c06f980 2024-04-17T08:47:28.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.709+0000 7f632aa00640 1 -- 172.21.15.152:0/733479680 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63180ac9f0 con 0x7f632c06f980 2024-04-17T08:47:28.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.709+0000 7f6332a00640 1 -- 172.21.15.152:0/733479680 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f632c06f980 msgr2=0x7f632c072530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:28.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.709+0000 7f6332a00640 1 --2- 172.21.15.152:0/733479680 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f632c06f980 0x7f632c072530 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f632c06d680 tx=0x7f631801c3c0 comp rx=0 tx=0).stop 2024-04-17T08:47:28.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.709+0000 7f6332a00640 1 -- 172.21.15.152:0/733479680 shutdown_connections 2024-04-17T08:47:28.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.709+0000 7f6332a00640 1 --2- 172.21.15.152:0/733479680 >> v2:172.21.15.196:3300/0 conn(0x7f632c0d0360 0x7f632c0d07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:28.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.709+0000 7f6332a00640 1 --2- 172.21.15.152:0/733479680 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f632c06f980 0x7f632c072530 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:28.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.709+0000 7f6332a00640 1 -- 172.21.15.152:0/733479680 >> 172.21.15.152:0/733479680 conn(0x7f632c0b3350 msgr2=0x7f632c0b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:28.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.709+0000 7f6332a00640 1 -- 172.21.15.152:0/733479680 shutdown_connections 2024-04-17T08:47:28.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.709+0000 7f6332a00640 1 -- 172.21.15.152:0/733479680 wait complete. 2024-04-17T08:47:28.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.709+0000 7f6332a00640 1 Processor -- start 2024-04-17T08:47:28.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.709+0000 7f6332a00640 1 -- start start 2024-04-17T08:47:28.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.713+0000 7f6332a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f632c06f980 0x7f632c1514a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:28.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.713+0000 7f6332a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f632c0af670 0x7f632c164400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:28.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.713+0000 7f6332a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f632c0d0360 0x7f632c151f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:28.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.713+0000 7f6332a00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f632c072a70 con 0x7f632c0d0360 2024-04-17T08:47:28.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.713+0000 7f6332a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f632c0afa50 con 0x7f632c06f980 2024-04-17T08:47:28.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.713+0000 7f6332a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f632c072bf0 con 0x7f632c0af670 2024-04-17T08:47:28.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.713+0000 7f6330a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f632c0d0360 0x7f632c151f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:28.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.713+0000 7f6330a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f632c0d0360 0x7f632c151f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32860/0 (socket says 172.21.15.152:32860) 2024-04-17T08:47:28.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.713+0000 7f6330a00640 1 -- 172.21.15.152:0/278017467 learned_addr learned my addr 172.21.15.152:0/278017467 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:28.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.713+0000 7f632b400640 1 --2- 172.21.15.152:0/278017467 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f632c0af670 0x7f632c164400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:28.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.713+0000 7f632be00640 1 --2- 172.21.15.152:0/278017467 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f632c06f980 0x7f632c1514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:28.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.713+0000 7f6330a00640 1 -- 172.21.15.152:0/278017467 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f632c0af670 msgr2=0x7f632c164400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:28.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.713+0000 7f6330a00640 1 --2- 172.21.15.152:0/278017467 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f632c0af670 0x7f632c164400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:28.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.713+0000 7f6330a00640 1 -- 172.21.15.152:0/278017467 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f632c06f980 msgr2=0x7f632c1514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:28.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.713+0000 7f6330a00640 1 --2- 172.21.15.152:0/278017467 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f632c06f980 0x7f632c1514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:28.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.713+0000 7f6330a00640 1 -- 172.21.15.152:0/278017467 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f632c158d40 con 0x7f632c0d0360 2024-04-17T08:47:28.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.713+0000 7f632be00640 1 --2- 172.21.15.152:0/278017467 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f632c06f980 0x7f632c1514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:28.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.713+0000 7f6330a00640 1 --2- 172.21.15.152:0/278017467 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f632c0d0360 0x7f632c151f40 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f632400cc60 tx=0x7f632400a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:28.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.713+0000 7f6323e00640 1 -- 172.21.15.152:0/278017467 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63240039a0 con 0x7f632c0d0360 2024-04-17T08:47:28.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.713+0000 7f6323e00640 1 -- 172.21.15.152:0/278017467 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6324003b40 con 0x7f632c0d0360 2024-04-17T08:47:28.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.713+0000 7f6332a00640 1 -- 172.21.15.152:0/278017467 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f632c150720 con 0x7f632c0d0360 2024-04-17T08:47:28.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.713+0000 7f6323e00640 1 -- 172.21.15.152:0/278017467 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6324004020 con 0x7f632c0d0360 2024-04-17T08:47:28.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.713+0000 7f6332a00640 1 -- 172.21.15.152:0/278017467 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f632c1509c0 con 0x7f632c0d0360 2024-04-17T08:47:28.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.713+0000 7f6332a00640 1 -- 172.21.15.152:0/278017467 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f632c068a30 con 0x7f632c0d0360 2024-04-17T08:47:28.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.713+0000 7f6323e00640 1 -- 172.21.15.152:0/278017467 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f63240041c0 con 0x7f632c0d0360 2024-04-17T08:47:28.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.717+0000 7f6323e00640 1 --2- 172.21.15.152:0/278017467 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f630c068380 0x7f630c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:28.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.717+0000 7f6323e00640 1 -- 172.21.15.152:0/278017467 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f6324087190 con 0x7f632c0d0360 2024-04-17T08:47:28.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.717+0000 7f632be00640 1 --2- 172.21.15.152:0/278017467 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f630c068380 0x7f630c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:28.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.717+0000 7f632be00640 1 --2- 172.21.15.152:0/278017467 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f630c068380 0x7f630c06a840 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f632c0cf260 tx=0x7f631c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:28.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.721+0000 7f6323e00640 1 -- 172.21.15.152:0/278017467 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f6324014030 con 0x7f632c0d0360 2024-04-17T08:47:28.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.877+0000 7f6332a00640 1 -- 172.21.15.152:0/278017467 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f632c06cdb0 con 0x7f632c0d0360 2024-04-17T08:47:28.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.877+0000 7f6323e00640 1 -- 172.21.15.152:0/278017467 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f6324056cf0 con 0x7f632c0d0360 2024-04-17T08:47:28.879 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-04-17T08:47:28.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.877+0000 7f6332a00640 1 -- 172.21.15.152:0/278017467 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f630c068380 msgr2=0x7f630c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:28.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.877+0000 7f6332a00640 1 --2- 172.21.15.152:0/278017467 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f630c068380 0x7f630c06a840 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f632c0cf260 tx=0x7f631c009040 comp rx=0 tx=0).stop 2024-04-17T08:47:28.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.877+0000 7f6332a00640 1 -- 172.21.15.152:0/278017467 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f632c0d0360 msgr2=0x7f632c151f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:28.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.877+0000 7f6332a00640 1 --2- 172.21.15.152:0/278017467 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f632c0d0360 0x7f632c151f40 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f632400cc60 tx=0x7f632400a5c0 comp rx=0 tx=0).stop 2024-04-17T08:47:28.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.877+0000 7f6332a00640 1 -- 172.21.15.152:0/278017467 shutdown_connections 2024-04-17T08:47:28.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.877+0000 7f6332a00640 1 --2- 172.21.15.152:0/278017467 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f632c0d0360 0x7f632c151f40 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:28.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.877+0000 7f6332a00640 1 --2- 172.21.15.152:0/278017467 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f630c068380 0x7f630c06a840 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:28.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.877+0000 7f6332a00640 1 --2- 172.21.15.152:0/278017467 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f632c0af670 0x7f632c164400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:28.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.877+0000 7f6332a00640 1 --2- 172.21.15.152:0/278017467 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f632c06f980 0x7f632c1514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:28.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.877+0000 7f6332a00640 1 -- 172.21.15.152:0/278017467 >> 172.21.15.152:0/278017467 conn(0x7f632c0b3350 msgr2=0x7f632c067770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:28.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.877+0000 7f6332a00640 1 -- 172.21.15.152:0/278017467 shutdown_connections 2024-04-17T08:47:28.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:28.877+0000 7f6332a00640 1 -- 172.21.15.152:0/278017467 wait complete. 2024-04-17T08:47:28.901 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-17T08:47:29.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.037+0000 7f3252600640 1 Processor -- start 2024-04-17T08:47:29.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.037+0000 7f3252600640 1 -- start start 2024-04-17T08:47:29.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.037+0000 7f3252600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f324c15a010 0x7f324c0d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:29.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.037+0000 7f3252600640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f324c160720 0x7f324c0d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:29.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.037+0000 7f3252600640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f324c160d20 con 0x7f324c15d710 2024-04-17T08:47:29.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.037+0000 7f3252600640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f324c15d280 con 0x7f324c160720 2024-04-17T08:47:29.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.037+0000 7f3252600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f324c15c9d0 con 0x7f324c15a010 2024-04-17T08:47:29.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.037+0000 7f324be00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f324c160720 0x7f324c0d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:29.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.037+0000 7f324be00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f324c160720 0x7f324c0d08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32862/0 (socket says 172.21.15.152:32862) 2024-04-17T08:47:29.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.037+0000 7f324be00640 1 -- 172.21.15.152:0/2989560006 learned_addr learned my addr 172.21.15.152:0/2989560006 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:29.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.037+0000 7f324b400640 1 --2- 172.21.15.152:0/2989560006 >> v2:172.21.15.196:3300/0 conn(0x7f324c15a010 0x7f324c0d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:29.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.037+0000 7f324be00640 1 -- 172.21.15.152:0/2989560006 >> v2:172.21.15.196:3300/0 conn(0x7f324c15a010 msgr2=0x7f324c0d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:29.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.037+0000 7f324be00640 1 --2- 172.21.15.152:0/2989560006 >> v2:172.21.15.196:3300/0 conn(0x7f324c15a010 0x7f324c0d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:29.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.037+0000 7f324be00640 1 -- 172.21.15.152:0/2989560006 >> v1:172.21.15.196:6789/0 conn(0x7f324c15d710 legacy=0x7f324c160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:29.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.037+0000 7f324be00640 1 -- 172.21.15.152:0/2989560006 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f324c15cc30 con 0x7f324c160720 2024-04-17T08:47:29.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.041+0000 7f324be00640 1 --2- 172.21.15.152:0/2989560006 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f324c160720 0x7f324c0d08a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f324c06d9d0 tx=0x7f324401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e66e0cd6ec891ed server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:29.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.041+0000 7f324a000640 1 -- 172.21.15.152:0/2989560006 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32440a5730 con 0x7f324c160720 2024-04-17T08:47:29.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.041+0000 7f324a000640 1 -- 172.21.15.152:0/2989560006 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32440a58d0 con 0x7f324c160720 2024-04-17T08:47:29.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.041+0000 7f324a000640 1 -- 172.21.15.152:0/2989560006 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32440a5ca0 con 0x7f324c160720 2024-04-17T08:47:29.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.041+0000 7f3252600640 1 -- 172.21.15.152:0/2989560006 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f324c160720 msgr2=0x7f324c0d08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:29.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.041+0000 7f3252600640 1 --2- 172.21.15.152:0/2989560006 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f324c160720 0x7f324c0d08a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f324c06d9d0 tx=0x7f324401c960 comp rx=0 tx=0).stop 2024-04-17T08:47:29.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.041+0000 7f3252600640 1 -- 172.21.15.152:0/2989560006 shutdown_connections 2024-04-17T08:47:29.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.041+0000 7f3252600640 1 --2- 172.21.15.152:0/2989560006 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f324c160720 0x7f324c0d08a0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:29.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.041+0000 7f3252600640 1 --2- 172.21.15.152:0/2989560006 >> v2:172.21.15.196:3300/0 conn(0x7f324c15a010 0x7f324c0d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:29.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.041+0000 7f3252600640 1 -- 172.21.15.152:0/2989560006 >> 172.21.15.152:0/2989560006 conn(0x7f324c0b3350 msgr2=0x7f324c0b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:29.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.041+0000 7f3252600640 1 -- 172.21.15.152:0/2989560006 shutdown_connections 2024-04-17T08:47:29.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.041+0000 7f3252600640 1 -- 172.21.15.152:0/2989560006 wait complete. 2024-04-17T08:47:29.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.041+0000 7f3252600640 1 Processor -- start 2024-04-17T08:47:29.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.041+0000 7f3252600640 1 -- start start 2024-04-17T08:47:29.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.045+0000 7f3252600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f324c15a010 0x7f324c09d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:29.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.045+0000 7f3252600640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f324c15d710 0x7f324c1518e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:29.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.045+0000 7f3252600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f324c160720 0x7f324c151e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:29.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.045+0000 7f3252600640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f324c15e780 con 0x7f324c15d710 2024-04-17T08:47:29.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.045+0000 7f3252600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f324c15e600 con 0x7f324c160720 2024-04-17T08:47:29.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.045+0000 7f3252600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f324c15e900 con 0x7f324c15a010 2024-04-17T08:47:29.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.045+0000 7f324aa00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f324c15d710 0x7f324c1518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:29.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.045+0000 7f324aa00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f324c15d710 0x7f324c1518e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32868/0 (socket says 172.21.15.152:32868) 2024-04-17T08:47:29.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.045+0000 7f324aa00640 1 -- 172.21.15.152:0/522605016 learned_addr learned my addr 172.21.15.152:0/522605016 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:29.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.045+0000 7f324b400640 1 --2- 172.21.15.152:0/522605016 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f324c15a010 0x7f324c09d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:29.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.045+0000 7f324be00640 1 --2- 172.21.15.152:0/522605016 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f324c160720 0x7f324c151e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:29.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.045+0000 7f324aa00640 1 -- 172.21.15.152:0/522605016 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f324c15a010 msgr2=0x7f324c09d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:29.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.045+0000 7f324aa00640 1 --2- 172.21.15.152:0/522605016 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f324c15a010 0x7f324c09d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:29.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.045+0000 7f324aa00640 1 -- 172.21.15.152:0/522605016 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f324c160720 msgr2=0x7f324c151e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:29.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.045+0000 7f324aa00640 1 --2- 172.21.15.152:0/522605016 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f324c160720 0x7f324c151e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:29.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.045+0000 7f324aa00640 1 -- 172.21.15.152:0/522605016 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f324c09dbf0 con 0x7f324c15d710 2024-04-17T08:47:29.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.045+0000 7f324aa00640 1 --2- 172.21.15.152:0/522605016 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f324c15d710 0x7f324c1518e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f323800c420 tx=0x7f323800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:29.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.045+0000 7f3243400640 1 -- 172.21.15.152:0/522605016 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32380052d0 con 0x7f324c15d710 2024-04-17T08:47:29.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.045+0000 7f3243400640 1 -- 172.21.15.152:0/522605016 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3238005470 con 0x7f324c15d710 2024-04-17T08:47:29.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.045+0000 7f3243400640 1 -- 172.21.15.152:0/522605016 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3238007260 con 0x7f324c15d710 2024-04-17T08:47:29.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.045+0000 7f3252600640 1 -- 172.21.15.152:0/522605016 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f324c09deb0 con 0x7f324c15d710 2024-04-17T08:47:29.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.045+0000 7f3252600640 1 -- 172.21.15.152:0/522605016 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f324c157000 con 0x7f324c15d710 2024-04-17T08:47:29.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.045+0000 7f3252600640 1 -- 172.21.15.152:0/522605016 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f324c068a30 con 0x7f324c15d710 2024-04-17T08:47:29.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.049+0000 7f3243400640 1 -- 172.21.15.152:0/522605016 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3238007400 con 0x7f324c15d710 2024-04-17T08:47:29.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.049+0000 7f3243400640 1 --2- 172.21.15.152:0/522605016 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f322c068380 0x7f322c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:29.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.049+0000 7f3243400640 1 -- 172.21.15.152:0/522605016 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f3238086260 con 0x7f324c15d710 2024-04-17T08:47:29.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.049+0000 7f324b400640 1 --2- 172.21.15.152:0/522605016 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f322c068380 0x7f322c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:29.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.049+0000 7f324b400640 1 --2- 172.21.15.152:0/522605016 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f322c068380 0x7f322c06a840 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f324c1f89f0 tx=0x7f323c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:29.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.053+0000 7f3243400640 1 -- 172.21.15.152:0/522605016 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f3238055da0 con 0x7f324c15d710 2024-04-17T08:47:29.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.209+0000 7f3252600640 1 -- 172.21.15.152:0/522605016 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f324c06d660 con 0x7f324c15d710 2024-04-17T08:47:29.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.209+0000 7f3243400640 1 -- 172.21.15.152:0/522605016 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f323805a0a0 con 0x7f324c15d710 2024-04-17T08:47:29.211 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 64 2024-04-17T08:47:29.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.209+0000 7f3252600640 1 -- 172.21.15.152:0/522605016 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f322c068380 msgr2=0x7f322c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:29.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.209+0000 7f3252600640 1 --2- 172.21.15.152:0/522605016 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f322c068380 0x7f322c06a840 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f324c1f89f0 tx=0x7f323c008040 comp rx=0 tx=0).stop 2024-04-17T08:47:29.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.209+0000 7f3252600640 1 -- 172.21.15.152:0/522605016 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f324c15d710 msgr2=0x7f324c1518e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:29.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.209+0000 7f3252600640 1 --2- 172.21.15.152:0/522605016 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f324c15d710 0x7f324c1518e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f323800c420 tx=0x7f323800c8e0 comp rx=0 tx=0).stop 2024-04-17T08:47:29.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.209+0000 7f3252600640 1 -- 172.21.15.152:0/522605016 shutdown_connections 2024-04-17T08:47:29.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.209+0000 7f3252600640 1 --2- 172.21.15.152:0/522605016 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f324c160720 0x7f324c151e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:29.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.209+0000 7f3252600640 1 --2- 172.21.15.152:0/522605016 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f324c15d710 0x7f324c1518e0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:29.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.209+0000 7f3252600640 1 --2- 172.21.15.152:0/522605016 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f322c068380 0x7f322c06a840 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:29.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.209+0000 7f3252600640 1 --2- 172.21.15.152:0/522605016 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f324c15a010 0x7f324c09d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:29.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.209+0000 7f3252600640 1 -- 172.21.15.152:0/522605016 >> 172.21.15.152:0/522605016 conn(0x7f324c0b3350 msgr2=0x7f324c152740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:29.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.209+0000 7f3252600640 1 -- 172.21.15.152:0/522605016 shutdown_connections 2024-04-17T08:47:29.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.213+0000 7f3252600640 1 -- 172.21.15.152:0/522605016 wait complete. 2024-04-17T08:47:29.233 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-17T08:47:29.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.373+0000 7faf7e200640 1 Processor -- start 2024-04-17T08:47:29.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.373+0000 7faf7e200640 1 -- start start 2024-04-17T08:47:29.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.373+0000 7faf7e200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf780af670 0x7faf7815b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:29.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.373+0000 7faf7e200640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf78072c40 con 0x7faf780d0360 2024-04-17T08:47:29.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.373+0000 7faf7e200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf7815c260 con 0x7faf7806f980 2024-04-17T08:47:29.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.373+0000 7faf7e200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7faf7815c820 con 0x7faf780af670 2024-04-17T08:47:29.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.373+0000 7faf77e00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7faf780d0360 0x7faf7806dc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:60458/0 (socket says 172.21.15.152:60458) 2024-04-17T08:47:29.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.373+0000 7faf77e00640 1 -- 172.21.15.152:0/1510469098 learned_addr learned my addr 172.21.15.152:0/1510469098 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:29.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.373+0000 7faf77400640 1 --2- 172.21.15.152:0/1510469098 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf780af670 0x7faf7815b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:29.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.373+0000 7faf76000640 1 -- 172.21.15.152:0/1510469098 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2894144028 0 0) 0x7faf78072c40 con 0x7faf780d0360 2024-04-17T08:47:29.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.373+0000 7faf76000640 1 -- 172.21.15.152:0/1510469098 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf5c003530 con 0x7faf780d0360 2024-04-17T08:47:29.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.373+0000 7faf76000640 1 -- 172.21.15.152:0/1510469098 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3496109331 0 0) 0x7faf7815c260 con 0x7faf7806f980 2024-04-17T08:47:29.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.373+0000 7faf76000640 1 -- 172.21.15.152:0/1510469098 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf78072c40 con 0x7faf7806f980 2024-04-17T08:47:29.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.373+0000 7faf76000640 1 -- 172.21.15.152:0/1510469098 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3483698701 0 0) 0x7faf5c003530 con 0x7faf780d0360 2024-04-17T08:47:29.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.373+0000 7faf76000640 1 -- 172.21.15.152:0/1510469098 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf780af670 msgr2=0x7faf7815b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:29.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.373+0000 7faf76000640 1 --2- 172.21.15.152:0/1510469098 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf780af670 0x7faf7815b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:29.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.373+0000 7faf76000640 1 -- 172.21.15.152:0/1510469098 >> v1:172.21.15.196:6789/0 conn(0x7faf7806f980 legacy=0x7faf78072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:29.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.373+0000 7faf76000640 1 -- 172.21.15.152:0/1510469098 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf7815c540 con 0x7faf780d0360 2024-04-17T08:47:29.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.373+0000 7faf76000640 1 -- 172.21.15.152:0/1510469098 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2973887244 0 0) 0x7faf70001a00 con 0x7faf780d0360 2024-04-17T08:47:29.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.373+0000 7faf76000640 1 -- 172.21.15.152:0/1510469098 >> v1:172.21.15.152:6789/0 conn(0x7faf780d0360 legacy=0x7faf7806dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:29.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.373+0000 7faf76000640 1 --2- 172.21.15.152:0/1510469098 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf5c003b80 0x7faf5c003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:29.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.373+0000 7faf76000640 1 --2- 172.21.15.152:0/1510469098 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf780af670 0x7faf5c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:29.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.373+0000 7faf76000640 1 --2- 172.21.15.152:0/1510469098 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faf5c004d50 0x7faf5c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:29.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.373+0000 7faf76000640 1 -- 172.21.15.152:0/1510469098 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7faf7815c820 con 0x7faf5c003b80 2024-04-17T08:47:29.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.373+0000 7faf76000640 1 -- 172.21.15.152:0/1510469098 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7faf5c00dce0 con 0x7faf5c004d50 2024-04-17T08:47:29.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.373+0000 7faf76000640 1 -- 172.21.15.152:0/1510469098 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7faf5c00dee0 con 0x7faf780af670 2024-04-17T08:47:29.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.373+0000 7faf77400640 1 --2- 172.21.15.152:0/1510469098 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf5c003b80 0x7faf5c003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:29.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.373+0000 7faf76a00640 1 --2- 172.21.15.152:0/1510469098 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf780af670 0x7faf5c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:29.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.373+0000 7faf77e00640 1 --2- 172.21.15.152:0/1510469098 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faf5c004d50 0x7faf5c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:29.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.373+0000 7faf77400640 1 -- 172.21.15.152:0/1510469098 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf780af670 msgr2=0x7faf5c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:29.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.373+0000 7faf77400640 1 --2- 172.21.15.152:0/1510469098 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf780af670 0x7faf5c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:29.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.373+0000 7faf77400640 1 -- 172.21.15.152:0/1510469098 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faf5c004d50 msgr2=0x7faf5c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:29.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.373+0000 7faf77400640 1 --2- 172.21.15.152:0/1510469098 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faf5c004d50 0x7faf5c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:29.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.373+0000 7faf77400640 1 -- 172.21.15.152:0/1510469098 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf5c003530 con 0x7faf5c003b80 2024-04-17T08:47:29.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.377+0000 7faf77400640 1 --2- 172.21.15.152:0/1510469098 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf5c003b80 0x7faf5c003f80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7faf68009ae0 tx=0x7faf6801ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d04c03921bd0245a server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:29.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.377+0000 7faf76000640 1 -- 172.21.15.152:0/1510469098 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf680b2070 con 0x7faf5c003b80 2024-04-17T08:47:29.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.377+0000 7faf76000640 1 -- 172.21.15.152:0/1510469098 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf680a5610 con 0x7faf5c003b80 2024-04-17T08:47:29.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.377+0000 7faf76000640 1 -- 172.21.15.152:0/1510469098 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf680096b0 con 0x7faf5c003b80 2024-04-17T08:47:29.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.377+0000 7faf7e200640 1 -- 172.21.15.152:0/1510469098 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf5c003b80 msgr2=0x7faf5c003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:29.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.377+0000 7faf7e200640 1 --2- 172.21.15.152:0/1510469098 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf5c003b80 0x7faf5c003f80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7faf68009ae0 tx=0x7faf6801ca40 comp rx=0 tx=0).stop 2024-04-17T08:47:29.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.377+0000 7faf77e00640 1 -- 172.21.15.152:0/1510469098 reap_dead start 2024-04-17T08:47:29.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.377+0000 7faf7e200640 1 -- 172.21.15.152:0/1510469098 shutdown_connections 2024-04-17T08:47:29.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.377+0000 7faf7e200640 1 -- 172.21.15.152:0/1510469098 >> 172.21.15.152:0/1510469098 conn(0x7faf780b3350 msgr2=0x7faf780b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:29.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.377+0000 7faf7e200640 1 -- 172.21.15.152:0/1510469098 shutdown_connections 2024-04-17T08:47:29.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.377+0000 7faf7e200640 1 -- 172.21.15.152:0/1510469098 wait complete. 2024-04-17T08:47:29.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.381+0000 7faf7e200640 1 Processor -- start 2024-04-17T08:47:29.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.381+0000 7faf7e200640 1 -- start start 2024-04-17T08:47:29.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.381+0000 7faf7e200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf5c003b80 0x7faf78152ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:29.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.381+0000 7faf7e200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf781532b0 0x7faf781580f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:29.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.381+0000 7faf7e200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faf781537e0 0x7faf780b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:29.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.381+0000 7faf7e200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7faf780d0b80 con 0x7faf5c003b80 2024-04-17T08:47:29.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.381+0000 7faf7e200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7faf7806b9b0 con 0x7faf781537e0 2024-04-17T08:47:29.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.381+0000 7faf7e200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7faf78156e00 con 0x7faf781532b0 2024-04-17T08:47:29.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.381+0000 7faf77400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf5c003b80 0x7faf78152ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:29.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.381+0000 7faf77400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf5c003b80 0x7faf78152ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32898/0 (socket says 172.21.15.152:32898) 2024-04-17T08:47:29.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.381+0000 7faf77400640 1 -- 172.21.15.152:0/4184845577 learned_addr learned my addr 172.21.15.152:0/4184845577 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:29.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.381+0000 7faf76a00640 1 --2- 172.21.15.152:0/4184845577 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf781532b0 0x7faf781580f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:29.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.381+0000 7faf77e00640 1 --2- 172.21.15.152:0/4184845577 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faf781537e0 0x7faf780b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:29.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.381+0000 7faf77400640 1 -- 172.21.15.152:0/4184845577 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf781532b0 msgr2=0x7faf781580f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:29.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.381+0000 7faf77400640 1 --2- 172.21.15.152:0/4184845577 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf781532b0 0x7faf781580f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:29.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.381+0000 7faf77400640 1 -- 172.21.15.152:0/4184845577 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faf781537e0 msgr2=0x7faf780b1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:29.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.381+0000 7faf77400640 1 --2- 172.21.15.152:0/4184845577 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faf781537e0 0x7faf780b1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:29.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.381+0000 7faf77400640 1 -- 172.21.15.152:0/4184845577 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf78157050 con 0x7faf5c003b80 2024-04-17T08:47:29.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.381+0000 7faf76a00640 1 --2- 172.21.15.152:0/4184845577 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf781532b0 0x7faf781580f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:29.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.381+0000 7faf77400640 1 --2- 172.21.15.152:0/4184845577 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf5c003b80 0x7faf78152ac0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7faf680b0040 tx=0x7faf5c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:29.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.381+0000 7faf6f400640 1 -- 172.21.15.152:0/4184845577 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf680b2040 con 0x7faf5c003b80 2024-04-17T08:47:29.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.381+0000 7faf6f400640 1 -- 172.21.15.152:0/4184845577 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf6800f000 con 0x7faf5c003b80 2024-04-17T08:47:29.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.381+0000 7faf7e200640 1 -- 172.21.15.152:0/4184845577 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf78157330 con 0x7faf5c003b80 2024-04-17T08:47:29.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.381+0000 7faf6f400640 1 -- 172.21.15.152:0/4184845577 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf68004020 con 0x7faf5c003b80 2024-04-17T08:47:29.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.381+0000 7faf7e200640 1 -- 172.21.15.152:0/4184845577 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf781578f0 con 0x7faf5c003b80 2024-04-17T08:47:29.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.381+0000 7faf7e200640 1 -- 172.21.15.152:0/4184845577 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf78068a30 con 0x7faf5c003b80 2024-04-17T08:47:29.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.385+0000 7faf6f400640 1 -- 172.21.15.152:0/4184845577 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7faf680c0030 con 0x7faf5c003b80 2024-04-17T08:47:29.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.385+0000 7faf6f400640 1 --2- 172.21.15.152:0/4184845577 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7faf58068380 0x7faf5806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:29.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.385+0000 7faf6f400640 1 -- 172.21.15.152:0/4184845577 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7faf68120b50 con 0x7faf5c003b80 2024-04-17T08:47:29.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.385+0000 7faf76a00640 1 --2- 172.21.15.152:0/4184845577 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7faf58068380 0x7faf5806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:29.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.385+0000 7faf76a00640 1 --2- 172.21.15.152:0/4184845577 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7faf58068380 0x7faf5806a840 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7faf78153d00 tx=0x7faf64009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:29.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.389+0000 7faf6f400640 1 -- 172.21.15.152:0/4184845577 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7faf680c7060 con 0x7faf5c003b80 2024-04-17T08:47:29.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.545+0000 7faf7e200640 1 -- 172.21.15.152:0/4184845577 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7faf780728b0 con 0x7faf5c003b80 2024-04-17T08:47:29.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.545+0000 7faf6f400640 1 -- 172.21.15.152:0/4184845577 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7faf68016780 con 0x7faf5c003b80 2024-04-17T08:47:29.549 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-04-17T08:47:29.551 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.549+0000 7faf7e200640 1 -- 172.21.15.152:0/4184845577 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7faf58068380 msgr2=0x7faf5806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:29.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.549+0000 7faf7e200640 1 --2- 172.21.15.152:0/4184845577 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7faf58068380 0x7faf5806a840 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7faf78153d00 tx=0x7faf64009040 comp rx=0 tx=0).stop 2024-04-17T08:47:29.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.549+0000 7faf7e200640 1 -- 172.21.15.152:0/4184845577 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf5c003b80 msgr2=0x7faf78152ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:29.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.549+0000 7faf7e200640 1 --2- 172.21.15.152:0/4184845577 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf5c003b80 0x7faf78152ac0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7faf680b0040 tx=0x7faf5c005840 comp rx=0 tx=0).stop 2024-04-17T08:47:29.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.549+0000 7faf7e200640 1 -- 172.21.15.152:0/4184845577 shutdown_connections 2024-04-17T08:47:29.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.549+0000 7faf7e200640 1 --2- 172.21.15.152:0/4184845577 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faf781537e0 0x7faf780b1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:29.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.549+0000 7faf7e200640 1 --2- 172.21.15.152:0/4184845577 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7faf58068380 0x7faf5806a840 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:29.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.549+0000 7faf7e200640 1 --2- 172.21.15.152:0/4184845577 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf781532b0 0x7faf781580f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:29.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.549+0000 7faf7e200640 1 --2- 172.21.15.152:0/4184845577 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf5c003b80 0x7faf78152ac0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:29.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.549+0000 7faf7e200640 1 -- 172.21.15.152:0/4184845577 >> 172.21.15.152:0/4184845577 conn(0x7faf780b3350 msgr2=0x7faf7806bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:29.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.549+0000 7faf7e200640 1 -- 172.21.15.152:0/4184845577 shutdown_connections 2024-04-17T08:47:29.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.549+0000 7faf7e200640 1 -- 172.21.15.152:0/4184845577 wait complete. 2024-04-17T08:47:29.571 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-17T08:47:29.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.705+0000 7fab4c200640 1 Processor -- start 2024-04-17T08:47:29.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.705+0000 7fab4c200640 1 -- start start 2024-04-17T08:47:29.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.705+0000 7fab4c200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fab4415a010 0x7fab440d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:29.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.705+0000 7fab4c200640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fab44160720 0x7fab440d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:29.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.705+0000 7fab4c200640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab44160d20 con 0x7fab4415d710 2024-04-17T08:47:29.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.705+0000 7fab4c200640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fab4415d280 con 0x7fab44160720 2024-04-17T08:47:29.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.705+0000 7fab4c200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fab4415c9d0 con 0x7fab4415a010 2024-04-17T08:47:29.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.705+0000 7fab48e00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fab4415d710 0x7fab44160010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:60468/0 (socket says 172.21.15.152:60468) 2024-04-17T08:47:29.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.705+0000 7fab48e00640 1 -- 172.21.15.152:0/3376143309 learned_addr learned my addr 172.21.15.152:0/3376143309 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:29.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.705+0000 7fab4a200640 1 --2- 172.21.15.152:0/3376143309 >> v2:172.21.15.152:3300/0 conn(0x7fab44160720 0x7fab440d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:29.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.709+0000 7fab49800640 1 --2- 172.21.15.152:0/3376143309 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fab4415a010 0x7fab440d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:29.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.709+0000 7fab4a200640 1 -- 172.21.15.152:0/3376143309 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fab4415a010 msgr2=0x7fab440d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:29.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.709+0000 7fab4a200640 1 --2- 172.21.15.152:0/3376143309 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fab4415a010 0x7fab440d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:29.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.709+0000 7fab4a200640 1 -- 172.21.15.152:0/3376143309 >> v1:172.21.15.152:6789/0 conn(0x7fab4415d710 legacy=0x7fab44160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:29.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.709+0000 7fab4a200640 1 -- 172.21.15.152:0/3376143309 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab4415cc30 con 0x7fab44160720 2024-04-17T08:47:29.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.709+0000 7fab4a200640 1 --2- 172.21.15.152:0/3376143309 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab44160720 0x7fab440d08a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fab3c009d90 tx=0x7fab3c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a87f6869e7462d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:29.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.709+0000 7fab43e00640 1 -- 172.21.15.152:0/3376143309 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab3c0b2070 con 0x7fab44160720 2024-04-17T08:47:29.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.709+0000 7fab43e00640 1 -- 172.21.15.152:0/3376143309 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab3c0a5870 con 0x7fab44160720 2024-04-17T08:47:29.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.709+0000 7fab43e00640 1 -- 172.21.15.152:0/3376143309 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab3c0a5c40 con 0x7fab44160720 2024-04-17T08:47:29.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.709+0000 7fab4c200640 1 -- 172.21.15.152:0/3376143309 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab44160720 msgr2=0x7fab440d08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:29.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.709+0000 7fab4c200640 1 --2- 172.21.15.152:0/3376143309 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab44160720 0x7fab440d08a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fab3c009d90 tx=0x7fab3c01c8e0 comp rx=0 tx=0).stop 2024-04-17T08:47:29.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.713+0000 7fab4c200640 1 -- 172.21.15.152:0/3376143309 shutdown_connections 2024-04-17T08:47:29.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.713+0000 7fab4c200640 1 --2- 172.21.15.152:0/3376143309 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab44160720 0x7fab440d08a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:29.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.713+0000 7fab4c200640 1 --2- 172.21.15.152:0/3376143309 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fab4415a010 0x7fab440d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:29.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.713+0000 7fab4c200640 1 -- 172.21.15.152:0/3376143309 >> 172.21.15.152:0/3376143309 conn(0x7fab440b3350 msgr2=0x7fab440b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:29.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.713+0000 7fab4c200640 1 -- 172.21.15.152:0/3376143309 shutdown_connections 2024-04-17T08:47:29.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.713+0000 7fab4c200640 1 -- 172.21.15.152:0/3376143309 wait complete. 2024-04-17T08:47:29.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.713+0000 7fab4c200640 1 Processor -- start 2024-04-17T08:47:29.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.713+0000 7fab4c200640 1 -- start start 2024-04-17T08:47:29.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.713+0000 7fab4c200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fab4415a010 0x7fab44099ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:29.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.713+0000 7fab4c200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab4415d710 0x7fab440b0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:29.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.713+0000 7fab4c200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fab44160720 0x7fab440b08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:29.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.713+0000 7fab4c200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fab4415e780 con 0x7fab4415d710 2024-04-17T08:47:29.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.713+0000 7fab4c200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fab4415e600 con 0x7fab4415a010 2024-04-17T08:47:29.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.713+0000 7fab4c200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fab4415e900 con 0x7fab44160720 2024-04-17T08:47:29.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.713+0000 7fab48e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab4415d710 0x7fab440b0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:29.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.713+0000 7fab48e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab4415d710 0x7fab440b0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32920/0 (socket says 172.21.15.152:32920) 2024-04-17T08:47:29.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.713+0000 7fab48e00640 1 -- 172.21.15.152:0/1088204389 learned_addr learned my addr 172.21.15.152:0/1088204389 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:29.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.713+0000 7fab49800640 1 --2- 172.21.15.152:0/1088204389 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fab4415a010 0x7fab44099ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:29.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.713+0000 7fab4a200640 1 --2- 172.21.15.152:0/1088204389 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fab44160720 0x7fab440b08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:29.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.713+0000 7fab48e00640 1 -- 172.21.15.152:0/1088204389 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fab44160720 msgr2=0x7fab440b08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:29.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.713+0000 7fab48e00640 1 --2- 172.21.15.152:0/1088204389 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fab44160720 0x7fab440b08b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:29.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.713+0000 7fab48e00640 1 -- 172.21.15.152:0/1088204389 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fab4415a010 msgr2=0x7fab44099ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:29.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.713+0000 7fab48e00640 1 --2- 172.21.15.152:0/1088204389 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fab4415a010 0x7fab44099ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:29.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.713+0000 7fab48e00640 1 -- 172.21.15.152:0/1088204389 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab4414fe40 con 0x7fab4415d710 2024-04-17T08:47:29.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.713+0000 7fab48e00640 1 --2- 172.21.15.152:0/1088204389 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab4415d710 0x7fab440b0370 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fab3000c450 tx=0x7fab3000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:29.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.713+0000 7fab41600640 1 -- 172.21.15.152:0/1088204389 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab30017070 con 0x7fab4415d710 2024-04-17T08:47:29.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.717+0000 7fab41600640 1 -- 172.21.15.152:0/1088204389 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab30005cf0 con 0x7fab4415d710 2024-04-17T08:47:29.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.717+0000 7fab41600640 1 -- 172.21.15.152:0/1088204389 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab30007290 con 0x7fab4415d710 2024-04-17T08:47:29.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.717+0000 7fab4c200640 1 -- 172.21.15.152:0/1088204389 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab4414f5a0 con 0x7fab4415d710 2024-04-17T08:47:29.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.717+0000 7fab4c200640 1 -- 172.21.15.152:0/1088204389 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab4414fb60 con 0x7fab4415d710 2024-04-17T08:47:29.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.717+0000 7fab4c200640 1 -- 172.21.15.152:0/1088204389 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab44068a30 con 0x7fab4415d710 2024-04-17T08:47:29.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.717+0000 7fab41600640 1 -- 172.21.15.152:0/1088204389 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fab3001a070 con 0x7fab4415d710 2024-04-17T08:47:29.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.717+0000 7fab41600640 1 --2- 172.21.15.152:0/1088204389 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fab240683b0 0x7fab2406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:29.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.717+0000 7fab41600640 1 -- 172.21.15.152:0/1088204389 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fab30086150 con 0x7fab4415d710 2024-04-17T08:47:29.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.717+0000 7fab49800640 1 --2- 172.21.15.152:0/1088204389 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fab240683b0 0x7fab2406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:29.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.717+0000 7fab49800640 1 --2- 172.21.15.152:0/1088204389 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fab240683b0 0x7fab2406a870 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fab3800b9d0 tx=0x7fab38008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:29.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.721+0000 7fab41600640 1 -- 172.21.15.152:0/1088204389 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fab30056250 con 0x7fab4415d710 2024-04-17T08:47:29.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.889+0000 7fab4c200640 1 -- 172.21.15.152:0/1088204389 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fab4406d660 con 0x7fab4415d710 2024-04-17T08:47:29.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.889+0000 7fab41600640 1 -- 172.21.15.152:0/1088204389 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7fab30055b50 con 0x7fab4415d710 2024-04-17T08:47:29.892 INFO:teuthology.orchestra.run.smithi152.stderr:listed 0 entries 2024-04-17T08:47:29.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.889+0000 7fab4c200640 1 -- 172.21.15.152:0/1088204389 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fab240683b0 msgr2=0x7fab2406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:29.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.889+0000 7fab4c200640 1 --2- 172.21.15.152:0/1088204389 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fab240683b0 0x7fab2406a870 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fab3800b9d0 tx=0x7fab38008040 comp rx=0 tx=0).stop 2024-04-17T08:47:29.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.889+0000 7fab4c200640 1 -- 172.21.15.152:0/1088204389 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab4415d710 msgr2=0x7fab440b0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:29.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.889+0000 7fab4c200640 1 --2- 172.21.15.152:0/1088204389 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab4415d710 0x7fab440b0370 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fab3000c450 tx=0x7fab3000c910 comp rx=0 tx=0).stop 2024-04-17T08:47:29.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.889+0000 7fab4c200640 1 -- 172.21.15.152:0/1088204389 shutdown_connections 2024-04-17T08:47:29.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.889+0000 7fab4c200640 1 --2- 172.21.15.152:0/1088204389 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fab240683b0 0x7fab2406a870 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:29.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.889+0000 7fab4c200640 1 --2- 172.21.15.152:0/1088204389 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fab44160720 0x7fab440b08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:29.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.889+0000 7fab4c200640 1 --2- 172.21.15.152:0/1088204389 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab4415d710 0x7fab440b0370 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:29.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.889+0000 7fab4c200640 1 --2- 172.21.15.152:0/1088204389 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fab4415a010 0x7fab44099ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:29.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.889+0000 7fab4c200640 1 -- 172.21.15.152:0/1088204389 >> 172.21.15.152:0/1088204389 conn(0x7fab440b3350 msgr2=0x7fab440aee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:29.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.893+0000 7fab4c200640 1 -- 172.21.15.152:0/1088204389 shutdown_connections 2024-04-17T08:47:29.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:29.893+0000 7fab4c200640 1 -- 172.21.15.152:0/1088204389 wait complete. 2024-04-17T08:47:29.913 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-17T08:47:29.913 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-17T08:47:29.921 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T08:47:30.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.097+0000 7f11a2000640 1 Processor -- start 2024-04-17T08:47:30.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.097+0000 7f11a2000640 1 -- start start 2024-04-17T08:47:30.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.097+0000 7f11a2000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f119c1472e0 0x7f119c1476c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:30.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.097+0000 7f11a2000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f119c0cf370 0x7f119c0b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:30.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.097+0000 7f11a2000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f119c162260 con 0x7f119c06d350 2024-04-17T08:47:30.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.097+0000 7f11a2000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f119c163020 con 0x7f119c0cf370 2024-04-17T08:47:30.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.097+0000 7f11a2000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f119c162540 con 0x7f119c1472e0 2024-04-17T08:47:30.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.101+0000 7f11a1600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f119c0cf370 0x7f119c0b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:30.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.101+0000 7f11a1600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f119c0cf370 0x7f119c0b2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.152:57096/0 (socket says 172.21.15.152:57096) 2024-04-17T08:47:30.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.101+0000 7f11a1600640 1 -- 172.21.15.152:0/2161700288 learned_addr learned my addr 172.21.15.152:0/2161700288 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:30.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.101+0000 7f11a0c00640 1 --2- 172.21.15.152:0/2161700288 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f119c1472e0 0x7f119c1476c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:30.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.101+0000 7f11a1600640 1 -- 172.21.15.152:0/2161700288 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f119c1472e0 msgr2=0x7f119c1476c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:30.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.101+0000 7f11a1600640 1 --2- 172.21.15.152:0/2161700288 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f119c1472e0 0x7f119c1476c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:30.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.101+0000 7f11a1600640 1 -- 172.21.15.152:0/2161700288 >> v1:172.21.15.196:6789/0 conn(0x7f119c06d350 legacy=0x7f119c0cec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:30.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.101+0000 7f11a1600640 1 -- 172.21.15.152:0/2161700288 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f119c162820 con 0x7f119c0cf370 2024-04-17T08:47:30.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.101+0000 7f11a1600640 1 --2- 172.21.15.152:0/2161700288 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f119c0cf370 0x7f119c0b2b00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1194009e50 tx=0x7f119401c9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=642b185001e7a61e server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:30.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.105+0000 7f119b400640 1 -- 172.21.15.152:0/2161700288 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11940a5770 con 0x7f119c0cf370 2024-04-17T08:47:30.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.105+0000 7f119b400640 1 -- 172.21.15.152:0/2161700288 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11940a5910 con 0x7f119c0cf370 2024-04-17T08:47:30.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.105+0000 7f119b400640 1 -- 172.21.15.152:0/2161700288 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11940a5ce0 con 0x7f119c0cf370 2024-04-17T08:47:30.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.105+0000 7f11a2000640 1 -- 172.21.15.152:0/2161700288 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f119c0cf370 msgr2=0x7f119c0b2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:30.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.105+0000 7f11a2000640 1 --2- 172.21.15.152:0/2161700288 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f119c0cf370 0x7f119c0b2b00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1194009e50 tx=0x7f119401c9a0 comp rx=0 tx=0).stop 2024-04-17T08:47:30.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.105+0000 7f11a2000640 1 -- 172.21.15.152:0/2161700288 shutdown_connections 2024-04-17T08:47:30.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.105+0000 7f11a2000640 1 --2- 172.21.15.152:0/2161700288 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f119c0cf370 0x7f119c0b2b00 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:30.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.105+0000 7f11a2000640 1 --2- 172.21.15.152:0/2161700288 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f119c1472e0 0x7f119c1476c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:30.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.105+0000 7f11a2000640 1 -- 172.21.15.152:0/2161700288 >> 172.21.15.152:0/2161700288 conn(0x7f119c0b4b20 msgr2=0x7f119c071790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:30.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.105+0000 7f11a2000640 1 -- 172.21.15.152:0/2161700288 shutdown_connections 2024-04-17T08:47:30.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.105+0000 7f11a2000640 1 -- 172.21.15.152:0/2161700288 wait complete. 2024-04-17T08:47:30.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.105+0000 7f11a2000640 1 Processor -- start 2024-04-17T08:47:30.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.105+0000 7f11a2000640 1 -- start start 2024-04-17T08:47:30.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.105+0000 7f11a2000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f119c06d350 0x7f119c15df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:30.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.105+0000 7f11a2000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f119c0cf370 0x7f119c15c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:30.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.105+0000 7f11a2000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f119c1472e0 0x7f119c0d1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:30.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.105+0000 7f11a2000640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f119c0b3be0 con 0x7f119c06d350 2024-04-17T08:47:30.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.105+0000 7f11a2000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f119c0b3a60 con 0x7f119c0cf370 2024-04-17T08:47:30.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.105+0000 7f11a2000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f119c16b440 con 0x7f119c1472e0 2024-04-17T08:47:30.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.105+0000 7f11a0c00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f119c06d350 0x7f119c15df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:30.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.105+0000 7f11a0c00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f119c06d350 0x7f119c15df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32930/0 (socket says 172.21.15.152:32930) 2024-04-17T08:47:30.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.105+0000 7f11a0c00640 1 -- 172.21.15.152:0/2822005835 learned_addr learned my addr 172.21.15.152:0/2822005835 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:30.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.109+0000 7f11a0c00640 1 -- 172.21.15.152:0/2822005835 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f119c1472e0 msgr2=0x7f119c0d1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:30.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.109+0000 7f11a0c00640 1 --2- 172.21.15.152:0/2822005835 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f119c1472e0 0x7f119c0d1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:30.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.109+0000 7f11a0c00640 1 -- 172.21.15.152:0/2822005835 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f119c0cf370 msgr2=0x7f119c15c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:30.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.109+0000 7f119be00640 1 --2- 172.21.15.152:0/2822005835 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f119c0cf370 0x7f119c15c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:30.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.109+0000 7f11a0c00640 1 --2- 172.21.15.152:0/2822005835 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f119c0cf370 0x7f119c15c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:30.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.109+0000 7f11a0c00640 1 -- 172.21.15.152:0/2822005835 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f119c15c840 con 0x7f119c06d350 2024-04-17T08:47:30.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.109+0000 7f119be00640 1 --2- 172.21.15.152:0/2822005835 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f119c0cf370 0x7f119c15c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:47:30.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.109+0000 7f11a0c00640 1 --2- 172.21.15.152:0/2822005835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f119c06d350 0x7f119c15df00 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f118c00e870 tx=0x7f118c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:30.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.109+0000 7f1198c00640 1 -- 172.21.15.152:0/2822005835 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f118c017070 con 0x7f119c06d350 2024-04-17T08:47:30.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.109+0000 7f1198c00640 1 -- 172.21.15.152:0/2822005835 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f118c00c8e0 con 0x7f119c06d350 2024-04-17T08:47:30.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.109+0000 7f1198c00640 1 -- 172.21.15.152:0/2822005835 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f118c00cc90 con 0x7f119c06d350 2024-04-17T08:47:30.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.109+0000 7f11a2000640 1 -- 172.21.15.152:0/2822005835 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f119c15d940 con 0x7f119c06d350 2024-04-17T08:47:30.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.109+0000 7f11a2000640 1 -- 172.21.15.152:0/2822005835 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f119c144b30 con 0x7f119c06d350 2024-04-17T08:47:30.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.109+0000 7f11a2000640 1 -- 172.21.15.152:0/2822005835 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f119c144940 con 0x7f119c06d350 2024-04-17T08:47:30.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.109+0000 7f1198c00640 1 -- 172.21.15.152:0/2822005835 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f118c01a070 con 0x7f119c06d350 2024-04-17T08:47:30.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.109+0000 7f1198c00640 1 --2- 172.21.15.152:0/2822005835 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f117c068380 0x7f117c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:30.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.109+0000 7f1198c00640 1 -- 172.21.15.152:0/2822005835 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f118c086d00 con 0x7f119c06d350 2024-04-17T08:47:30.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.113+0000 7f119be00640 1 --2- 172.21.15.152:0/2822005835 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f117c068380 0x7f117c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:30.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.113+0000 7f119be00640 1 --2- 172.21.15.152:0/2822005835 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f117c068380 0x7f117c06a840 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f119c15e440 tx=0x7f1188009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:30.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.113+0000 7f1198c00640 1 -- 172.21.15.152:0/2822005835 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f118c056e00 con 0x7f119c06d350 2024-04-17T08:47:30.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.277+0000 7f11a2000640 1 -- 172.21.15.152:0/2822005835 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f119c0b23d0 con 0x7f119c06d350 2024-04-17T08:47:30.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.277+0000 7f1198c00640 1 -- 172.21.15.152:0/2822005835 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18972 (secure 0 0 0) 0x7f118c056700 con 0x7f119c06d350 2024-04-17T08:47:30.281 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:47:30.281 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":26,"fsid":"ce68f82e-ec5f-4205-9fd5-bdfdf6ef31e2","created":"2024-04-17T08:46:08.353546+0000","modified":"2024-04-17T08:47:15.280634+0000","last_up_change":"2024-04-17T08:46:20.738799+0000","last_in_change":"2024-04-17T08:46:11.210050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T08:46:21.386856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T08:46:31.812460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T08:46:32.555559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T08:46:36.258078+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"682f0192-187c-404e-bc7a-b6b4e23825e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6819","nonce":3603799291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6823","nonce":3603799291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6831","nonce":3603799291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6827","nonce":3603799291}]},"public_addr":"172.21.15.152:6819/3603799291","cluster_addr":"172.21.15.152:6823/3603799291","heartbeat_back_addr":"172.21.15.152:6831/3603799291","heartbeat_front_addr":"172.21.15.152:6827/3603799291","state":["exists","up"]},{"osd":1,"uuid":"f0fe8fef-60ec-4a39-83b6-2fa6a5adb0f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6801","nonce":4133383142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6803","nonce":4133383142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6807","nonce":4133383142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6805","nonce":4133383142}]},"public_addr":"172.21.15.152:6801/4133383142","cluster_addr":"172.21.15.152:6803/4133383142","heartbeat_back_addr":"172.21.15.152:6807/4133383142","heartbeat_front_addr":"172.21.15.152:6805/4133383142","state":["exists","up"]},{"osd":2,"uuid":"35f36d9c-5245-4431-a618-f4df0fa380ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6809","nonce":3826143898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6811","nonce":3826143898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6815","nonce":3826143898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6813","nonce":3826143898}]},"public_addr":"172.21.15.152:6809/3826143898","cluster_addr":"172.21.15.152:6811/3826143898","heartbeat_back_addr":"172.21.15.152:6815/3826143898","heartbeat_front_addr":"172.21.15.152:6813/3826143898","state":["exists","up"]},{"osd":3,"uuid":"96e56ca5-15b4-4895-9b79-da2c92043159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6818","nonce":165717826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6822","nonce":165717826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6830","nonce":165717826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6826","nonce":165717826}]},"public_addr":"172.21.15.152:6818/165717826","cluster_addr":"172.21.15.152:6822/165717826","heartbeat_back_addr":"172.21.15.152:6830/165717826","heartbeat_front_addr":"172.21.15.152:6826/165717826","state":["exists","up"]},{"osd":4,"uuid":"f5aa10a4-9ff9-41fe-a5c9-15326f982cc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6817","nonce":4080159297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6819","nonce":4080159297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6823","nonce":4080159297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6821","nonce":4080159297}]},"public_addr":"172.21.15.196:6817/4080159297","cluster_addr":"172.21.15.196:6819/4080159297","heartbeat_back_addr":"172.21.15.196:6823/4080159297","heartbeat_front_addr":"172.21.15.196:6821/4080159297","state":["exists","up"]},{"osd":5,"uuid":"42bab884-3476-47ae-ac65-935fa6e0f055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6801","nonce":3519444232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6803","nonce":3519444232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6807","nonce":3519444232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6805","nonce":3519444232}]},"public_addr":"172.21.15.196:6801/3519444232","cluster_addr":"172.21.15.196:6803/3519444232","heartbeat_back_addr":"172.21.15.196:6807/3519444232","heartbeat_front_addr":"172.21.15.196:6805/3519444232","state":["exists","up"]},{"osd":6,"uuid":"460b6167-f57b-4224-9c92-cfc9b80bbe99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6809","nonce":275739834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6811","nonce":275739834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6815","nonce":275739834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6813","nonce":275739834}]},"public_addr":"172.21.15.196:6809/275739834","cluster_addr":"172.21.15.196:6811/275739834","heartbeat_back_addr":"172.21.15.196:6815/275739834","heartbeat_front_addr":"172.21.15.196:6813/275739834","state":["exists","up"]},{"osd":7,"uuid":"d695643f-5e07-4e2a-a646-c06bd97b6650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6825","nonce":307626968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6827","nonce":307626968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6831","nonce":307626968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6829","nonce":307626968}]},"public_addr":"172.21.15.196:6825/307626968","cluster_addr":"172.21.15.196:6827/307626968","heartbeat_back_addr":"172.21.15.196:6831/307626968","heartbeat_front_addr":"172.21.15.196:6829/307626968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.293257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.964533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.248895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.010000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.832554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.743704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930171+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930962+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T08:47:30.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.281+0000 7f11a2000640 1 -- 172.21.15.152:0/2822005835 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f117c068380 msgr2=0x7f117c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:30.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.281+0000 7f11a2000640 1 --2- 172.21.15.152:0/2822005835 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f117c068380 0x7f117c06a840 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f119c15e440 tx=0x7f1188009040 comp rx=0 tx=0).stop 2024-04-17T08:47:30.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.281+0000 7f11a2000640 1 -- 172.21.15.152:0/2822005835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f119c06d350 msgr2=0x7f119c15df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:30.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.281+0000 7f11a2000640 1 --2- 172.21.15.152:0/2822005835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f119c06d350 0x7f119c15df00 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f118c00e870 tx=0x7f118c00ec70 comp rx=0 tx=0).stop 2024-04-17T08:47:30.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.281+0000 7f11a2000640 1 -- 172.21.15.152:0/2822005835 shutdown_connections 2024-04-17T08:47:30.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.281+0000 7f11a2000640 1 --2- 172.21.15.152:0/2822005835 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f117c068380 0x7f117c06a840 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:30.284 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.281+0000 7f11a2000640 1 --2- 172.21.15.152:0/2822005835 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f119c1472e0 0x7f119c0d1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:30.284 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.281+0000 7f11a2000640 1 --2- 172.21.15.152:0/2822005835 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f119c0cf370 0x7f119c15c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:30.284 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.281+0000 7f11a2000640 1 --2- 172.21.15.152:0/2822005835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f119c06d350 0x7f119c15df00 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:30.284 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.281+0000 7f11a2000640 1 -- 172.21.15.152:0/2822005835 >> 172.21.15.152:0/2822005835 conn(0x7f119c0b4b20 msgr2=0x7f119c06f560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:30.284 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.281+0000 7f11a2000640 1 -- 172.21.15.152:0/2822005835 shutdown_connections 2024-04-17T08:47:30.284 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.281+0000 7f11a2000640 1 -- 172.21.15.152:0/2822005835 wait complete. 2024-04-17T08:47:30.302 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T08:46:21.386856+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-17T08:46:31.812460+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-17T08:46:32.555559+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-17T08:46:36.258078+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-17T08:47:30.302 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T08:47:30.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.441+0000 7f65a0000640 1 Processor -- start 2024-04-17T08:47:30.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.441+0000 7f65a0000640 1 -- start start 2024-04-17T08:47:30.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.441+0000 7f65a0000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f659806f980 0x7f6598072530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:30.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.441+0000 7f65a0000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65980d0360 0x7f65980d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:30.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.441+0000 7f65a0000640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f659815bfd0 con 0x7f65980af670 2024-04-17T08:47:30.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.441+0000 7f65a0000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f659815c820 con 0x7f659806f980 2024-04-17T08:47:30.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.441+0000 7f65a0000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f659815c260 con 0x7f65980d0360 2024-04-17T08:47:30.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.441+0000 7f659d600640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f65980af670 0x7f659815b8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:60478/0 (socket says 172.21.15.152:60478) 2024-04-17T08:47:30.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.441+0000 7f659d600640 1 -- 172.21.15.152:0/1908118938 learned_addr learned my addr 172.21.15.152:0/1908118938 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:30.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.441+0000 7f659e000640 1 --2- 172.21.15.152:0/1908118938 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65980d0360 0x7f65980d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:30.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.441+0000 7f659cc00640 1 --2- 172.21.15.152:0/1908118938 >> v2:172.21.15.196:3300/0 conn(0x7f659806f980 0x7f6598072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:30.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.441+0000 7f6597e00640 1 -- 172.21.15.152:0/1908118938 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2434364870 0 0) 0x7f659815bfd0 con 0x7f65980af670 2024-04-17T08:47:30.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.441+0000 7f6597e00640 1 -- 172.21.15.152:0/1908118938 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6580003530 con 0x7f65980af670 2024-04-17T08:47:30.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.441+0000 7f659e000640 1 -- 172.21.15.152:0/1908118938 >> v2:172.21.15.196:3300/0 conn(0x7f659806f980 msgr2=0x7f6598072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:30.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.441+0000 7f659e000640 1 --2- 172.21.15.152:0/1908118938 >> v2:172.21.15.196:3300/0 conn(0x7f659806f980 0x7f6598072530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:30.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.441+0000 7f659e000640 1 -- 172.21.15.152:0/1908118938 >> v1:172.21.15.152:6789/0 conn(0x7f65980af670 legacy=0x7f659815b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:30.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.441+0000 7f659e000640 1 -- 172.21.15.152:0/1908118938 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f659815c540 con 0x7f65980d0360 2024-04-17T08:47:30.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.441+0000 7f659cc00640 1 --2- 172.21.15.152:0/1908118938 >> v2:172.21.15.196:3300/0 conn(0x7f659806f980 0x7f6598072530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T08:47:30.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.445+0000 7f659e000640 1 --2- 172.21.15.152:0/1908118938 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65980d0360 0x7f65980d07f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6590009d90 tx=0x7f659001eaf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=287f5a185feb416c server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:30.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.445+0000 7f6597e00640 1 -- 172.21.15.152:0/1908118938 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65900b4070 con 0x7f65980d0360 2024-04-17T08:47:30.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.445+0000 7f6597e00640 1 -- 172.21.15.152:0/1908118938 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65900a7ab0 con 0x7f65980d0360 2024-04-17T08:47:30.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.445+0000 7f6597e00640 1 -- 172.21.15.152:0/1908118938 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65900af440 con 0x7f65980d0360 2024-04-17T08:47:30.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.445+0000 7f65a0000640 1 -- 172.21.15.152:0/1908118938 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65980d0360 msgr2=0x7f65980d07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:30.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.445+0000 7f65a0000640 1 --2- 172.21.15.152:0/1908118938 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65980d0360 0x7f65980d07f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6590009d90 tx=0x7f659001eaf0 comp rx=0 tx=0).stop 2024-04-17T08:47:30.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.445+0000 7f65a0000640 1 -- 172.21.15.152:0/1908118938 shutdown_connections 2024-04-17T08:47:30.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.445+0000 7f65a0000640 1 --2- 172.21.15.152:0/1908118938 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65980d0360 0x7f65980d07f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:30.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.445+0000 7f65a0000640 1 --2- 172.21.15.152:0/1908118938 >> v2:172.21.15.196:3300/0 conn(0x7f659806f980 0x7f6598072530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:30.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.445+0000 7f65a0000640 1 -- 172.21.15.152:0/1908118938 >> 172.21.15.152:0/1908118938 conn(0x7f65980b3350 msgr2=0x7f65980b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:30.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.445+0000 7f65a0000640 1 -- 172.21.15.152:0/1908118938 shutdown_connections 2024-04-17T08:47:30.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.445+0000 7f65a0000640 1 -- 172.21.15.152:0/1908118938 wait complete. 2024-04-17T08:47:30.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.449+0000 7f65a0000640 1 Processor -- start 2024-04-17T08:47:30.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.449+0000 7f65a0000640 1 -- start start 2024-04-17T08:47:30.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.449+0000 7f65a0000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f659806f980 0x7f6598157da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:30.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.449+0000 7f65a0000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65980af670 0x7f65980b10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:30.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.449+0000 7f65a0000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65980d0360 0x7f6598152320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:30.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.449+0000 7f65a0000640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6598072bf0 con 0x7f659806f980 2024-04-17T08:47:30.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.449+0000 7f65a0000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f6598072a70 con 0x7f65980d0360 2024-04-17T08:47:30.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.449+0000 7f65a0000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f659806b9b0 con 0x7f65980af670 2024-04-17T08:47:30.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.449+0000 7f659d600640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f659806f980 0x7f6598157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:30.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.449+0000 7f659d600640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f659806f980 0x7f6598157da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32944/0 (socket says 172.21.15.152:32944) 2024-04-17T08:47:30.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.449+0000 7f659d600640 1 -- 172.21.15.152:0/811494159 learned_addr learned my addr 172.21.15.152:0/811494159 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:30.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.449+0000 7f659e000640 1 --2- 172.21.15.152:0/811494159 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65980d0360 0x7f6598152320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:30.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.449+0000 7f659cc00640 1 --2- 172.21.15.152:0/811494159 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65980af670 0x7f65980b10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:30.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.449+0000 7f659d600640 1 -- 172.21.15.152:0/811494159 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65980af670 msgr2=0x7f65980b10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:30.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.449+0000 7f659d600640 1 --2- 172.21.15.152:0/811494159 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65980af670 0x7f65980b10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:30.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.449+0000 7f659d600640 1 -- 172.21.15.152:0/811494159 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65980d0360 msgr2=0x7f6598152320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:30.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.449+0000 7f659d600640 1 --2- 172.21.15.152:0/811494159 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65980d0360 0x7f6598152320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:30.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.449+0000 7f659d600640 1 -- 172.21.15.152:0/811494159 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65981584a0 con 0x7f659806f980 2024-04-17T08:47:30.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.449+0000 7f659cc00640 1 --2- 172.21.15.152:0/811494159 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65980af670 0x7f65980b10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:30.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.449+0000 7f659d600640 1 --2- 172.21.15.152:0/811494159 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f659806f980 0x7f6598157da0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f658c00c450 tx=0x7f658c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:30.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.449+0000 7f6595600640 1 -- 172.21.15.152:0/811494159 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f658c017070 con 0x7f659806f980 2024-04-17T08:47:30.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.449+0000 7f6595600640 1 -- 172.21.15.152:0/811494159 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f658c005cf0 con 0x7f659806f980 2024-04-17T08:47:30.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.449+0000 7f6595600640 1 -- 172.21.15.152:0/811494159 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f658c007290 con 0x7f659806f980 2024-04-17T08:47:30.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.449+0000 7f65a0000640 1 -- 172.21.15.152:0/811494159 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6598158780 con 0x7f659806f980 2024-04-17T08:47:30.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.449+0000 7f65a0000640 1 -- 172.21.15.152:0/811494159 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65981f79b0 con 0x7f659806f980 2024-04-17T08:47:30.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.449+0000 7f65a0000640 1 -- 172.21.15.152:0/811494159 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6598068a30 con 0x7f659806f980 2024-04-17T08:47:30.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.453+0000 7f6595600640 1 -- 172.21.15.152:0/811494159 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f658c01a070 con 0x7f659806f980 2024-04-17T08:47:30.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.453+0000 7f6595600640 1 --2- 172.21.15.152:0/811494159 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f6578068380 0x7f657806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:30.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.453+0000 7f6595600640 1 -- 172.21.15.152:0/811494159 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f658c086110 con 0x7f659806f980 2024-04-17T08:47:30.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.453+0000 7f659cc00640 1 --2- 172.21.15.152:0/811494159 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f6578068380 0x7f657806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:30.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.453+0000 7f659cc00640 1 --2- 172.21.15.152:0/811494159 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f6578068380 0x7f657806a840 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f65980afef0 tx=0x7f6584008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:30.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.457+0000 7f6595600640 1 -- 172.21.15.152:0/811494159 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f658c055c50 con 0x7f659806f980 2024-04-17T08:47:30.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.613+0000 7f65a0000640 1 -- 172.21.15.152:0/811494159 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f65980b2c90 con 0x7f659806f980 2024-04-17T08:47:30.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.613+0000 7f6595600640 1 -- 172.21.15.152:0/811494159 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f658c059f50 con 0x7f659806f980 2024-04-17T08:47:30.616 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2024-04-17T08:47:30.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.617+0000 7f65a0000640 1 -- 172.21.15.152:0/811494159 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f6578068380 msgr2=0x7f657806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:30.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.617+0000 7f65a0000640 1 --2- 172.21.15.152:0/811494159 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f6578068380 0x7f657806a840 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f65980afef0 tx=0x7f6584008040 comp rx=0 tx=0).stop 2024-04-17T08:47:30.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.617+0000 7f65a0000640 1 -- 172.21.15.152:0/811494159 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f659806f980 msgr2=0x7f6598157da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:30.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.617+0000 7f65a0000640 1 --2- 172.21.15.152:0/811494159 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f659806f980 0x7f6598157da0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f658c00c450 tx=0x7f658c00c910 comp rx=0 tx=0).stop 2024-04-17T08:47:30.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.617+0000 7f65a0000640 1 -- 172.21.15.152:0/811494159 shutdown_connections 2024-04-17T08:47:30.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.617+0000 7f65a0000640 1 --2- 172.21.15.152:0/811494159 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65980d0360 0x7f6598152320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:30.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.617+0000 7f65a0000640 1 --2- 172.21.15.152:0/811494159 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f6578068380 0x7f657806a840 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:30.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.617+0000 7f65a0000640 1 --2- 172.21.15.152:0/811494159 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65980af670 0x7f65980b10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:30.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.617+0000 7f65a0000640 1 --2- 172.21.15.152:0/811494159 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f659806f980 0x7f6598157da0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:30.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.617+0000 7f65a0000640 1 -- 172.21.15.152:0/811494159 >> 172.21.15.152:0/811494159 conn(0x7f65980b3350 msgr2=0x7f65980b3730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:30.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.617+0000 7f65a0000640 1 -- 172.21.15.152:0/811494159 shutdown_connections 2024-04-17T08:47:30.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.617+0000 7f65a0000640 1 -- 172.21.15.152:0/811494159 wait complete. 2024-04-17T08:47:30.637 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-17T08:47:30.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.773+0000 7f1a45800640 1 Processor -- start 2024-04-17T08:47:30.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.773+0000 7f1a45800640 1 -- start start 2024-04-17T08:47:30.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.773+0000 7f1a45800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f1a400af670 0x7f1a4015b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:30.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.773+0000 7f1a45800640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f1a4006f980 0x7f1a40072530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:30.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.773+0000 7f1a45800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a4015c260 con 0x7f1a400d0360 2024-04-17T08:47:30.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.773+0000 7f1a45800640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f1a4015c820 con 0x7f1a4006f980 2024-04-17T08:47:30.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.773+0000 7f1a45800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f1a4015c540 con 0x7f1a400af670 2024-04-17T08:47:30.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.773+0000 7f1a36000640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f1a4006f980 0x7f1a40072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:30.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.773+0000 7f1a36000640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f1a4006f980 0x7f1a40072530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32950/0 (socket says 172.21.15.152:32950) 2024-04-17T08:47:30.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.773+0000 7f1a36000640 1 -- 172.21.15.152:0/4208085361 learned_addr learned my addr 172.21.15.152:0/4208085361 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:30.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.773+0000 7f1a3ea00640 1 --2- 172.21.15.152:0/4208085361 >> v2:172.21.15.196:3300/0 conn(0x7f1a400af670 0x7f1a4015b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:30.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.773+0000 7f1a36000640 1 -- 172.21.15.152:0/4208085361 >> v2:172.21.15.196:3300/0 conn(0x7f1a400af670 msgr2=0x7f1a4015b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:30.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.773+0000 7f1a36000640 1 --2- 172.21.15.152:0/4208085361 >> v2:172.21.15.196:3300/0 conn(0x7f1a400af670 0x7f1a4015b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:30.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.773+0000 7f1a36000640 1 -- 172.21.15.152:0/4208085361 >> v1:172.21.15.196:6789/0 conn(0x7f1a400d0360 legacy=0x7f1a4006dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:30.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.773+0000 7f1a36000640 1 -- 172.21.15.152:0/4208085361 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a40071d30 con 0x7f1a4006f980 2024-04-17T08:47:30.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.777+0000 7f1a36000640 1 --2- 172.21.15.152:0/4208085361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a4006f980 0x7f1a40072530 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1a40074260 tx=0x7f1a2801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b06b803401b58e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:30.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.777+0000 7f1a3e000640 1 -- 172.21.15.152:0/4208085361 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a280b1070 con 0x7f1a4006f980 2024-04-17T08:47:30.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.777+0000 7f1a3e000640 1 -- 172.21.15.152:0/4208085361 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a280ac410 con 0x7f1a4006f980 2024-04-17T08:47:30.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.777+0000 7f1a3e000640 1 -- 172.21.15.152:0/4208085361 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a280ac7e0 con 0x7f1a4006f980 2024-04-17T08:47:30.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.777+0000 7f1a45800640 1 -- 172.21.15.152:0/4208085361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a4006f980 msgr2=0x7f1a40072530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:30.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.777+0000 7f1a45800640 1 --2- 172.21.15.152:0/4208085361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a4006f980 0x7f1a40072530 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1a40074260 tx=0x7f1a2801c420 comp rx=0 tx=0).stop 2024-04-17T08:47:30.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.777+0000 7f1a45800640 1 -- 172.21.15.152:0/4208085361 shutdown_connections 2024-04-17T08:47:30.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.777+0000 7f1a45800640 1 --2- 172.21.15.152:0/4208085361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a4006f980 0x7f1a40072530 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:30.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.777+0000 7f1a45800640 1 --2- 172.21.15.152:0/4208085361 >> v2:172.21.15.196:3300/0 conn(0x7f1a400af670 0x7f1a4015b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:30.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.777+0000 7f1a45800640 1 -- 172.21.15.152:0/4208085361 >> 172.21.15.152:0/4208085361 conn(0x7f1a400b3350 msgr2=0x7f1a400b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:30.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.777+0000 7f1a45800640 1 -- 172.21.15.152:0/4208085361 shutdown_connections 2024-04-17T08:47:30.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.777+0000 7f1a45800640 1 -- 172.21.15.152:0/4208085361 wait complete. 2024-04-17T08:47:30.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.781+0000 7f1a45800640 1 Processor -- start 2024-04-17T08:47:30.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.781+0000 7f1a45800640 1 -- start start 2024-04-17T08:47:30.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.781+0000 7f1a45800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1a4006f980 0x7f1a401533e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:30.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.781+0000 7f1a45800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1a400af670 0x7f1a40157fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:30.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.781+0000 7f1a45800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a400d0360 0x7f1a400b2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:30.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.781+0000 7f1a45800640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1a4015bf80 con 0x7f1a400d0360 2024-04-17T08:47:30.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.781+0000 7f1a45800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1a4015be00 con 0x7f1a4006f980 2024-04-17T08:47:30.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.781+0000 7f1a45800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f1a40072a70 con 0x7f1a400af670 2024-04-17T08:47:30.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.781+0000 7f1a3f400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a400d0360 0x7f1a400b2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:30.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.781+0000 7f1a3f400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a400d0360 0x7f1a400b2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32964/0 (socket says 172.21.15.152:32964) 2024-04-17T08:47:30.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.781+0000 7f1a3f400640 1 -- 172.21.15.152:0/2051585297 learned_addr learned my addr 172.21.15.152:0/2051585297 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:30.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.781+0000 7f1a3ea00640 1 --2- 172.21.15.152:0/2051585297 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1a4006f980 0x7f1a401533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:30.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.781+0000 7f1a36000640 1 --2- 172.21.15.152:0/2051585297 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1a400af670 0x7f1a40157fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:30.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.781+0000 7f1a3f400640 1 -- 172.21.15.152:0/2051585297 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1a400af670 msgr2=0x7f1a40157fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:30.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.781+0000 7f1a3f400640 1 --2- 172.21.15.152:0/2051585297 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1a400af670 0x7f1a40157fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:30.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.781+0000 7f1a3f400640 1 -- 172.21.15.152:0/2051585297 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1a4006f980 msgr2=0x7f1a401533e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:30.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.781+0000 7f1a3f400640 1 --2- 172.21.15.152:0/2051585297 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1a4006f980 0x7f1a401533e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:30.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.781+0000 7f1a3f400640 1 -- 172.21.15.152:0/2051585297 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a40154b80 con 0x7f1a400d0360 2024-04-17T08:47:30.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.781+0000 7f1a3f400640 1 --2- 172.21.15.152:0/2051585297 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a400d0360 0x7f1a400b2440 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1a3800b970 tx=0x7f1a3800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:30.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.781+0000 7f1a37400640 1 -- 172.21.15.152:0/2051585297 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a38019070 con 0x7f1a400d0360 2024-04-17T08:47:30.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.781+0000 7f1a37400640 1 -- 172.21.15.152:0/2051585297 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a3800cb40 con 0x7f1a400d0360 2024-04-17T08:47:30.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.781+0000 7f1a45800640 1 -- 172.21.15.152:0/2051585297 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a40153ae0 con 0x7f1a400d0360 2024-04-17T08:47:30.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.781+0000 7f1a37400640 1 -- 172.21.15.152:0/2051585297 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a38014440 con 0x7f1a400d0360 2024-04-17T08:47:30.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.781+0000 7f1a45800640 1 -- 172.21.15.152:0/2051585297 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a401540a0 con 0x7f1a400d0360 2024-04-17T08:47:30.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.785+0000 7f1a45800640 1 -- 172.21.15.152:0/2051585297 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a40068a30 con 0x7f1a400d0360 2024-04-17T08:47:30.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.785+0000 7f1a37400640 1 -- 172.21.15.152:0/2051585297 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1a3801c070 con 0x7f1a400d0360 2024-04-17T08:47:30.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.785+0000 7f1a37400640 1 --2- 172.21.15.152:0/2051585297 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1a1c0683b0 0x7f1a1c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:30.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.785+0000 7f1a37400640 1 -- 172.21.15.152:0/2051585297 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f1a38086940 con 0x7f1a400d0360 2024-04-17T08:47:30.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.785+0000 7f1a3ea00640 1 --2- 172.21.15.152:0/2051585297 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1a1c0683b0 0x7f1a1c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:30.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.785+0000 7f1a3ea00640 1 --2- 172.21.15.152:0/2051585297 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1a1c0683b0 0x7f1a1c06a870 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1a401551c0 tx=0x7f1a30008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:30.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.789+0000 7f1a37400640 1 -- 172.21.15.152:0/2051585297 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f1a38056480 con 0x7f1a400d0360 2024-04-17T08:47:30.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.945+0000 7f1a45800640 1 -- 172.21.15.152:0/2051585297 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f1a40073c80 con 0x7f1a400d0360 2024-04-17T08:47:30.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.945+0000 7f1a37400640 1 -- 172.21.15.152:0/2051585297 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f1a3805a780 con 0x7f1a400d0360 2024-04-17T08:47:30.949 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-04-17T08:47:30.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.949+0000 7f1a45800640 1 -- 172.21.15.152:0/2051585297 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1a1c0683b0 msgr2=0x7f1a1c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:30.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.949+0000 7f1a45800640 1 --2- 172.21.15.152:0/2051585297 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1a1c0683b0 0x7f1a1c06a870 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1a401551c0 tx=0x7f1a30008040 comp rx=0 tx=0).stop 2024-04-17T08:47:30.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.949+0000 7f1a45800640 1 -- 172.21.15.152:0/2051585297 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a400d0360 msgr2=0x7f1a400b2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:30.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.949+0000 7f1a45800640 1 --2- 172.21.15.152:0/2051585297 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a400d0360 0x7f1a400b2440 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1a3800b970 tx=0x7f1a3800be30 comp rx=0 tx=0).stop 2024-04-17T08:47:30.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.949+0000 7f1a45800640 1 -- 172.21.15.152:0/2051585297 shutdown_connections 2024-04-17T08:47:30.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.949+0000 7f1a45800640 1 --2- 172.21.15.152:0/2051585297 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a400d0360 0x7f1a400b2440 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:30.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.949+0000 7f1a45800640 1 --2- 172.21.15.152:0/2051585297 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1a1c0683b0 0x7f1a1c06a870 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:30.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.949+0000 7f1a45800640 1 --2- 172.21.15.152:0/2051585297 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1a400af670 0x7f1a40157fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:30.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.949+0000 7f1a45800640 1 --2- 172.21.15.152:0/2051585297 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1a4006f980 0x7f1a401533e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:30.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.949+0000 7f1a45800640 1 -- 172.21.15.152:0/2051585297 >> 172.21.15.152:0/2051585297 conn(0x7f1a400b3350 msgr2=0x7f1a4006b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:30.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.949+0000 7f1a45800640 1 -- 172.21.15.152:0/2051585297 shutdown_connections 2024-04-17T08:47:30.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:30.949+0000 7f1a45800640 1 -- 172.21.15.152:0/2051585297 wait complete. 2024-04-17T08:47:30.971 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-17T08:47:31.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.105+0000 7f9547000640 1 Processor -- start 2024-04-17T08:47:31.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.105+0000 7f9547000640 1 -- start start 2024-04-17T08:47:31.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.109+0000 7f9547000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f95400d0a70 0x7f9540160010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:31.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.109+0000 7f9547000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f954015d710 0x7f9540160550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:31.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.109+0000 7f9547000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9540160a90 con 0x7f954015a010 2024-04-17T08:47:31.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.109+0000 7f9547000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f954015d280 con 0x7f954015d710 2024-04-17T08:47:31.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.109+0000 7f9547000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f954015c9d0 con 0x7f95400d0a70 2024-04-17T08:47:31.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.109+0000 7f9545000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f954015d710 0x7f9540160550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:31.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.109+0000 7f9537e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f95400d0a70 0x7f9540160010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:31.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.109+0000 7f953fe00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f954015a010 0x7f95400d0360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.152:57238/0 (socket says 172.21.15.152:57238) 2024-04-17T08:47:31.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.109+0000 7f953fe00640 1 -- 172.21.15.152:0/3625426854 learned_addr learned my addr 172.21.15.152:0/3625426854 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:31.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.109+0000 7f9545000640 1 -- 172.21.15.152:0/3625426854 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f95400d0a70 msgr2=0x7f9540160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:31.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.109+0000 7f9545000640 1 --2- 172.21.15.152:0/3625426854 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f95400d0a70 0x7f9540160010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:31.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.109+0000 7f9545000640 1 -- 172.21.15.152:0/3625426854 >> v1:172.21.15.196:6789/0 conn(0x7f954015a010 legacy=0x7f95400d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:31.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.109+0000 7f9545000640 1 -- 172.21.15.152:0/3625426854 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9540160d20 con 0x7f954015d710 2024-04-17T08:47:31.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.113+0000 7f9545000640 1 --2- 172.21.15.152:0/3625426854 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f954015d710 0x7f9540160550 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9538009d90 tx=0x7f953801c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb202b878d9807b server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:31.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.113+0000 7f953f400640 1 -- 172.21.15.152:0/3625426854 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95380b2070 con 0x7f954015d710 2024-04-17T08:47:31.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.113+0000 7f953f400640 1 -- 172.21.15.152:0/3625426854 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95380a5890 con 0x7f954015d710 2024-04-17T08:47:31.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.113+0000 7f953f400640 1 -- 172.21.15.152:0/3625426854 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95380a5c60 con 0x7f954015d710 2024-04-17T08:47:31.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.113+0000 7f9547000640 1 -- 172.21.15.152:0/3625426854 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f954015d710 msgr2=0x7f9540160550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:31.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.113+0000 7f9547000640 1 --2- 172.21.15.152:0/3625426854 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f954015d710 0x7f9540160550 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9538009d90 tx=0x7f953801c8e0 comp rx=0 tx=0).stop 2024-04-17T08:47:31.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.113+0000 7f9547000640 1 -- 172.21.15.152:0/3625426854 shutdown_connections 2024-04-17T08:47:31.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.113+0000 7f9547000640 1 --2- 172.21.15.152:0/3625426854 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f954015d710 0x7f9540160550 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:31.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.113+0000 7f9547000640 1 --2- 172.21.15.152:0/3625426854 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f95400d0a70 0x7f9540160010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:31.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.113+0000 7f9547000640 1 -- 172.21.15.152:0/3625426854 >> 172.21.15.152:0/3625426854 conn(0x7f95400b3350 msgr2=0x7f95400b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:31.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.113+0000 7f9547000640 1 -- 172.21.15.152:0/3625426854 shutdown_connections 2024-04-17T08:47:31.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.113+0000 7f9547000640 1 -- 172.21.15.152:0/3625426854 wait complete. 2024-04-17T08:47:31.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.113+0000 7f9547000640 1 Processor -- start 2024-04-17T08:47:31.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.113+0000 7f9547000640 1 -- start start 2024-04-17T08:47:31.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.117+0000 7f9547000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f95400d0a70 0x7f954006dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:31.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.117+0000 7f9547000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f954015a010 0x7f9540156fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:31.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.117+0000 7f9547000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f954015d710 0x7f954014bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:31.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.117+0000 7f9547000640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f954015e570 con 0x7f954015d710 2024-04-17T08:47:31.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.117+0000 7f9547000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f954015e3f0 con 0x7f954015a010 2024-04-17T08:47:31.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.117+0000 7f9547000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f954015e6f0 con 0x7f95400d0a70 2024-04-17T08:47:31.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.117+0000 7f9545000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f954015d710 0x7f954014bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:31.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.117+0000 7f9545000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f954015d710 0x7f954014bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32980/0 (socket says 172.21.15.152:32980) 2024-04-17T08:47:31.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.117+0000 7f9545000640 1 -- 172.21.15.152:0/2289975867 learned_addr learned my addr 172.21.15.152:0/2289975867 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:31.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.117+0000 7f9537e00640 1 --2- 172.21.15.152:0/2289975867 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f954015a010 0x7f9540156fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:31.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.117+0000 7f953fe00640 1 --2- 172.21.15.152:0/2289975867 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f95400d0a70 0x7f954006dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:31.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.117+0000 7f9545000640 1 -- 172.21.15.152:0/2289975867 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f95400d0a70 msgr2=0x7f954006dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:31.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.117+0000 7f9545000640 1 --2- 172.21.15.152:0/2289975867 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f95400d0a70 0x7f954006dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:31.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.117+0000 7f9545000640 1 -- 172.21.15.152:0/2289975867 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f954015a010 msgr2=0x7f9540156fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:31.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.117+0000 7f9545000640 1 --2- 172.21.15.152:0/2289975867 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f954015a010 0x7f9540156fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:31.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.117+0000 7f9545000640 1 -- 172.21.15.152:0/2289975867 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9540151380 con 0x7f954015d710 2024-04-17T08:47:31.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.117+0000 7f9545000640 1 --2- 172.21.15.152:0/2289975867 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f954015d710 0x7f954014bc50 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f953801af90 tx=0x7f9538019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:31.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.117+0000 7f953cc00640 1 -- 172.21.15.152:0/2289975867 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95380b2050 con 0x7f954015d710 2024-04-17T08:47:31.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.117+0000 7f953cc00640 1 -- 172.21.15.152:0/2289975867 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95380be070 con 0x7f954015d710 2024-04-17T08:47:31.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.117+0000 7f953cc00640 1 -- 172.21.15.152:0/2289975867 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95380ad850 con 0x7f954015d710 2024-04-17T08:47:31.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.117+0000 7f9547000640 1 -- 172.21.15.152:0/2289975867 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f954006e5d0 con 0x7f954015d710 2024-04-17T08:47:31.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.117+0000 7f9547000640 1 -- 172.21.15.152:0/2289975867 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f954006eb90 con 0x7f954015d710 2024-04-17T08:47:31.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.117+0000 7f9547000640 1 -- 172.21.15.152:0/2289975867 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9540068a30 con 0x7f954015d710 2024-04-17T08:47:31.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.117+0000 7f953cc00640 1 -- 172.21.15.152:0/2289975867 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f95380ad9f0 con 0x7f954015d710 2024-04-17T08:47:31.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.121+0000 7f953cc00640 1 --2- 172.21.15.152:0/2289975867 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f951c0683b0 0x7f951c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:31.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.121+0000 7f953cc00640 1 -- 172.21.15.152:0/2289975867 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f9538121700 con 0x7f954015d710 2024-04-17T08:47:31.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.121+0000 7f953fe00640 1 --2- 172.21.15.152:0/2289975867 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f951c0683b0 0x7f951c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:31.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.121+0000 7f953fe00640 1 --2- 172.21.15.152:0/2289975867 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f951c0683b0 0x7f951c06a870 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9530000f70 tx=0x7f9530007e90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:31.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.125+0000 7f953cc00640 1 -- 172.21.15.152:0/2289975867 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f95380c7020 con 0x7f954015d710 2024-04-17T08:47:31.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.281+0000 7f9547000640 1 -- 172.21.15.152:0/2289975867 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f9540157520 con 0x7f954015d710 2024-04-17T08:47:31.284 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.281+0000 7f953cc00640 1 -- 172.21.15.152:0/2289975867 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f9538016560 con 0x7f954015d710 2024-04-17T08:47:31.284 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 64 2024-04-17T08:47:31.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.285+0000 7f9547000640 1 -- 172.21.15.152:0/2289975867 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f951c0683b0 msgr2=0x7f951c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:31.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.285+0000 7f9547000640 1 --2- 172.21.15.152:0/2289975867 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f951c0683b0 0x7f951c06a870 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9530000f70 tx=0x7f9530007e90 comp rx=0 tx=0).stop 2024-04-17T08:47:31.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.285+0000 7f9547000640 1 -- 172.21.15.152:0/2289975867 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f954015d710 msgr2=0x7f954014bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:31.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.285+0000 7f9547000640 1 --2- 172.21.15.152:0/2289975867 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f954015d710 0x7f954014bc50 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f953801af90 tx=0x7f9538019680 comp rx=0 tx=0).stop 2024-04-17T08:47:31.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.285+0000 7f9547000640 1 -- 172.21.15.152:0/2289975867 shutdown_connections 2024-04-17T08:47:31.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.285+0000 7f9547000640 1 --2- 172.21.15.152:0/2289975867 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f954015d710 0x7f954014bc50 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:31.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.285+0000 7f9547000640 1 --2- 172.21.15.152:0/2289975867 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f954015a010 0x7f9540156fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:31.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.285+0000 7f9547000640 1 --2- 172.21.15.152:0/2289975867 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f951c0683b0 0x7f951c06a870 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:31.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.285+0000 7f9547000640 1 --2- 172.21.15.152:0/2289975867 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f95400d0a70 0x7f954006dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:31.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.285+0000 7f9547000640 1 -- 172.21.15.152:0/2289975867 >> 172.21.15.152:0/2289975867 conn(0x7f95400b3350 msgr2=0x7f95400728a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:31.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.285+0000 7f9547000640 1 -- 172.21.15.152:0/2289975867 shutdown_connections 2024-04-17T08:47:31.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.285+0000 7f9547000640 1 -- 172.21.15.152:0/2289975867 wait complete. 2024-04-17T08:47:31.306 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-17T08:47:31.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.445+0000 7f6bb8c00640 1 Processor -- start 2024-04-17T08:47:31.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.445+0000 7f6bb8c00640 1 -- start start 2024-04-17T08:47:31.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.445+0000 7f6bb8c00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f6bb40d07c0 0x7f6bb40adae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:31.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.445+0000 7f6bb8c00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bb406e6b0 con 0x7f6bb40d0360 2024-04-17T08:47:31.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.445+0000 7f6bb8c00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bb406e990 con 0x7f6bb4161b70 2024-04-17T08:47:31.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.445+0000 7f6bb8c00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f6bb4161f50 con 0x7f6bb40d07c0 2024-04-17T08:47:31.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.445+0000 7f6bb2800640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f6bb40d07c0 0x7f6bb40adae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:31.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.445+0000 7f6bb2800640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f6bb40d07c0 0x7f6bb40adae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32988/0 (socket says 172.21.15.152:32988) 2024-04-17T08:47:31.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.445+0000 7f6bb2800640 1 -- 172.21.15.152:0/1985114342 learned_addr learned my addr 172.21.15.152:0/1985114342 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:31.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.445+0000 7f6bb2800640 1 -- 172.21.15.152:0/1985114342 >> v1:172.21.15.196:6789/0 conn(0x7f6bb4161b70 legacy=0x7f6bb406dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:31.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.445+0000 7f6bb2800640 1 -- 172.21.15.152:0/1985114342 >> v1:172.21.15.152:6789/0 conn(0x7f6bb40d0360 legacy=0x7f6bb40ad3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:31.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.445+0000 7f6bb2800640 1 -- 172.21.15.152:0/1985114342 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bb406ec70 con 0x7f6bb40d07c0 2024-04-17T08:47:31.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.449+0000 7f6bb2800640 1 --2- 172.21.15.152:0/1985114342 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6bb40d07c0 0x7f6bb40adae0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6bac009e50 tx=0x7f6bac01d400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a8b53d1782cd920 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:31.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.449+0000 7f6bb0a00640 1 -- 172.21.15.152:0/1985114342 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bac0a5770 con 0x7f6bb40d07c0 2024-04-17T08:47:31.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.449+0000 7f6bb0a00640 1 -- 172.21.15.152:0/1985114342 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bac0a5910 con 0x7f6bb40d07c0 2024-04-17T08:47:31.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.449+0000 7f6bb0a00640 1 -- 172.21.15.152:0/1985114342 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bac0a5ce0 con 0x7f6bb40d07c0 2024-04-17T08:47:31.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.449+0000 7f6bb8c00640 1 -- 172.21.15.152:0/1985114342 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6bb40d07c0 msgr2=0x7f6bb40adae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:31.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.449+0000 7f6bb8c00640 1 --2- 172.21.15.152:0/1985114342 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6bb40d07c0 0x7f6bb40adae0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6bac009e50 tx=0x7f6bac01d400 comp rx=0 tx=0).stop 2024-04-17T08:47:31.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.449+0000 7f6bb8c00640 1 -- 172.21.15.152:0/1985114342 shutdown_connections 2024-04-17T08:47:31.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.449+0000 7f6bb8c00640 1 --2- 172.21.15.152:0/1985114342 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6bb40d07c0 0x7f6bb40adae0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:31.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.449+0000 7f6bb8c00640 1 -- 172.21.15.152:0/1985114342 >> 172.21.15.152:0/1985114342 conn(0x7f6bb40b3350 msgr2=0x7f6bb40b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:31.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.449+0000 7f6bb8c00640 1 -- 172.21.15.152:0/1985114342 shutdown_connections 2024-04-17T08:47:31.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.449+0000 7f6bb8c00640 1 -- 172.21.15.152:0/1985114342 wait complete. 2024-04-17T08:47:31.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.453+0000 7f6bb8c00640 1 Processor -- start 2024-04-17T08:47:31.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.453+0000 7f6bb8c00640 1 -- start start 2024-04-17T08:47:31.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.453+0000 7f6bb8c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6bb40d0360 0x7f6bb41527a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:31.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.453+0000 7f6bb8c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6bb40d07c0 0x7f6bb4156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:31.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.453+0000 7f6bb8c00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6bb4161b70 0x7f6bb41587b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:31.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.453+0000 7f6bb8c00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb4071ef0 con 0x7f6bb4161b70 2024-04-17T08:47:31.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.453+0000 7f6bb8c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb4071d70 con 0x7f6bb40d0360 2024-04-17T08:47:31.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.453+0000 7f6bb8c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f6bb416c1d0 con 0x7f6bb40d07c0 2024-04-17T08:47:31.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.453+0000 7f6bb2800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6bb4161b70 0x7f6bb41587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:31.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.453+0000 7f6bb2800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6bb4161b70 0x7f6bb41587b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33004/0 (socket says 172.21.15.152:33004) 2024-04-17T08:47:31.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.453+0000 7f6bb2800640 1 -- 172.21.15.152:0/2620205597 learned_addr learned my addr 172.21.15.152:0/2620205597 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:31.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.453+0000 7f6bb1e00640 1 --2- 172.21.15.152:0/2620205597 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6bb40d0360 0x7f6bb41527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:31.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.453+0000 7f6bb1400640 1 --2- 172.21.15.152:0/2620205597 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6bb40d07c0 0x7f6bb4156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:31.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.453+0000 7f6bb2800640 1 -- 172.21.15.152:0/2620205597 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6bb40d07c0 msgr2=0x7f6bb4156ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:31.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.453+0000 7f6bb2800640 1 --2- 172.21.15.152:0/2620205597 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6bb40d07c0 0x7f6bb4156ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:31.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.453+0000 7f6bb2800640 1 -- 172.21.15.152:0/2620205597 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6bb40d0360 msgr2=0x7f6bb41527a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:31.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.453+0000 7f6bb2800640 1 --2- 172.21.15.152:0/2620205597 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6bb40d0360 0x7f6bb41527a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:31.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.453+0000 7f6bb2800640 1 -- 172.21.15.152:0/2620205597 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bb415aa20 con 0x7f6bb4161b70 2024-04-17T08:47:31.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.453+0000 7f6bb1e00640 1 --2- 172.21.15.152:0/2620205597 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6bb40d0360 0x7f6bb41527a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:31.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.453+0000 7f6bb2800640 1 --2- 172.21.15.152:0/2620205597 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6bb4161b70 0x7f6bb41587b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6bac0195b0 tx=0x7f6bac019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:31.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.453+0000 7f6baa000640 1 -- 172.21.15.152:0/2620205597 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bac0bb030 con 0x7f6bb4161b70 2024-04-17T08:47:31.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.453+0000 7f6baa000640 1 -- 172.21.15.152:0/2620205597 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bac0b7400 con 0x7f6bb4161b70 2024-04-17T08:47:31.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.453+0000 7f6baa000640 1 -- 172.21.15.152:0/2620205597 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bac0b77f0 con 0x7f6bb4161b70 2024-04-17T08:47:31.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.453+0000 7f6bb8c00640 1 -- 172.21.15.152:0/2620205597 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bb415ad00 con 0x7f6bb4161b70 2024-04-17T08:47:31.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.453+0000 7f6bb8c00640 1 -- 172.21.15.152:0/2620205597 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bb415b2c0 con 0x7f6bb4161b70 2024-04-17T08:47:31.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.453+0000 7f6bb8c00640 1 -- 172.21.15.152:0/2620205597 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bb4068a30 con 0x7f6bb4161b70 2024-04-17T08:47:31.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.457+0000 7f6baa000640 1 -- 172.21.15.152:0/2620205597 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6bac0be070 con 0x7f6bb4161b70 2024-04-17T08:47:31.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.457+0000 7f6baa000640 1 --2- 172.21.15.152:0/2620205597 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f6b94068380 0x7f6b9406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:31.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.457+0000 7f6baa000640 1 -- 172.21.15.152:0/2620205597 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f6bac121600 con 0x7f6bb4161b70 2024-04-17T08:47:31.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.457+0000 7f6bb1e00640 1 --2- 172.21.15.152:0/2620205597 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f6b94068380 0x7f6b9406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:31.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.457+0000 7f6bb1e00640 1 --2- 172.21.15.152:0/2620205597 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f6b94068380 0x7f6b9406a840 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6bb409e380 tx=0x7f6ba4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:31.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.461+0000 7f6baa000640 1 -- 172.21.15.152:0/2620205597 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f6bac0c5070 con 0x7f6bb4161b70 2024-04-17T08:47:31.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.617+0000 7f6bb8c00640 1 -- 172.21.15.152:0/2620205597 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f6bb40b2850 con 0x7f6bb4161b70 2024-04-17T08:47:31.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.617+0000 7f6baa000640 1 -- 172.21.15.152:0/2620205597 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f6bac016620 con 0x7f6bb4161b70 2024-04-17T08:47:31.621 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-04-17T08:47:31.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.621+0000 7f6bb8c00640 1 -- 172.21.15.152:0/2620205597 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f6b94068380 msgr2=0x7f6b9406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:31.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.621+0000 7f6bb8c00640 1 --2- 172.21.15.152:0/2620205597 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f6b94068380 0x7f6b9406a840 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6bb409e380 tx=0x7f6ba4009040 comp rx=0 tx=0).stop 2024-04-17T08:47:31.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.621+0000 7f6bb8c00640 1 -- 172.21.15.152:0/2620205597 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6bb4161b70 msgr2=0x7f6bb41587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:31.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.621+0000 7f6bb8c00640 1 --2- 172.21.15.152:0/2620205597 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6bb4161b70 0x7f6bb41587b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6bac0195b0 tx=0x7f6bac019740 comp rx=0 tx=0).stop 2024-04-17T08:47:31.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.621+0000 7f6bb8c00640 1 -- 172.21.15.152:0/2620205597 shutdown_connections 2024-04-17T08:47:31.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.621+0000 7f6bb8c00640 1 --2- 172.21.15.152:0/2620205597 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6bb4161b70 0x7f6bb41587b0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:31.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.621+0000 7f6bb8c00640 1 --2- 172.21.15.152:0/2620205597 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f6b94068380 0x7f6b9406a840 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:31.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.621+0000 7f6bb8c00640 1 --2- 172.21.15.152:0/2620205597 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6bb40d07c0 0x7f6bb4156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:31.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.621+0000 7f6bb8c00640 1 --2- 172.21.15.152:0/2620205597 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6bb40d0360 0x7f6bb41527a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:31.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.621+0000 7f6bb8c00640 1 -- 172.21.15.152:0/2620205597 >> 172.21.15.152:0/2620205597 conn(0x7f6bb40b3350 msgr2=0x7f6bb415cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:31.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.621+0000 7f6bb8c00640 1 -- 172.21.15.152:0/2620205597 shutdown_connections 2024-04-17T08:47:31.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.621+0000 7f6bb8c00640 1 -- 172.21.15.152:0/2620205597 wait complete. 2024-04-17T08:47:31.642 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-17T08:47:31.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.773+0000 7f47f4000640 1 Processor -- start 2024-04-17T08:47:31.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.773+0000 7f47f4000640 1 -- start start 2024-04-17T08:47:31.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.777+0000 7f47f4000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f47ec15d710 0x7f47ec160720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:31.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.777+0000 7f47f4000640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47ec160d20 con 0x7f47ec0d0a70 2024-04-17T08:47:31.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.777+0000 7f47f4000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47ec15cc30 con 0x7f47ec15a010 2024-04-17T08:47:31.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.777+0000 7f47f4000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f47ec15d280 con 0x7f47ec15d710 2024-04-17T08:47:31.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.777+0000 7f47f0c00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f47ec0d0a70 0x7f47ec160010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:60494/0 (socket says 172.21.15.152:60494) 2024-04-17T08:47:31.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.777+0000 7f47f0c00640 1 -- 172.21.15.152:0/847209731 learned_addr learned my addr 172.21.15.152:0/847209731 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:31.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.777+0000 7f47f2000640 1 --2- 172.21.15.152:0/847209731 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f47ec15d710 0x7f47ec160720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:31.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.777+0000 7f47ebe00640 1 -- 172.21.15.152:0/847209731 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1876545016 0 0) 0x7f47ec160d20 con 0x7f47ec0d0a70 2024-04-17T08:47:31.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.777+0000 7f47ebe00640 1 -- 172.21.15.152:0/847209731 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47d4003530 con 0x7f47ec0d0a70 2024-04-17T08:47:31.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.777+0000 7f47ebe00640 1 -- 172.21.15.152:0/847209731 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2245827840 0 0) 0x7f47ec15cc30 con 0x7f47ec15a010 2024-04-17T08:47:31.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.777+0000 7f47ebe00640 1 -- 172.21.15.152:0/847209731 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47ec160d20 con 0x7f47ec15a010 2024-04-17T08:47:31.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.777+0000 7f47f2000640 1 -- 172.21.15.152:0/847209731 >> v1:172.21.15.196:6789/0 conn(0x7f47ec15a010 legacy=0x7f47ec0d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:31.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.777+0000 7f47f2000640 1 -- 172.21.15.152:0/847209731 >> v1:172.21.15.152:6789/0 conn(0x7f47ec0d0a70 legacy=0x7f47ec160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:31.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.777+0000 7f47f2000640 1 -- 172.21.15.152:0/847209731 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47ec15cf10 con 0x7f47ec15d710 2024-04-17T08:47:31.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.781+0000 7f47f2000640 1 --2- 172.21.15.152:0/847209731 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f47ec15d710 0x7f47ec160720 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f47e4009dc0 tx=0x7f47e401c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=994dccdc20547609 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:31.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.781+0000 7f47ebe00640 1 -- 172.21.15.152:0/847209731 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e40b2070 con 0x7f47ec15d710 2024-04-17T08:47:31.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.781+0000 7f47ebe00640 1 -- 172.21.15.152:0/847209731 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47e40a57c0 con 0x7f47ec15d710 2024-04-17T08:47:31.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.781+0000 7f47ebe00640 1 -- 172.21.15.152:0/847209731 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e40a5b70 con 0x7f47ec15d710 2024-04-17T08:47:31.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.781+0000 7f47f4000640 1 -- 172.21.15.152:0/847209731 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f47ec15d710 msgr2=0x7f47ec160720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:31.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.781+0000 7f47f4000640 1 --2- 172.21.15.152:0/847209731 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f47ec15d710 0x7f47ec160720 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f47e4009dc0 tx=0x7f47e401c900 comp rx=0 tx=0).stop 2024-04-17T08:47:31.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.781+0000 7f47f4000640 1 -- 172.21.15.152:0/847209731 shutdown_connections 2024-04-17T08:47:31.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.781+0000 7f47f4000640 1 --2- 172.21.15.152:0/847209731 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f47ec15d710 0x7f47ec160720 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:31.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.781+0000 7f47f4000640 1 -- 172.21.15.152:0/847209731 >> 172.21.15.152:0/847209731 conn(0x7f47ec0b3350 msgr2=0x7f47ec0b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:31.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.781+0000 7f47f4000640 1 -- 172.21.15.152:0/847209731 shutdown_connections 2024-04-17T08:47:31.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.781+0000 7f47f4000640 1 -- 172.21.15.152:0/847209731 wait complete. 2024-04-17T08:47:31.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.781+0000 7f47f4000640 1 Processor -- start 2024-04-17T08:47:31.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.781+0000 7f47f4000640 1 -- start start 2024-04-17T08:47:31.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.785+0000 7f47f4000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f47ec0d0a70 0x7f47ec06f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:31.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.785+0000 7f47f4000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f47ec15a010 0x7f47ec147950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:31.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.785+0000 7f47f4000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47ec15d710 0x7f47ec1502e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:31.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.785+0000 7f47f4000640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f47ec169f50 con 0x7f47ec15d710 2024-04-17T08:47:31.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.785+0000 7f47f4000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f47ec169dd0 con 0x7f47ec15a010 2024-04-17T08:47:31.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.785+0000 7f47f4000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f47ec16a0d0 con 0x7f47ec0d0a70 2024-04-17T08:47:31.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.785+0000 7f47f2000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47ec15d710 0x7f47ec1502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:31.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.785+0000 7f47f2000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47ec15d710 0x7f47ec1502e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33014/0 (socket says 172.21.15.152:33014) 2024-04-17T08:47:31.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.785+0000 7f47f2000640 1 -- 172.21.15.152:0/2535207354 learned_addr learned my addr 172.21.15.152:0/2535207354 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:31.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.785+0000 7f47f0c00640 1 --2- 172.21.15.152:0/2535207354 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f47ec15a010 0x7f47ec147950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:31.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.785+0000 7f47f2000640 1 -- 172.21.15.152:0/2535207354 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f47ec0d0a70 msgr2=0x7f47ec06f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:31.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.785+0000 7f47f1600640 1 --2- 172.21.15.152:0/2535207354 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f47ec0d0a70 0x7f47ec06f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:31.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.785+0000 7f47f2000640 1 --2- 172.21.15.152:0/2535207354 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f47ec0d0a70 0x7f47ec06f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:31.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.785+0000 7f47f2000640 1 -- 172.21.15.152:0/2535207354 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f47ec15a010 msgr2=0x7f47ec147950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:31.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.785+0000 7f47f2000640 1 --2- 172.21.15.152:0/2535207354 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f47ec15a010 0x7f47ec147950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:31.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.785+0000 7f47f2000640 1 -- 172.21.15.152:0/2535207354 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47ec06fc40 con 0x7f47ec15d710 2024-04-17T08:47:31.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.785+0000 7f47f0c00640 1 --2- 172.21.15.152:0/2535207354 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f47ec15a010 0x7f47ec147950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:47:31.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.785+0000 7f47f1600640 1 --2- 172.21.15.152:0/2535207354 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f47ec0d0a70 0x7f47ec06f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:47:31.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.785+0000 7f47f2000640 1 --2- 172.21.15.152:0/2535207354 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47ec15d710 0x7f47ec1502e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f47e40b0040 tx=0x7f47e40196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:31.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.785+0000 7f47e9600640 1 -- 172.21.15.152:0/2535207354 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e40b2050 con 0x7f47ec15d710 2024-04-17T08:47:31.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.785+0000 7f47e9600640 1 -- 172.21.15.152:0/2535207354 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47e40be070 con 0x7f47ec15d710 2024-04-17T08:47:31.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.785+0000 7f47f4000640 1 -- 172.21.15.152:0/2535207354 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47ec159300 con 0x7f47ec15d710 2024-04-17T08:47:31.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.785+0000 7f47e9600640 1 -- 172.21.15.152:0/2535207354 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e4009450 con 0x7f47ec15d710 2024-04-17T08:47:31.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.785+0000 7f47f4000640 1 -- 172.21.15.152:0/2535207354 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47ec06f960 con 0x7f47ec15d710 2024-04-17T08:47:31.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.785+0000 7f47f4000640 1 -- 172.21.15.152:0/2535207354 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47ec068a30 con 0x7f47ec15d710 2024-04-17T08:47:31.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.785+0000 7f47e9600640 1 -- 172.21.15.152:0/2535207354 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f47e40adca0 con 0x7f47ec15d710 2024-04-17T08:47:31.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.789+0000 7f47e9600640 1 --2- 172.21.15.152:0/2535207354 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f47cc068380 0x7f47cc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:31.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.789+0000 7f47e9600640 1 -- 172.21.15.152:0/2535207354 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f47e4121ed0 con 0x7f47ec15d710 2024-04-17T08:47:31.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.789+0000 7f47f1600640 1 --2- 172.21.15.152:0/2535207354 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f47cc068380 0x7f47cc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:31.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.789+0000 7f47f1600640 1 --2- 172.21.15.152:0/2535207354 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f47cc068380 0x7f47cc06a840 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f47e00016e0 tx=0x7f47e0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:31.795 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.793+0000 7f47e9600640 1 -- 172.21.15.152:0/2535207354 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f47e4016580 con 0x7f47ec15d710 2024-04-17T08:47:31.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.961+0000 7f47f4000640 1 -- 172.21.15.152:0/2535207354 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f47ec06d660 con 0x7f47ec15d710 2024-04-17T08:47:31.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.961+0000 7f47e9600640 1 -- 172.21.15.152:0/2535207354 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f47e40f2180 con 0x7f47ec15d710 2024-04-17T08:47:31.963 INFO:teuthology.orchestra.run.smithi152.stderr:listed 0 entries 2024-04-17T08:47:31.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.961+0000 7f47f4000640 1 -- 172.21.15.152:0/2535207354 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f47cc068380 msgr2=0x7f47cc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:31.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.961+0000 7f47f4000640 1 --2- 172.21.15.152:0/2535207354 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f47cc068380 0x7f47cc06a840 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f47e00016e0 tx=0x7f47e0009040 comp rx=0 tx=0).stop 2024-04-17T08:47:31.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.961+0000 7f47f4000640 1 -- 172.21.15.152:0/2535207354 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47ec15d710 msgr2=0x7f47ec1502e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:31.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.961+0000 7f47f4000640 1 --2- 172.21.15.152:0/2535207354 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47ec15d710 0x7f47ec1502e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f47e40b0040 tx=0x7f47e40196a0 comp rx=0 tx=0).stop 2024-04-17T08:47:31.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.961+0000 7f47f4000640 1 -- 172.21.15.152:0/2535207354 shutdown_connections 2024-04-17T08:47:31.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.961+0000 7f47f4000640 1 --2- 172.21.15.152:0/2535207354 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47ec15d710 0x7f47ec1502e0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:31.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.961+0000 7f47f4000640 1 --2- 172.21.15.152:0/2535207354 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f47ec15a010 0x7f47ec147950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:31.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.961+0000 7f47f4000640 1 --2- 172.21.15.152:0/2535207354 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f47cc068380 0x7f47cc06a840 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:31.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.961+0000 7f47f4000640 1 --2- 172.21.15.152:0/2535207354 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f47ec0d0a70 0x7f47ec06f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:31.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.961+0000 7f47f4000640 1 -- 172.21.15.152:0/2535207354 >> 172.21.15.152:0/2535207354 conn(0x7f47ec0b3350 msgr2=0x7f47ec166ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:31.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.961+0000 7f47f4000640 1 -- 172.21.15.152:0/2535207354 shutdown_connections 2024-04-17T08:47:31.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:31.961+0000 7f47f4000640 1 -- 172.21.15.152:0/2535207354 wait complete. 2024-04-17T08:47:31.983 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi152.front.sepia.ceph.com... 2024-04-17T08:47:31.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:31.984 DEBUG:teuthology.orchestra.run.smithi152:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-17T08:47:32.005 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T08:47:32.005 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi152.front.sepia.ceph.com 2024-04-17T08:47:32.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:32.005 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-17T08:47:32.054 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-17T08:47:32.054 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-17T08:47:32.064 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-17T08:47:32.064 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-17T08:47:32.113 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T08:47:32.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.245+0000 7fa1e4000640 1 Processor -- start 2024-04-17T08:47:32.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.245+0000 7fa1e4000640 1 -- start start 2024-04-17T08:47:32.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.245+0000 7fa1e4000640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa1dc0d07c0 0x7fa1dc0adae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:32.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.245+0000 7fa1e4000640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1dc06e6b0 con 0x7fa1dc161b70 2024-04-17T08:47:32.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.245+0000 7fa1e4000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1dc06e990 con 0x7fa1dc0d0360 2024-04-17T08:47:32.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.245+0000 7fa1e4000640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fa1dc161f50 con 0x7fa1dc0d07c0 2024-04-17T08:47:32.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.245+0000 7fa1e1600640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fa1dc161b70 0x7fa1dc06dc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:60500/0 (socket says 172.21.15.152:60500) 2024-04-17T08:47:32.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.245+0000 7fa1e1600640 1 -- 172.21.15.152:0/1829626829 learned_addr learned my addr 172.21.15.152:0/1829626829 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:32.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.245+0000 7fa1e2000640 1 --2- 172.21.15.152:0/1829626829 >> v2:172.21.15.152:3300/0 conn(0x7fa1dc0d07c0 0x7fa1dc0adae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:32.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.249+0000 7fa1e2000640 1 -- 172.21.15.152:0/1829626829 >> v1:172.21.15.196:6789/0 conn(0x7fa1dc0d0360 legacy=0x7fa1dc0ad3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:32.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.249+0000 7fa1e2000640 1 -- 172.21.15.152:0/1829626829 >> v1:172.21.15.152:6789/0 conn(0x7fa1dc161b70 legacy=0x7fa1dc06dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:32.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.249+0000 7fa1e2000640 1 -- 172.21.15.152:0/1829626829 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1dc06ec70 con 0x7fa1dc0d07c0 2024-04-17T08:47:32.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.249+0000 7fa1e2000640 1 --2- 172.21.15.152:0/1829626829 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1dc0d07c0 0x7fa1dc0adae0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa1d40097c0 tx=0x7fa1d401ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3648c031eb61df6f server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:32.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.249+0000 7fa1dbe00640 1 -- 172.21.15.152:0/1829626829 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d40b0070 con 0x7fa1dc0d07c0 2024-04-17T08:47:32.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.249+0000 7fa1dbe00640 1 -- 172.21.15.152:0/1829626829 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1d40ab600 con 0x7fa1dc0d07c0 2024-04-17T08:47:32.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.249+0000 7fa1dbe00640 1 -- 172.21.15.152:0/1829626829 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d40ab9d0 con 0x7fa1dc0d07c0 2024-04-17T08:47:32.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.249+0000 7fa1e4000640 1 -- 172.21.15.152:0/1829626829 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1dc0d07c0 msgr2=0x7fa1dc0adae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:32.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.249+0000 7fa1e4000640 1 --2- 172.21.15.152:0/1829626829 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1dc0d07c0 0x7fa1dc0adae0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa1d40097c0 tx=0x7fa1d401ce30 comp rx=0 tx=0).stop 2024-04-17T08:47:32.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.249+0000 7fa1e4000640 1 -- 172.21.15.152:0/1829626829 shutdown_connections 2024-04-17T08:47:32.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.249+0000 7fa1e4000640 1 --2- 172.21.15.152:0/1829626829 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1dc0d07c0 0x7fa1dc0adae0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:32.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.249+0000 7fa1e4000640 1 -- 172.21.15.152:0/1829626829 >> 172.21.15.152:0/1829626829 conn(0x7fa1dc0b3350 msgr2=0x7fa1dc0b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:32.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.249+0000 7fa1e4000640 1 -- 172.21.15.152:0/1829626829 shutdown_connections 2024-04-17T08:47:32.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.249+0000 7fa1e4000640 1 -- 172.21.15.152:0/1829626829 wait complete. 2024-04-17T08:47:32.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.253+0000 7fa1e4000640 1 Processor -- start 2024-04-17T08:47:32.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.253+0000 7fa1e4000640 1 -- start start 2024-04-17T08:47:32.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.253+0000 7fa1e4000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa1dc0d0360 0x7fa1dc15f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:32.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.253+0000 7fa1e4000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa1dc0d07c0 0x7fa1dc14ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:32.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.253+0000 7fa1e4000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1dc161b70 0x7fa1dc14b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:32.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.253+0000 7fa1e4000640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa1dc071ef0 con 0x7fa1dc161b70 2024-04-17T08:47:32.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.253+0000 7fa1e4000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa1dc071d70 con 0x7fa1dc0d07c0 2024-04-17T08:47:32.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.253+0000 7fa1e4000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fa1dc16c1d0 con 0x7fa1dc0d0360 2024-04-17T08:47:32.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.253+0000 7fa1e2000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1dc161b70 0x7fa1dc14b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:32.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.253+0000 7fa1e2000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1dc161b70 0x7fa1dc14b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33020/0 (socket says 172.21.15.152:33020) 2024-04-17T08:47:32.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.253+0000 7fa1e2000640 1 -- 172.21.15.152:0/2768411658 learned_addr learned my addr 172.21.15.152:0/2768411658 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:32.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.253+0000 7fa1e0c00640 1 --2- 172.21.15.152:0/2768411658 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa1dc0d07c0 0x7fa1dc14ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:32.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.253+0000 7fa1e1600640 1 --2- 172.21.15.152:0/2768411658 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa1dc0d0360 0x7fa1dc15f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:32.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.253+0000 7fa1e2000640 1 -- 172.21.15.152:0/2768411658 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa1dc0d0360 msgr2=0x7fa1dc15f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:32.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.253+0000 7fa1e2000640 1 --2- 172.21.15.152:0/2768411658 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa1dc0d0360 0x7fa1dc15f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:32.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.253+0000 7fa1e2000640 1 -- 172.21.15.152:0/2768411658 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa1dc0d07c0 msgr2=0x7fa1dc14ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:32.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.253+0000 7fa1e2000640 1 --2- 172.21.15.152:0/2768411658 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa1dc0d07c0 0x7fa1dc14ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:32.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.253+0000 7fa1e2000640 1 -- 172.21.15.152:0/2768411658 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1dc1567b0 con 0x7fa1dc161b70 2024-04-17T08:47:32.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.253+0000 7fa1e2000640 1 --2- 172.21.15.152:0/2768411658 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1dc161b70 0x7fa1dc14b2f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa1d40ae040 tx=0x7fa1dc0ae830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:32.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.253+0000 7fa1d9600640 1 -- 172.21.15.152:0/2768411658 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d40b8020 con 0x7fa1dc161b70 2024-04-17T08:47:32.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.253+0000 7fa1d9600640 1 -- 172.21.15.152:0/2768411658 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1d40b4410 con 0x7fa1dc161b70 2024-04-17T08:47:32.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.253+0000 7fa1e4000640 1 -- 172.21.15.152:0/2768411658 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1dc156a90 con 0x7fa1dc161b70 2024-04-17T08:47:32.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.253+0000 7fa1d9600640 1 -- 172.21.15.152:0/2768411658 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d40b0040 con 0x7fa1dc161b70 2024-04-17T08:47:32.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.253+0000 7fa1e4000640 1 -- 172.21.15.152:0/2768411658 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1dc157050 con 0x7fa1dc161b70 2024-04-17T08:47:32.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.257+0000 7fa1e4000640 1 -- 172.21.15.152:0/2768411658 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1dc068a30 con 0x7fa1dc161b70 2024-04-17T08:47:32.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.257+0000 7fa1d9600640 1 -- 172.21.15.152:0/2768411658 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa1d40bb020 con 0x7fa1dc161b70 2024-04-17T08:47:32.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.257+0000 7fa1d9600640 1 --2- 172.21.15.152:0/2768411658 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fa1bc068380 0x7fa1bc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:32.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.257+0000 7fa1d9600640 1 -- 172.21.15.152:0/2768411658 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fa1d4120a10 con 0x7fa1dc161b70 2024-04-17T08:47:32.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.257+0000 7fa1e1600640 1 --2- 172.21.15.152:0/2768411658 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fa1bc068380 0x7fa1bc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:32.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.257+0000 7fa1e1600640 1 --2- 172.21.15.152:0/2768411658 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fa1bc068380 0x7fa1bc06a840 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa1d00012f0 tx=0x7fa1d0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:32.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.261+0000 7fa1d9600640 1 -- 172.21.15.152:0/2768411658 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fa1d40c2030 con 0x7fa1dc161b70 2024-04-17T08:47:32.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.421+0000 7fa1e4000640 1 -- 172.21.15.152:0/2768411658 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa1dc14e2a0 con 0x7fa1dc161b70 2024-04-17T08:47:32.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.421+0000 7fa1d9600640 1 -- 172.21.15.152:0/2768411658 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18972 (secure 0 0 0) 0x7fa1d4016050 con 0x7fa1dc161b70 2024-04-17T08:47:32.425 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:47:32.425 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":26,"fsid":"ce68f82e-ec5f-4205-9fd5-bdfdf6ef31e2","created":"2024-04-17T08:46:08.353546+0000","modified":"2024-04-17T08:47:15.280634+0000","last_up_change":"2024-04-17T08:46:20.738799+0000","last_in_change":"2024-04-17T08:46:11.210050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T08:46:21.386856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T08:46:31.812460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T08:46:32.555559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T08:46:36.258078+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"682f0192-187c-404e-bc7a-b6b4e23825e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6819","nonce":3603799291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6823","nonce":3603799291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6831","nonce":3603799291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6827","nonce":3603799291}]},"public_addr":"172.21.15.152:6819/3603799291","cluster_addr":"172.21.15.152:6823/3603799291","heartbeat_back_addr":"172.21.15.152:6831/3603799291","heartbeat_front_addr":"172.21.15.152:6827/3603799291","state":["exists","up"]},{"osd":1,"uuid":"f0fe8fef-60ec-4a39-83b6-2fa6a5adb0f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6801","nonce":4133383142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6803","nonce":4133383142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6807","nonce":4133383142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6805","nonce":4133383142}]},"public_addr":"172.21.15.152:6801/4133383142","cluster_addr":"172.21.15.152:6803/4133383142","heartbeat_back_addr":"172.21.15.152:6807/4133383142","heartbeat_front_addr":"172.21.15.152:6805/4133383142","state":["exists","up"]},{"osd":2,"uuid":"35f36d9c-5245-4431-a618-f4df0fa380ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6809","nonce":3826143898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6811","nonce":3826143898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6815","nonce":3826143898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6813","nonce":3826143898}]},"public_addr":"172.21.15.152:6809/3826143898","cluster_addr":"172.21.15.152:6811/3826143898","heartbeat_back_addr":"172.21.15.152:6815/3826143898","heartbeat_front_addr":"172.21.15.152:6813/3826143898","state":["exists","up"]},{"osd":3,"uuid":"96e56ca5-15b4-4895-9b79-da2c92043159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6818","nonce":165717826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6822","nonce":165717826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6830","nonce":165717826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6826","nonce":165717826}]},"public_addr":"172.21.15.152:6818/165717826","cluster_addr":"172.21.15.152:6822/165717826","heartbeat_back_addr":"172.21.15.152:6830/165717826","heartbeat_front_addr":"172.21.15.152:6826/165717826","state":["exists","up"]},{"osd":4,"uuid":"f5aa10a4-9ff9-41fe-a5c9-15326f982cc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6817","nonce":4080159297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6819","nonce":4080159297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6823","nonce":4080159297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6821","nonce":4080159297}]},"public_addr":"172.21.15.196:6817/4080159297","cluster_addr":"172.21.15.196:6819/4080159297","heartbeat_back_addr":"172.21.15.196:6823/4080159297","heartbeat_front_addr":"172.21.15.196:6821/4080159297","state":["exists","up"]},{"osd":5,"uuid":"42bab884-3476-47ae-ac65-935fa6e0f055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6801","nonce":3519444232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6803","nonce":3519444232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6807","nonce":3519444232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6805","nonce":3519444232}]},"public_addr":"172.21.15.196:6801/3519444232","cluster_addr":"172.21.15.196:6803/3519444232","heartbeat_back_addr":"172.21.15.196:6807/3519444232","heartbeat_front_addr":"172.21.15.196:6805/3519444232","state":["exists","up"]},{"osd":6,"uuid":"460b6167-f57b-4224-9c92-cfc9b80bbe99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6809","nonce":275739834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6811","nonce":275739834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6815","nonce":275739834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6813","nonce":275739834}]},"public_addr":"172.21.15.196:6809/275739834","cluster_addr":"172.21.15.196:6811/275739834","heartbeat_back_addr":"172.21.15.196:6815/275739834","heartbeat_front_addr":"172.21.15.196:6813/275739834","state":["exists","up"]},{"osd":7,"uuid":"d695643f-5e07-4e2a-a646-c06bd97b6650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6825","nonce":307626968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6827","nonce":307626968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6831","nonce":307626968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6829","nonce":307626968}]},"public_addr":"172.21.15.196:6825/307626968","cluster_addr":"172.21.15.196:6827/307626968","heartbeat_back_addr":"172.21.15.196:6831/307626968","heartbeat_front_addr":"172.21.15.196:6829/307626968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.293257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.964533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.248895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.010000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.832554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.743704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930171+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930962+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T08:47:32.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.425+0000 7fa1e4000640 1 -- 172.21.15.152:0/2768411658 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fa1bc068380 msgr2=0x7fa1bc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:32.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.425+0000 7fa1e4000640 1 --2- 172.21.15.152:0/2768411658 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fa1bc068380 0x7fa1bc06a840 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa1d00012f0 tx=0x7fa1d0009040 comp rx=0 tx=0).stop 2024-04-17T08:47:32.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.425+0000 7fa1e4000640 1 -- 172.21.15.152:0/2768411658 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1dc161b70 msgr2=0x7fa1dc14b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:32.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.425+0000 7fa1e4000640 1 --2- 172.21.15.152:0/2768411658 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1dc161b70 0x7fa1dc14b2f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa1d40ae040 tx=0x7fa1dc0ae830 comp rx=0 tx=0).stop 2024-04-17T08:47:32.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.425+0000 7fa1e4000640 1 -- 172.21.15.152:0/2768411658 shutdown_connections 2024-04-17T08:47:32.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.425+0000 7fa1e4000640 1 --2- 172.21.15.152:0/2768411658 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1dc161b70 0x7fa1dc14b2f0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:32.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.425+0000 7fa1e4000640 1 --2- 172.21.15.152:0/2768411658 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa1dc0d07c0 0x7fa1dc14ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:32.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.425+0000 7fa1e4000640 1 --2- 172.21.15.152:0/2768411658 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fa1bc068380 0x7fa1bc06a840 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:32.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.425+0000 7fa1e4000640 1 --2- 172.21.15.152:0/2768411658 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa1dc0d0360 0x7fa1dc15f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:32.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.425+0000 7fa1e4000640 1 -- 172.21.15.152:0/2768411658 >> 172.21.15.152:0/2768411658 conn(0x7fa1dc0b3350 msgr2=0x7fa1dc15cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:32.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.425+0000 7fa1e4000640 1 -- 172.21.15.152:0/2768411658 shutdown_connections 2024-04-17T08:47:32.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.425+0000 7fa1e4000640 1 -- 172.21.15.152:0/2768411658 wait complete. 2024-04-17T08:47:32.446 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T08:46:21.386856+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-17T08:46:31.812460+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-17T08:46:32.555559+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-17T08:46:36.258078+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-17T08:47:32.446 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T08:47:32.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.581+0000 7fac61800640 1 Processor -- start 2024-04-17T08:47:32.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.581+0000 7fac61800640 1 -- start start 2024-04-17T08:47:32.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.581+0000 7fac61800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fac5c147f70 0x7fac5c071790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:32.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.581+0000 7fac61800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fac5c071cd0 0x7fac5c0d0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:32.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.581+0000 7fac61800640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac5c06db40 con 0x7fac5c0d1d00 2024-04-17T08:47:32.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.581+0000 7fac61800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fac5c06de20 con 0x7fac5c071cd0 2024-04-17T08:47:32.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.581+0000 7fac61800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fac5c06e100 con 0x7fac5c147f70 2024-04-17T08:47:32.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.585+0000 7fac5aa00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fac5c0d1d00 0x7fac5c06d350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:60508/0 (socket says 172.21.15.152:60508) 2024-04-17T08:47:32.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.585+0000 7fac5aa00640 1 -- 172.21.15.152:0/3696214697 learned_addr learned my addr 172.21.15.152:0/3696214697 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:32.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.585+0000 7fac5b400640 1 --2- 172.21.15.152:0/3696214697 >> v2:172.21.15.196:3300/0 conn(0x7fac5c071cd0 0x7fac5c0d0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:32.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.585+0000 7fac5a000640 1 --2- 172.21.15.152:0/3696214697 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fac5c147f70 0x7fac5c071790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:32.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.585+0000 7fac59600640 1 -- 172.21.15.152:0/3696214697 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1215624397 0 0) 0x7fac5c06db40 con 0x7fac5c0d1d00 2024-04-17T08:47:32.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.585+0000 7fac59600640 1 -- 172.21.15.152:0/3696214697 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac40003530 con 0x7fac5c0d1d00 2024-04-17T08:47:32.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.585+0000 7fac5a000640 1 -- 172.21.15.152:0/3696214697 >> v2:172.21.15.196:3300/0 conn(0x7fac5c071cd0 msgr2=0x7fac5c0d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:32.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.585+0000 7fac5a000640 1 --2- 172.21.15.152:0/3696214697 >> v2:172.21.15.196:3300/0 conn(0x7fac5c071cd0 0x7fac5c0d0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:32.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.585+0000 7fac5a000640 1 -- 172.21.15.152:0/3696214697 >> v1:172.21.15.152:6789/0 conn(0x7fac5c0d1d00 legacy=0x7fac5c06d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:32.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.585+0000 7fac5a000640 1 -- 172.21.15.152:0/3696214697 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac5c06e3e0 con 0x7fac5c147f70 2024-04-17T08:47:32.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.585+0000 7fac5b400640 1 --2- 172.21.15.152:0/3696214697 >> v2:172.21.15.196:3300/0 conn(0x7fac5c071cd0 0x7fac5c0d0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T08:47:32.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.585+0000 7fac5a000640 1 --2- 172.21.15.152:0/3696214697 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fac5c147f70 0x7fac5c071790 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fac4c0097c0 tx=0x7fac4c01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=211f7f2db12fb0ed server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:32.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.585+0000 7fac59600640 1 -- 172.21.15.152:0/3696214697 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac4c0b1070 con 0x7fac5c147f70 2024-04-17T08:47:32.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.585+0000 7fac59600640 1 -- 172.21.15.152:0/3696214697 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac4c0ac410 con 0x7fac5c147f70 2024-04-17T08:47:32.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.585+0000 7fac59600640 1 -- 172.21.15.152:0/3696214697 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac4c0ac7e0 con 0x7fac5c147f70 2024-04-17T08:47:32.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.589+0000 7fac61800640 1 -- 172.21.15.152:0/3696214697 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fac5c147f70 msgr2=0x7fac5c071790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:32.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.589+0000 7fac61800640 1 --2- 172.21.15.152:0/3696214697 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fac5c147f70 0x7fac5c071790 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fac4c0097c0 tx=0x7fac4c01c4a0 comp rx=0 tx=0).stop 2024-04-17T08:47:32.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.589+0000 7fac61800640 1 -- 172.21.15.152:0/3696214697 shutdown_connections 2024-04-17T08:47:32.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.589+0000 7fac61800640 1 --2- 172.21.15.152:0/3696214697 >> v2:172.21.15.196:3300/0 conn(0x7fac5c071cd0 0x7fac5c0d0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:32.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.589+0000 7fac61800640 1 --2- 172.21.15.152:0/3696214697 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fac5c147f70 0x7fac5c071790 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:32.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.589+0000 7fac61800640 1 -- 172.21.15.152:0/3696214697 >> 172.21.15.152:0/3696214697 conn(0x7fac5c0d2350 msgr2=0x7fac5c0d2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:32.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.589+0000 7fac61800640 1 -- 172.21.15.152:0/3696214697 shutdown_connections 2024-04-17T08:47:32.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.589+0000 7fac61800640 1 -- 172.21.15.152:0/3696214697 wait complete. 2024-04-17T08:47:32.592 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.589+0000 7fac61800640 1 Processor -- start 2024-04-17T08:47:32.592 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.589+0000 7fac61800640 1 -- start start 2024-04-17T08:47:32.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.589+0000 7fac61800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fac5c071cd0 0x7fac5c0c9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:32.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.589+0000 7fac61800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fac5c0d1d00 0x7fac5c1427c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:32.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.589+0000 7fac61800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fac5c147f70 0x7fac5c13f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:32.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.589+0000 7fac61800640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fac5c0d0fa0 con 0x7fac5c071cd0 2024-04-17T08:47:32.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.589+0000 7fac61800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fac5c0720e0 con 0x7fac5c147f70 2024-04-17T08:47:32.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.589+0000 7fac61800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fac5c0d1120 con 0x7fac5c0d1d00 2024-04-17T08:47:32.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.589+0000 7fac5aa00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fac5c071cd0 0x7fac5c0c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:32.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.589+0000 7fac5aa00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fac5c071cd0 0x7fac5c0c9420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33036/0 (socket says 172.21.15.152:33036) 2024-04-17T08:47:32.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.589+0000 7fac5aa00640 1 -- 172.21.15.152:0/4019829914 learned_addr learned my addr 172.21.15.152:0/4019829914 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:32.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.589+0000 7fac5a000640 1 --2- 172.21.15.152:0/4019829914 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fac5c0d1d00 0x7fac5c1427c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:32.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.589+0000 7fac5b400640 1 --2- 172.21.15.152:0/4019829914 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fac5c147f70 0x7fac5c13f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:32.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.589+0000 7fac5aa00640 1 -- 172.21.15.152:0/4019829914 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fac5c0d1d00 msgr2=0x7fac5c1427c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:32.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.589+0000 7fac5aa00640 1 --2- 172.21.15.152:0/4019829914 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fac5c0d1d00 0x7fac5c1427c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:32.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.589+0000 7fac5aa00640 1 -- 172.21.15.152:0/4019829914 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fac5c147f70 msgr2=0x7fac5c13f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:32.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.589+0000 7fac5aa00640 1 --2- 172.21.15.152:0/4019829914 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fac5c147f70 0x7fac5c13f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:32.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.589+0000 7fac5aa00640 1 -- 172.21.15.152:0/4019829914 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac5c0c9ab0 con 0x7fac5c071cd0 2024-04-17T08:47:32.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.593+0000 7fac5aa00640 1 --2- 172.21.15.152:0/4019829914 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fac5c071cd0 0x7fac5c0c9420 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fac4400c450 tx=0x7fac4400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:32.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.593+0000 7fac52a00640 1 -- 172.21.15.152:0/4019829914 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac44017070 con 0x7fac5c071cd0 2024-04-17T08:47:32.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.593+0000 7fac52a00640 1 -- 172.21.15.152:0/4019829914 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac44005cf0 con 0x7fac5c071cd0 2024-04-17T08:47:32.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.593+0000 7fac52a00640 1 -- 172.21.15.152:0/4019829914 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac440072f0 con 0x7fac5c071cd0 2024-04-17T08:47:32.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.593+0000 7fac61800640 1 -- 172.21.15.152:0/4019829914 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac5c140a00 con 0x7fac5c071cd0 2024-04-17T08:47:32.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.593+0000 7fac61800640 1 -- 172.21.15.152:0/4019829914 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac5c0b7eb0 con 0x7fac5c071cd0 2024-04-17T08:47:32.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.593+0000 7fac61800640 1 -- 172.21.15.152:0/4019829914 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac5c068a30 con 0x7fac5c071cd0 2024-04-17T08:47:32.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.593+0000 7fac52a00640 1 -- 172.21.15.152:0/4019829914 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fac4401a070 con 0x7fac5c071cd0 2024-04-17T08:47:32.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.593+0000 7fac52a00640 1 --2- 172.21.15.152:0/4019829914 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fac38068380 0x7fac3806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:32.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.593+0000 7fac52a00640 1 -- 172.21.15.152:0/4019829914 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fac440861c0 con 0x7fac5c071cd0 2024-04-17T08:47:32.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.593+0000 7fac5a000640 1 --2- 172.21.15.152:0/4019829914 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fac38068380 0x7fac3806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:32.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.597+0000 7fac5a000640 1 --2- 172.21.15.152:0/4019829914 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fac38068380 0x7fac3806a840 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fac4c0ae000 tx=0x7fac4c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:32.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.597+0000 7fac52a00640 1 -- 172.21.15.152:0/4019829914 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fac5c0c9ab0 con 0x7fac5c071cd0 2024-04-17T08:47:32.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.753+0000 7fac61800640 1 -- 172.21.15.152:0/4019829914 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fac5c0b3690 con 0x7fac5c071cd0 2024-04-17T08:47:32.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.753+0000 7fac52a00640 1 -- 172.21.15.152:0/4019829914 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7fac44055c70 con 0x7fac5c071cd0 2024-04-17T08:47:32.757 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2024-04-17T08:47:32.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.757+0000 7fac61800640 1 -- 172.21.15.152:0/4019829914 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fac38068380 msgr2=0x7fac3806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:32.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.757+0000 7fac61800640 1 --2- 172.21.15.152:0/4019829914 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fac38068380 0x7fac3806a840 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fac4c0ae000 tx=0x7fac4c008040 comp rx=0 tx=0).stop 2024-04-17T08:47:32.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.757+0000 7fac61800640 1 -- 172.21.15.152:0/4019829914 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fac5c071cd0 msgr2=0x7fac5c0c9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:32.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.757+0000 7fac61800640 1 --2- 172.21.15.152:0/4019829914 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fac5c071cd0 0x7fac5c0c9420 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fac4400c450 tx=0x7fac4400c850 comp rx=0 tx=0).stop 2024-04-17T08:47:32.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.757+0000 7fac61800640 1 -- 172.21.15.152:0/4019829914 shutdown_connections 2024-04-17T08:47:32.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.757+0000 7fac61800640 1 --2- 172.21.15.152:0/4019829914 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fac5c147f70 0x7fac5c13f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:32.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.757+0000 7fac61800640 1 --2- 172.21.15.152:0/4019829914 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fac38068380 0x7fac3806a840 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:32.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.757+0000 7fac61800640 1 --2- 172.21.15.152:0/4019829914 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fac5c0d1d00 0x7fac5c1427c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:32.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.757+0000 7fac61800640 1 --2- 172.21.15.152:0/4019829914 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fac5c071cd0 0x7fac5c0c9420 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:32.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.757+0000 7fac61800640 1 -- 172.21.15.152:0/4019829914 >> 172.21.15.152:0/4019829914 conn(0x7fac5c0d2350 msgr2=0x7fac5c0d2730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:32.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.757+0000 7fac61800640 1 -- 172.21.15.152:0/4019829914 shutdown_connections 2024-04-17T08:47:32.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.757+0000 7fac61800640 1 -- 172.21.15.152:0/4019829914 wait complete. 2024-04-17T08:47:32.777 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-17T08:47:32.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.913+0000 7ff527c00640 1 Processor -- start 2024-04-17T08:47:32.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.913+0000 7ff527c00640 1 -- start start 2024-04-17T08:47:32.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.913+0000 7ff527c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5200af670 0x7ff52015b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:32.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.913+0000 7ff527c00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff5200d0360 0x7ff5200d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:32.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.913+0000 7ff527c00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff520072c40 con 0x7ff52006f980 2024-04-17T08:47:32.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.913+0000 7ff527c00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7ff52015c820 con 0x7ff5200d0360 2024-04-17T08:47:32.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.913+0000 7ff527c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7ff52015c260 con 0x7ff5200af670 2024-04-17T08:47:32.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.913+0000 7ff525c00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff5200d0360 0x7ff5200d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:32.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.913+0000 7ff525c00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff5200d0360 0x7ff5200d07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33040/0 (socket says 172.21.15.152:33040) 2024-04-17T08:47:32.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.913+0000 7ff517e00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7ff52006f980 0x7ff520072530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:60518/0 (socket says 172.21.15.152:60518) 2024-04-17T08:47:32.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.913+0000 7ff525c00640 1 -- 172.21.15.152:0/2159459124 learned_addr learned my addr 172.21.15.152:0/2159459124 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:32.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.913+0000 7ff525200640 1 --2- 172.21.15.152:0/2159459124 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5200af670 0x7ff52015b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:32.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.913+0000 7ff525c00640 1 -- 172.21.15.152:0/2159459124 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5200af670 msgr2=0x7ff52015b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:32.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.913+0000 7ff525c00640 1 --2- 172.21.15.152:0/2159459124 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5200af670 0x7ff52015b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:32.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.913+0000 7ff525c00640 1 -- 172.21.15.152:0/2159459124 >> v1:172.21.15.152:6789/0 conn(0x7ff52006f980 legacy=0x7ff520072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:32.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.913+0000 7ff525c00640 1 -- 172.21.15.152:0/2159459124 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff52015c540 con 0x7ff5200d0360 2024-04-17T08:47:32.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.917+0000 7ff525c00640 1 --2- 172.21.15.152:0/2159459124 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5200d0360 0x7ff5200d07f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff518009e50 tx=0x7ff51801ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=174ccfb10a7bf5b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:32.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.917+0000 7ff51fe00640 1 -- 172.21.15.152:0/2159459124 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5180a7970 con 0x7ff5200d0360 2024-04-17T08:47:32.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.917+0000 7ff51fe00640 1 -- 172.21.15.152:0/2159459124 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5180a7b10 con 0x7ff5200d0360 2024-04-17T08:47:32.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.917+0000 7ff51fe00640 1 -- 172.21.15.152:0/2159459124 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5180af3f0 con 0x7ff5200d0360 2024-04-17T08:47:32.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.917+0000 7ff527c00640 1 -- 172.21.15.152:0/2159459124 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5200d0360 msgr2=0x7ff5200d07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:32.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.917+0000 7ff527c00640 1 --2- 172.21.15.152:0/2159459124 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5200d0360 0x7ff5200d07f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff518009e50 tx=0x7ff51801ebb0 comp rx=0 tx=0).stop 2024-04-17T08:47:32.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.917+0000 7ff527c00640 1 -- 172.21.15.152:0/2159459124 shutdown_connections 2024-04-17T08:47:32.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.917+0000 7ff527c00640 1 --2- 172.21.15.152:0/2159459124 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5200d0360 0x7ff5200d07f0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:32.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.917+0000 7ff527c00640 1 --2- 172.21.15.152:0/2159459124 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5200af670 0x7ff52015b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:32.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.917+0000 7ff527c00640 1 -- 172.21.15.152:0/2159459124 >> 172.21.15.152:0/2159459124 conn(0x7ff5200b3350 msgr2=0x7ff5200b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:32.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.917+0000 7ff527c00640 1 -- 172.21.15.152:0/2159459124 shutdown_connections 2024-04-17T08:47:32.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.917+0000 7ff527c00640 1 -- 172.21.15.152:0/2159459124 wait complete. 2024-04-17T08:47:32.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.921+0000 7ff527c00640 1 Processor -- start 2024-04-17T08:47:32.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.921+0000 7ff527c00640 1 -- start start 2024-04-17T08:47:32.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.921+0000 7ff527c00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff52006f980 0x7ff520164660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:32.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.921+0000 7ff527c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5200af670 0x7ff5201495a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:32.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.921+0000 7ff527c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5200d0360 0x7ff520149ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:32.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.921+0000 7ff527c00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff52015bf80 con 0x7ff52006f980 2024-04-17T08:47:32.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.921+0000 7ff527c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff52015be00 con 0x7ff5200af670 2024-04-17T08:47:32.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.921+0000 7ff527c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7ff52006b9b0 con 0x7ff5200d0360 2024-04-17T08:47:32.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.921+0000 7ff525200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff52006f980 0x7ff520164660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:32.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.921+0000 7ff525200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff52006f980 0x7ff520164660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33056/0 (socket says 172.21.15.152:33056) 2024-04-17T08:47:32.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.921+0000 7ff525200640 1 -- 172.21.15.152:0/1338724722 learned_addr learned my addr 172.21.15.152:0/1338724722 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:32.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.921+0000 7ff525c00640 1 --2- 172.21.15.152:0/1338724722 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5200d0360 0x7ff520149ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:32.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.921+0000 7ff517e00640 1 --2- 172.21.15.152:0/1338724722 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5200af670 0x7ff5201495a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:32.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.921+0000 7ff525200640 1 -- 172.21.15.152:0/1338724722 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5200d0360 msgr2=0x7ff520149ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:32.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.921+0000 7ff525200640 1 --2- 172.21.15.152:0/1338724722 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5200d0360 0x7ff520149ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:32.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.921+0000 7ff525200640 1 -- 172.21.15.152:0/1338724722 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5200af670 msgr2=0x7ff5201495a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:32.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.921+0000 7ff525200640 1 --2- 172.21.15.152:0/1338724722 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5200af670 0x7ff5201495a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:32.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.921+0000 7ff525200640 1 -- 172.21.15.152:0/1338724722 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff52014f1e0 con 0x7ff52006f980 2024-04-17T08:47:32.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.921+0000 7ff525200640 1 --2- 172.21.15.152:0/1338724722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff52006f980 0x7ff520164660 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff51000d830 tx=0x7ff51000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:32.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.921+0000 7ff51d600640 1 -- 172.21.15.152:0/1338724722 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff51000b6c0 con 0x7ff52006f980 2024-04-17T08:47:32.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.921+0000 7ff51d600640 1 -- 172.21.15.152:0/1338724722 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff510019070 con 0x7ff52006f980 2024-04-17T08:47:32.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.921+0000 7ff51d600640 1 -- 172.21.15.152:0/1338724722 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff51000ba60 con 0x7ff52006f980 2024-04-17T08:47:32.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.921+0000 7ff527c00640 1 -- 172.21.15.152:0/1338724722 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff520155b80 con 0x7ff52006f980 2024-04-17T08:47:32.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.921+0000 7ff527c00640 1 -- 172.21.15.152:0/1338724722 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5201558a0 con 0x7ff52006f980 2024-04-17T08:47:32.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.925+0000 7ff527c00640 1 -- 172.21.15.152:0/1338724722 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff520153fc0 con 0x7ff52006f980 2024-04-17T08:47:32.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.925+0000 7ff51d600640 1 -- 172.21.15.152:0/1338724722 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff51001e460 con 0x7ff52006f980 2024-04-17T08:47:32.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.925+0000 7ff51d600640 1 --2- 172.21.15.152:0/1338724722 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7ff4fc068380 0x7ff4fc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:32.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.925+0000 7ff51d600640 1 -- 172.21.15.152:0/1338724722 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7ff5100874b0 con 0x7ff52006f980 2024-04-17T08:47:32.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.925+0000 7ff517e00640 1 --2- 172.21.15.152:0/1338724722 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7ff4fc068380 0x7ff4fc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:32.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.925+0000 7ff517e00640 1 --2- 172.21.15.152:0/1338724722 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7ff4fc068380 0x7ff4fc06a840 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff52014e380 tx=0x7ff508007cd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:32.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:32.929+0000 7ff51d600640 1 -- 172.21.15.152:0/1338724722 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7ff520153fc0 con 0x7ff52006f980 2024-04-17T08:47:33.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.085+0000 7ff527c00640 1 -- 172.21.15.152:0/1338724722 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff520068a30 con 0x7ff52006f980 2024-04-17T08:47:33.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.085+0000 7ff51d600640 1 -- 172.21.15.152:0/1338724722 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7ff52014f1e0 con 0x7ff52006f980 2024-04-17T08:47:33.090 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-04-17T08:47:33.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.089+0000 7ff527c00640 1 -- 172.21.15.152:0/1338724722 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7ff4fc068380 msgr2=0x7ff4fc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:33.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.089+0000 7ff527c00640 1 --2- 172.21.15.152:0/1338724722 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7ff4fc068380 0x7ff4fc06a840 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff52014e380 tx=0x7ff508007cd0 comp rx=0 tx=0).stop 2024-04-17T08:47:33.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.089+0000 7ff527c00640 1 -- 172.21.15.152:0/1338724722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff52006f980 msgr2=0x7ff520164660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:33.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.089+0000 7ff527c00640 1 --2- 172.21.15.152:0/1338724722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff52006f980 0x7ff520164660 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff51000d830 tx=0x7ff51000dcf0 comp rx=0 tx=0).stop 2024-04-17T08:47:33.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.089+0000 7ff527c00640 1 -- 172.21.15.152:0/1338724722 shutdown_connections 2024-04-17T08:47:33.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.089+0000 7ff527c00640 1 --2- 172.21.15.152:0/1338724722 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7ff4fc068380 0x7ff4fc06a840 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:33.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.089+0000 7ff527c00640 1 --2- 172.21.15.152:0/1338724722 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5200d0360 0x7ff520149ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:33.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.089+0000 7ff527c00640 1 --2- 172.21.15.152:0/1338724722 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5200af670 0x7ff5201495a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:33.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.089+0000 7ff527c00640 1 --2- 172.21.15.152:0/1338724722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff52006f980 0x7ff520164660 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:33.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.089+0000 7ff527c00640 1 -- 172.21.15.152:0/1338724722 >> 172.21.15.152:0/1338724722 conn(0x7ff5200b3350 msgr2=0x7ff52006e830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:33.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.089+0000 7ff527c00640 1 -- 172.21.15.152:0/1338724722 shutdown_connections 2024-04-17T08:47:33.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.089+0000 7ff527c00640 1 -- 172.21.15.152:0/1338724722 wait complete. 2024-04-17T08:47:33.110 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-17T08:47:33.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.245+0000 7f9ff0200640 1 Processor -- start 2024-04-17T08:47:33.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.245+0000 7f9ff0200640 1 -- start start 2024-04-17T08:47:33.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.249+0000 7f9ff0200640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f9fe806f980 0x7f9fe8072530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:33.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.249+0000 7f9ff0200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f9fe80d0360 0x7f9fe80d07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:33.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.249+0000 7f9ff0200640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fe815bfd0 con 0x7f9fe80af670 2024-04-17T08:47:33.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.249+0000 7f9ff0200640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f9fe80d0cf0 con 0x7f9fe806f980 2024-04-17T08:47:33.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.249+0000 7f9ff0200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f9fe815c820 con 0x7f9fe80d0360 2024-04-17T08:47:33.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.249+0000 7f9fece00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f9fe806f980 0x7f9fe8072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:33.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.249+0000 7f9fece00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f9fe806f980 0x7f9fe8072530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33072/0 (socket says 172.21.15.152:33072) 2024-04-17T08:47:33.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.249+0000 7f9fece00640 1 -- 172.21.15.152:0/801055756 learned_addr learned my addr 172.21.15.152:0/801055756 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:33.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.249+0000 7f9fee200640 1 --2- 172.21.15.152:0/801055756 >> v2:172.21.15.196:3300/0 conn(0x7f9fe80d0360 0x7f9fe80d07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:33.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.249+0000 7f9fece00640 1 -- 172.21.15.152:0/801055756 >> v2:172.21.15.196:3300/0 conn(0x7f9fe80d0360 msgr2=0x7f9fe80d07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:33.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.249+0000 7f9fece00640 1 --2- 172.21.15.152:0/801055756 >> v2:172.21.15.196:3300/0 conn(0x7f9fe80d0360 0x7f9fe80d07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:33.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.249+0000 7f9fece00640 1 -- 172.21.15.152:0/801055756 >> v1:172.21.15.152:6789/0 conn(0x7f9fe80af670 legacy=0x7f9fe815b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:33.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.249+0000 7f9fece00640 1 -- 172.21.15.152:0/801055756 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fe815c260 con 0x7f9fe806f980 2024-04-17T08:47:33.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.249+0000 7f9fece00640 1 --2- 172.21.15.152:0/801055756 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9fe806f980 0x7f9fe8072530 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9fe806d680 tx=0x7f9fd401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6819d5d2cfe4395f server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:33.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.249+0000 7f9fe7e00640 1 -- 172.21.15.152:0/801055756 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd40ab660 con 0x7f9fe806f980 2024-04-17T08:47:33.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.249+0000 7f9fe7e00640 1 -- 172.21.15.152:0/801055756 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fd40b0070 con 0x7f9fe806f980 2024-04-17T08:47:33.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.249+0000 7f9fe7e00640 1 -- 172.21.15.152:0/801055756 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd40aba20 con 0x7f9fe806f980 2024-04-17T08:47:33.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.253+0000 7f9ff0200640 1 -- 172.21.15.152:0/801055756 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9fe806f980 msgr2=0x7f9fe8072530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:33.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.253+0000 7f9ff0200640 1 --2- 172.21.15.152:0/801055756 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9fe806f980 0x7f9fe8072530 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9fe806d680 tx=0x7f9fd401c460 comp rx=0 tx=0).stop 2024-04-17T08:47:33.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.253+0000 7f9ff0200640 1 -- 172.21.15.152:0/801055756 shutdown_connections 2024-04-17T08:47:33.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.253+0000 7f9ff0200640 1 --2- 172.21.15.152:0/801055756 >> v2:172.21.15.196:3300/0 conn(0x7f9fe80d0360 0x7f9fe80d07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:33.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.253+0000 7f9ff0200640 1 --2- 172.21.15.152:0/801055756 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9fe806f980 0x7f9fe8072530 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:33.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.253+0000 7f9ff0200640 1 -- 172.21.15.152:0/801055756 >> 172.21.15.152:0/801055756 conn(0x7f9fe80b3350 msgr2=0x7f9fe80b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:33.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.253+0000 7f9ff0200640 1 -- 172.21.15.152:0/801055756 shutdown_connections 2024-04-17T08:47:33.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.253+0000 7f9ff0200640 1 -- 172.21.15.152:0/801055756 wait complete. 2024-04-17T08:47:33.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.253+0000 7f9ff0200640 1 Processor -- start 2024-04-17T08:47:33.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.253+0000 7f9ff0200640 1 -- start start 2024-04-17T08:47:33.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.253+0000 7f9ff0200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9fe806f980 0x7f9fe80998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:33.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.253+0000 7f9ff0200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9fe80af670 0x7f9fe8154150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:33.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.253+0000 7f9ff0200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9fe80d0360 0x7f9fe8154690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:33.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.253+0000 7f9ff0200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe8072a70 con 0x7f9fe80d0360 2024-04-17T08:47:33.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.253+0000 7f9ff0200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe80afa50 con 0x7f9fe80af670 2024-04-17T08:47:33.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.253+0000 7f9ff0200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f9fe8072bf0 con 0x7f9fe806f980 2024-04-17T08:47:33.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.253+0000 7f9fee200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9fe80d0360 0x7f9fe8154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:33.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.253+0000 7f9fee200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9fe80d0360 0x7f9fe8154690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33074/0 (socket says 172.21.15.152:33074) 2024-04-17T08:47:33.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.253+0000 7f9fee200640 1 -- 172.21.15.152:0/2260253817 learned_addr learned my addr 172.21.15.152:0/2260253817 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:33.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.253+0000 7f9fed800640 1 --2- 172.21.15.152:0/2260253817 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9fe806f980 0x7f9fe80998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:33.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.253+0000 7f9fece00640 1 --2- 172.21.15.152:0/2260253817 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9fe80af670 0x7f9fe8154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:33.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.253+0000 7f9fee200640 1 -- 172.21.15.152:0/2260253817 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9fe806f980 msgr2=0x7f9fe80998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:33.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.253+0000 7f9fee200640 1 --2- 172.21.15.152:0/2260253817 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9fe806f980 0x7f9fe80998d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:33.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.257+0000 7f9fee200640 1 -- 172.21.15.152:0/2260253817 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9fe80af670 msgr2=0x7f9fe8154150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:33.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.257+0000 7f9fee200640 1 --2- 172.21.15.152:0/2260253817 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9fe80af670 0x7f9fe8154150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:33.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.257+0000 7f9fee200640 1 -- 172.21.15.152:0/2260253817 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fe8151470 con 0x7f9fe80d0360 2024-04-17T08:47:33.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.257+0000 7f9fee200640 1 --2- 172.21.15.152:0/2260253817 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9fe80d0360 0x7f9fe8154690 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0007e90 tx=0x7f9fe000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:33.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.257+0000 7f9fe5600640 1 -- 172.21.15.152:0/2260253817 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe0014420 con 0x7f9fe80d0360 2024-04-17T08:47:33.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.257+0000 7f9fe5600640 1 -- 172.21.15.152:0/2260253817 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fe0019070 con 0x7f9fe80d0360 2024-04-17T08:47:33.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.257+0000 7f9ff0200640 1 -- 172.21.15.152:0/2260253817 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fe8151750 con 0x7f9fe80d0360 2024-04-17T08:47:33.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.257+0000 7f9fe5600640 1 -- 172.21.15.152:0/2260253817 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe0014800 con 0x7f9fe80d0360 2024-04-17T08:47:33.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.257+0000 7f9ff0200640 1 -- 172.21.15.152:0/2260253817 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fe8151d10 con 0x7f9fe80d0360 2024-04-17T08:47:33.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.257+0000 7f9ff0200640 1 -- 172.21.15.152:0/2260253817 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fe8068a30 con 0x7f9fe80d0360 2024-04-17T08:47:33.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.257+0000 7f9fe5600640 1 -- 172.21.15.152:0/2260253817 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9fe00149a0 con 0x7f9fe80d0360 2024-04-17T08:47:33.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.257+0000 7f9fe5600640 1 --2- 172.21.15.152:0/2260253817 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9fc8068380 0x7f9fc806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:33.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.257+0000 7f9fe5600640 1 -- 172.21.15.152:0/2260253817 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f9fe0087590 con 0x7f9fe80d0360 2024-04-17T08:47:33.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.257+0000 7f9fed800640 1 --2- 172.21.15.152:0/2260253817 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9fc8068380 0x7f9fc806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:33.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.261+0000 7f9fed800640 1 --2- 172.21.15.152:0/2260253817 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9fc8068380 0x7f9fc806a840 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc001810 tx=0x7f9fdc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:33.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.261+0000 7f9fe5600640 1 -- 172.21.15.152:0/2260253817 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f9fe0057040 con 0x7f9fe80d0360 2024-04-17T08:47:33.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.421+0000 7f9ff0200640 1 -- 172.21.15.152:0/2260253817 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f9fe8165190 con 0x7f9fe80d0360 2024-04-17T08:47:33.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.421+0000 7f9fe5600640 1 -- 172.21.15.152:0/2260253817 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f9fe005b340 con 0x7f9fe80d0360 2024-04-17T08:47:33.425 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 64 2024-04-17T08:47:33.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.425+0000 7f9ff0200640 1 -- 172.21.15.152:0/2260253817 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9fc8068380 msgr2=0x7f9fc806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:33.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.425+0000 7f9ff0200640 1 --2- 172.21.15.152:0/2260253817 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9fc8068380 0x7f9fc806a840 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc001810 tx=0x7f9fdc009040 comp rx=0 tx=0).stop 2024-04-17T08:47:33.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.425+0000 7f9ff0200640 1 -- 172.21.15.152:0/2260253817 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9fe80d0360 msgr2=0x7f9fe8154690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:33.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.425+0000 7f9ff0200640 1 --2- 172.21.15.152:0/2260253817 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9fe80d0360 0x7f9fe8154690 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0007e90 tx=0x7f9fe000e4b0 comp rx=0 tx=0).stop 2024-04-17T08:47:33.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.425+0000 7f9ff0200640 1 -- 172.21.15.152:0/2260253817 shutdown_connections 2024-04-17T08:47:33.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.425+0000 7f9ff0200640 1 --2- 172.21.15.152:0/2260253817 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9fe80d0360 0x7f9fe8154690 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:33.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.425+0000 7f9ff0200640 1 --2- 172.21.15.152:0/2260253817 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9fe80af670 0x7f9fe8154150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:33.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.425+0000 7f9ff0200640 1 --2- 172.21.15.152:0/2260253817 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9fc8068380 0x7f9fc806a840 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:33.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.425+0000 7f9ff0200640 1 --2- 172.21.15.152:0/2260253817 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9fe806f980 0x7f9fe80998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:33.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.425+0000 7f9ff0200640 1 -- 172.21.15.152:0/2260253817 >> 172.21.15.152:0/2260253817 conn(0x7f9fe80b3350 msgr2=0x7f9fe814f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:33.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.425+0000 7f9ff0200640 1 -- 172.21.15.152:0/2260253817 shutdown_connections 2024-04-17T08:47:33.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.425+0000 7f9ff0200640 1 -- 172.21.15.152:0/2260253817 wait complete. 2024-04-17T08:47:33.447 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-17T08:47:33.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.585+0000 7f30e1200640 1 Processor -- start 2024-04-17T08:47:33.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.585+0000 7f30e1200640 1 -- start start 2024-04-17T08:47:33.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.585+0000 7f30e1200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f30dc0d0a70 0x7f30dc160010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:33.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.585+0000 7f30e1200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f30dc15d710 0x7f30dc160550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:33.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.585+0000 7f30e1200640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30dc160a90 con 0x7f30dc15a010 2024-04-17T08:47:33.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.585+0000 7f30e1200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f30dc15d280 con 0x7f30dc15d710 2024-04-17T08:47:33.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.585+0000 7f30e1200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f30dc15c9d0 con 0x7f30dc0d0a70 2024-04-17T08:47:33.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.585+0000 7f30d9e00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f30dc15a010 0x7f30dc0d0360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:60536/0 (socket says 172.21.15.152:60536) 2024-04-17T08:47:33.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.585+0000 7f30d9e00640 1 -- 172.21.15.152:0/3928991972 learned_addr learned my addr 172.21.15.152:0/3928991972 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:33.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.585+0000 7f30da800640 1 --2- 172.21.15.152:0/3928991972 >> v2:172.21.15.196:3300/0 conn(0x7f30dc15d710 0x7f30dc160550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:33.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.585+0000 7f30d1400640 1 --2- 172.21.15.152:0/3928991972 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f30dc0d0a70 0x7f30dc160010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:33.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.585+0000 7f30d9400640 1 -- 172.21.15.152:0/3928991972 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 637908635 0 0) 0x7f30dc160a90 con 0x7f30dc15a010 2024-04-17T08:47:33.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.585+0000 7f30d9400640 1 -- 172.21.15.152:0/3928991972 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30c0003530 con 0x7f30dc15a010 2024-04-17T08:47:33.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.585+0000 7f30d9400640 1 -- 172.21.15.152:0/3928991972 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4059235362 0 0) 0x7f30c0003530 con 0x7f30dc15a010 2024-04-17T08:47:33.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.585+0000 7f30d9400640 1 -- 172.21.15.152:0/3928991972 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f30dc0d0a70 msgr2=0x7f30dc160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:33.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.585+0000 7f30d9400640 1 --2- 172.21.15.152:0/3928991972 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f30dc0d0a70 0x7f30dc160010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:33.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.585+0000 7f30d9400640 1 -- 172.21.15.152:0/3928991972 >> v2:172.21.15.196:3300/0 conn(0x7f30dc15d710 msgr2=0x7f30dc160550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:33.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.585+0000 7f30d9400640 1 --2- 172.21.15.152:0/3928991972 >> v2:172.21.15.196:3300/0 conn(0x7f30dc15d710 0x7f30dc160550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:33.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.585+0000 7f30d9400640 1 -- 172.21.15.152:0/3928991972 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30dc160d20 con 0x7f30dc15a010 2024-04-17T08:47:33.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.585+0000 7f30d9400640 1 -- 172.21.15.152:0/3928991972 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2973887244 0 0) 0x7f30cc001680 con 0x7f30dc15a010 2024-04-17T08:47:33.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.585+0000 7f30d9400640 1 -- 172.21.15.152:0/3928991972 >> v1:172.21.15.152:6789/0 conn(0x7f30dc15a010 legacy=0x7f30dc0d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:33.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.585+0000 7f30d9400640 1 --2- 172.21.15.152:0/3928991972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30c00039c0 0x7f30c0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:33.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.585+0000 7f30d9400640 1 --2- 172.21.15.152:0/3928991972 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f30c0004810 0x7f30c0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:33.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.585+0000 7f30d9400640 1 --2- 172.21.15.152:0/3928991972 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f30dc0d0a70 0x7f30c00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:33.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.585+0000 7f30d9400640 1 -- 172.21.15.152:0/3928991972 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f30dc15d280 con 0x7f30c00039c0 2024-04-17T08:47:33.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.585+0000 7f30d9400640 1 -- 172.21.15.152:0/3928991972 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f30dc15c9d0 con 0x7f30c0004810 2024-04-17T08:47:33.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.585+0000 7f30d9400640 1 -- 172.21.15.152:0/3928991972 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f30c000ba50 con 0x7f30dc0d0a70 2024-04-17T08:47:33.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.585+0000 7f30d9e00640 1 --2- 172.21.15.152:0/3928991972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30c00039c0 0x7f30c0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:33.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.585+0000 7f30d1400640 1 --2- 172.21.15.152:0/3928991972 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f30c0004810 0x7f30c0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:33.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.585+0000 7f30da800640 1 --2- 172.21.15.152:0/3928991972 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f30dc0d0a70 0x7f30c00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:33.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.585+0000 7f30d9e00640 1 -- 172.21.15.152:0/3928991972 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f30dc0d0a70 msgr2=0x7f30c00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:33.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.585+0000 7f30d9e00640 1 --2- 172.21.15.152:0/3928991972 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f30dc0d0a70 0x7f30c00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:33.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.585+0000 7f30d9e00640 1 -- 172.21.15.152:0/3928991972 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f30c0004810 msgr2=0x7f30c0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:33.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.585+0000 7f30d9e00640 1 --2- 172.21.15.152:0/3928991972 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f30c0004810 0x7f30c0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:33.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.585+0000 7f30d9e00640 1 -- 172.21.15.152:0/3928991972 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30c0003530 con 0x7f30c00039c0 2024-04-17T08:47:33.592 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.589+0000 7f30d9e00640 1 --2- 172.21.15.152:0/3928991972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30c00039c0 0x7f30c0003de0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f30cc00c190 tx=0x7f30cc01cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70b5eabdabb68f22 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:33.592 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.589+0000 7f30d9400640 1 -- 172.21.15.152:0/3928991972 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30cc007c70 con 0x7f30c00039c0 2024-04-17T08:47:33.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.589+0000 7f30d9400640 1 -- 172.21.15.152:0/3928991972 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30cc0a9020 con 0x7f30c00039c0 2024-04-17T08:47:33.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.589+0000 7f30d9400640 1 -- 172.21.15.152:0/3928991972 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30cc005b00 con 0x7f30c00039c0 2024-04-17T08:47:33.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.589+0000 7f30e1200640 1 -- 172.21.15.152:0/3928991972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30c00039c0 msgr2=0x7f30c0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:33.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.589+0000 7f30e1200640 1 --2- 172.21.15.152:0/3928991972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30c00039c0 0x7f30c0003de0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f30cc00c190 tx=0x7f30cc01cbe0 comp rx=0 tx=0).stop 2024-04-17T08:47:33.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.589+0000 7f30da800640 1 -- 172.21.15.152:0/3928991972 reap_dead start 2024-04-17T08:47:33.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.589+0000 7f30e1200640 1 -- 172.21.15.152:0/3928991972 shutdown_connections 2024-04-17T08:47:33.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.589+0000 7f30e1200640 1 -- 172.21.15.152:0/3928991972 >> 172.21.15.152:0/3928991972 conn(0x7f30dc0b3350 msgr2=0x7f30dc0b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:33.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.589+0000 7f30e1200640 1 -- 172.21.15.152:0/3928991972 shutdown_connections 2024-04-17T08:47:33.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.589+0000 7f30e1200640 1 -- 172.21.15.152:0/3928991972 wait complete. 2024-04-17T08:47:33.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.593+0000 7f30e1200640 1 Processor -- start 2024-04-17T08:47:33.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.593+0000 7f30e1200640 1 -- start start 2024-04-17T08:47:33.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.593+0000 7f30e1200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f30c00039c0 0x7f30dc161b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:33.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.593+0000 7f30e1200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f30dc0cf7b0 0x7f30dc153980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:33.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.593+0000 7f30e1200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30dc06e650 0x7f30dc06ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:33.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.593+0000 7f30e1200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f30dc15e570 con 0x7f30dc06e650 2024-04-17T08:47:33.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.593+0000 7f30e1200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f30dc15e3f0 con 0x7f30dc0cf7b0 2024-04-17T08:47:33.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.593+0000 7f30e1200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f30dc15e6f0 con 0x7f30c00039c0 2024-04-17T08:47:33.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.593+0000 7f30da800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30dc06e650 0x7f30dc06ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:33.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.593+0000 7f30da800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30dc06e650 0x7f30dc06ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33094/0 (socket says 172.21.15.152:33094) 2024-04-17T08:47:33.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.593+0000 7f30da800640 1 -- 172.21.15.152:0/1750357687 learned_addr learned my addr 172.21.15.152:0/1750357687 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:33.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.593+0000 7f30d9e00640 1 --2- 172.21.15.152:0/1750357687 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f30c00039c0 0x7f30dc161b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:33.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.593+0000 7f30d1400640 1 --2- 172.21.15.152:0/1750357687 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f30dc0cf7b0 0x7f30dc153980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:33.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.593+0000 7f30da800640 1 -- 172.21.15.152:0/1750357687 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f30c00039c0 msgr2=0x7f30dc161b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:33.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.593+0000 7f30da800640 1 --2- 172.21.15.152:0/1750357687 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f30c00039c0 0x7f30dc161b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:33.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.593+0000 7f30da800640 1 -- 172.21.15.152:0/1750357687 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f30dc0cf7b0 msgr2=0x7f30dc153980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:33.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.593+0000 7f30da800640 1 --2- 172.21.15.152:0/1750357687 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f30dc0cf7b0 0x7f30dc153980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:33.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.593+0000 7f30da800640 1 -- 172.21.15.152:0/1750357687 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30dc162a60 con 0x7f30dc06e650 2024-04-17T08:47:33.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.593+0000 7f30da800640 1 --2- 172.21.15.152:0/1750357687 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30dc06e650 0x7f30dc06ead0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f30dc15ff70 tx=0x7f30d40115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:33.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.593+0000 7f30d2a00640 1 -- 172.21.15.152:0/1750357687 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d4011e10 con 0x7f30dc06e650 2024-04-17T08:47:33.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.593+0000 7f30d2a00640 1 -- 172.21.15.152:0/1750357687 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30d401b070 con 0x7f30dc06e650 2024-04-17T08:47:33.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.593+0000 7f30d2a00640 1 -- 172.21.15.152:0/1750357687 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d40039a0 con 0x7f30dc06e650 2024-04-17T08:47:33.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.593+0000 7f30e1200640 1 -- 172.21.15.152:0/1750357687 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30dc1621c0 con 0x7f30dc06e650 2024-04-17T08:47:33.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.593+0000 7f30e1200640 1 -- 172.21.15.152:0/1750357687 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30dc162780 con 0x7f30dc06e650 2024-04-17T08:47:33.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.593+0000 7f30e1200640 1 -- 172.21.15.152:0/1750357687 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30dc068a30 con 0x7f30dc06e650 2024-04-17T08:47:33.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.597+0000 7f30d2a00640 1 -- 172.21.15.152:0/1750357687 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f30d4003b40 con 0x7f30dc06e650 2024-04-17T08:47:33.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.597+0000 7f30d2a00640 1 --2- 172.21.15.152:0/1750357687 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f30b80683b0 0x7f30b806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:33.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.597+0000 7f30d2a00640 1 -- 172.21.15.152:0/1750357687 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f30d4087500 con 0x7f30dc06e650 2024-04-17T08:47:33.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.597+0000 7f30d9e00640 1 --2- 172.21.15.152:0/1750357687 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f30b80683b0 0x7f30b806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:33.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.597+0000 7f30d9e00640 1 --2- 172.21.15.152:0/1750357687 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f30b80683b0 0x7f30b806a870 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f30cc00c190 tx=0x7f30dc15d1f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:33.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.601+0000 7f30d2a00640 1 -- 172.21.15.152:0/1750357687 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f30d4025020 con 0x7f30dc06e650 2024-04-17T08:47:33.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.757+0000 7f30e1200640 1 -- 172.21.15.152:0/1750357687 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f30dc0ad5a0 con 0x7f30dc06e650 2024-04-17T08:47:33.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.757+0000 7f30d2a00640 1 -- 172.21.15.152:0/1750357687 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f30d4057690 con 0x7f30dc06e650 2024-04-17T08:47:33.760 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-04-17T08:47:33.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.757+0000 7f30e1200640 1 -- 172.21.15.152:0/1750357687 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f30b80683b0 msgr2=0x7f30b806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:33.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.757+0000 7f30e1200640 1 --2- 172.21.15.152:0/1750357687 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f30b80683b0 0x7f30b806a870 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f30cc00c190 tx=0x7f30dc15d1f0 comp rx=0 tx=0).stop 2024-04-17T08:47:33.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.757+0000 7f30e1200640 1 -- 172.21.15.152:0/1750357687 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30dc06e650 msgr2=0x7f30dc06ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:33.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.757+0000 7f30e1200640 1 --2- 172.21.15.152:0/1750357687 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30dc06e650 0x7f30dc06ead0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f30dc15ff70 tx=0x7f30d40115a0 comp rx=0 tx=0).stop 2024-04-17T08:47:33.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.757+0000 7f30e1200640 1 -- 172.21.15.152:0/1750357687 shutdown_connections 2024-04-17T08:47:33.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.757+0000 7f30e1200640 1 --2- 172.21.15.152:0/1750357687 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30dc06e650 0x7f30dc06ead0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:33.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.757+0000 7f30e1200640 1 --2- 172.21.15.152:0/1750357687 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f30dc0cf7b0 0x7f30dc153980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:33.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.757+0000 7f30e1200640 1 --2- 172.21.15.152:0/1750357687 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f30b80683b0 0x7f30b806a870 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:33.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.757+0000 7f30e1200640 1 --2- 172.21.15.152:0/1750357687 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f30c00039c0 0x7f30dc161b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:33.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.757+0000 7f30e1200640 1 -- 172.21.15.152:0/1750357687 >> 172.21.15.152:0/1750357687 conn(0x7f30dc0b3350 msgr2=0x7f30dc1592c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:33.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.757+0000 7f30e1200640 1 -- 172.21.15.152:0/1750357687 shutdown_connections 2024-04-17T08:47:33.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.757+0000 7f30e1200640 1 -- 172.21.15.152:0/1750357687 wait complete. 2024-04-17T08:47:33.781 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-17T08:47:33.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.913+0000 7f4508200640 1 Processor -- start 2024-04-17T08:47:33.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.913+0000 7f4508200640 1 -- start start 2024-04-17T08:47:33.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.917+0000 7f4508200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f45000d0360 0x7f45000d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:33.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.917+0000 7f4508200640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f450015bfd0 con 0x7f450006f980 2024-04-17T08:47:33.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.917+0000 7f4508200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4500072c40 con 0x7f45000af670 2024-04-17T08:47:33.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.917+0000 7f4508200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f450015c820 con 0x7f45000d0360 2024-04-17T08:47:33.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.917+0000 7f4504e00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f450006f980 0x7f4500072530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:60548/0 (socket says 172.21.15.152:60548) 2024-04-17T08:47:33.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.917+0000 7f4504e00640 1 -- 172.21.15.152:0/2824048152 learned_addr learned my addr 172.21.15.152:0/2824048152 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:33.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.917+0000 7f4506200640 1 --2- 172.21.15.152:0/2824048152 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f45000d0360 0x7f45000d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:33.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.917+0000 7f44ffe00640 1 -- 172.21.15.152:0/2824048152 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2682873965 0 0) 0x7f450015bfd0 con 0x7f450006f980 2024-04-17T08:47:33.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.917+0000 7f44ffe00640 1 -- 172.21.15.152:0/2824048152 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44e8003530 con 0x7f450006f980 2024-04-17T08:47:33.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.917+0000 7f44ffe00640 1 -- 172.21.15.152:0/2824048152 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2143336863 0 0) 0x7f4500072c40 con 0x7f45000af670 2024-04-17T08:47:33.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.917+0000 7f44ffe00640 1 -- 172.21.15.152:0/2824048152 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f450015bfd0 con 0x7f45000af670 2024-04-17T08:47:33.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.917+0000 7f4506200640 1 -- 172.21.15.152:0/2824048152 >> v1:172.21.15.196:6789/0 conn(0x7f45000af670 legacy=0x7f450015b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:33.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.917+0000 7f4506200640 1 -- 172.21.15.152:0/2824048152 >> v1:172.21.15.152:6789/0 conn(0x7f450006f980 legacy=0x7f4500072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:33.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.917+0000 7f44ffe00640 1 -- 172.21.15.152:0/2824048152 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 365996851 0 0) 0x7f44e8003530 con 0x7f450006f980 2024-04-17T08:47:33.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.917+0000 7f4506200640 1 -- 172.21.15.152:0/2824048152 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f450015c260 con 0x7f45000d0360 2024-04-17T08:47:33.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.921+0000 7f4506200640 1 --2- 172.21.15.152:0/2824048152 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f45000d0360 0x7f45000d07f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f44f80097f0 tx=0x7f44f801c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3f6339de1973966 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:33.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.921+0000 7f44ffe00640 1 -- 172.21.15.152:0/2824048152 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f80b0070 con 0x7f45000d0360 2024-04-17T08:47:33.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.921+0000 7f44ffe00640 1 -- 172.21.15.152:0/2824048152 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44f80ab400 con 0x7f45000d0360 2024-04-17T08:47:33.922 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.921+0000 7f44ffe00640 1 -- 172.21.15.152:0/2824048152 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44ec001680 con 0x7f45000d0360 2024-04-17T08:47:33.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.921+0000 7f4508200640 1 -- 172.21.15.152:0/2824048152 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f45000d0360 msgr2=0x7f45000d07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:33.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.921+0000 7f4508200640 1 --2- 172.21.15.152:0/2824048152 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f45000d0360 0x7f45000d07f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f44f80097f0 tx=0x7f44f801c370 comp rx=0 tx=0).stop 2024-04-17T08:47:33.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.921+0000 7f4508200640 1 -- 172.21.15.152:0/2824048152 shutdown_connections 2024-04-17T08:47:33.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.921+0000 7f4508200640 1 --2- 172.21.15.152:0/2824048152 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f45000d0360 0x7f45000d07f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:33.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.921+0000 7f4508200640 1 -- 172.21.15.152:0/2824048152 >> 172.21.15.152:0/2824048152 conn(0x7f45000b3350 msgr2=0x7f45000b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:33.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.921+0000 7f4508200640 1 -- 172.21.15.152:0/2824048152 shutdown_connections 2024-04-17T08:47:33.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.921+0000 7f4508200640 1 -- 172.21.15.152:0/2824048152 wait complete. 2024-04-17T08:47:33.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.921+0000 7f4508200640 1 Processor -- start 2024-04-17T08:47:33.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.921+0000 7f4508200640 1 -- start start 2024-04-17T08:47:33.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.921+0000 7f4508200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f450006f980 0x7f4500156410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:33.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.921+0000 7f4508200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45000af670 0x7f45000b0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:33.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.921+0000 7f4508200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f45000d0360 0x7f4500164400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:33.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.921+0000 7f4508200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4500169060 con 0x7f45000af670 2024-04-17T08:47:33.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.921+0000 7f4508200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f45000afa50 con 0x7f45000d0360 2024-04-17T08:47:33.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.921+0000 7f4508200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f45001691e0 con 0x7f450006f980 2024-04-17T08:47:33.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.921+0000 7f4504e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45000af670 0x7f45000b0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:33.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.921+0000 7f4504e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45000af670 0x7f45000b0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33110/0 (socket says 172.21.15.152:33110) 2024-04-17T08:47:33.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.921+0000 7f4504e00640 1 -- 172.21.15.152:0/1720650723 learned_addr learned my addr 172.21.15.152:0/1720650723 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:33.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.921+0000 7f4506200640 1 --2- 172.21.15.152:0/1720650723 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f45000d0360 0x7f4500164400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:33.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.921+0000 7f4505800640 1 --2- 172.21.15.152:0/1720650723 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f450006f980 0x7f4500156410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:33.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.925+0000 7f4504e00640 1 -- 172.21.15.152:0/1720650723 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f450006f980 msgr2=0x7f4500156410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:33.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.925+0000 7f4504e00640 1 --2- 172.21.15.152:0/1720650723 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f450006f980 0x7f4500156410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:33.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.925+0000 7f4504e00640 1 -- 172.21.15.152:0/1720650723 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f45000d0360 msgr2=0x7f4500164400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:33.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.925+0000 7f4504e00640 1 --2- 172.21.15.152:0/1720650723 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f45000d0360 0x7f4500164400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:33.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.925+0000 7f4504e00640 1 -- 172.21.15.152:0/1720650723 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4500156d10 con 0x7f45000af670 2024-04-17T08:47:33.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.925+0000 7f4505800640 1 --2- 172.21.15.152:0/1720650723 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f450006f980 0x7f4500156410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:47:33.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.925+0000 7f4504e00640 1 --2- 172.21.15.152:0/1720650723 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45000af670 0x7f45000b0400 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f44ec00c750 tx=0x7f44ec00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:33.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.925+0000 7f44fd600640 1 -- 172.21.15.152:0/1720650723 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44ec005af0 con 0x7f45000af670 2024-04-17T08:47:33.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.925+0000 7f44fd600640 1 -- 172.21.15.152:0/1720650723 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44ec005c90 con 0x7f45000af670 2024-04-17T08:47:33.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.925+0000 7f44fd600640 1 -- 172.21.15.152:0/1720650723 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44ec007270 con 0x7f45000af670 2024-04-17T08:47:33.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.925+0000 7f4508200640 1 -- 172.21.15.152:0/1720650723 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4500156ff0 con 0x7f45000af670 2024-04-17T08:47:33.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.925+0000 7f4508200640 1 -- 172.21.15.152:0/1720650723 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4500156950 con 0x7f45000af670 2024-04-17T08:47:33.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.925+0000 7f4508200640 1 -- 172.21.15.152:0/1720650723 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45001573e0 con 0x7f45000af670 2024-04-17T08:47:33.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.925+0000 7f44fd600640 1 -- 172.21.15.152:0/1720650723 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f44ec007410 con 0x7f45000af670 2024-04-17T08:47:33.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.925+0000 7f44fd600640 1 --2- 172.21.15.152:0/1720650723 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f44e0068380 0x7f44e006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:33.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.925+0000 7f44fd600640 1 -- 172.21.15.152:0/1720650723 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f44ec086cd0 con 0x7f45000af670 2024-04-17T08:47:33.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.925+0000 7f4505800640 1 --2- 172.21.15.152:0/1720650723 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f44e0068380 0x7f44e006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:33.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.929+0000 7f4505800640 1 --2- 172.21.15.152:0/1720650723 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f44e0068380 0x7f44e006a840 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f44f4001570 tx=0x7f44f4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:33.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:33.929+0000 7f44fd600640 1 -- 172.21.15.152:0/1720650723 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f44ec056e60 con 0x7f45000af670 2024-04-17T08:47:34.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.097+0000 7f4508200640 1 -- 172.21.15.152:0/1720650723 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f45001571c0 con 0x7f45000af670 2024-04-17T08:47:34.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.101+0000 7f44fd600640 1 -- 172.21.15.152:0/1720650723 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f44ec056760 con 0x7f45000af670 2024-04-17T08:47:34.102 INFO:teuthology.orchestra.run.smithi152.stderr:listed 0 entries 2024-04-17T08:47:34.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.101+0000 7f4508200640 1 -- 172.21.15.152:0/1720650723 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f44e0068380 msgr2=0x7f44e006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:34.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.101+0000 7f4508200640 1 --2- 172.21.15.152:0/1720650723 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f44e0068380 0x7f44e006a840 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f44f4001570 tx=0x7f44f4009040 comp rx=0 tx=0).stop 2024-04-17T08:47:34.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.101+0000 7f4508200640 1 -- 172.21.15.152:0/1720650723 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45000af670 msgr2=0x7f45000b0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:34.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.101+0000 7f4508200640 1 --2- 172.21.15.152:0/1720650723 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45000af670 0x7f45000b0400 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f44ec00c750 tx=0x7f44ec00cc10 comp rx=0 tx=0).stop 2024-04-17T08:47:34.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.101+0000 7f4508200640 1 -- 172.21.15.152:0/1720650723 shutdown_connections 2024-04-17T08:47:34.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.101+0000 7f4508200640 1 --2- 172.21.15.152:0/1720650723 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f45000d0360 0x7f4500164400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:34.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.101+0000 7f4508200640 1 --2- 172.21.15.152:0/1720650723 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45000af670 0x7f45000b0400 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:34.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.101+0000 7f4508200640 1 --2- 172.21.15.152:0/1720650723 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f44e0068380 0x7f44e006a840 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:34.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.101+0000 7f4508200640 1 --2- 172.21.15.152:0/1720650723 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f450006f980 0x7f4500156410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:34.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.101+0000 7f4508200640 1 -- 172.21.15.152:0/1720650723 >> 172.21.15.152:0/1720650723 conn(0x7f45000b3350 msgr2=0x7f45000ae960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:34.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.101+0000 7f4508200640 1 -- 172.21.15.152:0/1720650723 shutdown_connections 2024-04-17T08:47:34.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.101+0000 7f4508200640 1 -- 172.21.15.152:0/1720650723 wait complete. 2024-04-17T08:47:34.123 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-17T08:47:34.123 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-17T08:47:34.133 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T08:47:34.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.265+0000 7fb914600640 1 Processor -- start 2024-04-17T08:47:34.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.265+0000 7fb914600640 1 -- start start 2024-04-17T08:47:34.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.265+0000 7fb914600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb90c161b70 0x7fb90c06dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:34.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.265+0000 7fb914600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fb90c0d0a70 0x7fb90c0ad3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:34.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.265+0000 7fb914600640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb90c06e6b0 con 0x7fb90c06e1a0 2024-04-17T08:47:34.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.265+0000 7fb914600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fb90c161f50 con 0x7fb90c0d0a70 2024-04-17T08:47:34.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.265+0000 7fb914600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fb90c06f230 con 0x7fb90c161b70 2024-04-17T08:47:34.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.265+0000 7fb911200640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fb90c06e1a0 0x7fb90c0d0360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:60554/0 (socket says 172.21.15.152:60554) 2024-04-17T08:47:34.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.265+0000 7fb911200640 1 -- 172.21.15.152:0/198743207 learned_addr learned my addr 172.21.15.152:0/198743207 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:34.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.269+0000 7fb912600640 1 --2- 172.21.15.152:0/198743207 >> v2:172.21.15.196:3300/0 conn(0x7fb90c0d0a70 0x7fb90c0ad3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:34.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.269+0000 7fb911c00640 1 --2- 172.21.15.152:0/198743207 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb90c161b70 0x7fb90c06dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:34.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.269+0000 7fb90be00640 1 -- 172.21.15.152:0/198743207 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2874966708 0 0) 0x7fb90c06e6b0 con 0x7fb90c06e1a0 2024-04-17T08:47:34.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.269+0000 7fb90be00640 1 -- 172.21.15.152:0/198743207 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8f4003530 con 0x7fb90c06e1a0 2024-04-17T08:47:34.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.269+0000 7fb911c00640 1 -- 172.21.15.152:0/198743207 >> v2:172.21.15.196:3300/0 conn(0x7fb90c0d0a70 msgr2=0x7fb90c0ad3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:34.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.269+0000 7fb911c00640 1 --2- 172.21.15.152:0/198743207 >> v2:172.21.15.196:3300/0 conn(0x7fb90c0d0a70 0x7fb90c0ad3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:34.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.269+0000 7fb911c00640 1 -- 172.21.15.152:0/198743207 >> v1:172.21.15.152:6789/0 conn(0x7fb90c06e1a0 legacy=0x7fb90c0d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:34.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.269+0000 7fb911c00640 1 -- 172.21.15.152:0/198743207 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb90c06e990 con 0x7fb90c161b70 2024-04-17T08:47:34.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.269+0000 7fb911c00640 1 --2- 172.21.15.152:0/198743207 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb90c161b70 0x7fb90c06dc60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb9000097c0 tx=0x7fb90001c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90da0ef174b0466f server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:34.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.269+0000 7fb90be00640 1 -- 172.21.15.152:0/198743207 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9000b1070 con 0x7fb90c161b70 2024-04-17T08:47:34.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.269+0000 7fb90be00640 1 -- 172.21.15.152:0/198743207 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9000a8050 con 0x7fb90c161b70 2024-04-17T08:47:34.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.269+0000 7fb90be00640 1 -- 172.21.15.152:0/198743207 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9000ac860 con 0x7fb90c161b70 2024-04-17T08:47:34.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.273+0000 7fb914600640 1 -- 172.21.15.152:0/198743207 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb90c161b70 msgr2=0x7fb90c06dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:34.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.273+0000 7fb914600640 1 --2- 172.21.15.152:0/198743207 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb90c161b70 0x7fb90c06dc60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb9000097c0 tx=0x7fb90001c3e0 comp rx=0 tx=0).stop 2024-04-17T08:47:34.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.273+0000 7fb914600640 1 -- 172.21.15.152:0/198743207 shutdown_connections 2024-04-17T08:47:34.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.273+0000 7fb914600640 1 --2- 172.21.15.152:0/198743207 >> v2:172.21.15.196:3300/0 conn(0x7fb90c0d0a70 0x7fb90c0ad3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:34.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.273+0000 7fb914600640 1 --2- 172.21.15.152:0/198743207 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb90c161b70 0x7fb90c06dc60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:34.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.273+0000 7fb914600640 1 -- 172.21.15.152:0/198743207 >> 172.21.15.152:0/198743207 conn(0x7fb90c0b3350 msgr2=0x7fb90c0b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:34.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.273+0000 7fb914600640 1 -- 172.21.15.152:0/198743207 shutdown_connections 2024-04-17T08:47:34.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.273+0000 7fb914600640 1 -- 172.21.15.152:0/198743207 wait complete. 2024-04-17T08:47:34.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.273+0000 7fb914600640 1 Processor -- start 2024-04-17T08:47:34.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.273+0000 7fb914600640 1 -- start start 2024-04-17T08:47:34.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.273+0000 7fb914600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb90c06e1a0 0x7fb90c14dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:34.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.273+0000 7fb914600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb90c0d0a70 0x7fb90c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:34.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.273+0000 7fb914600640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb90c161b70 0x7fb90c14e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:34.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.273+0000 7fb914600640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb90c0ae2a0 con 0x7fb90c161b70 2024-04-17T08:47:34.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.273+0000 7fb914600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb90c0ae120 con 0x7fb90c0d0a70 2024-04-17T08:47:34.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.273+0000 7fb914600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fb90c0ae420 con 0x7fb90c06e1a0 2024-04-17T08:47:34.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.273+0000 7fb912600640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb90c161b70 0x7fb90c14e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:34.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.273+0000 7fb912600640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb90c161b70 0x7fb90c14e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33114/0 (socket says 172.21.15.152:33114) 2024-04-17T08:47:34.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.273+0000 7fb912600640 1 -- 172.21.15.152:0/3538302814 learned_addr learned my addr 172.21.15.152:0/3538302814 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:34.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.273+0000 7fb911200640 1 --2- 172.21.15.152:0/3538302814 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb90c0d0a70 0x7fb90c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:34.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.273+0000 7fb911c00640 1 --2- 172.21.15.152:0/3538302814 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb90c06e1a0 0x7fb90c14dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:34.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.277+0000 7fb912600640 1 -- 172.21.15.152:0/3538302814 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb90c06e1a0 msgr2=0x7fb90c14dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:34.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.277+0000 7fb912600640 1 --2- 172.21.15.152:0/3538302814 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb90c06e1a0 0x7fb90c14dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:34.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.277+0000 7fb912600640 1 -- 172.21.15.152:0/3538302814 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb90c0d0a70 msgr2=0x7fb90c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:34.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.277+0000 7fb912600640 1 --2- 172.21.15.152:0/3538302814 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb90c0d0a70 0x7fb90c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:34.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.277+0000 7fb912600640 1 -- 172.21.15.152:0/3538302814 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb90c14e020 con 0x7fb90c161b70 2024-04-17T08:47:34.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.277+0000 7fb912600640 1 --2- 172.21.15.152:0/3538302814 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb90c161b70 0x7fb90c14e240 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb90400efc0 tx=0x7fb90400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:34.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.277+0000 7fb909600640 1 -- 172.21.15.152:0/3538302814 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb904018020 con 0x7fb90c161b70 2024-04-17T08:47:34.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.277+0000 7fb909600640 1 -- 172.21.15.152:0/3538302814 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb904014480 con 0x7fb90c161b70 2024-04-17T08:47:34.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.277+0000 7fb909600640 1 -- 172.21.15.152:0/3538302814 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb904014870 con 0x7fb90c161b70 2024-04-17T08:47:34.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.277+0000 7fb914600640 1 -- 172.21.15.152:0/3538302814 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb90c09af20 con 0x7fb90c161b70 2024-04-17T08:47:34.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.277+0000 7fb914600640 1 -- 172.21.15.152:0/3538302814 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb90c1539c0 con 0x7fb90c161b70 2024-04-17T08:47:34.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.277+0000 7fb914600640 1 -- 172.21.15.152:0/3538302814 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb90c068a30 con 0x7fb90c161b70 2024-04-17T08:47:34.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.277+0000 7fb909600640 1 -- 172.21.15.152:0/3538302814 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb90401b020 con 0x7fb90c161b70 2024-04-17T08:47:34.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.277+0000 7fb909600640 1 --2- 172.21.15.152:0/3538302814 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb8ec0683d0 0x7fb8ec06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:34.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.277+0000 7fb909600640 1 -- 172.21.15.152:0/3538302814 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fb904087a90 con 0x7fb90c161b70 2024-04-17T08:47:34.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.277+0000 7fb911c00640 1 --2- 172.21.15.152:0/3538302814 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb8ec0683d0 0x7fb8ec06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:34.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.281+0000 7fb911c00640 1 --2- 172.21.15.152:0/3538302814 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb8ec0683d0 0x7fb8ec06a890 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb9000ae000 tx=0x7fb9000a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:34.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.285+0000 7fb909600640 1 -- 172.21.15.152:0/3538302814 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fb904022030 con 0x7fb90c161b70 2024-04-17T08:47:34.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.445+0000 7fb914600640 1 -- 172.21.15.152:0/3538302814 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb90c0b37d0 con 0x7fb90c161b70 2024-04-17T08:47:34.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.449+0000 7fb909600640 1 -- 172.21.15.152:0/3538302814 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18972 (secure 0 0 0) 0x7fb904010040 con 0x7fb90c161b70 2024-04-17T08:47:34.450 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:47:34.450 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":26,"fsid":"ce68f82e-ec5f-4205-9fd5-bdfdf6ef31e2","created":"2024-04-17T08:46:08.353546+0000","modified":"2024-04-17T08:47:15.280634+0000","last_up_change":"2024-04-17T08:46:20.738799+0000","last_in_change":"2024-04-17T08:46:11.210050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T08:46:21.386856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T08:46:31.812460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T08:46:32.555559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T08:46:36.258078+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"682f0192-187c-404e-bc7a-b6b4e23825e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6819","nonce":3603799291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6823","nonce":3603799291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6831","nonce":3603799291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6827","nonce":3603799291}]},"public_addr":"172.21.15.152:6819/3603799291","cluster_addr":"172.21.15.152:6823/3603799291","heartbeat_back_addr":"172.21.15.152:6831/3603799291","heartbeat_front_addr":"172.21.15.152:6827/3603799291","state":["exists","up"]},{"osd":1,"uuid":"f0fe8fef-60ec-4a39-83b6-2fa6a5adb0f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6801","nonce":4133383142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6803","nonce":4133383142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6807","nonce":4133383142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6805","nonce":4133383142}]},"public_addr":"172.21.15.152:6801/4133383142","cluster_addr":"172.21.15.152:6803/4133383142","heartbeat_back_addr":"172.21.15.152:6807/4133383142","heartbeat_front_addr":"172.21.15.152:6805/4133383142","state":["exists","up"]},{"osd":2,"uuid":"35f36d9c-5245-4431-a618-f4df0fa380ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6809","nonce":3826143898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6811","nonce":3826143898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6815","nonce":3826143898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6813","nonce":3826143898}]},"public_addr":"172.21.15.152:6809/3826143898","cluster_addr":"172.21.15.152:6811/3826143898","heartbeat_back_addr":"172.21.15.152:6815/3826143898","heartbeat_front_addr":"172.21.15.152:6813/3826143898","state":["exists","up"]},{"osd":3,"uuid":"96e56ca5-15b4-4895-9b79-da2c92043159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6818","nonce":165717826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6822","nonce":165717826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6830","nonce":165717826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6826","nonce":165717826}]},"public_addr":"172.21.15.152:6818/165717826","cluster_addr":"172.21.15.152:6822/165717826","heartbeat_back_addr":"172.21.15.152:6830/165717826","heartbeat_front_addr":"172.21.15.152:6826/165717826","state":["exists","up"]},{"osd":4,"uuid":"f5aa10a4-9ff9-41fe-a5c9-15326f982cc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6817","nonce":4080159297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6819","nonce":4080159297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6823","nonce":4080159297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6821","nonce":4080159297}]},"public_addr":"172.21.15.196:6817/4080159297","cluster_addr":"172.21.15.196:6819/4080159297","heartbeat_back_addr":"172.21.15.196:6823/4080159297","heartbeat_front_addr":"172.21.15.196:6821/4080159297","state":["exists","up"]},{"osd":5,"uuid":"42bab884-3476-47ae-ac65-935fa6e0f055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6801","nonce":3519444232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6803","nonce":3519444232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6807","nonce":3519444232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6805","nonce":3519444232}]},"public_addr":"172.21.15.196:6801/3519444232","cluster_addr":"172.21.15.196:6803/3519444232","heartbeat_back_addr":"172.21.15.196:6807/3519444232","heartbeat_front_addr":"172.21.15.196:6805/3519444232","state":["exists","up"]},{"osd":6,"uuid":"460b6167-f57b-4224-9c92-cfc9b80bbe99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6809","nonce":275739834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6811","nonce":275739834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6815","nonce":275739834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6813","nonce":275739834}]},"public_addr":"172.21.15.196:6809/275739834","cluster_addr":"172.21.15.196:6811/275739834","heartbeat_back_addr":"172.21.15.196:6815/275739834","heartbeat_front_addr":"172.21.15.196:6813/275739834","state":["exists","up"]},{"osd":7,"uuid":"d695643f-5e07-4e2a-a646-c06bd97b6650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6825","nonce":307626968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6827","nonce":307626968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6831","nonce":307626968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6829","nonce":307626968}]},"public_addr":"172.21.15.196:6825/307626968","cluster_addr":"172.21.15.196:6827/307626968","heartbeat_back_addr":"172.21.15.196:6831/307626968","heartbeat_front_addr":"172.21.15.196:6829/307626968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.293257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.964533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.248895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.010000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.832554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.743704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930171+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930962+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T08:47:34.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.449+0000 7fb914600640 1 -- 172.21.15.152:0/3538302814 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb8ec0683d0 msgr2=0x7fb8ec06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:34.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.449+0000 7fb914600640 1 --2- 172.21.15.152:0/3538302814 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb8ec0683d0 0x7fb8ec06a890 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb9000ae000 tx=0x7fb9000a7000 comp rx=0 tx=0).stop 2024-04-17T08:47:34.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.449+0000 7fb914600640 1 -- 172.21.15.152:0/3538302814 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb90c161b70 msgr2=0x7fb90c14e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:34.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.449+0000 7fb914600640 1 --2- 172.21.15.152:0/3538302814 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb90c161b70 0x7fb90c14e240 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb90400efc0 tx=0x7fb90400c490 comp rx=0 tx=0).stop 2024-04-17T08:47:34.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.449+0000 7fb914600640 1 -- 172.21.15.152:0/3538302814 shutdown_connections 2024-04-17T08:47:34.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.449+0000 7fb914600640 1 --2- 172.21.15.152:0/3538302814 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb90c161b70 0x7fb90c14e240 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:34.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.449+0000 7fb914600640 1 --2- 172.21.15.152:0/3538302814 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb90c0d0a70 0x7fb90c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:34.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.449+0000 7fb914600640 1 --2- 172.21.15.152:0/3538302814 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb8ec0683d0 0x7fb8ec06a890 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:34.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.449+0000 7fb914600640 1 --2- 172.21.15.152:0/3538302814 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb90c06e1a0 0x7fb90c14dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:34.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.449+0000 7fb914600640 1 -- 172.21.15.152:0/3538302814 >> 172.21.15.152:0/3538302814 conn(0x7fb90c0b3350 msgr2=0x7fb90c156320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:34.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.449+0000 7fb914600640 1 -- 172.21.15.152:0/3538302814 shutdown_connections 2024-04-17T08:47:34.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.449+0000 7fb914600640 1 -- 172.21.15.152:0/3538302814 wait complete. 2024-04-17T08:47:34.471 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T08:46:21.386856+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-17T08:46:31.812460+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-17T08:46:32.555559+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-17T08:46:36.258078+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-17T08:47:34.472 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T08:47:34.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.609+0000 7fc4f7800640 1 Processor -- start 2024-04-17T08:47:34.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.609+0000 7fc4f7800640 1 -- start start 2024-04-17T08:47:34.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.609+0000 7fc4f7800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc4f00af670 0x7fc4f015b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:34.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.613+0000 7fc4f7800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc4f00d0360 0x7fc4f00d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:34.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.613+0000 7fc4f7800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4f0072c40 con 0x7fc4f006f980 2024-04-17T08:47:34.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.613+0000 7fc4f7800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fc4f015c820 con 0x7fc4f00d0360 2024-04-17T08:47:34.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.613+0000 7fc4f7800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fc4f015c260 con 0x7fc4f00af670 2024-04-17T08:47:34.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.613+0000 7fc4f5800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc4f00d0360 0x7fc4f00d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:34.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.613+0000 7fc4f4e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc4f00af670 0x7fc4f015b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:34.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.613+0000 7fc4f5800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc4f00d0360 0x7fc4f00d07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.152:57258/0 (socket says 172.21.15.152:57258) 2024-04-17T08:47:34.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.613+0000 7fc4f5800640 1 -- 172.21.15.152:0/1532243861 learned_addr learned my addr 172.21.15.152:0/1532243861 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:34.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.613+0000 7fc4efe00640 1 --1- 172.21.15.152:0/1532243861 >> v1:172.21.15.196:6789/0 conn(0x7fc4f006f980 0x7fc4f0072530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.152:57266/0 (socket says 172.21.15.152:57266) 2024-04-17T08:47:34.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.613+0000 7fc4f5800640 1 -- 172.21.15.152:0/1532243861 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc4f00af670 msgr2=0x7fc4f015b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:34.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.613+0000 7fc4f5800640 1 --2- 172.21.15.152:0/1532243861 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc4f00af670 0x7fc4f015b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:34.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.613+0000 7fc4f5800640 1 -- 172.21.15.152:0/1532243861 >> v1:172.21.15.196:6789/0 conn(0x7fc4f006f980 legacy=0x7fc4f0072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:34.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.613+0000 7fc4f5800640 1 -- 172.21.15.152:0/1532243861 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4f015c540 con 0x7fc4f00d0360 2024-04-17T08:47:34.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.613+0000 7fc4f4e00640 1 --2- 172.21.15.152:0/1532243861 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc4f00af670 0x7fc4f015b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T08:47:34.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.617+0000 7fc4f5800640 1 --2- 172.21.15.152:0/1532243861 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc4f00d0360 0x7fc4f00d07f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc4e8009870 tx=0x7fc4e801c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3b2d52bd4c9962d server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:34.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.617+0000 7fc4ef400640 1 -- 172.21.15.152:0/1532243861 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e80b1070 con 0x7fc4f00d0360 2024-04-17T08:47:34.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.617+0000 7fc4ef400640 1 -- 172.21.15.152:0/1532243861 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4e80ac620 con 0x7fc4f00d0360 2024-04-17T08:47:34.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.617+0000 7fc4ef400640 1 -- 172.21.15.152:0/1532243861 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e80ac9f0 con 0x7fc4f00d0360 2024-04-17T08:47:34.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.617+0000 7fc4f7800640 1 -- 172.21.15.152:0/1532243861 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc4f00d0360 msgr2=0x7fc4f00d07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:34.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.617+0000 7fc4f7800640 1 --2- 172.21.15.152:0/1532243861 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc4f00d0360 0x7fc4f00d07f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc4e8009870 tx=0x7fc4e801c4d0 comp rx=0 tx=0).stop 2024-04-17T08:47:34.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.617+0000 7fc4f7800640 1 -- 172.21.15.152:0/1532243861 shutdown_connections 2024-04-17T08:47:34.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.617+0000 7fc4f7800640 1 --2- 172.21.15.152:0/1532243861 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc4f00d0360 0x7fc4f00d07f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:34.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.617+0000 7fc4f7800640 1 --2- 172.21.15.152:0/1532243861 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc4f00af670 0x7fc4f015b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:34.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.617+0000 7fc4f7800640 1 -- 172.21.15.152:0/1532243861 >> 172.21.15.152:0/1532243861 conn(0x7fc4f00b3350 msgr2=0x7fc4f00b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:34.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.617+0000 7fc4f7800640 1 -- 172.21.15.152:0/1532243861 shutdown_connections 2024-04-17T08:47:34.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.617+0000 7fc4f7800640 1 -- 172.21.15.152:0/1532243861 wait complete. 2024-04-17T08:47:34.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.617+0000 7fc4f7800640 1 Processor -- start 2024-04-17T08:47:34.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.617+0000 7fc4f7800640 1 -- start start 2024-04-17T08:47:34.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.617+0000 7fc4f7800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc4f006f980 0x7fc4f0148760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:34.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.617+0000 7fc4f7800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc4f00af670 0x7fc4f0156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:34.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.617+0000 7fc4f7800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc4f00d0360 0x7fc4f01649d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:34.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.617+0000 7fc4f7800640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f015bf80 con 0x7fc4f006f980 2024-04-17T08:47:34.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.617+0000 7fc4f7800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f015be00 con 0x7fc4f00af670 2024-04-17T08:47:34.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.617+0000 7fc4f7800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fc4f0168050 con 0x7fc4f00d0360 2024-04-17T08:47:34.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.617+0000 7fc4f4e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc4f006f980 0x7fc4f0148760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:34.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.617+0000 7fc4f4e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc4f006f980 0x7fc4f0148760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33116/0 (socket says 172.21.15.152:33116) 2024-04-17T08:47:34.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.617+0000 7fc4f4e00640 1 -- 172.21.15.152:0/1634355459 learned_addr learned my addr 172.21.15.152:0/1634355459 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:34.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.617+0000 7fc4f5800640 1 --2- 172.21.15.152:0/1634355459 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc4f00d0360 0x7fc4f01649d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:34.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.617+0000 7fc4efe00640 1 --2- 172.21.15.152:0/1634355459 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc4f00af670 0x7fc4f0156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:34.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.621+0000 7fc4f4e00640 1 -- 172.21.15.152:0/1634355459 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc4f00d0360 msgr2=0x7fc4f01649d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:34.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.621+0000 7fc4f4e00640 1 --2- 172.21.15.152:0/1634355459 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc4f00d0360 0x7fc4f01649d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:34.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.621+0000 7fc4f4e00640 1 -- 172.21.15.152:0/1634355459 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc4f00af670 msgr2=0x7fc4f0156c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:34.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.621+0000 7fc4f4e00640 1 --2- 172.21.15.152:0/1634355459 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc4f00af670 0x7fc4f0156c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:34.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.621+0000 7fc4f4e00640 1 -- 172.21.15.152:0/1634355459 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4f014fc90 con 0x7fc4f006f980 2024-04-17T08:47:34.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.621+0000 7fc4efe00640 1 --2- 172.21.15.152:0/1634355459 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc4f00af670 0x7fc4f0156c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T08:47:34.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.621+0000 7fc4f5800640 1 --2- 172.21.15.152:0/1634355459 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc4f00d0360 0x7fc4f01649d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T08:47:34.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.621+0000 7fc4f4e00640 1 --2- 172.21.15.152:0/1634355459 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc4f006f980 0x7fc4f0148760 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc4e000efc0 tx=0x7fc4e000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:34.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.621+0000 7fc4ecc00640 1 -- 172.21.15.152:0/1634355459 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e0018020 con 0x7fc4f006f980 2024-04-17T08:47:34.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.621+0000 7fc4ecc00640 1 -- 172.21.15.152:0/1634355459 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4e0014680 con 0x7fc4f006f980 2024-04-17T08:47:34.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.621+0000 7fc4f7800640 1 -- 172.21.15.152:0/1634355459 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4f014ff70 con 0x7fc4f006f980 2024-04-17T08:47:34.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.621+0000 7fc4ecc00640 1 -- 172.21.15.152:0/1634355459 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e0014a50 con 0x7fc4f006f980 2024-04-17T08:47:34.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.621+0000 7fc4f7800640 1 -- 172.21.15.152:0/1634355459 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4f0157170 con 0x7fc4f006f980 2024-04-17T08:47:34.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.621+0000 7fc4f7800640 1 -- 172.21.15.152:0/1634355459 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4f0068a30 con 0x7fc4f006f980 2024-04-17T08:47:34.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.621+0000 7fc4ecc00640 1 -- 172.21.15.152:0/1634355459 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc4e001b020 con 0x7fc4f006f980 2024-04-17T08:47:34.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.625+0000 7fc4ecc00640 1 --2- 172.21.15.152:0/1634355459 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc4d0068380 0x7fc4d006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:34.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.625+0000 7fc4ecc00640 1 -- 172.21.15.152:0/1634355459 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fc4e0087a80 con 0x7fc4f006f980 2024-04-17T08:47:34.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.625+0000 7fc4efe00640 1 --2- 172.21.15.152:0/1634355459 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc4d0068380 0x7fc4d006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:34.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.625+0000 7fc4efe00640 1 --2- 172.21.15.152:0/1634355459 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc4d0068380 0x7fc4d006a840 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc4f015e870 tx=0x7fc4dc007e90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:34.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.629+0000 7fc4ecc00640 1 -- 172.21.15.152:0/1634355459 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fc4e0089e20 con 0x7fc4f006f980 2024-04-17T08:47:34.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.785+0000 7fc4f7800640 1 -- 172.21.15.152:0/1634355459 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc4f006c610 con 0x7fc4f006f980 2024-04-17T08:47:34.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.785+0000 7fc4ecc00640 1 -- 172.21.15.152:0/1634355459 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7fc4e0022030 con 0x7fc4f006f980 2024-04-17T08:47:34.787 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2024-04-17T08:47:34.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.785+0000 7fc4f7800640 1 -- 172.21.15.152:0/1634355459 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc4d0068380 msgr2=0x7fc4d006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:34.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.785+0000 7fc4f7800640 1 --2- 172.21.15.152:0/1634355459 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc4d0068380 0x7fc4d006a840 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc4f015e870 tx=0x7fc4dc007e90 comp rx=0 tx=0).stop 2024-04-17T08:47:34.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.785+0000 7fc4f7800640 1 -- 172.21.15.152:0/1634355459 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc4f006f980 msgr2=0x7fc4f0148760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:34.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.785+0000 7fc4f7800640 1 --2- 172.21.15.152:0/1634355459 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc4f006f980 0x7fc4f0148760 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc4e000efc0 tx=0x7fc4e000c490 comp rx=0 tx=0).stop 2024-04-17T08:47:34.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.785+0000 7fc4f7800640 1 -- 172.21.15.152:0/1634355459 shutdown_connections 2024-04-17T08:47:34.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.785+0000 7fc4f7800640 1 --2- 172.21.15.152:0/1634355459 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc4d0068380 0x7fc4d006a840 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:34.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.785+0000 7fc4f7800640 1 --2- 172.21.15.152:0/1634355459 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc4f00d0360 0x7fc4f01649d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:34.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.785+0000 7fc4f7800640 1 --2- 172.21.15.152:0/1634355459 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc4f00af670 0x7fc4f0156c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:34.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.785+0000 7fc4f7800640 1 --2- 172.21.15.152:0/1634355459 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc4f006f980 0x7fc4f0148760 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:34.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.785+0000 7fc4f7800640 1 -- 172.21.15.152:0/1634355459 >> 172.21.15.152:0/1634355459 conn(0x7fc4f00b3350 msgr2=0x7fc4f00ae660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:34.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.785+0000 7fc4f7800640 1 -- 172.21.15.152:0/1634355459 shutdown_connections 2024-04-17T08:47:34.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.785+0000 7fc4f7800640 1 -- 172.21.15.152:0/1634355459 wait complete. 2024-04-17T08:47:34.808 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-17T08:47:34.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.945+0000 7f37caa00640 1 Processor -- start 2024-04-17T08:47:34.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.945+0000 7f37caa00640 1 -- start start 2024-04-17T08:47:34.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.945+0000 7f37caa00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f37c40af670 0x7f37c415b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:34.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.945+0000 7f37caa00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f37c40d0360 0x7f37c40d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:34.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.945+0000 7f37caa00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37c4072c40 con 0x7f37c406f980 2024-04-17T08:47:34.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.945+0000 7f37caa00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f37c415c820 con 0x7f37c40af670 2024-04-17T08:47:34.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.945+0000 7f37caa00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f37c415c260 con 0x7f37c40d0360 2024-04-17T08:47:34.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.945+0000 7f37c3e00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f37c40af670 0x7f37c415b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:34.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.945+0000 7f37c3400640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f37c406f980 0x7f37c4072530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:60562/0 (socket says 172.21.15.152:60562) 2024-04-17T08:47:34.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.945+0000 7f37c3400640 1 -- 172.21.15.152:0/1560194177 learned_addr learned my addr 172.21.15.152:0/1560194177 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:34.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.945+0000 7f37c3e00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f37c40af670 0x7f37c415b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33132/0 (socket says 172.21.15.152:33132) 2024-04-17T08:47:34.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.945+0000 7f37c8a00640 1 --2- 172.21.15.152:0/1560194177 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f37c40d0360 0x7f37c40d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:34.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.945+0000 7f37c3e00640 1 -- 172.21.15.152:0/1560194177 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f37c40d0360 msgr2=0x7f37c40d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:34.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.945+0000 7f37c3e00640 1 --2- 172.21.15.152:0/1560194177 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f37c40d0360 0x7f37c40d07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:34.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.945+0000 7f37c3e00640 1 -- 172.21.15.152:0/1560194177 >> v1:172.21.15.152:6789/0 conn(0x7f37c406f980 legacy=0x7f37c4072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:34.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.945+0000 7f37c3e00640 1 -- 172.21.15.152:0/1560194177 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37c415c540 con 0x7f37c40af670 2024-04-17T08:47:34.950 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.949+0000 7f37c3e00640 1 --2- 172.21.15.152:0/1560194177 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37c40af670 0x7f37c415b8c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f37b40097c0 tx=0x7f37b401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b90c8c20e95ac01 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:34.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.949+0000 7f37c2a00640 1 -- 172.21.15.152:0/1560194177 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b40b0070 con 0x7f37c40af670 2024-04-17T08:47:34.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.949+0000 7f37c2a00640 1 -- 172.21.15.152:0/1560194177 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37b40ab600 con 0x7f37c40af670 2024-04-17T08:47:34.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.949+0000 7f37c2a00640 1 -- 172.21.15.152:0/1560194177 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b40ab9d0 con 0x7f37c40af670 2024-04-17T08:47:34.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.949+0000 7f37caa00640 1 -- 172.21.15.152:0/1560194177 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37c40af670 msgr2=0x7f37c415b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:34.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.949+0000 7f37caa00640 1 --2- 172.21.15.152:0/1560194177 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37c40af670 0x7f37c415b8c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f37b40097c0 tx=0x7f37b401c410 comp rx=0 tx=0).stop 2024-04-17T08:47:34.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.949+0000 7f37caa00640 1 -- 172.21.15.152:0/1560194177 shutdown_connections 2024-04-17T08:47:34.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.949+0000 7f37caa00640 1 --2- 172.21.15.152:0/1560194177 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f37c40d0360 0x7f37c40d07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:34.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.949+0000 7f37caa00640 1 --2- 172.21.15.152:0/1560194177 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37c40af670 0x7f37c415b8c0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:34.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.949+0000 7f37caa00640 1 -- 172.21.15.152:0/1560194177 >> 172.21.15.152:0/1560194177 conn(0x7f37c40b3350 msgr2=0x7f37c40b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:34.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.949+0000 7f37caa00640 1 -- 172.21.15.152:0/1560194177 shutdown_connections 2024-04-17T08:47:34.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.949+0000 7f37caa00640 1 -- 172.21.15.152:0/1560194177 wait complete. 2024-04-17T08:47:34.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.949+0000 7f37caa00640 1 Processor -- start 2024-04-17T08:47:34.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.949+0000 7f37caa00640 1 -- start start 2024-04-17T08:47:34.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.953+0000 7f37caa00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f37c406f980 0x7f37c4153fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:34.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.953+0000 7f37caa00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f37c40af670 0x7f37c4159930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:34.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.953+0000 7f37caa00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37c40d0360 0x7f37c414f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:34.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.953+0000 7f37caa00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f37c415bf80 con 0x7f37c40d0360 2024-04-17T08:47:34.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.953+0000 7f37caa00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f37c415be00 con 0x7f37c40af670 2024-04-17T08:47:34.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.953+0000 7f37caa00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f37c406b9b0 con 0x7f37c406f980 2024-04-17T08:47:34.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.953+0000 7f37c8a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37c40d0360 0x7f37c414f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:34.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.953+0000 7f37c8a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37c40d0360 0x7f37c414f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33136/0 (socket says 172.21.15.152:33136) 2024-04-17T08:47:34.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.953+0000 7f37c8a00640 1 -- 172.21.15.152:0/473359497 learned_addr learned my addr 172.21.15.152:0/473359497 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:34.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.953+0000 7f37c3e00640 1 --2- 172.21.15.152:0/473359497 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f37c406f980 0x7f37c4153fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:34.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.953+0000 7f37c3400640 1 --2- 172.21.15.152:0/473359497 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f37c40af670 0x7f37c4159930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:34.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.953+0000 7f37c8a00640 1 -- 172.21.15.152:0/473359497 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f37c406f980 msgr2=0x7f37c4153fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:34.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.953+0000 7f37c8a00640 1 --2- 172.21.15.152:0/473359497 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f37c406f980 0x7f37c4153fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:34.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.953+0000 7f37c8a00640 1 -- 172.21.15.152:0/473359497 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f37c40af670 msgr2=0x7f37c4159930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:34.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.953+0000 7f37c8a00640 1 --2- 172.21.15.152:0/473359497 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f37c40af670 0x7f37c4159930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:34.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.953+0000 7f37c8a00640 1 -- 172.21.15.152:0/473359497 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37c4154890 con 0x7f37c40d0360 2024-04-17T08:47:34.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.953+0000 7f37c3400640 1 --2- 172.21.15.152:0/473359497 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f37c40af670 0x7f37c4159930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:34.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.953+0000 7f37c8a00640 1 --2- 172.21.15.152:0/473359497 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37c40d0360 0x7f37c414f090 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f37bc007e90 tx=0x7f37bc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:34.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.953+0000 7f37bbe00640 1 -- 172.21.15.152:0/473359497 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37bc014420 con 0x7f37c40d0360 2024-04-17T08:47:34.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.953+0000 7f37bbe00640 1 -- 172.21.15.152:0/473359497 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37bc019070 con 0x7f37c40d0360 2024-04-17T08:47:34.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.953+0000 7f37caa00640 1 -- 172.21.15.152:0/473359497 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37c4154b70 con 0x7f37c40d0360 2024-04-17T08:47:34.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.953+0000 7f37bbe00640 1 -- 172.21.15.152:0/473359497 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37bc014800 con 0x7f37c40d0360 2024-04-17T08:47:34.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.953+0000 7f37caa00640 1 -- 172.21.15.152:0/473359497 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37c4150b40 con 0x7f37c40d0360 2024-04-17T08:47:34.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.953+0000 7f37caa00640 1 -- 172.21.15.152:0/473359497 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37c4068a30 con 0x7f37c40d0360 2024-04-17T08:47:34.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.953+0000 7f37bbe00640 1 -- 172.21.15.152:0/473359497 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f37bc0149a0 con 0x7f37c40d0360 2024-04-17T08:47:34.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.957+0000 7f37bbe00640 1 --2- 172.21.15.152:0/473359497 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f37a4068380 0x7f37a406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:34.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.957+0000 7f37bbe00640 1 -- 172.21.15.152:0/473359497 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f37bc087690 con 0x7f37c40d0360 2024-04-17T08:47:34.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.957+0000 7f37c3e00640 1 --2- 172.21.15.152:0/473359497 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f37a4068380 0x7f37a406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:34.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.957+0000 7f37c3e00640 1 --2- 172.21.15.152:0/473359497 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f37a4068380 0x7f37a406a840 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f37b40ad000 tx=0x7f37b40a4f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:34.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:34.961+0000 7f37bbe00640 1 -- 172.21.15.152:0/473359497 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f37bc057790 con 0x7f37c40d0360 2024-04-17T08:47:35.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.117+0000 7f37caa00640 1 -- 172.21.15.152:0/473359497 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f37c4150d10 con 0x7f37c40d0360 2024-04-17T08:47:35.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.117+0000 7f37bbe00640 1 -- 172.21.15.152:0/473359497 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f37bc057090 con 0x7f37c40d0360 2024-04-17T08:47:35.121 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-04-17T08:47:35.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.121+0000 7f37caa00640 1 -- 172.21.15.152:0/473359497 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f37a4068380 msgr2=0x7f37a406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:35.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.121+0000 7f37caa00640 1 --2- 172.21.15.152:0/473359497 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f37a4068380 0x7f37a406a840 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f37b40ad000 tx=0x7f37b40a4f90 comp rx=0 tx=0).stop 2024-04-17T08:47:35.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.121+0000 7f37caa00640 1 -- 172.21.15.152:0/473359497 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37c40d0360 msgr2=0x7f37c414f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:35.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.121+0000 7f37caa00640 1 --2- 172.21.15.152:0/473359497 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37c40d0360 0x7f37c414f090 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f37bc007e90 tx=0x7f37bc00e4b0 comp rx=0 tx=0).stop 2024-04-17T08:47:35.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.121+0000 7f37caa00640 1 -- 172.21.15.152:0/473359497 shutdown_connections 2024-04-17T08:47:35.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.121+0000 7f37caa00640 1 --2- 172.21.15.152:0/473359497 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37c40d0360 0x7f37c414f090 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:35.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.121+0000 7f37caa00640 1 --2- 172.21.15.152:0/473359497 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f37c40af670 0x7f37c4159930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:35.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.121+0000 7f37caa00640 1 --2- 172.21.15.152:0/473359497 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f37a4068380 0x7f37a406a840 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:35.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.121+0000 7f37caa00640 1 --2- 172.21.15.152:0/473359497 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f37c406f980 0x7f37c4153fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:35.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.121+0000 7f37caa00640 1 -- 172.21.15.152:0/473359497 >> 172.21.15.152:0/473359497 conn(0x7f37c40b3350 msgr2=0x7f37c4073140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:35.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.121+0000 7f37caa00640 1 -- 172.21.15.152:0/473359497 shutdown_connections 2024-04-17T08:47:35.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.121+0000 7f37caa00640 1 -- 172.21.15.152:0/473359497 wait complete. 2024-04-17T08:47:35.142 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-17T08:47:35.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.277+0000 7fd001200640 1 Processor -- start 2024-04-17T08:47:35.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.277+0000 7fd001200640 1 -- start start 2024-04-17T08:47:35.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.281+0000 7fd001200640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fcffc0d04e0 0x7fcffc06d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:35.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.281+0000 7fd001200640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcffc06e1a0 con 0x7fcffc15c050 2024-04-17T08:47:35.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.281+0000 7fd001200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcffc06e480 con 0x7fcffc06d940 2024-04-17T08:47:35.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.281+0000 7fd001200640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fcffc06edb0 con 0x7fcffc0d04e0 2024-04-17T08:47:35.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.281+0000 7fcffaa00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fcffc0d04e0 0x7fcffc06d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:35.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.281+0000 7fcffaa00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fcffc0d04e0 0x7fcffc06d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33142/0 (socket says 172.21.15.152:33142) 2024-04-17T08:47:35.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.281+0000 7fcffaa00640 1 -- 172.21.15.152:0/2328671278 learned_addr learned my addr 172.21.15.152:0/2328671278 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:35.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.281+0000 7fcffaa00640 1 -- 172.21.15.152:0/2328671278 >> v1:172.21.15.196:6789/0 conn(0x7fcffc06d940 legacy=0x7fcffc15fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:35.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.281+0000 7fcffaa00640 1 -- 172.21.15.152:0/2328671278 >> v1:172.21.15.152:6789/0 conn(0x7fcffc15c050 legacy=0x7fcffc0cfdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:35.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.281+0000 7fcffaa00640 1 -- 172.21.15.152:0/2328671278 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcffc06e760 con 0x7fcffc0d04e0 2024-04-17T08:47:35.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.281+0000 7fcffaa00640 1 --2- 172.21.15.152:0/2328671278 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcffc0d04e0 0x7fcffc06d400 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fcfe80098a0 tx=0x7fcfe801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c83b0a741783cd3 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:35.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.285+0000 7fcffa000640 1 -- 172.21.15.152:0/2328671278 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe80aa430 con 0x7fcffc0d04e0 2024-04-17T08:47:35.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.285+0000 7fcffa000640 1 -- 172.21.15.152:0/2328671278 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfe80af070 con 0x7fcffc0d04e0 2024-04-17T08:47:35.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.285+0000 7fcffa000640 1 -- 172.21.15.152:0/2328671278 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe80aa7f0 con 0x7fcffc0d04e0 2024-04-17T08:47:35.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.285+0000 7fd001200640 1 -- 172.21.15.152:0/2328671278 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcffc0d04e0 msgr2=0x7fcffc06d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:35.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.285+0000 7fd001200640 1 --2- 172.21.15.152:0/2328671278 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcffc0d04e0 0x7fcffc06d400 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fcfe80098a0 tx=0x7fcfe801c510 comp rx=0 tx=0).stop 2024-04-17T08:47:35.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.285+0000 7fd001200640 1 -- 172.21.15.152:0/2328671278 shutdown_connections 2024-04-17T08:47:35.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.285+0000 7fd001200640 1 --2- 172.21.15.152:0/2328671278 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcffc0d04e0 0x7fcffc06d400 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:35.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.285+0000 7fd001200640 1 -- 172.21.15.152:0/2328671278 >> 172.21.15.152:0/2328671278 conn(0x7fcffc0b3dd0 msgr2=0x7fcffc0b41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:35.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.285+0000 7fd001200640 1 -- 172.21.15.152:0/2328671278 shutdown_connections 2024-04-17T08:47:35.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.285+0000 7fd001200640 1 -- 172.21.15.152:0/2328671278 wait complete. 2024-04-17T08:47:35.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.285+0000 7fd001200640 1 Processor -- start 2024-04-17T08:47:35.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.285+0000 7fd001200640 1 -- start start 2024-04-17T08:47:35.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.285+0000 7fd001200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcffc06d940 0x7fcffc14d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:35.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.285+0000 7fd001200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcffc0d04e0 0x7fcffc154970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:35.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.285+0000 7fd001200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcffc15c050 0x7fcffc154eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:35.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.285+0000 7fd001200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fcffc06def0 con 0x7fcffc15c050 2024-04-17T08:47:35.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.285+0000 7fd001200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fcffc06dd70 con 0x7fcffc06d940 2024-04-17T08:47:35.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.285+0000 7fd001200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fcffc16c4b0 con 0x7fcffc0d04e0 2024-04-17T08:47:35.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.285+0000 7fcffbe00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcffc15c050 0x7fcffc154eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:35.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.285+0000 7fcffbe00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcffc15c050 0x7fcffc154eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33156/0 (socket says 172.21.15.152:33156) 2024-04-17T08:47:35.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.285+0000 7fcffbe00640 1 -- 172.21.15.152:0/4220728708 learned_addr learned my addr 172.21.15.152:0/4220728708 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:35.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.285+0000 7fcffb400640 1 --2- 172.21.15.152:0/4220728708 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcffc06d940 0x7fcffc14d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:35.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.285+0000 7fcffaa00640 1 --2- 172.21.15.152:0/4220728708 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcffc0d04e0 0x7fcffc154970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:35.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.289+0000 7fcffbe00640 1 -- 172.21.15.152:0/4220728708 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcffc0d04e0 msgr2=0x7fcffc154970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:35.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.289+0000 7fcffbe00640 1 --2- 172.21.15.152:0/4220728708 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcffc0d04e0 0x7fcffc154970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:35.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.289+0000 7fcffbe00640 1 -- 172.21.15.152:0/4220728708 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcffc06d940 msgr2=0x7fcffc14d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:35.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.289+0000 7fcffbe00640 1 --2- 172.21.15.152:0/4220728708 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcffc06d940 0x7fcffc14d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:35.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.289+0000 7fcffbe00640 1 -- 172.21.15.152:0/4220728708 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcffc155530 con 0x7fcffc15c050 2024-04-17T08:47:35.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.289+0000 7fcffaa00640 1 --2- 172.21.15.152:0/4220728708 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcffc0d04e0 0x7fcffc154970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:35.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.289+0000 7fcffbe00640 1 --2- 172.21.15.152:0/4220728708 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcffc15c050 0x7fcffc154eb0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fcff400c770 tx=0x7fcff400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:35.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.289+0000 7fcff3400640 1 -- 172.21.15.152:0/4220728708 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff4003b80 con 0x7fcffc15c050 2024-04-17T08:47:35.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.289+0000 7fcff3400640 1 -- 172.21.15.152:0/4220728708 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcff4003d20 con 0x7fcffc15c050 2024-04-17T08:47:35.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.289+0000 7fcff3400640 1 -- 172.21.15.152:0/4220728708 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff400aa90 con 0x7fcffc15c050 2024-04-17T08:47:35.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.289+0000 7fd001200640 1 -- 172.21.15.152:0/4220728708 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcffc155810 con 0x7fcffc15c050 2024-04-17T08:47:35.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.289+0000 7fd001200640 1 -- 172.21.15.152:0/4220728708 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcffc155dd0 con 0x7fcffc15c050 2024-04-17T08:47:35.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.289+0000 7fd001200640 1 -- 172.21.15.152:0/4220728708 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcffc075be0 con 0x7fcffc15c050 2024-04-17T08:47:35.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.289+0000 7fcff3400640 1 -- 172.21.15.152:0/4220728708 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcff400ac30 con 0x7fcffc15c050 2024-04-17T08:47:35.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.289+0000 7fcff3400640 1 --2- 172.21.15.152:0/4220728708 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fcfdc068380 0x7fcfdc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:35.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.289+0000 7fcff3400640 1 -- 172.21.15.152:0/4220728708 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fcff4086c50 con 0x7fcffc15c050 2024-04-17T08:47:35.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.289+0000 7fcffb400640 1 --2- 172.21.15.152:0/4220728708 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fcfdc068380 0x7fcfdc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:35.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.293+0000 7fcffb400640 1 --2- 172.21.15.152:0/4220728708 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fcfdc068380 0x7fcfdc06a840 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcfec007fd0 tx=0x7fcfec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:35.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.293+0000 7fcff3400640 1 -- 172.21.15.152:0/4220728708 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fcff4056de0 con 0x7fcffc15c050 2024-04-17T08:47:35.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.453+0000 7fd001200640 1 -- 172.21.15.152:0/4220728708 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fcffc0b4490 con 0x7fcffc15c050 2024-04-17T08:47:35.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.457+0000 7fcff3400640 1 -- 172.21.15.152:0/4220728708 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7fcff40566e0 con 0x7fcffc15c050 2024-04-17T08:47:35.458 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 64 2024-04-17T08:47:35.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.457+0000 7fd001200640 1 -- 172.21.15.152:0/4220728708 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fcfdc068380 msgr2=0x7fcfdc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:35.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.457+0000 7fd001200640 1 --2- 172.21.15.152:0/4220728708 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fcfdc068380 0x7fcfdc06a840 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcfec007fd0 tx=0x7fcfec009040 comp rx=0 tx=0).stop 2024-04-17T08:47:35.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.457+0000 7fd001200640 1 -- 172.21.15.152:0/4220728708 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcffc15c050 msgr2=0x7fcffc154eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:35.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.457+0000 7fd001200640 1 --2- 172.21.15.152:0/4220728708 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcffc15c050 0x7fcffc154eb0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fcff400c770 tx=0x7fcff400cc30 comp rx=0 tx=0).stop 2024-04-17T08:47:35.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.457+0000 7fd001200640 1 -- 172.21.15.152:0/4220728708 shutdown_connections 2024-04-17T08:47:35.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.457+0000 7fd001200640 1 --2- 172.21.15.152:0/4220728708 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcffc15c050 0x7fcffc154eb0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:35.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.457+0000 7fd001200640 1 --2- 172.21.15.152:0/4220728708 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fcfdc068380 0x7fcfdc06a840 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:35.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.457+0000 7fd001200640 1 --2- 172.21.15.152:0/4220728708 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcffc0d04e0 0x7fcffc154970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:35.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.457+0000 7fd001200640 1 --2- 172.21.15.152:0/4220728708 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcffc06d940 0x7fcffc14d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:35.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.457+0000 7fd001200640 1 -- 172.21.15.152:0/4220728708 >> 172.21.15.152:0/4220728708 conn(0x7fcffc0b3dd0 msgr2=0x7fcffc06fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:35.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.457+0000 7fd001200640 1 -- 172.21.15.152:0/4220728708 shutdown_connections 2024-04-17T08:47:35.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.457+0000 7fd001200640 1 -- 172.21.15.152:0/4220728708 wait complete. 2024-04-17T08:47:35.480 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-17T08:47:35.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.617+0000 7f93fde00640 1 Processor -- start 2024-04-17T08:47:35.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.617+0000 7f93fde00640 1 -- start start 2024-04-17T08:47:35.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.617+0000 7f93fde00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f93f815a010 0x7f93f80d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:35.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.617+0000 7f93fde00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93f8160d20 con 0x7f93f8160720 2024-04-17T08:47:35.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.617+0000 7f93fde00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93f815cc30 con 0x7f93f815d710 2024-04-17T08:47:35.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.617+0000 7f93fde00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f93f815d280 con 0x7f93f815a010 2024-04-17T08:47:35.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.617+0000 7f93f6a00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f93f815a010 0x7f93f80d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:35.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.617+0000 7f93f6a00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f93f815a010 0x7f93f80d0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33172/0 (socket says 172.21.15.152:33172) 2024-04-17T08:47:35.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.617+0000 7f93f6a00640 1 -- 172.21.15.152:0/1403126852 learned_addr learned my addr 172.21.15.152:0/1403126852 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:35.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.617+0000 7f93f6a00640 1 -- 172.21.15.152:0/1403126852 >> v1:172.21.15.196:6789/0 conn(0x7f93f815d710 legacy=0x7f93f8160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:35.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.617+0000 7f93f6a00640 1 -- 172.21.15.152:0/1403126852 >> v1:172.21.15.152:6789/0 conn(0x7f93f8160720 legacy=0x7f93f815dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:35.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.617+0000 7f93f6a00640 1 -- 172.21.15.152:0/1403126852 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93f815cf10 con 0x7f93f815a010 2024-04-17T08:47:35.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.621+0000 7f93f6a00640 1 --2- 172.21.15.152:0/1403126852 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93f815a010 0x7f93f80d0360 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f93f815d400 tx=0x7f93e801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd0a0efdea97b23b server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:35.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.621+0000 7f93f6000640 1 -- 172.21.15.152:0/1403126852 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e80b0070 con 0x7f93f815a010 2024-04-17T08:47:35.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.621+0000 7f93f6000640 1 -- 172.21.15.152:0/1403126852 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93e80ab600 con 0x7f93f815a010 2024-04-17T08:47:35.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.621+0000 7f93f6000640 1 -- 172.21.15.152:0/1403126852 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e80ab9d0 con 0x7f93f815a010 2024-04-17T08:47:35.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.621+0000 7f93fde00640 1 -- 172.21.15.152:0/1403126852 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93f815a010 msgr2=0x7f93f80d0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:35.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.621+0000 7f93fde00640 1 --2- 172.21.15.152:0/1403126852 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93f815a010 0x7f93f80d0360 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f93f815d400 tx=0x7f93e801c470 comp rx=0 tx=0).stop 2024-04-17T08:47:35.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.621+0000 7f93fde00640 1 -- 172.21.15.152:0/1403126852 shutdown_connections 2024-04-17T08:47:35.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.621+0000 7f93fde00640 1 --2- 172.21.15.152:0/1403126852 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93f815a010 0x7f93f80d0360 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:35.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.621+0000 7f93fde00640 1 -- 172.21.15.152:0/1403126852 >> 172.21.15.152:0/1403126852 conn(0x7f93f80b3350 msgr2=0x7f93f80b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:35.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.621+0000 7f93fde00640 1 -- 172.21.15.152:0/1403126852 shutdown_connections 2024-04-17T08:47:35.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.621+0000 7f93fde00640 1 -- 172.21.15.152:0/1403126852 wait complete. 2024-04-17T08:47:35.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.621+0000 7f93fde00640 1 Processor -- start 2024-04-17T08:47:35.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.621+0000 7f93fde00640 1 -- start start 2024-04-17T08:47:35.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.625+0000 7f93fde00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f93f815a010 0x7f93f8098d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:35.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.625+0000 7f93fde00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93f815d710 0x7f93f80b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:35.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.625+0000 7f93fde00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93f8160720 0x7f93f80b1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:35.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.625+0000 7f93fde00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f93f80d0cb0 con 0x7f93f8160720 2024-04-17T08:47:35.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.625+0000 7f93fde00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f93f815c9d0 con 0x7f93f815a010 2024-04-17T08:47:35.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.625+0000 7f93fde00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f93f816a5d0 con 0x7f93f815d710 2024-04-17T08:47:35.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.625+0000 7f93f7400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93f8160720 0x7f93f80b1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:35.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.625+0000 7f93f7400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93f8160720 0x7f93f80b1390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33180/0 (socket says 172.21.15.152:33180) 2024-04-17T08:47:35.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.625+0000 7f93f7400640 1 -- 172.21.15.152:0/1234270647 learned_addr learned my addr 172.21.15.152:0/1234270647 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:35.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.625+0000 7f93f6a00640 1 --2- 172.21.15.152:0/1234270647 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f93f815a010 0x7f93f8098d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:35.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.625+0000 7f93efe00640 1 --2- 172.21.15.152:0/1234270647 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93f815d710 0x7f93f80b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:35.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.625+0000 7f93f7400640 1 -- 172.21.15.152:0/1234270647 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93f815d710 msgr2=0x7f93f80b0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:35.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.625+0000 7f93f7400640 1 --2- 172.21.15.152:0/1234270647 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93f815d710 0x7f93f80b0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:35.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.625+0000 7f93f7400640 1 -- 172.21.15.152:0/1234270647 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f93f815a010 msgr2=0x7f93f8098d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:35.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.625+0000 7f93f7400640 1 --2- 172.21.15.152:0/1234270647 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f93f815a010 0x7f93f8098d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:35.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.625+0000 7f93f7400640 1 -- 172.21.15.152:0/1234270647 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93f806dc60 con 0x7f93f8160720 2024-04-17T08:47:35.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.625+0000 7f93efe00640 1 --2- 172.21.15.152:0/1234270647 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93f815d710 0x7f93f80b0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:35.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.625+0000 7f93f7400640 1 --2- 172.21.15.152:0/1234270647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93f8160720 0x7f93f80b1390 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f93f000c730 tx=0x7f93f000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:35.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.625+0000 7f93ef400640 1 -- 172.21.15.152:0/1234270647 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f0003b80 con 0x7f93f8160720 2024-04-17T08:47:35.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.625+0000 7f93ef400640 1 -- 172.21.15.152:0/1234270647 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93f0003d20 con 0x7f93f8160720 2024-04-17T08:47:35.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.625+0000 7f93ef400640 1 -- 172.21.15.152:0/1234270647 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f000aa30 con 0x7f93f8160720 2024-04-17T08:47:35.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.625+0000 7f93fde00640 1 -- 172.21.15.152:0/1234270647 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93f8099d50 con 0x7f93f8160720 2024-04-17T08:47:35.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.625+0000 7f93fde00640 1 -- 172.21.15.152:0/1234270647 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93f806e200 con 0x7f93f8160720 2024-04-17T08:47:35.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.625+0000 7f93fde00640 1 -- 172.21.15.152:0/1234270647 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93f806e400 con 0x7f93f8160720 2024-04-17T08:47:35.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.625+0000 7f93ef400640 1 -- 172.21.15.152:0/1234270647 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f93f000abd0 con 0x7f93f8160720 2024-04-17T08:47:35.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.629+0000 7f93ef400640 1 --2- 172.21.15.152:0/1234270647 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f93d4068380 0x7f93d406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:35.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.629+0000 7f93ef400640 1 -- 172.21.15.152:0/1234270647 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f93f0086d00 con 0x7f93f8160720 2024-04-17T08:47:35.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.629+0000 7f93f6a00640 1 --2- 172.21.15.152:0/1234270647 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f93d4068380 0x7f93d406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:35.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.629+0000 7f93f6a00640 1 --2- 172.21.15.152:0/1234270647 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f93d4068380 0x7f93d406a840 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f93e80ad000 tx=0x7f93e80a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:35.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.633+0000 7f93ef400640 1 -- 172.21.15.152:0/1234270647 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f93f806e400 con 0x7f93f8160720 2024-04-17T08:47:35.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.789+0000 7f93fde00640 1 -- 172.21.15.152:0/1234270647 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f93f8068a30 con 0x7f93f8160720 2024-04-17T08:47:35.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.789+0000 7f93ef400640 1 -- 172.21.15.152:0/1234270647 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f93f0056d70 con 0x7f93f8160720 2024-04-17T08:47:35.792 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-04-17T08:47:35.795 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.793+0000 7f93fde00640 1 -- 172.21.15.152:0/1234270647 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f93d4068380 msgr2=0x7f93d406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:35.795 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.793+0000 7f93fde00640 1 --2- 172.21.15.152:0/1234270647 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f93d4068380 0x7f93d406a840 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f93e80ad000 tx=0x7f93e80a6000 comp rx=0 tx=0).stop 2024-04-17T08:47:35.795 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.793+0000 7f93fde00640 1 -- 172.21.15.152:0/1234270647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93f8160720 msgr2=0x7f93f80b1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:35.795 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.793+0000 7f93fde00640 1 --2- 172.21.15.152:0/1234270647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93f8160720 0x7f93f80b1390 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f93f000c730 tx=0x7f93f000cbf0 comp rx=0 tx=0).stop 2024-04-17T08:47:35.795 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.793+0000 7f93fde00640 1 -- 172.21.15.152:0/1234270647 shutdown_connections 2024-04-17T08:47:35.795 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.793+0000 7f93fde00640 1 --2- 172.21.15.152:0/1234270647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93f8160720 0x7f93f80b1390 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:35.795 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.793+0000 7f93fde00640 1 --2- 172.21.15.152:0/1234270647 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f93d4068380 0x7f93d406a840 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:35.795 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.793+0000 7f93fde00640 1 --2- 172.21.15.152:0/1234270647 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93f815d710 0x7f93f80b0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:35.795 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.793+0000 7f93fde00640 1 --2- 172.21.15.152:0/1234270647 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f93f815a010 0x7f93f8098d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:35.795 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.793+0000 7f93fde00640 1 -- 172.21.15.152:0/1234270647 >> 172.21.15.152:0/1234270647 conn(0x7f93f80b3350 msgr2=0x7f93f80b1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:35.795 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.793+0000 7f93fde00640 1 -- 172.21.15.152:0/1234270647 shutdown_connections 2024-04-17T08:47:35.795 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.793+0000 7f93fde00640 1 -- 172.21.15.152:0/1234270647 wait complete. 2024-04-17T08:47:35.813 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-17T08:47:35.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.949+0000 7fab28c00640 1 Processor -- start 2024-04-17T08:47:35.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.949+0000 7fab28c00640 1 -- start start 2024-04-17T08:47:35.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.949+0000 7fab28c00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fab2415c490 0x7fab240cca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:35.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.949+0000 7fab28c00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab240b2f20 con 0x7fab24071790 2024-04-17T08:47:35.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.949+0000 7fab28c00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab240d0410 con 0x7fab240cff80 2024-04-17T08:47:35.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.949+0000 7fab28c00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fab240d06f0 con 0x7fab2415c490 2024-04-17T08:47:35.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.949+0000 7fab21e00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fab2415c490 0x7fab240cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:35.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.949+0000 7fab21e00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fab2415c490 0x7fab240cca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33190/0 (socket says 172.21.15.152:33190) 2024-04-17T08:47:35.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.949+0000 7fab21e00640 1 -- 172.21.15.152:0/1264835098 learned_addr learned my addr 172.21.15.152:0/1264835098 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:35.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.949+0000 7fab21e00640 1 -- 172.21.15.152:0/1264835098 >> v1:172.21.15.196:6789/0 conn(0x7fab240cff80 legacy=0x7fab240b2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:35.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.949+0000 7fab21e00640 1 -- 172.21.15.152:0/1264835098 >> v1:172.21.15.152:6789/0 conn(0x7fab24071790 legacy=0x7fab24071ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:35.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.949+0000 7fab21e00640 1 -- 172.21.15.152:0/1264835098 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab240c7570 con 0x7fab2415c490 2024-04-17T08:47:35.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.953+0000 7fab21e00640 1 --2- 172.21.15.152:0/1264835098 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab2415c490 0x7fab240cca00 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fab14009e50 tx=0x7fab1401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=853d93720642492b server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:35.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.953+0000 7fab20a00640 1 -- 172.21.15.152:0/1264835098 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab140a5730 con 0x7fab2415c490 2024-04-17T08:47:35.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.953+0000 7fab20a00640 1 -- 172.21.15.152:0/1264835098 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab140a58d0 con 0x7fab2415c490 2024-04-17T08:47:35.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.953+0000 7fab20a00640 1 -- 172.21.15.152:0/1264835098 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab140a5ca0 con 0x7fab2415c490 2024-04-17T08:47:35.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.953+0000 7fab28c00640 1 -- 172.21.15.152:0/1264835098 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab2415c490 msgr2=0x7fab240cca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:35.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.953+0000 7fab28c00640 1 --2- 172.21.15.152:0/1264835098 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab2415c490 0x7fab240cca00 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fab14009e50 tx=0x7fab1401c960 comp rx=0 tx=0).stop 2024-04-17T08:47:35.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.953+0000 7fab28c00640 1 -- 172.21.15.152:0/1264835098 shutdown_connections 2024-04-17T08:47:35.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.953+0000 7fab28c00640 1 --2- 172.21.15.152:0/1264835098 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab2415c490 0x7fab240cca00 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:35.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.953+0000 7fab28c00640 1 -- 172.21.15.152:0/1264835098 >> 172.21.15.152:0/1264835098 conn(0x7fab240d23b0 msgr2=0x7fab240d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:35.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.953+0000 7fab28c00640 1 -- 172.21.15.152:0/1264835098 shutdown_connections 2024-04-17T08:47:35.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.953+0000 7fab28c00640 1 -- 172.21.15.152:0/1264835098 wait complete. 2024-04-17T08:47:35.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.957+0000 7fab28c00640 1 Processor -- start 2024-04-17T08:47:35.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.957+0000 7fab28c00640 1 -- start start 2024-04-17T08:47:35.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.957+0000 7fab28c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fab24071790 0x7fab240b7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:35.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.957+0000 7fab28c00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab2415c490 0x7fab2415b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:35.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.957+0000 7fab28c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fab24151d00 0x7fab24070570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:35.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.957+0000 7fab28c00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fab2416a480 con 0x7fab2415c490 2024-04-17T08:47:35.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.957+0000 7fab28c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fab2416a300 con 0x7fab24151d00 2024-04-17T08:47:35.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.957+0000 7fab28c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fab2416a600 con 0x7fab24071790 2024-04-17T08:47:35.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.957+0000 7fab21400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab2415c490 0x7fab2415b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:35.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.957+0000 7fab21400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab2415c490 0x7fab2415b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33200/0 (socket says 172.21.15.152:33200) 2024-04-17T08:47:35.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.957+0000 7fab21400640 1 -- 172.21.15.152:0/2511271502 learned_addr learned my addr 172.21.15.152:0/2511271502 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:35.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.957+0000 7fab22800640 1 --2- 172.21.15.152:0/2511271502 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fab24151d00 0x7fab24070570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:35.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.957+0000 7fab21e00640 1 --2- 172.21.15.152:0/2511271502 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fab24071790 0x7fab240b7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:35.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.957+0000 7fab21400640 1 -- 172.21.15.152:0/2511271502 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fab24071790 msgr2=0x7fab240b7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:35.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.957+0000 7fab21400640 1 --2- 172.21.15.152:0/2511271502 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fab24071790 0x7fab240b7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:35.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.957+0000 7fab21400640 1 -- 172.21.15.152:0/2511271502 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fab24151d00 msgr2=0x7fab24070570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:35.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.957+0000 7fab21400640 1 --2- 172.21.15.152:0/2511271502 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fab24151d00 0x7fab24070570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:35.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.957+0000 7fab21400640 1 -- 172.21.15.152:0/2511271502 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab24152190 con 0x7fab2415c490 2024-04-17T08:47:35.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.957+0000 7fab21400640 1 --2- 172.21.15.152:0/2511271502 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab2415c490 0x7fab2415b460 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fab1000c490 tx=0x7fab10001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:35.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.957+0000 7fab1a000640 1 -- 172.21.15.152:0/2511271502 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab10017070 con 0x7fab2415c490 2024-04-17T08:47:35.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.957+0000 7fab1a000640 1 -- 172.21.15.152:0/2511271502 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab10003600 con 0x7fab2415c490 2024-04-17T08:47:35.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.957+0000 7fab1a000640 1 -- 172.21.15.152:0/2511271502 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab100039f0 con 0x7fab2415c490 2024-04-17T08:47:35.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.957+0000 7fab28c00640 1 -- 172.21.15.152:0/2511271502 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab24152470 con 0x7fab2415c490 2024-04-17T08:47:35.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.957+0000 7fab28c00640 1 -- 172.21.15.152:0/2511271502 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab2414f620 con 0x7fab2415c490 2024-04-17T08:47:35.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.957+0000 7fab28c00640 1 -- 172.21.15.152:0/2511271502 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab24068a30 con 0x7fab2415c490 2024-04-17T08:47:35.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.961+0000 7fab1a000640 1 -- 172.21.15.152:0/2511271502 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fab1001a070 con 0x7fab2415c490 2024-04-17T08:47:35.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.961+0000 7fab1a000640 1 --2- 172.21.15.152:0/2511271502 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fab04068380 0x7fab0406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:35.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.961+0000 7fab1a000640 1 -- 172.21.15.152:0/2511271502 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fab10086340 con 0x7fab2415c490 2024-04-17T08:47:35.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.961+0000 7fab21e00640 1 --2- 172.21.15.152:0/2511271502 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fab04068380 0x7fab0406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:35.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.961+0000 7fab21e00640 1 --2- 172.21.15.152:0/2511271502 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fab04068380 0x7fab0406a840 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fab140ae000 tx=0x7fab140a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:35.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:35.965+0000 7fab1a000640 1 -- 172.21.15.152:0/2511271502 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fab100563b0 con 0x7fab2415c490 2024-04-17T08:47:36.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.133+0000 7fab28c00640 1 -- 172.21.15.152:0/2511271502 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fab240b3da0 con 0x7fab2415c490 2024-04-17T08:47:36.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.133+0000 7fab1a000640 1 -- 172.21.15.152:0/2511271502 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7fab10055cb0 con 0x7fab2415c490 2024-04-17T08:47:36.135 INFO:teuthology.orchestra.run.smithi152.stderr:listed 0 entries 2024-04-17T08:47:36.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.133+0000 7fab28c00640 1 -- 172.21.15.152:0/2511271502 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fab04068380 msgr2=0x7fab0406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:36.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.133+0000 7fab28c00640 1 --2- 172.21.15.152:0/2511271502 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fab04068380 0x7fab0406a840 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fab140ae000 tx=0x7fab140a7070 comp rx=0 tx=0).stop 2024-04-17T08:47:36.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.133+0000 7fab28c00640 1 -- 172.21.15.152:0/2511271502 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab2415c490 msgr2=0x7fab2415b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:36.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.133+0000 7fab28c00640 1 --2- 172.21.15.152:0/2511271502 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab2415c490 0x7fab2415b460 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fab1000c490 tx=0x7fab10001e80 comp rx=0 tx=0).stop 2024-04-17T08:47:36.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.133+0000 7fab28c00640 1 -- 172.21.15.152:0/2511271502 shutdown_connections 2024-04-17T08:47:36.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.133+0000 7fab28c00640 1 --2- 172.21.15.152:0/2511271502 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fab24151d00 0x7fab24070570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:36.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.133+0000 7fab28c00640 1 --2- 172.21.15.152:0/2511271502 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab2415c490 0x7fab2415b460 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:36.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.133+0000 7fab28c00640 1 --2- 172.21.15.152:0/2511271502 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fab04068380 0x7fab0406a840 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:36.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.133+0000 7fab28c00640 1 --2- 172.21.15.152:0/2511271502 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fab24071790 0x7fab240b7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:36.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.133+0000 7fab28c00640 1 -- 172.21.15.152:0/2511271502 >> 172.21.15.152:0/2511271502 conn(0x7fab240d23b0 msgr2=0x7fab240c9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:36.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.133+0000 7fab28c00640 1 -- 172.21.15.152:0/2511271502 shutdown_connections 2024-04-17T08:47:36.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.133+0000 7fab28c00640 1 -- 172.21.15.152:0/2511271502 wait complete. 2024-04-17T08:47:36.157 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi196.front.sepia.ceph.com... 2024-04-17T08:47:36.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:36.157 DEBUG:teuthology.orchestra.run.smithi196:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-04-17T08:47:36.428 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T08:47:36.429 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi196.front.sepia.ceph.com 2024-04-17T08:47:36.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:36.429 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-17T08:47:36.447 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-17T08:47:36.447 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-17T08:47:36.456 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-17T08:47:36.456 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-17T08:47:36.505 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T08:47:36.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.677+0000 7f0f27000640 1 Processor -- start 2024-04-17T08:47:36.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.677+0000 7f0f27000640 1 -- start start 2024-04-17T08:47:36.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.681+0000 7f0f27000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0f2015a010 0x7f0f200d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:36.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.681+0000 7f0f27000640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f0f20160720 0x7f0f200d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:36.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.681+0000 7f0f27000640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f20160d20 con 0x7f0f2015d710 2024-04-17T08:47:36.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.681+0000 7f0f27000640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f0f2015d280 con 0x7f0f20160720 2024-04-17T08:47:36.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.681+0000 7f0f27000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f0f2015c9d0 con 0x7f0f2015a010 2024-04-17T08:47:36.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.681+0000 7f0f17400640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f0f2015d710 0x7f0f20160010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:60612/0 (socket says 172.21.15.152:60612) 2024-04-17T08:47:36.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.681+0000 7f0f17400640 1 -- 172.21.15.152:0/601879552 learned_addr learned my addr 172.21.15.152:0/601879552 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:36.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.681+0000 7f0f25000640 1 --2- 172.21.15.152:0/601879552 >> v2:172.21.15.152:3300/0 conn(0x7f0f20160720 0x7f0f200d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:36.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.681+0000 7f0f1fe00640 1 --2- 172.21.15.152:0/601879552 >> v2:172.21.15.196:3300/0 conn(0x7f0f2015a010 0x7f0f200d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:36.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.681+0000 7f0f1f400640 1 -- 172.21.15.152:0/601879552 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1072762008 0 0) 0x7f0f20160d20 con 0x7f0f2015d710 2024-04-17T08:47:36.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.681+0000 7f0f1f400640 1 -- 172.21.15.152:0/601879552 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f04003530 con 0x7f0f2015d710 2024-04-17T08:47:36.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.681+0000 7f0f25000640 1 -- 172.21.15.152:0/601879552 >> v2:172.21.15.196:3300/0 conn(0x7f0f2015a010 msgr2=0x7f0f200d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:36.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.681+0000 7f0f25000640 1 --2- 172.21.15.152:0/601879552 >> v2:172.21.15.196:3300/0 conn(0x7f0f2015a010 0x7f0f200d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:36.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.681+0000 7f0f25000640 1 -- 172.21.15.152:0/601879552 >> v1:172.21.15.152:6789/0 conn(0x7f0f2015d710 legacy=0x7f0f20160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:36.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.681+0000 7f0f25000640 1 -- 172.21.15.152:0/601879552 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f2015cc30 con 0x7f0f20160720 2024-04-17T08:47:36.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.681+0000 7f0f25000640 1 --2- 172.21.15.152:0/601879552 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f20160720 0x7f0f200d08a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0f2006d9d0 tx=0x7f0f1801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ad202cd98254b3f server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:36.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.685+0000 7f0f1f400640 1 -- 172.21.15.152:0/601879552 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f180b0070 con 0x7f0f20160720 2024-04-17T08:47:36.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.685+0000 7f0f1f400640 1 -- 172.21.15.152:0/601879552 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f180ab600 con 0x7f0f20160720 2024-04-17T08:47:36.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.685+0000 7f0f1f400640 1 -- 172.21.15.152:0/601879552 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f180ab9d0 con 0x7f0f20160720 2024-04-17T08:47:36.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.685+0000 7f0f27000640 1 -- 172.21.15.152:0/601879552 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f20160720 msgr2=0x7f0f200d08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:36.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.685+0000 7f0f27000640 1 --2- 172.21.15.152:0/601879552 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f20160720 0x7f0f200d08a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0f2006d9d0 tx=0x7f0f1801c3f0 comp rx=0 tx=0).stop 2024-04-17T08:47:36.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.685+0000 7f0f27000640 1 -- 172.21.15.152:0/601879552 shutdown_connections 2024-04-17T08:47:36.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.685+0000 7f0f27000640 1 --2- 172.21.15.152:0/601879552 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f20160720 0x7f0f200d08a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:36.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.685+0000 7f0f27000640 1 --2- 172.21.15.152:0/601879552 >> v2:172.21.15.196:3300/0 conn(0x7f0f2015a010 0x7f0f200d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:36.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.685+0000 7f0f27000640 1 -- 172.21.15.152:0/601879552 >> 172.21.15.152:0/601879552 conn(0x7f0f200b3350 msgr2=0x7f0f200b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:36.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.685+0000 7f0f27000640 1 -- 172.21.15.152:0/601879552 shutdown_connections 2024-04-17T08:47:36.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.685+0000 7f0f27000640 1 -- 172.21.15.152:0/601879552 wait complete. 2024-04-17T08:47:36.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.685+0000 7f0f27000640 1 Processor -- start 2024-04-17T08:47:36.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.685+0000 7f0f27000640 1 -- start start 2024-04-17T08:47:36.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.685+0000 7f0f27000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f2015a010 0x7f0f200991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:36.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.685+0000 7f0f27000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0f2015d710 0x7f0f2015b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:36.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.685+0000 7f0f27000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0f20160720 0x7f0f2015bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:36.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.685+0000 7f0f27000640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0f2015e780 con 0x7f0f2015a010 2024-04-17T08:47:36.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.685+0000 7f0f27000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0f2015e600 con 0x7f0f20160720 2024-04-17T08:47:36.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.685+0000 7f0f27000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f0f2015e900 con 0x7f0f2015d710 2024-04-17T08:47:36.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.685+0000 7f0f1fe00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f2015a010 0x7f0f200991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:36.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.685+0000 7f0f1fe00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f2015a010 0x7f0f200991a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33214/0 (socket says 172.21.15.152:33214) 2024-04-17T08:47:36.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.685+0000 7f0f1fe00640 1 -- 172.21.15.152:0/1025385707 learned_addr learned my addr 172.21.15.152:0/1025385707 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:36.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.689+0000 7f0f1fe00640 1 -- 172.21.15.152:0/1025385707 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0f2015d710 msgr2=0x7f0f2015b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:36.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.689+0000 7f0f1fe00640 1 --2- 172.21.15.152:0/1025385707 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0f2015d710 0x7f0f2015b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:36.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.689+0000 7f0f1fe00640 1 -- 172.21.15.152:0/1025385707 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0f20160720 msgr2=0x7f0f2015bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:36.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.689+0000 7f0f1fe00640 1 --2- 172.21.15.152:0/1025385707 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0f20160720 0x7f0f2015bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:36.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.689+0000 7f0f1fe00640 1 -- 172.21.15.152:0/1025385707 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f2006e830 con 0x7f0f2015a010 2024-04-17T08:47:36.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.689+0000 7f0f1fe00640 1 --2- 172.21.15.152:0/1025385707 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f2015a010 0x7f0f200991a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0f10007ef0 tx=0x7f0f1000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:36.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.689+0000 7f0f1cc00640 1 -- 172.21.15.152:0/1025385707 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f10014620 con 0x7f0f2015a010 2024-04-17T08:47:36.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.689+0000 7f0f1cc00640 1 -- 172.21.15.152:0/1025385707 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f10019070 con 0x7f0f2015a010 2024-04-17T08:47:36.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.689+0000 7f0f27000640 1 -- 172.21.15.152:0/1025385707 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f2006eb10 con 0x7f0f2015a010 2024-04-17T08:47:36.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.689+0000 7f0f1cc00640 1 -- 172.21.15.152:0/1025385707 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f10014a00 con 0x7f0f2015a010 2024-04-17T08:47:36.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.689+0000 7f0f27000640 1 -- 172.21.15.152:0/1025385707 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f2006f0d0 con 0x7f0f2015a010 2024-04-17T08:47:36.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.689+0000 7f0f27000640 1 -- 172.21.15.152:0/1025385707 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f20160530 con 0x7f0f2015a010 2024-04-17T08:47:36.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.689+0000 7f0f1cc00640 1 -- 172.21.15.152:0/1025385707 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0f10014ba0 con 0x7f0f2015a010 2024-04-17T08:47:36.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.689+0000 7f0f1cc00640 1 --2- 172.21.15.152:0/1025385707 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0efc068380 0x7f0efc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:36.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.689+0000 7f0f1cc00640 1 -- 172.21.15.152:0/1025385707 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f0f10087720 con 0x7f0f2015a010 2024-04-17T08:47:36.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.689+0000 7f0f17400640 1 --2- 172.21.15.152:0/1025385707 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0efc068380 0x7f0efc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:36.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.693+0000 7f0f17400640 1 --2- 172.21.15.152:0/1025385707 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0efc068380 0x7f0efc06a840 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0f080011f0 tx=0x7f0f08007920 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:36.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.693+0000 7f0f1cc00640 1 -- 172.21.15.152:0/1025385707 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f0f100578c0 con 0x7f0f2015a010 2024-04-17T08:47:36.854 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.853+0000 7f0f27000640 1 -- 172.21.15.152:0/1025385707 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0f2006c940 con 0x7f0f2015a010 2024-04-17T08:47:36.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.853+0000 7f0f1cc00640 1 -- 172.21.15.152:0/1025385707 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18972 (secure 0 0 0) 0x7f0f100571c0 con 0x7f0f2015a010 2024-04-17T08:47:36.856 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:47:36.856 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":26,"fsid":"ce68f82e-ec5f-4205-9fd5-bdfdf6ef31e2","created":"2024-04-17T08:46:08.353546+0000","modified":"2024-04-17T08:47:15.280634+0000","last_up_change":"2024-04-17T08:46:20.738799+0000","last_in_change":"2024-04-17T08:46:11.210050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T08:46:21.386856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T08:46:31.812460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T08:46:32.555559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T08:46:36.258078+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"682f0192-187c-404e-bc7a-b6b4e23825e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6819","nonce":3603799291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6823","nonce":3603799291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6831","nonce":3603799291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6827","nonce":3603799291}]},"public_addr":"172.21.15.152:6819/3603799291","cluster_addr":"172.21.15.152:6823/3603799291","heartbeat_back_addr":"172.21.15.152:6831/3603799291","heartbeat_front_addr":"172.21.15.152:6827/3603799291","state":["exists","up"]},{"osd":1,"uuid":"f0fe8fef-60ec-4a39-83b6-2fa6a5adb0f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6801","nonce":4133383142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6803","nonce":4133383142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6807","nonce":4133383142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6805","nonce":4133383142}]},"public_addr":"172.21.15.152:6801/4133383142","cluster_addr":"172.21.15.152:6803/4133383142","heartbeat_back_addr":"172.21.15.152:6807/4133383142","heartbeat_front_addr":"172.21.15.152:6805/4133383142","state":["exists","up"]},{"osd":2,"uuid":"35f36d9c-5245-4431-a618-f4df0fa380ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6809","nonce":3826143898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6811","nonce":3826143898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6815","nonce":3826143898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6813","nonce":3826143898}]},"public_addr":"172.21.15.152:6809/3826143898","cluster_addr":"172.21.15.152:6811/3826143898","heartbeat_back_addr":"172.21.15.152:6815/3826143898","heartbeat_front_addr":"172.21.15.152:6813/3826143898","state":["exists","up"]},{"osd":3,"uuid":"96e56ca5-15b4-4895-9b79-da2c92043159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6818","nonce":165717826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6822","nonce":165717826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6830","nonce":165717826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6826","nonce":165717826}]},"public_addr":"172.21.15.152:6818/165717826","cluster_addr":"172.21.15.152:6822/165717826","heartbeat_back_addr":"172.21.15.152:6830/165717826","heartbeat_front_addr":"172.21.15.152:6826/165717826","state":["exists","up"]},{"osd":4,"uuid":"f5aa10a4-9ff9-41fe-a5c9-15326f982cc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6817","nonce":4080159297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6819","nonce":4080159297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6823","nonce":4080159297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6821","nonce":4080159297}]},"public_addr":"172.21.15.196:6817/4080159297","cluster_addr":"172.21.15.196:6819/4080159297","heartbeat_back_addr":"172.21.15.196:6823/4080159297","heartbeat_front_addr":"172.21.15.196:6821/4080159297","state":["exists","up"]},{"osd":5,"uuid":"42bab884-3476-47ae-ac65-935fa6e0f055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6801","nonce":3519444232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6803","nonce":3519444232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6807","nonce":3519444232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6805","nonce":3519444232}]},"public_addr":"172.21.15.196:6801/3519444232","cluster_addr":"172.21.15.196:6803/3519444232","heartbeat_back_addr":"172.21.15.196:6807/3519444232","heartbeat_front_addr":"172.21.15.196:6805/3519444232","state":["exists","up"]},{"osd":6,"uuid":"460b6167-f57b-4224-9c92-cfc9b80bbe99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6809","nonce":275739834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6811","nonce":275739834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6815","nonce":275739834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6813","nonce":275739834}]},"public_addr":"172.21.15.196:6809/275739834","cluster_addr":"172.21.15.196:6811/275739834","heartbeat_back_addr":"172.21.15.196:6815/275739834","heartbeat_front_addr":"172.21.15.196:6813/275739834","state":["exists","up"]},{"osd":7,"uuid":"d695643f-5e07-4e2a-a646-c06bd97b6650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6825","nonce":307626968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6827","nonce":307626968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6831","nonce":307626968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6829","nonce":307626968}]},"public_addr":"172.21.15.196:6825/307626968","cluster_addr":"172.21.15.196:6827/307626968","heartbeat_back_addr":"172.21.15.196:6831/307626968","heartbeat_front_addr":"172.21.15.196:6829/307626968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.293257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.964533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.248895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.010000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.832554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.743704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930171+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930962+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T08:47:36.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.857+0000 7f0f27000640 1 -- 172.21.15.152:0/1025385707 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0efc068380 msgr2=0x7f0efc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:36.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.857+0000 7f0f27000640 1 --2- 172.21.15.152:0/1025385707 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0efc068380 0x7f0efc06a840 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0f080011f0 tx=0x7f0f08007920 comp rx=0 tx=0).stop 2024-04-17T08:47:36.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.857+0000 7f0f27000640 1 -- 172.21.15.152:0/1025385707 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f2015a010 msgr2=0x7f0f200991a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:36.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.857+0000 7f0f27000640 1 --2- 172.21.15.152:0/1025385707 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f2015a010 0x7f0f200991a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0f10007ef0 tx=0x7f0f1000e4b0 comp rx=0 tx=0).stop 2024-04-17T08:47:36.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.857+0000 7f0f27000640 1 -- 172.21.15.152:0/1025385707 shutdown_connections 2024-04-17T08:47:36.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.857+0000 7f0f27000640 1 --2- 172.21.15.152:0/1025385707 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0f20160720 0x7f0f2015bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:36.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.857+0000 7f0f27000640 1 --2- 172.21.15.152:0/1025385707 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0efc068380 0x7f0efc06a840 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:36.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.857+0000 7f0f27000640 1 --2- 172.21.15.152:0/1025385707 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0f2015d710 0x7f0f2015b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:36.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.857+0000 7f0f27000640 1 --2- 172.21.15.152:0/1025385707 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f2015a010 0x7f0f200991a0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:36.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.857+0000 7f0f27000640 1 -- 172.21.15.152:0/1025385707 >> 172.21.15.152:0/1025385707 conn(0x7f0f200b3350 msgr2=0x7f0f200725c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:36.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.857+0000 7f0f27000640 1 -- 172.21.15.152:0/1025385707 shutdown_connections 2024-04-17T08:47:36.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:36.857+0000 7f0f27000640 1 -- 172.21.15.152:0/1025385707 wait complete. 2024-04-17T08:47:36.877 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T08:46:21.386856+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-17T08:46:31.812460+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-17T08:46:32.555559+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-17T08:46:36.258078+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-17T08:47:36.877 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T08:47:37.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.013+0000 7f177dc00640 1 Processor -- start 2024-04-17T08:47:37.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.013+0000 7f177dc00640 1 -- start start 2024-04-17T08:47:37.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.013+0000 7f177dc00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f17780af670 0x7f177815b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:37.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.013+0000 7f177dc00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1778072c40 con 0x7f177806f980 2024-04-17T08:47:37.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.013+0000 7f177dc00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f177815c260 con 0x7f17780d0360 2024-04-17T08:47:37.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.013+0000 7f177dc00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f177815c820 con 0x7f17780af670 2024-04-17T08:47:37.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.013+0000 7f1776a00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f17780af670 0x7f177815b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:37.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.013+0000 7f1776a00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f17780af670 0x7f177815b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33224/0 (socket says 172.21.15.152:33224) 2024-04-17T08:47:37.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.013+0000 7f1776a00640 1 -- 172.21.15.152:0/1916635085 learned_addr learned my addr 172.21.15.152:0/1916635085 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:37.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.013+0000 7f1776000640 1 --1- 172.21.15.152:0/1916635085 >> v1:172.21.15.152:6789/0 conn(0x7f177806f980 0x7f1778072530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:60616/0 (socket says 172.21.15.152:60616) 2024-04-17T08:47:37.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.013+0000 7f1776a00640 1 -- 172.21.15.152:0/1916635085 >> v1:172.21.15.196:6789/0 conn(0x7f17780d0360 legacy=0x7f177806dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:37.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.013+0000 7f1776a00640 1 -- 172.21.15.152:0/1916635085 >> v1:172.21.15.152:6789/0 conn(0x7f177806f980 legacy=0x7f1778072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:37.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.013+0000 7f1776a00640 1 -- 172.21.15.152:0/1916635085 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f177815c540 con 0x7f17780af670 2024-04-17T08:47:37.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.013+0000 7f1775600640 1 -- 172.21.15.152:0/1916635085 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3945205388 0 0) 0x7f1778072c40 con 0x7f177806f980 2024-04-17T08:47:37.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.017+0000 7f1776a00640 1 --2- 172.21.15.152:0/1916635085 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17780af670 0x7f177815b8c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f1760009870 tx=0x7f176001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62928462f81a9af9 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:37.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.017+0000 7f1775600640 1 -- 172.21.15.152:0/1916635085 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17600ab660 con 0x7f17780af670 2024-04-17T08:47:37.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.017+0000 7f1775600640 1 -- 172.21.15.152:0/1916635085 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17600b0070 con 0x7f17780af670 2024-04-17T08:47:37.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.017+0000 7f1775600640 1 -- 172.21.15.152:0/1916635085 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17600aba20 con 0x7f17780af670 2024-04-17T08:47:37.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.017+0000 7f177dc00640 1 -- 172.21.15.152:0/1916635085 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17780af670 msgr2=0x7f177815b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:37.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.017+0000 7f177dc00640 1 --2- 172.21.15.152:0/1916635085 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17780af670 0x7f177815b8c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f1760009870 tx=0x7f176001c460 comp rx=0 tx=0).stop 2024-04-17T08:47:37.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.017+0000 7f177dc00640 1 -- 172.21.15.152:0/1916635085 shutdown_connections 2024-04-17T08:47:37.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.017+0000 7f177dc00640 1 --2- 172.21.15.152:0/1916635085 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17780af670 0x7f177815b8c0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:37.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.017+0000 7f177dc00640 1 -- 172.21.15.152:0/1916635085 >> 172.21.15.152:0/1916635085 conn(0x7f17780b3350 msgr2=0x7f17780b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:37.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.017+0000 7f177dc00640 1 -- 172.21.15.152:0/1916635085 shutdown_connections 2024-04-17T08:47:37.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.017+0000 7f177dc00640 1 -- 172.21.15.152:0/1916635085 wait complete. 2024-04-17T08:47:37.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.021+0000 7f177dc00640 1 Processor -- start 2024-04-17T08:47:37.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.021+0000 7f177dc00640 1 -- start start 2024-04-17T08:47:37.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.021+0000 7f177dc00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f177806f980 0x7f1778155f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:37.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.021+0000 7f177dc00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17780af670 0x7f1778151e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:37.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.021+0000 7f177dc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f17780d0360 0x7f1778142450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:37.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.021+0000 7f177dc00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f177815be00 con 0x7f17780af670 2024-04-17T08:47:37.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.021+0000 7f177dc00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f17780d0bc0 con 0x7f177806f980 2024-04-17T08:47:37.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.021+0000 7f177dc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f177815bf80 con 0x7f17780d0360 2024-04-17T08:47:37.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.021+0000 7f1776000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17780af670 0x7f1778151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:37.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.021+0000 7f1776000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17780af670 0x7f1778151e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33234/0 (socket says 172.21.15.152:33234) 2024-04-17T08:47:37.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.021+0000 7f1776000640 1 -- 172.21.15.152:0/1379742450 learned_addr learned my addr 172.21.15.152:0/1379742450 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:37.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.021+0000 7f1776a00640 1 --2- 172.21.15.152:0/1379742450 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f177806f980 0x7f1778155f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:37.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.021+0000 7f1777400640 1 --2- 172.21.15.152:0/1379742450 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f17780d0360 0x7f1778142450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:37.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.021+0000 7f1776000640 1 -- 172.21.15.152:0/1379742450 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f17780d0360 msgr2=0x7f1778142450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:37.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.021+0000 7f1776000640 1 --2- 172.21.15.152:0/1379742450 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f17780d0360 0x7f1778142450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:37.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.021+0000 7f1776000640 1 -- 172.21.15.152:0/1379742450 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f177806f980 msgr2=0x7f1778155f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:37.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.021+0000 7f1776000640 1 --2- 172.21.15.152:0/1379742450 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f177806f980 0x7f1778155f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:37.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.021+0000 7f1776000640 1 -- 172.21.15.152:0/1379742450 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1778142990 con 0x7f17780af670 2024-04-17T08:47:37.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.021+0000 7f1776000640 1 --2- 172.21.15.152:0/1379742450 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17780af670 0x7f1778151e30 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f176800c4b0 tx=0x7f176800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:37.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.021+0000 7f176ea00640 1 -- 172.21.15.152:0/1379742450 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1768018070 con 0x7f17780af670 2024-04-17T08:47:37.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.021+0000 7f176ea00640 1 -- 172.21.15.152:0/1379742450 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1768007500 con 0x7f17780af670 2024-04-17T08:47:37.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.021+0000 7f177dc00640 1 -- 172.21.15.152:0/1379742450 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1778157c90 con 0x7f17780af670 2024-04-17T08:47:37.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.021+0000 7f176ea00640 1 -- 172.21.15.152:0/1379742450 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1768004a30 con 0x7f17780af670 2024-04-17T08:47:37.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.021+0000 7f177dc00640 1 -- 172.21.15.152:0/1379742450 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1778158250 con 0x7f17780af670 2024-04-17T08:47:37.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.021+0000 7f177dc00640 1 -- 172.21.15.152:0/1379742450 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1778068a30 con 0x7f17780af670 2024-04-17T08:47:37.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.025+0000 7f176ea00640 1 -- 172.21.15.152:0/1379742450 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f176801b070 con 0x7f17780af670 2024-04-17T08:47:37.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.025+0000 7f176ea00640 1 --2- 172.21.15.152:0/1379742450 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1754068380 0x7f175406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:37.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.025+0000 7f176ea00640 1 -- 172.21.15.152:0/1379742450 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f1768086060 con 0x7f17780af670 2024-04-17T08:47:37.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.025+0000 7f1776a00640 1 --2- 172.21.15.152:0/1379742450 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1754068380 0x7f175406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:37.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.025+0000 7f1776a00640 1 --2- 172.21.15.152:0/1379742450 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1754068380 0x7f175406a840 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f17600af000 tx=0x7f17600a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:37.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.029+0000 7f176ea00640 1 -- 172.21.15.152:0/1379742450 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f1768055c60 con 0x7f17780af670 2024-04-17T08:47:37.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.185+0000 7f177dc00640 1 -- 172.21.15.152:0/1379742450 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f17780aea60 con 0x7f17780af670 2024-04-17T08:47:37.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.185+0000 7f176ea00640 1 -- 172.21.15.152:0/1379742450 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f1768059f60 con 0x7f17780af670 2024-04-17T08:47:37.188 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2024-04-17T08:47:37.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.189+0000 7f177dc00640 1 -- 172.21.15.152:0/1379742450 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1754068380 msgr2=0x7f175406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:37.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.189+0000 7f177dc00640 1 --2- 172.21.15.152:0/1379742450 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1754068380 0x7f175406a840 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f17600af000 tx=0x7f17600a7000 comp rx=0 tx=0).stop 2024-04-17T08:47:37.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.189+0000 7f177dc00640 1 -- 172.21.15.152:0/1379742450 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17780af670 msgr2=0x7f1778151e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:37.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.189+0000 7f177dc00640 1 --2- 172.21.15.152:0/1379742450 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17780af670 0x7f1778151e30 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f176800c4b0 tx=0x7f176800c970 comp rx=0 tx=0).stop 2024-04-17T08:47:37.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.189+0000 7f177dc00640 1 -- 172.21.15.152:0/1379742450 shutdown_connections 2024-04-17T08:47:37.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.189+0000 7f177dc00640 1 --2- 172.21.15.152:0/1379742450 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1754068380 0x7f175406a840 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:37.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.189+0000 7f177dc00640 1 --2- 172.21.15.152:0/1379742450 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f17780d0360 0x7f1778142450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:37.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.189+0000 7f177dc00640 1 --2- 172.21.15.152:0/1379742450 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17780af670 0x7f1778151e30 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:37.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.189+0000 7f177dc00640 1 --2- 172.21.15.152:0/1379742450 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f177806f980 0x7f1778155f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:37.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.189+0000 7f177dc00640 1 -- 172.21.15.152:0/1379742450 >> 172.21.15.152:0/1379742450 conn(0x7f17780b3350 msgr2=0x7f177815ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:37.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.189+0000 7f177dc00640 1 -- 172.21.15.152:0/1379742450 shutdown_connections 2024-04-17T08:47:37.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.189+0000 7f177dc00640 1 -- 172.21.15.152:0/1379742450 wait complete. 2024-04-17T08:47:37.209 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-17T08:47:37.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.349+0000 7fed70a00640 1 Processor -- start 2024-04-17T08:47:37.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.349+0000 7fed70a00640 1 -- start start 2024-04-17T08:47:37.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.349+0000 7fed70a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fed6c0af670 0x7fed6c15b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:37.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.349+0000 7fed70a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fed6c0d0360 0x7fed6c0d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:37.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.349+0000 7fed70a00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed6c072c40 con 0x7fed6c06f980 2024-04-17T08:47:37.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.349+0000 7fed70a00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fed6c15c820 con 0x7fed6c0d0360 2024-04-17T08:47:37.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.349+0000 7fed70a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fed6c15c260 con 0x7fed6c0af670 2024-04-17T08:47:37.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.349+0000 7fed63e00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fed6c06f980 0x7fed6c072530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:60632/0 (socket says 172.21.15.152:60632) 2024-04-17T08:47:37.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.349+0000 7fed63e00640 1 -- 172.21.15.152:0/3897304676 learned_addr learned my addr 172.21.15.152:0/3897304676 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:37.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.349+0000 7fed69e00640 1 --2- 172.21.15.152:0/3897304676 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fed6c0af670 0x7fed6c15b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:37.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.349+0000 7fed6a800640 1 --2- 172.21.15.152:0/3897304676 >> v2:172.21.15.196:3300/0 conn(0x7fed6c0d0360 0x7fed6c0d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:37.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.349+0000 7fed69400640 1 -- 172.21.15.152:0/3897304676 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2178341365 0 0) 0x7fed6c072c40 con 0x7fed6c06f980 2024-04-17T08:47:37.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.349+0000 7fed69400640 1 -- 172.21.15.152:0/3897304676 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed50003530 con 0x7fed6c06f980 2024-04-17T08:47:37.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.349+0000 7fed69400640 1 -- 172.21.15.152:0/3897304676 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1699856777 0 0) 0x7fed50003530 con 0x7fed6c06f980 2024-04-17T08:47:37.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.349+0000 7fed69400640 1 -- 172.21.15.152:0/3897304676 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fed6c0af670 msgr2=0x7fed6c15b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:37.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.349+0000 7fed69400640 1 --2- 172.21.15.152:0/3897304676 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fed6c0af670 0x7fed6c15b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:37.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.349+0000 7fed69400640 1 -- 172.21.15.152:0/3897304676 >> v2:172.21.15.196:3300/0 conn(0x7fed6c0d0360 msgr2=0x7fed6c0d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:37.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.349+0000 7fed69400640 1 --2- 172.21.15.152:0/3897304676 >> v2:172.21.15.196:3300/0 conn(0x7fed6c0d0360 0x7fed6c0d07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:37.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.349+0000 7fed69400640 1 -- 172.21.15.152:0/3897304676 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed6c15c540 con 0x7fed6c06f980 2024-04-17T08:47:37.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.349+0000 7fed69400640 1 -- 172.21.15.152:0/3897304676 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2973887244 0 0) 0x7fed54001680 con 0x7fed6c06f980 2024-04-17T08:47:37.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.349+0000 7fed69400640 1 -- 172.21.15.152:0/3897304676 >> v1:172.21.15.152:6789/0 conn(0x7fed6c06f980 legacy=0x7fed6c072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:37.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.349+0000 7fed69400640 1 --2- 172.21.15.152:0/3897304676 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fed500039c0 0x7fed50003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:37.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.349+0000 7fed69400640 1 --2- 172.21.15.152:0/3897304676 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fed6c0af670 0x7fed50004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:37.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.349+0000 7fed69400640 1 --2- 172.21.15.152:0/3897304676 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed50004d50 0x7fed500051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:37.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.349+0000 7fed69400640 1 -- 172.21.15.152:0/3897304676 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fed6c15c820 con 0x7fed50004d50 2024-04-17T08:47:37.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.349+0000 7fed69400640 1 -- 172.21.15.152:0/3897304676 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fed6c15c260 con 0x7fed500039c0 2024-04-17T08:47:37.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.349+0000 7fed69400640 1 -- 172.21.15.152:0/3897304676 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fed5000b9d0 con 0x7fed6c0af670 2024-04-17T08:47:37.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.349+0000 7fed6a800640 1 --2- 172.21.15.152:0/3897304676 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed50004d50 0x7fed500051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:37.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.349+0000 7fed69e00640 1 --2- 172.21.15.152:0/3897304676 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fed500039c0 0x7fed50003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:37.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.349+0000 7fed63e00640 1 --2- 172.21.15.152:0/3897304676 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fed6c0af670 0x7fed50004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:37.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.349+0000 7fed6a800640 1 -- 172.21.15.152:0/3897304676 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fed6c0af670 msgr2=0x7fed50004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:37.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.349+0000 7fed6a800640 1 --2- 172.21.15.152:0/3897304676 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fed6c0af670 0x7fed50004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:37.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.349+0000 7fed6a800640 1 -- 172.21.15.152:0/3897304676 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fed500039c0 msgr2=0x7fed50003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:37.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.349+0000 7fed6a800640 1 --2- 172.21.15.152:0/3897304676 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fed500039c0 0x7fed50003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:37.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.349+0000 7fed6a800640 1 -- 172.21.15.152:0/3897304676 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed50003530 con 0x7fed50004d50 2024-04-17T08:47:37.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.349+0000 7fed63e00640 1 --2- 172.21.15.152:0/3897304676 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fed6c0af670 0x7fed50004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:37.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.353+0000 7fed6a800640 1 --2- 172.21.15.152:0/3897304676 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed50004d50 0x7fed500051d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fed64009fc0 tx=0x7fed6401eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2204886ca71f9b0e server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:37.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.353+0000 7fed69400640 1 -- 172.21.15.152:0/3897304676 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed640b4070 con 0x7fed50004d50 2024-04-17T08:47:37.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.353+0000 7fed69400640 1 -- 172.21.15.152:0/3897304676 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed640af440 con 0x7fed50004d50 2024-04-17T08:47:37.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.353+0000 7fed69400640 1 -- 172.21.15.152:0/3897304676 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed64009c10 con 0x7fed50004d50 2024-04-17T08:47:37.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.353+0000 7fed70a00640 1 -- 172.21.15.152:0/3897304676 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed50004d50 msgr2=0x7fed500051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:37.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.353+0000 7fed70a00640 1 --2- 172.21.15.152:0/3897304676 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed50004d50 0x7fed500051d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fed64009fc0 tx=0x7fed6401eed0 comp rx=0 tx=0).stop 2024-04-17T08:47:37.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.353+0000 7fed6a800640 1 -- 172.21.15.152:0/3897304676 reap_dead start 2024-04-17T08:47:37.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.353+0000 7fed70a00640 1 -- 172.21.15.152:0/3897304676 shutdown_connections 2024-04-17T08:47:37.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.353+0000 7fed70a00640 1 -- 172.21.15.152:0/3897304676 >> 172.21.15.152:0/3897304676 conn(0x7fed6c0b3350 msgr2=0x7fed6c0b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:37.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.353+0000 7fed70a00640 1 -- 172.21.15.152:0/3897304676 shutdown_connections 2024-04-17T08:47:37.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.353+0000 7fed70a00640 1 -- 172.21.15.152:0/3897304676 wait complete. 2024-04-17T08:47:37.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.357+0000 7fed70a00640 1 Processor -- start 2024-04-17T08:47:37.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.357+0000 7fed70a00640 1 -- start start 2024-04-17T08:47:37.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.357+0000 7fed70a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed50004d50 0x7fed6c14d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:37.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.357+0000 7fed70a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fed6c0cee80 0x7fed6c0b0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:37.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.357+0000 7fed70a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fed6c0cd470 0x7fed6c159480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:37.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.357+0000 7fed70a00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fed6c0afa50 con 0x7fed50004d50 2024-04-17T08:47:37.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.357+0000 7fed70a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fed6c072010 con 0x7fed6c0cee80 2024-04-17T08:47:37.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.357+0000 7fed70a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fed6c15b8c0 con 0x7fed6c0cd470 2024-04-17T08:47:37.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.357+0000 7fed69e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed50004d50 0x7fed6c14d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:37.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.357+0000 7fed69e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed50004d50 0x7fed6c14d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33264/0 (socket says 172.21.15.152:33264) 2024-04-17T08:47:37.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.357+0000 7fed69e00640 1 -- 172.21.15.152:0/2280141123 learned_addr learned my addr 172.21.15.152:0/2280141123 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:37.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.357+0000 7fed63e00640 1 --2- 172.21.15.152:0/2280141123 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fed6c0cee80 0x7fed6c0b0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:37.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.357+0000 7fed6a800640 1 --2- 172.21.15.152:0/2280141123 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fed6c0cd470 0x7fed6c159480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:37.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.357+0000 7fed69e00640 1 -- 172.21.15.152:0/2280141123 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fed6c0cd470 msgr2=0x7fed6c159480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:37.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.357+0000 7fed69e00640 1 --2- 172.21.15.152:0/2280141123 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fed6c0cd470 0x7fed6c159480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:37.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.357+0000 7fed69e00640 1 -- 172.21.15.152:0/2280141123 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fed6c0cee80 msgr2=0x7fed6c0b0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:37.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.357+0000 7fed69e00640 1 --2- 172.21.15.152:0/2280141123 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fed6c0cee80 0x7fed6c0b0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:37.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.357+0000 7fed69e00640 1 -- 172.21.15.152:0/2280141123 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed6c0b14d0 con 0x7fed50004d50 2024-04-17T08:47:37.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.357+0000 7fed69e00640 1 --2- 172.21.15.152:0/2280141123 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed50004d50 0x7fed6c14d520 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fed5c011990 tx=0x7fed5c011d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:37.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.357+0000 7fed62000640 1 -- 172.21.15.152:0/2280141123 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed5c00fa30 con 0x7fed50004d50 2024-04-17T08:47:37.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.357+0000 7fed62000640 1 -- 172.21.15.152:0/2280141123 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed5c00fbd0 con 0x7fed50004d50 2024-04-17T08:47:37.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.357+0000 7fed70a00640 1 -- 172.21.15.152:0/2280141123 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed6c0b17b0 con 0x7fed50004d50 2024-04-17T08:47:37.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.357+0000 7fed62000640 1 -- 172.21.15.152:0/2280141123 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed5c014440 con 0x7fed50004d50 2024-04-17T08:47:37.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.357+0000 7fed70a00640 1 -- 172.21.15.152:0/2280141123 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed6c0ce680 con 0x7fed50004d50 2024-04-17T08:47:37.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.361+0000 7fed70a00640 1 -- 172.21.15.152:0/2280141123 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed6c068a30 con 0x7fed50004d50 2024-04-17T08:47:37.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.361+0000 7fed62000640 1 -- 172.21.15.152:0/2280141123 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fed5c012040 con 0x7fed50004d50 2024-04-17T08:47:37.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.361+0000 7fed62000640 1 --2- 172.21.15.152:0/2280141123 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fed480683b0 0x7fed4806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:37.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.361+0000 7fed62000640 1 -- 172.21.15.152:0/2280141123 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fed5c087310 con 0x7fed50004d50 2024-04-17T08:47:37.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.361+0000 7fed63e00640 1 --2- 172.21.15.152:0/2280141123 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fed480683b0 0x7fed4806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:37.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.361+0000 7fed63e00640 1 --2- 172.21.15.152:0/2280141123 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fed480683b0 0x7fed4806a870 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fed6c15e710 tx=0x7fed54001440 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:37.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.365+0000 7fed62000640 1 -- 172.21.15.152:0/2280141123 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fed5c019030 con 0x7fed50004d50 2024-04-17T08:47:37.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.525+0000 7fed70a00640 1 -- 172.21.15.152:0/2280141123 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fed6c073630 con 0x7fed50004d50 2024-04-17T08:47:37.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.525+0000 7fed62000640 1 -- 172.21.15.152:0/2280141123 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7fed5c0574a0 con 0x7fed50004d50 2024-04-17T08:47:37.528 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-04-17T08:47:37.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.529+0000 7fed70a00640 1 -- 172.21.15.152:0/2280141123 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fed480683b0 msgr2=0x7fed4806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:37.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.529+0000 7fed70a00640 1 --2- 172.21.15.152:0/2280141123 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fed480683b0 0x7fed4806a870 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fed6c15e710 tx=0x7fed54001440 comp rx=0 tx=0).stop 2024-04-17T08:47:37.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.529+0000 7fed70a00640 1 -- 172.21.15.152:0/2280141123 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed50004d50 msgr2=0x7fed6c14d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:37.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.529+0000 7fed70a00640 1 --2- 172.21.15.152:0/2280141123 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed50004d50 0x7fed6c14d520 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fed5c011990 tx=0x7fed5c011d90 comp rx=0 tx=0).stop 2024-04-17T08:47:37.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.529+0000 7fed70a00640 1 -- 172.21.15.152:0/2280141123 shutdown_connections 2024-04-17T08:47:37.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.529+0000 7fed70a00640 1 --2- 172.21.15.152:0/2280141123 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fed480683b0 0x7fed4806a870 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:37.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.529+0000 7fed70a00640 1 --2- 172.21.15.152:0/2280141123 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fed6c0cd470 0x7fed6c159480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:37.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.529+0000 7fed70a00640 1 --2- 172.21.15.152:0/2280141123 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fed6c0cee80 0x7fed6c0b0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:37.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.529+0000 7fed70a00640 1 --2- 172.21.15.152:0/2280141123 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed50004d50 0x7fed6c14d520 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:37.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.529+0000 7fed70a00640 1 -- 172.21.15.152:0/2280141123 >> 172.21.15.152:0/2280141123 conn(0x7fed6c0b3350 msgr2=0x7fed6c15ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:37.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.529+0000 7fed70a00640 1 -- 172.21.15.152:0/2280141123 shutdown_connections 2024-04-17T08:47:37.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.529+0000 7fed70a00640 1 -- 172.21.15.152:0/2280141123 wait complete. 2024-04-17T08:47:37.549 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-17T08:47:37.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.685+0000 7f922fc00640 1 Processor -- start 2024-04-17T08:47:37.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.685+0000 7f922fc00640 1 -- start start 2024-04-17T08:47:37.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.685+0000 7f922fc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f922815a010 0x7f92280d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:37.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.685+0000 7f922fc00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f922815d710 0x7f92280d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:37.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.685+0000 7f922fc00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9228160d20 con 0x7f9228160010 2024-04-17T08:47:37.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.685+0000 7f922fc00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f922815d280 con 0x7f922815d710 2024-04-17T08:47:37.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.685+0000 7f922fc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f922815c9d0 con 0x7f922815a010 2024-04-17T08:47:37.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.685+0000 7f922dc00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f9228160010 0x7f9228160480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:60640/0 (socket says 172.21.15.152:60640) 2024-04-17T08:47:37.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.685+0000 7f922dc00640 1 -- 172.21.15.152:0/2941693783 learned_addr learned my addr 172.21.15.152:0/2941693783 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:37.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.685+0000 7f9227e00640 1 --2- 172.21.15.152:0/2941693783 >> v2:172.21.15.196:3300/0 conn(0x7f922815d710 0x7f92280d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:37.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.685+0000 7f922d200640 1 --2- 172.21.15.152:0/2941693783 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f922815a010 0x7f92280d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:37.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.685+0000 7f9227400640 1 -- 172.21.15.152:0/2941693783 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2295829778 0 0) 0x7f9228160d20 con 0x7f9228160010 2024-04-17T08:47:37.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.685+0000 7f9227400640 1 -- 172.21.15.152:0/2941693783 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9210003530 con 0x7f9228160010 2024-04-17T08:47:37.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.685+0000 7f9227400640 1 -- 172.21.15.152:0/2941693783 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4069476926 0 0) 0x7f9210003530 con 0x7f9228160010 2024-04-17T08:47:37.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.685+0000 7f9227400640 1 -- 172.21.15.152:0/2941693783 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f922815a010 msgr2=0x7f92280d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:37.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.685+0000 7f9227400640 1 --2- 172.21.15.152:0/2941693783 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f922815a010 0x7f92280d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:37.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.685+0000 7f9227400640 1 -- 172.21.15.152:0/2941693783 >> v2:172.21.15.196:3300/0 conn(0x7f922815d710 msgr2=0x7f92280d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:37.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.685+0000 7f9227400640 1 --2- 172.21.15.152:0/2941693783 >> v2:172.21.15.196:3300/0 conn(0x7f922815d710 0x7f92280d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:37.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.685+0000 7f9227400640 1 -- 172.21.15.152:0/2941693783 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f922815cc30 con 0x7f9228160010 2024-04-17T08:47:37.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.685+0000 7f9227400640 1 -- 172.21.15.152:0/2941693783 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2973887244 0 0) 0x7f9220001a00 con 0x7f9228160010 2024-04-17T08:47:37.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.685+0000 7f9227400640 1 -- 172.21.15.152:0/2941693783 >> v1:172.21.15.152:6789/0 conn(0x7f9228160010 legacy=0x7f9228160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:37.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.685+0000 7f9227400640 1 --2- 172.21.15.152:0/2941693783 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f922815a010 0x7f92100039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:37.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.685+0000 7f9227400640 1 --2- 172.21.15.152:0/2941693783 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9210003f40 0x7f9210004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:37.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.685+0000 7f9227400640 1 --2- 172.21.15.152:0/2941693783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9210004d50 0x7f92100051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:37.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.685+0000 7f9227400640 1 -- 172.21.15.152:0/2941693783 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f922815d280 con 0x7f9210004d50 2024-04-17T08:47:37.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.685+0000 7f9227400640 1 -- 172.21.15.152:0/2941693783 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f922815c9d0 con 0x7f9210003f40 2024-04-17T08:47:37.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.685+0000 7f9227400640 1 -- 172.21.15.152:0/2941693783 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f921000ba20 con 0x7f922815a010 2024-04-17T08:47:37.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.685+0000 7f922dc00640 1 --2- 172.21.15.152:0/2941693783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9210004d50 0x7f92100051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:37.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.685+0000 7f922d200640 1 --2- 172.21.15.152:0/2941693783 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f922815a010 0x7f92100039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:37.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.685+0000 7f9227e00640 1 --2- 172.21.15.152:0/2941693783 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9210003f40 0x7f9210004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:37.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.685+0000 7f922dc00640 1 -- 172.21.15.152:0/2941693783 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f922815a010 msgr2=0x7f92100039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:37.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.685+0000 7f922dc00640 1 --2- 172.21.15.152:0/2941693783 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f922815a010 0x7f92100039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:37.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.685+0000 7f922dc00640 1 -- 172.21.15.152:0/2941693783 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9210003f40 msgr2=0x7f9210004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:37.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.685+0000 7f922dc00640 1 --2- 172.21.15.152:0/2941693783 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9210003f40 0x7f9210004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:37.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.685+0000 7f922dc00640 1 -- 172.21.15.152:0/2941693783 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9210003530 con 0x7f9210004d50 2024-04-17T08:47:37.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.689+0000 7f922dc00640 1 --2- 172.21.15.152:0/2941693783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9210004d50 0x7f92100051d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f922000a8b0 tx=0x7f922001fb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25fc20557f6dc37a server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:37.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.689+0000 7f9227400640 1 -- 172.21.15.152:0/2941693783 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f922000a4a0 con 0x7f9210004d50 2024-04-17T08:47:37.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.689+0000 7f9227400640 1 -- 172.21.15.152:0/2941693783 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92200ad020 con 0x7f9210004d50 2024-04-17T08:47:37.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.689+0000 7f9227400640 1 -- 172.21.15.152:0/2941693783 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92200a9740 con 0x7f9210004d50 2024-04-17T08:47:37.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.689+0000 7f922fc00640 1 -- 172.21.15.152:0/2941693783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9210004d50 msgr2=0x7f92100051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:37.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.689+0000 7f922fc00640 1 --2- 172.21.15.152:0/2941693783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9210004d50 0x7f92100051d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f922000a8b0 tx=0x7f922001fb00 comp rx=0 tx=0).stop 2024-04-17T08:47:37.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.689+0000 7f922dc00640 1 -- 172.21.15.152:0/2941693783 reap_dead start 2024-04-17T08:47:37.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.689+0000 7f922fc00640 1 -- 172.21.15.152:0/2941693783 shutdown_connections 2024-04-17T08:47:37.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.689+0000 7f922fc00640 1 -- 172.21.15.152:0/2941693783 >> 172.21.15.152:0/2941693783 conn(0x7f92280b3350 msgr2=0x7f92280b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:37.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.689+0000 7f922fc00640 1 -- 172.21.15.152:0/2941693783 shutdown_connections 2024-04-17T08:47:37.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.689+0000 7f922fc00640 1 -- 172.21.15.152:0/2941693783 wait complete. 2024-04-17T08:47:37.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.693+0000 7f922fc00640 1 Processor -- start 2024-04-17T08:47:37.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.693+0000 7f922fc00640 1 -- start start 2024-04-17T08:47:37.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.693+0000 7f922fc00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9210004d50 0x7f92281517a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:37.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.693+0000 7f922fc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f92280b01c0 0x7f92281f3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:37.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.693+0000 7f922fc00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f922815b6f0 0x7f922815bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:37.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.693+0000 7f922fc00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f92280d0360 con 0x7f9210004d50 2024-04-17T08:47:37.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.693+0000 7f922fc00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f922815a3f0 con 0x7f922815b6f0 2024-04-17T08:47:37.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.693+0000 7f922fc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f92280d04e0 con 0x7f92280b01c0 2024-04-17T08:47:37.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.693+0000 7f922d200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9210004d50 0x7f92281517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:37.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.693+0000 7f922d200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9210004d50 0x7f92281517a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33276/0 (socket says 172.21.15.152:33276) 2024-04-17T08:47:37.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.693+0000 7f922d200640 1 -- 172.21.15.152:0/2462708346 learned_addr learned my addr 172.21.15.152:0/2462708346 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:37.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.693+0000 7f9227e00640 1 --2- 172.21.15.152:0/2462708346 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f92280b01c0 0x7f92281f3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:37.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.693+0000 7f922dc00640 1 --2- 172.21.15.152:0/2462708346 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f922815b6f0 0x7f922815bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:37.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.693+0000 7f922d200640 1 -- 172.21.15.152:0/2462708346 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f92280b01c0 msgr2=0x7f92281f3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:37.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.693+0000 7f922d200640 1 --2- 172.21.15.152:0/2462708346 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f92280b01c0 0x7f92281f3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:37.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.693+0000 7f922d200640 1 -- 172.21.15.152:0/2462708346 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f922815b6f0 msgr2=0x7f922815bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:37.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.693+0000 7f922d200640 1 --2- 172.21.15.152:0/2462708346 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f922815b6f0 0x7f922815bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:37.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.693+0000 7f922d200640 1 -- 172.21.15.152:0/2462708346 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92280c9510 con 0x7f9210004d50 2024-04-17T08:47:37.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.693+0000 7f922d200640 1 --2- 172.21.15.152:0/2462708346 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9210004d50 0x7f92281517a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f921c011a30 tx=0x7f921c011ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:37.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.693+0000 7f9224c00640 1 -- 172.21.15.152:0/2462708346 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f921c00fb50 con 0x7f9210004d50 2024-04-17T08:47:37.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.693+0000 7f9224c00640 1 -- 172.21.15.152:0/2462708346 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f921c00fcf0 con 0x7f9210004d50 2024-04-17T08:47:37.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.693+0000 7f922fc00640 1 -- 172.21.15.152:0/2462708346 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f922806f7d0 con 0x7f9210004d50 2024-04-17T08:47:37.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.693+0000 7f9224c00640 1 -- 172.21.15.152:0/2462708346 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f921c00fea0 con 0x7f9210004d50 2024-04-17T08:47:37.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.693+0000 7f922fc00640 1 -- 172.21.15.152:0/2462708346 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92280d0a70 con 0x7f9210004d50 2024-04-17T08:47:37.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.697+0000 7f922fc00640 1 -- 172.21.15.152:0/2462708346 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9228068a30 con 0x7f9210004d50 2024-04-17T08:47:37.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.697+0000 7f9224c00640 1 -- 172.21.15.152:0/2462708346 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f921c012040 con 0x7f9210004d50 2024-04-17T08:47:37.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.697+0000 7f9224c00640 1 --2- 172.21.15.152:0/2462708346 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9208068380 0x7f920806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:37.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.697+0000 7f9224c00640 1 -- 172.21.15.152:0/2462708346 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f921c0874f0 con 0x7f9210004d50 2024-04-17T08:47:37.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.697+0000 7f9227e00640 1 --2- 172.21.15.152:0/2462708346 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9208068380 0x7f920806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:37.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.697+0000 7f9227e00640 1 --2- 172.21.15.152:0/2462708346 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9208068380 0x7f920806a840 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f92280ae450 tx=0x7f9214008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:37.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.701+0000 7f9224c00640 1 -- 172.21.15.152:0/2462708346 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f921c019030 con 0x7f9210004d50 2024-04-17T08:47:37.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.857+0000 7f922fc00640 1 -- 172.21.15.152:0/2462708346 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f922806d660 con 0x7f9210004d50 2024-04-17T08:47:37.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.857+0000 7f9224c00640 1 -- 172.21.15.152:0/2462708346 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f921c0576b0 con 0x7f9210004d50 2024-04-17T08:47:37.859 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 64 2024-04-17T08:47:37.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.857+0000 7f922fc00640 1 -- 172.21.15.152:0/2462708346 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9208068380 msgr2=0x7f920806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:37.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.857+0000 7f922fc00640 1 --2- 172.21.15.152:0/2462708346 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9208068380 0x7f920806a840 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f92280ae450 tx=0x7f9214008040 comp rx=0 tx=0).stop 2024-04-17T08:47:37.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.857+0000 7f922fc00640 1 -- 172.21.15.152:0/2462708346 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9210004d50 msgr2=0x7f92281517a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:37.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.857+0000 7f922fc00640 1 --2- 172.21.15.152:0/2462708346 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9210004d50 0x7f92281517a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f921c011a30 tx=0x7f921c011ef0 comp rx=0 tx=0).stop 2024-04-17T08:47:37.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.857+0000 7f922fc00640 1 -- 172.21.15.152:0/2462708346 shutdown_connections 2024-04-17T08:47:37.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.857+0000 7f922fc00640 1 --2- 172.21.15.152:0/2462708346 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f922815b6f0 0x7f922815bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:37.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.857+0000 7f922fc00640 1 --2- 172.21.15.152:0/2462708346 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9208068380 0x7f920806a840 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:37.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.857+0000 7f922fc00640 1 --2- 172.21.15.152:0/2462708346 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f92280b01c0 0x7f92281f3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:37.862 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.857+0000 7f922fc00640 1 --2- 172.21.15.152:0/2462708346 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9210004d50 0x7f92281517a0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:37.862 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.857+0000 7f922fc00640 1 -- 172.21.15.152:0/2462708346 >> 172.21.15.152:0/2462708346 conn(0x7f92280b3350 msgr2=0x7f92281580d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:37.862 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.857+0000 7f922fc00640 1 -- 172.21.15.152:0/2462708346 shutdown_connections 2024-04-17T08:47:37.862 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:37.857+0000 7f922fc00640 1 -- 172.21.15.152:0/2462708346 wait complete. 2024-04-17T08:47:37.882 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-17T08:47:38.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.017+0000 7fa99d400640 1 Processor -- start 2024-04-17T08:47:38.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.017+0000 7fa99d400640 1 -- start start 2024-04-17T08:47:38.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.021+0000 7fa99d400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa99815a010 0x7fa9980d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:38.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.021+0000 7fa99d400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa99815d710 0x7fa9980d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:38.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.021+0000 7fa99d400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa998160d20 con 0x7fa998160010 2024-04-17T08:47:38.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.021+0000 7fa99d400640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fa99815d280 con 0x7fa99815a010 2024-04-17T08:47:38.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.021+0000 7fa99d400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fa99815c9d0 con 0x7fa99815d710 2024-04-17T08:47:38.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.021+0000 7fa996800640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa99815a010 0x7fa9980d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:38.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.021+0000 7fa996800640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa99815a010 0x7fa9980d0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33288/0 (socket says 172.21.15.152:33288) 2024-04-17T08:47:38.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.021+0000 7fa996800640 1 -- 172.21.15.152:0/1451551229 learned_addr learned my addr 172.21.15.152:0/1451551229 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:38.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.021+0000 7fa995e00640 1 --2- 172.21.15.152:0/1451551229 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa99815d710 0x7fa9980d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:38.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.021+0000 7fa996800640 1 -- 172.21.15.152:0/1451551229 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa99815d710 msgr2=0x7fa9980d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:38.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.021+0000 7fa996800640 1 --2- 172.21.15.152:0/1451551229 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa99815d710 0x7fa9980d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:38.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.021+0000 7fa996800640 1 -- 172.21.15.152:0/1451551229 >> v1:172.21.15.196:6789/0 conn(0x7fa998160010 legacy=0x7fa998160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:38.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.021+0000 7fa996800640 1 -- 172.21.15.152:0/1451551229 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa99815cc30 con 0x7fa99815a010 2024-04-17T08:47:38.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.021+0000 7fa995e00640 1 --2- 172.21.15.152:0/1451551229 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa99815d710 0x7fa9980d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:47:38.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.021+0000 7fa996800640 1 --2- 172.21.15.152:0/1451551229 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa99815a010 0x7fa9980d0360 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa988009870 tx=0x7fa98801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d09af9b91a9940f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:38.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.021+0000 7fa995400640 1 -- 172.21.15.152:0/1451551229 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9880b1070 con 0x7fa99815a010 2024-04-17T08:47:38.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.025+0000 7fa995400640 1 -- 172.21.15.152:0/1451551229 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9880ac600 con 0x7fa99815a010 2024-04-17T08:47:38.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.025+0000 7fa995400640 1 -- 172.21.15.152:0/1451551229 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9880ac9d0 con 0x7fa99815a010 2024-04-17T08:47:38.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.025+0000 7fa99d400640 1 -- 172.21.15.152:0/1451551229 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa99815a010 msgr2=0x7fa9980d0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:38.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.025+0000 7fa99d400640 1 --2- 172.21.15.152:0/1451551229 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa99815a010 0x7fa9980d0360 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa988009870 tx=0x7fa98801c4d0 comp rx=0 tx=0).stop 2024-04-17T08:47:38.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.025+0000 7fa99d400640 1 -- 172.21.15.152:0/1451551229 shutdown_connections 2024-04-17T08:47:38.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.025+0000 7fa99d400640 1 --2- 172.21.15.152:0/1451551229 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa99815d710 0x7fa9980d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:38.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.025+0000 7fa99d400640 1 --2- 172.21.15.152:0/1451551229 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa99815a010 0x7fa9980d0360 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:38.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.025+0000 7fa99d400640 1 -- 172.21.15.152:0/1451551229 >> 172.21.15.152:0/1451551229 conn(0x7fa9980b3350 msgr2=0x7fa9980b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:38.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.025+0000 7fa99d400640 1 -- 172.21.15.152:0/1451551229 shutdown_connections 2024-04-17T08:47:38.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.025+0000 7fa99d400640 1 -- 172.21.15.152:0/1451551229 wait complete. 2024-04-17T08:47:38.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.025+0000 7fa99d400640 1 Processor -- start 2024-04-17T08:47:38.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.025+0000 7fa99d400640 1 -- start start 2024-04-17T08:47:38.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.025+0000 7fa99d400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa99815a010 0x7fa998151a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:38.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.025+0000 7fa99d400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa99815d710 0x7fa99815a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:38.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.025+0000 7fa99d400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa998160010 0x7fa99814c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:38.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.025+0000 7fa99d400640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa99815e780 con 0x7fa998160010 2024-04-17T08:47:38.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.025+0000 7fa99d400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa99815e600 con 0x7fa99815a010 2024-04-17T08:47:38.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.025+0000 7fa99d400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fa99815e900 con 0x7fa99815d710 2024-04-17T08:47:38.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.025+0000 7fa997200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa998160010 0x7fa99814c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:38.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.025+0000 7fa997200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa998160010 0x7fa99814c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33292/0 (socket says 172.21.15.152:33292) 2024-04-17T08:47:38.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.025+0000 7fa997200640 1 -- 172.21.15.152:0/1630977154 learned_addr learned my addr 172.21.15.152:0/1630977154 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:38.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.025+0000 7fa996800640 1 --2- 172.21.15.152:0/1630977154 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa99815a010 0x7fa998151a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:38.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.025+0000 7fa995e00640 1 --2- 172.21.15.152:0/1630977154 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa99815d710 0x7fa99815a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:38.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.029+0000 7fa997200640 1 -- 172.21.15.152:0/1630977154 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa99815d710 msgr2=0x7fa99815a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:38.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.029+0000 7fa997200640 1 --2- 172.21.15.152:0/1630977154 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa99815d710 0x7fa99815a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:38.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.029+0000 7fa997200640 1 -- 172.21.15.152:0/1630977154 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa99815a010 msgr2=0x7fa998151a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:38.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.029+0000 7fa997200640 1 --2- 172.21.15.152:0/1630977154 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa99815a010 0x7fa998151a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:38.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.029+0000 7fa997200640 1 -- 172.21.15.152:0/1630977154 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa99806e0f0 con 0x7fa998160010 2024-04-17T08:47:38.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.029+0000 7fa995e00640 1 --2- 172.21.15.152:0/1630977154 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa99815d710 0x7fa99815a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:38.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.029+0000 7fa997200640 1 --2- 172.21.15.152:0/1630977154 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa998160010 0x7fa99814c0d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa99000c730 tx=0x7fa99000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:38.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.029+0000 7fa98ea00640 1 -- 172.21.15.152:0/1630977154 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa990003b80 con 0x7fa998160010 2024-04-17T08:47:38.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.029+0000 7fa98ea00640 1 -- 172.21.15.152:0/1630977154 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa990003d20 con 0x7fa998160010 2024-04-17T08:47:38.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.029+0000 7fa98ea00640 1 -- 172.21.15.152:0/1630977154 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa99000aa30 con 0x7fa998160010 2024-04-17T08:47:38.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.029+0000 7fa99d400640 1 -- 172.21.15.152:0/1630977154 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa99806e3d0 con 0x7fa998160010 2024-04-17T08:47:38.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.029+0000 7fa99d400640 1 -- 172.21.15.152:0/1630977154 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa99806e990 con 0x7fa998160010 2024-04-17T08:47:38.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.029+0000 7fa99d400640 1 -- 172.21.15.152:0/1630977154 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa998068a30 con 0x7fa998160010 2024-04-17T08:47:38.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.029+0000 7fa98ea00640 1 -- 172.21.15.152:0/1630977154 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa99000abd0 con 0x7fa998160010 2024-04-17T08:47:38.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.029+0000 7fa98ea00640 1 --2- 172.21.15.152:0/1630977154 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fa9780683b0 0x7fa97806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:38.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.029+0000 7fa98ea00640 1 -- 172.21.15.152:0/1630977154 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fa990086c50 con 0x7fa998160010 2024-04-17T08:47:38.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.029+0000 7fa996800640 1 --2- 172.21.15.152:0/1630977154 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fa9780683b0 0x7fa97806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:38.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.033+0000 7fa996800640 1 --2- 172.21.15.152:0/1630977154 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fa9780683b0 0x7fa97806a870 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa9880ae000 tx=0x7fa9880a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:38.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.033+0000 7fa98ea00640 1 -- 172.21.15.152:0/1630977154 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fa990056d50 con 0x7fa998160010 2024-04-17T08:47:38.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.193+0000 7fa99d400640 1 -- 172.21.15.152:0/1630977154 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fa99806d660 con 0x7fa998160010 2024-04-17T08:47:38.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.193+0000 7fa98ea00640 1 -- 172.21.15.152:0/1630977154 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7fa990056650 con 0x7fa998160010 2024-04-17T08:47:38.196 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-04-17T08:47:38.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.197+0000 7fa99d400640 1 -- 172.21.15.152:0/1630977154 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fa9780683b0 msgr2=0x7fa97806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:38.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.197+0000 7fa99d400640 1 --2- 172.21.15.152:0/1630977154 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fa9780683b0 0x7fa97806a870 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa9880ae000 tx=0x7fa9880a7000 comp rx=0 tx=0).stop 2024-04-17T08:47:38.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.197+0000 7fa99d400640 1 -- 172.21.15.152:0/1630977154 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa998160010 msgr2=0x7fa99814c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:38.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.197+0000 7fa99d400640 1 --2- 172.21.15.152:0/1630977154 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa998160010 0x7fa99814c0d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa99000c730 tx=0x7fa99000cbf0 comp rx=0 tx=0).stop 2024-04-17T08:47:38.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.197+0000 7fa99d400640 1 -- 172.21.15.152:0/1630977154 shutdown_connections 2024-04-17T08:47:38.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.197+0000 7fa99d400640 1 --2- 172.21.15.152:0/1630977154 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa998160010 0x7fa99814c0d0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:38.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.197+0000 7fa99d400640 1 --2- 172.21.15.152:0/1630977154 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fa9780683b0 0x7fa97806a870 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:38.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.197+0000 7fa99d400640 1 --2- 172.21.15.152:0/1630977154 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa99815d710 0x7fa99815a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:38.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.197+0000 7fa99d400640 1 --2- 172.21.15.152:0/1630977154 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa99815a010 0x7fa998151a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:38.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.197+0000 7fa99d400640 1 -- 172.21.15.152:0/1630977154 >> 172.21.15.152:0/1630977154 conn(0x7fa9980b3350 msgr2=0x7fa9980aeeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:38.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.197+0000 7fa99d400640 1 -- 172.21.15.152:0/1630977154 shutdown_connections 2024-04-17T08:47:38.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.197+0000 7fa99d400640 1 -- 172.21.15.152:0/1630977154 wait complete. 2024-04-17T08:47:38.218 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-17T08:47:38.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.357+0000 7f05dbc00640 1 Processor -- start 2024-04-17T08:47:38.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.357+0000 7f05dbc00640 1 -- start start 2024-04-17T08:47:38.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.357+0000 7f05dbc00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f05d40d0360 0x7f05d40d07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:38.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.357+0000 7f05dbc00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05d415bfd0 con 0x7f05d406f980 2024-04-17T08:47:38.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.357+0000 7f05dbc00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05d4072c40 con 0x7f05d40af670 2024-04-17T08:47:38.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.357+0000 7f05dbc00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f05d40d0cf0 con 0x7f05d40d0360 2024-04-17T08:47:38.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.357+0000 7f05d9c00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f05d40d0360 0x7f05d40d07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:38.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.357+0000 7f05d3e00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f05d406f980 0x7f05d4072530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:54312/0 (socket says 172.21.15.152:54312) 2024-04-17T08:47:38.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.357+0000 7f05d3e00640 1 -- 172.21.15.152:0/3554789092 learned_addr learned my addr 172.21.15.152:0/3554789092 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:38.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.357+0000 7f05d9c00640 1 -- 172.21.15.152:0/3554789092 >> v1:172.21.15.196:6789/0 conn(0x7f05d40af670 legacy=0x7f05d415b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:38.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.357+0000 7f05d9c00640 1 -- 172.21.15.152:0/3554789092 >> v1:172.21.15.152:6789/0 conn(0x7f05d406f980 legacy=0x7f05d4072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:38.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.357+0000 7f05d9c00640 1 -- 172.21.15.152:0/3554789092 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05d415c260 con 0x7f05d40d0360 2024-04-17T08:47:38.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.361+0000 7f05d9c00640 1 --2- 172.21.15.152:0/3554789092 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05d40d0360 0x7f05d40d07b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f05cc009d90 tx=0x7f05cc01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a6e9910bc4c4eae server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:38.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.361+0000 7f05d3400640 1 -- 172.21.15.152:0/3554789092 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05cc0b2070 con 0x7f05d40d0360 2024-04-17T08:47:38.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.361+0000 7f05d3400640 1 -- 172.21.15.152:0/3554789092 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05cc0a5890 con 0x7f05d40d0360 2024-04-17T08:47:38.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.361+0000 7f05d3400640 1 -- 172.21.15.152:0/3554789092 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05cc0a5c60 con 0x7f05d40d0360 2024-04-17T08:47:38.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.361+0000 7f05dbc00640 1 -- 172.21.15.152:0/3554789092 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05d40d0360 msgr2=0x7f05d40d07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:38.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.361+0000 7f05dbc00640 1 --2- 172.21.15.152:0/3554789092 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05d40d0360 0x7f05d40d07b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f05cc009d90 tx=0x7f05cc01c8e0 comp rx=0 tx=0).stop 2024-04-17T08:47:38.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.361+0000 7f05dbc00640 1 -- 172.21.15.152:0/3554789092 shutdown_connections 2024-04-17T08:47:38.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.361+0000 7f05dbc00640 1 --2- 172.21.15.152:0/3554789092 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05d40d0360 0x7f05d40d07b0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:38.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.361+0000 7f05dbc00640 1 -- 172.21.15.152:0/3554789092 >> 172.21.15.152:0/3554789092 conn(0x7f05d40b3350 msgr2=0x7f05d40b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:38.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.361+0000 7f05dbc00640 1 -- 172.21.15.152:0/3554789092 shutdown_connections 2024-04-17T08:47:38.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.361+0000 7f05dbc00640 1 -- 172.21.15.152:0/3554789092 wait complete. 2024-04-17T08:47:38.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.361+0000 7f05dbc00640 1 Processor -- start 2024-04-17T08:47:38.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.361+0000 7f05dbc00640 1 -- start start 2024-04-17T08:47:38.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.365+0000 7f05dbc00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05d406f980 0x7f05d4099ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:38.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.365+0000 7f05dbc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05d40af670 0x7f05d415ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:38.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.365+0000 7f05dbc00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05d40d0360 0x7f05d415e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:38.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.365+0000 7f05dbc00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f05d4169060 con 0x7f05d406f980 2024-04-17T08:47:38.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.365+0000 7f05dbc00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f05d40afa50 con 0x7f05d40d0360 2024-04-17T08:47:38.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.365+0000 7f05dbc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f05d41691e0 con 0x7f05d40af670 2024-04-17T08:47:38.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.365+0000 7f05d9200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05d406f980 0x7f05d4099ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:38.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.365+0000 7f05d9200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05d406f980 0x7f05d4099ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60086/0 (socket says 172.21.15.152:60086) 2024-04-17T08:47:38.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.365+0000 7f05d9200640 1 -- 172.21.15.152:0/228415938 learned_addr learned my addr 172.21.15.152:0/228415938 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:38.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.365+0000 7f05d3e00640 1 --2- 172.21.15.152:0/228415938 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05d40af670 0x7f05d415ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:38.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.365+0000 7f05d9200640 1 -- 172.21.15.152:0/228415938 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05d40af670 msgr2=0x7f05d415ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:38.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.365+0000 7f05d9c00640 1 --2- 172.21.15.152:0/228415938 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05d40d0360 0x7f05d415e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:38.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.365+0000 7f05d9200640 1 --2- 172.21.15.152:0/228415938 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05d40af670 0x7f05d415ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:38.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.365+0000 7f05d9200640 1 -- 172.21.15.152:0/228415938 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05d40d0360 msgr2=0x7f05d415e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:38.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.365+0000 7f05d9200640 1 --2- 172.21.15.152:0/228415938 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05d40d0360 0x7f05d415e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:38.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.365+0000 7f05d9200640 1 -- 172.21.15.152:0/228415938 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05d4150110 con 0x7f05d406f980 2024-04-17T08:47:38.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.365+0000 7f05d3e00640 1 --2- 172.21.15.152:0/228415938 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05d40af670 0x7f05d415ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:47:38.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.365+0000 7f05d9c00640 1 --2- 172.21.15.152:0/228415938 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05d40d0360 0x7f05d415e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:47:38.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.365+0000 7f05d9200640 1 --2- 172.21.15.152:0/228415938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05d406f980 0x7f05d4099ad0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f05c800c500 tx=0x7f05c800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:38.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.365+0000 7f05d0c00640 1 -- 172.21.15.152:0/228415938 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c8016020 con 0x7f05d406f980 2024-04-17T08:47:38.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.365+0000 7f05d0c00640 1 -- 172.21.15.152:0/228415938 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05c8005220 con 0x7f05d406f980 2024-04-17T08:47:38.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.365+0000 7f05d0c00640 1 -- 172.21.15.152:0/228415938 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c8007030 con 0x7f05d406f980 2024-04-17T08:47:38.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.365+0000 7f05dbc00640 1 -- 172.21.15.152:0/228415938 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05d4151170 con 0x7f05d406f980 2024-04-17T08:47:38.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.365+0000 7f05dbc00640 1 -- 172.21.15.152:0/228415938 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05d4150690 con 0x7f05d406f980 2024-04-17T08:47:38.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.365+0000 7f05dbc00640 1 -- 172.21.15.152:0/228415938 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05d4068a30 con 0x7f05d406f980 2024-04-17T08:47:38.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.365+0000 7f05d0c00640 1 -- 172.21.15.152:0/228415938 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f05c80071f0 con 0x7f05d406f980 2024-04-17T08:47:38.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.369+0000 7f05d0c00640 1 --2- 172.21.15.152:0/228415938 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f05b4068380 0x7f05b406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:38.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.369+0000 7f05d0c00640 1 -- 172.21.15.152:0/228415938 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f05c80868b0 con 0x7f05d406f980 2024-04-17T08:47:38.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.369+0000 7f05d3e00640 1 --2- 172.21.15.152:0/228415938 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f05b4068380 0x7f05b406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:38.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.369+0000 7f05d3e00640 1 --2- 172.21.15.152:0/228415938 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f05b4068380 0x7f05b406a840 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f05d4154920 tx=0x7f05c0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:38.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.373+0000 7f05d0c00640 1 -- 172.21.15.152:0/228415938 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f05c8020020 con 0x7f05d406f980 2024-04-17T08:47:38.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.541+0000 7f05dbc00640 1 -- 172.21.15.152:0/228415938 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f05d406ebb0 con 0x7f05d406f980 2024-04-17T08:47:38.544 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.541+0000 7f05d0c00640 1 -- 172.21.15.152:0/228415938 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f05c80569c0 con 0x7f05d406f980 2024-04-17T08:47:38.544 INFO:teuthology.orchestra.run.smithi152.stderr:listed 0 entries 2024-04-17T08:47:38.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.541+0000 7f05dbc00640 1 -- 172.21.15.152:0/228415938 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f05b4068380 msgr2=0x7f05b406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:38.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.541+0000 7f05dbc00640 1 --2- 172.21.15.152:0/228415938 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f05b4068380 0x7f05b406a840 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f05d4154920 tx=0x7f05c0009040 comp rx=0 tx=0).stop 2024-04-17T08:47:38.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.541+0000 7f05dbc00640 1 -- 172.21.15.152:0/228415938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05d406f980 msgr2=0x7f05d4099ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:38.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.541+0000 7f05dbc00640 1 --2- 172.21.15.152:0/228415938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05d406f980 0x7f05d4099ad0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f05c800c500 tx=0x7f05c800c9c0 comp rx=0 tx=0).stop 2024-04-17T08:47:38.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.541+0000 7f05dbc00640 1 -- 172.21.15.152:0/228415938 shutdown_connections 2024-04-17T08:47:38.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.541+0000 7f05dbc00640 1 --2- 172.21.15.152:0/228415938 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05d40d0360 0x7f05d415e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:38.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.541+0000 7f05dbc00640 1 --2- 172.21.15.152:0/228415938 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f05b4068380 0x7f05b406a840 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:38.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.541+0000 7f05dbc00640 1 --2- 172.21.15.152:0/228415938 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05d40af670 0x7f05d415ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:38.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.541+0000 7f05dbc00640 1 --2- 172.21.15.152:0/228415938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05d406f980 0x7f05d4099ad0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:38.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.545+0000 7f05dbc00640 1 -- 172.21.15.152:0/228415938 >> 172.21.15.152:0/228415938 conn(0x7f05d40b3350 msgr2=0x7f05d40aece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:38.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.545+0000 7f05dbc00640 1 -- 172.21.15.152:0/228415938 shutdown_connections 2024-04-17T08:47:38.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.545+0000 7f05dbc00640 1 -- 172.21.15.152:0/228415938 wait complete. 2024-04-17T08:47:38.565 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-17T08:47:38.565 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-17T08:47:38.573 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T08:47:38.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.749+0000 7fa774000640 1 Processor -- start 2024-04-17T08:47:38.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.749+0000 7fa774000640 1 -- start start 2024-04-17T08:47:38.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.749+0000 7fa774000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa76c0af670 0x7fa76c15b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:38.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.749+0000 7fa774000640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa76c06f980 0x7fa76c072530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:38.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.749+0000 7fa774000640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa76c15c260 con 0x7fa76c0d0360 2024-04-17T08:47:38.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.749+0000 7fa774000640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fa76c15c820 con 0x7fa76c06f980 2024-04-17T08:47:38.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.749+0000 7fa774000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fa76c15c540 con 0x7fa76c0af670 2024-04-17T08:47:38.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.749+0000 7fa770c00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa76c06f980 0x7fa76c072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:38.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.749+0000 7fa772000640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fa76c0d0360 0x7fa76c06dc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:54320/0 (socket says 172.21.15.152:54320) 2024-04-17T08:47:38.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.749+0000 7fa772000640 1 -- 172.21.15.152:0/3308003412 learned_addr learned my addr 172.21.15.152:0/3308003412 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:38.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.749+0000 7fa771600640 1 --2- 172.21.15.152:0/3308003412 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa76c0af670 0x7fa76c15b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:38.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.749+0000 7fa770c00640 1 -- 172.21.15.152:0/3308003412 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa76c0af670 msgr2=0x7fa76c15b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:38.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.749+0000 7fa770c00640 1 --2- 172.21.15.152:0/3308003412 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa76c0af670 0x7fa76c15b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:38.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.749+0000 7fa770c00640 1 -- 172.21.15.152:0/3308003412 >> v1:172.21.15.152:6789/0 conn(0x7fa76c0d0360 legacy=0x7fa76c06dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:38.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.753+0000 7fa770c00640 1 -- 172.21.15.152:0/3308003412 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa76c071d30 con 0x7fa76c06f980 2024-04-17T08:47:38.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.753+0000 7fa76be00640 1 -- 172.21.15.152:0/3308003412 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 369984953 0 0) 0x7fa76c15c260 con 0x7fa76c0d0360 2024-04-17T08:47:38.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.753+0000 7fa771600640 1 --2- 172.21.15.152:0/3308003412 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa76c0af670 0x7fa76c15b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:38.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.753+0000 7fa770c00640 1 --2- 172.21.15.152:0/3308003412 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa76c06f980 0x7fa76c072530 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa7580097c0 tx=0x7fa75801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88d67e77d0ba0cf2 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:38.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.753+0000 7fa76be00640 1 -- 172.21.15.152:0/3308003412 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7580b0070 con 0x7fa76c06f980 2024-04-17T08:47:38.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.753+0000 7fa76be00640 1 -- 172.21.15.152:0/3308003412 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7580ab600 con 0x7fa76c06f980 2024-04-17T08:47:38.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.753+0000 7fa76be00640 1 -- 172.21.15.152:0/3308003412 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7580ab9d0 con 0x7fa76c06f980 2024-04-17T08:47:38.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.753+0000 7fa774000640 1 -- 172.21.15.152:0/3308003412 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa76c06f980 msgr2=0x7fa76c072530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:38.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.753+0000 7fa774000640 1 --2- 172.21.15.152:0/3308003412 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa76c06f980 0x7fa76c072530 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa7580097c0 tx=0x7fa75801c3e0 comp rx=0 tx=0).stop 2024-04-17T08:47:38.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.753+0000 7fa774000640 1 -- 172.21.15.152:0/3308003412 shutdown_connections 2024-04-17T08:47:38.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.753+0000 7fa774000640 1 --2- 172.21.15.152:0/3308003412 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa76c06f980 0x7fa76c072530 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:38.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.753+0000 7fa774000640 1 --2- 172.21.15.152:0/3308003412 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa76c0af670 0x7fa76c15b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:38.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.753+0000 7fa774000640 1 -- 172.21.15.152:0/3308003412 >> 172.21.15.152:0/3308003412 conn(0x7fa76c0b3350 msgr2=0x7fa76c0b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:38.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.753+0000 7fa774000640 1 -- 172.21.15.152:0/3308003412 shutdown_connections 2024-04-17T08:47:38.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.753+0000 7fa774000640 1 -- 172.21.15.152:0/3308003412 wait complete. 2024-04-17T08:47:38.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.757+0000 7fa774000640 1 Processor -- start 2024-04-17T08:47:38.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.757+0000 7fa774000640 1 -- start start 2024-04-17T08:47:38.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.757+0000 7fa774000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa76c06f980 0x7fa76c06edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:38.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.757+0000 7fa774000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa76c0af670 0x7fa76c155010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:38.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.757+0000 7fa774000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa76c0d0360 0x7fa76c09aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:38.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.757+0000 7fa774000640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa76c15bf80 con 0x7fa76c0af670 2024-04-17T08:47:38.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.757+0000 7fa774000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa76c15be00 con 0x7fa76c0d0360 2024-04-17T08:47:38.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.757+0000 7fa774000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fa76c072a70 con 0x7fa76c06f980 2024-04-17T08:47:38.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.757+0000 7fa770c00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa76c0af670 0x7fa76c155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:38.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.757+0000 7fa770c00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa76c0af670 0x7fa76c155010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60104/0 (socket says 172.21.15.152:60104) 2024-04-17T08:47:38.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.757+0000 7fa770c00640 1 -- 172.21.15.152:0/1315225104 learned_addr learned my addr 172.21.15.152:0/1315225104 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:38.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.757+0000 7fa771600640 1 --2- 172.21.15.152:0/1315225104 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa76c06f980 0x7fa76c06edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:38.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.757+0000 7fa772000640 1 --2- 172.21.15.152:0/1315225104 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa76c0d0360 0x7fa76c09aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:38.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.757+0000 7fa770c00640 1 -- 172.21.15.152:0/1315225104 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa76c06f980 msgr2=0x7fa76c06edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:38.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.757+0000 7fa770c00640 1 --2- 172.21.15.152:0/1315225104 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa76c06f980 0x7fa76c06edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:38.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.757+0000 7fa770c00640 1 -- 172.21.15.152:0/1315225104 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa76c0d0360 msgr2=0x7fa76c09aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:38.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.757+0000 7fa770c00640 1 --2- 172.21.15.152:0/1315225104 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa76c0d0360 0x7fa76c09aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:38.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.757+0000 7fa770c00640 1 -- 172.21.15.152:0/1315225104 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa76c15bc30 con 0x7fa76c0af670 2024-04-17T08:47:38.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.757+0000 7fa770c00640 1 --2- 172.21.15.152:0/1315225104 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa76c0af670 0x7fa76c155010 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa75801a010 tx=0x7fa75801ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:38.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.757+0000 7fa769600640 1 -- 172.21.15.152:0/1315225104 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7580b0050 con 0x7fa76c0af670 2024-04-17T08:47:38.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.757+0000 7fa769600640 1 -- 172.21.15.152:0/1315225104 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7580bc070 con 0x7fa76c0af670 2024-04-17T08:47:38.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.757+0000 7fa769600640 1 -- 172.21.15.152:0/1315225104 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7580b5830 con 0x7fa76c0af670 2024-04-17T08:47:38.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.757+0000 7fa774000640 1 -- 172.21.15.152:0/1315225104 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa76c09a310 con 0x7fa76c0af670 2024-04-17T08:47:38.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.757+0000 7fa774000640 1 -- 172.21.15.152:0/1315225104 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa76c09a8d0 con 0x7fa76c0af670 2024-04-17T08:47:38.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.761+0000 7fa774000640 1 -- 172.21.15.152:0/1315225104 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa76c068a30 con 0x7fa76c0af670 2024-04-17T08:47:38.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.761+0000 7fa769600640 1 -- 172.21.15.152:0/1315225104 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa7580b59d0 con 0x7fa76c0af670 2024-04-17T08:47:38.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.761+0000 7fa769600640 1 --2- 172.21.15.152:0/1315225104 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fa74c0683b0 0x7fa74c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:38.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.761+0000 7fa769600640 1 -- 172.21.15.152:0/1315225104 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fa7581216b0 con 0x7fa76c0af670 2024-04-17T08:47:38.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.761+0000 7fa771600640 1 --2- 172.21.15.152:0/1315225104 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fa74c0683b0 0x7fa74c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:38.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.765+0000 7fa771600640 1 --2- 172.21.15.152:0/1315225104 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fa74c0683b0 0x7fa74c06a870 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa76c0ae310 tx=0x7fa760008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:38.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.765+0000 7fa769600640 1 -- 172.21.15.152:0/1315225104 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fa758016090 con 0x7fa76c0af670 2024-04-17T08:47:38.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.925+0000 7fa774000640 1 -- 172.21.15.152:0/1315225104 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa76c15e000 con 0x7fa76c0af670 2024-04-17T08:47:38.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.925+0000 7fa769600640 1 -- 172.21.15.152:0/1315225104 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18972 (secure 0 0 0) 0x7fa7580f18d0 con 0x7fa76c0af670 2024-04-17T08:47:38.928 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:47:38.928 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":26,"fsid":"ce68f82e-ec5f-4205-9fd5-bdfdf6ef31e2","created":"2024-04-17T08:46:08.353546+0000","modified":"2024-04-17T08:47:15.280634+0000","last_up_change":"2024-04-17T08:46:20.738799+0000","last_in_change":"2024-04-17T08:46:11.210050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T08:46:21.386856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T08:46:31.812460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T08:46:32.555559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T08:46:36.258078+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"682f0192-187c-404e-bc7a-b6b4e23825e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6819","nonce":3603799291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6823","nonce":3603799291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6831","nonce":3603799291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6827","nonce":3603799291}]},"public_addr":"172.21.15.152:6819/3603799291","cluster_addr":"172.21.15.152:6823/3603799291","heartbeat_back_addr":"172.21.15.152:6831/3603799291","heartbeat_front_addr":"172.21.15.152:6827/3603799291","state":["exists","up"]},{"osd":1,"uuid":"f0fe8fef-60ec-4a39-83b6-2fa6a5adb0f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6801","nonce":4133383142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6803","nonce":4133383142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6807","nonce":4133383142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6805","nonce":4133383142}]},"public_addr":"172.21.15.152:6801/4133383142","cluster_addr":"172.21.15.152:6803/4133383142","heartbeat_back_addr":"172.21.15.152:6807/4133383142","heartbeat_front_addr":"172.21.15.152:6805/4133383142","state":["exists","up"]},{"osd":2,"uuid":"35f36d9c-5245-4431-a618-f4df0fa380ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6809","nonce":3826143898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6811","nonce":3826143898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6815","nonce":3826143898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6813","nonce":3826143898}]},"public_addr":"172.21.15.152:6809/3826143898","cluster_addr":"172.21.15.152:6811/3826143898","heartbeat_back_addr":"172.21.15.152:6815/3826143898","heartbeat_front_addr":"172.21.15.152:6813/3826143898","state":["exists","up"]},{"osd":3,"uuid":"96e56ca5-15b4-4895-9b79-da2c92043159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6818","nonce":165717826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6822","nonce":165717826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6830","nonce":165717826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6826","nonce":165717826}]},"public_addr":"172.21.15.152:6818/165717826","cluster_addr":"172.21.15.152:6822/165717826","heartbeat_back_addr":"172.21.15.152:6830/165717826","heartbeat_front_addr":"172.21.15.152:6826/165717826","state":["exists","up"]},{"osd":4,"uuid":"f5aa10a4-9ff9-41fe-a5c9-15326f982cc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6817","nonce":4080159297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6819","nonce":4080159297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6823","nonce":4080159297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6821","nonce":4080159297}]},"public_addr":"172.21.15.196:6817/4080159297","cluster_addr":"172.21.15.196:6819/4080159297","heartbeat_back_addr":"172.21.15.196:6823/4080159297","heartbeat_front_addr":"172.21.15.196:6821/4080159297","state":["exists","up"]},{"osd":5,"uuid":"42bab884-3476-47ae-ac65-935fa6e0f055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6801","nonce":3519444232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6803","nonce":3519444232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6807","nonce":3519444232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6805","nonce":3519444232}]},"public_addr":"172.21.15.196:6801/3519444232","cluster_addr":"172.21.15.196:6803/3519444232","heartbeat_back_addr":"172.21.15.196:6807/3519444232","heartbeat_front_addr":"172.21.15.196:6805/3519444232","state":["exists","up"]},{"osd":6,"uuid":"460b6167-f57b-4224-9c92-cfc9b80bbe99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6809","nonce":275739834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6811","nonce":275739834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6815","nonce":275739834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6813","nonce":275739834}]},"public_addr":"172.21.15.196:6809/275739834","cluster_addr":"172.21.15.196:6811/275739834","heartbeat_back_addr":"172.21.15.196:6815/275739834","heartbeat_front_addr":"172.21.15.196:6813/275739834","state":["exists","up"]},{"osd":7,"uuid":"d695643f-5e07-4e2a-a646-c06bd97b6650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6825","nonce":307626968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6827","nonce":307626968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6831","nonce":307626968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6829","nonce":307626968}]},"public_addr":"172.21.15.196:6825/307626968","cluster_addr":"172.21.15.196:6827/307626968","heartbeat_back_addr":"172.21.15.196:6831/307626968","heartbeat_front_addr":"172.21.15.196:6829/307626968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.293257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.964533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.248895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.010000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.832554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.743704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930171+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930962+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T08:47:38.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.929+0000 7fa774000640 1 -- 172.21.15.152:0/1315225104 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fa74c0683b0 msgr2=0x7fa74c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:38.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.929+0000 7fa774000640 1 --2- 172.21.15.152:0/1315225104 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fa74c0683b0 0x7fa74c06a870 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa76c0ae310 tx=0x7fa760008040 comp rx=0 tx=0).stop 2024-04-17T08:47:38.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.929+0000 7fa774000640 1 -- 172.21.15.152:0/1315225104 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa76c0af670 msgr2=0x7fa76c155010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:38.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.929+0000 7fa774000640 1 --2- 172.21.15.152:0/1315225104 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa76c0af670 0x7fa76c155010 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa75801a010 tx=0x7fa75801ac20 comp rx=0 tx=0).stop 2024-04-17T08:47:38.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.929+0000 7fa774000640 1 -- 172.21.15.152:0/1315225104 shutdown_connections 2024-04-17T08:47:38.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.929+0000 7fa774000640 1 --2- 172.21.15.152:0/1315225104 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa76c0d0360 0x7fa76c09aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:38.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.929+0000 7fa774000640 1 --2- 172.21.15.152:0/1315225104 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa76c0af670 0x7fa76c155010 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:38.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.929+0000 7fa774000640 1 --2- 172.21.15.152:0/1315225104 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fa74c0683b0 0x7fa74c06a870 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:38.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.929+0000 7fa774000640 1 --2- 172.21.15.152:0/1315225104 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa76c06f980 0x7fa76c06edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:38.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.929+0000 7fa774000640 1 -- 172.21.15.152:0/1315225104 >> 172.21.15.152:0/1315225104 conn(0x7fa76c0b3350 msgr2=0x7fa76c15d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:38.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.929+0000 7fa774000640 1 -- 172.21.15.152:0/1315225104 shutdown_connections 2024-04-17T08:47:38.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:38.929+0000 7fa774000640 1 -- 172.21.15.152:0/1315225104 wait complete. 2024-04-17T08:47:38.950 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T08:46:21.386856+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-17T08:46:31.812460+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-17T08:46:32.555559+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-17T08:46:36.258078+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-17T08:47:38.951 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T08:47:39.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.085+0000 7fed87e00640 1 Processor -- start 2024-04-17T08:47:39.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.085+0000 7fed87e00640 1 -- start start 2024-04-17T08:47:39.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.085+0000 7fed87e00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fed800d0360 0x7fed800d07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:39.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.085+0000 7fed87e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fed800ad3d0 0x7fed800ad820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:39.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.085+0000 7fed87e00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed8006e6b0 con 0x7fed80161b70 2024-04-17T08:47:39.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.085+0000 7fed87e00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fed800d0d00 con 0x7fed800d0360 2024-04-17T08:47:39.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.085+0000 7fed87e00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fed80161f50 con 0x7fed800ad3d0 2024-04-17T08:47:39.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.085+0000 7fed84a00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fed800d0360 0x7fed800d07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:39.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.085+0000 7fed84a00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fed800d0360 0x7fed800d07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60116/0 (socket says 172.21.15.152:60116) 2024-04-17T08:47:39.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.085+0000 7fed84a00640 1 -- 172.21.15.152:0/3822973678 learned_addr learned my addr 172.21.15.152:0/3822973678 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:39.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.085+0000 7fed85e00640 1 --2- 172.21.15.152:0/3822973678 >> v2:172.21.15.196:3300/0 conn(0x7fed800ad3d0 0x7fed800ad820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:39.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.085+0000 7fed84a00640 1 -- 172.21.15.152:0/3822973678 >> v2:172.21.15.196:3300/0 conn(0x7fed800ad3d0 msgr2=0x7fed800ad820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:39.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.085+0000 7fed84a00640 1 --2- 172.21.15.152:0/3822973678 >> v2:172.21.15.196:3300/0 conn(0x7fed800ad3d0 0x7fed800ad820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:39.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.085+0000 7fed84a00640 1 -- 172.21.15.152:0/3822973678 >> v1:172.21.15.196:6789/0 conn(0x7fed80161b70 legacy=0x7fed8006dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:39.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.085+0000 7fed84a00640 1 -- 172.21.15.152:0/3822973678 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed8006e990 con 0x7fed800d0360 2024-04-17T08:47:39.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.089+0000 7fed84a00640 1 --2- 172.21.15.152:0/3822973678 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed800d0360 0x7fed800d07c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fed8006d9d0 tx=0x7fed6c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d7efc5441d5f6e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:39.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.089+0000 7fed7fe00640 1 -- 172.21.15.152:0/3822973678 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed6c0b2070 con 0x7fed800d0360 2024-04-17T08:47:39.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.089+0000 7fed7fe00640 1 -- 172.21.15.152:0/3822973678 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed6c0ad680 con 0x7fed800d0360 2024-04-17T08:47:39.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.089+0000 7fed7fe00640 1 -- 172.21.15.152:0/3822973678 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed6c0ada50 con 0x7fed800d0360 2024-04-17T08:47:39.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.089+0000 7fed87e00640 1 -- 172.21.15.152:0/3822973678 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed800d0360 msgr2=0x7fed800d07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:39.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.089+0000 7fed87e00640 1 --2- 172.21.15.152:0/3822973678 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed800d0360 0x7fed800d07c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fed8006d9d0 tx=0x7fed6c01c490 comp rx=0 tx=0).stop 2024-04-17T08:47:39.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.089+0000 7fed87e00640 1 -- 172.21.15.152:0/3822973678 shutdown_connections 2024-04-17T08:47:39.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.089+0000 7fed87e00640 1 --2- 172.21.15.152:0/3822973678 >> v2:172.21.15.196:3300/0 conn(0x7fed800ad3d0 0x7fed800ad820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:39.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.089+0000 7fed87e00640 1 --2- 172.21.15.152:0/3822973678 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed800d0360 0x7fed800d07c0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:39.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.089+0000 7fed87e00640 1 -- 172.21.15.152:0/3822973678 >> 172.21.15.152:0/3822973678 conn(0x7fed800b3350 msgr2=0x7fed800b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:39.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.089+0000 7fed87e00640 1 -- 172.21.15.152:0/3822973678 shutdown_connections 2024-04-17T08:47:39.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.089+0000 7fed87e00640 1 -- 172.21.15.152:0/3822973678 wait complete. 2024-04-17T08:47:39.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.093+0000 7fed87e00640 1 Processor -- start 2024-04-17T08:47:39.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.093+0000 7fed87e00640 1 -- start start 2024-04-17T08:47:39.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.093+0000 7fed87e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fed800ad3d0 0x7fed80149a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:39.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.093+0000 7fed87e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed800d0360 0x7fed80149190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:39.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.093+0000 7fed87e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fed80161b70 0x7fed80160180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:39.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.093+0000 7fed87e00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fed80071ef0 con 0x7fed800d0360 2024-04-17T08:47:39.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.093+0000 7fed87e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fed80071d70 con 0x7fed800ad3d0 2024-04-17T08:47:39.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.093+0000 7fed87e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fed8016b1c0 con 0x7fed80161b70 2024-04-17T08:47:39.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.093+0000 7fed84a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed800d0360 0x7fed80149190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:39.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.093+0000 7fed84a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed800d0360 0x7fed80149190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60118/0 (socket says 172.21.15.152:60118) 2024-04-17T08:47:39.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.093+0000 7fed84a00640 1 -- 172.21.15.152:0/573507328 learned_addr learned my addr 172.21.15.152:0/573507328 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:39.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.093+0000 7fed85e00640 1 --2- 172.21.15.152:0/573507328 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fed80161b70 0x7fed80160180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:39.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.093+0000 7fed85400640 1 --2- 172.21.15.152:0/573507328 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fed800ad3d0 0x7fed80149a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:39.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.093+0000 7fed84a00640 1 -- 172.21.15.152:0/573507328 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fed80161b70 msgr2=0x7fed80160180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:39.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.093+0000 7fed84a00640 1 --2- 172.21.15.152:0/573507328 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fed80161b70 0x7fed80160180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:39.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.093+0000 7fed84a00640 1 -- 172.21.15.152:0/573507328 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fed800ad3d0 msgr2=0x7fed80149a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:39.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.093+0000 7fed84a00640 1 --2- 172.21.15.152:0/573507328 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fed800ad3d0 0x7fed80149a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:39.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.093+0000 7fed84a00640 1 -- 172.21.15.152:0/573507328 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed80149f70 con 0x7fed800d0360 2024-04-17T08:47:39.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.093+0000 7fed84a00640 1 --2- 172.21.15.152:0/573507328 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed800d0360 0x7fed80149190 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fed6c01a0c0 tx=0x7fed6c01acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:39.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.093+0000 7fed7d600640 1 -- 172.21.15.152:0/573507328 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed6c0b2040 con 0x7fed800d0360 2024-04-17T08:47:39.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.093+0000 7fed7d600640 1 -- 172.21.15.152:0/573507328 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed6c0bd070 con 0x7fed800d0360 2024-04-17T08:47:39.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.093+0000 7fed87e00640 1 -- 172.21.15.152:0/573507328 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed8014a240 con 0x7fed800d0360 2024-04-17T08:47:39.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.093+0000 7fed7d600640 1 -- 172.21.15.152:0/573507328 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed6c0ade10 con 0x7fed800d0360 2024-04-17T08:47:39.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.093+0000 7fed87e00640 1 -- 172.21.15.152:0/573507328 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed8014a800 con 0x7fed800d0360 2024-04-17T08:47:39.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.097+0000 7fed87e00640 1 -- 172.21.15.152:0/573507328 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed80068a30 con 0x7fed800d0360 2024-04-17T08:47:39.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.097+0000 7fed7d600640 1 -- 172.21.15.152:0/573507328 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fed6c0c2460 con 0x7fed800d0360 2024-04-17T08:47:39.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.097+0000 7fed7d600640 1 --2- 172.21.15.152:0/573507328 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fed60068380 0x7fed6006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:39.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.097+0000 7fed7d600640 1 -- 172.21.15.152:0/573507328 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fed6c120f90 con 0x7fed800d0360 2024-04-17T08:47:39.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.097+0000 7fed85400640 1 --2- 172.21.15.152:0/573507328 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fed60068380 0x7fed6006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:39.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.097+0000 7fed85400640 1 --2- 172.21.15.152:0/573507328 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fed60068380 0x7fed6006a840 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fed740016d0 tx=0x7fed74009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:39.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.101+0000 7fed7d600640 1 -- 172.21.15.152:0/573507328 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fed6c016110 con 0x7fed800d0360 2024-04-17T08:47:39.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.257+0000 7fed87e00640 1 -- 172.21.15.152:0/573507328 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fed8015ff40 con 0x7fed800d0360 2024-04-17T08:47:39.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.257+0000 7fed7d600640 1 -- 172.21.15.152:0/573507328 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7fed6c0f1090 con 0x7fed800d0360 2024-04-17T08:47:39.260 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2024-04-17T08:47:39.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.261+0000 7fed87e00640 1 -- 172.21.15.152:0/573507328 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fed60068380 msgr2=0x7fed6006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:39.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.261+0000 7fed87e00640 1 --2- 172.21.15.152:0/573507328 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fed60068380 0x7fed6006a840 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fed740016d0 tx=0x7fed74009040 comp rx=0 tx=0).stop 2024-04-17T08:47:39.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.261+0000 7fed87e00640 1 -- 172.21.15.152:0/573507328 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed800d0360 msgr2=0x7fed80149190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:39.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.261+0000 7fed87e00640 1 --2- 172.21.15.152:0/573507328 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed800d0360 0x7fed80149190 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fed6c01a0c0 tx=0x7fed6c01acd0 comp rx=0 tx=0).stop 2024-04-17T08:47:39.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.261+0000 7fed87e00640 1 -- 172.21.15.152:0/573507328 shutdown_connections 2024-04-17T08:47:39.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.261+0000 7fed87e00640 1 --2- 172.21.15.152:0/573507328 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fed60068380 0x7fed6006a840 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:39.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.261+0000 7fed87e00640 1 --2- 172.21.15.152:0/573507328 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fed80161b70 0x7fed80160180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:39.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.261+0000 7fed87e00640 1 --2- 172.21.15.152:0/573507328 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed800d0360 0x7fed80149190 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:39.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.261+0000 7fed87e00640 1 --2- 172.21.15.152:0/573507328 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fed800ad3d0 0x7fed80149a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:39.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.261+0000 7fed87e00640 1 -- 172.21.15.152:0/573507328 >> 172.21.15.152:0/573507328 conn(0x7fed800b3350 msgr2=0x7fed8006dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:39.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.261+0000 7fed87e00640 1 -- 172.21.15.152:0/573507328 shutdown_connections 2024-04-17T08:47:39.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.261+0000 7fed87e00640 1 -- 172.21.15.152:0/573507328 wait complete. 2024-04-17T08:47:39.281 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-17T08:47:39.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.421+0000 7ff9ab200640 1 Processor -- start 2024-04-17T08:47:39.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.421+0000 7ff9ab200640 1 -- start start 2024-04-17T08:47:39.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.421+0000 7ff9ab200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff9a40af670 0x7ff9a415b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:39.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.421+0000 7ff9ab200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ff9a40d0360 0x7ff9a40d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:39.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.421+0000 7ff9ab200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9a4072c40 con 0x7ff9a406f980 2024-04-17T08:47:39.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.421+0000 7ff9ab200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7ff9a415c820 con 0x7ff9a40d0360 2024-04-17T08:47:39.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.421+0000 7ff9ab200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7ff9a415c260 con 0x7ff9a40af670 2024-04-17T08:47:39.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.425+0000 7ff9a3e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff9a40af670 0x7ff9a415b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:39.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.425+0000 7ff9a9200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ff9a40d0360 0x7ff9a40d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:39.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.425+0000 7ff9a3e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff9a40af670 0x7ff9a415b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.152:35656/0 (socket says 172.21.15.152:35656) 2024-04-17T08:47:39.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.425+0000 7ff9a3e00640 1 -- 172.21.15.152:0/4090723431 learned_addr learned my addr 172.21.15.152:0/4090723431 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:39.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.425+0000 7ff9a9200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ff9a40d0360 0x7ff9a40d07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.152:58956/0 (socket says 172.21.15.152:58956) 2024-04-17T08:47:39.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.425+0000 7ff9a3e00640 1 -- 172.21.15.152:0/4090723431 >> v2:172.21.15.196:3300/0 conn(0x7ff9a40d0360 msgr2=0x7ff9a40d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:39.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.425+0000 7ff9a3e00640 1 --2- 172.21.15.152:0/4090723431 >> v2:172.21.15.196:3300/0 conn(0x7ff9a40d0360 0x7ff9a40d07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:39.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.425+0000 7ff9a3e00640 1 -- 172.21.15.152:0/4090723431 >> v1:172.21.15.196:6789/0 conn(0x7ff9a406f980 legacy=0x7ff9a4072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:39.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.425+0000 7ff9a3e00640 1 -- 172.21.15.152:0/4090723431 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9a415c540 con 0x7ff9a40af670 2024-04-17T08:47:39.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.425+0000 7ff9a3e00640 1 --2- 172.21.15.152:0/4090723431 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff9a40af670 0x7ff9a415b8c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff994009e50 tx=0x7ff99401c9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bdbaa1a358ac3391 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:39.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.425+0000 7ff9a3400640 1 -- 172.21.15.152:0/4090723431 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9940a5750 con 0x7ff9a40af670 2024-04-17T08:47:39.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.425+0000 7ff9a3400640 1 -- 172.21.15.152:0/4090723431 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9940a58f0 con 0x7ff9a40af670 2024-04-17T08:47:39.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.425+0000 7ff9a3400640 1 -- 172.21.15.152:0/4090723431 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9940a5cc0 con 0x7ff9a40af670 2024-04-17T08:47:39.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.429+0000 7ff9ab200640 1 -- 172.21.15.152:0/4090723431 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff9a40af670 msgr2=0x7ff9a415b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:39.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.429+0000 7ff9ab200640 1 --2- 172.21.15.152:0/4090723431 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff9a40af670 0x7ff9a415b8c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff994009e50 tx=0x7ff99401c9a0 comp rx=0 tx=0).stop 2024-04-17T08:47:39.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.429+0000 7ff9ab200640 1 -- 172.21.15.152:0/4090723431 shutdown_connections 2024-04-17T08:47:39.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.429+0000 7ff9ab200640 1 --2- 172.21.15.152:0/4090723431 >> v2:172.21.15.196:3300/0 conn(0x7ff9a40d0360 0x7ff9a40d07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:39.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.429+0000 7ff9ab200640 1 --2- 172.21.15.152:0/4090723431 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff9a40af670 0x7ff9a415b8c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:39.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.429+0000 7ff9ab200640 1 -- 172.21.15.152:0/4090723431 >> 172.21.15.152:0/4090723431 conn(0x7ff9a40b3350 msgr2=0x7ff9a40b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:39.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.429+0000 7ff9ab200640 1 -- 172.21.15.152:0/4090723431 shutdown_connections 2024-04-17T08:47:39.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.429+0000 7ff9ab200640 1 -- 172.21.15.152:0/4090723431 wait complete. 2024-04-17T08:47:39.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.429+0000 7ff9ab200640 1 Processor -- start 2024-04-17T08:47:39.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.429+0000 7ff9ab200640 1 -- start start 2024-04-17T08:47:39.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.429+0000 7ff9ab200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff9a406f980 0x7ff9a41571d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:39.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.429+0000 7ff9ab200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9a40af670 0x7ff9a4153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:39.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.429+0000 7ff9ab200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff9a40d0360 0x7ff9a4152780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:39.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.429+0000 7ff9ab200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a415bf80 con 0x7ff9a40af670 2024-04-17T08:47:39.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.429+0000 7ff9ab200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a415be00 con 0x7ff9a40d0360 2024-04-17T08:47:39.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.429+0000 7ff9ab200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7ff9a4168050 con 0x7ff9a406f980 2024-04-17T08:47:39.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.429+0000 7ff99b400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9a40af670 0x7ff9a4153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:39.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.429+0000 7ff99b400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9a40af670 0x7ff9a4153f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60134/0 (socket says 172.21.15.152:60134) 2024-04-17T08:47:39.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.429+0000 7ff9a3e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff9a406f980 0x7ff9a41571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:39.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.429+0000 7ff99b400640 1 -- 172.21.15.152:0/3923076044 learned_addr learned my addr 172.21.15.152:0/3923076044 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:39.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.429+0000 7ff9a9200640 1 --2- 172.21.15.152:0/3923076044 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff9a40d0360 0x7ff9a4152780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:39.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.429+0000 7ff99b400640 1 -- 172.21.15.152:0/3923076044 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff9a406f980 msgr2=0x7ff9a41571d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:39.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.429+0000 7ff99b400640 1 --2- 172.21.15.152:0/3923076044 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff9a406f980 0x7ff9a41571d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:39.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.429+0000 7ff99b400640 1 -- 172.21.15.152:0/3923076044 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff9a40d0360 msgr2=0x7ff9a4152780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:39.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.429+0000 7ff99b400640 1 --2- 172.21.15.152:0/3923076044 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff9a40d0360 0x7ff9a4152780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:39.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.429+0000 7ff99b400640 1 -- 172.21.15.152:0/3923076044 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9a4152e80 con 0x7ff9a40af670 2024-04-17T08:47:39.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.433+0000 7ff99b400640 1 --2- 172.21.15.152:0/3923076044 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9a40af670 0x7ff9a4153f20 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff98c00c340 tx=0x7ff98c00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:39.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.433+0000 7ff9a0c00640 1 -- 172.21.15.152:0/3923076044 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff98c0052d0 con 0x7ff9a40af670 2024-04-17T08:47:39.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.433+0000 7ff9a0c00640 1 -- 172.21.15.152:0/3923076044 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff98c005470 con 0x7ff9a40af670 2024-04-17T08:47:39.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.433+0000 7ff9ab200640 1 -- 172.21.15.152:0/3923076044 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9a4153160 con 0x7ff9a40af670 2024-04-17T08:47:39.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.433+0000 7ff9a0c00640 1 -- 172.21.15.152:0/3923076044 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff98c007260 con 0x7ff9a40af670 2024-04-17T08:47:39.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.433+0000 7ff9ab200640 1 -- 172.21.15.152:0/3923076044 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9a4153720 con 0x7ff9a40af670 2024-04-17T08:47:39.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.433+0000 7ff9ab200640 1 -- 172.21.15.152:0/3923076044 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9a4068a30 con 0x7ff9a40af670 2024-04-17T08:47:39.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.433+0000 7ff9a0c00640 1 -- 172.21.15.152:0/3923076044 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff98c007400 con 0x7ff9a40af670 2024-04-17T08:47:39.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.433+0000 7ff9a0c00640 1 --2- 172.21.15.152:0/3923076044 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7ff980068380 0x7ff98006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:39.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.433+0000 7ff9a0c00640 1 -- 172.21.15.152:0/3923076044 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7ff98c086170 con 0x7ff9a40af670 2024-04-17T08:47:39.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.433+0000 7ff9a3e00640 1 --2- 172.21.15.152:0/3923076044 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7ff980068380 0x7ff98006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:39.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.437+0000 7ff9a3e00640 1 --2- 172.21.15.152:0/3923076044 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7ff980068380 0x7ff98006a840 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff9940ae000 tx=0x7ff9940a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:39.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.437+0000 7ff9a0c00640 1 -- 172.21.15.152:0/3923076044 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7ff98c055cb0 con 0x7ff9a40af670 2024-04-17T08:47:39.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.597+0000 7ff9ab200640 1 -- 172.21.15.152:0/3923076044 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff9a4074e80 con 0x7ff9a40af670 2024-04-17T08:47:39.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.597+0000 7ff9a0c00640 1 -- 172.21.15.152:0/3923076044 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7ff98c059fb0 con 0x7ff9a40af670 2024-04-17T08:47:39.598 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-04-17T08:47:39.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.597+0000 7ff9ab200640 1 -- 172.21.15.152:0/3923076044 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7ff980068380 msgr2=0x7ff98006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:39.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.597+0000 7ff9ab200640 1 --2- 172.21.15.152:0/3923076044 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7ff980068380 0x7ff98006a840 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff9940ae000 tx=0x7ff9940a7070 comp rx=0 tx=0).stop 2024-04-17T08:47:39.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.597+0000 7ff9ab200640 1 -- 172.21.15.152:0/3923076044 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9a40af670 msgr2=0x7ff9a4153f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:39.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.597+0000 7ff9ab200640 1 --2- 172.21.15.152:0/3923076044 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9a40af670 0x7ff9a4153f20 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff98c00c340 tx=0x7ff98c00c800 comp rx=0 tx=0).stop 2024-04-17T08:47:39.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.597+0000 7ff9ab200640 1 -- 172.21.15.152:0/3923076044 shutdown_connections 2024-04-17T08:47:39.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.597+0000 7ff9ab200640 1 --2- 172.21.15.152:0/3923076044 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff9a40d0360 0x7ff9a4152780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:39.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.597+0000 7ff9ab200640 1 --2- 172.21.15.152:0/3923076044 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9a40af670 0x7ff9a4153f20 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:39.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.597+0000 7ff9ab200640 1 --2- 172.21.15.152:0/3923076044 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7ff980068380 0x7ff98006a840 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:39.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.597+0000 7ff9ab200640 1 --2- 172.21.15.152:0/3923076044 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff9a406f980 0x7ff9a41571d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:39.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.597+0000 7ff9ab200640 1 -- 172.21.15.152:0/3923076044 >> 172.21.15.152:0/3923076044 conn(0x7ff9a40b3350 msgr2=0x7ff9a40ae380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:39.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.597+0000 7ff9ab200640 1 -- 172.21.15.152:0/3923076044 shutdown_connections 2024-04-17T08:47:39.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.597+0000 7ff9ab200640 1 -- 172.21.15.152:0/3923076044 wait complete. 2024-04-17T08:47:39.619 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-17T08:47:39.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.753+0000 7f75efa00640 1 Processor -- start 2024-04-17T08:47:39.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.753+0000 7f75efa00640 1 -- start start 2024-04-17T08:47:39.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.757+0000 7f75efa00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f75e80af670 0x7f75e815b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:39.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.757+0000 7f75efa00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f75e806f980 0x7f75e8072530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:39.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.757+0000 7f75efa00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75e815c260 con 0x7f75e80d0360 2024-04-17T08:47:39.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.757+0000 7f75efa00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f75e815c820 con 0x7f75e806f980 2024-04-17T08:47:39.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.757+0000 7f75efa00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f75e815c540 con 0x7f75e80af670 2024-04-17T08:47:39.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.757+0000 7f75e7e00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f75e806f980 0x7f75e8072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:39.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.757+0000 7f75e7e00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f75e806f980 0x7f75e8072530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60150/0 (socket says 172.21.15.152:60150) 2024-04-17T08:47:39.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.757+0000 7f75e7e00640 1 -- 172.21.15.152:0/538163209 learned_addr learned my addr 172.21.15.152:0/538163209 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:39.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.757+0000 7f75ed000640 1 --2- 172.21.15.152:0/538163209 >> v2:172.21.15.196:3300/0 conn(0x7f75e80af670 0x7f75e815b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:39.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.757+0000 7f75e7e00640 1 -- 172.21.15.152:0/538163209 >> v2:172.21.15.196:3300/0 conn(0x7f75e80af670 msgr2=0x7f75e815b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:39.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.757+0000 7f75e7e00640 1 --2- 172.21.15.152:0/538163209 >> v2:172.21.15.196:3300/0 conn(0x7f75e80af670 0x7f75e815b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:39.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.757+0000 7f75e7e00640 1 -- 172.21.15.152:0/538163209 >> v1:172.21.15.196:6789/0 conn(0x7f75e80d0360 legacy=0x7f75e806dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:39.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.757+0000 7f75e7e00640 1 -- 172.21.15.152:0/538163209 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75e8071d30 con 0x7f75e806f980 2024-04-17T08:47:39.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.757+0000 7f75ed000640 1 --2- 172.21.15.152:0/538163209 >> v2:172.21.15.196:3300/0 conn(0x7f75e80af670 0x7f75e815b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:47:39.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.761+0000 7f75e7e00640 1 --2- 172.21.15.152:0/538163209 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75e806f980 0x7f75e8072530 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f75e8074260 tx=0x7f75d401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7f31c1673a85b78 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:39.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.761+0000 7f75e7400640 1 -- 172.21.15.152:0/538163209 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d40b1070 con 0x7f75e806f980 2024-04-17T08:47:39.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.761+0000 7f75e7400640 1 -- 172.21.15.152:0/538163209 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75d40ac410 con 0x7f75e806f980 2024-04-17T08:47:39.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.761+0000 7f75e7400640 1 -- 172.21.15.152:0/538163209 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d40ac7e0 con 0x7f75e806f980 2024-04-17T08:47:39.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.761+0000 7f75efa00640 1 -- 172.21.15.152:0/538163209 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75e806f980 msgr2=0x7f75e8072530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:39.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.761+0000 7f75efa00640 1 --2- 172.21.15.152:0/538163209 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75e806f980 0x7f75e8072530 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f75e8074260 tx=0x7f75d401c420 comp rx=0 tx=0).stop 2024-04-17T08:47:39.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.761+0000 7f75efa00640 1 -- 172.21.15.152:0/538163209 shutdown_connections 2024-04-17T08:47:39.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.761+0000 7f75efa00640 1 --2- 172.21.15.152:0/538163209 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75e806f980 0x7f75e8072530 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:39.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.761+0000 7f75efa00640 1 --2- 172.21.15.152:0/538163209 >> v2:172.21.15.196:3300/0 conn(0x7f75e80af670 0x7f75e815b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:39.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.761+0000 7f75efa00640 1 -- 172.21.15.152:0/538163209 >> 172.21.15.152:0/538163209 conn(0x7f75e80b3350 msgr2=0x7f75e80b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:39.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.761+0000 7f75efa00640 1 -- 172.21.15.152:0/538163209 shutdown_connections 2024-04-17T08:47:39.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.761+0000 7f75efa00640 1 -- 172.21.15.152:0/538163209 wait complete. 2024-04-17T08:47:39.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.761+0000 7f75efa00640 1 Processor -- start 2024-04-17T08:47:39.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.761+0000 7f75efa00640 1 -- start start 2024-04-17T08:47:39.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.761+0000 7f75efa00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75e806f980 0x7f75e81556d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:39.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.761+0000 7f75efa00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75e80af670 0x7f75e81682c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:39.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.761+0000 7f75efa00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f75e80d0360 0x7f75e815ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:39.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.761+0000 7f75efa00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f75e815bf80 con 0x7f75e806f980 2024-04-17T08:47:39.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.761+0000 7f75efa00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f75e815be00 con 0x7f75e80d0360 2024-04-17T08:47:39.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.761+0000 7f75efa00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f75e8072a70 con 0x7f75e80af670 2024-04-17T08:47:39.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.761+0000 7f75ed000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75e806f980 0x7f75e81556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:39.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.761+0000 7f75ed000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75e806f980 0x7f75e81556d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60158/0 (socket says 172.21.15.152:60158) 2024-04-17T08:47:39.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.761+0000 7f75ed000640 1 -- 172.21.15.152:0/150889445 learned_addr learned my addr 172.21.15.152:0/150889445 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:39.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.761+0000 7f75e7e00640 1 --2- 172.21.15.152:0/150889445 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75e80af670 0x7f75e81682c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:39.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.761+0000 7f75eda00640 1 --2- 172.21.15.152:0/150889445 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f75e80d0360 0x7f75e815ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:39.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.765+0000 7f75ed000640 1 -- 172.21.15.152:0/150889445 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75e80af670 msgr2=0x7f75e81682c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:39.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.765+0000 7f75ed000640 1 --2- 172.21.15.152:0/150889445 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75e80af670 0x7f75e81682c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:39.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.765+0000 7f75ed000640 1 -- 172.21.15.152:0/150889445 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f75e80d0360 msgr2=0x7f75e815ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:39.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.765+0000 7f75ed000640 1 --2- 172.21.15.152:0/150889445 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f75e80d0360 0x7f75e815ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:39.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.765+0000 7f75ed000640 1 -- 172.21.15.152:0/150889445 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75e815a600 con 0x7f75e806f980 2024-04-17T08:47:39.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.765+0000 7f75ed000640 1 --2- 172.21.15.152:0/150889445 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75e806f980 0x7f75e81556d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f75d800cf60 tx=0x7f75d800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:39.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.765+0000 7f75e4c00640 1 -- 172.21.15.152:0/150889445 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d801a070 con 0x7f75e806f980 2024-04-17T08:47:39.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.765+0000 7f75e4c00640 1 -- 172.21.15.152:0/150889445 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75d800d840 con 0x7f75e806f980 2024-04-17T08:47:39.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.765+0000 7f75e4c00640 1 -- 172.21.15.152:0/150889445 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d800dc10 con 0x7f75e806f980 2024-04-17T08:47:39.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.765+0000 7f75efa00640 1 -- 172.21.15.152:0/150889445 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75e815a8e0 con 0x7f75e806f980 2024-04-17T08:47:39.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.765+0000 7f75efa00640 1 -- 172.21.15.152:0/150889445 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75e815aea0 con 0x7f75e806f980 2024-04-17T08:47:39.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.765+0000 7f75efa00640 1 -- 172.21.15.152:0/150889445 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75e8068a30 con 0x7f75e806f980 2024-04-17T08:47:39.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.765+0000 7f75e4c00640 1 -- 172.21.15.152:0/150889445 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f75d801d070 con 0x7f75e806f980 2024-04-17T08:47:39.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.765+0000 7f75e4c00640 1 --2- 172.21.15.152:0/150889445 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f75c8068380 0x7f75c806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:39.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.765+0000 7f75e4c00640 1 -- 172.21.15.152:0/150889445 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f75d80875e0 con 0x7f75e806f980 2024-04-17T08:47:39.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.769+0000 7f75e7e00640 1 --2- 172.21.15.152:0/150889445 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f75c8068380 0x7f75c806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:39.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.769+0000 7f75e7e00640 1 --2- 172.21.15.152:0/150889445 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f75c8068380 0x7f75c806a840 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f75d40ae000 tx=0x7f75d4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:39.773 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.769+0000 7f75e4c00640 1 -- 172.21.15.152:0/150889445 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f75d8057120 con 0x7f75e806f980 2024-04-17T08:47:39.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.929+0000 7f75efa00640 1 -- 172.21.15.152:0/150889445 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f75e8150290 con 0x7f75e806f980 2024-04-17T08:47:39.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.929+0000 7f75e4c00640 1 -- 172.21.15.152:0/150889445 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f75d805b420 con 0x7f75e806f980 2024-04-17T08:47:39.934 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 64 2024-04-17T08:47:39.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.933+0000 7f75efa00640 1 -- 172.21.15.152:0/150889445 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f75c8068380 msgr2=0x7f75c806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:39.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.933+0000 7f75efa00640 1 --2- 172.21.15.152:0/150889445 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f75c8068380 0x7f75c806a840 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f75d40ae000 tx=0x7f75d4009040 comp rx=0 tx=0).stop 2024-04-17T08:47:39.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.933+0000 7f75efa00640 1 -- 172.21.15.152:0/150889445 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75e806f980 msgr2=0x7f75e81556d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:39.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.933+0000 7f75efa00640 1 --2- 172.21.15.152:0/150889445 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75e806f980 0x7f75e81556d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f75d800cf60 tx=0x7f75d800cf90 comp rx=0 tx=0).stop 2024-04-17T08:47:39.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.933+0000 7f75efa00640 1 -- 172.21.15.152:0/150889445 shutdown_connections 2024-04-17T08:47:39.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.933+0000 7f75efa00640 1 --2- 172.21.15.152:0/150889445 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f75e80d0360 0x7f75e815ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:39.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.933+0000 7f75efa00640 1 --2- 172.21.15.152:0/150889445 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f75c8068380 0x7f75c806a840 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:39.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.933+0000 7f75efa00640 1 --2- 172.21.15.152:0/150889445 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75e80af670 0x7f75e81682c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:39.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.933+0000 7f75efa00640 1 --2- 172.21.15.152:0/150889445 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75e806f980 0x7f75e81556d0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:39.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.933+0000 7f75efa00640 1 -- 172.21.15.152:0/150889445 >> 172.21.15.152:0/150889445 conn(0x7f75e80b3350 msgr2=0x7f75e814c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:39.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.933+0000 7f75efa00640 1 -- 172.21.15.152:0/150889445 shutdown_connections 2024-04-17T08:47:39.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:39.933+0000 7f75efa00640 1 -- 172.21.15.152:0/150889445 wait complete. 2024-04-17T08:47:39.955 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-17T08:47:40.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.089+0000 7fdd9e600640 1 Processor -- start 2024-04-17T08:47:40.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.089+0000 7fdd9e600640 1 -- start start 2024-04-17T08:47:40.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.093+0000 7fdd9e600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdd980d0a70 0x7fdd98160010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:40.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.093+0000 7fdd9e600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fdd9815d710 0x7fdd98160550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:40.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.093+0000 7fdd9e600640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd98160a90 con 0x7fdd9815a010 2024-04-17T08:47:40.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.093+0000 7fdd9e600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fdd9815d280 con 0x7fdd9815d710 2024-04-17T08:47:40.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.093+0000 7fdd9e600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fdd9815c9d0 con 0x7fdd980d0a70 2024-04-17T08:47:40.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.093+0000 7fdd96a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdd980d0a70 0x7fdd98160010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:40.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.093+0000 7fdd97400640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fdd9815a010 0x7fdd980d0360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.152:40348/0 (socket says 172.21.15.152:40348) 2024-04-17T08:47:40.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.093+0000 7fdd97400640 1 -- 172.21.15.152:0/1690506531 learned_addr learned my addr 172.21.15.152:0/1690506531 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:40.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.093+0000 7fdd97e00640 1 --2- 172.21.15.152:0/1690506531 >> v2:172.21.15.196:3300/0 conn(0x7fdd9815d710 0x7fdd98160550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:40.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.093+0000 7fdd96a00640 1 -- 172.21.15.152:0/1690506531 >> v2:172.21.15.196:3300/0 conn(0x7fdd9815d710 msgr2=0x7fdd98160550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:40.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.093+0000 7fdd96a00640 1 --2- 172.21.15.152:0/1690506531 >> v2:172.21.15.196:3300/0 conn(0x7fdd9815d710 0x7fdd98160550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:40.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.093+0000 7fdd96000640 1 -- 172.21.15.152:0/1690506531 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3877605194 0 0) 0x7fdd98160a90 con 0x7fdd9815a010 2024-04-17T08:47:40.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.093+0000 7fdd96a00640 1 -- 172.21.15.152:0/1690506531 >> v1:172.21.15.196:6789/0 conn(0x7fdd9815a010 legacy=0x7fdd980d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:40.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.093+0000 7fdd96a00640 1 -- 172.21.15.152:0/1690506531 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd98160d20 con 0x7fdd980d0a70 2024-04-17T08:47:40.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.097+0000 7fdd96a00640 1 --2- 172.21.15.152:0/1690506531 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdd980d0a70 0x7fdd98160010 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdd840097c0 tx=0x7fdd8401c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a0b4e23d0415ec6 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:40.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.097+0000 7fdd96000640 1 -- 172.21.15.152:0/1690506531 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd840b0070 con 0x7fdd980d0a70 2024-04-17T08:47:40.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.097+0000 7fdd96000640 1 -- 172.21.15.152:0/1690506531 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd840ab600 con 0x7fdd980d0a70 2024-04-17T08:47:40.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.097+0000 7fdd96000640 1 -- 172.21.15.152:0/1690506531 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd840ab9d0 con 0x7fdd980d0a70 2024-04-17T08:47:40.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.097+0000 7fdd9e600640 1 -- 172.21.15.152:0/1690506531 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdd980d0a70 msgr2=0x7fdd98160010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:40.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.097+0000 7fdd9e600640 1 --2- 172.21.15.152:0/1690506531 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdd980d0a70 0x7fdd98160010 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdd840097c0 tx=0x7fdd8401c410 comp rx=0 tx=0).stop 2024-04-17T08:47:40.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.097+0000 7fdd9e600640 1 -- 172.21.15.152:0/1690506531 shutdown_connections 2024-04-17T08:47:40.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.097+0000 7fdd9e600640 1 --2- 172.21.15.152:0/1690506531 >> v2:172.21.15.196:3300/0 conn(0x7fdd9815d710 0x7fdd98160550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:40.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.097+0000 7fdd9e600640 1 --2- 172.21.15.152:0/1690506531 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdd980d0a70 0x7fdd98160010 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:40.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.097+0000 7fdd9e600640 1 -- 172.21.15.152:0/1690506531 >> 172.21.15.152:0/1690506531 conn(0x7fdd980b3350 msgr2=0x7fdd980b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:40.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.097+0000 7fdd9e600640 1 -- 172.21.15.152:0/1690506531 shutdown_connections 2024-04-17T08:47:40.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.097+0000 7fdd9e600640 1 -- 172.21.15.152:0/1690506531 wait complete. 2024-04-17T08:47:40.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.097+0000 7fdd9e600640 1 Processor -- start 2024-04-17T08:47:40.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.097+0000 7fdd9e600640 1 -- start start 2024-04-17T08:47:40.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.101+0000 7fdd9e600640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd980d0a70 0x7fdd98099940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:40.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.101+0000 7fdd9e600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdd9815a010 0x7fdd980b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:40.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.101+0000 7fdd9e600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdd9815d710 0x7fdd981534b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:40.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.101+0000 7fdd9e600640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdd9815e570 con 0x7fdd980d0a70 2024-04-17T08:47:40.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.101+0000 7fdd9e600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fdd9815e3f0 con 0x7fdd9815a010 2024-04-17T08:47:40.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.101+0000 7fdd9e600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fdd9815e6f0 con 0x7fdd9815d710 2024-04-17T08:47:40.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.101+0000 7fdd97400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd980d0a70 0x7fdd98099940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:40.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.101+0000 7fdd97400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd980d0a70 0x7fdd98099940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60174/0 (socket says 172.21.15.152:60174) 2024-04-17T08:47:40.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.101+0000 7fdd97400640 1 -- 172.21.15.152:0/1063929962 learned_addr learned my addr 172.21.15.152:0/1063929962 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:40.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.101+0000 7fdd96a00640 1 --2- 172.21.15.152:0/1063929962 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdd9815a010 0x7fdd980b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:40.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.101+0000 7fdd97e00640 1 --2- 172.21.15.152:0/1063929962 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdd9815d710 0x7fdd981534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:40.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.101+0000 7fdd97400640 1 -- 172.21.15.152:0/1063929962 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdd9815d710 msgr2=0x7fdd981534b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:40.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.101+0000 7fdd97400640 1 --2- 172.21.15.152:0/1063929962 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdd9815d710 0x7fdd981534b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:40.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.101+0000 7fdd97400640 1 -- 172.21.15.152:0/1063929962 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdd9815a010 msgr2=0x7fdd980b00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:40.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.101+0000 7fdd97400640 1 --2- 172.21.15.152:0/1063929962 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdd9815a010 0x7fdd980b00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:40.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.101+0000 7fdd97400640 1 -- 172.21.15.152:0/1063929962 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd980b1450 con 0x7fdd980d0a70 2024-04-17T08:47:40.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.101+0000 7fdd97400640 1 --2- 172.21.15.152:0/1063929962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd980d0a70 0x7fdd98099940 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fdd8800c520 tx=0x7fdd8800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:40.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.101+0000 7fdd8f400640 1 -- 172.21.15.152:0/1063929962 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd88018070 con 0x7fdd980d0a70 2024-04-17T08:47:40.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.101+0000 7fdd8f400640 1 -- 172.21.15.152:0/1063929962 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd880074e0 con 0x7fdd980d0a70 2024-04-17T08:47:40.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.101+0000 7fdd8f400640 1 -- 172.21.15.152:0/1063929962 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd880049f0 con 0x7fdd980d0a70 2024-04-17T08:47:40.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.101+0000 7fdd9e600640 1 -- 172.21.15.152:0/1063929962 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd98099e80 con 0x7fdd980d0a70 2024-04-17T08:47:40.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.101+0000 7fdd9e600640 1 -- 172.21.15.152:0/1063929962 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd980b0e90 con 0x7fdd980d0a70 2024-04-17T08:47:40.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.101+0000 7fdd9e600640 1 -- 172.21.15.152:0/1063929962 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd98068a30 con 0x7fdd980d0a70 2024-04-17T08:47:40.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.101+0000 7fdd8f400640 1 -- 172.21.15.152:0/1063929962 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdd8801b070 con 0x7fdd980d0a70 2024-04-17T08:47:40.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.105+0000 7fdd8f400640 1 --2- 172.21.15.152:0/1063929962 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fdd78068380 0x7fdd7806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:40.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.105+0000 7fdd8f400640 1 -- 172.21.15.152:0/1063929962 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fdd880860d0 con 0x7fdd980d0a70 2024-04-17T08:47:40.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.105+0000 7fdd96a00640 1 --2- 172.21.15.152:0/1063929962 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fdd78068380 0x7fdd7806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:40.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.105+0000 7fdd96a00640 1 --2- 172.21.15.152:0/1063929962 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fdd78068380 0x7fdd7806a840 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fdd840ad000 tx=0x7fdd840a4f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:40.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.109+0000 7fdd8f400640 1 -- 172.21.15.152:0/1063929962 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fdd88055cb0 con 0x7fdd980d0a70 2024-04-17T08:47:40.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.265+0000 7fdd9e600640 1 -- 172.21.15.152:0/1063929962 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fdd980b3a70 con 0x7fdd980d0a70 2024-04-17T08:47:40.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.265+0000 7fdd8f400640 1 -- 172.21.15.152:0/1063929962 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7fdd88059fb0 con 0x7fdd980d0a70 2024-04-17T08:47:40.267 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-04-17T08:47:40.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.265+0000 7fdd9e600640 1 -- 172.21.15.152:0/1063929962 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fdd78068380 msgr2=0x7fdd7806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:40.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.265+0000 7fdd9e600640 1 --2- 172.21.15.152:0/1063929962 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fdd78068380 0x7fdd7806a840 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fdd840ad000 tx=0x7fdd840a4f90 comp rx=0 tx=0).stop 2024-04-17T08:47:40.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.265+0000 7fdd9e600640 1 -- 172.21.15.152:0/1063929962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd980d0a70 msgr2=0x7fdd98099940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:40.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.265+0000 7fdd9e600640 1 --2- 172.21.15.152:0/1063929962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd980d0a70 0x7fdd98099940 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fdd8800c520 tx=0x7fdd8800c9e0 comp rx=0 tx=0).stop 2024-04-17T08:47:40.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.265+0000 7fdd9e600640 1 -- 172.21.15.152:0/1063929962 shutdown_connections 2024-04-17T08:47:40.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.265+0000 7fdd9e600640 1 --2- 172.21.15.152:0/1063929962 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fdd78068380 0x7fdd7806a840 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:40.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.265+0000 7fdd9e600640 1 --2- 172.21.15.152:0/1063929962 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdd9815d710 0x7fdd981534b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:40.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.265+0000 7fdd9e600640 1 --2- 172.21.15.152:0/1063929962 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdd9815a010 0x7fdd980b00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:40.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.265+0000 7fdd9e600640 1 --2- 172.21.15.152:0/1063929962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd980d0a70 0x7fdd98099940 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:40.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.265+0000 7fdd9e600640 1 -- 172.21.15.152:0/1063929962 >> 172.21.15.152:0/1063929962 conn(0x7fdd980b3350 msgr2=0x7fdd98165bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:40.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.265+0000 7fdd9e600640 1 -- 172.21.15.152:0/1063929962 shutdown_connections 2024-04-17T08:47:40.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.265+0000 7fdd9e600640 1 -- 172.21.15.152:0/1063929962 wait complete. 2024-04-17T08:47:40.288 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-17T08:47:40.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.425+0000 7fb060200640 1 Processor -- start 2024-04-17T08:47:40.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.425+0000 7fb060200640 1 -- start start 2024-04-17T08:47:40.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.425+0000 7fb060200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fb0580af670 0x7fb05815b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:40.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.425+0000 7fb060200640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb05806f980 0x7fb058072530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:40.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.429+0000 7fb060200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb05815c260 con 0x7fb0580d0360 2024-04-17T08:47:40.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.429+0000 7fb060200640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fb05815c820 con 0x7fb05806f980 2024-04-17T08:47:40.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.429+0000 7fb060200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fb05815c540 con 0x7fb0580af670 2024-04-17T08:47:40.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.429+0000 7fb05ce00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb05806f980 0x7fb058072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:40.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.429+0000 7fb05ce00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb05806f980 0x7fb058072530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60186/0 (socket says 172.21.15.152:60186) 2024-04-17T08:47:40.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.429+0000 7fb05ce00640 1 -- 172.21.15.152:0/1621350411 learned_addr learned my addr 172.21.15.152:0/1621350411 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:40.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.429+0000 7fb05d800640 1 --2- 172.21.15.152:0/1621350411 >> v2:172.21.15.196:3300/0 conn(0x7fb0580af670 0x7fb05815b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:40.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.429+0000 7fb05ce00640 1 -- 172.21.15.152:0/1621350411 >> v2:172.21.15.196:3300/0 conn(0x7fb0580af670 msgr2=0x7fb05815b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:40.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.429+0000 7fb05ce00640 1 --2- 172.21.15.152:0/1621350411 >> v2:172.21.15.196:3300/0 conn(0x7fb0580af670 0x7fb05815b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:40.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.429+0000 7fb05ce00640 1 -- 172.21.15.152:0/1621350411 >> v1:172.21.15.196:6789/0 conn(0x7fb0580d0360 legacy=0x7fb05806dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:40.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.429+0000 7fb05ce00640 1 -- 172.21.15.152:0/1621350411 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb058071d30 con 0x7fb05806f980 2024-04-17T08:47:40.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.429+0000 7fb05ce00640 1 --2- 172.21.15.152:0/1621350411 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb05806f980 0x7fb058072530 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb058074260 tx=0x7fb04401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=478b2ccb6628654f server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:40.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.429+0000 7fb057e00640 1 -- 172.21.15.152:0/1621350411 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0440b1070 con 0x7fb05806f980 2024-04-17T08:47:40.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.429+0000 7fb057e00640 1 -- 172.21.15.152:0/1621350411 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0440ac410 con 0x7fb05806f980 2024-04-17T08:47:40.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.429+0000 7fb057e00640 1 -- 172.21.15.152:0/1621350411 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0440ac7e0 con 0x7fb05806f980 2024-04-17T08:47:40.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.433+0000 7fb060200640 1 -- 172.21.15.152:0/1621350411 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb05806f980 msgr2=0x7fb058072530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:40.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.433+0000 7fb060200640 1 --2- 172.21.15.152:0/1621350411 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb05806f980 0x7fb058072530 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb058074260 tx=0x7fb04401c420 comp rx=0 tx=0).stop 2024-04-17T08:47:40.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.433+0000 7fb060200640 1 -- 172.21.15.152:0/1621350411 shutdown_connections 2024-04-17T08:47:40.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.433+0000 7fb060200640 1 --2- 172.21.15.152:0/1621350411 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb05806f980 0x7fb058072530 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:40.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.433+0000 7fb060200640 1 --2- 172.21.15.152:0/1621350411 >> v2:172.21.15.196:3300/0 conn(0x7fb0580af670 0x7fb05815b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:40.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.433+0000 7fb060200640 1 -- 172.21.15.152:0/1621350411 >> 172.21.15.152:0/1621350411 conn(0x7fb0580b3350 msgr2=0x7fb0580b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:40.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.433+0000 7fb060200640 1 -- 172.21.15.152:0/1621350411 shutdown_connections 2024-04-17T08:47:40.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.433+0000 7fb060200640 1 -- 172.21.15.152:0/1621350411 wait complete. 2024-04-17T08:47:40.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.433+0000 7fb060200640 1 Processor -- start 2024-04-17T08:47:40.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.433+0000 7fb060200640 1 -- start start 2024-04-17T08:47:40.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.433+0000 7fb060200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb05806f980 0x7fb0580cf520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:40.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.433+0000 7fb060200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb0580af670 0x7fb058144c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:40.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.433+0000 7fb060200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0580d0360 0x7fb058164440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:40.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.433+0000 7fb060200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb05815bf80 con 0x7fb0580af670 2024-04-17T08:47:40.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.433+0000 7fb060200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb05815be00 con 0x7fb0580d0360 2024-04-17T08:47:40.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.433+0000 7fb060200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fb058072a70 con 0x7fb05806f980 2024-04-17T08:47:40.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.433+0000 7fb05ce00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb0580af670 0x7fb058144c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:40.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.433+0000 7fb05ce00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb0580af670 0x7fb058144c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60196/0 (socket says 172.21.15.152:60196) 2024-04-17T08:47:40.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.433+0000 7fb05ce00640 1 -- 172.21.15.152:0/2445235107 learned_addr learned my addr 172.21.15.152:0/2445235107 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:40.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.433+0000 7fb05d800640 1 --2- 172.21.15.152:0/2445235107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb05806f980 0x7fb0580cf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:40.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.433+0000 7fb05e200640 1 --2- 172.21.15.152:0/2445235107 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0580d0360 0x7fb058164440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:40.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.433+0000 7fb05ce00640 1 -- 172.21.15.152:0/2445235107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb05806f980 msgr2=0x7fb0580cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:40.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.433+0000 7fb05ce00640 1 --2- 172.21.15.152:0/2445235107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb05806f980 0x7fb0580cf520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:40.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.433+0000 7fb05ce00640 1 -- 172.21.15.152:0/2445235107 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0580d0360 msgr2=0x7fb058164440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:40.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.433+0000 7fb05ce00640 1 --2- 172.21.15.152:0/2445235107 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0580d0360 0x7fb058164440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:40.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.433+0000 7fb05ce00640 1 -- 172.21.15.152:0/2445235107 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb05809a170 con 0x7fb0580af670 2024-04-17T08:47:40.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.437+0000 7fb05ce00640 1 --2- 172.21.15.152:0/2445235107 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb0580af670 0x7fb058144c40 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb0440af040 tx=0x7fb0440191c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:40.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.437+0000 7fb055600640 1 -- 172.21.15.152:0/2445235107 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0440bc070 con 0x7fb0580af670 2024-04-17T08:47:40.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.437+0000 7fb055600640 1 -- 172.21.15.152:0/2445235107 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0440ab5c0 con 0x7fb0580af670 2024-04-17T08:47:40.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.437+0000 7fb055600640 1 -- 172.21.15.152:0/2445235107 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0440ace60 con 0x7fb0580af670 2024-04-17T08:47:40.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.437+0000 7fb060200640 1 -- 172.21.15.152:0/2445235107 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb05809a6f0 con 0x7fb0580af670 2024-04-17T08:47:40.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.437+0000 7fb060200640 1 -- 172.21.15.152:0/2445235107 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0581423d0 con 0x7fb0580af670 2024-04-17T08:47:40.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.437+0000 7fb060200640 1 -- 172.21.15.152:0/2445235107 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb058068a30 con 0x7fb0580af670 2024-04-17T08:47:40.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.437+0000 7fb055600640 1 -- 172.21.15.152:0/2445235107 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb0440bf070 con 0x7fb0580af670 2024-04-17T08:47:40.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.437+0000 7fb055600640 1 --2- 172.21.15.152:0/2445235107 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb0380683b0 0x7fb03806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:40.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.437+0000 7fb055600640 1 -- 172.21.15.152:0/2445235107 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fb0441206b0 con 0x7fb0580af670 2024-04-17T08:47:40.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.437+0000 7fb05d800640 1 --2- 172.21.15.152:0/2445235107 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb0380683b0 0x7fb03806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:40.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.441+0000 7fb05d800640 1 --2- 172.21.15.152:0/2445235107 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb0380683b0 0x7fb03806a870 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb058070780 tx=0x7fb04c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:40.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.441+0000 7fb055600640 1 -- 172.21.15.152:0/2445235107 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fb0440160d0 con 0x7fb0580af670 2024-04-17T08:47:40.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.609+0000 7fb060200640 1 -- 172.21.15.152:0/2445235107 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb05806df40 con 0x7fb0580af670 2024-04-17T08:47:40.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.609+0000 7fb055600640 1 -- 172.21.15.152:0/2445235107 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7fb0440f0160 con 0x7fb0580af670 2024-04-17T08:47:40.613 INFO:teuthology.orchestra.run.smithi152.stderr:listed 0 entries 2024-04-17T08:47:40.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.613+0000 7fb060200640 1 -- 172.21.15.152:0/2445235107 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb0380683b0 msgr2=0x7fb03806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:40.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.613+0000 7fb060200640 1 --2- 172.21.15.152:0/2445235107 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb0380683b0 0x7fb03806a870 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb058070780 tx=0x7fb04c008040 comp rx=0 tx=0).stop 2024-04-17T08:47:40.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.613+0000 7fb060200640 1 -- 172.21.15.152:0/2445235107 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb0580af670 msgr2=0x7fb058144c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:40.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.613+0000 7fb060200640 1 --2- 172.21.15.152:0/2445235107 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb0580af670 0x7fb058144c40 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb0440af040 tx=0x7fb0440191c0 comp rx=0 tx=0).stop 2024-04-17T08:47:40.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.613+0000 7fb060200640 1 -- 172.21.15.152:0/2445235107 shutdown_connections 2024-04-17T08:47:40.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.613+0000 7fb060200640 1 --2- 172.21.15.152:0/2445235107 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0580d0360 0x7fb058164440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:40.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.613+0000 7fb060200640 1 --2- 172.21.15.152:0/2445235107 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb0580af670 0x7fb058144c40 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:40.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.613+0000 7fb060200640 1 --2- 172.21.15.152:0/2445235107 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb0380683b0 0x7fb03806a870 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:40.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.613+0000 7fb060200640 1 --2- 172.21.15.152:0/2445235107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb05806f980 0x7fb0580cf520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:40.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.613+0000 7fb060200640 1 -- 172.21.15.152:0/2445235107 >> 172.21.15.152:0/2445235107 conn(0x7fb0580b3350 msgr2=0x7fb058158110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:40.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.613+0000 7fb060200640 1 -- 172.21.15.152:0/2445235107 shutdown_connections 2024-04-17T08:47:40.616 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.613+0000 7fb060200640 1 -- 172.21.15.152:0/2445235107 wait complete. 2024-04-17T08:47:40.635 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi152.front.sepia.ceph.com... 2024-04-17T08:47:40.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:40.636 DEBUG:teuthology.orchestra.run.smithi152:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-04-17T08:47:40.656 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T08:47:40.656 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi152.front.sepia.ceph.com 2024-04-17T08:47:40.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:40.657 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-04-17T08:47:40.706 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-17T08:47:40.706 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-17T08:47:40.715 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-17T08:47:40.715 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-17T08:47:40.764 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T08:47:40.900 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.897+0000 7f159be00640 1 Processor -- start 2024-04-17T08:47:40.900 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.897+0000 7f159be00640 1 -- start start 2024-04-17T08:47:40.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.897+0000 7f159be00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f15940af670 0x7f159415b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:40.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.897+0000 7f159be00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f159406f980 0x7f1594072530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:40.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.897+0000 7f159be00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f15940d0360 0x7f15940d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:40.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.897+0000 7f159be00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f159415c820 con 0x7f15940af670 2024-04-17T08:47:40.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.897+0000 7f159be00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f159415c260 con 0x7f159406f980 2024-04-17T08:47:40.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.897+0000 7f159be00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f159415c540 con 0x7f15940d0360 2024-04-17T08:47:40.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.897+0000 7f1599400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f15940af670 0x7f159415b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:40.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.897+0000 7f1599400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f15940af670 0x7f159415b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60200/0 (socket says 172.21.15.152:60200) 2024-04-17T08:47:40.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.897+0000 7f1599400640 1 -- 172.21.15.152:0/3454425029 learned_addr learned my addr 172.21.15.152:0/3454425029 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:40.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.897+0000 7f1598a00640 1 --2- 172.21.15.152:0/3454425029 >> v2:172.21.15.196:3300/0 conn(0x7f159406f980 0x7f1594072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:40.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.897+0000 7f1599e00640 1 --2- 172.21.15.152:0/3454425029 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f15940d0360 0x7f15940d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:40.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.897+0000 7f1599400640 1 -- 172.21.15.152:0/3454425029 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f15940d0360 msgr2=0x7f15940d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:40.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.897+0000 7f1599400640 1 --2- 172.21.15.152:0/3454425029 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f15940d0360 0x7f15940d07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:40.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.897+0000 7f1599400640 1 -- 172.21.15.152:0/3454425029 >> v2:172.21.15.196:3300/0 conn(0x7f159406f980 msgr2=0x7f1594072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:40.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.897+0000 7f1599400640 1 --2- 172.21.15.152:0/3454425029 >> v2:172.21.15.196:3300/0 conn(0x7f159406f980 0x7f1594072530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:40.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.897+0000 7f1599400640 1 -- 172.21.15.152:0/3454425029 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1594071d30 con 0x7f15940af670 2024-04-17T08:47:40.904 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.901+0000 7f1599400640 1 --2- 172.21.15.152:0/3454425029 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f15940af670 0x7f159415b8c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f15940b41d0 tx=0x7f158801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c283397a605b6346 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:40.904 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.901+0000 7f1593e00640 1 -- 172.21.15.152:0/3454425029 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15880a5660 con 0x7f15940af670 2024-04-17T08:47:40.904 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.901+0000 7f1593e00640 1 -- 172.21.15.152:0/3454425029 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15880a5800 con 0x7f15940af670 2024-04-17T08:47:40.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.901+0000 7f1593e00640 1 -- 172.21.15.152:0/3454425029 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15880a5bd0 con 0x7f15940af670 2024-04-17T08:47:40.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.901+0000 7f159be00640 1 -- 172.21.15.152:0/3454425029 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f15940af670 msgr2=0x7f159415b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:40.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.901+0000 7f159be00640 1 --2- 172.21.15.152:0/3454425029 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f15940af670 0x7f159415b8c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f15940b41d0 tx=0x7f158801c960 comp rx=0 tx=0).stop 2024-04-17T08:47:40.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.901+0000 7f159be00640 1 -- 172.21.15.152:0/3454425029 shutdown_connections 2024-04-17T08:47:40.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.901+0000 7f159be00640 1 --2- 172.21.15.152:0/3454425029 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f15940d0360 0x7f15940d07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:40.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.901+0000 7f159be00640 1 --2- 172.21.15.152:0/3454425029 >> v2:172.21.15.196:3300/0 conn(0x7f159406f980 0x7f1594072530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:40.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.901+0000 7f159be00640 1 --2- 172.21.15.152:0/3454425029 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f15940af670 0x7f159415b8c0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:40.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.901+0000 7f159be00640 1 -- 172.21.15.152:0/3454425029 >> 172.21.15.152:0/3454425029 conn(0x7f15940b3350 msgr2=0x7f15940b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:40.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.901+0000 7f159be00640 1 -- 172.21.15.152:0/3454425029 shutdown_connections 2024-04-17T08:47:40.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.901+0000 7f159be00640 1 -- 172.21.15.152:0/3454425029 wait complete. 2024-04-17T08:47:40.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.905+0000 7f159be00640 1 Processor -- start 2024-04-17T08:47:40.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.905+0000 7f159be00640 1 -- start start 2024-04-17T08:47:40.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.905+0000 7f159be00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f159406f980 0x7f159414b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:40.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.905+0000 7f159be00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f15940af670 0x7f1594155f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:40.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.905+0000 7f159be00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f15940d0360 0x7f1594164400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:40.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.905+0000 7f159be00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1594072bf0 con 0x7f15940d0360 2024-04-17T08:47:40.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.905+0000 7f159be00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1594072a70 con 0x7f15940af670 2024-04-17T08:47:40.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.905+0000 7f159be00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f159415eee0 con 0x7f159406f980 2024-04-17T08:47:40.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.905+0000 7f1599e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f15940d0360 0x7f1594164400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:40.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.905+0000 7f1599e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f15940d0360 0x7f1594164400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60202/0 (socket says 172.21.15.152:60202) 2024-04-17T08:47:40.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.905+0000 7f1599e00640 1 -- 172.21.15.152:0/4179962775 learned_addr learned my addr 172.21.15.152:0/4179962775 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:40.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.905+0000 7f1598a00640 1 --2- 172.21.15.152:0/4179962775 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f15940af670 0x7f1594155f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:40.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.905+0000 7f1599400640 1 --2- 172.21.15.152:0/4179962775 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f159406f980 0x7f159414b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:40.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.905+0000 7f1599e00640 1 -- 172.21.15.152:0/4179962775 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f159406f980 msgr2=0x7f159414b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:40.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.905+0000 7f1599e00640 1 --2- 172.21.15.152:0/4179962775 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f159406f980 0x7f159414b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:40.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.905+0000 7f1599e00640 1 -- 172.21.15.152:0/4179962775 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f15940af670 msgr2=0x7f1594155f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:40.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.905+0000 7f1599e00640 1 --2- 172.21.15.152:0/4179962775 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f15940af670 0x7f1594155f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:40.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.905+0000 7f1599e00640 1 -- 172.21.15.152:0/4179962775 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f159414f7f0 con 0x7f15940d0360 2024-04-17T08:47:40.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.905+0000 7f1599400640 1 --2- 172.21.15.152:0/4179962775 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f159406f980 0x7f159414b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:40.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.905+0000 7f1599e00640 1 --2- 172.21.15.152:0/4179962775 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f15940d0360 0x7f1594164400 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f158c00d590 tx=0x7f158c00da50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:40.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.905+0000 7f1591600640 1 -- 172.21.15.152:0/4179962775 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f158c0125f0 con 0x7f15940d0360 2024-04-17T08:47:40.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.905+0000 7f1591600640 1 -- 172.21.15.152:0/4179962775 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f158c019070 con 0x7f15940d0360 2024-04-17T08:47:40.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.905+0000 7f1591600640 1 -- 172.21.15.152:0/4179962775 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f158c0129f0 con 0x7f15940d0360 2024-04-17T08:47:40.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.905+0000 7f159be00640 1 -- 172.21.15.152:0/4179962775 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f159414fad0 con 0x7f15940d0360 2024-04-17T08:47:40.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.905+0000 7f159be00640 1 -- 172.21.15.152:0/4179962775 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1594150090 con 0x7f15940d0360 2024-04-17T08:47:40.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.909+0000 7f159be00640 1 -- 172.21.15.152:0/4179962775 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1594068a30 con 0x7f15940d0360 2024-04-17T08:47:40.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.909+0000 7f1591600640 1 -- 172.21.15.152:0/4179962775 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f158c012b90 con 0x7f15940d0360 2024-04-17T08:47:40.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.909+0000 7f1591600640 1 --2- 172.21.15.152:0/4179962775 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1574068380 0x7f157406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:40.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.909+0000 7f1591600640 1 -- 172.21.15.152:0/4179962775 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f158c0871b0 con 0x7f15940d0360 2024-04-17T08:47:40.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.909+0000 7f1599400640 1 --2- 172.21.15.152:0/4179962775 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1574068380 0x7f157406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:40.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.909+0000 7f1599400640 1 --2- 172.21.15.152:0/4179962775 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1574068380 0x7f157406a840 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f15880ae000 tx=0x7f15880a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:40.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:40.913+0000 7f1591600640 1 -- 172.21.15.152:0/4179962775 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f158c0572b0 con 0x7f15940d0360 2024-04-17T08:47:41.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.069+0000 7f159be00640 1 -- 172.21.15.152:0/4179962775 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1594150260 con 0x7f15940d0360 2024-04-17T08:47:41.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.073+0000 7f1591600640 1 -- 172.21.15.152:0/4179962775 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18972 (secure 0 0 0) 0x7f158c056bb0 con 0x7f15940d0360 2024-04-17T08:47:41.074 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:47:41.074 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":26,"fsid":"ce68f82e-ec5f-4205-9fd5-bdfdf6ef31e2","created":"2024-04-17T08:46:08.353546+0000","modified":"2024-04-17T08:47:15.280634+0000","last_up_change":"2024-04-17T08:46:20.738799+0000","last_in_change":"2024-04-17T08:46:11.210050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T08:46:21.386856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T08:46:31.812460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T08:46:32.555559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T08:46:36.258078+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"682f0192-187c-404e-bc7a-b6b4e23825e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6819","nonce":3603799291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6823","nonce":3603799291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6831","nonce":3603799291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6827","nonce":3603799291}]},"public_addr":"172.21.15.152:6819/3603799291","cluster_addr":"172.21.15.152:6823/3603799291","heartbeat_back_addr":"172.21.15.152:6831/3603799291","heartbeat_front_addr":"172.21.15.152:6827/3603799291","state":["exists","up"]},{"osd":1,"uuid":"f0fe8fef-60ec-4a39-83b6-2fa6a5adb0f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6801","nonce":4133383142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6803","nonce":4133383142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6807","nonce":4133383142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6805","nonce":4133383142}]},"public_addr":"172.21.15.152:6801/4133383142","cluster_addr":"172.21.15.152:6803/4133383142","heartbeat_back_addr":"172.21.15.152:6807/4133383142","heartbeat_front_addr":"172.21.15.152:6805/4133383142","state":["exists","up"]},{"osd":2,"uuid":"35f36d9c-5245-4431-a618-f4df0fa380ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6809","nonce":3826143898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6811","nonce":3826143898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6815","nonce":3826143898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6813","nonce":3826143898}]},"public_addr":"172.21.15.152:6809/3826143898","cluster_addr":"172.21.15.152:6811/3826143898","heartbeat_back_addr":"172.21.15.152:6815/3826143898","heartbeat_front_addr":"172.21.15.152:6813/3826143898","state":["exists","up"]},{"osd":3,"uuid":"96e56ca5-15b4-4895-9b79-da2c92043159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6818","nonce":165717826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6822","nonce":165717826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6830","nonce":165717826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6826","nonce":165717826}]},"public_addr":"172.21.15.152:6818/165717826","cluster_addr":"172.21.15.152:6822/165717826","heartbeat_back_addr":"172.21.15.152:6830/165717826","heartbeat_front_addr":"172.21.15.152:6826/165717826","state":["exists","up"]},{"osd":4,"uuid":"f5aa10a4-9ff9-41fe-a5c9-15326f982cc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6817","nonce":4080159297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6819","nonce":4080159297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6823","nonce":4080159297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6821","nonce":4080159297}]},"public_addr":"172.21.15.196:6817/4080159297","cluster_addr":"172.21.15.196:6819/4080159297","heartbeat_back_addr":"172.21.15.196:6823/4080159297","heartbeat_front_addr":"172.21.15.196:6821/4080159297","state":["exists","up"]},{"osd":5,"uuid":"42bab884-3476-47ae-ac65-935fa6e0f055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6801","nonce":3519444232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6803","nonce":3519444232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6807","nonce":3519444232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6805","nonce":3519444232}]},"public_addr":"172.21.15.196:6801/3519444232","cluster_addr":"172.21.15.196:6803/3519444232","heartbeat_back_addr":"172.21.15.196:6807/3519444232","heartbeat_front_addr":"172.21.15.196:6805/3519444232","state":["exists","up"]},{"osd":6,"uuid":"460b6167-f57b-4224-9c92-cfc9b80bbe99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6809","nonce":275739834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6811","nonce":275739834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6815","nonce":275739834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6813","nonce":275739834}]},"public_addr":"172.21.15.196:6809/275739834","cluster_addr":"172.21.15.196:6811/275739834","heartbeat_back_addr":"172.21.15.196:6815/275739834","heartbeat_front_addr":"172.21.15.196:6813/275739834","state":["exists","up"]},{"osd":7,"uuid":"d695643f-5e07-4e2a-a646-c06bd97b6650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6825","nonce":307626968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6827","nonce":307626968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6831","nonce":307626968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6829","nonce":307626968}]},"public_addr":"172.21.15.196:6825/307626968","cluster_addr":"172.21.15.196:6827/307626968","heartbeat_back_addr":"172.21.15.196:6831/307626968","heartbeat_front_addr":"172.21.15.196:6829/307626968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.293257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.964533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.248895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.010000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.832554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.743704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930171+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930962+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T08:47:41.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.073+0000 7f159be00640 1 -- 172.21.15.152:0/4179962775 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1574068380 msgr2=0x7f157406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:41.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.073+0000 7f159be00640 1 --2- 172.21.15.152:0/4179962775 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1574068380 0x7f157406a840 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f15880ae000 tx=0x7f15880a7070 comp rx=0 tx=0).stop 2024-04-17T08:47:41.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.073+0000 7f159be00640 1 -- 172.21.15.152:0/4179962775 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f15940d0360 msgr2=0x7f1594164400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:41.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.073+0000 7f159be00640 1 --2- 172.21.15.152:0/4179962775 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f15940d0360 0x7f1594164400 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f158c00d590 tx=0x7f158c00da50 comp rx=0 tx=0).stop 2024-04-17T08:47:41.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.073+0000 7f159be00640 1 -- 172.21.15.152:0/4179962775 shutdown_connections 2024-04-17T08:47:41.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.073+0000 7f159be00640 1 --2- 172.21.15.152:0/4179962775 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f15940d0360 0x7f1594164400 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:41.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.073+0000 7f159be00640 1 --2- 172.21.15.152:0/4179962775 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f15940af670 0x7f1594155f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:41.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.073+0000 7f159be00640 1 --2- 172.21.15.152:0/4179962775 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1574068380 0x7f157406a840 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:41.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.073+0000 7f159be00640 1 --2- 172.21.15.152:0/4179962775 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f159406f980 0x7f159414b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:41.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.073+0000 7f159be00640 1 -- 172.21.15.152:0/4179962775 >> 172.21.15.152:0/4179962775 conn(0x7f15940b3350 msgr2=0x7f15940aec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:41.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.073+0000 7f159be00640 1 -- 172.21.15.152:0/4179962775 shutdown_connections 2024-04-17T08:47:41.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.073+0000 7f159be00640 1 -- 172.21.15.152:0/4179962775 wait complete. 2024-04-17T08:47:41.095 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T08:46:21.386856+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-17T08:46:31.812460+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-17T08:46:32.555559+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-17T08:46:36.258078+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-17T08:47:41.096 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T08:47:41.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.229+0000 7f1fad000640 1 Processor -- start 2024-04-17T08:47:41.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.233+0000 7f1fad000640 1 -- start start 2024-04-17T08:47:41.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.233+0000 7f1fad000640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f1fa815a010 0x7f1fa80d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:41.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.233+0000 7f1fad000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1fa8160720 0x7f1fa80d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:41.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.233+0000 7f1fad000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fa8160d20 con 0x7f1fa815d710 2024-04-17T08:47:41.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.233+0000 7f1fad000640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f1fa815d280 con 0x7f1fa815a010 2024-04-17T08:47:41.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.233+0000 7f1fad000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f1fa815c9d0 con 0x7f1fa8160720 2024-04-17T08:47:41.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.233+0000 7f1fa5e00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f1fa815a010 0x7f1fa80d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:41.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.233+0000 7f1fa5e00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f1fa815a010 0x7f1fa80d0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60210/0 (socket says 172.21.15.152:60210) 2024-04-17T08:47:41.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.233+0000 7f1fa5e00640 1 -- 172.21.15.152:0/2040083182 learned_addr learned my addr 172.21.15.152:0/2040083182 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:41.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.233+0000 7f1fa6800640 1 --2- 172.21.15.152:0/2040083182 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1fa8160720 0x7f1fa80d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:41.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.233+0000 7f1fa5e00640 1 -- 172.21.15.152:0/2040083182 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1fa8160720 msgr2=0x7f1fa80d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:41.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.233+0000 7f1fa5e00640 1 --2- 172.21.15.152:0/2040083182 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1fa8160720 0x7f1fa80d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:41.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.233+0000 7f1fa5e00640 1 -- 172.21.15.152:0/2040083182 >> v1:172.21.15.196:6789/0 conn(0x7f1fa815d710 legacy=0x7f1fa8160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:41.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.233+0000 7f1fa5e00640 1 -- 172.21.15.152:0/2040083182 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fa815cc30 con 0x7f1fa815a010 2024-04-17T08:47:41.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.233+0000 7f1fa6800640 1 --2- 172.21.15.152:0/2040083182 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1fa8160720 0x7f1fa80d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:47:41.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.237+0000 7f1fa5e00640 1 --2- 172.21.15.152:0/2040083182 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1fa815a010 0x7f1fa80d0360 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f1fa806d9d0 tx=0x7f1f9801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80a7bb328549439c server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:41.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.237+0000 7f1fa4a00640 1 -- 172.21.15.152:0/2040083182 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f980b0070 con 0x7f1fa815a010 2024-04-17T08:47:41.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.237+0000 7f1fa4a00640 1 -- 172.21.15.152:0/2040083182 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f980ab600 con 0x7f1fa815a010 2024-04-17T08:47:41.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.237+0000 7f1fa4a00640 1 -- 172.21.15.152:0/2040083182 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f980ab9d0 con 0x7f1fa815a010 2024-04-17T08:47:41.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.237+0000 7f1fad000640 1 -- 172.21.15.152:0/2040083182 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1fa815a010 msgr2=0x7f1fa80d0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:41.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.237+0000 7f1fad000640 1 --2- 172.21.15.152:0/2040083182 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1fa815a010 0x7f1fa80d0360 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f1fa806d9d0 tx=0x7f1f9801c450 comp rx=0 tx=0).stop 2024-04-17T08:47:41.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.237+0000 7f1fad000640 1 -- 172.21.15.152:0/2040083182 shutdown_connections 2024-04-17T08:47:41.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.237+0000 7f1fad000640 1 --2- 172.21.15.152:0/2040083182 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1fa8160720 0x7f1fa80d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:41.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.237+0000 7f1fad000640 1 --2- 172.21.15.152:0/2040083182 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1fa815a010 0x7f1fa80d0360 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:41.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.237+0000 7f1fad000640 1 -- 172.21.15.152:0/2040083182 >> 172.21.15.152:0/2040083182 conn(0x7f1fa80b3350 msgr2=0x7f1fa80b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:41.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.237+0000 7f1fad000640 1 -- 172.21.15.152:0/2040083182 shutdown_connections 2024-04-17T08:47:41.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.237+0000 7f1fad000640 1 -- 172.21.15.152:0/2040083182 wait complete. 2024-04-17T08:47:41.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.237+0000 7f1fad000640 1 Processor -- start 2024-04-17T08:47:41.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.237+0000 7f1fad000640 1 -- start start 2024-04-17T08:47:41.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.241+0000 7f1fad000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1fa815a010 0x7f1fa814dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:41.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.241+0000 7f1fad000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1fa815d710 0x7f1fa8153950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:41.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.241+0000 7f1fad000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1fa8160720 0x7f1fa8153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:41.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.241+0000 7f1fad000640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa815e780 con 0x7f1fa8160720 2024-04-17T08:47:41.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.241+0000 7f1fad000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa815e600 con 0x7f1fa815d710 2024-04-17T08:47:41.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.241+0000 7f1fad000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f1fa815e900 con 0x7f1fa815a010 2024-04-17T08:47:41.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.241+0000 7f1fa6800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1fa8160720 0x7f1fa8153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:41.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.241+0000 7f1fa5400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1fa815d710 0x7f1fa8153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:41.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.241+0000 7f1fa5e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1fa815a010 0x7f1fa814dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:41.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.241+0000 7f1fa6800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1fa8160720 0x7f1fa8153e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60224/0 (socket says 172.21.15.152:60224) 2024-04-17T08:47:41.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.241+0000 7f1fa5e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1fa815a010 0x7f1fa814dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.152:35710/0 (socket says 172.21.15.152:35710) 2024-04-17T08:47:41.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.241+0000 7f1fa5400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1fa815d710 0x7f1fa8153950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.152:59036/0 (socket says 172.21.15.152:59036) 2024-04-17T08:47:41.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.241+0000 7f1fa6800640 1 -- 172.21.15.152:0/3186276024 learned_addr learned my addr 172.21.15.152:0/3186276024 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:41.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.241+0000 7f1fa6800640 1 -- 172.21.15.152:0/3186276024 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1fa815a010 msgr2=0x7f1fa814dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:41.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.241+0000 7f1fa6800640 1 --2- 172.21.15.152:0/3186276024 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1fa815a010 0x7f1fa814dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:41.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.241+0000 7f1fa6800640 1 -- 172.21.15.152:0/3186276024 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1fa815d710 msgr2=0x7f1fa8153950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:41.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.241+0000 7f1fa6800640 1 --2- 172.21.15.152:0/3186276024 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1fa815d710 0x7f1fa8153950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:41.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.241+0000 7f1fa6800640 1 -- 172.21.15.152:0/3186276024 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fa814e270 con 0x7f1fa8160720 2024-04-17T08:47:41.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.241+0000 7f1fa6800640 1 --2- 172.21.15.152:0/3186276024 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1fa8160720 0x7f1fa8153e90 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f1fa000cd50 tx=0x7f1fa000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:41.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.241+0000 7f1f9e000640 1 -- 172.21.15.152:0/3186276024 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa000f680 con 0x7f1fa8160720 2024-04-17T08:47:41.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.241+0000 7f1f9e000640 1 -- 172.21.15.152:0/3186276024 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fa000f840 con 0x7f1fa8160720 2024-04-17T08:47:41.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.241+0000 7f1fad000640 1 -- 172.21.15.152:0/3186276024 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fa814e760 con 0x7f1fa8160720 2024-04-17T08:47:41.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.241+0000 7f1f9e000640 1 -- 172.21.15.152:0/3186276024 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa000fc30 con 0x7f1fa8160720 2024-04-17T08:47:41.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.241+0000 7f1fad000640 1 -- 172.21.15.152:0/3186276024 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fa815ec60 con 0x7f1fa8160720 2024-04-17T08:47:41.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.241+0000 7f1fad000640 1 -- 172.21.15.152:0/3186276024 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fa8068a30 con 0x7f1fa8160720 2024-04-17T08:47:41.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.241+0000 7f1f9e000640 1 -- 172.21.15.152:0/3186276024 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1fa00213f0 con 0x7f1fa8160720 2024-04-17T08:47:41.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.245+0000 7f1f9e000640 1 --2- 172.21.15.152:0/3186276024 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1f88068380 0x7f1f8806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:41.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.245+0000 7f1f9e000640 1 -- 172.21.15.152:0/3186276024 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f1fa0087a10 con 0x7f1fa8160720 2024-04-17T08:47:41.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.245+0000 7f1fa5e00640 1 --2- 172.21.15.152:0/3186276024 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1f88068380 0x7f1f8806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:41.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.245+0000 7f1fa5e00640 1 --2- 172.21.15.152:0/3186276024 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1f88068380 0x7f1f8806a840 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1f980ad000 tx=0x7f1f980a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:41.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.249+0000 7f1f9e000640 1 -- 172.21.15.152:0/3186276024 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f1fa0014030 con 0x7f1fa8160720 2024-04-17T08:47:41.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.405+0000 7f1fad000640 1 -- 172.21.15.152:0/3186276024 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1fa8159820 con 0x7f1fa8160720 2024-04-17T08:47:41.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.405+0000 7f1f9e000640 1 -- 172.21.15.152:0/3186276024 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f1fa0057560 con 0x7f1fa8160720 2024-04-17T08:47:41.410 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2024-04-17T08:47:41.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.409+0000 7f1fad000640 1 -- 172.21.15.152:0/3186276024 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1f88068380 msgr2=0x7f1f8806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:41.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.409+0000 7f1fad000640 1 --2- 172.21.15.152:0/3186276024 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1f88068380 0x7f1f8806a840 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1f980ad000 tx=0x7f1f980a6000 comp rx=0 tx=0).stop 2024-04-17T08:47:41.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.409+0000 7f1fad000640 1 -- 172.21.15.152:0/3186276024 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1fa8160720 msgr2=0x7f1fa8153e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:41.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.409+0000 7f1fad000640 1 --2- 172.21.15.152:0/3186276024 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1fa8160720 0x7f1fa8153e90 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f1fa000cd50 tx=0x7f1fa000a650 comp rx=0 tx=0).stop 2024-04-17T08:47:41.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.409+0000 7f1fad000640 1 -- 172.21.15.152:0/3186276024 shutdown_connections 2024-04-17T08:47:41.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.409+0000 7f1fad000640 1 --2- 172.21.15.152:0/3186276024 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1fa8160720 0x7f1fa8153e90 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:41.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.409+0000 7f1fad000640 1 --2- 172.21.15.152:0/3186276024 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1fa815d710 0x7f1fa8153950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:41.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.409+0000 7f1fad000640 1 --2- 172.21.15.152:0/3186276024 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1f88068380 0x7f1f8806a840 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:41.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.409+0000 7f1fad000640 1 --2- 172.21.15.152:0/3186276024 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1fa815a010 0x7f1fa814dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:41.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.409+0000 7f1fad000640 1 -- 172.21.15.152:0/3186276024 >> 172.21.15.152:0/3186276024 conn(0x7f1fa80b3350 msgr2=0x7f1fa8071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:41.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.409+0000 7f1fad000640 1 -- 172.21.15.152:0/3186276024 shutdown_connections 2024-04-17T08:47:41.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.409+0000 7f1fad000640 1 -- 172.21.15.152:0/3186276024 wait complete. 2024-04-17T08:47:41.431 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-17T08:47:41.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.565+0000 7f8c66e00640 1 Processor -- start 2024-04-17T08:47:41.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.565+0000 7f8c66e00640 1 -- start start 2024-04-17T08:47:41.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.569+0000 7f8c66e00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f8c6006f980 0x7f8c60072530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:41.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.569+0000 7f8c66e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c600d0360 0x7f8c600d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:41.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.569+0000 7f8c66e00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c6015bfd0 con 0x7f8c600af670 2024-04-17T08:47:41.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.569+0000 7f8c66e00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f8c6015c820 con 0x7f8c6006f980 2024-04-17T08:47:41.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.569+0000 7f8c66e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f8c6015c260 con 0x7f8c600d0360 2024-04-17T08:47:41.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.569+0000 7f8c57400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f8c6006f980 0x7f8c60072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:41.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.569+0000 7f8c57400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f8c6006f980 0x7f8c60072530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60234/0 (socket says 172.21.15.152:60234) 2024-04-17T08:47:41.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.569+0000 7f8c57400640 1 -- 172.21.15.152:0/1860170695 learned_addr learned my addr 172.21.15.152:0/1860170695 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:41.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.569+0000 7f8c64e00640 1 --2- 172.21.15.152:0/1860170695 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c600d0360 0x7f8c600d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:41.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.569+0000 7f8c57400640 1 -- 172.21.15.152:0/1860170695 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c600d0360 msgr2=0x7f8c600d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:41.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.569+0000 7f8c57400640 1 --2- 172.21.15.152:0/1860170695 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c600d0360 0x7f8c600d07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:41.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.569+0000 7f8c57400640 1 -- 172.21.15.152:0/1860170695 >> v1:172.21.15.196:6789/0 conn(0x7f8c600af670 legacy=0x7f8c6015b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:41.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.569+0000 7f8c57400640 1 -- 172.21.15.152:0/1860170695 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c6015c540 con 0x7f8c6006f980 2024-04-17T08:47:41.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.569+0000 7f8c64e00640 1 --2- 172.21.15.152:0/1860170695 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c600d0360 0x7f8c600d07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:41.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.573+0000 7f8c57400640 1 --2- 172.21.15.152:0/1860170695 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c6006f980 0x7f8c60072530 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f8c48009870 tx=0x7f8c4801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a0c5c2a3abe7b49 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:41.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.573+0000 7f8c5f400640 1 -- 172.21.15.152:0/1860170695 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c480b1070 con 0x7f8c6006f980 2024-04-17T08:47:41.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.573+0000 7f8c5f400640 1 -- 172.21.15.152:0/1860170695 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c480ac620 con 0x7f8c6006f980 2024-04-17T08:47:41.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.573+0000 7f8c5f400640 1 -- 172.21.15.152:0/1860170695 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c480ac9f0 con 0x7f8c6006f980 2024-04-17T08:47:41.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.573+0000 7f8c66e00640 1 -- 172.21.15.152:0/1860170695 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c6006f980 msgr2=0x7f8c60072530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:41.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.573+0000 7f8c66e00640 1 --2- 172.21.15.152:0/1860170695 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c6006f980 0x7f8c60072530 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f8c48009870 tx=0x7f8c4801c4d0 comp rx=0 tx=0).stop 2024-04-17T08:47:41.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.573+0000 7f8c66e00640 1 -- 172.21.15.152:0/1860170695 shutdown_connections 2024-04-17T08:47:41.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.573+0000 7f8c66e00640 1 --2- 172.21.15.152:0/1860170695 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c600d0360 0x7f8c600d07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:41.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.573+0000 7f8c66e00640 1 --2- 172.21.15.152:0/1860170695 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c6006f980 0x7f8c60072530 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:41.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.573+0000 7f8c66e00640 1 -- 172.21.15.152:0/1860170695 >> 172.21.15.152:0/1860170695 conn(0x7f8c600b3350 msgr2=0x7f8c600b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:41.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.573+0000 7f8c66e00640 1 -- 172.21.15.152:0/1860170695 shutdown_connections 2024-04-17T08:47:41.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.573+0000 7f8c66e00640 1 -- 172.21.15.152:0/1860170695 wait complete. 2024-04-17T08:47:41.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.573+0000 7f8c66e00640 1 Processor -- start 2024-04-17T08:47:41.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.573+0000 7f8c66e00640 1 -- start start 2024-04-17T08:47:41.578 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.573+0000 7f8c66e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c6006f980 0x7f8c6014f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:41.578 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.573+0000 7f8c66e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c600af670 0x7f8c6015d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:41.578 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.573+0000 7f8c66e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c600d0360 0x7f8c6015dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:41.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.573+0000 7f8c66e00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8c60072bf0 con 0x7f8c600d0360 2024-04-17T08:47:41.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.573+0000 7f8c66e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8c60072a70 con 0x7f8c6006f980 2024-04-17T08:47:41.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.573+0000 7f8c66e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f8c60168050 con 0x7f8c600af670 2024-04-17T08:47:41.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.573+0000 7f8c64e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c600d0360 0x7f8c6015dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:41.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.573+0000 7f8c64e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c600d0360 0x7f8c6015dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60248/0 (socket says 172.21.15.152:60248) 2024-04-17T08:47:41.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.573+0000 7f8c64e00640 1 -- 172.21.15.152:0/1765281477 learned_addr learned my addr 172.21.15.152:0/1765281477 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:41.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.577+0000 7f8c57400640 1 --2- 172.21.15.152:0/1765281477 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c600af670 0x7f8c6015d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:41.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.577+0000 7f8c5fe00640 1 --2- 172.21.15.152:0/1765281477 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c6006f980 0x7f8c6014f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:41.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.577+0000 7f8c64e00640 1 -- 172.21.15.152:0/1765281477 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c600af670 msgr2=0x7f8c6015d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:41.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.577+0000 7f8c64e00640 1 --2- 172.21.15.152:0/1765281477 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c600af670 0x7f8c6015d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:41.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.577+0000 7f8c64e00640 1 -- 172.21.15.152:0/1765281477 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c6006f980 msgr2=0x7f8c6014f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:41.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.577+0000 7f8c64e00640 1 --2- 172.21.15.152:0/1765281477 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c6006f980 0x7f8c6014f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:41.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.577+0000 7f8c64e00640 1 -- 172.21.15.152:0/1765281477 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c60157df0 con 0x7f8c600d0360 2024-04-17T08:47:41.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.577+0000 7f8c64e00640 1 --2- 172.21.15.152:0/1765281477 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c600d0360 0x7f8c6015dc10 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f8c58007e70 tx=0x7f8c5800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:41.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.577+0000 7f8c5cc00640 1 -- 172.21.15.152:0/1765281477 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c5801a070 con 0x7f8c600d0360 2024-04-17T08:47:41.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.577+0000 7f8c5cc00640 1 -- 172.21.15.152:0/1765281477 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c58003bc0 con 0x7f8c600d0360 2024-04-17T08:47:41.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.577+0000 7f8c66e00640 1 -- 172.21.15.152:0/1765281477 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c601580d0 con 0x7f8c600d0360 2024-04-17T08:47:41.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.577+0000 7f8c5cc00640 1 -- 172.21.15.152:0/1765281477 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c58004030 con 0x7f8c600d0360 2024-04-17T08:47:41.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.577+0000 7f8c66e00640 1 -- 172.21.15.152:0/1765281477 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c60158690 con 0x7f8c600d0360 2024-04-17T08:47:41.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.577+0000 7f8c66e00640 1 -- 172.21.15.152:0/1765281477 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c60068a30 con 0x7f8c600d0360 2024-04-17T08:47:41.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.577+0000 7f8c5cc00640 1 -- 172.21.15.152:0/1765281477 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8c5801d070 con 0x7f8c600d0360 2024-04-17T08:47:41.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.577+0000 7f8c5cc00640 1 --2- 172.21.15.152:0/1765281477 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8c3c068380 0x7f8c3c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:41.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.577+0000 7f8c5cc00640 1 -- 172.21.15.152:0/1765281477 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f8c58086ff0 con 0x7f8c600d0360 2024-04-17T08:47:41.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.581+0000 7f8c5fe00640 1 --2- 172.21.15.152:0/1765281477 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8c3c068380 0x7f8c3c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:41.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.581+0000 7f8c5fe00640 1 --2- 172.21.15.152:0/1765281477 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8c3c068380 0x7f8c3c06a840 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8c6009e3b0 tx=0x7f8c50009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:41.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.585+0000 7f8c5cc00640 1 -- 172.21.15.152:0/1765281477 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f8c58010070 con 0x7f8c600d0360 2024-04-17T08:47:41.742 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.741+0000 7f8c66e00640 1 -- 172.21.15.152:0/1765281477 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f8c600726d0 con 0x7f8c600d0360 2024-04-17T08:47:41.742 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.741+0000 7f8c5cc00640 1 -- 172.21.15.152:0/1765281477 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f8c58056ae0 con 0x7f8c600d0360 2024-04-17T08:47:41.742 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-04-17T08:47:41.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.741+0000 7f8c66e00640 1 -- 172.21.15.152:0/1765281477 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8c3c068380 msgr2=0x7f8c3c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:41.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.741+0000 7f8c66e00640 1 --2- 172.21.15.152:0/1765281477 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8c3c068380 0x7f8c3c06a840 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8c6009e3b0 tx=0x7f8c50009040 comp rx=0 tx=0).stop 2024-04-17T08:47:41.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.741+0000 7f8c66e00640 1 -- 172.21.15.152:0/1765281477 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c600d0360 msgr2=0x7f8c6015dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:41.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.741+0000 7f8c66e00640 1 --2- 172.21.15.152:0/1765281477 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c600d0360 0x7f8c6015dc10 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f8c58007e70 tx=0x7f8c5800d4a0 comp rx=0 tx=0).stop 2024-04-17T08:47:41.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.741+0000 7f8c66e00640 1 -- 172.21.15.152:0/1765281477 shutdown_connections 2024-04-17T08:47:41.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.741+0000 7f8c66e00640 1 --2- 172.21.15.152:0/1765281477 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c600d0360 0x7f8c6015dc10 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:41.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.741+0000 7f8c66e00640 1 --2- 172.21.15.152:0/1765281477 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8c3c068380 0x7f8c3c06a840 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:41.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.741+0000 7f8c66e00640 1 --2- 172.21.15.152:0/1765281477 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c600af670 0x7f8c6015d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:41.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.741+0000 7f8c66e00640 1 --2- 172.21.15.152:0/1765281477 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c6006f980 0x7f8c6014f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:41.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.741+0000 7f8c66e00640 1 -- 172.21.15.152:0/1765281477 >> 172.21.15.152:0/1765281477 conn(0x7f8c600b3350 msgr2=0x7f8c60151800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:41.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.741+0000 7f8c66e00640 1 -- 172.21.15.152:0/1765281477 shutdown_connections 2024-04-17T08:47:41.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.741+0000 7f8c66e00640 1 -- 172.21.15.152:0/1765281477 wait complete. 2024-04-17T08:47:41.763 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-17T08:47:41.900 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.897+0000 7fe4a7800640 1 Processor -- start 2024-04-17T08:47:41.900 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.897+0000 7fe4a7800640 1 -- start start 2024-04-17T08:47:41.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.897+0000 7fe4a7800640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fe4a006f980 0x7fe4a0072530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:41.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.897+0000 7fe4a7800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fe4a00d0360 0x7fe4a00d07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:41.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.897+0000 7fe4a7800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4a015bfd0 con 0x7fe4a00af670 2024-04-17T08:47:41.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.897+0000 7fe4a7800640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fe4a00d0cf0 con 0x7fe4a006f980 2024-04-17T08:47:41.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.897+0000 7fe4a7800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fe4a015c820 con 0x7fe4a00d0360 2024-04-17T08:47:41.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.897+0000 7fe49fe00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fe4a006f980 0x7fe4a0072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:41.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.897+0000 7fe49fe00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fe4a006f980 0x7fe4a0072530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60254/0 (socket says 172.21.15.152:60254) 2024-04-17T08:47:41.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.897+0000 7fe49fe00640 1 -- 172.21.15.152:0/803949235 learned_addr learned my addr 172.21.15.152:0/803949235 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:41.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.897+0000 7fe4a5800640 1 --2- 172.21.15.152:0/803949235 >> v2:172.21.15.196:3300/0 conn(0x7fe4a00d0360 0x7fe4a00d07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:41.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.901+0000 7fe49fe00640 1 -- 172.21.15.152:0/803949235 >> v2:172.21.15.196:3300/0 conn(0x7fe4a00d0360 msgr2=0x7fe4a00d07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:41.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.901+0000 7fe49fe00640 1 --2- 172.21.15.152:0/803949235 >> v2:172.21.15.196:3300/0 conn(0x7fe4a00d0360 0x7fe4a00d07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:41.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.901+0000 7fe49fe00640 1 -- 172.21.15.152:0/803949235 >> v1:172.21.15.196:6789/0 conn(0x7fe4a00af670 legacy=0x7fe4a015b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:41.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.901+0000 7fe49fe00640 1 -- 172.21.15.152:0/803949235 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4a015c260 con 0x7fe4a006f980 2024-04-17T08:47:41.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.901+0000 7fe49fe00640 1 --2- 172.21.15.152:0/803949235 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4a006f980 0x7fe4a0072530 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe4a006d680 tx=0x7fe48c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dd13e6e916feddc server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:41.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.901+0000 7fe49f400640 1 -- 172.21.15.152:0/803949235 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe48c0ab660 con 0x7fe4a006f980 2024-04-17T08:47:41.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.901+0000 7fe49f400640 1 -- 172.21.15.152:0/803949235 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe48c0b0070 con 0x7fe4a006f980 2024-04-17T08:47:41.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.901+0000 7fe49f400640 1 -- 172.21.15.152:0/803949235 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe48c0aba20 con 0x7fe4a006f980 2024-04-17T08:47:41.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.901+0000 7fe4a7800640 1 -- 172.21.15.152:0/803949235 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4a006f980 msgr2=0x7fe4a0072530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:41.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.901+0000 7fe4a7800640 1 --2- 172.21.15.152:0/803949235 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4a006f980 0x7fe4a0072530 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe4a006d680 tx=0x7fe48c01c460 comp rx=0 tx=0).stop 2024-04-17T08:47:41.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.901+0000 7fe4a7800640 1 -- 172.21.15.152:0/803949235 shutdown_connections 2024-04-17T08:47:41.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.901+0000 7fe4a7800640 1 --2- 172.21.15.152:0/803949235 >> v2:172.21.15.196:3300/0 conn(0x7fe4a00d0360 0x7fe4a00d07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:41.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.901+0000 7fe4a7800640 1 --2- 172.21.15.152:0/803949235 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4a006f980 0x7fe4a0072530 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:41.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.901+0000 7fe4a7800640 1 -- 172.21.15.152:0/803949235 >> 172.21.15.152:0/803949235 conn(0x7fe4a00b3350 msgr2=0x7fe4a00b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:41.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.905+0000 7fe4a7800640 1 -- 172.21.15.152:0/803949235 shutdown_connections 2024-04-17T08:47:41.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.905+0000 7fe4a7800640 1 -- 172.21.15.152:0/803949235 wait complete. 2024-04-17T08:47:41.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.905+0000 7fe4a7800640 1 Processor -- start 2024-04-17T08:47:41.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.905+0000 7fe4a7800640 1 -- start start 2024-04-17T08:47:41.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.905+0000 7fe4a7800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4a006f980 0x7fe4a00998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:41.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.905+0000 7fe4a7800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe4a00af670 0x7fe4a0154150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:41.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.905+0000 7fe4a7800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe4a00d0360 0x7fe4a0154690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:41.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.905+0000 7fe4a7800640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a0072a70 con 0x7fe4a006f980 2024-04-17T08:47:41.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.905+0000 7fe4a7800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a00afa50 con 0x7fe4a00af670 2024-04-17T08:47:41.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.905+0000 7fe4a7800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fe4a0072bf0 con 0x7fe4a00d0360 2024-04-17T08:47:41.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.905+0000 7fe4a4e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4a006f980 0x7fe4a00998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:41.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.905+0000 7fe4a4e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4a006f980 0x7fe4a00998d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60256/0 (socket says 172.21.15.152:60256) 2024-04-17T08:47:41.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.905+0000 7fe4a4e00640 1 -- 172.21.15.152:0/444515267 learned_addr learned my addr 172.21.15.152:0/444515267 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:41.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.905+0000 7fe49fe00640 1 --2- 172.21.15.152:0/444515267 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe4a00af670 0x7fe4a0154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:41.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.905+0000 7fe4a5800640 1 --2- 172.21.15.152:0/444515267 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe4a00d0360 0x7fe4a0154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:41.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.905+0000 7fe4a4e00640 1 -- 172.21.15.152:0/444515267 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe4a00d0360 msgr2=0x7fe4a0154690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:41.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.905+0000 7fe4a4e00640 1 --2- 172.21.15.152:0/444515267 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe4a00d0360 0x7fe4a0154690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:41.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.905+0000 7fe4a4e00640 1 -- 172.21.15.152:0/444515267 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe4a00af670 msgr2=0x7fe4a0154150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:41.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.905+0000 7fe4a4e00640 1 --2- 172.21.15.152:0/444515267 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe4a00af670 0x7fe4a0154150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:41.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.905+0000 7fe4a4e00640 1 -- 172.21.15.152:0/444515267 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4a0151470 con 0x7fe4a006f980 2024-04-17T08:47:41.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.905+0000 7fe4a4e00640 1 --2- 172.21.15.152:0/444515267 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4a006f980 0x7fe4a00998d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe49000c450 tx=0x7fe49000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:41.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.905+0000 7fe49cc00640 1 -- 172.21.15.152:0/444515267 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe490016020 con 0x7fe4a006f980 2024-04-17T08:47:41.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.905+0000 7fe49cc00640 1 -- 172.21.15.152:0/444515267 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4900052d0 con 0x7fe4a006f980 2024-04-17T08:47:41.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.905+0000 7fe49cc00640 1 -- 172.21.15.152:0/444515267 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe490007260 con 0x7fe4a006f980 2024-04-17T08:47:41.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.905+0000 7fe4a7800640 1 -- 172.21.15.152:0/444515267 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4a0151750 con 0x7fe4a006f980 2024-04-17T08:47:41.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.905+0000 7fe4a7800640 1 -- 172.21.15.152:0/444515267 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4a0151d10 con 0x7fe4a006f980 2024-04-17T08:47:41.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.909+0000 7fe4a7800640 1 -- 172.21.15.152:0/444515267 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4a0068a30 con 0x7fe4a006f980 2024-04-17T08:47:41.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.909+0000 7fe49cc00640 1 -- 172.21.15.152:0/444515267 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe490007400 con 0x7fe4a006f980 2024-04-17T08:47:41.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.909+0000 7fe49cc00640 1 --2- 172.21.15.152:0/444515267 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fe480068380 0x7fe48006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:41.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.909+0000 7fe49cc00640 1 -- 172.21.15.152:0/444515267 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fe490086860 con 0x7fe4a006f980 2024-04-17T08:47:41.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.909+0000 7fe49fe00640 1 --2- 172.21.15.152:0/444515267 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fe480068380 0x7fe48006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:41.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.909+0000 7fe49fe00640 1 --2- 172.21.15.152:0/444515267 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fe480068380 0x7fe48006a840 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe48c0af000 tx=0x7fe48c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:41.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:41.913+0000 7fe49cc00640 1 -- 172.21.15.152:0/444515267 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fe490020020 con 0x7fe4a006f980 2024-04-17T08:47:42.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.073+0000 7fe4a7800640 1 -- 172.21.15.152:0/444515267 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe4a0165190 con 0x7fe4a006f980 2024-04-17T08:47:42.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.073+0000 7fe49cc00640 1 -- 172.21.15.152:0/444515267 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7fe490005480 con 0x7fe4a006f980 2024-04-17T08:47:42.074 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 64 2024-04-17T08:47:42.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.073+0000 7fe4a7800640 1 -- 172.21.15.152:0/444515267 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fe480068380 msgr2=0x7fe48006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:42.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.073+0000 7fe4a7800640 1 --2- 172.21.15.152:0/444515267 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fe480068380 0x7fe48006a840 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe48c0af000 tx=0x7fe48c0a7000 comp rx=0 tx=0).stop 2024-04-17T08:47:42.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.073+0000 7fe4a7800640 1 -- 172.21.15.152:0/444515267 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4a006f980 msgr2=0x7fe4a00998d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:42.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.073+0000 7fe4a7800640 1 --2- 172.21.15.152:0/444515267 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4a006f980 0x7fe4a00998d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe49000c450 tx=0x7fe49000c910 comp rx=0 tx=0).stop 2024-04-17T08:47:42.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.073+0000 7fe4a7800640 1 -- 172.21.15.152:0/444515267 shutdown_connections 2024-04-17T08:47:42.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.073+0000 7fe4a7800640 1 --2- 172.21.15.152:0/444515267 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fe480068380 0x7fe48006a840 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:42.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.073+0000 7fe4a7800640 1 --2- 172.21.15.152:0/444515267 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe4a00d0360 0x7fe4a0154690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:42.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.073+0000 7fe4a7800640 1 --2- 172.21.15.152:0/444515267 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe4a00af670 0x7fe4a0154150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:42.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.073+0000 7fe4a7800640 1 --2- 172.21.15.152:0/444515267 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4a006f980 0x7fe4a00998d0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:42.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.073+0000 7fe4a7800640 1 -- 172.21.15.152:0/444515267 >> 172.21.15.152:0/444515267 conn(0x7fe4a00b3350 msgr2=0x7fe4a014f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:42.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.073+0000 7fe4a7800640 1 -- 172.21.15.152:0/444515267 shutdown_connections 2024-04-17T08:47:42.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.073+0000 7fe4a7800640 1 -- 172.21.15.152:0/444515267 wait complete. 2024-04-17T08:47:42.095 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-17T08:47:42.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.233+0000 7f63b7200640 1 Processor -- start 2024-04-17T08:47:42.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.233+0000 7f63b7200640 1 -- start start 2024-04-17T08:47:42.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.233+0000 7f63b7200640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f63b015d710 0x7f63b0160720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:42.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.233+0000 7f63b7200640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63b0160d20 con 0x7f63b00d0a70 2024-04-17T08:47:42.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.233+0000 7f63b7200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63b015cc30 con 0x7f63b015a010 2024-04-17T08:47:42.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.233+0000 7f63b7200640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f63b015d280 con 0x7f63b015d710 2024-04-17T08:47:42.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.233+0000 7f63a7400640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f63b00d0a70 0x7f63b0160010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:54332/0 (socket says 172.21.15.152:54332) 2024-04-17T08:47:42.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.233+0000 7f63a7400640 1 -- 172.21.15.152:0/307853440 learned_addr learned my addr 172.21.15.152:0/307853440 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:42.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.233+0000 7f63b5200640 1 --2- 172.21.15.152:0/307853440 >> v2:172.21.15.152:3300/0 conn(0x7f63b015d710 0x7f63b0160720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:42.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.233+0000 7f63af400640 1 -- 172.21.15.152:0/307853440 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1401678342 0 0) 0x7f63b0160d20 con 0x7f63b00d0a70 2024-04-17T08:47:42.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.233+0000 7f63af400640 1 -- 172.21.15.152:0/307853440 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6394003530 con 0x7f63b00d0a70 2024-04-17T08:47:42.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.233+0000 7f63b5200640 1 -- 172.21.15.152:0/307853440 >> v1:172.21.15.196:6789/0 conn(0x7f63b015a010 legacy=0x7f63b00d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:42.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.233+0000 7f63b5200640 1 -- 172.21.15.152:0/307853440 >> v1:172.21.15.152:6789/0 conn(0x7f63b00d0a70 legacy=0x7f63b0160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:42.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.233+0000 7f63b5200640 1 -- 172.21.15.152:0/307853440 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63b015cf10 con 0x7f63b015d710 2024-04-17T08:47:42.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.237+0000 7f63b5200640 1 --2- 172.21.15.152:0/307853440 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63b015d710 0x7f63b0160720 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f63a8009d90 tx=0x7f63a801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a7ebaa262246d7c server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:42.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.237+0000 7f63af400640 1 -- 172.21.15.152:0/307853440 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a80b2070 con 0x7f63b015d710 2024-04-17T08:47:42.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.237+0000 7f63af400640 1 -- 172.21.15.152:0/307853440 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63a80a57a0 con 0x7f63b015d710 2024-04-17T08:47:42.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.237+0000 7f63af400640 1 -- 172.21.15.152:0/307853440 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a80a5b70 con 0x7f63b015d710 2024-04-17T08:47:42.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.237+0000 7f63b7200640 1 -- 172.21.15.152:0/307853440 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63b015d710 msgr2=0x7f63b0160720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:42.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.237+0000 7f63b7200640 1 --2- 172.21.15.152:0/307853440 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63b015d710 0x7f63b0160720 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f63a8009d90 tx=0x7f63a801c8e0 comp rx=0 tx=0).stop 2024-04-17T08:47:42.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.237+0000 7f63b7200640 1 -- 172.21.15.152:0/307853440 shutdown_connections 2024-04-17T08:47:42.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.237+0000 7f63b7200640 1 --2- 172.21.15.152:0/307853440 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63b015d710 0x7f63b0160720 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:42.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.237+0000 7f63b7200640 1 -- 172.21.15.152:0/307853440 >> 172.21.15.152:0/307853440 conn(0x7f63b00b3350 msgr2=0x7f63b00b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:42.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.237+0000 7f63b7200640 1 -- 172.21.15.152:0/307853440 shutdown_connections 2024-04-17T08:47:42.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.237+0000 7f63b7200640 1 -- 172.21.15.152:0/307853440 wait complete. 2024-04-17T08:47:42.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.237+0000 7f63b7200640 1 Processor -- start 2024-04-17T08:47:42.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.237+0000 7f63b7200640 1 -- start start 2024-04-17T08:47:42.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.241+0000 7f63b7200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63b00d0a70 0x7f63b0147d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:42.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.241+0000 7f63b7200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63b015a010 0x7f63b015eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:42.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.241+0000 7f63b7200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f63b015d710 0x7f63b015f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:42.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.241+0000 7f63b7200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f63b0169f50 con 0x7f63b015a010 2024-04-17T08:47:42.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.241+0000 7f63b7200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f63b0169dd0 con 0x7f63b015d710 2024-04-17T08:47:42.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.241+0000 7f63b7200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f63b016a0d0 con 0x7f63b00d0a70 2024-04-17T08:47:42.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.241+0000 7f63a7400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63b015a010 0x7f63b015eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:42.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.241+0000 7f63a7400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63b015a010 0x7f63b015eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60280/0 (socket says 172.21.15.152:60280) 2024-04-17T08:47:42.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.241+0000 7f63a7400640 1 -- 172.21.15.152:0/304029614 learned_addr learned my addr 172.21.15.152:0/304029614 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:42.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.241+0000 7f63b5200640 1 --2- 172.21.15.152:0/304029614 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f63b015d710 0x7f63b015f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:42.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.241+0000 7f63afe00640 1 --2- 172.21.15.152:0/304029614 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63b00d0a70 0x7f63b0147d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:42.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.241+0000 7f63a7400640 1 -- 172.21.15.152:0/304029614 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63b00d0a70 msgr2=0x7f63b0147d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:42.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.241+0000 7f63a7400640 1 --2- 172.21.15.152:0/304029614 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63b00d0a70 0x7f63b0147d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:42.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.241+0000 7f63a7400640 1 -- 172.21.15.152:0/304029614 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f63b015d710 msgr2=0x7f63b015f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:42.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.241+0000 7f63a7400640 1 --2- 172.21.15.152:0/304029614 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f63b015d710 0x7f63b015f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:42.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.241+0000 7f63a7400640 1 -- 172.21.15.152:0/304029614 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63b0149180 con 0x7f63b015a010 2024-04-17T08:47:42.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.241+0000 7f63b5200640 1 --2- 172.21.15.152:0/304029614 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f63b015d710 0x7f63b015f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:47:42.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.241+0000 7f63afe00640 1 --2- 172.21.15.152:0/304029614 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63b00d0a70 0x7f63b0147d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:47:42.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.241+0000 7f63a7400640 1 --2- 172.21.15.152:0/304029614 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63b015a010 0x7f63b015eb70 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f639800c4d0 tx=0x7f639800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:42.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.241+0000 7f63acc00640 1 -- 172.21.15.152:0/304029614 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6398017070 con 0x7f63b015a010 2024-04-17T08:47:42.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.241+0000 7f63acc00640 1 -- 172.21.15.152:0/304029614 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6398005cf0 con 0x7f63b015a010 2024-04-17T08:47:42.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.241+0000 7f63acc00640 1 -- 172.21.15.152:0/304029614 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6398007270 con 0x7f63b015a010 2024-04-17T08:47:42.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.241+0000 7f63b7200640 1 -- 172.21.15.152:0/304029614 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63b0149460 con 0x7f63b015a010 2024-04-17T08:47:42.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.241+0000 7f63b7200640 1 -- 172.21.15.152:0/304029614 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63b0149a20 con 0x7f63b015a010 2024-04-17T08:47:42.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.241+0000 7f63b7200640 1 -- 172.21.15.152:0/304029614 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63b0068a30 con 0x7f63b015a010 2024-04-17T08:47:42.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.241+0000 7f63acc00640 1 -- 172.21.15.152:0/304029614 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f639801a070 con 0x7f63b015a010 2024-04-17T08:47:42.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.245+0000 7f63acc00640 1 --2- 172.21.15.152:0/304029614 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f638c068380 0x7f638c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:42.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.245+0000 7f63acc00640 1 -- 172.21.15.152:0/304029614 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f63980861b0 con 0x7f63b015a010 2024-04-17T08:47:42.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.245+0000 7f63afe00640 1 --2- 172.21.15.152:0/304029614 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f638c068380 0x7f638c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:42.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.245+0000 7f63afe00640 1 --2- 172.21.15.152:0/304029614 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f638c068380 0x7f638c06a840 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f63a00016f0 tx=0x7f63a0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:42.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.249+0000 7f63acc00640 1 -- 172.21.15.152:0/304029614 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f6398055c60 con 0x7f63b015a010 2024-04-17T08:47:42.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.409+0000 7f63b7200640 1 -- 172.21.15.152:0/304029614 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f63b006d660 con 0x7f63b015a010 2024-04-17T08:47:42.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.409+0000 7f63acc00640 1 -- 172.21.15.152:0/304029614 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f6398059f60 con 0x7f63b015a010 2024-04-17T08:47:42.412 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-04-17T08:47:42.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.413+0000 7f63b7200640 1 -- 172.21.15.152:0/304029614 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f638c068380 msgr2=0x7f638c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:42.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.413+0000 7f63b7200640 1 --2- 172.21.15.152:0/304029614 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f638c068380 0x7f638c06a840 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f63a00016f0 tx=0x7f63a0009040 comp rx=0 tx=0).stop 2024-04-17T08:47:42.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.413+0000 7f63b7200640 1 -- 172.21.15.152:0/304029614 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63b015a010 msgr2=0x7f63b015eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:42.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.413+0000 7f63b7200640 1 --2- 172.21.15.152:0/304029614 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63b015a010 0x7f63b015eb70 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f639800c4d0 tx=0x7f639800c990 comp rx=0 tx=0).stop 2024-04-17T08:47:42.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.413+0000 7f63b7200640 1 -- 172.21.15.152:0/304029614 shutdown_connections 2024-04-17T08:47:42.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.413+0000 7f63b7200640 1 --2- 172.21.15.152:0/304029614 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f63b015d710 0x7f63b015f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:42.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.413+0000 7f63b7200640 1 --2- 172.21.15.152:0/304029614 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63b015a010 0x7f63b015eb70 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:42.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.413+0000 7f63b7200640 1 --2- 172.21.15.152:0/304029614 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f638c068380 0x7f638c06a840 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:42.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.413+0000 7f63b7200640 1 --2- 172.21.15.152:0/304029614 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63b00d0a70 0x7f63b0147d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:42.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.413+0000 7f63b7200640 1 -- 172.21.15.152:0/304029614 >> 172.21.15.152:0/304029614 conn(0x7f63b00b3350 msgr2=0x7f63b0158da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:42.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.413+0000 7f63b7200640 1 -- 172.21.15.152:0/304029614 shutdown_connections 2024-04-17T08:47:42.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.413+0000 7f63b7200640 1 -- 172.21.15.152:0/304029614 wait complete. 2024-04-17T08:47:42.434 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-17T08:47:42.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.569+0000 7fef64000640 1 Processor -- start 2024-04-17T08:47:42.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.569+0000 7fef64000640 1 -- start start 2024-04-17T08:47:42.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.569+0000 7fef64000640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fef5c06f980 0x7fef5c072530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:42.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.569+0000 7fef64000640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef5c15bfd0 con 0x7fef5c0af670 2024-04-17T08:47:42.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.569+0000 7fef64000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef5c15c260 con 0x7fef5c0d0360 2024-04-17T08:47:42.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.569+0000 7fef64000640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fef5c15c820 con 0x7fef5c06f980 2024-04-17T08:47:42.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.569+0000 7fef60c00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fef5c06f980 0x7fef5c072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:42.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.569+0000 7fef61600640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fef5c0af670 0x7fef5c15b8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:54334/0 (socket says 172.21.15.152:54334) 2024-04-17T08:47:42.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.569+0000 7fef61600640 1 -- 172.21.15.152:0/1876503550 learned_addr learned my addr 172.21.15.152:0/1876503550 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:42.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.569+0000 7fef60c00640 1 -- 172.21.15.152:0/1876503550 >> v1:172.21.15.196:6789/0 conn(0x7fef5c0d0360 legacy=0x7fef5c06dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:42.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.569+0000 7fef60c00640 1 -- 172.21.15.152:0/1876503550 >> v1:172.21.15.152:6789/0 conn(0x7fef5c0af670 legacy=0x7fef5c15b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:42.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.569+0000 7fef60c00640 1 -- 172.21.15.152:0/1876503550 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef5c15c540 con 0x7fef5c06f980 2024-04-17T08:47:42.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.569+0000 7fef5be00640 1 -- 172.21.15.152:0/1876503550 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4138892958 0 0) 0x7fef5c15bfd0 con 0x7fef5c0af670 2024-04-17T08:47:42.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.573+0000 7fef60c00640 1 --2- 172.21.15.152:0/1876503550 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef5c06f980 0x7fef5c072530 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fef480097c0 tx=0x7fef4801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42100cf94f4b05e server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:42.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.573+0000 7fef5be00640 1 -- 172.21.15.152:0/1876503550 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef480b1070 con 0x7fef5c06f980 2024-04-17T08:47:42.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.573+0000 7fef5be00640 1 -- 172.21.15.152:0/1876503550 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef480a8050 con 0x7fef5c06f980 2024-04-17T08:47:42.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.573+0000 7fef5be00640 1 -- 172.21.15.152:0/1876503550 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef480ac860 con 0x7fef5c06f980 2024-04-17T08:47:42.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.573+0000 7fef64000640 1 -- 172.21.15.152:0/1876503550 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef5c06f980 msgr2=0x7fef5c072530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:42.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.573+0000 7fef64000640 1 --2- 172.21.15.152:0/1876503550 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef5c06f980 0x7fef5c072530 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fef480097c0 tx=0x7fef4801c3e0 comp rx=0 tx=0).stop 2024-04-17T08:47:42.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.573+0000 7fef64000640 1 -- 172.21.15.152:0/1876503550 shutdown_connections 2024-04-17T08:47:42.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.573+0000 7fef64000640 1 --2- 172.21.15.152:0/1876503550 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef5c06f980 0x7fef5c072530 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:42.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.573+0000 7fef64000640 1 -- 172.21.15.152:0/1876503550 >> 172.21.15.152:0/1876503550 conn(0x7fef5c0b3350 msgr2=0x7fef5c0b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:42.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.573+0000 7fef64000640 1 -- 172.21.15.152:0/1876503550 shutdown_connections 2024-04-17T08:47:42.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.573+0000 7fef64000640 1 -- 172.21.15.152:0/1876503550 wait complete. 2024-04-17T08:47:42.578 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.577+0000 7fef64000640 1 Processor -- start 2024-04-17T08:47:42.578 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.577+0000 7fef64000640 1 -- start start 2024-04-17T08:47:42.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.577+0000 7fef64000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef5c06f980 0x7fef5c151f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:42.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.577+0000 7fef64000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fef5c0af670 0x7fef5c1541a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:42.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.577+0000 7fef64000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fef5c0d0360 0x7fef5c1528f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:42.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.577+0000 7fef64000640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fef5c0d0b80 con 0x7fef5c06f980 2024-04-17T08:47:42.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.577+0000 7fef64000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fef5c072a70 con 0x7fef5c0d0360 2024-04-17T08:47:42.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.577+0000 7fef64000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fef5c1514f0 con 0x7fef5c0af670 2024-04-17T08:47:42.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.577+0000 7fef61600640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef5c06f980 0x7fef5c151f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:42.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.577+0000 7fef61600640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef5c06f980 0x7fef5c151f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60306/0 (socket says 172.21.15.152:60306) 2024-04-17T08:47:42.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.577+0000 7fef61600640 1 -- 172.21.15.152:0/4266326310 learned_addr learned my addr 172.21.15.152:0/4266326310 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:42.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.577+0000 7fef62000640 1 --2- 172.21.15.152:0/4266326310 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fef5c0d0360 0x7fef5c1528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:42.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.577+0000 7fef60c00640 1 --2- 172.21.15.152:0/4266326310 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fef5c0af670 0x7fef5c1541a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:42.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.577+0000 7fef61600640 1 -- 172.21.15.152:0/4266326310 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fef5c0af670 msgr2=0x7fef5c1541a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:42.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.577+0000 7fef61600640 1 --2- 172.21.15.152:0/4266326310 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fef5c0af670 0x7fef5c1541a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:42.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.577+0000 7fef61600640 1 -- 172.21.15.152:0/4266326310 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fef5c0d0360 msgr2=0x7fef5c1528f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:42.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.577+0000 7fef61600640 1 --2- 172.21.15.152:0/4266326310 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fef5c0d0360 0x7fef5c1528f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:42.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.577+0000 7fef61600640 1 -- 172.21.15.152:0/4266326310 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef5c1524d0 con 0x7fef5c06f980 2024-04-17T08:47:42.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.577+0000 7fef61600640 1 --2- 172.21.15.152:0/4266326310 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef5c06f980 0x7fef5c151f90 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fef5000c4a0 tx=0x7fef5000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:42.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.577+0000 7fef59600640 1 -- 172.21.15.152:0/4266326310 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef50018070 con 0x7fef5c06f980 2024-04-17T08:47:42.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.577+0000 7fef59600640 1 -- 172.21.15.152:0/4266326310 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef500074e0 con 0x7fef5c06f980 2024-04-17T08:47:42.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.577+0000 7fef64000640 1 -- 172.21.15.152:0/4266326310 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef5c153340 con 0x7fef5c06f980 2024-04-17T08:47:42.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.577+0000 7fef59600640 1 -- 172.21.15.152:0/4266326310 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef50004a30 con 0x7fef5c06f980 2024-04-17T08:47:42.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.577+0000 7fef64000640 1 -- 172.21.15.152:0/4266326310 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef5c151a70 con 0x7fef5c06f980 2024-04-17T08:47:42.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.581+0000 7fef64000640 1 -- 172.21.15.152:0/4266326310 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef5c153730 con 0x7fef5c06f980 2024-04-17T08:47:42.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.581+0000 7fef59600640 1 -- 172.21.15.152:0/4266326310 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fef5001b070 con 0x7fef5c06f980 2024-04-17T08:47:42.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.581+0000 7fef59600640 1 --2- 172.21.15.152:0/4266326310 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fef3c068380 0x7fef3c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:42.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.581+0000 7fef59600640 1 -- 172.21.15.152:0/4266326310 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fef500860b0 con 0x7fef5c06f980 2024-04-17T08:47:42.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.581+0000 7fef60c00640 1 --2- 172.21.15.152:0/4266326310 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fef3c068380 0x7fef3c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:42.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.581+0000 7fef60c00640 1 --2- 172.21.15.152:0/4266326310 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fef3c068380 0x7fef3c06a840 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fef480ae000 tx=0x7fef480a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:42.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.585+0000 7fef59600640 1 -- 172.21.15.152:0/4266326310 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fef50056240 con 0x7fef5c06f980 2024-04-17T08:47:42.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.757+0000 7fef64000640 1 -- 172.21.15.152:0/4266326310 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fef5c068a30 con 0x7fef5c06f980 2024-04-17T08:47:42.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.757+0000 7fef59600640 1 -- 172.21.15.152:0/4266326310 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7fef50055b40 con 0x7fef5c06f980 2024-04-17T08:47:42.758 INFO:teuthology.orchestra.run.smithi152.stderr:listed 0 entries 2024-04-17T08:47:42.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.757+0000 7fef64000640 1 -- 172.21.15.152:0/4266326310 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fef3c068380 msgr2=0x7fef3c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:42.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.757+0000 7fef64000640 1 --2- 172.21.15.152:0/4266326310 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fef3c068380 0x7fef3c06a840 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fef480ae000 tx=0x7fef480a7000 comp rx=0 tx=0).stop 2024-04-17T08:47:42.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.757+0000 7fef64000640 1 -- 172.21.15.152:0/4266326310 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef5c06f980 msgr2=0x7fef5c151f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:42.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.757+0000 7fef64000640 1 --2- 172.21.15.152:0/4266326310 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef5c06f980 0x7fef5c151f90 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fef5000c4a0 tx=0x7fef5000c960 comp rx=0 tx=0).stop 2024-04-17T08:47:42.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.757+0000 7fef64000640 1 -- 172.21.15.152:0/4266326310 shutdown_connections 2024-04-17T08:47:42.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.757+0000 7fef64000640 1 --2- 172.21.15.152:0/4266326310 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fef5c0d0360 0x7fef5c1528f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:42.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.757+0000 7fef64000640 1 --2- 172.21.15.152:0/4266326310 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fef3c068380 0x7fef3c06a840 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:42.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.757+0000 7fef64000640 1 --2- 172.21.15.152:0/4266326310 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fef5c0af670 0x7fef5c1541a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:42.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.757+0000 7fef64000640 1 --2- 172.21.15.152:0/4266326310 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef5c06f980 0x7fef5c151f90 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:42.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.757+0000 7fef64000640 1 -- 172.21.15.152:0/4266326310 >> 172.21.15.152:0/4266326310 conn(0x7fef5c0b3350 msgr2=0x7fef5c0ae720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:42.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.757+0000 7fef64000640 1 -- 172.21.15.152:0/4266326310 shutdown_connections 2024-04-17T08:47:42.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.757+0000 7fef64000640 1 -- 172.21.15.152:0/4266326310 wait complete. 2024-04-17T08:47:42.780 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-17T08:47:42.780 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-17T08:47:42.789 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T08:47:42.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.921+0000 7fd14e000640 1 Processor -- start 2024-04-17T08:47:42.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.921+0000 7fd14e000640 1 -- start start 2024-04-17T08:47:42.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.925+0000 7fd14e000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fd1480d0360 0x7fd1480d07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:42.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.925+0000 7fd14e000640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd14815bfd0 con 0x7fd14806f980 2024-04-17T08:47:42.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.925+0000 7fd14e000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd148072c40 con 0x7fd1480af670 2024-04-17T08:47:42.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.925+0000 7fd14e000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fd1480d0cf0 con 0x7fd1480d0360 2024-04-17T08:47:42.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.925+0000 7fd146a00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fd14806f980 0x7fd148072530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:54346/0 (socket says 172.21.15.152:54346) 2024-04-17T08:47:42.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.925+0000 7fd146a00640 1 -- 172.21.15.152:0/2377807822 learned_addr learned my addr 172.21.15.152:0/2377807822 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:42.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.925+0000 7fd147e00640 1 --2- 172.21.15.152:0/2377807822 >> v2:172.21.15.196:3300/0 conn(0x7fd1480d0360 0x7fd1480d07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:42.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.925+0000 7fd146000640 1 -- 172.21.15.152:0/2377807822 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 239916736 0 0) 0x7fd14815bfd0 con 0x7fd14806f980 2024-04-17T08:47:42.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.925+0000 7fd146000640 1 -- 172.21.15.152:0/2377807822 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd12c003530 con 0x7fd14806f980 2024-04-17T08:47:42.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.925+0000 7fd146000640 1 -- 172.21.15.152:0/2377807822 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2552430586 0 0) 0x7fd12c003530 con 0x7fd14806f980 2024-04-17T08:47:42.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.925+0000 7fd146000640 1 -- 172.21.15.152:0/2377807822 >> v2:172.21.15.196:3300/0 conn(0x7fd1480d0360 msgr2=0x7fd1480d07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:42.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.925+0000 7fd146000640 1 --2- 172.21.15.152:0/2377807822 >> v2:172.21.15.196:3300/0 conn(0x7fd1480d0360 0x7fd1480d07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:42.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.925+0000 7fd146000640 1 -- 172.21.15.152:0/2377807822 >> v1:172.21.15.196:6789/0 conn(0x7fd1480af670 legacy=0x7fd14815b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:42.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.925+0000 7fd146000640 1 -- 172.21.15.152:0/2377807822 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd14815c260 con 0x7fd14806f980 2024-04-17T08:47:42.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.925+0000 7fd146000640 1 -- 172.21.15.152:0/2377807822 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2973887244 0 0) 0x7fd134001680 con 0x7fd14806f980 2024-04-17T08:47:42.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.925+0000 7fd146000640 1 -- 172.21.15.152:0/2377807822 >> v1:172.21.15.152:6789/0 conn(0x7fd14806f980 legacy=0x7fd148072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:42.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.925+0000 7fd146000640 1 --2- 172.21.15.152:0/2377807822 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd12c0039c0 0x7fd12c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:42.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.925+0000 7fd146000640 1 --2- 172.21.15.152:0/2377807822 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd12c004810 0x7fd12c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:42.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.925+0000 7fd146000640 1 --2- 172.21.15.152:0/2377807822 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd12c0051d0 0x7fd12c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:42.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.925+0000 7fd146000640 1 -- 172.21.15.152:0/2377807822 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd1480d0cf0 con 0x7fd12c004810 2024-04-17T08:47:42.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.925+0000 7fd146000640 1 -- 172.21.15.152:0/2377807822 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd12c00c170 con 0x7fd12c0039c0 2024-04-17T08:47:42.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.925+0000 7fd146000640 1 -- 172.21.15.152:0/2377807822 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fd12c00c370 con 0x7fd12c0051d0 2024-04-17T08:47:42.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.925+0000 7fd147e00640 1 --2- 172.21.15.152:0/2377807822 >> v2:172.21.15.196:3300/0 conn(0x7fd1480d0360 0x7fd1480d07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T08:47:42.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.925+0000 7fd146a00640 1 --2- 172.21.15.152:0/2377807822 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd12c004810 0x7fd12c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:42.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.925+0000 7fd147400640 1 --2- 172.21.15.152:0/2377807822 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd12c0039c0 0x7fd12c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:42.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.925+0000 7fd147e00640 1 --2- 172.21.15.152:0/2377807822 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd12c0051d0 0x7fd12c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:42.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.925+0000 7fd146a00640 1 -- 172.21.15.152:0/2377807822 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd12c0051d0 msgr2=0x7fd12c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:42.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.925+0000 7fd146a00640 1 --2- 172.21.15.152:0/2377807822 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd12c0051d0 0x7fd12c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:42.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.925+0000 7fd146a00640 1 -- 172.21.15.152:0/2377807822 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd12c0039c0 msgr2=0x7fd12c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:42.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.925+0000 7fd146a00640 1 --2- 172.21.15.152:0/2377807822 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd12c0039c0 0x7fd12c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:42.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.925+0000 7fd146a00640 1 -- 172.21.15.152:0/2377807822 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd12c003530 con 0x7fd12c004810 2024-04-17T08:47:42.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.925+0000 7fd147e00640 1 -- 172.21.15.152:0/2377807822 reap_dead start 2024-04-17T08:47:42.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.929+0000 7fd146a00640 1 --2- 172.21.15.152:0/2377807822 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd12c004810 0x7fd12c004c90 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fd13400c210 tx=0x7fd13401cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82e638ce25a0275c server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:42.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.929+0000 7fd146000640 1 -- 172.21.15.152:0/2377807822 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd134007d20 con 0x7fd12c004810 2024-04-17T08:47:42.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.929+0000 7fd146000640 1 -- 172.21.15.152:0/2377807822 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1340a9070 con 0x7fd12c004810 2024-04-17T08:47:42.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.929+0000 7fd146000640 1 -- 172.21.15.152:0/2377807822 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd134005d80 con 0x7fd12c004810 2024-04-17T08:47:42.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.929+0000 7fd14e000640 1 -- 172.21.15.152:0/2377807822 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd12c004810 msgr2=0x7fd12c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:42.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.929+0000 7fd14e000640 1 --2- 172.21.15.152:0/2377807822 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd12c004810 0x7fd12c004c90 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fd13400c210 tx=0x7fd13401cbe0 comp rx=0 tx=0).stop 2024-04-17T08:47:42.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.929+0000 7fd14e000640 1 -- 172.21.15.152:0/2377807822 shutdown_connections 2024-04-17T08:47:42.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.929+0000 7fd14e000640 1 --2- 172.21.15.152:0/2377807822 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd12c004810 0x7fd12c004c90 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:42.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.929+0000 7fd14e000640 1 -- 172.21.15.152:0/2377807822 >> 172.21.15.152:0/2377807822 conn(0x7fd1480b3350 msgr2=0x7fd1480b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:42.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.929+0000 7fd14e000640 1 -- 172.21.15.152:0/2377807822 shutdown_connections 2024-04-17T08:47:42.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.929+0000 7fd14e000640 1 -- 172.21.15.152:0/2377807822 wait complete. 2024-04-17T08:47:42.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.929+0000 7fd14e000640 1 Processor -- start 2024-04-17T08:47:42.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.933+0000 7fd14e000640 1 -- start start 2024-04-17T08:47:42.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.933+0000 7fd14e000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd12c004810 0x7fd1481f8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:42.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.933+0000 7fd14e000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd148151e90 0x7fd148154b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:42.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.933+0000 7fd14e000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd1480b1eb0 0x7fd14814c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:42.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.933+0000 7fd14e000640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd148072940 con 0x7fd12c004810 2024-04-17T08:47:42.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.933+0000 7fd14e000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd1480afa50 con 0x7fd1480b1eb0 2024-04-17T08:47:42.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.933+0000 7fd14e000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fd148072ac0 con 0x7fd148151e90 2024-04-17T08:47:42.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.933+0000 7fd147400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd12c004810 0x7fd1481f8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:42.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.933+0000 7fd147400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd12c004810 0x7fd1481f8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60330/0 (socket says 172.21.15.152:60330) 2024-04-17T08:47:42.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.933+0000 7fd147400640 1 -- 172.21.15.152:0/270798515 learned_addr learned my addr 172.21.15.152:0/270798515 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:42.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.933+0000 7fd146a00640 1 --2- 172.21.15.152:0/270798515 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd148151e90 0x7fd148154b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:42.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.933+0000 7fd147e00640 1 --2- 172.21.15.152:0/270798515 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd1480b1eb0 0x7fd14814c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:42.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.933+0000 7fd147400640 1 -- 172.21.15.152:0/270798515 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd148151e90 msgr2=0x7fd148154b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:42.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.933+0000 7fd147400640 1 --2- 172.21.15.152:0/270798515 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd148151e90 0x7fd148154b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:42.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.933+0000 7fd147400640 1 -- 172.21.15.152:0/270798515 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd1480b1eb0 msgr2=0x7fd14814c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:42.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.933+0000 7fd147400640 1 --2- 172.21.15.152:0/270798515 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd1480b1eb0 0x7fd14814c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:42.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.933+0000 7fd147400640 1 -- 172.21.15.152:0/270798515 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1481f94b0 con 0x7fd12c004810 2024-04-17T08:47:42.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.933+0000 7fd147e00640 1 --2- 172.21.15.152:0/270798515 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd1480b1eb0 0x7fd14814c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:42.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.933+0000 7fd147400640 1 --2- 172.21.15.152:0/270798515 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd12c004810 0x7fd1481f8d40 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fd13800f620 tx=0x7fd13800fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:42.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.933+0000 7fd13f400640 1 -- 172.21.15.152:0/270798515 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1380052e0 con 0x7fd12c004810 2024-04-17T08:47:42.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.933+0000 7fd13f400640 1 -- 172.21.15.152:0/270798515 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd138018070 con 0x7fd12c004810 2024-04-17T08:47:42.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.933+0000 7fd14e000640 1 -- 172.21.15.152:0/270798515 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1481f9790 con 0x7fd12c004810 2024-04-17T08:47:42.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.933+0000 7fd13f400640 1 -- 172.21.15.152:0/270798515 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd138003820 con 0x7fd12c004810 2024-04-17T08:47:42.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.933+0000 7fd14e000640 1 -- 172.21.15.152:0/270798515 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1481550d0 con 0x7fd12c004810 2024-04-17T08:47:42.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.933+0000 7fd14e000640 1 -- 172.21.15.152:0/270798515 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd148068a30 con 0x7fd12c004810 2024-04-17T08:47:42.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.937+0000 7fd13f400640 1 -- 172.21.15.152:0/270798515 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd1380039c0 con 0x7fd12c004810 2024-04-17T08:47:42.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.937+0000 7fd13f400640 1 --2- 172.21.15.152:0/270798515 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fd1280683b0 0x7fd12806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:42.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.937+0000 7fd13f400640 1 -- 172.21.15.152:0/270798515 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fd138086b00 con 0x7fd12c004810 2024-04-17T08:47:42.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.937+0000 7fd146a00640 1 --2- 172.21.15.152:0/270798515 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fd1280683b0 0x7fd12806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:42.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.937+0000 7fd146a00640 1 --2- 172.21.15.152:0/270798515 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fd1280683b0 0x7fd12806a870 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd1340ab000 tx=0x7fd1340a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:42.943 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:42.941+0000 7fd13f400640 1 -- 172.21.15.152:0/270798515 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fd138056c90 con 0x7fd12c004810 2024-04-17T08:47:43.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.097+0000 7fd14e000640 1 -- 172.21.15.152:0/270798515 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd14806f170 con 0x7fd12c004810 2024-04-17T08:47:43.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.097+0000 7fd13f400640 1 -- 172.21.15.152:0/270798515 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18972 (secure 0 0 0) 0x7fd138005480 con 0x7fd12c004810 2024-04-17T08:47:43.102 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:47:43.102 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":26,"fsid":"ce68f82e-ec5f-4205-9fd5-bdfdf6ef31e2","created":"2024-04-17T08:46:08.353546+0000","modified":"2024-04-17T08:47:15.280634+0000","last_up_change":"2024-04-17T08:46:20.738799+0000","last_in_change":"2024-04-17T08:46:11.210050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T08:46:21.386856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T08:46:31.812460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T08:46:32.555559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T08:46:36.258078+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"682f0192-187c-404e-bc7a-b6b4e23825e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6819","nonce":3603799291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6823","nonce":3603799291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6831","nonce":3603799291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6827","nonce":3603799291}]},"public_addr":"172.21.15.152:6819/3603799291","cluster_addr":"172.21.15.152:6823/3603799291","heartbeat_back_addr":"172.21.15.152:6831/3603799291","heartbeat_front_addr":"172.21.15.152:6827/3603799291","state":["exists","up"]},{"osd":1,"uuid":"f0fe8fef-60ec-4a39-83b6-2fa6a5adb0f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6801","nonce":4133383142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6803","nonce":4133383142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6807","nonce":4133383142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6805","nonce":4133383142}]},"public_addr":"172.21.15.152:6801/4133383142","cluster_addr":"172.21.15.152:6803/4133383142","heartbeat_back_addr":"172.21.15.152:6807/4133383142","heartbeat_front_addr":"172.21.15.152:6805/4133383142","state":["exists","up"]},{"osd":2,"uuid":"35f36d9c-5245-4431-a618-f4df0fa380ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6809","nonce":3826143898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6811","nonce":3826143898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6815","nonce":3826143898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6813","nonce":3826143898}]},"public_addr":"172.21.15.152:6809/3826143898","cluster_addr":"172.21.15.152:6811/3826143898","heartbeat_back_addr":"172.21.15.152:6815/3826143898","heartbeat_front_addr":"172.21.15.152:6813/3826143898","state":["exists","up"]},{"osd":3,"uuid":"96e56ca5-15b4-4895-9b79-da2c92043159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6818","nonce":165717826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6822","nonce":165717826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6830","nonce":165717826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6826","nonce":165717826}]},"public_addr":"172.21.15.152:6818/165717826","cluster_addr":"172.21.15.152:6822/165717826","heartbeat_back_addr":"172.21.15.152:6830/165717826","heartbeat_front_addr":"172.21.15.152:6826/165717826","state":["exists","up"]},{"osd":4,"uuid":"f5aa10a4-9ff9-41fe-a5c9-15326f982cc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6817","nonce":4080159297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6819","nonce":4080159297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6823","nonce":4080159297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6821","nonce":4080159297}]},"public_addr":"172.21.15.196:6817/4080159297","cluster_addr":"172.21.15.196:6819/4080159297","heartbeat_back_addr":"172.21.15.196:6823/4080159297","heartbeat_front_addr":"172.21.15.196:6821/4080159297","state":["exists","up"]},{"osd":5,"uuid":"42bab884-3476-47ae-ac65-935fa6e0f055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6801","nonce":3519444232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6803","nonce":3519444232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6807","nonce":3519444232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6805","nonce":3519444232}]},"public_addr":"172.21.15.196:6801/3519444232","cluster_addr":"172.21.15.196:6803/3519444232","heartbeat_back_addr":"172.21.15.196:6807/3519444232","heartbeat_front_addr":"172.21.15.196:6805/3519444232","state":["exists","up"]},{"osd":6,"uuid":"460b6167-f57b-4224-9c92-cfc9b80bbe99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6809","nonce":275739834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6811","nonce":275739834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6815","nonce":275739834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6813","nonce":275739834}]},"public_addr":"172.21.15.196:6809/275739834","cluster_addr":"172.21.15.196:6811/275739834","heartbeat_back_addr":"172.21.15.196:6815/275739834","heartbeat_front_addr":"172.21.15.196:6813/275739834","state":["exists","up"]},{"osd":7,"uuid":"d695643f-5e07-4e2a-a646-c06bd97b6650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6825","nonce":307626968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6827","nonce":307626968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6831","nonce":307626968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6829","nonce":307626968}]},"public_addr":"172.21.15.196:6825/307626968","cluster_addr":"172.21.15.196:6827/307626968","heartbeat_back_addr":"172.21.15.196:6831/307626968","heartbeat_front_addr":"172.21.15.196:6829/307626968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.293257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.964533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.248895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.010000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.832554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.743704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930171+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930962+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T08:47:43.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.101+0000 7fd14e000640 1 -- 172.21.15.152:0/270798515 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fd1280683b0 msgr2=0x7fd12806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:43.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.101+0000 7fd14e000640 1 --2- 172.21.15.152:0/270798515 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fd1280683b0 0x7fd12806a870 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd1340ab000 tx=0x7fd1340a7070 comp rx=0 tx=0).stop 2024-04-17T08:47:43.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.101+0000 7fd14e000640 1 -- 172.21.15.152:0/270798515 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd12c004810 msgr2=0x7fd1481f8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:43.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.101+0000 7fd14e000640 1 --2- 172.21.15.152:0/270798515 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd12c004810 0x7fd1481f8d40 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fd13800f620 tx=0x7fd13800fae0 comp rx=0 tx=0).stop 2024-04-17T08:47:43.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.101+0000 7fd14e000640 1 -- 172.21.15.152:0/270798515 shutdown_connections 2024-04-17T08:47:43.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.101+0000 7fd14e000640 1 --2- 172.21.15.152:0/270798515 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd1480b1eb0 0x7fd14814c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:43.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.101+0000 7fd14e000640 1 --2- 172.21.15.152:0/270798515 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fd1280683b0 0x7fd12806a870 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:43.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.101+0000 7fd14e000640 1 --2- 172.21.15.152:0/270798515 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd148151e90 0x7fd148154b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:43.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.101+0000 7fd14e000640 1 --2- 172.21.15.152:0/270798515 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd12c004810 0x7fd1481f8d40 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:43.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.101+0000 7fd14e000640 1 -- 172.21.15.152:0/270798515 >> 172.21.15.152:0/270798515 conn(0x7fd1480b3350 msgr2=0x7fd1480aeb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:43.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.101+0000 7fd14e000640 1 -- 172.21.15.152:0/270798515 shutdown_connections 2024-04-17T08:47:43.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.101+0000 7fd14e000640 1 -- 172.21.15.152:0/270798515 wait complete. 2024-04-17T08:47:43.123 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T08:46:21.386856+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-17T08:46:31.812460+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-17T08:46:32.555559+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-17T08:46:36.258078+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-17T08:47:43.123 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T08:47:43.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.257+0000 7f6011c00640 1 Processor -- start 2024-04-17T08:47:43.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.257+0000 7f6011c00640 1 -- start start 2024-04-17T08:47:43.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.261+0000 7f6011c00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f600c159130 0x7f600c15c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:43.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.261+0000 7f6011c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f600c06b9b0 0x7f600c15cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:43.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.261+0000 7f6011c00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f600c06e040 con 0x7f600c0b47c0 2024-04-17T08:47:43.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.261+0000 7f6011c00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f600c06e970 con 0x7f600c159130 2024-04-17T08:47:43.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.261+0000 7f6011c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f600c06e320 con 0x7f600c06b9b0 2024-04-17T08:47:43.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.261+0000 7f600be00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f600c159130 0x7f600c15c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:43.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.261+0000 7f600be00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f600c159130 0x7f600c15c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60346/0 (socket says 172.21.15.152:60346) 2024-04-17T08:47:43.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.261+0000 7f600be00640 1 -- 172.21.15.152:0/179806369 learned_addr learned my addr 172.21.15.152:0/179806369 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:43.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.261+0000 7f6003e00640 1 --2- 172.21.15.152:0/179806369 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f600c06b9b0 0x7f600c15cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:43.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.261+0000 7f600be00640 1 -- 172.21.15.152:0/179806369 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f600c06b9b0 msgr2=0x7f600c15cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:43.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.261+0000 7f600be00640 1 --2- 172.21.15.152:0/179806369 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f600c06b9b0 0x7f600c15cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:43.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.261+0000 7f600be00640 1 -- 172.21.15.152:0/179806369 >> v1:172.21.15.196:6789/0 conn(0x7f600c0b47c0 legacy=0x7f600c06ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:43.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.261+0000 7f600be00640 1 -- 172.21.15.152:0/179806369 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f600c06e600 con 0x7f600c159130 2024-04-17T08:47:43.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.265+0000 7f600be00640 1 --2- 172.21.15.152:0/179806369 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f600c159130 0x7f600c15c390 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc009870 tx=0x7f5ffc01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97cc04afc761d220 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:43.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.265+0000 7f600b400640 1 -- 172.21.15.152:0/179806369 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ffc0b2070 con 0x7f600c159130 2024-04-17T08:47:43.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.265+0000 7f600b400640 1 -- 172.21.15.152:0/179806369 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ffc0a9070 con 0x7f600c159130 2024-04-17T08:47:43.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.265+0000 7f600b400640 1 -- 172.21.15.152:0/179806369 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ffc0ad880 con 0x7f600c159130 2024-04-17T08:47:43.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.265+0000 7f6011c00640 1 -- 172.21.15.152:0/179806369 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f600c159130 msgr2=0x7f600c15c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:43.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.265+0000 7f6011c00640 1 --2- 172.21.15.152:0/179806369 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f600c159130 0x7f600c15c390 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc009870 tx=0x7f5ffc01c560 comp rx=0 tx=0).stop 2024-04-17T08:47:43.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.265+0000 7f6011c00640 1 -- 172.21.15.152:0/179806369 shutdown_connections 2024-04-17T08:47:43.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.265+0000 7f6011c00640 1 --2- 172.21.15.152:0/179806369 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f600c06b9b0 0x7f600c15cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:43.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.265+0000 7f6011c00640 1 --2- 172.21.15.152:0/179806369 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f600c159130 0x7f600c15c390 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:43.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.265+0000 7f6011c00640 1 -- 172.21.15.152:0/179806369 >> 172.21.15.152:0/179806369 conn(0x7f600c0d0470 msgr2=0x7f600c0d0880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:43.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.265+0000 7f6011c00640 1 -- 172.21.15.152:0/179806369 shutdown_connections 2024-04-17T08:47:43.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.265+0000 7f6011c00640 1 -- 172.21.15.152:0/179806369 wait complete. 2024-04-17T08:47:43.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.265+0000 7f6011c00640 1 Processor -- start 2024-04-17T08:47:43.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.265+0000 7f6011c00640 1 -- start start 2024-04-17T08:47:43.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.265+0000 7f6011c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f600c06b9b0 0x7f600c0ab870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:43.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.265+0000 7f6011c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f600c0b47c0 0x7f600c154180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:43.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.265+0000 7f6011c00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f600c159130 0x7f600c152970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:43.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.265+0000 7f6011c00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f600c1688e0 con 0x7f600c159130 2024-04-17T08:47:43.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.265+0000 7f6011c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f600c168760 con 0x7f600c06b9b0 2024-04-17T08:47:43.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.265+0000 7f6011c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f600c168a60 con 0x7f600c0b47c0 2024-04-17T08:47:43.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.265+0000 7f6011200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f600c159130 0x7f600c152970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:43.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.265+0000 7f6011200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f600c159130 0x7f600c152970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60354/0 (socket says 172.21.15.152:60354) 2024-04-17T08:47:43.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.265+0000 7f6011200640 1 -- 172.21.15.152:0/892727489 learned_addr learned my addr 172.21.15.152:0/892727489 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:43.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.269+0000 7f600be00640 1 --2- 172.21.15.152:0/892727489 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f600c06b9b0 0x7f600c0ab870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:43.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.269+0000 7f6003e00640 1 --2- 172.21.15.152:0/892727489 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f600c0b47c0 0x7f600c154180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:43.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.269+0000 7f6011200640 1 -- 172.21.15.152:0/892727489 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f600c0b47c0 msgr2=0x7f600c154180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:43.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.269+0000 7f6011200640 1 --2- 172.21.15.152:0/892727489 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f600c0b47c0 0x7f600c154180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:43.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.269+0000 7f6011200640 1 -- 172.21.15.152:0/892727489 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f600c06b9b0 msgr2=0x7f600c0ab870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:43.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.269+0000 7f6011200640 1 --2- 172.21.15.152:0/892727489 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f600c06b9b0 0x7f600c0ab870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:43.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.269+0000 7f6011200640 1 -- 172.21.15.152:0/892727489 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f600c1530e0 con 0x7f600c159130 2024-04-17T08:47:43.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.269+0000 7f6011200640 1 --2- 172.21.15.152:0/892727489 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f600c159130 0x7f600c152970 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f600400c7a0 tx=0x7f600400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:43.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.269+0000 7f6008c00640 1 -- 172.21.15.152:0/892727489 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6004003b80 con 0x7f600c159130 2024-04-17T08:47:43.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.269+0000 7f6008c00640 1 -- 172.21.15.152:0/892727489 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6004003d20 con 0x7f600c159130 2024-04-17T08:47:43.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.269+0000 7f6008c00640 1 -- 172.21.15.152:0/892727489 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600400aa90 con 0x7f600c159130 2024-04-17T08:47:43.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.269+0000 7f6011c00640 1 -- 172.21.15.152:0/892727489 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f600c1533c0 con 0x7f600c159130 2024-04-17T08:47:43.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.269+0000 7f6011c00640 1 -- 172.21.15.152:0/892727489 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f600c153980 con 0x7f600c159130 2024-04-17T08:47:43.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.269+0000 7f6011c00640 1 -- 172.21.15.152:0/892727489 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f600c075be0 con 0x7f600c159130 2024-04-17T08:47:43.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.269+0000 7f6008c00640 1 -- 172.21.15.152:0/892727489 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f600400ac30 con 0x7f600c159130 2024-04-17T08:47:43.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.269+0000 7f6008c00640 1 --2- 172.21.15.152:0/892727489 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5fe8068380 0x7f5fe806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:43.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.269+0000 7f6008c00640 1 -- 172.21.15.152:0/892727489 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f6004086cf0 con 0x7f600c159130 2024-04-17T08:47:43.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.269+0000 7f600be00640 1 --2- 172.21.15.152:0/892727489 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5fe8068380 0x7f5fe806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:43.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.273+0000 7f600be00640 1 --2- 172.21.15.152:0/892727489 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5fe8068380 0x7f5fe806a840 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc0af000 tx=0x7f5ffc0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:43.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.277+0000 7f6008c00640 1 -- 172.21.15.152:0/892727489 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f6004056e80 con 0x7f600c159130 2024-04-17T08:47:43.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.433+0000 7f6011c00640 1 -- 172.21.15.152:0/892727489 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f600c0d1240 con 0x7f600c159130 2024-04-17T08:47:43.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.437+0000 7f6008c00640 1 -- 172.21.15.152:0/892727489 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f6004056780 con 0x7f600c159130 2024-04-17T08:47:43.438 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2024-04-17T08:47:43.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.437+0000 7f6011c00640 1 -- 172.21.15.152:0/892727489 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5fe8068380 msgr2=0x7f5fe806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:43.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.437+0000 7f6011c00640 1 --2- 172.21.15.152:0/892727489 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5fe8068380 0x7f5fe806a840 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc0af000 tx=0x7f5ffc0a7000 comp rx=0 tx=0).stop 2024-04-17T08:47:43.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.437+0000 7f6011c00640 1 -- 172.21.15.152:0/892727489 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f600c159130 msgr2=0x7f600c152970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:43.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.437+0000 7f6011c00640 1 --2- 172.21.15.152:0/892727489 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f600c159130 0x7f600c152970 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f600400c7a0 tx=0x7f600400cc60 comp rx=0 tx=0).stop 2024-04-17T08:47:43.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.437+0000 7f6011c00640 1 -- 172.21.15.152:0/892727489 shutdown_connections 2024-04-17T08:47:43.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.437+0000 7f6011c00640 1 --2- 172.21.15.152:0/892727489 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f600c159130 0x7f600c152970 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:43.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.437+0000 7f6011c00640 1 --2- 172.21.15.152:0/892727489 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5fe8068380 0x7f5fe806a840 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:43.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.437+0000 7f6011c00640 1 --2- 172.21.15.152:0/892727489 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f600c0b47c0 0x7f600c154180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:43.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.437+0000 7f6011c00640 1 --2- 172.21.15.152:0/892727489 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f600c06b9b0 0x7f600c0ab870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:43.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.437+0000 7f6011c00640 1 -- 172.21.15.152:0/892727489 >> 172.21.15.152:0/892727489 conn(0x7f600c0d0470 msgr2=0x7f600c155bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:43.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.437+0000 7f6011c00640 1 -- 172.21.15.152:0/892727489 shutdown_connections 2024-04-17T08:47:43.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.437+0000 7f6011c00640 1 -- 172.21.15.152:0/892727489 wait complete. 2024-04-17T08:47:43.458 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-17T08:47:43.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.593+0000 7f333cc00640 1 Processor -- start 2024-04-17T08:47:43.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.593+0000 7f333cc00640 1 -- start start 2024-04-17T08:47:43.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.593+0000 7f333cc00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f33380af670 0x7f333815b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:43.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.593+0000 7f333cc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f333806f980 0x7f3338072530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:43.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.593+0000 7f333cc00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f333815c260 con 0x7f33380d0360 2024-04-17T08:47:43.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.593+0000 7f333cc00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f333815c820 con 0x7f33380af670 2024-04-17T08:47:43.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.593+0000 7f333cc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f333815c540 con 0x7f333806f980 2024-04-17T08:47:43.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.597+0000 7f3335e00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f33380af670 0x7f333815b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:43.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.597+0000 7f3335e00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f33380af670 0x7f333815b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60370/0 (socket says 172.21.15.152:60370) 2024-04-17T08:47:43.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.597+0000 7f3335e00640 1 -- 172.21.15.152:0/1708048819 learned_addr learned my addr 172.21.15.152:0/1708048819 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:43.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.597+0000 7f332d400640 1 --2- 172.21.15.152:0/1708048819 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f333806f980 0x7f3338072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:43.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.597+0000 7f3335e00640 1 -- 172.21.15.152:0/1708048819 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f333806f980 msgr2=0x7f3338072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:43.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.597+0000 7f3335e00640 1 --2- 172.21.15.152:0/1708048819 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f333806f980 0x7f3338072530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:43.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.597+0000 7f3335e00640 1 -- 172.21.15.152:0/1708048819 >> v1:172.21.15.196:6789/0 conn(0x7f33380d0360 legacy=0x7f333806dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:43.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.597+0000 7f3335e00640 1 -- 172.21.15.152:0/1708048819 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3338071d30 con 0x7f33380af670 2024-04-17T08:47:43.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.597+0000 7f3335e00640 1 --2- 172.21.15.152:0/1708048819 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f33380af670 0x7f333815b8c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f3328009e50 tx=0x7f332801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3200444417033e3e server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:43.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.597+0000 7f3335400640 1 -- 172.21.15.152:0/1708048819 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33280a5740 con 0x7f33380af670 2024-04-17T08:47:43.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.597+0000 7f3335400640 1 -- 172.21.15.152:0/1708048819 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33280a58e0 con 0x7f33380af670 2024-04-17T08:47:43.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.597+0000 7f3335400640 1 -- 172.21.15.152:0/1708048819 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33280a5cb0 con 0x7f33380af670 2024-04-17T08:47:43.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.601+0000 7f333cc00640 1 -- 172.21.15.152:0/1708048819 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f33380af670 msgr2=0x7f333815b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:43.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.601+0000 7f333cc00640 1 --2- 172.21.15.152:0/1708048819 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f33380af670 0x7f333815b8c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f3328009e50 tx=0x7f332801c930 comp rx=0 tx=0).stop 2024-04-17T08:47:43.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.601+0000 7f333cc00640 1 -- 172.21.15.152:0/1708048819 shutdown_connections 2024-04-17T08:47:43.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.601+0000 7f333cc00640 1 --2- 172.21.15.152:0/1708048819 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f333806f980 0x7f3338072530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:43.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.601+0000 7f333cc00640 1 --2- 172.21.15.152:0/1708048819 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f33380af670 0x7f333815b8c0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:43.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.601+0000 7f333cc00640 1 -- 172.21.15.152:0/1708048819 >> 172.21.15.152:0/1708048819 conn(0x7f33380b3350 msgr2=0x7f33380b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:43.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.601+0000 7f333cc00640 1 -- 172.21.15.152:0/1708048819 shutdown_connections 2024-04-17T08:47:43.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.601+0000 7f333cc00640 1 -- 172.21.15.152:0/1708048819 wait complete. 2024-04-17T08:47:43.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.601+0000 7f333cc00640 1 Processor -- start 2024-04-17T08:47:43.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.601+0000 7f333cc00640 1 -- start start 2024-04-17T08:47:43.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.601+0000 7f333cc00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f333806f980 0x7f3338149900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:43.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.601+0000 7f333cc00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f33380af670 0x7f33381500b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:43.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.601+0000 7f333cc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33380d0360 0x7f33381505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:43.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.601+0000 7f333cc00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f333815bf80 con 0x7f33380af670 2024-04-17T08:47:43.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.601+0000 7f333cc00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f333815be00 con 0x7f333806f980 2024-04-17T08:47:43.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.601+0000 7f333cc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f3338072a70 con 0x7f33380d0360 2024-04-17T08:47:43.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.601+0000 7f332d400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f33380af670 0x7f33381500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:43.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.601+0000 7f332d400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f33380af670 0x7f33381500b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60376/0 (socket says 172.21.15.152:60376) 2024-04-17T08:47:43.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.601+0000 7f332d400640 1 -- 172.21.15.152:0/4162950796 learned_addr learned my addr 172.21.15.152:0/4162950796 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:43.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.601+0000 7f3335e00640 1 --2- 172.21.15.152:0/4162950796 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f333806f980 0x7f3338149900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:43.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.601+0000 7f3336800640 1 --2- 172.21.15.152:0/4162950796 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33380d0360 0x7f33381505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:43.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.601+0000 7f332d400640 1 -- 172.21.15.152:0/4162950796 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33380d0360 msgr2=0x7f33381505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:43.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.601+0000 7f332d400640 1 --2- 172.21.15.152:0/4162950796 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33380d0360 0x7f33381505f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:43.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.601+0000 7f332d400640 1 -- 172.21.15.152:0/4162950796 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f333806f980 msgr2=0x7f3338149900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:43.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.601+0000 7f332d400640 1 --2- 172.21.15.152:0/4162950796 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f333806f980 0x7f3338149900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:43.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.601+0000 7f332d400640 1 -- 172.21.15.152:0/4162950796 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f333815a870 con 0x7f33380af670 2024-04-17T08:47:43.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.601+0000 7f3336800640 1 --2- 172.21.15.152:0/4162950796 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33380d0360 0x7f33381505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:43.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.601+0000 7f332d400640 1 --2- 172.21.15.152:0/4162950796 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f33380af670 0x7f33381500b0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f332000c610 tx=0x7f332000cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:43.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.605+0000 7f332ea00640 1 -- 172.21.15.152:0/4162950796 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3320015070 con 0x7f33380af670 2024-04-17T08:47:43.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.605+0000 7f332ea00640 1 -- 172.21.15.152:0/4162950796 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3320004220 con 0x7f33380af670 2024-04-17T08:47:43.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.605+0000 7f332ea00640 1 -- 172.21.15.152:0/4162950796 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3320003620 con 0x7f33380af670 2024-04-17T08:47:43.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.605+0000 7f333cc00640 1 -- 172.21.15.152:0/4162950796 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f333815ab50 con 0x7f33380af670 2024-04-17T08:47:43.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.605+0000 7f333cc00640 1 -- 172.21.15.152:0/4162950796 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f333815b110 con 0x7f33380af670 2024-04-17T08:47:43.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.605+0000 7f333cc00640 1 -- 172.21.15.152:0/4162950796 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3338068a30 con 0x7f33380af670 2024-04-17T08:47:43.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.605+0000 7f332ea00640 1 -- 172.21.15.152:0/4162950796 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f33200037c0 con 0x7f33380af670 2024-04-17T08:47:43.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.605+0000 7f332ea00640 1 --2- 172.21.15.152:0/4162950796 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3314068380 0x7f331406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:43.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.605+0000 7f332ea00640 1 -- 172.21.15.152:0/4162950796 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f3320086ba0 con 0x7f33380af670 2024-04-17T08:47:43.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.605+0000 7f3335e00640 1 --2- 172.21.15.152:0/4162950796 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3314068380 0x7f331406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:43.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.609+0000 7f3335e00640 1 --2- 172.21.15.152:0/4162950796 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3314068380 0x7f331406a840 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f33280ae000 tx=0x7f33280a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:43.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.609+0000 7f332ea00640 1 -- 172.21.15.152:0/4162950796 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f3320056650 con 0x7f33380af670 2024-04-17T08:47:43.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.765+0000 7f333cc00640 1 -- 172.21.15.152:0/4162950796 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f33381558e0 con 0x7f33380af670 2024-04-17T08:47:43.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.765+0000 7f332ea00640 1 -- 172.21.15.152:0/4162950796 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f332005a950 con 0x7f33380af670 2024-04-17T08:47:43.770 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-04-17T08:47:43.772 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.769+0000 7f333cc00640 1 -- 172.21.15.152:0/4162950796 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3314068380 msgr2=0x7f331406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:43.772 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.769+0000 7f333cc00640 1 --2- 172.21.15.152:0/4162950796 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3314068380 0x7f331406a840 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f33280ae000 tx=0x7f33280a7070 comp rx=0 tx=0).stop 2024-04-17T08:47:43.772 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.769+0000 7f333cc00640 1 -- 172.21.15.152:0/4162950796 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f33380af670 msgr2=0x7f33381500b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:43.772 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.769+0000 7f333cc00640 1 --2- 172.21.15.152:0/4162950796 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f33380af670 0x7f33381500b0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f332000c610 tx=0x7f332000cad0 comp rx=0 tx=0).stop 2024-04-17T08:47:43.772 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.769+0000 7f333cc00640 1 -- 172.21.15.152:0/4162950796 shutdown_connections 2024-04-17T08:47:43.772 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.769+0000 7f333cc00640 1 --2- 172.21.15.152:0/4162950796 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3314068380 0x7f331406a840 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:43.772 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.769+0000 7f333cc00640 1 --2- 172.21.15.152:0/4162950796 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33380d0360 0x7f33381505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:43.772 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.769+0000 7f333cc00640 1 --2- 172.21.15.152:0/4162950796 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f33380af670 0x7f33381500b0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:43.772 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.769+0000 7f333cc00640 1 --2- 172.21.15.152:0/4162950796 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f333806f980 0x7f3338149900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:43.772 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.769+0000 7f333cc00640 1 -- 172.21.15.152:0/4162950796 >> 172.21.15.152:0/4162950796 conn(0x7f33380b3350 msgr2=0x7f3338152a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:43.772 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.769+0000 7f333cc00640 1 -- 172.21.15.152:0/4162950796 shutdown_connections 2024-04-17T08:47:43.772 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.769+0000 7f333cc00640 1 -- 172.21.15.152:0/4162950796 wait complete. 2024-04-17T08:47:43.790 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-17T08:47:43.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.925+0000 7f4bdf200640 1 Processor -- start 2024-04-17T08:47:43.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.925+0000 7f4bdf200640 1 -- start start 2024-04-17T08:47:43.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.925+0000 7f4bdf200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f4bd8145ea0 0x7f4bd80d0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:43.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.925+0000 7f4bdf200640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f4bd80d0790 0x7f4bd80c7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:43.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.925+0000 7f4bdf200640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bd80ccbb0 con 0x7f4bd80c7770 2024-04-17T08:47:43.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.925+0000 7f4bdf200640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f4bd80cce90 con 0x7f4bd80d0790 2024-04-17T08:47:43.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.925+0000 7f4bdf200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f4bd80cd170 con 0x7f4bd8145ea0 2024-04-17T08:47:43.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.925+0000 7f4bcf400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f4bd80d0790 0x7f4bd80c7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:43.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.925+0000 7f4bdd200640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f4bd80c7770 0x7f4bd8071790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:54348/0 (socket says 172.21.15.152:54348) 2024-04-17T08:47:43.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.925+0000 7f4bcf400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f4bd80d0790 0x7f4bd80c7230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60384/0 (socket says 172.21.15.152:60384) 2024-04-17T08:47:43.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.925+0000 7f4bdd200640 1 -- 172.21.15.152:0/2606611972 learned_addr learned my addr 172.21.15.152:0/2606611972 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:43.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.925+0000 7f4bd7e00640 1 --2- 172.21.15.152:0/2606611972 >> v2:172.21.15.196:3300/0 conn(0x7f4bd8145ea0 0x7f4bd80d0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:43.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.925+0000 7f4bcf400640 1 -- 172.21.15.152:0/2606611972 >> v2:172.21.15.196:3300/0 conn(0x7f4bd8145ea0 msgr2=0x7f4bd80d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:43.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.925+0000 7f4bcf400640 1 --2- 172.21.15.152:0/2606611972 >> v2:172.21.15.196:3300/0 conn(0x7f4bd8145ea0 0x7f4bd80d0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:43.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.925+0000 7f4bcf400640 1 -- 172.21.15.152:0/2606611972 >> v1:172.21.15.152:6789/0 conn(0x7f4bd80c7770 legacy=0x7f4bd8071790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:43.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.925+0000 7f4bd7400640 1 -- 172.21.15.152:0/2606611972 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3769449914 0 0) 0x7f4bd80ccbb0 con 0x7f4bd80c7770 2024-04-17T08:47:43.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.925+0000 7f4bcf400640 1 -- 172.21.15.152:0/2606611972 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bd80cd450 con 0x7f4bd80d0790 2024-04-17T08:47:43.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.929+0000 7f4bcf400640 1 --2- 172.21.15.152:0/2606611972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4bd80d0790 0x7f4bd80c7230 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f4bd80727f0 tx=0x7f4bc001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af08a00d8267ed22 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:43.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.929+0000 7f4bd7400640 1 -- 172.21.15.152:0/2606611972 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc00b0070 con 0x7f4bd80d0790 2024-04-17T08:47:43.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.929+0000 7f4bd7400640 1 -- 172.21.15.152:0/2606611972 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bc00ab600 con 0x7f4bd80d0790 2024-04-17T08:47:43.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.929+0000 7f4bd7400640 1 -- 172.21.15.152:0/2606611972 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc00ab9d0 con 0x7f4bd80d0790 2024-04-17T08:47:43.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.929+0000 7f4bdf200640 1 -- 172.21.15.152:0/2606611972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4bd80d0790 msgr2=0x7f4bd80c7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:43.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.929+0000 7f4bdf200640 1 --2- 172.21.15.152:0/2606611972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4bd80d0790 0x7f4bd80c7230 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f4bd80727f0 tx=0x7f4bc001c3f0 comp rx=0 tx=0).stop 2024-04-17T08:47:43.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.929+0000 7f4bdf200640 1 -- 172.21.15.152:0/2606611972 shutdown_connections 2024-04-17T08:47:43.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.929+0000 7f4bdf200640 1 --2- 172.21.15.152:0/2606611972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4bd80d0790 0x7f4bd80c7230 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:43.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.929+0000 7f4bdf200640 1 --2- 172.21.15.152:0/2606611972 >> v2:172.21.15.196:3300/0 conn(0x7f4bd8145ea0 0x7f4bd80d0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:43.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.929+0000 7f4bdf200640 1 -- 172.21.15.152:0/2606611972 >> 172.21.15.152:0/2606611972 conn(0x7f4bd80d2350 msgr2=0x7f4bd80d2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:43.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.929+0000 7f4bdf200640 1 -- 172.21.15.152:0/2606611972 shutdown_connections 2024-04-17T08:47:43.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.929+0000 7f4bdf200640 1 -- 172.21.15.152:0/2606611972 wait complete. 2024-04-17T08:47:43.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.933+0000 7f4bdf200640 1 Processor -- start 2024-04-17T08:47:43.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.933+0000 7f4bdf200640 1 -- start start 2024-04-17T08:47:43.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.933+0000 7f4bdf200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4bd80c7770 0x7f4bd80b6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:43.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.933+0000 7f4bdf200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4bd80d0790 0x7f4bd80cb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:43.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.933+0000 7f4bdf200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4bd8145ea0 0x7f4bd80cbb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:43.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.933+0000 7f4bdf200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd8072020 con 0x7f4bd80c7770 2024-04-17T08:47:43.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.933+0000 7f4bdf200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd8071ea0 con 0x7f4bd80d0790 2024-04-17T08:47:43.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.933+0000 7f4bdf200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f4bd8169490 con 0x7f4bd8145ea0 2024-04-17T08:47:43.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.933+0000 7f4bd7e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4bd80c7770 0x7f4bd80b6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:43.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.933+0000 7f4bd7e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4bd80c7770 0x7f4bd80b6cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60388/0 (socket says 172.21.15.152:60388) 2024-04-17T08:47:43.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.933+0000 7f4bd7e00640 1 -- 172.21.15.152:0/2710966423 learned_addr learned my addr 172.21.15.152:0/2710966423 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:43.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.933+0000 7f4bd7e00640 1 -- 172.21.15.152:0/2710966423 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4bd8145ea0 msgr2=0x7f4bd80cbb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:43.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.933+0000 7f4bd7e00640 1 --2- 172.21.15.152:0/2710966423 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4bd8145ea0 0x7f4bd80cbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:43.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.933+0000 7f4bd7e00640 1 -- 172.21.15.152:0/2710966423 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4bd80d0790 msgr2=0x7f4bd80cb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:43.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.933+0000 7f4bd7e00640 1 --2- 172.21.15.152:0/2710966423 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4bd80d0790 0x7f4bd80cb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:43.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.933+0000 7f4bd7e00640 1 -- 172.21.15.152:0/2710966423 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bd81452f0 con 0x7f4bd80c7770 2024-04-17T08:47:43.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.933+0000 7f4bd7e00640 1 --2- 172.21.15.152:0/2710966423 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4bd80c7770 0x7f4bd80b6cb0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8009d10 tx=0x7f4bc800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:43.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.933+0000 7f4bd4c00640 1 -- 172.21.15.152:0/2710966423 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc8018020 con 0x7f4bd80c7770 2024-04-17T08:47:43.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.933+0000 7f4bd4c00640 1 -- 172.21.15.152:0/2710966423 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bc8014480 con 0x7f4bd80c7770 2024-04-17T08:47:43.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.933+0000 7f4bd4c00640 1 -- 172.21.15.152:0/2710966423 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc8014830 con 0x7f4bd80c7770 2024-04-17T08:47:43.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.933+0000 7f4bdf200640 1 -- 172.21.15.152:0/2710966423 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bd8070d00 con 0x7f4bd80c7770 2024-04-17T08:47:43.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.933+0000 7f4bdf200640 1 -- 172.21.15.152:0/2710966423 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bd80709b0 con 0x7f4bd80c7770 2024-04-17T08:47:43.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.937+0000 7f4bdf200640 1 -- 172.21.15.152:0/2710966423 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bd8068a30 con 0x7f4bd80c7770 2024-04-17T08:47:43.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.937+0000 7f4bd4c00640 1 -- 172.21.15.152:0/2710966423 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4bc801b020 con 0x7f4bd80c7770 2024-04-17T08:47:43.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.937+0000 7f4bd4c00640 1 --2- 172.21.15.152:0/2710966423 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f4bb4068380 0x7f4bb406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:43.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.937+0000 7f4bd4c00640 1 -- 172.21.15.152:0/2710966423 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f4bc8087b60 con 0x7f4bd80c7770 2024-04-17T08:47:43.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.937+0000 7f4bcf400640 1 --2- 172.21.15.152:0/2710966423 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f4bb4068380 0x7f4bb406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:43.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.937+0000 7f4bcf400640 1 --2- 172.21.15.152:0/2710966423 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f4bb4068380 0x7f4bb406a840 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4bc00ad000 tx=0x7f4bc0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:43.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:43.941+0000 7f4bd4c00640 1 -- 172.21.15.152:0/2710966423 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f4bc8022030 con 0x7f4bd80c7770 2024-04-17T08:47:44.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.097+0000 7f4bdf200640 1 -- 172.21.15.152:0/2710966423 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4bd80b7420 con 0x7f4bd80c7770 2024-04-17T08:47:44.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.097+0000 7f4bd4c00640 1 -- 172.21.15.152:0/2710966423 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f4bd81452f0 con 0x7f4bd80c7770 2024-04-17T08:47:44.100 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 64 2024-04-17T08:47:44.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.101+0000 7f4bdf200640 1 -- 172.21.15.152:0/2710966423 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f4bb4068380 msgr2=0x7f4bb406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:44.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.101+0000 7f4bdf200640 1 --2- 172.21.15.152:0/2710966423 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f4bb4068380 0x7f4bb406a840 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4bc00ad000 tx=0x7f4bc0008040 comp rx=0 tx=0).stop 2024-04-17T08:47:44.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.101+0000 7f4bdf200640 1 -- 172.21.15.152:0/2710966423 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4bd80c7770 msgr2=0x7f4bd80b6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:44.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.101+0000 7f4bdf200640 1 --2- 172.21.15.152:0/2710966423 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4bd80c7770 0x7f4bd80b6cb0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8009d10 tx=0x7f4bc800c490 comp rx=0 tx=0).stop 2024-04-17T08:47:44.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.101+0000 7f4bdf200640 1 -- 172.21.15.152:0/2710966423 shutdown_connections 2024-04-17T08:47:44.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.101+0000 7f4bdf200640 1 --2- 172.21.15.152:0/2710966423 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f4bb4068380 0x7f4bb406a840 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:44.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.101+0000 7f4bdf200640 1 --2- 172.21.15.152:0/2710966423 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4bd8145ea0 0x7f4bd80cbb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:44.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.101+0000 7f4bdf200640 1 --2- 172.21.15.152:0/2710966423 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4bd80d0790 0x7f4bd80cb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:44.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.101+0000 7f4bdf200640 1 --2- 172.21.15.152:0/2710966423 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4bd80c7770 0x7f4bd80b6cb0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:44.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.101+0000 7f4bdf200640 1 -- 172.21.15.152:0/2710966423 >> 172.21.15.152:0/2710966423 conn(0x7f4bd80d2350 msgr2=0x7f4bd815f480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:44.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.101+0000 7f4bdf200640 1 -- 172.21.15.152:0/2710966423 shutdown_connections 2024-04-17T08:47:44.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.101+0000 7f4bdf200640 1 -- 172.21.15.152:0/2710966423 wait complete. 2024-04-17T08:47:44.121 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-17T08:47:44.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.257+0000 7f593fc00640 1 Processor -- start 2024-04-17T08:47:44.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.257+0000 7f593fc00640 1 -- start start 2024-04-17T08:47:44.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.261+0000 7f593fc00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f59380af670 0x7f593815b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:44.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.261+0000 7f593fc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f593806f980 0x7f5938072530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:44.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.261+0000 7f593fc00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f593815c260 con 0x7f59380d0360 2024-04-17T08:47:44.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.261+0000 7f593fc00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f593815c820 con 0x7f59380af670 2024-04-17T08:47:44.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.261+0000 7f593fc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f593815c540 con 0x7f593806f980 2024-04-17T08:47:44.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.261+0000 7f593d200640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f59380af670 0x7f593815b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:44.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.261+0000 7f593d200640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f59380af670 0x7f593815b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60404/0 (socket says 172.21.15.152:60404) 2024-04-17T08:47:44.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.261+0000 7f593d200640 1 -- 172.21.15.152:0/3592639774 learned_addr learned my addr 172.21.15.152:0/3592639774 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:44.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.261+0000 7f5937e00640 1 --2- 172.21.15.152:0/3592639774 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f593806f980 0x7f5938072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:44.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.261+0000 7f593d200640 1 -- 172.21.15.152:0/3592639774 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f593806f980 msgr2=0x7f5938072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:44.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.261+0000 7f593d200640 1 --2- 172.21.15.152:0/3592639774 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f593806f980 0x7f5938072530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:44.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.261+0000 7f593d200640 1 -- 172.21.15.152:0/3592639774 >> v1:172.21.15.196:6789/0 conn(0x7f59380d0360 legacy=0x7f593806dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:44.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.261+0000 7f593d200640 1 -- 172.21.15.152:0/3592639774 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5938071d30 con 0x7f59380af670 2024-04-17T08:47:44.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.261+0000 7f593d200640 1 --2- 172.21.15.152:0/3592639774 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59380af670 0x7f593815b8c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f592800d150 tx=0x7f592801eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=942b6fbe8ebf2c18 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:44.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.265+0000 7f5937400640 1 -- 172.21.15.152:0/3592639774 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f592800b2d0 con 0x7f59380af670 2024-04-17T08:47:44.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.265+0000 7f5937400640 1 -- 172.21.15.152:0/3592639774 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f592800b470 con 0x7f59380af670 2024-04-17T08:47:44.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.265+0000 7f5937400640 1 -- 172.21.15.152:0/3592639774 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59280a7af0 con 0x7f59380af670 2024-04-17T08:47:44.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.265+0000 7f593fc00640 1 -- 172.21.15.152:0/3592639774 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59380af670 msgr2=0x7f593815b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:44.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.265+0000 7f593fc00640 1 --2- 172.21.15.152:0/3592639774 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59380af670 0x7f593815b8c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f592800d150 tx=0x7f592801eb70 comp rx=0 tx=0).stop 2024-04-17T08:47:44.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.265+0000 7f593fc00640 1 -- 172.21.15.152:0/3592639774 shutdown_connections 2024-04-17T08:47:44.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.265+0000 7f593fc00640 1 --2- 172.21.15.152:0/3592639774 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f593806f980 0x7f5938072530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:44.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.265+0000 7f593fc00640 1 --2- 172.21.15.152:0/3592639774 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59380af670 0x7f593815b8c0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:44.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.265+0000 7f593fc00640 1 -- 172.21.15.152:0/3592639774 >> 172.21.15.152:0/3592639774 conn(0x7f59380b3350 msgr2=0x7f59380b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:44.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.265+0000 7f593fc00640 1 -- 172.21.15.152:0/3592639774 shutdown_connections 2024-04-17T08:47:44.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.265+0000 7f593fc00640 1 -- 172.21.15.152:0/3592639774 wait complete. 2024-04-17T08:47:44.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.265+0000 7f593fc00640 1 Processor -- start 2024-04-17T08:47:44.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.265+0000 7f593fc00640 1 -- start start 2024-04-17T08:47:44.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.265+0000 7f593fc00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f593806f980 0x7f59380b2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:44.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.265+0000 7f593fc00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f59380af670 0x7f593806e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:44.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.265+0000 7f593fc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f59380d0360 0x7f593806ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:44.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.265+0000 7f593fc00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f593815bf80 con 0x7f593806f980 2024-04-17T08:47:44.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.265+0000 7f593fc00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f593815be00 con 0x7f59380af670 2024-04-17T08:47:44.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.265+0000 7f593fc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f5938072a70 con 0x7f59380d0360 2024-04-17T08:47:44.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.265+0000 7f593d200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f593806f980 0x7f59380b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:44.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.265+0000 7f593d200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f593806f980 0x7f59380b2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60414/0 (socket says 172.21.15.152:60414) 2024-04-17T08:47:44.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.265+0000 7f593d200640 1 -- 172.21.15.152:0/1877493853 learned_addr learned my addr 172.21.15.152:0/1877493853 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:44.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.265+0000 7f5937e00640 1 --2- 172.21.15.152:0/1877493853 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f59380af670 0x7f593806e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:44.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.265+0000 7f593dc00640 1 --2- 172.21.15.152:0/1877493853 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f59380d0360 0x7f593806ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:44.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.269+0000 7f593d200640 1 -- 172.21.15.152:0/1877493853 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f59380d0360 msgr2=0x7f593806ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:44.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.269+0000 7f593d200640 1 --2- 172.21.15.152:0/1877493853 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f59380d0360 0x7f593806ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:44.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.269+0000 7f593d200640 1 -- 172.21.15.152:0/1877493853 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f59380af670 msgr2=0x7f593806e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:44.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.269+0000 7f593d200640 1 --2- 172.21.15.152:0/1877493853 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f59380af670 0x7f593806e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:44.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.269+0000 7f593d200640 1 -- 172.21.15.152:0/1877493853 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5938158d60 con 0x7f593806f980 2024-04-17T08:47:44.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.269+0000 7f593d200640 1 --2- 172.21.15.152:0/1877493853 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f593806f980 0x7f59380b2450 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f592801d220 tx=0x7f592801b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:44.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.269+0000 7f5934c00640 1 -- 172.21.15.152:0/1877493853 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5928009600 con 0x7f593806f980 2024-04-17T08:47:44.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.269+0000 7f5934c00640 1 -- 172.21.15.152:0/1877493853 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59280097a0 con 0x7f593806f980 2024-04-17T08:47:44.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.269+0000 7f593fc00640 1 -- 172.21.15.152:0/1877493853 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f593814c0f0 con 0x7f593806f980 2024-04-17T08:47:44.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.269+0000 7f5934c00640 1 -- 172.21.15.152:0/1877493853 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5928009b90 con 0x7f593806f980 2024-04-17T08:47:44.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.269+0000 7f593fc00640 1 -- 172.21.15.152:0/1877493853 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f593814c670 con 0x7f593806f980 2024-04-17T08:47:44.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.269+0000 7f593fc00640 1 -- 172.21.15.152:0/1877493853 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5938068a30 con 0x7f593806f980 2024-04-17T08:47:44.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.269+0000 7f5934c00640 1 -- 172.21.15.152:0/1877493853 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f59280c0020 con 0x7f593806f980 2024-04-17T08:47:44.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.269+0000 7f5934c00640 1 --2- 172.21.15.152:0/1877493853 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5918068380 0x7f591806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:44.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.269+0000 7f5934c00640 1 -- 172.21.15.152:0/1877493853 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f59281217e0 con 0x7f593806f980 2024-04-17T08:47:44.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.269+0000 7f5937e00640 1 --2- 172.21.15.152:0/1877493853 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5918068380 0x7f591806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:44.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.273+0000 7f5937e00640 1 --2- 172.21.15.152:0/1877493853 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5918068380 0x7f591806a840 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f593815e590 tx=0x7f5924008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:44.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.273+0000 7f5934c00640 1 -- 172.21.15.152:0/1877493853 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f59280c7020 con 0x7f593806f980 2024-04-17T08:47:44.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.433+0000 7f593fc00640 1 -- 172.21.15.152:0/1877493853 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f59380679c0 con 0x7f593806f980 2024-04-17T08:47:44.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.433+0000 7f5934c00640 1 -- 172.21.15.152:0/1877493853 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f5928018820 con 0x7f593806f980 2024-04-17T08:47:44.437 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-04-17T08:47:44.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.437+0000 7f593fc00640 1 -- 172.21.15.152:0/1877493853 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5918068380 msgr2=0x7f591806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:44.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.437+0000 7f593fc00640 1 --2- 172.21.15.152:0/1877493853 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5918068380 0x7f591806a840 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f593815e590 tx=0x7f5924008040 comp rx=0 tx=0).stop 2024-04-17T08:47:44.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.437+0000 7f593fc00640 1 -- 172.21.15.152:0/1877493853 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f593806f980 msgr2=0x7f59380b2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:44.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.437+0000 7f593fc00640 1 --2- 172.21.15.152:0/1877493853 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f593806f980 0x7f59380b2450 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f592801d220 tx=0x7f592801b910 comp rx=0 tx=0).stop 2024-04-17T08:47:44.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.437+0000 7f593fc00640 1 -- 172.21.15.152:0/1877493853 shutdown_connections 2024-04-17T08:47:44.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.437+0000 7f593fc00640 1 --2- 172.21.15.152:0/1877493853 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5918068380 0x7f591806a840 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:44.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.437+0000 7f593fc00640 1 --2- 172.21.15.152:0/1877493853 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f59380d0360 0x7f593806ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:44.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.437+0000 7f593fc00640 1 --2- 172.21.15.152:0/1877493853 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f59380af670 0x7f593806e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:44.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.437+0000 7f593fc00640 1 --2- 172.21.15.152:0/1877493853 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f593806f980 0x7f59380b2450 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:44.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.437+0000 7f593fc00640 1 -- 172.21.15.152:0/1877493853 >> 172.21.15.152:0/1877493853 conn(0x7f59380b3350 msgr2=0x7f593814fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:44.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.437+0000 7f593fc00640 1 -- 172.21.15.152:0/1877493853 shutdown_connections 2024-04-17T08:47:44.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.437+0000 7f593fc00640 1 -- 172.21.15.152:0/1877493853 wait complete. 2024-04-17T08:47:44.458 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-17T08:47:44.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.593+0000 7fc1cd400640 1 Processor -- start 2024-04-17T08:47:44.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.593+0000 7fc1cd400640 1 -- start start 2024-04-17T08:47:44.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.593+0000 7fc1cd400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc1c80af670 0x7fc1c815b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:44.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.593+0000 7fc1cd400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1c80d0360 0x7fc1c80d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:44.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.593+0000 7fc1cd400640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1c8072c40 con 0x7fc1c806f980 2024-04-17T08:47:44.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.593+0000 7fc1cd400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fc1c815c820 con 0x7fc1c80af670 2024-04-17T08:47:44.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.593+0000 7fc1cd400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fc1c815c260 con 0x7fc1c80d0360 2024-04-17T08:47:44.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.593+0000 7fc1bde00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fc1c806f980 0x7fc1c8072530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:54356/0 (socket says 172.21.15.152:54356) 2024-04-17T08:47:44.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.593+0000 7fc1bde00640 1 -- 172.21.15.152:0/1686450475 learned_addr learned my addr 172.21.15.152:0/1686450475 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:44.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.593+0000 7fc1c7200640 1 --2- 172.21.15.152:0/1686450475 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1c80d0360 0x7fc1c80d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:44.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.593+0000 7fc1c6800640 1 --2- 172.21.15.152:0/1686450475 >> v2:172.21.15.196:3300/0 conn(0x7fc1c80af670 0x7fc1c815b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:44.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.593+0000 7fc1c5e00640 1 -- 172.21.15.152:0/1686450475 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3162773566 0 0) 0x7fc1c8072c40 con 0x7fc1c806f980 2024-04-17T08:47:44.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.593+0000 7fc1c5e00640 1 -- 172.21.15.152:0/1686450475 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1ac003530 con 0x7fc1c806f980 2024-04-17T08:47:44.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.593+0000 7fc1c5e00640 1 -- 172.21.15.152:0/1686450475 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4164629638 0 0) 0x7fc1ac003530 con 0x7fc1c806f980 2024-04-17T08:47:44.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.593+0000 7fc1c5e00640 1 -- 172.21.15.152:0/1686450475 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1c80d0360 msgr2=0x7fc1c80d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:44.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.593+0000 7fc1c5e00640 1 --2- 172.21.15.152:0/1686450475 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1c80d0360 0x7fc1c80d07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:44.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.593+0000 7fc1c5e00640 1 -- 172.21.15.152:0/1686450475 >> v2:172.21.15.196:3300/0 conn(0x7fc1c80af670 msgr2=0x7fc1c815b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:44.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.593+0000 7fc1c5e00640 1 --2- 172.21.15.152:0/1686450475 >> v2:172.21.15.196:3300/0 conn(0x7fc1c80af670 0x7fc1c815b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:44.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.593+0000 7fc1c5e00640 1 -- 172.21.15.152:0/1686450475 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1c815c540 con 0x7fc1c806f980 2024-04-17T08:47:44.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.593+0000 7fc1c5e00640 1 -- 172.21.15.152:0/1686450475 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2973887244 0 0) 0x7fc1b0001680 con 0x7fc1c806f980 2024-04-17T08:47:44.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.593+0000 7fc1c7200640 1 --2- 172.21.15.152:0/1686450475 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1c80d0360 0x7fc1c80d07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T08:47:44.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.593+0000 7fc1c5e00640 1 -- 172.21.15.152:0/1686450475 >> v1:172.21.15.152:6789/0 conn(0x7fc1c806f980 legacy=0x7fc1c8072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:44.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.593+0000 7fc1c5e00640 1 --2- 172.21.15.152:0/1686450475 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1ac0039c0 0x7fc1ac003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:44.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.593+0000 7fc1c5e00640 1 --2- 172.21.15.152:0/1686450475 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1c80d0360 0x7fc1ac004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:44.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.593+0000 7fc1c5e00640 1 --2- 172.21.15.152:0/1686450475 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc1ac004d50 0x7fc1ac0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:44.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.593+0000 7fc1c5e00640 1 -- 172.21.15.152:0/1686450475 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c815c820 con 0x7fc1ac0039c0 2024-04-17T08:47:44.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.593+0000 7fc1c5e00640 1 -- 172.21.15.152:0/1686450475 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c815c260 con 0x7fc1ac004d50 2024-04-17T08:47:44.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.593+0000 7fc1c5e00640 1 -- 172.21.15.152:0/1686450475 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fc1ac00b9d0 con 0x7fc1c80d0360 2024-04-17T08:47:44.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.593+0000 7fc1c6800640 1 --2- 172.21.15.152:0/1686450475 >> v2:172.21.15.196:3300/0 conn(0x7fc1c80af670 0x7fc1c815b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T08:47:44.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.593+0000 7fc1c6800640 1 --2- 172.21.15.152:0/1686450475 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1ac0039c0 0x7fc1ac003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:44.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.593+0000 7fc1c7200640 1 --2- 172.21.15.152:0/1686450475 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc1ac004d50 0x7fc1ac0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:44.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.593+0000 7fc1bde00640 1 --2- 172.21.15.152:0/1686450475 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1c80d0360 0x7fc1ac004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:44.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.593+0000 7fc1c6800640 1 -- 172.21.15.152:0/1686450475 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1c80d0360 msgr2=0x7fc1ac004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:44.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.593+0000 7fc1c6800640 1 --2- 172.21.15.152:0/1686450475 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1c80d0360 0x7fc1ac004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:44.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.593+0000 7fc1c6800640 1 -- 172.21.15.152:0/1686450475 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc1ac004d50 msgr2=0x7fc1ac0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:44.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.593+0000 7fc1c6800640 1 --2- 172.21.15.152:0/1686450475 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc1ac004d50 0x7fc1ac0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:44.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.593+0000 7fc1c6800640 1 -- 172.21.15.152:0/1686450475 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1ac003530 con 0x7fc1ac0039c0 2024-04-17T08:47:44.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.597+0000 7fc1c6800640 1 --2- 172.21.15.152:0/1686450475 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1ac0039c0 0x7fc1ac003de0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fc1b8009820 tx=0x7fc1b801edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cd79a952a6f9c24 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:44.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.597+0000 7fc1c5e00640 1 -- 172.21.15.152:0/1686450475 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b8009860 con 0x7fc1ac0039c0 2024-04-17T08:47:44.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.597+0000 7fc1c5e00640 1 -- 172.21.15.152:0/1686450475 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1b80a7b10 con 0x7fc1ac0039c0 2024-04-17T08:47:44.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.597+0000 7fc1c5e00640 1 -- 172.21.15.152:0/1686450475 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b8004020 con 0x7fc1ac0039c0 2024-04-17T08:47:44.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.597+0000 7fc1cd400640 1 -- 172.21.15.152:0/1686450475 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1ac0039c0 msgr2=0x7fc1ac003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:44.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.597+0000 7fc1cd400640 1 --2- 172.21.15.152:0/1686450475 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1ac0039c0 0x7fc1ac003de0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fc1b8009820 tx=0x7fc1b801edf0 comp rx=0 tx=0).stop 2024-04-17T08:47:44.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.597+0000 7fc1c7200640 1 -- 172.21.15.152:0/1686450475 reap_dead start 2024-04-17T08:47:44.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.597+0000 7fc1cd400640 1 -- 172.21.15.152:0/1686450475 shutdown_connections 2024-04-17T08:47:44.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.597+0000 7fc1cd400640 1 -- 172.21.15.152:0/1686450475 >> 172.21.15.152:0/1686450475 conn(0x7fc1c80b3350 msgr2=0x7fc1c80b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:44.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.597+0000 7fc1cd400640 1 -- 172.21.15.152:0/1686450475 shutdown_connections 2024-04-17T08:47:44.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.597+0000 7fc1cd400640 1 -- 172.21.15.152:0/1686450475 wait complete. 2024-04-17T08:47:44.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.601+0000 7fc1cd400640 1 Processor -- start 2024-04-17T08:47:44.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.601+0000 7fc1cd400640 1 -- start start 2024-04-17T08:47:44.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.601+0000 7fc1cd400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1ac0039c0 0x7fc1c814dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:44.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.601+0000 7fc1cd400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1c814ce60 0x7fc1c8152c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:44.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.601+0000 7fc1cd400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc1c81531c0 0x7fc1c80afc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:44.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.601+0000 7fc1cd400640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c80d0b80 con 0x7fc1c814ce60 2024-04-17T08:47:44.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.601+0000 7fc1cd400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c815be00 con 0x7fc1c81531c0 2024-04-17T08:47:44.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.601+0000 7fc1cd400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fc1c814d9a0 con 0x7fc1ac0039c0 2024-04-17T08:47:44.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.601+0000 7fc1bde00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1c814ce60 0x7fc1c8152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:44.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.601+0000 7fc1bde00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1c814ce60 0x7fc1c8152c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60420/0 (socket says 172.21.15.152:60420) 2024-04-17T08:47:44.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.601+0000 7fc1bde00640 1 -- 172.21.15.152:0/2446948601 learned_addr learned my addr 172.21.15.152:0/2446948601 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:44.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.601+0000 7fc1c6800640 1 --2- 172.21.15.152:0/2446948601 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1ac0039c0 0x7fc1c814dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:44.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.601+0000 7fc1c7200640 1 --2- 172.21.15.152:0/2446948601 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc1c81531c0 0x7fc1c80afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:44.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.601+0000 7fc1bde00640 1 -- 172.21.15.152:0/2446948601 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1ac0039c0 msgr2=0x7fc1c814dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:44.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.601+0000 7fc1bde00640 1 --2- 172.21.15.152:0/2446948601 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1ac0039c0 0x7fc1c814dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:44.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.601+0000 7fc1bde00640 1 -- 172.21.15.152:0/2446948601 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc1c81531c0 msgr2=0x7fc1c80afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:44.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.601+0000 7fc1bde00640 1 --2- 172.21.15.152:0/2446948601 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc1c81531c0 0x7fc1c80afc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:44.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.601+0000 7fc1bde00640 1 -- 172.21.15.152:0/2446948601 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1c814ec80 con 0x7fc1c814ce60 2024-04-17T08:47:44.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.601+0000 7fc1c7200640 1 --2- 172.21.15.152:0/2446948601 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc1c81531c0 0x7fc1c80afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:44.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.601+0000 7fc1bde00640 1 --2- 172.21.15.152:0/2446948601 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1c814ce60 0x7fc1c8152c80 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fc1b000e780 tx=0x7fc1b000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:44.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.601+0000 7fc1bf400640 1 -- 172.21.15.152:0/2446948601 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b000c8d0 con 0x7fc1c814ce60 2024-04-17T08:47:44.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.601+0000 7fc1bf400640 1 -- 172.21.15.152:0/2446948601 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1b0018070 con 0x7fc1c814ce60 2024-04-17T08:47:44.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.601+0000 7fc1bf400640 1 -- 172.21.15.152:0/2446948601 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b000ccd0 con 0x7fc1c814ce60 2024-04-17T08:47:44.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.601+0000 7fc1cd400640 1 -- 172.21.15.152:0/2446948601 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1c814e6c0 con 0x7fc1c814ce60 2024-04-17T08:47:44.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.601+0000 7fc1cd400640 1 -- 172.21.15.152:0/2446948601 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1c8152480 con 0x7fc1c814ce60 2024-04-17T08:47:44.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.605+0000 7fc1cd400640 1 -- 172.21.15.152:0/2446948601 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1c8068a30 con 0x7fc1c814ce60 2024-04-17T08:47:44.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.605+0000 7fc1bf400640 1 -- 172.21.15.152:0/2446948601 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc1b001d460 con 0x7fc1c814ce60 2024-04-17T08:47:44.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.605+0000 7fc1bf400640 1 --2- 172.21.15.152:0/2446948601 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc1a4068380 0x7fc1a406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:44.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.605+0000 7fc1bf400640 1 -- 172.21.15.152:0/2446948601 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fc1b0086c80 con 0x7fc1c814ce60 2024-04-17T08:47:44.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.605+0000 7fc1c6800640 1 --2- 172.21.15.152:0/2446948601 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc1a4068380 0x7fc1a406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:44.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.605+0000 7fc1c6800640 1 --2- 172.21.15.152:0/2446948601 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc1a4068380 0x7fc1a406a840 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc1b80b0000 tx=0x7fc1b8010040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:44.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.609+0000 7fc1bf400640 1 -- 172.21.15.152:0/2446948601 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fc1b0056e10 con 0x7fc1c814ce60 2024-04-17T08:47:44.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.777+0000 7fc1cd400640 1 -- 172.21.15.152:0/2446948601 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc1c8074e80 con 0x7fc1c814ce60 2024-04-17T08:47:44.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.781+0000 7fc1bf400640 1 -- 172.21.15.152:0/2446948601 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7fc1b0056710 con 0x7fc1c814ce60 2024-04-17T08:47:44.782 INFO:teuthology.orchestra.run.smithi152.stderr:listed 0 entries 2024-04-17T08:47:44.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.781+0000 7fc1cd400640 1 -- 172.21.15.152:0/2446948601 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc1a4068380 msgr2=0x7fc1a406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:44.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.781+0000 7fc1cd400640 1 --2- 172.21.15.152:0/2446948601 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc1a4068380 0x7fc1a406a840 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc1b80b0000 tx=0x7fc1b8010040 comp rx=0 tx=0).stop 2024-04-17T08:47:44.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.781+0000 7fc1cd400640 1 -- 172.21.15.152:0/2446948601 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1c814ce60 msgr2=0x7fc1c8152c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:44.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.781+0000 7fc1cd400640 1 --2- 172.21.15.152:0/2446948601 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1c814ce60 0x7fc1c8152c80 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fc1b000e780 tx=0x7fc1b000ec40 comp rx=0 tx=0).stop 2024-04-17T08:47:44.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.781+0000 7fc1cd400640 1 -- 172.21.15.152:0/2446948601 shutdown_connections 2024-04-17T08:47:44.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.781+0000 7fc1cd400640 1 --2- 172.21.15.152:0/2446948601 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc1c81531c0 0x7fc1c80afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:44.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.781+0000 7fc1cd400640 1 --2- 172.21.15.152:0/2446948601 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1c814ce60 0x7fc1c8152c80 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:44.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.781+0000 7fc1cd400640 1 --2- 172.21.15.152:0/2446948601 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc1a4068380 0x7fc1a406a840 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:44.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.781+0000 7fc1cd400640 1 --2- 172.21.15.152:0/2446948601 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1ac0039c0 0x7fc1c814dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:44.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.781+0000 7fc1cd400640 1 -- 172.21.15.152:0/2446948601 >> 172.21.15.152:0/2446948601 conn(0x7fc1c80b3350 msgr2=0x7fc1c81536b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:44.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.781+0000 7fc1cd400640 1 -- 172.21.15.152:0/2446948601 shutdown_connections 2024-04-17T08:47:44.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:44.781+0000 7fc1cd400640 1 -- 172.21.15.152:0/2446948601 wait complete. 2024-04-17T08:47:44.803 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi196.front.sepia.ceph.com... 2024-04-17T08:47:44.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:44.803 DEBUG:teuthology.orchestra.run.smithi196:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-04-17T08:47:44.826 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T08:47:44.826 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi196.front.sepia.ceph.com 2024-04-17T08:47:44.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:47:44.826 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-04-17T08:47:44.881 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-17T08:47:44.881 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T08:47:45.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.013+0000 7f6f5b000640 1 Processor -- start 2024-04-17T08:47:45.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.013+0000 7f6f5b000640 1 -- start start 2024-04-17T08:47:45.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.013+0000 7f6f5b000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6f540d0360 0x7f6f540d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:45.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.013+0000 7f6f5b000640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f5415bfd0 con 0x7f6f540af670 2024-04-17T08:47:45.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.013+0000 7f6f5b000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f54072c40 con 0x7f6f5406f980 2024-04-17T08:47:45.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.013+0000 7f6f5b000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f6f5415c820 con 0x7f6f540d0360 2024-04-17T08:47:45.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.013+0000 7f6f53e00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f6f540af670 0x7f6f5415b8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:54362/0 (socket says 172.21.15.152:54362) 2024-04-17T08:47:45.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.013+0000 7f6f53e00640 1 -- 172.21.15.152:0/1294796420 learned_addr learned my addr 172.21.15.152:0/1294796420 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:45.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.013+0000 7f6f59000640 1 --2- 172.21.15.152:0/1294796420 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6f540d0360 0x7f6f540d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:45.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.017+0000 7f6f53400640 1 -- 172.21.15.152:0/1294796420 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1192417067 0 0) 0x7f6f5415bfd0 con 0x7f6f540af670 2024-04-17T08:47:45.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.017+0000 7f6f53400640 1 -- 172.21.15.152:0/1294796420 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f38003530 con 0x7f6f540af670 2024-04-17T08:47:45.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.017+0000 7f6f53400640 1 -- 172.21.15.152:0/1294796420 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1712365165 0 0) 0x7f6f54072c40 con 0x7f6f5406f980 2024-04-17T08:47:45.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.017+0000 7f6f53400640 1 -- 172.21.15.152:0/1294796420 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f5415bfd0 con 0x7f6f5406f980 2024-04-17T08:47:45.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.017+0000 7f6f59000640 1 -- 172.21.15.152:0/1294796420 >> v1:172.21.15.196:6789/0 conn(0x7f6f5406f980 legacy=0x7f6f54072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:45.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.017+0000 7f6f59000640 1 -- 172.21.15.152:0/1294796420 >> v1:172.21.15.152:6789/0 conn(0x7f6f540af670 legacy=0x7f6f5415b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:45.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.017+0000 7f6f59000640 1 -- 172.21.15.152:0/1294796420 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f5415c260 con 0x7f6f540d0360 2024-04-17T08:47:45.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.017+0000 7f6f59000640 1 --2- 172.21.15.152:0/1294796420 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6f540d0360 0x7f6f540d07f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c0097f0 tx=0x7f6f4c01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=274a0e0ac0981a22 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:45.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.017+0000 7f6f53400640 1 -- 172.21.15.152:0/1294796420 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c0b0070 con 0x7f6f540d0360 2024-04-17T08:47:45.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.017+0000 7f6f53400640 1 -- 172.21.15.152:0/1294796420 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f4c0ab600 con 0x7f6f540d0360 2024-04-17T08:47:45.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.017+0000 7f6f53400640 1 -- 172.21.15.152:0/1294796420 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c0ab9d0 con 0x7f6f540d0360 2024-04-17T08:47:45.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.021+0000 7f6f5b000640 1 -- 172.21.15.152:0/1294796420 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6f540d0360 msgr2=0x7f6f540d07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:45.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.021+0000 7f6f5b000640 1 --2- 172.21.15.152:0/1294796420 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6f540d0360 0x7f6f540d07f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c0097f0 tx=0x7f6f4c01c450 comp rx=0 tx=0).stop 2024-04-17T08:47:45.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.021+0000 7f6f5b000640 1 -- 172.21.15.152:0/1294796420 shutdown_connections 2024-04-17T08:47:45.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.021+0000 7f6f5b000640 1 --2- 172.21.15.152:0/1294796420 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6f540d0360 0x7f6f540d07f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:45.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.021+0000 7f6f5b000640 1 -- 172.21.15.152:0/1294796420 >> 172.21.15.152:0/1294796420 conn(0x7f6f540b3350 msgr2=0x7f6f540b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:45.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.021+0000 7f6f5b000640 1 -- 172.21.15.152:0/1294796420 shutdown_connections 2024-04-17T08:47:45.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.021+0000 7f6f5b000640 1 -- 172.21.15.152:0/1294796420 wait complete. 2024-04-17T08:47:45.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.021+0000 7f6f5b000640 1 Processor -- start 2024-04-17T08:47:45.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.021+0000 7f6f5b000640 1 -- start start 2024-04-17T08:47:45.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.021+0000 7f6f5b000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6f5406f980 0x7f6f54153ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:45.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.021+0000 7f6f5b000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f540af670 0x7f6f540afde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:45.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.021+0000 7f6f5b000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6f540d0360 0x7f6f5414eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:45.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.021+0000 7f6f5b000640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6f54169060 con 0x7f6f540af670 2024-04-17T08:47:45.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.021+0000 7f6f5b000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f6f540afa50 con 0x7f6f540d0360 2024-04-17T08:47:45.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.021+0000 7f6f5b000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f6f541691e0 con 0x7f6f5406f980 2024-04-17T08:47:45.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.021+0000 7f6f4b400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f540af670 0x7f6f540afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:45.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.021+0000 7f6f4b400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f540af670 0x7f6f540afde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60436/0 (socket says 172.21.15.152:60436) 2024-04-17T08:47:45.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.021+0000 7f6f4b400640 1 -- 172.21.15.152:0/3498320219 learned_addr learned my addr 172.21.15.152:0/3498320219 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:45.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.021+0000 7f6f59000640 1 --2- 172.21.15.152:0/3498320219 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6f540d0360 0x7f6f5414eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:45.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.021+0000 7f6f53e00640 1 --2- 172.21.15.152:0/3498320219 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6f5406f980 0x7f6f54153ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:45.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.021+0000 7f6f4b400640 1 -- 172.21.15.152:0/3498320219 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6f5406f980 msgr2=0x7f6f54153ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:45.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.021+0000 7f6f4b400640 1 --2- 172.21.15.152:0/3498320219 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6f5406f980 0x7f6f54153ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:45.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.021+0000 7f6f4b400640 1 -- 172.21.15.152:0/3498320219 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6f540d0360 msgr2=0x7f6f5414eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:45.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.021+0000 7f6f4b400640 1 --2- 172.21.15.152:0/3498320219 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6f540d0360 0x7f6f5414eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:45.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.021+0000 7f6f4b400640 1 -- 172.21.15.152:0/3498320219 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f54151da0 con 0x7f6f540af670 2024-04-17T08:47:45.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.021+0000 7f6f59000640 1 --2- 172.21.15.152:0/3498320219 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6f540d0360 0x7f6f5414eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:47:45.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.021+0000 7f6f53e00640 1 --2- 172.21.15.152:0/3498320219 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6f5406f980 0x7f6f54153ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:47:45.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.021+0000 7f6f4b400640 1 --2- 172.21.15.152:0/3498320219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f540af670 0x7f6f540afde0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c00c410 tx=0x7f6f3c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:45.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.025+0000 7f6f50c00640 1 -- 172.21.15.152:0/3498320219 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c017070 con 0x7f6f540af670 2024-04-17T08:47:45.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.025+0000 7f6f50c00640 1 -- 172.21.15.152:0/3498320219 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f3c0052f0 con 0x7f6f540af670 2024-04-17T08:47:45.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.025+0000 7f6f50c00640 1 -- 172.21.15.152:0/3498320219 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c003840 con 0x7f6f540af670 2024-04-17T08:47:45.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.025+0000 7f6f5b000640 1 -- 172.21.15.152:0/3498320219 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f541520e0 con 0x7f6f540af670 2024-04-17T08:47:45.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.025+0000 7f6f5b000640 1 -- 172.21.15.152:0/3498320219 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f54151720 con 0x7f6f540af670 2024-04-17T08:47:45.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.025+0000 7f6f5b000640 1 -- 172.21.15.152:0/3498320219 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f54068a30 con 0x7f6f540af670 2024-04-17T08:47:45.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.025+0000 7f6f50c00640 1 -- 172.21.15.152:0/3498320219 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6f3c01a070 con 0x7f6f540af670 2024-04-17T08:47:45.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.025+0000 7f6f50c00640 1 --2- 172.21.15.152:0/3498320219 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f6f30068380 0x7f6f3006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:45.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.025+0000 7f6f50c00640 1 -- 172.21.15.152:0/3498320219 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f6f3c0862b0 con 0x7f6f540af670 2024-04-17T08:47:45.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.025+0000 7f6f53e00640 1 --2- 172.21.15.152:0/3498320219 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f6f30068380 0x7f6f3006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:45.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.025+0000 7f6f53e00640 1 --2- 172.21.15.152:0/3498320219 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f6f30068380 0x7f6f3006a840 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6f44001570 tx=0x7f6f44009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:45.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.029+0000 7f6f50c00640 1 -- 172.21.15.152:0/3498320219 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f6f541520e0 con 0x7f6f540af670 2024-04-17T08:47:45.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.217+0000 7f6f5b000640 1 -- 172.21.15.152:0/3498320219 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6f540b3940 con 0x7f6f540af670 2024-04-17T08:47:45.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.221+0000 7f6f50c00640 1 -- 172.21.15.152:0/3498320219 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5207 (secure 0 0 0) 0x7f6f3c0563b0 con 0x7f6f540af670 2024-04-17T08:47:45.222 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:47:45.222 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6834/2461981726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":2461981726},{"type":"v1","addr":"172.21.15.196:6834","nonce":2461981726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6835/3397289430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6833","nonce":3397289430},{"type":"v1","addr":"172.21.15.196:6835","nonce":3397289430}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/2491486613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2491486613},{"type":"v1","addr":"172.21.15.152:6836","nonce":2491486613}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-17T08:46:33.607720+0000","modified":"2024-04-17T08:46:57.830153+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6837/3890159871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":3890159871},{"type":"v1","addr":"172.21.15.152:6837","nonce":3890159871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-04-17T08:47:45.222 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 9 2024-04-17T08:47:45.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.221+0000 7f6f5b000640 1 -- 172.21.15.152:0/3498320219 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f6f30068380 msgr2=0x7f6f3006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:45.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.221+0000 7f6f5b000640 1 --2- 172.21.15.152:0/3498320219 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f6f30068380 0x7f6f3006a840 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6f44001570 tx=0x7f6f44009040 comp rx=0 tx=0).stop 2024-04-17T08:47:45.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.221+0000 7f6f5b000640 1 -- 172.21.15.152:0/3498320219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f540af670 msgr2=0x7f6f540afde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:45.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.221+0000 7f6f5b000640 1 --2- 172.21.15.152:0/3498320219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f540af670 0x7f6f540afde0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c00c410 tx=0x7f6f3c00c8d0 comp rx=0 tx=0).stop 2024-04-17T08:47:45.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.221+0000 7f6f5b000640 1 -- 172.21.15.152:0/3498320219 shutdown_connections 2024-04-17T08:47:45.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.221+0000 7f6f5b000640 1 --2- 172.21.15.152:0/3498320219 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6f540d0360 0x7f6f5414eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:45.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.221+0000 7f6f5b000640 1 --2- 172.21.15.152:0/3498320219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f540af670 0x7f6f540afde0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:45.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.221+0000 7f6f5b000640 1 --2- 172.21.15.152:0/3498320219 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f6f30068380 0x7f6f3006a840 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:45.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.221+0000 7f6f5b000640 1 --2- 172.21.15.152:0/3498320219 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6f5406f980 0x7f6f54153ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:45.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.221+0000 7f6f5b000640 1 -- 172.21.15.152:0/3498320219 >> 172.21.15.152:0/3498320219 conn(0x7f6f540b3350 msgr2=0x7f6f540aea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:45.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.221+0000 7f6f5b000640 1 -- 172.21.15.152:0/3498320219 shutdown_connections 2024-04-17T08:47:45.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.221+0000 7f6f5b000640 1 -- 172.21.15.152:0/3498320219 wait complete. 2024-04-17T08:47:45.246 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T08:47:45.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.377+0000 7f34b8200640 1 Processor -- start 2024-04-17T08:47:45.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.377+0000 7f34b8200640 1 -- start start 2024-04-17T08:47:45.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.381+0000 7f34b8200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f34b0147a90 0x7f34b0071790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:45.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.381+0000 7f34b8200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34b0071cd0 0x7f34b006da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:45.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.381+0000 7f34b8200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34b0162aa0 con 0x7f34b0147690 2024-04-17T08:47:45.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.381+0000 7f34b8200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f34b0162d80 con 0x7f34b0147a90 2024-04-17T08:47:45.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.381+0000 7f34b8200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f34b0163060 con 0x7f34b0071cd0 2024-04-17T08:47:45.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.381+0000 7f34b4e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f34b0147a90 0x7f34b0071790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:45.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.381+0000 7f34b6200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34b0071cd0 0x7f34b006da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:45.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.381+0000 7f34b5800640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f34b0147690 0x7f34b01622e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.152:40446/0 (socket says 172.21.15.152:40446) 2024-04-17T08:47:45.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.381+0000 7f34b5800640 1 -- 172.21.15.152:0/3382923809 learned_addr learned my addr 172.21.15.152:0/3382923809 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:45.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.381+0000 7f34afe00640 1 -- 172.21.15.152:0/3382923809 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 715547857 0 0) 0x7f34b0162aa0 con 0x7f34b0147690 2024-04-17T08:47:45.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.381+0000 7f34afe00640 1 -- 172.21.15.152:0/3382923809 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3498003530 con 0x7f34b0147690 2024-04-17T08:47:45.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.381+0000 7f34b4e00640 1 -- 172.21.15.152:0/3382923809 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34b0071cd0 msgr2=0x7f34b006da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:45.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.381+0000 7f34b4e00640 1 --2- 172.21.15.152:0/3382923809 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34b0071cd0 0x7f34b006da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:45.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.381+0000 7f34b4e00640 1 -- 172.21.15.152:0/3382923809 >> v1:172.21.15.196:6789/0 conn(0x7f34b0147690 legacy=0x7f34b01622e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:45.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.381+0000 7f34b4e00640 1 -- 172.21.15.152:0/3382923809 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34b006d560 con 0x7f34b0147a90 2024-04-17T08:47:45.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.381+0000 7f34b6200640 1 --2- 172.21.15.152:0/3382923809 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34b0071cd0 0x7f34b006da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T08:47:45.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.385+0000 7f34b4e00640 1 --2- 172.21.15.152:0/3382923809 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f34b0147a90 0x7f34b0071790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f349c0097c0 tx=0x7f349c01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb38300e7ed8b0a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:45.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.385+0000 7f34afe00640 1 -- 172.21.15.152:0/3382923809 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f349c0b0070 con 0x7f34b0147a90 2024-04-17T08:47:45.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.385+0000 7f34afe00640 1 -- 172.21.15.152:0/3382923809 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f349c0ab600 con 0x7f34b0147a90 2024-04-17T08:47:45.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.385+0000 7f34afe00640 1 -- 172.21.15.152:0/3382923809 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f349c0ab9d0 con 0x7f34b0147a90 2024-04-17T08:47:45.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.385+0000 7f34b8200640 1 -- 172.21.15.152:0/3382923809 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f34b0147a90 msgr2=0x7f34b0071790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:45.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.385+0000 7f34b8200640 1 --2- 172.21.15.152:0/3382923809 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f34b0147a90 0x7f34b0071790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f349c0097c0 tx=0x7f349c01c4a0 comp rx=0 tx=0).stop 2024-04-17T08:47:45.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.385+0000 7f34b8200640 1 -- 172.21.15.152:0/3382923809 shutdown_connections 2024-04-17T08:47:45.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.385+0000 7f34b8200640 1 --2- 172.21.15.152:0/3382923809 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34b0071cd0 0x7f34b006da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:45.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.385+0000 7f34b8200640 1 --2- 172.21.15.152:0/3382923809 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f34b0147a90 0x7f34b0071790 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:45.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.385+0000 7f34b8200640 1 -- 172.21.15.152:0/3382923809 >> 172.21.15.152:0/3382923809 conn(0x7f34b00d2350 msgr2=0x7f34b00d2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:45.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.385+0000 7f34b8200640 1 -- 172.21.15.152:0/3382923809 shutdown_connections 2024-04-17T08:47:45.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.385+0000 7f34b8200640 1 -- 172.21.15.152:0/3382923809 wait complete. 2024-04-17T08:47:45.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.385+0000 7f34b8200640 1 Processor -- start 2024-04-17T08:47:45.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.385+0000 7f34b8200640 1 -- start start 2024-04-17T08:47:45.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.389+0000 7f34b8200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34b0071cd0 0x7f34b0160630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:45.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.389+0000 7f34b8200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f34b0147690 0x7f34b00cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:45.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.389+0000 7f34b8200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34b0147a90 0x7f34b00ca600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:45.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.389+0000 7f34b8200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f34b006eba0 con 0x7f34b0071cd0 2024-04-17T08:47:45.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.389+0000 7f34b8200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f34b006ea20 con 0x7f34b0147690 2024-04-17T08:47:45.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.389+0000 7f34b8200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f34b006ed20 con 0x7f34b0147a90 2024-04-17T08:47:45.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.389+0000 7f34b5800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34b0071cd0 0x7f34b0160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:45.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.389+0000 7f34b5800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34b0071cd0 0x7f34b0160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60444/0 (socket says 172.21.15.152:60444) 2024-04-17T08:47:45.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.389+0000 7f34b5800640 1 -- 172.21.15.152:0/3429581758 learned_addr learned my addr 172.21.15.152:0/3429581758 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:45.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.389+0000 7f34b4e00640 1 --2- 172.21.15.152:0/3429581758 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f34b0147690 0x7f34b00cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:45.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.389+0000 7f34b6200640 1 --2- 172.21.15.152:0/3429581758 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34b0147a90 0x7f34b00ca600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:45.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.389+0000 7f34b5800640 1 -- 172.21.15.152:0/3429581758 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34b0147a90 msgr2=0x7f34b00ca600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:45.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.389+0000 7f34b5800640 1 --2- 172.21.15.152:0/3429581758 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34b0147a90 0x7f34b00ca600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:45.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.389+0000 7f34b5800640 1 -- 172.21.15.152:0/3429581758 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f34b0147690 msgr2=0x7f34b00cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:45.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.389+0000 7f34b5800640 1 --2- 172.21.15.152:0/3429581758 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f34b0147690 0x7f34b00cdcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:45.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.389+0000 7f34b5800640 1 -- 172.21.15.152:0/3429581758 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34b0161c60 con 0x7f34b0071cd0 2024-04-17T08:47:45.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.389+0000 7f34b5800640 1 --2- 172.21.15.152:0/3429581758 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34b0071cd0 0x7f34b0160630 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f34a400c480 tx=0x7f34a400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:45.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.389+0000 7f34ad600640 1 -- 172.21.15.152:0/3429581758 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a4017070 con 0x7f34b0071cd0 2024-04-17T08:47:45.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.389+0000 7f34ad600640 1 -- 172.21.15.152:0/3429581758 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34a4005cf0 con 0x7f34b0071cd0 2024-04-17T08:47:45.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.389+0000 7f34ad600640 1 -- 172.21.15.152:0/3429581758 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a4007290 con 0x7f34b0071cd0 2024-04-17T08:47:45.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.389+0000 7f34b8200640 1 -- 172.21.15.152:0/3429581758 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34b015cce0 con 0x7f34b0071cd0 2024-04-17T08:47:45.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.389+0000 7f34b8200640 1 -- 172.21.15.152:0/3429581758 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34b015d2a0 con 0x7f34b0071cd0 2024-04-17T08:47:45.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.389+0000 7f34b8200640 1 -- 172.21.15.152:0/3429581758 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34b0068a30 con 0x7f34b0071cd0 2024-04-17T08:47:45.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.393+0000 7f34ad600640 1 -- 172.21.15.152:0/3429581758 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f34a401a070 con 0x7f34b0071cd0 2024-04-17T08:47:45.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.393+0000 7f34ad600640 1 --2- 172.21.15.152:0/3429581758 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3490068380 0x7f349006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:45.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.393+0000 7f34ad600640 1 -- 172.21.15.152:0/3429581758 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f34a40861b0 con 0x7f34b0071cd0 2024-04-17T08:47:45.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.393+0000 7f34b4e00640 1 --2- 172.21.15.152:0/3429581758 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3490068380 0x7f349006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:45.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.393+0000 7f34b4e00640 1 --2- 172.21.15.152:0/3429581758 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3490068380 0x7f349006a840 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f349c0ad000 tx=0x7f349c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:45.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.397+0000 7f34ad600640 1 -- 172.21.15.152:0/3429581758 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f34a4055ce0 con 0x7f34b0071cd0 2024-04-17T08:47:45.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.557+0000 7f34b8200640 1 -- 172.21.15.152:0/3429581758 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f34b00b3690 con 0x7f34b0071cd0 2024-04-17T08:47:45.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.557+0000 7f34ad600640 1 -- 172.21.15.152:0/3429581758 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18972 (secure 0 0 0) 0x7f34a4059fe0 con 0x7f34b0071cd0 2024-04-17T08:47:45.560 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:47:45.560 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":26,"fsid":"ce68f82e-ec5f-4205-9fd5-bdfdf6ef31e2","created":"2024-04-17T08:46:08.353546+0000","modified":"2024-04-17T08:47:15.280634+0000","last_up_change":"2024-04-17T08:46:20.738799+0000","last_in_change":"2024-04-17T08:46:11.210050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T08:46:21.386856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T08:46:31.812460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T08:46:32.555559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T08:46:36.258078+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"682f0192-187c-404e-bc7a-b6b4e23825e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6819","nonce":3603799291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6823","nonce":3603799291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6831","nonce":3603799291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6827","nonce":3603799291}]},"public_addr":"172.21.15.152:6819/3603799291","cluster_addr":"172.21.15.152:6823/3603799291","heartbeat_back_addr":"172.21.15.152:6831/3603799291","heartbeat_front_addr":"172.21.15.152:6827/3603799291","state":["exists","up"]},{"osd":1,"uuid":"f0fe8fef-60ec-4a39-83b6-2fa6a5adb0f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6801","nonce":4133383142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6803","nonce":4133383142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6807","nonce":4133383142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6805","nonce":4133383142}]},"public_addr":"172.21.15.152:6801/4133383142","cluster_addr":"172.21.15.152:6803/4133383142","heartbeat_back_addr":"172.21.15.152:6807/4133383142","heartbeat_front_addr":"172.21.15.152:6805/4133383142","state":["exists","up"]},{"osd":2,"uuid":"35f36d9c-5245-4431-a618-f4df0fa380ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6809","nonce":3826143898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6811","nonce":3826143898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6815","nonce":3826143898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6813","nonce":3826143898}]},"public_addr":"172.21.15.152:6809/3826143898","cluster_addr":"172.21.15.152:6811/3826143898","heartbeat_back_addr":"172.21.15.152:6815/3826143898","heartbeat_front_addr":"172.21.15.152:6813/3826143898","state":["exists","up"]},{"osd":3,"uuid":"96e56ca5-15b4-4895-9b79-da2c92043159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6818","nonce":165717826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6822","nonce":165717826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6830","nonce":165717826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6826","nonce":165717826}]},"public_addr":"172.21.15.152:6818/165717826","cluster_addr":"172.21.15.152:6822/165717826","heartbeat_back_addr":"172.21.15.152:6830/165717826","heartbeat_front_addr":"172.21.15.152:6826/165717826","state":["exists","up"]},{"osd":4,"uuid":"f5aa10a4-9ff9-41fe-a5c9-15326f982cc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6817","nonce":4080159297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6819","nonce":4080159297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6823","nonce":4080159297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6821","nonce":4080159297}]},"public_addr":"172.21.15.196:6817/4080159297","cluster_addr":"172.21.15.196:6819/4080159297","heartbeat_back_addr":"172.21.15.196:6823/4080159297","heartbeat_front_addr":"172.21.15.196:6821/4080159297","state":["exists","up"]},{"osd":5,"uuid":"42bab884-3476-47ae-ac65-935fa6e0f055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6801","nonce":3519444232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6803","nonce":3519444232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6807","nonce":3519444232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6805","nonce":3519444232}]},"public_addr":"172.21.15.196:6801/3519444232","cluster_addr":"172.21.15.196:6803/3519444232","heartbeat_back_addr":"172.21.15.196:6807/3519444232","heartbeat_front_addr":"172.21.15.196:6805/3519444232","state":["exists","up"]},{"osd":6,"uuid":"460b6167-f57b-4224-9c92-cfc9b80bbe99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6809","nonce":275739834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6811","nonce":275739834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6815","nonce":275739834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6813","nonce":275739834}]},"public_addr":"172.21.15.196:6809/275739834","cluster_addr":"172.21.15.196:6811/275739834","heartbeat_back_addr":"172.21.15.196:6815/275739834","heartbeat_front_addr":"172.21.15.196:6813/275739834","state":["exists","up"]},{"osd":7,"uuid":"d695643f-5e07-4e2a-a646-c06bd97b6650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6825","nonce":307626968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6827","nonce":307626968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6831","nonce":307626968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6829","nonce":307626968}]},"public_addr":"172.21.15.196:6825/307626968","cluster_addr":"172.21.15.196:6827/307626968","heartbeat_back_addr":"172.21.15.196:6831/307626968","heartbeat_front_addr":"172.21.15.196:6829/307626968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.293257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.964533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.248895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.010000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.832554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.743704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930171+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930962+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T08:47:45.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.557+0000 7f34b8200640 1 -- 172.21.15.152:0/3429581758 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3490068380 msgr2=0x7f349006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:45.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.557+0000 7f34b8200640 1 --2- 172.21.15.152:0/3429581758 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3490068380 0x7f349006a840 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f349c0ad000 tx=0x7f349c008040 comp rx=0 tx=0).stop 2024-04-17T08:47:45.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.557+0000 7f34b8200640 1 -- 172.21.15.152:0/3429581758 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34b0071cd0 msgr2=0x7f34b0160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:45.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.557+0000 7f34b8200640 1 --2- 172.21.15.152:0/3429581758 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34b0071cd0 0x7f34b0160630 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f34a400c480 tx=0x7f34a400c940 comp rx=0 tx=0).stop 2024-04-17T08:47:45.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.561+0000 7f34b8200640 1 -- 172.21.15.152:0/3429581758 shutdown_connections 2024-04-17T08:47:45.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.561+0000 7f34b8200640 1 --2- 172.21.15.152:0/3429581758 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3490068380 0x7f349006a840 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:45.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.561+0000 7f34b8200640 1 --2- 172.21.15.152:0/3429581758 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34b0147a90 0x7f34b00ca600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:45.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.561+0000 7f34b8200640 1 --2- 172.21.15.152:0/3429581758 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f34b0147690 0x7f34b00cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:45.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.561+0000 7f34b8200640 1 --2- 172.21.15.152:0/3429581758 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34b0071cd0 0x7f34b0160630 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:45.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.561+0000 7f34b8200640 1 -- 172.21.15.152:0/3429581758 >> 172.21.15.152:0/3429581758 conn(0x7f34b00d2350 msgr2=0x7f34b00d2730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:45.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.561+0000 7f34b8200640 1 -- 172.21.15.152:0/3429581758 shutdown_connections 2024-04-17T08:47:45.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.561+0000 7f34b8200640 1 -- 172.21.15.152:0/3429581758 wait complete. 2024-04-17T08:47:45.581 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T08:46:21.386856+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-17T08:46:31.812460+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-17T08:46:32.555559+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-17T08:46:36.258078+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-17T08:47:45.581 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T08:47:45.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.717+0000 7f9117800640 1 Processor -- start 2024-04-17T08:47:45.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.717+0000 7f9117800640 1 -- start start 2024-04-17T08:47:45.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.717+0000 7f9117800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f91100af670 0x7f911015b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:45.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.717+0000 7f9117800640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9110072c40 con 0x7f911006f980 2024-04-17T08:47:45.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.717+0000 7f9117800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f911015c260 con 0x7f91100d0360 2024-04-17T08:47:45.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.717+0000 7f9117800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f911015c820 con 0x7f91100af670 2024-04-17T08:47:45.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.717+0000 7f9107e00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f911006f980 0x7f9110072530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:54366/0 (socket says 172.21.15.152:54366) 2024-04-17T08:47:45.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.717+0000 7f9107e00640 1 -- 172.21.15.152:0/975896303 learned_addr learned my addr 172.21.15.152:0/975896303 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:45.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.717+0000 7f9114e00640 1 --2- 172.21.15.152:0/975896303 >> v2:172.21.15.196:3300/0 conn(0x7f91100af670 0x7f911015b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:45.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.717+0000 7f910fe00640 1 -- 172.21.15.152:0/975896303 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3653994792 0 0) 0x7f9110072c40 con 0x7f911006f980 2024-04-17T08:47:45.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.717+0000 7f910fe00640 1 -- 172.21.15.152:0/975896303 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90f4003530 con 0x7f911006f980 2024-04-17T08:47:45.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.717+0000 7f9114e00640 1 -- 172.21.15.152:0/975896303 >> v1:172.21.15.196:6789/0 conn(0x7f91100d0360 legacy=0x7f911006dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:45.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.717+0000 7f9114e00640 1 -- 172.21.15.152:0/975896303 >> v1:172.21.15.152:6789/0 conn(0x7f911006f980 legacy=0x7f9110072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:45.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.717+0000 7f9114e00640 1 -- 172.21.15.152:0/975896303 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f911015c540 con 0x7f91100af670 2024-04-17T08:47:45.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.721+0000 7f9114e00640 1 --2- 172.21.15.152:0/975896303 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f91100af670 0x7f911015b8c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f91000097c0 tx=0x7f910001c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6379707f65ad2ffd server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:45.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.721+0000 7f910fe00640 1 -- 172.21.15.152:0/975896303 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91000b1070 con 0x7f91100af670 2024-04-17T08:47:45.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.721+0000 7f910fe00640 1 -- 172.21.15.152:0/975896303 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91000a8050 con 0x7f91100af670 2024-04-17T08:47:45.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.721+0000 7f910fe00640 1 -- 172.21.15.152:0/975896303 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91000ac860 con 0x7f91100af670 2024-04-17T08:47:45.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.721+0000 7f9117800640 1 -- 172.21.15.152:0/975896303 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f91100af670 msgr2=0x7f911015b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:45.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.721+0000 7f9117800640 1 --2- 172.21.15.152:0/975896303 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f91100af670 0x7f911015b8c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f91000097c0 tx=0x7f910001c3e0 comp rx=0 tx=0).stop 2024-04-17T08:47:45.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.721+0000 7f9117800640 1 -- 172.21.15.152:0/975896303 shutdown_connections 2024-04-17T08:47:45.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.721+0000 7f9117800640 1 --2- 172.21.15.152:0/975896303 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f91100af670 0x7f911015b8c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:45.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.721+0000 7f9117800640 1 -- 172.21.15.152:0/975896303 >> 172.21.15.152:0/975896303 conn(0x7f91100b3350 msgr2=0x7f91100b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:45.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.721+0000 7f9117800640 1 -- 172.21.15.152:0/975896303 shutdown_connections 2024-04-17T08:47:45.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.721+0000 7f9117800640 1 -- 172.21.15.152:0/975896303 wait complete. 2024-04-17T08:47:45.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.725+0000 7f9117800640 1 Processor -- start 2024-04-17T08:47:45.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.725+0000 7f9117800640 1 -- start start 2024-04-17T08:47:45.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.725+0000 7f9117800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f911006f980 0x7f9110155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:45.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.725+0000 7f9117800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f91100af670 0x7f91101526d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:45.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.725+0000 7f9117800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91100d0360 0x7f9110154df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:45.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.725+0000 7f9117800640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f91100d0b80 con 0x7f91100d0360 2024-04-17T08:47:45.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.725+0000 7f9117800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f911015be00 con 0x7f91100af670 2024-04-17T08:47:45.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.725+0000 7f9117800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f9110157580 con 0x7f911006f980 2024-04-17T08:47:45.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.725+0000 7f9115800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91100d0360 0x7f9110154df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:45.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.725+0000 7f9115800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91100d0360 0x7f9110154df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60450/0 (socket says 172.21.15.152:60450) 2024-04-17T08:47:45.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.725+0000 7f9115800640 1 -- 172.21.15.152:0/3509820623 learned_addr learned my addr 172.21.15.152:0/3509820623 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:45.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.725+0000 7f9107e00640 1 --2- 172.21.15.152:0/3509820623 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f91100af670 0x7f91101526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:45.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.725+0000 7f9114e00640 1 --2- 172.21.15.152:0/3509820623 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f911006f980 0x7f9110155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:45.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.725+0000 7f9115800640 1 -- 172.21.15.152:0/3509820623 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f911006f980 msgr2=0x7f9110155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:45.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.725+0000 7f9115800640 1 --2- 172.21.15.152:0/3509820623 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f911006f980 0x7f9110155f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:45.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.725+0000 7f9115800640 1 -- 172.21.15.152:0/3509820623 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f91100af670 msgr2=0x7f91101526d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:45.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.725+0000 7f9115800640 1 --2- 172.21.15.152:0/3509820623 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f91100af670 0x7f91101526d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:45.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.725+0000 7f9115800640 1 -- 172.21.15.152:0/3509820623 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9110157fe0 con 0x7f91100d0360 2024-04-17T08:47:45.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.725+0000 7f9115800640 1 --2- 172.21.15.152:0/3509820623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91100d0360 0x7f9110154df0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f910800c770 tx=0x7f910800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:45.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.725+0000 7f910d600640 1 -- 172.21.15.152:0/3509820623 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9108003b80 con 0x7f91100d0360 2024-04-17T08:47:45.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.725+0000 7f910d600640 1 -- 172.21.15.152:0/3509820623 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9108003d20 con 0x7f91100d0360 2024-04-17T08:47:45.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.725+0000 7f910d600640 1 -- 172.21.15.152:0/3509820623 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f910800aa90 con 0x7f91100d0360 2024-04-17T08:47:45.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.725+0000 7f9117800640 1 -- 172.21.15.152:0/3509820623 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91101564e0 con 0x7f91100d0360 2024-04-17T08:47:45.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.725+0000 7f9117800640 1 -- 172.21.15.152:0/3509820623 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9110156aa0 con 0x7f91100d0360 2024-04-17T08:47:45.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.729+0000 7f9117800640 1 -- 172.21.15.152:0/3509820623 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9110068a30 con 0x7f91100d0360 2024-04-17T08:47:45.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.729+0000 7f910d600640 1 -- 172.21.15.152:0/3509820623 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f910800ac30 con 0x7f91100d0360 2024-04-17T08:47:45.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.729+0000 7f910d600640 1 --2- 172.21.15.152:0/3509820623 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f90ec068380 0x7f90ec06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:45.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.729+0000 7f910d600640 1 -- 172.21.15.152:0/3509820623 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f9108086ba0 con 0x7f91100d0360 2024-04-17T08:47:45.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.729+0000 7f9114e00640 1 --2- 172.21.15.152:0/3509820623 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f90ec068380 0x7f90ec06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:45.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.729+0000 7f9114e00640 1 --2- 172.21.15.152:0/3509820623 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f90ec068380 0x7f90ec06a840 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f91000ae000 tx=0x7f91000a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:45.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.733+0000 7f910d600640 1 -- 172.21.15.152:0/3509820623 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f9110157fe0 con 0x7f91100d0360 2024-04-17T08:47:45.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.889+0000 7f9117800640 1 -- 172.21.15.152:0/3509820623 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f911006cf10 con 0x7f91100d0360 2024-04-17T08:47:45.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.889+0000 7f910d600640 1 -- 172.21.15.152:0/3509820623 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f91080566e0 con 0x7f91100d0360 2024-04-17T08:47:45.892 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2024-04-17T08:47:45.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.893+0000 7f9117800640 1 -- 172.21.15.152:0/3509820623 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f90ec068380 msgr2=0x7f90ec06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:45.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.893+0000 7f9117800640 1 --2- 172.21.15.152:0/3509820623 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f90ec068380 0x7f90ec06a840 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f91000ae000 tx=0x7f91000a7000 comp rx=0 tx=0).stop 2024-04-17T08:47:45.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.893+0000 7f9117800640 1 -- 172.21.15.152:0/3509820623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91100d0360 msgr2=0x7f9110154df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:45.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.893+0000 7f9117800640 1 --2- 172.21.15.152:0/3509820623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91100d0360 0x7f9110154df0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f910800c770 tx=0x7f910800cc30 comp rx=0 tx=0).stop 2024-04-17T08:47:45.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.893+0000 7f9117800640 1 -- 172.21.15.152:0/3509820623 shutdown_connections 2024-04-17T08:47:45.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.893+0000 7f9117800640 1 --2- 172.21.15.152:0/3509820623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91100d0360 0x7f9110154df0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:45.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.893+0000 7f9117800640 1 --2- 172.21.15.152:0/3509820623 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f91100af670 0x7f91101526d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:45.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.893+0000 7f9117800640 1 --2- 172.21.15.152:0/3509820623 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f90ec068380 0x7f90ec06a840 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:45.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.893+0000 7f9117800640 1 --2- 172.21.15.152:0/3509820623 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f911006f980 0x7f9110155f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:45.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.893+0000 7f9117800640 1 -- 172.21.15.152:0/3509820623 >> 172.21.15.152:0/3509820623 conn(0x7f91100b3350 msgr2=0x7f91100aec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:45.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.893+0000 7f9117800640 1 -- 172.21.15.152:0/3509820623 shutdown_connections 2024-04-17T08:47:45.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:45.893+0000 7f9117800640 1 -- 172.21.15.152:0/3509820623 wait complete. 2024-04-17T08:47:45.913 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-17T08:47:46.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.049+0000 7f27f2e00640 1 Processor -- start 2024-04-17T08:47:46.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.049+0000 7f27f2e00640 1 -- start start 2024-04-17T08:47:46.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.049+0000 7f27f2e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f27ec0af670 0x7f27ec15b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:46.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.049+0000 7f27f2e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f27ec06f980 0x7f27ec072530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:46.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.049+0000 7f27f2e00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27ec15c260 con 0x7f27ec0d0360 2024-04-17T08:47:46.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.049+0000 7f27f2e00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f27ec15c820 con 0x7f27ec0af670 2024-04-17T08:47:46.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.049+0000 7f27f2e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f27ec15c540 con 0x7f27ec06f980 2024-04-17T08:47:46.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.049+0000 7f27f0e00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f27ec0d0360 0x7f27ec06dc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:54378/0 (socket says 172.21.15.152:54378) 2024-04-17T08:47:46.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.049+0000 7f27f0e00640 1 -- 172.21.15.152:0/3883671786 learned_addr learned my addr 172.21.15.152:0/3883671786 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:46.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.049+0000 7f27ebe00640 1 --2- 172.21.15.152:0/3883671786 >> v2:172.21.15.196:3300/0 conn(0x7f27ec0af670 0x7f27ec15b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:46.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.049+0000 7f27e3400640 1 --2- 172.21.15.152:0/3883671786 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f27ec06f980 0x7f27ec072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:46.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.053+0000 7f27eb400640 1 -- 172.21.15.152:0/3883671786 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1705786918 0 0) 0x7f27ec15c260 con 0x7f27ec0d0360 2024-04-17T08:47:46.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.053+0000 7f27eb400640 1 -- 172.21.15.152:0/3883671786 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27d0003530 con 0x7f27ec0d0360 2024-04-17T08:47:46.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.053+0000 7f27eb400640 1 -- 172.21.15.152:0/3883671786 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3343396703 0 0) 0x7f27d0003530 con 0x7f27ec0d0360 2024-04-17T08:47:46.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.053+0000 7f27eb400640 1 -- 172.21.15.152:0/3883671786 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f27ec06f980 msgr2=0x7f27ec072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:46.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.053+0000 7f27eb400640 1 --2- 172.21.15.152:0/3883671786 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f27ec06f980 0x7f27ec072530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:46.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.053+0000 7f27eb400640 1 -- 172.21.15.152:0/3883671786 >> v2:172.21.15.196:3300/0 conn(0x7f27ec0af670 msgr2=0x7f27ec15b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:46.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.053+0000 7f27eb400640 1 --2- 172.21.15.152:0/3883671786 >> v2:172.21.15.196:3300/0 conn(0x7f27ec0af670 0x7f27ec15b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:46.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.053+0000 7f27eb400640 1 -- 172.21.15.152:0/3883671786 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27ec071d30 con 0x7f27ec0d0360 2024-04-17T08:47:46.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.053+0000 7f27eb400640 1 -- 172.21.15.152:0/3883671786 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2973887244 0 0) 0x7f27e4001680 con 0x7f27ec0d0360 2024-04-17T08:47:46.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.053+0000 7f27ebe00640 1 --2- 172.21.15.152:0/3883671786 >> v2:172.21.15.196:3300/0 conn(0x7f27ec0af670 0x7f27ec15b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T08:47:46.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.053+0000 7f27eb400640 1 -- 172.21.15.152:0/3883671786 >> v1:172.21.15.152:6789/0 conn(0x7f27ec0d0360 legacy=0x7f27ec06dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:46.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.053+0000 7f27eb400640 1 --2- 172.21.15.152:0/3883671786 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27d00039c0 0x7f27d0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:46.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.053+0000 7f27eb400640 1 --2- 172.21.15.152:0/3883671786 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f27ec06f980 0x7f27d0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:46.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.053+0000 7f27eb400640 1 --2- 172.21.15.152:0/3883671786 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f27d0004d50 0x7f27d00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:46.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.053+0000 7f27eb400640 1 -- 172.21.15.152:0/3883671786 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f27ec15c820 con 0x7f27d00039c0 2024-04-17T08:47:46.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.053+0000 7f27eb400640 1 -- 172.21.15.152:0/3883671786 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f27ec15c540 con 0x7f27d0004d50 2024-04-17T08:47:46.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.053+0000 7f27eb400640 1 -- 172.21.15.152:0/3883671786 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f27d000b9d0 con 0x7f27ec06f980 2024-04-17T08:47:46.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.053+0000 7f27ebe00640 1 --2- 172.21.15.152:0/3883671786 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27d00039c0 0x7f27d0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:46.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.053+0000 7f27e3400640 1 --2- 172.21.15.152:0/3883671786 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f27ec06f980 0x7f27d0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:46.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.053+0000 7f27f0e00640 1 --2- 172.21.15.152:0/3883671786 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f27d0004d50 0x7f27d00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:46.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.053+0000 7f27ebe00640 1 -- 172.21.15.152:0/3883671786 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f27ec06f980 msgr2=0x7f27d0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:46.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.053+0000 7f27ebe00640 1 --2- 172.21.15.152:0/3883671786 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f27ec06f980 0x7f27d0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:46.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.053+0000 7f27ebe00640 1 -- 172.21.15.152:0/3883671786 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f27d0004d50 msgr2=0x7f27d00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:46.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.053+0000 7f27ebe00640 1 --2- 172.21.15.152:0/3883671786 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f27d0004d50 0x7f27d00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:46.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.053+0000 7f27ebe00640 1 -- 172.21.15.152:0/3883671786 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27d0003530 con 0x7f27d00039c0 2024-04-17T08:47:46.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.053+0000 7f27e3400640 1 --2- 172.21.15.152:0/3883671786 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f27ec06f980 0x7f27d0004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:46.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.057+0000 7f27ebe00640 1 --2- 172.21.15.152:0/3883671786 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27d00039c0 0x7f27d0003de0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f27dc0104c0 tx=0x7f27dc01f050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a303463bcbead6c server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:46.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.057+0000 7f27eb400640 1 -- 172.21.15.152:0/3883671786 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27dc0b3070 con 0x7f27d00039c0 2024-04-17T08:47:46.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.057+0000 7f27eb400640 1 -- 172.21.15.152:0/3883671786 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27dc00b2d0 con 0x7f27d00039c0 2024-04-17T08:47:46.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.057+0000 7f27eb400640 1 -- 172.21.15.152:0/3883671786 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27dc010140 con 0x7f27d00039c0 2024-04-17T08:47:46.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.057+0000 7f27f2e00640 1 -- 172.21.15.152:0/3883671786 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27d00039c0 msgr2=0x7f27d0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:46.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.057+0000 7f27f2e00640 1 --2- 172.21.15.152:0/3883671786 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27d00039c0 0x7f27d0003de0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f27dc0104c0 tx=0x7f27dc01f050 comp rx=0 tx=0).stop 2024-04-17T08:47:46.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.057+0000 7f27f0e00640 1 -- 172.21.15.152:0/3883671786 reap_dead start 2024-04-17T08:47:46.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.057+0000 7f27f2e00640 1 -- 172.21.15.152:0/3883671786 shutdown_connections 2024-04-17T08:47:46.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.057+0000 7f27f2e00640 1 -- 172.21.15.152:0/3883671786 >> 172.21.15.152:0/3883671786 conn(0x7f27ec0b3350 msgr2=0x7f27ec0b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:46.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.057+0000 7f27f2e00640 1 -- 172.21.15.152:0/3883671786 shutdown_connections 2024-04-17T08:47:46.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.057+0000 7f27f2e00640 1 -- 172.21.15.152:0/3883671786 wait complete. 2024-04-17T08:47:46.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.057+0000 7f27f2e00640 1 Processor -- start 2024-04-17T08:47:46.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.057+0000 7f27f2e00640 1 -- start start 2024-04-17T08:47:46.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.057+0000 7f27f2e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f27d00039c0 0x7f27ec14f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:46.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.057+0000 7f27f2e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27ec1fbc10 0x7f27ec156300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:46.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.057+0000 7f27f2e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f27ec0ae600 0x7f27ec0afcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:46.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.057+0000 7f27f2e00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f27ec15bf80 con 0x7f27ec1fbc10 2024-04-17T08:47:46.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.057+0000 7f27f2e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f27ec15be00 con 0x7f27d00039c0 2024-04-17T08:47:46.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.057+0000 7f27f2e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f27ec06b9b0 con 0x7f27ec0ae600 2024-04-17T08:47:46.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.057+0000 7f27e3400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27ec1fbc10 0x7f27ec156300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:46.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.061+0000 7f27e3400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27ec1fbc10 0x7f27ec156300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60468/0 (socket says 172.21.15.152:60468) 2024-04-17T08:47:46.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.061+0000 7f27e3400640 1 -- 172.21.15.152:0/1870571823 learned_addr learned my addr 172.21.15.152:0/1870571823 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:46.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.061+0000 7f27f0e00640 1 --2- 172.21.15.152:0/1870571823 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f27ec0ae600 0x7f27ec0afcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:46.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.061+0000 7f27ebe00640 1 --2- 172.21.15.152:0/1870571823 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f27d00039c0 0x7f27ec14f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:46.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.061+0000 7f27e3400640 1 -- 172.21.15.152:0/1870571823 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f27ec0ae600 msgr2=0x7f27ec0afcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:46.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.061+0000 7f27e3400640 1 --2- 172.21.15.152:0/1870571823 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f27ec0ae600 0x7f27ec0afcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:46.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.061+0000 7f27e3400640 1 -- 172.21.15.152:0/1870571823 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f27d00039c0 msgr2=0x7f27ec14f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:46.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.061+0000 7f27e3400640 1 --2- 172.21.15.152:0/1870571823 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f27d00039c0 0x7f27ec14f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:46.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.061+0000 7f27e3400640 1 -- 172.21.15.152:0/1870571823 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27ec153290 con 0x7f27ec1fbc10 2024-04-17T08:47:46.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.061+0000 7f27e3400640 1 --2- 172.21.15.152:0/1870571823 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27ec1fbc10 0x7f27ec156300 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f27d40116a0 tx=0x7f27d4011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:46.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.061+0000 7f27e8c00640 1 -- 172.21.15.152:0/1870571823 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d4004220 con 0x7f27ec1fbc10 2024-04-17T08:47:46.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.061+0000 7f27e8c00640 1 -- 172.21.15.152:0/1870571823 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27d40043c0 con 0x7f27ec1fbc10 2024-04-17T08:47:46.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.061+0000 7f27f2e00640 1 -- 172.21.15.152:0/1870571823 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27ec153570 con 0x7f27ec1fbc10 2024-04-17T08:47:46.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.061+0000 7f27e8c00640 1 -- 172.21.15.152:0/1870571823 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d4015870 con 0x7f27ec1fbc10 2024-04-17T08:47:46.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.061+0000 7f27f2e00640 1 -- 172.21.15.152:0/1870571823 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27ec153b30 con 0x7f27ec1fbc10 2024-04-17T08:47:46.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.061+0000 7f27f2e00640 1 -- 172.21.15.152:0/1870571823 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27ec068a30 con 0x7f27ec1fbc10 2024-04-17T08:47:46.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.061+0000 7f27e8c00640 1 -- 172.21.15.152:0/1870571823 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f27d4015a10 con 0x7f27ec1fbc10 2024-04-17T08:47:46.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.065+0000 7f27e8c00640 1 --2- 172.21.15.152:0/1870571823 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f27c80683b0 0x7f27c806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:46.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.065+0000 7f27e8c00640 1 -- 172.21.15.152:0/1870571823 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f27d4087400 con 0x7f27ec1fbc10 2024-04-17T08:47:46.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.065+0000 7f27ebe00640 1 --2- 172.21.15.152:0/1870571823 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f27c80683b0 0x7f27c806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:46.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.065+0000 7f27ebe00640 1 --2- 172.21.15.152:0/1870571823 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f27c80683b0 0x7f27c806a870 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f27dc0b0000 tx=0x7f27dc004ac0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:46.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.069+0000 7f27e8c00640 1 -- 172.21.15.152:0/1870571823 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f27d4019030 con 0x7f27ec1fbc10 2024-04-17T08:47:46.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.221+0000 7f27f2e00640 1 -- 172.21.15.152:0/1870571823 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f27ec06cc30 con 0x7f27ec1fbc10 2024-04-17T08:47:46.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.225+0000 7f27e8c00640 1 -- 172.21.15.152:0/1870571823 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f27d4056ec0 con 0x7f27ec1fbc10 2024-04-17T08:47:46.226 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-04-17T08:47:46.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.225+0000 7f27f2e00640 1 -- 172.21.15.152:0/1870571823 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f27c80683b0 msgr2=0x7f27c806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:46.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.225+0000 7f27f2e00640 1 --2- 172.21.15.152:0/1870571823 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f27c80683b0 0x7f27c806a870 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f27dc0b0000 tx=0x7f27dc004ac0 comp rx=0 tx=0).stop 2024-04-17T08:47:46.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.225+0000 7f27f2e00640 1 -- 172.21.15.152:0/1870571823 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27ec1fbc10 msgr2=0x7f27ec156300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:46.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.225+0000 7f27f2e00640 1 --2- 172.21.15.152:0/1870571823 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27ec1fbc10 0x7f27ec156300 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f27d40116a0 tx=0x7f27d4011aa0 comp rx=0 tx=0).stop 2024-04-17T08:47:46.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.225+0000 7f27f2e00640 1 -- 172.21.15.152:0/1870571823 shutdown_connections 2024-04-17T08:47:46.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.225+0000 7f27f2e00640 1 --2- 172.21.15.152:0/1870571823 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f27c80683b0 0x7f27c806a870 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:46.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.225+0000 7f27f2e00640 1 --2- 172.21.15.152:0/1870571823 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f27ec0ae600 0x7f27ec0afcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:46.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.225+0000 7f27f2e00640 1 --2- 172.21.15.152:0/1870571823 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27ec1fbc10 0x7f27ec156300 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:46.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.225+0000 7f27f2e00640 1 --2- 172.21.15.152:0/1870571823 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f27d00039c0 0x7f27ec14f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:46.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.225+0000 7f27f2e00640 1 -- 172.21.15.152:0/1870571823 >> 172.21.15.152:0/1870571823 conn(0x7f27ec0b3350 msgr2=0x7f27ec151560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:46.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.225+0000 7f27f2e00640 1 -- 172.21.15.152:0/1870571823 shutdown_connections 2024-04-17T08:47:46.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.225+0000 7f27f2e00640 1 -- 172.21.15.152:0/1870571823 wait complete. 2024-04-17T08:47:46.249 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-17T08:47:46.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.385+0000 7fd5edc00640 1 Processor -- start 2024-04-17T08:47:46.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.385+0000 7fd5edc00640 1 -- start start 2024-04-17T08:47:46.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.385+0000 7fd5edc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd5e806f980 0x7fd5e8072530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:46.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.385+0000 7fd5edc00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd5e80d0360 0x7fd5e80d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:46.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.385+0000 7fd5edc00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5e815bfd0 con 0x7fd5e80af670 2024-04-17T08:47:46.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.385+0000 7fd5edc00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fd5e815c820 con 0x7fd5e80d0360 2024-04-17T08:47:46.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.385+0000 7fd5edc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fd5e815c260 con 0x7fd5e806f980 2024-04-17T08:47:46.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.385+0000 7fd5e7400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd5e80d0360 0x7fd5e80d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:46.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.385+0000 7fd5e6a00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fd5e80af670 0x7fd5e815b8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:54388/0 (socket says 172.21.15.152:54388) 2024-04-17T08:47:46.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.385+0000 7fd5e7400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd5e80d0360 0x7fd5e80d07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60480/0 (socket says 172.21.15.152:60480) 2024-04-17T08:47:46.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.385+0000 7fd5e6a00640 1 -- 172.21.15.152:0/2108428352 learned_addr learned my addr 172.21.15.152:0/2108428352 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:46.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.385+0000 7fd5de000640 1 --2- 172.21.15.152:0/2108428352 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd5e806f980 0x7fd5e8072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:46.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.389+0000 7fd5e7400640 1 -- 172.21.15.152:0/2108428352 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd5e806f980 msgr2=0x7fd5e8072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:46.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.389+0000 7fd5e7400640 1 --2- 172.21.15.152:0/2108428352 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd5e806f980 0x7fd5e8072530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:46.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.389+0000 7fd5e7400640 1 -- 172.21.15.152:0/2108428352 >> v1:172.21.15.152:6789/0 conn(0x7fd5e80af670 legacy=0x7fd5e815b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:46.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.389+0000 7fd5e7400640 1 -- 172.21.15.152:0/2108428352 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5e815c540 con 0x7fd5e80d0360 2024-04-17T08:47:46.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.389+0000 7fd5e7400640 1 --2- 172.21.15.152:0/2108428352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5e80d0360 0x7fd5e80d07f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0009d90 tx=0x7fd5e001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5f8cce86aca0326 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:46.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.389+0000 7fd5e6000640 1 -- 172.21.15.152:0/2108428352 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e00b2070 con 0x7fd5e80d0360 2024-04-17T08:47:46.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.389+0000 7fd5e6000640 1 -- 172.21.15.152:0/2108428352 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5e00a5890 con 0x7fd5e80d0360 2024-04-17T08:47:46.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.389+0000 7fd5e6000640 1 -- 172.21.15.152:0/2108428352 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e00a5c60 con 0x7fd5e80d0360 2024-04-17T08:47:46.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.389+0000 7fd5edc00640 1 -- 172.21.15.152:0/2108428352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5e80d0360 msgr2=0x7fd5e80d07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:46.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.389+0000 7fd5edc00640 1 --2- 172.21.15.152:0/2108428352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5e80d0360 0x7fd5e80d07f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0009d90 tx=0x7fd5e001c8e0 comp rx=0 tx=0).stop 2024-04-17T08:47:46.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.389+0000 7fd5edc00640 1 -- 172.21.15.152:0/2108428352 shutdown_connections 2024-04-17T08:47:46.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.389+0000 7fd5edc00640 1 --2- 172.21.15.152:0/2108428352 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd5e806f980 0x7fd5e8072530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:46.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.389+0000 7fd5edc00640 1 --2- 172.21.15.152:0/2108428352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5e80d0360 0x7fd5e80d07f0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:46.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.389+0000 7fd5edc00640 1 -- 172.21.15.152:0/2108428352 >> 172.21.15.152:0/2108428352 conn(0x7fd5e80b3350 msgr2=0x7fd5e80b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:46.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.389+0000 7fd5edc00640 1 -- 172.21.15.152:0/2108428352 shutdown_connections 2024-04-17T08:47:46.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.389+0000 7fd5edc00640 1 -- 172.21.15.152:0/2108428352 wait complete. 2024-04-17T08:47:46.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.393+0000 7fd5edc00640 1 Processor -- start 2024-04-17T08:47:46.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.393+0000 7fd5edc00640 1 -- start start 2024-04-17T08:47:46.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.393+0000 7fd5edc00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5e806f980 0x7fd5e80b0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:46.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.393+0000 7fd5edc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd5e80af670 0x7fd5e814f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:46.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.393+0000 7fd5edc00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd5e80d0360 0x7fd5e814ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:46.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.393+0000 7fd5edc00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e8072bf0 con 0x7fd5e806f980 2024-04-17T08:47:46.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.393+0000 7fd5edc00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e8072a70 con 0x7fd5e80d0360 2024-04-17T08:47:46.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.393+0000 7fd5edc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fd5e806b9b0 con 0x7fd5e80af670 2024-04-17T08:47:46.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.393+0000 7fd5e6a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5e806f980 0x7fd5e80b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:46.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.393+0000 7fd5e6a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5e806f980 0x7fd5e80b0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60488/0 (socket says 172.21.15.152:60488) 2024-04-17T08:47:46.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.393+0000 7fd5e6a00640 1 -- 172.21.15.152:0/4185157181 learned_addr learned my addr 172.21.15.152:0/4185157181 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:46.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.393+0000 7fd5de000640 1 --2- 172.21.15.152:0/4185157181 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd5e80af670 0x7fd5e814f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:46.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.393+0000 7fd5e6a00640 1 -- 172.21.15.152:0/4185157181 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd5e80af670 msgr2=0x7fd5e814f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:46.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.393+0000 7fd5e6a00640 1 --2- 172.21.15.152:0/4185157181 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd5e80af670 0x7fd5e814f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:46.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.393+0000 7fd5e7400640 1 --2- 172.21.15.152:0/4185157181 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd5e80d0360 0x7fd5e814ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:46.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.393+0000 7fd5e6a00640 1 -- 172.21.15.152:0/4185157181 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd5e80d0360 msgr2=0x7fd5e814ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:46.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.393+0000 7fd5e6a00640 1 --2- 172.21.15.152:0/4185157181 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd5e80d0360 0x7fd5e814ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:46.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.393+0000 7fd5e6a00640 1 -- 172.21.15.152:0/4185157181 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5e80b0b50 con 0x7fd5e806f980 2024-04-17T08:47:46.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.393+0000 7fd5de000640 1 --2- 172.21.15.152:0/4185157181 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd5e80af670 0x7fd5e814f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:47:46.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.393+0000 7fd5e7400640 1 --2- 172.21.15.152:0/4185157181 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd5e80d0360 0x7fd5e814ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:47:46.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.393+0000 7fd5e6a00640 1 --2- 172.21.15.152:0/4185157181 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5e806f980 0x7fd5e80b0570 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fd5d800c450 tx=0x7fd5d800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:46.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.393+0000 7fd5df400640 1 -- 172.21.15.152:0/4185157181 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d8017070 con 0x7fd5e806f980 2024-04-17T08:47:46.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.393+0000 7fd5df400640 1 -- 172.21.15.152:0/4185157181 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5d8005cf0 con 0x7fd5e806f980 2024-04-17T08:47:46.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.393+0000 7fd5df400640 1 -- 172.21.15.152:0/4185157181 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d8007290 con 0x7fd5e806f980 2024-04-17T08:47:46.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.393+0000 7fd5edc00640 1 -- 172.21.15.152:0/4185157181 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5e81645a0 con 0x7fd5e806f980 2024-04-17T08:47:46.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.397+0000 7fd5edc00640 1 -- 172.21.15.152:0/4185157181 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5e8159e40 con 0x7fd5e806f980 2024-04-17T08:47:46.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.397+0000 7fd5edc00640 1 -- 172.21.15.152:0/4185157181 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5e8068a30 con 0x7fd5e806f980 2024-04-17T08:47:46.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.397+0000 7fd5df400640 1 -- 172.21.15.152:0/4185157181 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd5d801a070 con 0x7fd5e806f980 2024-04-17T08:47:46.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.397+0000 7fd5df400640 1 --2- 172.21.15.152:0/4185157181 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fd5c4068380 0x7fd5c406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:46.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.397+0000 7fd5df400640 1 -- 172.21.15.152:0/4185157181 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fd5d80860d0 con 0x7fd5e806f980 2024-04-17T08:47:46.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.397+0000 7fd5de000640 1 --2- 172.21.15.152:0/4185157181 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fd5c4068380 0x7fd5c406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:46.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.397+0000 7fd5de000640 1 --2- 172.21.15.152:0/4185157181 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fd5c4068380 0x7fd5c406a840 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd5e80b2de0 tx=0x7fd5d0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:46.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.401+0000 7fd5df400640 1 -- 172.21.15.152:0/4185157181 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fd5d8056260 con 0x7fd5e806f980 2024-04-17T08:47:46.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.561+0000 7fd5edc00640 1 -- 172.21.15.152:0/4185157181 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd5e806be00 con 0x7fd5e806f980 2024-04-17T08:47:46.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.561+0000 7fd5df400640 1 -- 172.21.15.152:0/4185157181 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7fd5d8055b60 con 0x7fd5e806f980 2024-04-17T08:47:46.563 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 64 2024-04-17T08:47:46.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.561+0000 7fd5edc00640 1 -- 172.21.15.152:0/4185157181 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fd5c4068380 msgr2=0x7fd5c406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:46.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.561+0000 7fd5edc00640 1 --2- 172.21.15.152:0/4185157181 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fd5c4068380 0x7fd5c406a840 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd5e80b2de0 tx=0x7fd5d0008040 comp rx=0 tx=0).stop 2024-04-17T08:47:46.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.561+0000 7fd5edc00640 1 -- 172.21.15.152:0/4185157181 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5e806f980 msgr2=0x7fd5e80b0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:46.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.561+0000 7fd5edc00640 1 --2- 172.21.15.152:0/4185157181 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5e806f980 0x7fd5e80b0570 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fd5d800c450 tx=0x7fd5d800c910 comp rx=0 tx=0).stop 2024-04-17T08:47:46.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.561+0000 7fd5edc00640 1 -- 172.21.15.152:0/4185157181 shutdown_connections 2024-04-17T08:47:46.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.561+0000 7fd5edc00640 1 --2- 172.21.15.152:0/4185157181 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd5e80d0360 0x7fd5e814ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:46.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.561+0000 7fd5edc00640 1 --2- 172.21.15.152:0/4185157181 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fd5c4068380 0x7fd5c406a840 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:46.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.561+0000 7fd5edc00640 1 --2- 172.21.15.152:0/4185157181 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd5e80af670 0x7fd5e814f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:46.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.561+0000 7fd5edc00640 1 --2- 172.21.15.152:0/4185157181 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5e806f980 0x7fd5e80b0570 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:46.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.561+0000 7fd5edc00640 1 -- 172.21.15.152:0/4185157181 >> 172.21.15.152:0/4185157181 conn(0x7fd5e80b3350 msgr2=0x7fd5e815a660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:46.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.561+0000 7fd5edc00640 1 -- 172.21.15.152:0/4185157181 shutdown_connections 2024-04-17T08:47:46.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.561+0000 7fd5edc00640 1 -- 172.21.15.152:0/4185157181 wait complete. 2024-04-17T08:47:46.585 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-17T08:47:46.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.721+0000 7fe958600640 1 Processor -- start 2024-04-17T08:47:46.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.721+0000 7fe958600640 1 -- start start 2024-04-17T08:47:46.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.721+0000 7fe958600640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fe950161b70 0x7fe95006dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:46.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.721+0000 7fe958600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fe95006e1a0 0x7fe9500d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:46.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.721+0000 7fe958600640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe95006e6b0 con 0x7fe9500d08a0 2024-04-17T08:47:46.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.721+0000 7fe958600640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fe9500d0cf0 con 0x7fe950161b70 2024-04-17T08:47:46.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.721+0000 7fe958600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fe950161f50 con 0x7fe95006e1a0 2024-04-17T08:47:46.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.721+0000 7fe955c00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fe950161b70 0x7fe95006dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:46.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.721+0000 7fe955c00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fe950161b70 0x7fe95006dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60492/0 (socket says 172.21.15.152:60492) 2024-04-17T08:47:46.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.721+0000 7fe955c00640 1 -- 172.21.15.152:0/458553394 learned_addr learned my addr 172.21.15.152:0/458553394 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:46.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.721+0000 7fe955200640 1 --2- 172.21.15.152:0/458553394 >> v2:172.21.15.196:3300/0 conn(0x7fe95006e1a0 0x7fe9500d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:46.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.721+0000 7fe955c00640 1 -- 172.21.15.152:0/458553394 >> v2:172.21.15.196:3300/0 conn(0x7fe95006e1a0 msgr2=0x7fe9500d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:46.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.721+0000 7fe955c00640 1 --2- 172.21.15.152:0/458553394 >> v2:172.21.15.196:3300/0 conn(0x7fe95006e1a0 0x7fe9500d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:46.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.721+0000 7fe955c00640 1 -- 172.21.15.152:0/458553394 >> v1:172.21.15.196:6789/0 conn(0x7fe9500d08a0 legacy=0x7fe95006b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:46.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.721+0000 7fe955c00640 1 -- 172.21.15.152:0/458553394 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe95006e990 con 0x7fe950161b70 2024-04-17T08:47:46.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.725+0000 7fe955c00640 1 --2- 172.21.15.152:0/458553394 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe950161b70 0x7fe95006dc60 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe9500d0eb0 tx=0x7fe94401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d943426c3892365 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:46.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.725+0000 7fe94fe00640 1 -- 172.21.15.152:0/458553394 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9440b0070 con 0x7fe950161b70 2024-04-17T08:47:46.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.725+0000 7fe94fe00640 1 -- 172.21.15.152:0/458553394 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9440ab600 con 0x7fe950161b70 2024-04-17T08:47:46.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.725+0000 7fe94fe00640 1 -- 172.21.15.152:0/458553394 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9440ab9d0 con 0x7fe950161b70 2024-04-17T08:47:46.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.725+0000 7fe958600640 1 -- 172.21.15.152:0/458553394 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe950161b70 msgr2=0x7fe95006dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:46.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.725+0000 7fe958600640 1 --2- 172.21.15.152:0/458553394 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe950161b70 0x7fe95006dc60 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe9500d0eb0 tx=0x7fe94401c450 comp rx=0 tx=0).stop 2024-04-17T08:47:46.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.725+0000 7fe958600640 1 -- 172.21.15.152:0/458553394 shutdown_connections 2024-04-17T08:47:46.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.725+0000 7fe958600640 1 --2- 172.21.15.152:0/458553394 >> v2:172.21.15.196:3300/0 conn(0x7fe95006e1a0 0x7fe9500d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:46.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.725+0000 7fe958600640 1 --2- 172.21.15.152:0/458553394 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe950161b70 0x7fe95006dc60 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:46.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.725+0000 7fe958600640 1 -- 172.21.15.152:0/458553394 >> 172.21.15.152:0/458553394 conn(0x7fe9500b3350 msgr2=0x7fe9500b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:46.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.725+0000 7fe958600640 1 -- 172.21.15.152:0/458553394 shutdown_connections 2024-04-17T08:47:46.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.725+0000 7fe958600640 1 -- 172.21.15.152:0/458553394 wait complete. 2024-04-17T08:47:46.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.729+0000 7fe958600640 1 Processor -- start 2024-04-17T08:47:46.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.729+0000 7fe958600640 1 -- start start 2024-04-17T08:47:46.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.729+0000 7fe958600640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe95006e1a0 0x7fe950158b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:46.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.729+0000 7fe958600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe9500d08a0 0x7fe950157130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:46.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.729+0000 7fe958600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe950161b70 0x7fe95014d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:46.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.729+0000 7fe958600640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe95016b340 con 0x7fe95006e1a0 2024-04-17T08:47:46.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.729+0000 7fe958600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe95016b1c0 con 0x7fe950161b70 2024-04-17T08:47:46.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.729+0000 7fe958600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fe95016b4c0 con 0x7fe9500d08a0 2024-04-17T08:47:46.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.729+0000 7fe955c00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe95006e1a0 0x7fe950158b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:46.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.729+0000 7fe955c00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe95006e1a0 0x7fe950158b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60508/0 (socket says 172.21.15.152:60508) 2024-04-17T08:47:46.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.729+0000 7fe955c00640 1 -- 172.21.15.152:0/3233649466 learned_addr learned my addr 172.21.15.152:0/3233649466 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:46.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.729+0000 7fe955c00640 1 -- 172.21.15.152:0/3233649466 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe9500d08a0 msgr2=0x7fe950157130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:46.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.729+0000 7fe955c00640 1 --2- 172.21.15.152:0/3233649466 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe9500d08a0 0x7fe950157130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:46.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.729+0000 7fe955c00640 1 -- 172.21.15.152:0/3233649466 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe950161b70 msgr2=0x7fe95014d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:46.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.729+0000 7fe955c00640 1 --2- 172.21.15.152:0/3233649466 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe950161b70 0x7fe95014d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:46.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.729+0000 7fe955c00640 1 -- 172.21.15.152:0/3233649466 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9501592a0 con 0x7fe95006e1a0 2024-04-17T08:47:46.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.729+0000 7fe955c00640 1 --2- 172.21.15.152:0/3233649466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe95006e1a0 0x7fe950158b70 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe94401ab00 tx=0x7fe9440191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:46.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.729+0000 7fe94d600640 1 -- 172.21.15.152:0/3233649466 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9440bb070 con 0x7fe95006e1a0 2024-04-17T08:47:46.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.729+0000 7fe94d600640 1 -- 172.21.15.152:0/3233649466 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9440b6440 con 0x7fe95006e1a0 2024-04-17T08:47:46.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.729+0000 7fe94d600640 1 -- 172.21.15.152:0/3233649466 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9440b0040 con 0x7fe95006e1a0 2024-04-17T08:47:46.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.729+0000 7fe958600640 1 -- 172.21.15.152:0/3233649466 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe95014e3d0 con 0x7fe95006e1a0 2024-04-17T08:47:46.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.729+0000 7fe958600640 1 -- 172.21.15.152:0/3233649466 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe95014e990 con 0x7fe95006e1a0 2024-04-17T08:47:46.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.729+0000 7fe958600640 1 -- 172.21.15.152:0/3233649466 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe95014e1e0 con 0x7fe95006e1a0 2024-04-17T08:47:46.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.733+0000 7fe94d600640 1 -- 172.21.15.152:0/3233649466 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe9440b67f0 con 0x7fe95006e1a0 2024-04-17T08:47:46.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.733+0000 7fe94d600640 1 --2- 172.21.15.152:0/3233649466 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fe930068380 0x7fe93006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:46.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.733+0000 7fe94d600640 1 -- 172.21.15.152:0/3233649466 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fe944120700 con 0x7fe95006e1a0 2024-04-17T08:47:46.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.733+0000 7fe955200640 1 --2- 172.21.15.152:0/3233649466 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fe930068380 0x7fe93006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:46.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.733+0000 7fe955200640 1 --2- 172.21.15.152:0/3233649466 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fe930068380 0x7fe93006a840 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe9500b3b30 tx=0x7fe93c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:46.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.737+0000 7fe94d600640 1 -- 172.21.15.152:0/3233649466 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fe9440160d0 con 0x7fe95006e1a0 2024-04-17T08:47:46.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.893+0000 7fe958600640 1 -- 172.21.15.152:0/3233649466 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fe950068a30 con 0x7fe95006e1a0 2024-04-17T08:47:46.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.893+0000 7fe94d600640 1 -- 172.21.15.152:0/3233649466 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7fe9440f0890 con 0x7fe95006e1a0 2024-04-17T08:47:46.895 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-04-17T08:47:46.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.893+0000 7fe958600640 1 -- 172.21.15.152:0/3233649466 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fe930068380 msgr2=0x7fe93006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:46.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.893+0000 7fe958600640 1 --2- 172.21.15.152:0/3233649466 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fe930068380 0x7fe93006a840 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe9500b3b30 tx=0x7fe93c008040 comp rx=0 tx=0).stop 2024-04-17T08:47:46.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.893+0000 7fe958600640 1 -- 172.21.15.152:0/3233649466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe95006e1a0 msgr2=0x7fe950158b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:46.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.893+0000 7fe958600640 1 --2- 172.21.15.152:0/3233649466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe95006e1a0 0x7fe950158b70 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe94401ab00 tx=0x7fe9440191f0 comp rx=0 tx=0).stop 2024-04-17T08:47:46.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.893+0000 7fe958600640 1 -- 172.21.15.152:0/3233649466 shutdown_connections 2024-04-17T08:47:46.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.893+0000 7fe958600640 1 --2- 172.21.15.152:0/3233649466 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe950161b70 0x7fe95014d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:46.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.893+0000 7fe958600640 1 --2- 172.21.15.152:0/3233649466 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fe930068380 0x7fe93006a840 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:46.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.893+0000 7fe958600640 1 --2- 172.21.15.152:0/3233649466 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe9500d08a0 0x7fe950157130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:46.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.893+0000 7fe958600640 1 --2- 172.21.15.152:0/3233649466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe95006e1a0 0x7fe950158b70 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:46.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.893+0000 7fe958600640 1 -- 172.21.15.152:0/3233649466 >> 172.21.15.152:0/3233649466 conn(0x7fe9500b3350 msgr2=0x7fe9500ae910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:46.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.893+0000 7fe958600640 1 -- 172.21.15.152:0/3233649466 shutdown_connections 2024-04-17T08:47:46.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:46.893+0000 7fe958600640 1 -- 172.21.15.152:0/3233649466 wait complete. 2024-04-17T08:47:46.916 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T08:47:47.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.049+0000 7efc1ca00640 1 Processor -- start 2024-04-17T08:47:47.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.049+0000 7efc1ca00640 1 -- start start 2024-04-17T08:47:47.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.049+0000 7efc1ca00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efc180d0a70 0x7efc18160010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:47.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.049+0000 7efc1ca00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc18160d20 con 0x7efc1815a010 2024-04-17T08:47:47.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.049+0000 7efc1ca00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc1815cc30 con 0x7efc1815d710 2024-04-17T08:47:47.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.049+0000 7efc1ca00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7efc1815d280 con 0x7efc180d0a70 2024-04-17T08:47:47.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.049+0000 7efc15e00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7efc1815a010 0x7efc180d0360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:54394/0 (socket says 172.21.15.152:54394) 2024-04-17T08:47:47.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.049+0000 7efc15e00640 1 -- 172.21.15.152:0/3149994383 learned_addr learned my addr 172.21.15.152:0/3149994383 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:47.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.049+0000 7efc15400640 1 --2- 172.21.15.152:0/3149994383 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efc180d0a70 0x7efc18160010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:47.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.049+0000 7efc14a00640 1 -- 172.21.15.152:0/3149994383 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1408959861 0 0) 0x7efc18160d20 con 0x7efc1815a010 2024-04-17T08:47:47.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.049+0000 7efc14a00640 1 -- 172.21.15.152:0/3149994383 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efbfc003530 con 0x7efc1815a010 2024-04-17T08:47:47.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.049+0000 7efc14a00640 1 -- 172.21.15.152:0/3149994383 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3499368793 0 0) 0x7efc1815cc30 con 0x7efc1815d710 2024-04-17T08:47:47.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.049+0000 7efc14a00640 1 -- 172.21.15.152:0/3149994383 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc18160d20 con 0x7efc1815d710 2024-04-17T08:47:47.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.049+0000 7efc14a00640 1 -- 172.21.15.152:0/3149994383 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3136603397 0 0) 0x7efbfc003530 con 0x7efc1815a010 2024-04-17T08:47:47.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.049+0000 7efc14a00640 1 -- 172.21.15.152:0/3149994383 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efc180d0a70 msgr2=0x7efc18160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:47.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.049+0000 7efc14a00640 1 --2- 172.21.15.152:0/3149994383 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efc180d0a70 0x7efc18160010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:47.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.049+0000 7efc14a00640 1 -- 172.21.15.152:0/3149994383 >> v1:172.21.15.196:6789/0 conn(0x7efc1815d710 legacy=0x7efc18160550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:47.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.049+0000 7efc14a00640 1 -- 172.21.15.152:0/3149994383 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc1815cf10 con 0x7efc1815a010 2024-04-17T08:47:47.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.049+0000 7efc14a00640 1 -- 172.21.15.152:0/3149994383 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2973887244 0 0) 0x7efc08001a20 con 0x7efc1815a010 2024-04-17T08:47:47.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.049+0000 7efc14a00640 1 -- 172.21.15.152:0/3149994383 >> v1:172.21.15.152:6789/0 conn(0x7efc1815a010 legacy=0x7efc180d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:47.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.049+0000 7efc14a00640 1 --2- 172.21.15.152:0/3149994383 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efbfc003b80 0x7efbfc003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:47.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.049+0000 7efc14a00640 1 --2- 172.21.15.152:0/3149994383 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efbfc004810 0x7efbfc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:47.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.049+0000 7efc14a00640 1 --2- 172.21.15.152:0/3149994383 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efc180d0a70 0x7efbfc005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:47.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.049+0000 7efc14a00640 1 -- 172.21.15.152:0/3149994383 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7efc1815d280 con 0x7efbfc003b80 2024-04-17T08:47:47.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.049+0000 7efc14a00640 1 -- 172.21.15.152:0/3149994383 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7efbfc00bb60 con 0x7efbfc004810 2024-04-17T08:47:47.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.049+0000 7efc14a00640 1 -- 172.21.15.152:0/3149994383 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7efbfc00bd60 con 0x7efc180d0a70 2024-04-17T08:47:47.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.053+0000 7efc15e00640 1 --2- 172.21.15.152:0/3149994383 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efbfc003b80 0x7efbfc003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:47.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.053+0000 7efc15400640 1 --2- 172.21.15.152:0/3149994383 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efbfc004810 0x7efbfc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:47.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.053+0000 7efc16800640 1 --2- 172.21.15.152:0/3149994383 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efc180d0a70 0x7efbfc005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:47.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.053+0000 7efc15e00640 1 -- 172.21.15.152:0/3149994383 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efc180d0a70 msgr2=0x7efbfc005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:47.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.053+0000 7efc15e00640 1 --2- 172.21.15.152:0/3149994383 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efc180d0a70 0x7efbfc005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:47.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.053+0000 7efc15e00640 1 -- 172.21.15.152:0/3149994383 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efbfc004810 msgr2=0x7efbfc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:47.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.053+0000 7efc15e00640 1 --2- 172.21.15.152:0/3149994383 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efbfc004810 0x7efbfc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:47.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.053+0000 7efc15e00640 1 -- 172.21.15.152:0/3149994383 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efbfc003530 con 0x7efbfc003b80 2024-04-17T08:47:47.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.053+0000 7efc15e00640 1 --2- 172.21.15.152:0/3149994383 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efbfc003b80 0x7efbfc003f80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7efc0800a720 tx=0x7efc0801d200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73e5ee04a944d9ed server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:47.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.053+0000 7efc14a00640 1 -- 172.21.15.152:0/3149994383 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc0800a370 con 0x7efbfc003b80 2024-04-17T08:47:47.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.053+0000 7efc14a00640 1 -- 172.21.15.152:0/3149994383 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc080a9020 con 0x7efbfc003b80 2024-04-17T08:47:47.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.053+0000 7efc14a00640 1 -- 172.21.15.152:0/3149994383 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc080070d0 con 0x7efbfc003b80 2024-04-17T08:47:47.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.053+0000 7efc1ca00640 1 -- 172.21.15.152:0/3149994383 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efbfc003b80 msgr2=0x7efbfc003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:47.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.053+0000 7efc1ca00640 1 --2- 172.21.15.152:0/3149994383 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efbfc003b80 0x7efbfc003f80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7efc0800a720 tx=0x7efc0801d200 comp rx=0 tx=0).stop 2024-04-17T08:47:47.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.057+0000 7efc16800640 1 -- 172.21.15.152:0/3149994383 reap_dead start 2024-04-17T08:47:47.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.057+0000 7efc1ca00640 1 -- 172.21.15.152:0/3149994383 shutdown_connections 2024-04-17T08:47:47.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.057+0000 7efc1ca00640 1 -- 172.21.15.152:0/3149994383 >> 172.21.15.152:0/3149994383 conn(0x7efc180b3350 msgr2=0x7efc180b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:47.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.057+0000 7efc1ca00640 1 -- 172.21.15.152:0/3149994383 shutdown_connections 2024-04-17T08:47:47.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.057+0000 7efc1ca00640 1 -- 172.21.15.152:0/3149994383 wait complete. 2024-04-17T08:47:47.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.057+0000 7efc1ca00640 1 Processor -- start 2024-04-17T08:47:47.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.057+0000 7efc1ca00640 1 -- start start 2024-04-17T08:47:47.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.057+0000 7efc1ca00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efbfc003b80 0x7efc18157780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:47.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.057+0000 7efc1ca00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efc18157cc0 0x7efc180c9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:47.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.057+0000 7efc1ca00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efc180c9a50 0x7efc18158260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:47.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.057+0000 7efc1ca00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7efc18167dc0 con 0x7efbfc003b80 2024-04-17T08:47:47.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.057+0000 7efc1ca00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7efc1815c9d0 con 0x7efc180c9a50 2024-04-17T08:47:47.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.057+0000 7efc1ca00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7efc18167f40 con 0x7efc18157cc0 2024-04-17T08:47:47.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.057+0000 7efc15e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efbfc003b80 0x7efc18157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:47.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.057+0000 7efc15e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efbfc003b80 0x7efc18157780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60532/0 (socket says 172.21.15.152:60532) 2024-04-17T08:47:47.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.057+0000 7efc15e00640 1 -- 172.21.15.152:0/2508366681 learned_addr learned my addr 172.21.15.152:0/2508366681 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:47.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.057+0000 7efc15e00640 1 -- 172.21.15.152:0/2508366681 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efc18157cc0 msgr2=0x7efc180c9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:47.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.057+0000 7efc15e00640 1 --2- 172.21.15.152:0/2508366681 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efc18157cc0 0x7efc180c9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:47.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.057+0000 7efc16800640 1 --2- 172.21.15.152:0/2508366681 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efc180c9a50 0x7efc18158260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:47.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.057+0000 7efc15e00640 1 -- 172.21.15.152:0/2508366681 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efc180c9a50 msgr2=0x7efc18158260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:47.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.057+0000 7efc15e00640 1 --2- 172.21.15.152:0/2508366681 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efc180c9a50 0x7efc18158260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:47.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.057+0000 7efc15e00640 1 -- 172.21.15.152:0/2508366681 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc180ca080 con 0x7efbfc003b80 2024-04-17T08:47:47.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.057+0000 7efc16800640 1 --2- 172.21.15.152:0/2508366681 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efc180c9a50 0x7efc18158260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:47:47.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.057+0000 7efc15e00640 1 --2- 172.21.15.152:0/2508366681 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efbfc003b80 0x7efc18157780 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7efc08007040 tx=0x7efbfc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:47.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.057+0000 7efc0e000640 1 -- 172.21.15.152:0/2508366681 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc080072d0 con 0x7efbfc003b80 2024-04-17T08:47:47.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.061+0000 7efc0e000640 1 -- 172.21.15.152:0/2508366681 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc08007470 con 0x7efbfc003b80 2024-04-17T08:47:47.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.061+0000 7efc1ca00640 1 -- 172.21.15.152:0/2508366681 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc180ca360 con 0x7efbfc003b80 2024-04-17T08:47:47.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.061+0000 7efc0e000640 1 -- 172.21.15.152:0/2508366681 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc08007820 con 0x7efbfc003b80 2024-04-17T08:47:47.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.061+0000 7efc1ca00640 1 -- 172.21.15.152:0/2508366681 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc180ca920 con 0x7efbfc003b80 2024-04-17T08:47:47.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.061+0000 7efc1ca00640 1 -- 172.21.15.152:0/2508366681 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc18068a30 con 0x7efbfc003b80 2024-04-17T08:47:47.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.061+0000 7efc0e000640 1 -- 172.21.15.152:0/2508366681 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efc080ae430 con 0x7efbfc003b80 2024-04-17T08:47:47.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.061+0000 7efc0e000640 1 --2- 172.21.15.152:0/2508366681 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7efbf8068380 0x7efbf806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:47.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.061+0000 7efc0e000640 1 -- 172.21.15.152:0/2508366681 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7efc081210e0 con 0x7efbfc003b80 2024-04-17T08:47:47.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.061+0000 7efc15400640 1 --2- 172.21.15.152:0/2508366681 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7efbf8068380 0x7efbf806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:47.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.061+0000 7efc15400640 1 --2- 172.21.15.152:0/2508366681 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7efbf8068380 0x7efbf806a840 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7efc180cad60 tx=0x7efc040095f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:47.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.065+0000 7efc0e000640 1 -- 172.21.15.152:0/2508366681 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7efc080be060 con 0x7efbfc003b80 2024-04-17T08:47:47.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.257+0000 7efc1ca00640 1 -- 172.21.15.152:0/2508366681 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efc1806dc60 con 0x7efbfc003b80 2024-04-17T08:47:47.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.257+0000 7efc0e000640 1 -- 172.21.15.152:0/2508366681 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5207 (secure 0 0 0) 0x7efc080f1e20 con 0x7efbfc003b80 2024-04-17T08:47:47.260 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:47:47.260 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6834/2461981726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":2461981726},{"type":"v1","addr":"172.21.15.196:6834","nonce":2461981726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6835/3397289430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6833","nonce":3397289430},{"type":"v1","addr":"172.21.15.196:6835","nonce":3397289430}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/2491486613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2491486613},{"type":"v1","addr":"172.21.15.152:6836","nonce":2491486613}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-17T08:46:33.607720+0000","modified":"2024-04-17T08:46:57.830153+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6837/3890159871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":3890159871},{"type":"v1","addr":"172.21.15.152:6837","nonce":3890159871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-04-17T08:47:47.260 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 9 2024-04-17T08:47:47.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.261+0000 7efc1ca00640 1 -- 172.21.15.152:0/2508366681 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7efbf8068380 msgr2=0x7efbf806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:47.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.261+0000 7efc1ca00640 1 --2- 172.21.15.152:0/2508366681 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7efbf8068380 0x7efbf806a840 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7efc180cad60 tx=0x7efc040095f0 comp rx=0 tx=0).stop 2024-04-17T08:47:47.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.261+0000 7efc1ca00640 1 -- 172.21.15.152:0/2508366681 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efbfc003b80 msgr2=0x7efc18157780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:47.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.261+0000 7efc1ca00640 1 --2- 172.21.15.152:0/2508366681 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efbfc003b80 0x7efc18157780 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7efc08007040 tx=0x7efbfc005840 comp rx=0 tx=0).stop 2024-04-17T08:47:47.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.261+0000 7efc1ca00640 1 -- 172.21.15.152:0/2508366681 shutdown_connections 2024-04-17T08:47:47.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.261+0000 7efc1ca00640 1 --2- 172.21.15.152:0/2508366681 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efc180c9a50 0x7efc18158260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:47.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.261+0000 7efc1ca00640 1 --2- 172.21.15.152:0/2508366681 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7efbf8068380 0x7efbf806a840 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:47.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.261+0000 7efc1ca00640 1 --2- 172.21.15.152:0/2508366681 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efc18157cc0 0x7efc180c9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:47.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.261+0000 7efc1ca00640 1 --2- 172.21.15.152:0/2508366681 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efbfc003b80 0x7efc18157780 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:47.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.261+0000 7efc1ca00640 1 -- 172.21.15.152:0/2508366681 >> 172.21.15.152:0/2508366681 conn(0x7efc180b3350 msgr2=0x7efc180b1340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:47.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.261+0000 7efc1ca00640 1 -- 172.21.15.152:0/2508366681 shutdown_connections 2024-04-17T08:47:47.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.261+0000 7efc1ca00640 1 -- 172.21.15.152:0/2508366681 wait complete. 2024-04-17T08:47:47.281 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T08:47:47.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.413+0000 7fbda2a00640 1 Processor -- start 2024-04-17T08:47:47.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.413+0000 7fbda2a00640 1 -- start start 2024-04-17T08:47:47.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.417+0000 7fbda2a00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fbd9c070eb0 0x7fbd9c0cc920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:47.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.417+0000 7fbda2a00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd9c0cea90 con 0x7fbd9c0cce60 2024-04-17T08:47:47.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.417+0000 7fbda2a00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd9c0ced50 con 0x7fbd9c160980 2024-04-17T08:47:47.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.417+0000 7fbda2a00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fbd9c0cf830 con 0x7fbd9c070eb0 2024-04-17T08:47:47.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.417+0000 7fbda1600640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fbd9c070eb0 0x7fbd9c0cc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:47.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.417+0000 7fbda0c00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fbd9c0cce60 0x7fbd9c160270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:54404/0 (socket says 172.21.15.152:54404) 2024-04-17T08:47:47.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.417+0000 7fbda0c00640 1 -- 172.21.15.152:0/3159012174 learned_addr learned my addr 172.21.15.152:0/3159012174 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:47.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.417+0000 7fbda1600640 1 -- 172.21.15.152:0/3159012174 >> v1:172.21.15.196:6789/0 conn(0x7fbd9c160980 legacy=0x7fbd9c159640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:47.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.417+0000 7fbda1600640 1 -- 172.21.15.152:0/3159012174 >> v1:172.21.15.152:6789/0 conn(0x7fbd9c0cce60 legacy=0x7fbd9c160270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:47.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.417+0000 7fbda1600640 1 -- 172.21.15.152:0/3159012174 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd9c0cf030 con 0x7fbd9c070eb0 2024-04-17T08:47:47.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.421+0000 7fbda1600640 1 --2- 172.21.15.152:0/3159012174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd9c070eb0 0x7fbd9c0cc920 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fbd900097c0 tx=0x7fbd9001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18ddef8ac1bbba57 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:47.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.421+0000 7fbd9be00640 1 -- 172.21.15.152:0/3159012174 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd900b0070 con 0x7fbd9c070eb0 2024-04-17T08:47:47.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.421+0000 7fbd9be00640 1 -- 172.21.15.152:0/3159012174 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd900ab600 con 0x7fbd9c070eb0 2024-04-17T08:47:47.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.421+0000 7fbd9be00640 1 -- 172.21.15.152:0/3159012174 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd900ab9d0 con 0x7fbd9c070eb0 2024-04-17T08:47:47.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.421+0000 7fbda2a00640 1 -- 172.21.15.152:0/3159012174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd9c070eb0 msgr2=0x7fbd9c0cc920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:47.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.421+0000 7fbda2a00640 1 --2- 172.21.15.152:0/3159012174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd9c070eb0 0x7fbd9c0cc920 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fbd900097c0 tx=0x7fbd9001c4a0 comp rx=0 tx=0).stop 2024-04-17T08:47:47.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.421+0000 7fbda2a00640 1 -- 172.21.15.152:0/3159012174 shutdown_connections 2024-04-17T08:47:47.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.421+0000 7fbda2a00640 1 --2- 172.21.15.152:0/3159012174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd9c070eb0 0x7fbd9c0cc920 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:47.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.421+0000 7fbda2a00640 1 -- 172.21.15.152:0/3159012174 >> 172.21.15.152:0/3159012174 conn(0x7fbd9c0b3e40 msgr2=0x7fbd9c0b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:47.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.421+0000 7fbda2a00640 1 -- 172.21.15.152:0/3159012174 shutdown_connections 2024-04-17T08:47:47.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.421+0000 7fbda2a00640 1 -- 172.21.15.152:0/3159012174 wait complete. 2024-04-17T08:47:47.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.421+0000 7fbda2a00640 1 Processor -- start 2024-04-17T08:47:47.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.421+0000 7fbda2a00640 1 -- start start 2024-04-17T08:47:47.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.425+0000 7fbda2a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd9c070eb0 0x7fbd9c167e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:47.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.425+0000 7fbda2a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd9c0cce60 0x7fbd9c06ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:47.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.425+0000 7fbda2a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd9c160980 0x7fbd9c154180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:47.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.425+0000 7fbda2a00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbd9c160d90 con 0x7fbd9c070eb0 2024-04-17T08:47:47.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.425+0000 7fbda2a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fbd9c0cf3a0 con 0x7fbd9c160980 2024-04-17T08:47:47.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.425+0000 7fbda2a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fbd9c0ce830 con 0x7fbd9c0cce60 2024-04-17T08:47:47.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.425+0000 7fbda1600640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd9c070eb0 0x7fbd9c167e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:47.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.425+0000 7fbda1600640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd9c070eb0 0x7fbd9c167e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60552/0 (socket says 172.21.15.152:60552) 2024-04-17T08:47:47.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.425+0000 7fbda1600640 1 -- 172.21.15.152:0/3239392737 learned_addr learned my addr 172.21.15.152:0/3239392737 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:47.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.425+0000 7fbda0c00640 1 --2- 172.21.15.152:0/3239392737 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd9c0cce60 0x7fbd9c06ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:47.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.425+0000 7fbda2000640 1 --2- 172.21.15.152:0/3239392737 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd9c160980 0x7fbd9c154180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:47.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.425+0000 7fbda1600640 1 -- 172.21.15.152:0/3239392737 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd9c0cce60 msgr2=0x7fbd9c06ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:47.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.425+0000 7fbda1600640 1 --2- 172.21.15.152:0/3239392737 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd9c0cce60 0x7fbd9c06ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:47.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.425+0000 7fbda1600640 1 -- 172.21.15.152:0/3239392737 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd9c160980 msgr2=0x7fbd9c154180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:47.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.425+0000 7fbda1600640 1 --2- 172.21.15.152:0/3239392737 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd9c160980 0x7fbd9c154180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:47.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.425+0000 7fbda1600640 1 -- 172.21.15.152:0/3239392737 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd9c06d690 con 0x7fbd9c070eb0 2024-04-17T08:47:47.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.425+0000 7fbda0c00640 1 --2- 172.21.15.152:0/3239392737 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd9c0cce60 0x7fbd9c06ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:47.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.425+0000 7fbda1600640 1 --2- 172.21.15.152:0/3239392737 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd9c070eb0 0x7fbd9c167e80 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fbd900190b0 tx=0x7fbd90019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:47.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.425+0000 7fbd99600640 1 -- 172.21.15.152:0/3239392737 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd900b0040 con 0x7fbd9c070eb0 2024-04-17T08:47:47.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.425+0000 7fbd99600640 1 -- 172.21.15.152:0/3239392737 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd900bb070 con 0x7fbd9c070eb0 2024-04-17T08:47:47.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.425+0000 7fbda2a00640 1 -- 172.21.15.152:0/3239392737 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd9c06d3f0 con 0x7fbd9c070eb0 2024-04-17T08:47:47.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.425+0000 7fbd99600640 1 -- 172.21.15.152:0/3239392737 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd900b4870 con 0x7fbd9c070eb0 2024-04-17T08:47:47.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.425+0000 7fbda2a00640 1 -- 172.21.15.152:0/3239392737 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd9c06e660 con 0x7fbd9c070eb0 2024-04-17T08:47:47.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.425+0000 7fbda2a00640 1 -- 172.21.15.152:0/3239392737 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd9c075c10 con 0x7fbd9c070eb0 2024-04-17T08:47:47.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.425+0000 7fbd99600640 1 -- 172.21.15.152:0/3239392737 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbd900ab4c0 con 0x7fbd9c070eb0 2024-04-17T08:47:47.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.429+0000 7fbd99600640 1 --2- 172.21.15.152:0/3239392737 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fbd7c068380 0x7fbd7c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:47.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.429+0000 7fbd99600640 1 -- 172.21.15.152:0/3239392737 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fbd90120ae0 con 0x7fbd9c070eb0 2024-04-17T08:47:47.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.429+0000 7fbda0c00640 1 --2- 172.21.15.152:0/3239392737 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fbd7c068380 0x7fbd7c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:47.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.429+0000 7fbda0c00640 1 --2- 172.21.15.152:0/3239392737 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fbd7c068380 0x7fbd7c06a840 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c0d2960 tx=0x7fbd88009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:47.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.433+0000 7fbd99600640 1 -- 172.21.15.152:0/3239392737 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fbd90016090 con 0x7fbd9c070eb0 2024-04-17T08:47:47.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.589+0000 7fbda2a00640 1 -- 172.21.15.152:0/3239392737 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbd9c0cc700 con 0x7fbd9c070eb0 2024-04-17T08:47:47.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.589+0000 7fbd99600640 1 -- 172.21.15.152:0/3239392737 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18972 (secure 0 0 0) 0x7fbd900f0be0 con 0x7fbd9c070eb0 2024-04-17T08:47:47.592 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:47:47.592 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":26,"fsid":"ce68f82e-ec5f-4205-9fd5-bdfdf6ef31e2","created":"2024-04-17T08:46:08.353546+0000","modified":"2024-04-17T08:47:15.280634+0000","last_up_change":"2024-04-17T08:46:20.738799+0000","last_in_change":"2024-04-17T08:46:11.210050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T08:46:21.386856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T08:46:31.812460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T08:46:32.555559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T08:46:36.258078+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"682f0192-187c-404e-bc7a-b6b4e23825e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6819","nonce":3603799291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6823","nonce":3603799291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6831","nonce":3603799291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6827","nonce":3603799291}]},"public_addr":"172.21.15.152:6819/3603799291","cluster_addr":"172.21.15.152:6823/3603799291","heartbeat_back_addr":"172.21.15.152:6831/3603799291","heartbeat_front_addr":"172.21.15.152:6827/3603799291","state":["exists","up"]},{"osd":1,"uuid":"f0fe8fef-60ec-4a39-83b6-2fa6a5adb0f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6801","nonce":4133383142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6803","nonce":4133383142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6807","nonce":4133383142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6805","nonce":4133383142}]},"public_addr":"172.21.15.152:6801/4133383142","cluster_addr":"172.21.15.152:6803/4133383142","heartbeat_back_addr":"172.21.15.152:6807/4133383142","heartbeat_front_addr":"172.21.15.152:6805/4133383142","state":["exists","up"]},{"osd":2,"uuid":"35f36d9c-5245-4431-a618-f4df0fa380ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6809","nonce":3826143898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6811","nonce":3826143898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6815","nonce":3826143898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6813","nonce":3826143898}]},"public_addr":"172.21.15.152:6809/3826143898","cluster_addr":"172.21.15.152:6811/3826143898","heartbeat_back_addr":"172.21.15.152:6815/3826143898","heartbeat_front_addr":"172.21.15.152:6813/3826143898","state":["exists","up"]},{"osd":3,"uuid":"96e56ca5-15b4-4895-9b79-da2c92043159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6818","nonce":165717826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6822","nonce":165717826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6830","nonce":165717826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6826","nonce":165717826}]},"public_addr":"172.21.15.152:6818/165717826","cluster_addr":"172.21.15.152:6822/165717826","heartbeat_back_addr":"172.21.15.152:6830/165717826","heartbeat_front_addr":"172.21.15.152:6826/165717826","state":["exists","up"]},{"osd":4,"uuid":"f5aa10a4-9ff9-41fe-a5c9-15326f982cc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6817","nonce":4080159297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6819","nonce":4080159297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6823","nonce":4080159297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6821","nonce":4080159297}]},"public_addr":"172.21.15.196:6817/4080159297","cluster_addr":"172.21.15.196:6819/4080159297","heartbeat_back_addr":"172.21.15.196:6823/4080159297","heartbeat_front_addr":"172.21.15.196:6821/4080159297","state":["exists","up"]},{"osd":5,"uuid":"42bab884-3476-47ae-ac65-935fa6e0f055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6801","nonce":3519444232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6803","nonce":3519444232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6807","nonce":3519444232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6805","nonce":3519444232}]},"public_addr":"172.21.15.196:6801/3519444232","cluster_addr":"172.21.15.196:6803/3519444232","heartbeat_back_addr":"172.21.15.196:6807/3519444232","heartbeat_front_addr":"172.21.15.196:6805/3519444232","state":["exists","up"]},{"osd":6,"uuid":"460b6167-f57b-4224-9c92-cfc9b80bbe99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6809","nonce":275739834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6811","nonce":275739834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6815","nonce":275739834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6813","nonce":275739834}]},"public_addr":"172.21.15.196:6809/275739834","cluster_addr":"172.21.15.196:6811/275739834","heartbeat_back_addr":"172.21.15.196:6815/275739834","heartbeat_front_addr":"172.21.15.196:6813/275739834","state":["exists","up"]},{"osd":7,"uuid":"d695643f-5e07-4e2a-a646-c06bd97b6650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6825","nonce":307626968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6827","nonce":307626968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6831","nonce":307626968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6829","nonce":307626968}]},"public_addr":"172.21.15.196:6825/307626968","cluster_addr":"172.21.15.196:6827/307626968","heartbeat_back_addr":"172.21.15.196:6831/307626968","heartbeat_front_addr":"172.21.15.196:6829/307626968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.293257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.964533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.248895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.010000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.832554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.743704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930171+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930962+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T08:47:47.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.589+0000 7fbda2a00640 1 -- 172.21.15.152:0/3239392737 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fbd7c068380 msgr2=0x7fbd7c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:47.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.589+0000 7fbda2a00640 1 --2- 172.21.15.152:0/3239392737 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fbd7c068380 0x7fbd7c06a840 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c0d2960 tx=0x7fbd88009040 comp rx=0 tx=0).stop 2024-04-17T08:47:47.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.589+0000 7fbda2a00640 1 -- 172.21.15.152:0/3239392737 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd9c070eb0 msgr2=0x7fbd9c167e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:47.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.589+0000 7fbda2a00640 1 --2- 172.21.15.152:0/3239392737 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd9c070eb0 0x7fbd9c167e80 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fbd900190b0 tx=0x7fbd90019240 comp rx=0 tx=0).stop 2024-04-17T08:47:47.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.589+0000 7fbda2a00640 1 -- 172.21.15.152:0/3239392737 shutdown_connections 2024-04-17T08:47:47.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.589+0000 7fbda2a00640 1 --2- 172.21.15.152:0/3239392737 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd9c160980 0x7fbd9c154180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:47.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.589+0000 7fbda2a00640 1 --2- 172.21.15.152:0/3239392737 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fbd7c068380 0x7fbd7c06a840 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:47.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.589+0000 7fbda2a00640 1 --2- 172.21.15.152:0/3239392737 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd9c0cce60 0x7fbd9c06ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:47.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.589+0000 7fbda2a00640 1 --2- 172.21.15.152:0/3239392737 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd9c070eb0 0x7fbd9c167e80 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:47.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.589+0000 7fbda2a00640 1 -- 172.21.15.152:0/3239392737 >> 172.21.15.152:0/3239392737 conn(0x7fbd9c0b3e40 msgr2=0x7fbd9c15b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:47.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.589+0000 7fbda2a00640 1 -- 172.21.15.152:0/3239392737 shutdown_connections 2024-04-17T08:47:47.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.593+0000 7fbda2a00640 1 -- 172.21.15.152:0/3239392737 wait complete. 2024-04-17T08:47:47.613 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-17T08:47:47.613 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T08:47:47.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.745+0000 7f01c7a00640 1 Processor -- start 2024-04-17T08:47:47.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.745+0000 7f01c7a00640 1 -- start start 2024-04-17T08:47:47.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.745+0000 7f01c7a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f01c015a010 0x7f01c00d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:47.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.745+0000 7f01c7a00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f01c0160720 0x7f01c00d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:47.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.745+0000 7f01c7a00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01c0160d20 con 0x7f01c015d710 2024-04-17T08:47:47.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.745+0000 7f01c7a00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f01c015d280 con 0x7f01c0160720 2024-04-17T08:47:47.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.745+0000 7f01c7a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f01c015c9d0 con 0x7f01c015a010 2024-04-17T08:47:47.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.745+0000 7f01c5a00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f01c0160720 0x7f01c00d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:47.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.745+0000 7f01c5a00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f01c0160720 0x7f01c00d08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60560/0 (socket says 172.21.15.152:60560) 2024-04-17T08:47:47.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.745+0000 7f01c5a00640 1 -- 172.21.15.152:0/2249859397 learned_addr learned my addr 172.21.15.152:0/2249859397 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:47.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.745+0000 7f01c5000640 1 --2- 172.21.15.152:0/2249859397 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f01c015a010 0x7f01c00d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:47.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.745+0000 7f01c5a00640 1 -- 172.21.15.152:0/2249859397 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f01c015a010 msgr2=0x7f01c00d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:47.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.745+0000 7f01c5a00640 1 --2- 172.21.15.152:0/2249859397 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f01c015a010 0x7f01c00d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:47.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.745+0000 7f01c5a00640 1 -- 172.21.15.152:0/2249859397 >> v1:172.21.15.196:6789/0 conn(0x7f01c015d710 legacy=0x7f01c0160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:47.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.745+0000 7f01c5a00640 1 -- 172.21.15.152:0/2249859397 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01c015cc30 con 0x7f01c0160720 2024-04-17T08:47:47.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.745+0000 7f01c5000640 1 --2- 172.21.15.152:0/2249859397 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f01c015a010 0x7f01c00d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:47:47.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.749+0000 7f01c5a00640 1 --2- 172.21.15.152:0/2249859397 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f01c0160720 0x7f01c00d08a0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f01b8009870 tx=0x7f01b801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dc18f2206331c2f server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:47.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.749+0000 7f01bf400640 1 -- 172.21.15.152:0/2249859397 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b80b1070 con 0x7f01c0160720 2024-04-17T08:47:47.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.749+0000 7f01bf400640 1 -- 172.21.15.152:0/2249859397 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01b80ac600 con 0x7f01c0160720 2024-04-17T08:47:47.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.749+0000 7f01bf400640 1 -- 172.21.15.152:0/2249859397 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b80ac9d0 con 0x7f01c0160720 2024-04-17T08:47:47.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.749+0000 7f01c7a00640 1 -- 172.21.15.152:0/2249859397 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f01c0160720 msgr2=0x7f01c00d08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:47.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.749+0000 7f01c7a00640 1 --2- 172.21.15.152:0/2249859397 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f01c0160720 0x7f01c00d08a0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f01b8009870 tx=0x7f01b801c4d0 comp rx=0 tx=0).stop 2024-04-17T08:47:47.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.749+0000 7f01c7a00640 1 -- 172.21.15.152:0/2249859397 shutdown_connections 2024-04-17T08:47:47.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.749+0000 7f01c7a00640 1 --2- 172.21.15.152:0/2249859397 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f01c0160720 0x7f01c00d08a0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:47.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.749+0000 7f01c7a00640 1 --2- 172.21.15.152:0/2249859397 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f01c015a010 0x7f01c00d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:47.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.749+0000 7f01c7a00640 1 -- 172.21.15.152:0/2249859397 >> 172.21.15.152:0/2249859397 conn(0x7f01c00b3350 msgr2=0x7f01c00b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:47.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.749+0000 7f01c7a00640 1 -- 172.21.15.152:0/2249859397 shutdown_connections 2024-04-17T08:47:47.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.749+0000 7f01c7a00640 1 -- 172.21.15.152:0/2249859397 wait complete. 2024-04-17T08:47:47.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.753+0000 7f01c7a00640 1 Processor -- start 2024-04-17T08:47:47.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.753+0000 7f01c7a00640 1 -- start start 2024-04-17T08:47:47.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.753+0000 7f01c7a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f01c015a010 0x7f01c00afcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:47.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.753+0000 7f01c7a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f01c015d710 0x7f01c00999b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:47.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.753+0000 7f01c7a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f01c0160720 0x7f01c0152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:47.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.753+0000 7f01c7a00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f01c015e780 con 0x7f01c0160720 2024-04-17T08:47:47.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.753+0000 7f01c7a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f01c015e600 con 0x7f01c015a010 2024-04-17T08:47:47.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.753+0000 7f01c7a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f01c015e900 con 0x7f01c015d710 2024-04-17T08:47:47.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.753+0000 7f01c5a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f01c0160720 0x7f01c0152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:47.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.753+0000 7f01c5a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f01c0160720 0x7f01c0152ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60572/0 (socket says 172.21.15.152:60572) 2024-04-17T08:47:47.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.753+0000 7f01c5a00640 1 -- 172.21.15.152:0/541272457 learned_addr learned my addr 172.21.15.152:0/541272457 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:47.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.753+0000 7f01c5000640 1 --2- 172.21.15.152:0/541272457 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f01c015a010 0x7f01c00afcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:47.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.753+0000 7f01bfe00640 1 --2- 172.21.15.152:0/541272457 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f01c015d710 0x7f01c00999b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:47.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.753+0000 7f01c5a00640 1 -- 172.21.15.152:0/541272457 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f01c015d710 msgr2=0x7f01c00999b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:47.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.753+0000 7f01c5a00640 1 --2- 172.21.15.152:0/541272457 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f01c015d710 0x7f01c00999b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:47.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.753+0000 7f01c5a00640 1 -- 172.21.15.152:0/541272457 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f01c015a010 msgr2=0x7f01c00afcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:47.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.753+0000 7f01c5a00640 1 --2- 172.21.15.152:0/541272457 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f01c015a010 0x7f01c00afcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:47.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.753+0000 7f01c5a00640 1 -- 172.21.15.152:0/541272457 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01c01656f0 con 0x7f01c0160720 2024-04-17T08:47:47.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.753+0000 7f01bfe00640 1 --2- 172.21.15.152:0/541272457 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f01c015d710 0x7f01c00999b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:47.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.753+0000 7f01c5a00640 1 --2- 172.21.15.152:0/541272457 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f01c0160720 0x7f01c0152ce0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f01b801a100 tx=0x7f01b801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:47.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.753+0000 7f01bcc00640 1 -- 172.21.15.152:0/541272457 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b80bc070 con 0x7f01c0160720 2024-04-17T08:47:47.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.753+0000 7f01bcc00640 1 -- 172.21.15.152:0/541272457 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01b80b7610 con 0x7f01c0160720 2024-04-17T08:47:47.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.753+0000 7f01bcc00640 1 -- 172.21.15.152:0/541272457 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b80b1040 con 0x7f01c0160720 2024-04-17T08:47:47.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.753+0000 7f01c7a00640 1 -- 172.21.15.152:0/541272457 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01c01659d0 con 0x7f01c0160720 2024-04-17T08:47:47.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.753+0000 7f01c7a00640 1 -- 172.21.15.152:0/541272457 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01c015bf90 con 0x7f01c0160720 2024-04-17T08:47:47.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.757+0000 7f01c7a00640 1 -- 172.21.15.152:0/541272457 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01c0068a30 con 0x7f01c0160720 2024-04-17T08:47:47.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.757+0000 7f01bcc00640 1 -- 172.21.15.152:0/541272457 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f01b80ac4c0 con 0x7f01c0160720 2024-04-17T08:47:47.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.757+0000 7f01bcc00640 1 --2- 172.21.15.152:0/541272457 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f01a00683b0 0x7f01a006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:47.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.757+0000 7f01bcc00640 1 -- 172.21.15.152:0/541272457 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f01b81205b0 con 0x7f01c0160720 2024-04-17T08:47:47.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.757+0000 7f01c5000640 1 --2- 172.21.15.152:0/541272457 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f01a00683b0 0x7f01a006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:47.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.757+0000 7f01c5000640 1 --2- 172.21.15.152:0/541272457 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f01a00683b0 0x7f01a006a870 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f01c006cb30 tx=0x7f01b0007810 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:47.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.761+0000 7f01bcc00640 1 -- 172.21.15.152:0/541272457 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f01b8016150 con 0x7f01c0160720 2024-04-17T08:47:47.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.953+0000 7f01c7a00640 1 -- 172.21.15.152:0/541272457 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f01c00739d0 con 0x7f01c0160720 2024-04-17T08:47:47.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.953+0000 7f01bcc00640 1 -- 172.21.15.152:0/541272457 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5207 (secure 0 0 0) 0x7f01b80f0060 con 0x7f01c0160720 2024-04-17T08:47:47.957 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:47:47.957 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6834/2461981726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":2461981726},{"type":"v1","addr":"172.21.15.196:6834","nonce":2461981726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6835/3397289430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6833","nonce":3397289430},{"type":"v1","addr":"172.21.15.196:6835","nonce":3397289430}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/2491486613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2491486613},{"type":"v1","addr":"172.21.15.152:6836","nonce":2491486613}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-17T08:46:33.607720+0000","modified":"2024-04-17T08:46:57.830153+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6837/3890159871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":3890159871},{"type":"v1","addr":"172.21.15.152:6837","nonce":3890159871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-04-17T08:47:47.957 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 9 2024-04-17T08:47:47.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.957+0000 7f01c7a00640 1 -- 172.21.15.152:0/541272457 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f01a00683b0 msgr2=0x7f01a006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:47.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.957+0000 7f01c7a00640 1 --2- 172.21.15.152:0/541272457 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f01a00683b0 0x7f01a006a870 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f01c006cb30 tx=0x7f01b0007810 comp rx=0 tx=0).stop 2024-04-17T08:47:47.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.957+0000 7f01c7a00640 1 -- 172.21.15.152:0/541272457 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f01c0160720 msgr2=0x7f01c0152ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:47.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.957+0000 7f01c7a00640 1 --2- 172.21.15.152:0/541272457 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f01c0160720 0x7f01c0152ce0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f01b801a100 tx=0x7f01b801ad10 comp rx=0 tx=0).stop 2024-04-17T08:47:47.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.957+0000 7f01c7a00640 1 -- 172.21.15.152:0/541272457 shutdown_connections 2024-04-17T08:47:47.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.957+0000 7f01c7a00640 1 --2- 172.21.15.152:0/541272457 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f01c0160720 0x7f01c0152ce0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:47.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.957+0000 7f01c7a00640 1 --2- 172.21.15.152:0/541272457 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f01a00683b0 0x7f01a006a870 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:47.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.957+0000 7f01c7a00640 1 --2- 172.21.15.152:0/541272457 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f01c015d710 0x7f01c00999b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:47.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.957+0000 7f01c7a00640 1 --2- 172.21.15.152:0/541272457 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f01c015a010 0x7f01c00afcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:47.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.957+0000 7f01c7a00640 1 -- 172.21.15.152:0/541272457 >> 172.21.15.152:0/541272457 conn(0x7f01c00b3350 msgr2=0x7f01c015a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:47.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.957+0000 7f01c7a00640 1 -- 172.21.15.152:0/541272457 shutdown_connections 2024-04-17T08:47:47.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:47.957+0000 7f01c7a00640 1 -- 172.21.15.152:0/541272457 wait complete. 2024-04-17T08:47:47.979 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T08:47:48.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.113+0000 7f34f6800640 1 Processor -- start 2024-04-17T08:47:48.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.113+0000 7f34f6800640 1 -- start start 2024-04-17T08:47:48.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.113+0000 7f34f6800640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f34f0147690 0x7f34f01622e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:48.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.113+0000 7f34f6800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34f0147a90 0x7f34f0071790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:48.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.113+0000 7f34f6800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34f0162820 con 0x7f34f0071cd0 2024-04-17T08:47:48.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.113+0000 7f34f6800640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f34f0072130 con 0x7f34f0147690 2024-04-17T08:47:48.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.113+0000 7f34f6800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f34f0162aa0 con 0x7f34f0147a90 2024-04-17T08:47:48.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.113+0000 7f34ef400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f34f0147690 0x7f34f01622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:48.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.113+0000 7f34ef400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f34f0147690 0x7f34f01622e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60580/0 (socket says 172.21.15.152:60580) 2024-04-17T08:47:48.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.113+0000 7f34ef400640 1 -- 172.21.15.152:0/635253751 learned_addr learned my addr 172.21.15.152:0/635253751 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:48.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.113+0000 7f34eea00640 1 --2- 172.21.15.152:0/635253751 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34f0147a90 0x7f34f0071790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:48.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.113+0000 7f34ef400640 1 -- 172.21.15.152:0/635253751 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34f0147a90 msgr2=0x7f34f0071790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:48.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.113+0000 7f34ef400640 1 --2- 172.21.15.152:0/635253751 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34f0147a90 0x7f34f0071790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:48.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.113+0000 7f34ef400640 1 -- 172.21.15.152:0/635253751 >> v1:172.21.15.196:6789/0 conn(0x7f34f0071cd0 legacy=0x7f34f015ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:48.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.113+0000 7f34ef400640 1 -- 172.21.15.152:0/635253751 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34f0162d80 con 0x7f34f0147690 2024-04-17T08:47:48.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.117+0000 7f34ef400640 1 --2- 172.21.15.152:0/635253751 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34f0147690 0x7f34f01622e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f34e0009870 tx=0x7f34e001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e28a4f294280975c server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:48.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.117+0000 7f34ee000640 1 -- 172.21.15.152:0/635253751 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34e00b2070 con 0x7f34f0147690 2024-04-17T08:47:48.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.117+0000 7f34ee000640 1 -- 172.21.15.152:0/635253751 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34e00a9070 con 0x7f34f0147690 2024-04-17T08:47:48.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.117+0000 7f34ee000640 1 -- 172.21.15.152:0/635253751 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34e00ad880 con 0x7f34f0147690 2024-04-17T08:47:48.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.117+0000 7f34f6800640 1 -- 172.21.15.152:0/635253751 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34f0147690 msgr2=0x7f34f01622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:48.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.117+0000 7f34f6800640 1 --2- 172.21.15.152:0/635253751 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34f0147690 0x7f34f01622e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f34e0009870 tx=0x7f34e001c560 comp rx=0 tx=0).stop 2024-04-17T08:47:48.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.117+0000 7f34f6800640 1 -- 172.21.15.152:0/635253751 shutdown_connections 2024-04-17T08:47:48.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.117+0000 7f34f6800640 1 --2- 172.21.15.152:0/635253751 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34f0147a90 0x7f34f0071790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:48.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.117+0000 7f34f6800640 1 --2- 172.21.15.152:0/635253751 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34f0147690 0x7f34f01622e0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:48.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.117+0000 7f34f6800640 1 -- 172.21.15.152:0/635253751 >> 172.21.15.152:0/635253751 conn(0x7f34f00d2350 msgr2=0x7f34f00d2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:48.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.117+0000 7f34f6800640 1 -- 172.21.15.152:0/635253751 shutdown_connections 2024-04-17T08:47:48.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.117+0000 7f34f6800640 1 -- 172.21.15.152:0/635253751 wait complete. 2024-04-17T08:47:48.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.121+0000 7f34f6800640 1 Processor -- start 2024-04-17T08:47:48.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.121+0000 7f34f6800640 1 -- start start 2024-04-17T08:47:48.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.121+0000 7f34f6800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34f0071cd0 0x7f34f015e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:48.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.121+0000 7f34f6800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34f0147690 0x7f34f01440f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:48.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.121+0000 7f34f6800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f34f0147a90 0x7f34f00cd980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:48.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.121+0000 7f34f6800640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f34f016ba10 con 0x7f34f0147690 2024-04-17T08:47:48.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.121+0000 7f34f6800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f34f016b890 con 0x7f34f0147a90 2024-04-17T08:47:48.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.121+0000 7f34f6800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f34f016bb90 con 0x7f34f0071cd0 2024-04-17T08:47:48.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.121+0000 7f34eea00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34f0147690 0x7f34f01440f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:48.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.121+0000 7f34eea00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34f0147690 0x7f34f01440f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60582/0 (socket says 172.21.15.152:60582) 2024-04-17T08:47:48.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.121+0000 7f34eea00640 1 -- 172.21.15.152:0/3482110171 learned_addr learned my addr 172.21.15.152:0/3482110171 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:48.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.121+0000 7f34ef400640 1 --2- 172.21.15.152:0/3482110171 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34f0071cd0 0x7f34f015e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:48.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.121+0000 7f34efe00640 1 --2- 172.21.15.152:0/3482110171 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f34f0147a90 0x7f34f00cd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:48.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.121+0000 7f34eea00640 1 -- 172.21.15.152:0/3482110171 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34f0071cd0 msgr2=0x7f34f015e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:48.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.121+0000 7f34eea00640 1 --2- 172.21.15.152:0/3482110171 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34f0071cd0 0x7f34f015e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:48.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.121+0000 7f34eea00640 1 -- 172.21.15.152:0/3482110171 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f34f0147a90 msgr2=0x7f34f00cd980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:48.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.121+0000 7f34eea00640 1 --2- 172.21.15.152:0/3482110171 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f34f0147a90 0x7f34f00cd980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:48.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.121+0000 7f34eea00640 1 -- 172.21.15.152:0/3482110171 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34f00b7d60 con 0x7f34f0147690 2024-04-17T08:47:48.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.121+0000 7f34eea00640 1 --2- 172.21.15.152:0/3482110171 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34f0147690 0x7f34f01440f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f34d800d800 tx=0x7f34d800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:48.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.121+0000 7f34e7400640 1 -- 172.21.15.152:0/3482110171 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d800b6c0 con 0x7f34f0147690 2024-04-17T08:47:48.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.121+0000 7f34e7400640 1 -- 172.21.15.152:0/3482110171 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34d8019070 con 0x7f34f0147690 2024-04-17T08:47:48.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.121+0000 7f34e7400640 1 -- 172.21.15.152:0/3482110171 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d800ba60 con 0x7f34f0147690 2024-04-17T08:47:48.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.121+0000 7f34f6800640 1 -- 172.21.15.152:0/3482110171 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34f00b8040 con 0x7f34f0147690 2024-04-17T08:47:48.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.121+0000 7f34f6800640 1 -- 172.21.15.152:0/3482110171 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34f01438f0 con 0x7f34f0147690 2024-04-17T08:47:48.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.121+0000 7f34f6800640 1 -- 172.21.15.152:0/3482110171 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34f0068a30 con 0x7f34f0147690 2024-04-17T08:47:48.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.125+0000 7f34e7400640 1 -- 172.21.15.152:0/3482110171 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f34d800bc00 con 0x7f34f0147690 2024-04-17T08:47:48.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.125+0000 7f34e7400640 1 --2- 172.21.15.152:0/3482110171 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f34cc068380 0x7f34cc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:48.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.125+0000 7f34e7400640 1 -- 172.21.15.152:0/3482110171 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f34d8087140 con 0x7f34f0147690 2024-04-17T08:47:48.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.125+0000 7f34ef400640 1 --2- 172.21.15.152:0/3482110171 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f34cc068380 0x7f34cc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:48.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.125+0000 7f34ef400640 1 --2- 172.21.15.152:0/3482110171 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f34cc068380 0x7f34cc06a840 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f34e00af000 tx=0x7f34e00a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:48.131 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.129+0000 7f34e7400640 1 -- 172.21.15.152:0/3482110171 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f34d8056c80 con 0x7f34f0147690 2024-04-17T08:47:48.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.317+0000 7f34f6800640 1 -- 172.21.15.152:0/3482110171 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f34f00b3690 con 0x7f34f0147690 2024-04-17T08:47:48.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.317+0000 7f34e7400640 1 -- 172.21.15.152:0/3482110171 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5207 (secure 0 0 0) 0x7f34d805af80 con 0x7f34f0147690 2024-04-17T08:47:48.321 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:47:48.321 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6834/2461981726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":2461981726},{"type":"v1","addr":"172.21.15.196:6834","nonce":2461981726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6835/3397289430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6833","nonce":3397289430},{"type":"v1","addr":"172.21.15.196:6835","nonce":3397289430}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/2491486613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2491486613},{"type":"v1","addr":"172.21.15.152:6836","nonce":2491486613}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-17T08:46:33.607720+0000","modified":"2024-04-17T08:46:57.830153+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6837/3890159871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":3890159871},{"type":"v1","addr":"172.21.15.152:6837","nonce":3890159871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-04-17T08:47:48.321 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 9 2024-04-17T08:47:48.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.321+0000 7f34f6800640 1 -- 172.21.15.152:0/3482110171 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f34cc068380 msgr2=0x7f34cc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:48.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.321+0000 7f34f6800640 1 --2- 172.21.15.152:0/3482110171 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f34cc068380 0x7f34cc06a840 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f34e00af000 tx=0x7f34e00a7000 comp rx=0 tx=0).stop 2024-04-17T08:47:48.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.321+0000 7f34f6800640 1 -- 172.21.15.152:0/3482110171 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34f0147690 msgr2=0x7f34f01440f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:48.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.321+0000 7f34f6800640 1 --2- 172.21.15.152:0/3482110171 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34f0147690 0x7f34f01440f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f34d800d800 tx=0x7f34d800dcc0 comp rx=0 tx=0).stop 2024-04-17T08:47:48.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.321+0000 7f34f6800640 1 -- 172.21.15.152:0/3482110171 shutdown_connections 2024-04-17T08:47:48.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.321+0000 7f34f6800640 1 --2- 172.21.15.152:0/3482110171 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f34f0147a90 0x7f34f00cd980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:48.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.321+0000 7f34f6800640 1 --2- 172.21.15.152:0/3482110171 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34f0147690 0x7f34f01440f0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:48.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.321+0000 7f34f6800640 1 --2- 172.21.15.152:0/3482110171 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f34cc068380 0x7f34cc06a840 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:48.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.321+0000 7f34f6800640 1 --2- 172.21.15.152:0/3482110171 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34f0071cd0 0x7f34f015e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:48.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.321+0000 7f34f6800640 1 -- 172.21.15.152:0/3482110171 >> 172.21.15.152:0/3482110171 conn(0x7f34f00d2350 msgr2=0x7f34f00d0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:48.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.321+0000 7f34f6800640 1 -- 172.21.15.152:0/3482110171 shutdown_connections 2024-04-17T08:47:48.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.321+0000 7f34f6800640 1 -- 172.21.15.152:0/3482110171 wait complete. 2024-04-17T08:47:48.343 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T08:47:48.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.477+0000 7f1927e00640 1 Processor -- start 2024-04-17T08:47:48.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.477+0000 7f1927e00640 1 -- start start 2024-04-17T08:47:48.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.477+0000 7f1927e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f19280b5ac0 0x7f19280d21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:48.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.477+0000 7f1927e00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f192815f4c0 0x7f192806d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:48.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.477+0000 7f1927e00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f192815fb00 con 0x7f19280d2710 2024-04-17T08:47:48.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.477+0000 7f1927e00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f19280d2b70 con 0x7f192815f4c0 2024-04-17T08:47:48.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.477+0000 7f1927e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f19280b26b0 con 0x7f19280b5ac0 2024-04-17T08:47:48.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.477+0000 7f1927400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f192815f4c0 0x7f192806d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:48.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.477+0000 7f1927400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f192815f4c0 0x7f192806d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50526/0 (socket says 172.21.15.152:50526) 2024-04-17T08:47:48.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.477+0000 7f1927400640 1 -- 172.21.15.152:0/972949870 learned_addr learned my addr 172.21.15.152:0/972949870 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:48.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.481+0000 7f1926a00640 1 --2- 172.21.15.152:0/972949870 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f19280b5ac0 0x7f19280d21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:48.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.481+0000 7f1927400640 1 -- 172.21.15.152:0/972949870 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f19280b5ac0 msgr2=0x7f19280d21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:48.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.481+0000 7f1927400640 1 --2- 172.21.15.152:0/972949870 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f19280b5ac0 0x7f19280d21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:48.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.481+0000 7f1927400640 1 -- 172.21.15.152:0/972949870 >> v1:172.21.15.196:6789/0 conn(0x7f19280d2710 legacy=0x7f192815edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:48.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.481+0000 7f1927400640 1 -- 172.21.15.152:0/972949870 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19280b1d80 con 0x7f192815f4c0 2024-04-17T08:47:48.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.481+0000 7f1927400640 1 --2- 172.21.15.152:0/972949870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f192815f4c0 0x7f192806d860 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f1920009e50 tx=0x7f192001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62a30b07f1c7b416 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:48.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.481+0000 7f1926000640 1 -- 172.21.15.152:0/972949870 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19200ac020 con 0x7f192815f4c0 2024-04-17T08:47:48.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.481+0000 7f1926000640 1 -- 172.21.15.152:0/972949870 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19200a6430 con 0x7f192815f4c0 2024-04-17T08:47:48.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.481+0000 7f1926000640 1 -- 172.21.15.152:0/972949870 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19200a6800 con 0x7f192815f4c0 2024-04-17T08:47:48.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.481+0000 7f1927e00640 1 -- 172.21.15.152:0/972949870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f192815f4c0 msgr2=0x7f192806d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:48.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.481+0000 7f1927e00640 1 --2- 172.21.15.152:0/972949870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f192815f4c0 0x7f192806d860 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f1920009e50 tx=0x7f192001ca30 comp rx=0 tx=0).stop 2024-04-17T08:47:48.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.485+0000 7f1927e00640 1 -- 172.21.15.152:0/972949870 shutdown_connections 2024-04-17T08:47:48.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.485+0000 7f1927e00640 1 --2- 172.21.15.152:0/972949870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f192815f4c0 0x7f192806d860 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:48.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.485+0000 7f1927e00640 1 --2- 172.21.15.152:0/972949870 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f19280b5ac0 0x7f19280d21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:48.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.485+0000 7f1927e00640 1 -- 172.21.15.152:0/972949870 >> 172.21.15.152:0/972949870 conn(0x7f19280b7690 msgr2=0x7f19280b7aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:48.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.485+0000 7f1927e00640 1 -- 172.21.15.152:0/972949870 shutdown_connections 2024-04-17T08:47:48.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.485+0000 7f1927e00640 1 -- 172.21.15.152:0/972949870 wait complete. 2024-04-17T08:47:48.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.485+0000 7f1927e00640 1 Processor -- start 2024-04-17T08:47:48.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.485+0000 7f1927e00640 1 -- start start 2024-04-17T08:47:48.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.485+0000 7f1927e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f19280b5ac0 0x7f19281fae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:48.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.485+0000 7f1927e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f19280d2710 0x7f19281fb390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:48.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.485+0000 7f1927e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f192815f4c0 0x7f19281fb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:48.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.485+0000 7f1927e00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f19280b2ca0 con 0x7f192815f4c0 2024-04-17T08:47:48.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.485+0000 7f1927e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f19280b2b20 con 0x7f19280b5ac0 2024-04-17T08:47:48.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.485+0000 7f1927e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f192816b580 con 0x7f19280d2710 2024-04-17T08:47:48.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.485+0000 7f1927400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f192815f4c0 0x7f19281fb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:48.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.485+0000 7f1927400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f192815f4c0 0x7f19281fb8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50528/0 (socket says 172.21.15.152:50528) 2024-04-17T08:47:48.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.485+0000 7f1927400640 1 -- 172.21.15.152:0/394762813 learned_addr learned my addr 172.21.15.152:0/394762813 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:48.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.485+0000 7f1926a00640 1 --2- 172.21.15.152:0/394762813 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f19280b5ac0 0x7f19281fae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:48.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.485+0000 7f191fe00640 1 --2- 172.21.15.152:0/394762813 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f19280d2710 0x7f19281fb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:48.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.485+0000 7f1927400640 1 -- 172.21.15.152:0/394762813 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f19280d2710 msgr2=0x7f19281fb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:48.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.485+0000 7f1927400640 1 --2- 172.21.15.152:0/394762813 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f19280d2710 0x7f19281fb390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:48.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.485+0000 7f1927400640 1 -- 172.21.15.152:0/394762813 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f19280b5ac0 msgr2=0x7f19281fae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:48.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.485+0000 7f1927400640 1 --2- 172.21.15.152:0/394762813 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f19280b5ac0 0x7f19281fae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:48.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.485+0000 7f1927400640 1 -- 172.21.15.152:0/394762813 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f192815e0e0 con 0x7f192815f4c0 2024-04-17T08:47:48.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.485+0000 7f1927400640 1 --2- 172.21.15.152:0/394762813 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f192815f4c0 0x7f19281fb8d0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f19200ab040 tx=0x7f19200197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:48.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.485+0000 7f191ea00640 1 -- 172.21.15.152:0/394762813 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19200ac040 con 0x7f192815f4c0 2024-04-17T08:47:48.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.485+0000 7f191ea00640 1 -- 172.21.15.152:0/394762813 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19200b1620 con 0x7f192815f4c0 2024-04-17T08:47:48.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.485+0000 7f191ea00640 1 -- 172.21.15.152:0/394762813 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1920009510 con 0x7f192815f4c0 2024-04-17T08:47:48.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.485+0000 7f1927e00640 1 -- 172.21.15.152:0/394762813 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f192815d840 con 0x7f192815f4c0 2024-04-17T08:47:48.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.489+0000 7f1927e00640 1 -- 172.21.15.152:0/394762813 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f192815de00 con 0x7f192815f4c0 2024-04-17T08:47:48.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.489+0000 7f1927e00640 1 -- 172.21.15.152:0/394762813 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1928075c10 con 0x7f192815f4c0 2024-04-17T08:47:48.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.489+0000 7f191ea00640 1 -- 172.21.15.152:0/394762813 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f19200af020 con 0x7f192815f4c0 2024-04-17T08:47:48.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.489+0000 7f191ea00640 1 --2- 172.21.15.152:0/394762813 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1904068380 0x7f190406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:48.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.489+0000 7f191ea00640 1 -- 172.21.15.152:0/394762813 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f1920120de0 con 0x7f192815f4c0 2024-04-17T08:47:48.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.489+0000 7f1926a00640 1 --2- 172.21.15.152:0/394762813 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1904068380 0x7f190406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:48.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.489+0000 7f1926a00640 1 --2- 172.21.15.152:0/394762813 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1904068380 0x7f190406a840 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1918007a60 tx=0x7f1918008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:48.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.493+0000 7f191ea00640 1 -- 172.21.15.152:0/394762813 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f19200c1060 con 0x7f192815f4c0 2024-04-17T08:47:48.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.649+0000 7f1927e00640 1 -- 172.21.15.152:0/394762813 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1928156170 con 0x7f192815f4c0 2024-04-17T08:47:48.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.653+0000 7f191ea00640 1 -- 172.21.15.152:0/394762813 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18972 (secure 0 0 0) 0x7f1920016620 con 0x7f192815f4c0 2024-04-17T08:47:48.654 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:47:48.654 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":26,"fsid":"ce68f82e-ec5f-4205-9fd5-bdfdf6ef31e2","created":"2024-04-17T08:46:08.353546+0000","modified":"2024-04-17T08:47:15.280634+0000","last_up_change":"2024-04-17T08:46:20.738799+0000","last_in_change":"2024-04-17T08:46:11.210050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T08:46:21.386856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T08:46:31.812460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T08:46:32.555559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T08:46:36.258078+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"682f0192-187c-404e-bc7a-b6b4e23825e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6819","nonce":3603799291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6823","nonce":3603799291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6831","nonce":3603799291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6827","nonce":3603799291}]},"public_addr":"172.21.15.152:6819/3603799291","cluster_addr":"172.21.15.152:6823/3603799291","heartbeat_back_addr":"172.21.15.152:6831/3603799291","heartbeat_front_addr":"172.21.15.152:6827/3603799291","state":["exists","up"]},{"osd":1,"uuid":"f0fe8fef-60ec-4a39-83b6-2fa6a5adb0f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6801","nonce":4133383142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6803","nonce":4133383142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6807","nonce":4133383142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6805","nonce":4133383142}]},"public_addr":"172.21.15.152:6801/4133383142","cluster_addr":"172.21.15.152:6803/4133383142","heartbeat_back_addr":"172.21.15.152:6807/4133383142","heartbeat_front_addr":"172.21.15.152:6805/4133383142","state":["exists","up"]},{"osd":2,"uuid":"35f36d9c-5245-4431-a618-f4df0fa380ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6809","nonce":3826143898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6811","nonce":3826143898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6815","nonce":3826143898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6813","nonce":3826143898}]},"public_addr":"172.21.15.152:6809/3826143898","cluster_addr":"172.21.15.152:6811/3826143898","heartbeat_back_addr":"172.21.15.152:6815/3826143898","heartbeat_front_addr":"172.21.15.152:6813/3826143898","state":["exists","up"]},{"osd":3,"uuid":"96e56ca5-15b4-4895-9b79-da2c92043159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6818","nonce":165717826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6822","nonce":165717826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6830","nonce":165717826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6826","nonce":165717826}]},"public_addr":"172.21.15.152:6818/165717826","cluster_addr":"172.21.15.152:6822/165717826","heartbeat_back_addr":"172.21.15.152:6830/165717826","heartbeat_front_addr":"172.21.15.152:6826/165717826","state":["exists","up"]},{"osd":4,"uuid":"f5aa10a4-9ff9-41fe-a5c9-15326f982cc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6817","nonce":4080159297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6819","nonce":4080159297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6823","nonce":4080159297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6821","nonce":4080159297}]},"public_addr":"172.21.15.196:6817/4080159297","cluster_addr":"172.21.15.196:6819/4080159297","heartbeat_back_addr":"172.21.15.196:6823/4080159297","heartbeat_front_addr":"172.21.15.196:6821/4080159297","state":["exists","up"]},{"osd":5,"uuid":"42bab884-3476-47ae-ac65-935fa6e0f055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6801","nonce":3519444232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6803","nonce":3519444232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6807","nonce":3519444232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6805","nonce":3519444232}]},"public_addr":"172.21.15.196:6801/3519444232","cluster_addr":"172.21.15.196:6803/3519444232","heartbeat_back_addr":"172.21.15.196:6807/3519444232","heartbeat_front_addr":"172.21.15.196:6805/3519444232","state":["exists","up"]},{"osd":6,"uuid":"460b6167-f57b-4224-9c92-cfc9b80bbe99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6809","nonce":275739834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6811","nonce":275739834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6815","nonce":275739834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6813","nonce":275739834}]},"public_addr":"172.21.15.196:6809/275739834","cluster_addr":"172.21.15.196:6811/275739834","heartbeat_back_addr":"172.21.15.196:6815/275739834","heartbeat_front_addr":"172.21.15.196:6813/275739834","state":["exists","up"]},{"osd":7,"uuid":"d695643f-5e07-4e2a-a646-c06bd97b6650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6825","nonce":307626968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6827","nonce":307626968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6831","nonce":307626968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6829","nonce":307626968}]},"public_addr":"172.21.15.196:6825/307626968","cluster_addr":"172.21.15.196:6827/307626968","heartbeat_back_addr":"172.21.15.196:6831/307626968","heartbeat_front_addr":"172.21.15.196:6829/307626968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.293257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.964533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.248895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.010000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.832554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.743704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930171+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930962+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T08:47:48.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.653+0000 7f1927e00640 1 -- 172.21.15.152:0/394762813 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1904068380 msgr2=0x7f190406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:48.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.653+0000 7f1927e00640 1 --2- 172.21.15.152:0/394762813 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1904068380 0x7f190406a840 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1918007a60 tx=0x7f1918008040 comp rx=0 tx=0).stop 2024-04-17T08:47:48.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.653+0000 7f1927e00640 1 -- 172.21.15.152:0/394762813 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f192815f4c0 msgr2=0x7f19281fb8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:48.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.653+0000 7f1927e00640 1 --2- 172.21.15.152:0/394762813 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f192815f4c0 0x7f19281fb8d0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f19200ab040 tx=0x7f19200197d0 comp rx=0 tx=0).stop 2024-04-17T08:47:48.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.653+0000 7f1927e00640 1 -- 172.21.15.152:0/394762813 shutdown_connections 2024-04-17T08:47:48.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.653+0000 7f1927e00640 1 --2- 172.21.15.152:0/394762813 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f192815f4c0 0x7f19281fb8d0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:48.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.653+0000 7f1927e00640 1 --2- 172.21.15.152:0/394762813 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1904068380 0x7f190406a840 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:48.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.653+0000 7f1927e00640 1 --2- 172.21.15.152:0/394762813 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f19280d2710 0x7f19281fb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:48.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.653+0000 7f1927e00640 1 --2- 172.21.15.152:0/394762813 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f19280b5ac0 0x7f19281fae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:48.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.653+0000 7f1927e00640 1 -- 172.21.15.152:0/394762813 >> 172.21.15.152:0/394762813 conn(0x7f19280b7690 msgr2=0x7f1928153670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:48.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.653+0000 7f1927e00640 1 -- 172.21.15.152:0/394762813 shutdown_connections 2024-04-17T08:47:48.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.653+0000 7f1927e00640 1 -- 172.21.15.152:0/394762813 wait complete. 2024-04-17T08:47:48.676 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-17T08:47:48.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.809+0000 7f06f3400640 1 Processor -- start 2024-04-17T08:47:48.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.809+0000 7f06f3400640 1 -- start start 2024-04-17T08:47:48.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.809+0000 7f06f3400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f06ec0af670 0x7f06ec15b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:48.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.809+0000 7f06f3400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f06ec06f980 0x7f06ec072530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:48.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.809+0000 7f06f3400640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06ec15c260 con 0x7f06ec0d0360 2024-04-17T08:47:48.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.809+0000 7f06f3400640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f06ec15c820 con 0x7f06ec06f980 2024-04-17T08:47:48.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.809+0000 7f06f3400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f06ec15c540 con 0x7f06ec0af670 2024-04-17T08:47:48.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.809+0000 7f06e3e00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f06ec06f980 0x7f06ec072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:48.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.809+0000 7f06f1400640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f06ec0d0360 0x7f06ec06dc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:50198/0 (socket says 172.21.15.152:50198) 2024-04-17T08:47:48.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.809+0000 7f06f1400640 1 -- 172.21.15.152:0/340580777 learned_addr learned my addr 172.21.15.152:0/340580777 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:48.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.813+0000 7f06f0a00640 1 --2- 172.21.15.152:0/340580777 >> v2:172.21.15.196:3300/0 conn(0x7f06ec0af670 0x7f06ec15b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:48.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.813+0000 7f06ebe00640 1 -- 172.21.15.152:0/340580777 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2204621208 0 0) 0x7f06ec15c260 con 0x7f06ec0d0360 2024-04-17T08:47:48.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.813+0000 7f06e3e00640 1 -- 172.21.15.152:0/340580777 >> v2:172.21.15.196:3300/0 conn(0x7f06ec0af670 msgr2=0x7f06ec15b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:48.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.813+0000 7f06e3e00640 1 --2- 172.21.15.152:0/340580777 >> v2:172.21.15.196:3300/0 conn(0x7f06ec0af670 0x7f06ec15b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:48.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.813+0000 7f06e3e00640 1 -- 172.21.15.152:0/340580777 >> v1:172.21.15.152:6789/0 conn(0x7f06ec0d0360 legacy=0x7f06ec06dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:48.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.813+0000 7f06e3e00640 1 -- 172.21.15.152:0/340580777 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06ec071d30 con 0x7f06ec06f980 2024-04-17T08:47:48.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.813+0000 7f06e3e00640 1 --2- 172.21.15.152:0/340580777 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06ec06f980 0x7f06ec072530 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f06ec074260 tx=0x7f06d401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=392cd175f624ac0e server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:48.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.813+0000 7f06ebe00640 1 -- 172.21.15.152:0/340580777 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d40b0070 con 0x7f06ec06f980 2024-04-17T08:47:48.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.813+0000 7f06ebe00640 1 -- 172.21.15.152:0/340580777 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06d4004230 con 0x7f06ec06f980 2024-04-17T08:47:48.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.813+0000 7f06ebe00640 1 -- 172.21.15.152:0/340580777 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d4003620 con 0x7f06ec06f980 2024-04-17T08:47:48.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.817+0000 7f06f3400640 1 -- 172.21.15.152:0/340580777 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06ec06f980 msgr2=0x7f06ec072530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:48.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.817+0000 7f06f3400640 1 --2- 172.21.15.152:0/340580777 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06ec06f980 0x7f06ec072530 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f06ec074260 tx=0x7f06d401c3c0 comp rx=0 tx=0).stop 2024-04-17T08:47:48.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.817+0000 7f06f3400640 1 -- 172.21.15.152:0/340580777 shutdown_connections 2024-04-17T08:47:48.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.817+0000 7f06f3400640 1 --2- 172.21.15.152:0/340580777 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06ec06f980 0x7f06ec072530 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:48.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.817+0000 7f06f3400640 1 --2- 172.21.15.152:0/340580777 >> v2:172.21.15.196:3300/0 conn(0x7f06ec0af670 0x7f06ec15b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:48.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.817+0000 7f06f3400640 1 -- 172.21.15.152:0/340580777 >> 172.21.15.152:0/340580777 conn(0x7f06ec0b3350 msgr2=0x7f06ec0b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:48.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.817+0000 7f06f3400640 1 -- 172.21.15.152:0/340580777 shutdown_connections 2024-04-17T08:47:48.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.817+0000 7f06f3400640 1 -- 172.21.15.152:0/340580777 wait complete. 2024-04-17T08:47:48.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.817+0000 7f06f3400640 1 Processor -- start 2024-04-17T08:47:48.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.817+0000 7f06f3400640 1 -- start start 2024-04-17T08:47:48.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.817+0000 7f06f3400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f06ec06f980 0x7f06ec1f85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:48.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.817+0000 7f06f3400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f06ec0af670 0x7f06ec1506c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:48.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.817+0000 7f06f3400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06ec0d0360 0x7f06ec15a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:48.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.817+0000 7f06f3400640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f06ec15bf80 con 0x7f06ec0d0360 2024-04-17T08:47:48.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.817+0000 7f06f3400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f06ec15be00 con 0x7f06ec0af670 2024-04-17T08:47:48.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.817+0000 7f06f3400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f06ec072a70 con 0x7f06ec06f980 2024-04-17T08:47:48.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.817+0000 7f06f1400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06ec0d0360 0x7f06ec15a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:48.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.817+0000 7f06f1400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06ec0d0360 0x7f06ec15a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50550/0 (socket says 172.21.15.152:50550) 2024-04-17T08:47:48.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.817+0000 7f06f1400640 1 -- 172.21.15.152:0/1614920551 learned_addr learned my addr 172.21.15.152:0/1614920551 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:48.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.817+0000 7f06f0a00640 1 --2- 172.21.15.152:0/1614920551 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f06ec06f980 0x7f06ec1f85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:48.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.817+0000 7f06e3e00640 1 --2- 172.21.15.152:0/1614920551 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f06ec0af670 0x7f06ec1506c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:48.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.817+0000 7f06f1400640 1 -- 172.21.15.152:0/1614920551 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f06ec06f980 msgr2=0x7f06ec1f85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:48.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.817+0000 7f06f1400640 1 --2- 172.21.15.152:0/1614920551 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f06ec06f980 0x7f06ec1f85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:48.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.817+0000 7f06f1400640 1 -- 172.21.15.152:0/1614920551 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f06ec0af670 msgr2=0x7f06ec1506c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:48.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.817+0000 7f06f1400640 1 --2- 172.21.15.152:0/1614920551 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f06ec0af670 0x7f06ec1506c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:48.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.817+0000 7f06f1400640 1 -- 172.21.15.152:0/1614920551 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06ec164bd0 con 0x7f06ec0d0360 2024-04-17T08:47:48.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.817+0000 7f06f1400640 1 --2- 172.21.15.152:0/1614920551 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06ec0d0360 0x7f06ec15a450 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f06e400c730 tx=0x7f06e400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:48.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.821+0000 7f06e9600640 1 -- 172.21.15.152:0/1614920551 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e4018070 con 0x7f06ec0d0360 2024-04-17T08:47:48.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.821+0000 7f06e9600640 1 -- 172.21.15.152:0/1614920551 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06e400ce40 con 0x7f06ec0d0360 2024-04-17T08:47:48.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.821+0000 7f06f3400640 1 -- 172.21.15.152:0/1614920551 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06ec1566f0 con 0x7f06ec0d0360 2024-04-17T08:47:48.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.821+0000 7f06e9600640 1 -- 172.21.15.152:0/1614920551 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e400a860 con 0x7f06ec0d0360 2024-04-17T08:47:48.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.821+0000 7f06f3400640 1 -- 172.21.15.152:0/1614920551 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06ec156cb0 con 0x7f06ec0d0360 2024-04-17T08:47:48.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.821+0000 7f06f3400640 1 -- 172.21.15.152:0/1614920551 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06ec068a30 con 0x7f06ec0d0360 2024-04-17T08:47:48.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.821+0000 7f06e9600640 1 -- 172.21.15.152:0/1614920551 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f06e401b070 con 0x7f06ec0d0360 2024-04-17T08:47:48.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.821+0000 7f06e9600640 1 --2- 172.21.15.152:0/1614920551 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f06c8068380 0x7f06c806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:48.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.821+0000 7f06e9600640 1 -- 172.21.15.152:0/1614920551 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f06e4086370 con 0x7f06ec0d0360 2024-04-17T08:47:48.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.821+0000 7f06f0a00640 1 --2- 172.21.15.152:0/1614920551 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f06c8068380 0x7f06c806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:48.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.821+0000 7f06f0a00640 1 --2- 172.21.15.152:0/1614920551 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f06c8068380 0x7f06c806a840 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f06ec15daf0 tx=0x7f06dc009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:48.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:48.825+0000 7f06e9600640 1 -- 172.21.15.152:0/1614920551 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f06e4055e20 con 0x7f06ec0d0360 2024-04-17T08:47:49.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.017+0000 7f06f3400640 1 -- 172.21.15.152:0/1614920551 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f06ec0ad6c0 con 0x7f06ec0d0360 2024-04-17T08:47:49.019 INFO:tasks.ceph.mon.a.smithi152.stderr:2024-04-17T08:47:49.017+0000 7fa662400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-17T08:47:49.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.017+0000 7f06e9600640 1 -- 172.21.15.152:0/1614920551 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) ==== 161+0+0 (secure 0 0 0) 0x7f06e405a120 con 0x7f06ec0d0360 2024-04-17T08:47:49.021 INFO:teuthology.orchestra.run.smithi152.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-17T08:47:49.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.021+0000 7f06f3400640 1 -- 172.21.15.152:0/1614920551 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f06c8068380 msgr2=0x7f06c806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:49.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.021+0000 7f06f3400640 1 --2- 172.21.15.152:0/1614920551 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f06c8068380 0x7f06c806a840 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f06ec15daf0 tx=0x7f06dc009190 comp rx=0 tx=0).stop 2024-04-17T08:47:49.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.021+0000 7f06f3400640 1 -- 172.21.15.152:0/1614920551 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06ec0d0360 msgr2=0x7f06ec15a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:49.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.021+0000 7f06f3400640 1 --2- 172.21.15.152:0/1614920551 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06ec0d0360 0x7f06ec15a450 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f06e400c730 tx=0x7f06e400cbf0 comp rx=0 tx=0).stop 2024-04-17T08:47:49.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.021+0000 7f06f3400640 1 -- 172.21.15.152:0/1614920551 shutdown_connections 2024-04-17T08:47:49.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.021+0000 7f06f3400640 1 --2- 172.21.15.152:0/1614920551 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06ec0d0360 0x7f06ec15a450 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:49.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.021+0000 7f06f3400640 1 --2- 172.21.15.152:0/1614920551 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f06ec0af670 0x7f06ec1506c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:49.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.021+0000 7f06f3400640 1 --2- 172.21.15.152:0/1614920551 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f06c8068380 0x7f06c806a840 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:49.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.021+0000 7f06f3400640 1 --2- 172.21.15.152:0/1614920551 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f06ec06f980 0x7f06ec1f85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:49.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.021+0000 7f06f3400640 1 -- 172.21.15.152:0/1614920551 >> 172.21.15.152:0/1614920551 conn(0x7f06ec0b3350 msgr2=0x7f06ec06dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:49.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.021+0000 7f06f3400640 1 -- 172.21.15.152:0/1614920551 shutdown_connections 2024-04-17T08:47:49.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.021+0000 7f06f3400640 1 -- 172.21.15.152:0/1614920551 wait complete. 2024-04-17T08:47:49.033 INFO:tasks.ceph.mds.c.smithi152.stderr: -4974> 2024-04-17T08:46:38.186+0000 7f6556600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-17T08:47:49.045 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-17T08:47:49.082 INFO:tasks.ceph.mds.c.smithi152.stdout:starting mds.c at 2024-04-17T08:47:49.185 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.181+0000 7f4945a00640 1 Processor -- start 2024-04-17T08:47:49.185 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.181+0000 7f4945a00640 1 -- start start 2024-04-17T08:47:49.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.185+0000 7f4945a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f494006f980 0x7f4940072530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:49.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.185+0000 7f4945a00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f494015bfd0 con 0x7f49400af670 2024-04-17T08:47:49.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.185+0000 7f4945a00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f494015c260 con 0x7f49400d0360 2024-04-17T08:47:49.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.185+0000 7f4945a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f494015c820 con 0x7f494006f980 2024-04-17T08:47:49.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.185+0000 7f493ea00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f49400af670 0x7f494015b8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:50214/0 (socket says 172.21.15.152:50214) 2024-04-17T08:47:49.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.185+0000 7f493ea00640 1 -- 172.21.15.152:0/717188651 learned_addr learned my addr 172.21.15.152:0/717188651 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:49.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.185+0000 7f493e000640 1 --2- 172.21.15.152:0/717188651 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f494006f980 0x7f4940072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:49.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.185+0000 7f493d600640 1 -- 172.21.15.152:0/717188651 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1621574693 0 0) 0x7f494015bfd0 con 0x7f49400af670 2024-04-17T08:47:49.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.185+0000 7f493d600640 1 -- 172.21.15.152:0/717188651 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4924003530 con 0x7f49400af670 2024-04-17T08:47:49.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.185+0000 7f493e000640 1 -- 172.21.15.152:0/717188651 >> v1:172.21.15.196:6789/0 conn(0x7f49400d0360 legacy=0x7f494006dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:49.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.185+0000 7f493d600640 1 -- 172.21.15.152:0/717188651 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2405867392 0 0) 0x7f494015c260 con 0x7f49400d0360 2024-04-17T08:47:49.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.185+0000 7f493e000640 1 -- 172.21.15.152:0/717188651 >> v1:172.21.15.152:6789/0 conn(0x7f49400af670 legacy=0x7f494015b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:49.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.185+0000 7f493e000640 1 -- 172.21.15.152:0/717188651 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f494015c540 con 0x7f494006f980 2024-04-17T08:47:49.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.189+0000 7f493e000640 1 --2- 172.21.15.152:0/717188651 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f494006f980 0x7f4940072530 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f49300097f0 tx=0x7f493001c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55f34bec582f56a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:49.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.189+0000 7f493d600640 1 -- 172.21.15.152:0/717188651 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49300ab620 con 0x7f494006f980 2024-04-17T08:47:49.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.189+0000 7f493d600640 1 -- 172.21.15.152:0/717188651 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49300b0070 con 0x7f494006f980 2024-04-17T08:47:49.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.189+0000 7f493d600640 1 -- 172.21.15.152:0/717188651 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49300ab9e0 con 0x7f494006f980 2024-04-17T08:47:49.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.189+0000 7f4945a00640 1 -- 172.21.15.152:0/717188651 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f494006f980 msgr2=0x7f4940072530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:49.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.189+0000 7f4945a00640 1 --2- 172.21.15.152:0/717188651 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f494006f980 0x7f4940072530 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f49300097f0 tx=0x7f493001c420 comp rx=0 tx=0).stop 2024-04-17T08:47:49.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.189+0000 7f4945a00640 1 -- 172.21.15.152:0/717188651 shutdown_connections 2024-04-17T08:47:49.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.189+0000 7f4945a00640 1 --2- 172.21.15.152:0/717188651 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f494006f980 0x7f4940072530 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:49.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.189+0000 7f4945a00640 1 -- 172.21.15.152:0/717188651 >> 172.21.15.152:0/717188651 conn(0x7f49400b3350 msgr2=0x7f49400b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:49.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.189+0000 7f4945a00640 1 -- 172.21.15.152:0/717188651 shutdown_connections 2024-04-17T08:47:49.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.189+0000 7f4945a00640 1 -- 172.21.15.152:0/717188651 wait complete. 2024-04-17T08:47:49.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.189+0000 7f4945a00640 1 Processor -- start 2024-04-17T08:47:49.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.189+0000 7f4945a00640 1 -- start start 2024-04-17T08:47:49.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.189+0000 7f4945a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f494006f980 0x7f49400b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:49.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.189+0000 7f4945a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f49400af670 0x7f494014d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:49.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.189+0000 7f4945a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f49400d0360 0x7f494014d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:49.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.189+0000 7f4945a00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4940072a70 con 0x7f49400d0360 2024-04-17T08:47:49.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.189+0000 7f4945a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f49400d0bc0 con 0x7f494006f980 2024-04-17T08:47:49.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.189+0000 7f4945a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f4940072bf0 con 0x7f49400af670 2024-04-17T08:47:49.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.189+0000 7f493f400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f49400d0360 0x7f494014d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:49.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.189+0000 7f493f400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f49400d0360 0x7f494014d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50568/0 (socket says 172.21.15.152:50568) 2024-04-17T08:47:49.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.189+0000 7f493ea00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f494006f980 0x7f49400b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:49.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.189+0000 7f493f400640 1 -- 172.21.15.152:0/2057012144 learned_addr learned my addr 172.21.15.152:0/2057012144 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:49.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.193+0000 7f493e000640 1 --2- 172.21.15.152:0/2057012144 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f49400af670 0x7f494014d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:49.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.193+0000 7f493f400640 1 -- 172.21.15.152:0/2057012144 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f49400af670 msgr2=0x7f494014d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:49.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.193+0000 7f493f400640 1 --2- 172.21.15.152:0/2057012144 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f49400af670 0x7f494014d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:49.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.193+0000 7f493f400640 1 -- 172.21.15.152:0/2057012144 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f494006f980 msgr2=0x7f49400b0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:49.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.193+0000 7f493f400640 1 --2- 172.21.15.152:0/2057012144 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f494006f980 0x7f49400b0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:49.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.193+0000 7f493f400640 1 -- 172.21.15.152:0/2057012144 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49400b1710 con 0x7f49400d0360 2024-04-17T08:47:49.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.193+0000 7f493f400640 1 --2- 172.21.15.152:0/2057012144 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f49400d0360 0x7f494014d9b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f493800c780 tx=0x7f493800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:49.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.193+0000 7f4936a00640 1 -- 172.21.15.152:0/2057012144 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4938003db0 con 0x7f49400d0360 2024-04-17T08:47:49.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.193+0000 7f4936a00640 1 -- 172.21.15.152:0/2057012144 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f493800ce30 con 0x7f49400d0360 2024-04-17T08:47:49.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.193+0000 7f4936a00640 1 -- 172.21.15.152:0/2057012144 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4938005290 con 0x7f49400d0360 2024-04-17T08:47:49.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.193+0000 7f4945a00640 1 -- 172.21.15.152:0/2057012144 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49400b19f0 con 0x7f49400d0360 2024-04-17T08:47:49.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.193+0000 7f4945a00640 1 -- 172.21.15.152:0/2057012144 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49400b1fb0 con 0x7f49400d0360 2024-04-17T08:47:49.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.193+0000 7f4945a00640 1 -- 172.21.15.152:0/2057012144 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4940068a30 con 0x7f49400d0360 2024-04-17T08:47:49.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.193+0000 7f4936a00640 1 -- 172.21.15.152:0/2057012144 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4938005430 con 0x7f49400d0360 2024-04-17T08:47:49.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.193+0000 7f4936a00640 1 --2- 172.21.15.152:0/2057012144 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f491c068380 0x7f491c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:49.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.193+0000 7f4936a00640 1 -- 172.21.15.152:0/2057012144 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6850+0+0 (secure 0 0 0) 0x7f4938086c60 con 0x7f49400d0360 2024-04-17T08:47:49.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.197+0000 7f493ea00640 1 --2- 172.21.15.152:0/2057012144 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f491c068380 0x7f491c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:49.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.197+0000 7f493ea00640 1 --2- 172.21.15.152:0/2057012144 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f491c068380 0x7f491c06a840 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4928007fd0 tx=0x7f4928009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:49.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.197+0000 7f4936a00640 1 -- 172.21.15.152:0/2057012144 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f49380566b0 con 0x7f49400d0360 2024-04-17T08:47:49.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:49.389+0000 7f4945a00640 1 -- 172.21.15.152:0/2057012144 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f494015dfa0 con 0x7f49400d0360 2024-04-17T08:47:50.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.025+0000 7f4936a00640 1 -- 172.21.15.152:0/2057012144 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f493805a9b0 con 0x7f49400d0360 2024-04-17T08:47:50.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.029+0000 7f4945a00640 1 -- 172.21.15.152:0/2057012144 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f491c068380 msgr2=0x7f491c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:50.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.029+0000 7f4945a00640 1 --2- 172.21.15.152:0/2057012144 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f491c068380 0x7f491c06a840 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4928007fd0 tx=0x7f4928009040 comp rx=0 tx=0).stop 2024-04-17T08:47:50.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.029+0000 7f4945a00640 1 -- 172.21.15.152:0/2057012144 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f49400d0360 msgr2=0x7f494014d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:50.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.029+0000 7f4945a00640 1 --2- 172.21.15.152:0/2057012144 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f49400d0360 0x7f494014d9b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f493800c780 tx=0x7f493800cc40 comp rx=0 tx=0).stop 2024-04-17T08:47:50.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.029+0000 7f4945a00640 1 -- 172.21.15.152:0/2057012144 shutdown_connections 2024-04-17T08:47:50.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.029+0000 7f4945a00640 1 --2- 172.21.15.152:0/2057012144 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f49400d0360 0x7f494014d9b0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:50.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.029+0000 7f4945a00640 1 --2- 172.21.15.152:0/2057012144 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f491c068380 0x7f491c06a840 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:50.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.029+0000 7f4945a00640 1 --2- 172.21.15.152:0/2057012144 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f49400af670 0x7f494014d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:50.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.029+0000 7f4945a00640 1 --2- 172.21.15.152:0/2057012144 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f494006f980 0x7f49400b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:50.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.029+0000 7f4945a00640 1 -- 172.21.15.152:0/2057012144 >> 172.21.15.152:0/2057012144 conn(0x7f49400b3350 msgr2=0x7f4940158230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:50.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.029+0000 7f4945a00640 1 -- 172.21.15.152:0/2057012144 shutdown_connections 2024-04-17T08:47:50.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.029+0000 7f4945a00640 1 -- 172.21.15.152:0/2057012144 wait complete. 2024-04-17T08:47:50.054 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-17T08:47:50.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.233+0000 7f0080e00640 1 Processor -- start 2024-04-17T08:47:50.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.233+0000 7f0080e00640 1 -- start start 2024-04-17T08:47:50.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.237+0000 7f0080e00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f007c146fc0 0x7f007c161f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:50.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.237+0000 7f0080e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f007c1473a0 0x7f007c06e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:50.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.237+0000 7f0080e00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f007c0d0790 con 0x7f007c0ce9c0 2024-04-17T08:47:50.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.237+0000 7f0080e00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f007c0d0aa0 con 0x7f007c146fc0 2024-04-17T08:47:50.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.237+0000 7f0080e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f007c06ebb0 con 0x7f007c1473a0 2024-04-17T08:47:50.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.237+0000 7f007be00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f007c0ce9c0 0x7f007c0cb450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:50226/0 (socket says 172.21.15.152:50226) 2024-04-17T08:47:50.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.237+0000 7f007be00640 1 -- 172.21.15.152:0/2062522850 learned_addr learned my addr 172.21.15.152:0/2062522850 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:50.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.237+0000 7f007b400640 1 --2- 172.21.15.152:0/2062522850 >> v2:172.21.15.152:3300/0 conn(0x7f007c146fc0 0x7f007c161f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:50.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.237+0000 7f007aa00640 1 --2- 172.21.15.152:0/2062522850 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f007c1473a0 0x7f007c06e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:50.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.237+0000 7f007a000640 1 -- 172.21.15.152:0/2062522850 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3488088146 0 0) 0x7f0074001120 con 0x7f007c0ce9c0 2024-04-17T08:47:50.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.237+0000 7f007a000640 1 -- 172.21.15.152:0/2062522850 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0060003530 con 0x7f007c0ce9c0 2024-04-17T08:47:50.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.237+0000 7f007b400640 1 -- 172.21.15.152:0/2062522850 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f007c1473a0 msgr2=0x7f007c06e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:50.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.237+0000 7f007b400640 1 --2- 172.21.15.152:0/2062522850 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f007c1473a0 0x7f007c06e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:50.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.237+0000 7f007b400640 1 -- 172.21.15.152:0/2062522850 >> v1:172.21.15.152:6789/0 conn(0x7f007c0ce9c0 legacy=0x7f007c0cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:50.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.237+0000 7f007b400640 1 -- 172.21.15.152:0/2062522850 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f007c0d1f40 con 0x7f007c146fc0 2024-04-17T08:47:50.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.237+0000 7f007aa00640 1 --2- 172.21.15.152:0/2062522850 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f007c1473a0 0x7f007c06e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:47:50.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.241+0000 7f007b400640 1 --2- 172.21.15.152:0/2062522850 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f007c146fc0 0x7f007c161f60 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f006c009d90 tx=0x7f006c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=792da1b3e0f19e93 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:50.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.241+0000 7f007a000640 1 -- 172.21.15.152:0/2062522850 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f006c0b2070 con 0x7f007c146fc0 2024-04-17T08:47:50.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.241+0000 7f007a000640 1 -- 172.21.15.152:0/2062522850 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f006c0a5890 con 0x7f007c146fc0 2024-04-17T08:47:50.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.241+0000 7f007a000640 1 -- 172.21.15.152:0/2062522850 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f006c0a5c40 con 0x7f007c146fc0 2024-04-17T08:47:50.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.241+0000 7f0080e00640 1 -- 172.21.15.152:0/2062522850 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f007c146fc0 msgr2=0x7f007c161f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:50.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.241+0000 7f0080e00640 1 --2- 172.21.15.152:0/2062522850 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f007c146fc0 0x7f007c161f60 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f006c009d90 tx=0x7f006c01c8e0 comp rx=0 tx=0).stop 2024-04-17T08:47:50.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.241+0000 7f0080e00640 1 -- 172.21.15.152:0/2062522850 shutdown_connections 2024-04-17T08:47:50.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.241+0000 7f0080e00640 1 --2- 172.21.15.152:0/2062522850 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f007c1473a0 0x7f007c06e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:50.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.241+0000 7f0080e00640 1 --2- 172.21.15.152:0/2062522850 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f007c146fc0 0x7f007c161f60 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:50.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.241+0000 7f0080e00640 1 -- 172.21.15.152:0/2062522850 >> 172.21.15.152:0/2062522850 conn(0x7f007c06bfb0 msgr2=0x7f007c0b3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:50.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.241+0000 7f0080e00640 1 -- 172.21.15.152:0/2062522850 shutdown_connections 2024-04-17T08:47:50.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.241+0000 7f0080e00640 1 -- 172.21.15.152:0/2062522850 wait complete. 2024-04-17T08:47:50.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.241+0000 7f0080e00640 1 Processor -- start 2024-04-17T08:47:50.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.241+0000 7f0080e00640 1 -- start start 2024-04-17T08:47:50.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.245+0000 7f0080e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f007c0ce9c0 0x7f007c163f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:50.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.245+0000 7f0080e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f007c146fc0 0x7f007c165d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:50.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.245+0000 7f0080e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f007c1473a0 0x7f007c1437e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:50.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.245+0000 7f0080e00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f007c0cf1e0 con 0x7f007c1473a0 2024-04-17T08:47:50.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.245+0000 7f0080e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f007c0b2390 con 0x7f007c0ce9c0 2024-04-17T08:47:50.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.245+0000 7f0080e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f007c0b62c0 con 0x7f007c146fc0 2024-04-17T08:47:50.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.245+0000 7f007be00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f007c1473a0 0x7f007c1437e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:50.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.245+0000 7f007be00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f007c1473a0 0x7f007c1437e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50588/0 (socket says 172.21.15.152:50588) 2024-04-17T08:47:50.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.245+0000 7f007be00640 1 -- 172.21.15.152:0/209717990 learned_addr learned my addr 172.21.15.152:0/209717990 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:50.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.245+0000 7f007b400640 1 --2- 172.21.15.152:0/209717990 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f007c0ce9c0 0x7f007c163f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:50.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.245+0000 7f007aa00640 1 --2- 172.21.15.152:0/209717990 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f007c146fc0 0x7f007c165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:50.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.245+0000 7f007be00640 1 -- 172.21.15.152:0/209717990 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f007c146fc0 msgr2=0x7f007c165d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:50.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.245+0000 7f007be00640 1 --2- 172.21.15.152:0/209717990 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f007c146fc0 0x7f007c165d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:50.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.245+0000 7f007be00640 1 -- 172.21.15.152:0/209717990 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f007c0ce9c0 msgr2=0x7f007c163f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:50.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.245+0000 7f007be00640 1 --2- 172.21.15.152:0/209717990 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f007c0ce9c0 0x7f007c163f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:50.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.245+0000 7f007be00640 1 -- 172.21.15.152:0/209717990 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f007c0b6510 con 0x7f007c1473a0 2024-04-17T08:47:50.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.245+0000 7f007be00640 1 --2- 172.21.15.152:0/209717990 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f007c1473a0 0x7f007c1437e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f007400c730 tx=0x7f007400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:50.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.245+0000 7f0073400640 1 -- 172.21.15.152:0/209717990 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0074017070 con 0x7f007c1473a0 2024-04-17T08:47:50.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.245+0000 7f0073400640 1 -- 172.21.15.152:0/209717990 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00740058c0 con 0x7f007c1473a0 2024-04-17T08:47:50.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.245+0000 7f0080e00640 1 -- 172.21.15.152:0/209717990 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f007c0b67f0 con 0x7f007c1473a0 2024-04-17T08:47:50.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.245+0000 7f0073400640 1 -- 172.21.15.152:0/209717990 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0074005c90 con 0x7f007c1473a0 2024-04-17T08:47:50.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.245+0000 7f0080e00640 1 -- 172.21.15.152:0/209717990 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f007c164450 con 0x7f007c1473a0 2024-04-17T08:47:50.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.245+0000 7f0080e00640 1 -- 172.21.15.152:0/209717990 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f007c075be0 con 0x7f007c1473a0 2024-04-17T08:47:50.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.245+0000 7f0073400640 1 -- 172.21.15.152:0/209717990 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f007401a070 con 0x7f007c1473a0 2024-04-17T08:47:50.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.249+0000 7f0073400640 1 --2- 172.21.15.152:0/209717990 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f005c068380 0x7f005c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:50.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.249+0000 7f0073400640 1 -- 172.21.15.152:0/209717990 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6850+0+0 (secure 0 0 0) 0x7f00740860b0 con 0x7f007c1473a0 2024-04-17T08:47:50.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.249+0000 7f007b400640 1 --2- 172.21.15.152:0/209717990 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f005c068380 0x7f005c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:50.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.249+0000 7f007b400640 1 --2- 172.21.15.152:0/209717990 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f005c068380 0x7f005c06a840 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f006c0af000 tx=0x7f006c0a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:50.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.253+0000 7f0073400640 1 -- 172.21.15.152:0/209717990 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f007c0d0790 con 0x7f007c1473a0 2024-04-17T08:47:50.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:50.413+0000 7f0080e00640 1 -- 172.21.15.152:0/209717990 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f007c0b2170 con 0x7f007c1473a0 2024-04-17T08:47:51.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.025+0000 7f0073400640 1 -- 172.21.15.152:0/209717990 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) ==== 181+0+0 (secure 0 0 0) 0x7f0074056280 con 0x7f007c1473a0 2024-04-17T08:47:51.029 INFO:teuthology.orchestra.run.smithi152.stderr:pool 'cephfs_metadata' removed 2024-04-17T08:47:51.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.029+0000 7f0080e00640 1 -- 172.21.15.152:0/209717990 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f005c068380 msgr2=0x7f005c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:51.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.029+0000 7f0080e00640 1 --2- 172.21.15.152:0/209717990 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f005c068380 0x7f005c06a840 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f006c0af000 tx=0x7f006c0a7070 comp rx=0 tx=0).stop 2024-04-17T08:47:51.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.029+0000 7f0080e00640 1 -- 172.21.15.152:0/209717990 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f007c1473a0 msgr2=0x7f007c1437e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:51.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.029+0000 7f0080e00640 1 --2- 172.21.15.152:0/209717990 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f007c1473a0 0x7f007c1437e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f007400c730 tx=0x7f007400cbf0 comp rx=0 tx=0).stop 2024-04-17T08:47:51.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.029+0000 7f0080e00640 1 -- 172.21.15.152:0/209717990 shutdown_connections 2024-04-17T08:47:51.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.029+0000 7f0080e00640 1 --2- 172.21.15.152:0/209717990 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f007c1473a0 0x7f007c1437e0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:51.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.029+0000 7f0080e00640 1 --2- 172.21.15.152:0/209717990 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f005c068380 0x7f005c06a840 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:51.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.029+0000 7f0080e00640 1 --2- 172.21.15.152:0/209717990 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f007c146fc0 0x7f007c165d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:51.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.029+0000 7f0080e00640 1 --2- 172.21.15.152:0/209717990 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f007c0ce9c0 0x7f007c163f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:51.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.029+0000 7f0080e00640 1 -- 172.21.15.152:0/209717990 >> 172.21.15.152:0/209717990 conn(0x7f007c06bfb0 msgr2=0x7f007c0cb450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:51.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.029+0000 7f0080e00640 1 -- 172.21.15.152:0/209717990 shutdown_connections 2024-04-17T08:47:51.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.029+0000 7f0080e00640 1 -- 172.21.15.152:0/209717990 wait complete. 2024-04-17T08:47:51.056 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-17T08:47:51.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.193+0000 7fe1d8800640 1 Processor -- start 2024-04-17T08:47:51.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.193+0000 7fe1d8800640 1 -- start start 2024-04-17T08:47:51.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.197+0000 7fe1d8800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fe1d015d710 0x7fe1d0160720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:51.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.197+0000 7fe1d8800640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1d0160d20 con 0x7fe1d00d0a70 2024-04-17T08:47:51.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.197+0000 7fe1d8800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1d015cc30 con 0x7fe1d015a010 2024-04-17T08:47:51.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.197+0000 7fe1d8800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fe1d015d280 con 0x7fe1d015d710 2024-04-17T08:47:51.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.197+0000 7fe1d5400640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fe1d00d0a70 0x7fe1d0160010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:50230/0 (socket says 172.21.15.152:50230) 2024-04-17T08:47:51.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.197+0000 7fe1d5400640 1 -- 172.21.15.152:0/239673477 learned_addr learned my addr 172.21.15.152:0/239673477 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:51.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.197+0000 7fe1d6800640 1 --2- 172.21.15.152:0/239673477 >> v2:172.21.15.196:3300/0 conn(0x7fe1d015d710 0x7fe1d0160720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:51.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.197+0000 7fe1d4a00640 1 -- 172.21.15.152:0/239673477 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 486147181 0 0) 0x7fe1d0160d20 con 0x7fe1d00d0a70 2024-04-17T08:47:51.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.197+0000 7fe1d4a00640 1 -- 172.21.15.152:0/239673477 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1b8003530 con 0x7fe1d00d0a70 2024-04-17T08:47:51.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.197+0000 7fe1d4a00640 1 -- 172.21.15.152:0/239673477 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3171935112 0 0) 0x7fe1b8003530 con 0x7fe1d00d0a70 2024-04-17T08:47:51.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.197+0000 7fe1d4a00640 1 -- 172.21.15.152:0/239673477 >> v2:172.21.15.196:3300/0 conn(0x7fe1d015d710 msgr2=0x7fe1d0160720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:51.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.197+0000 7fe1d4a00640 1 --2- 172.21.15.152:0/239673477 >> v2:172.21.15.196:3300/0 conn(0x7fe1d015d710 0x7fe1d0160720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:51.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.197+0000 7fe1d4a00640 1 -- 172.21.15.152:0/239673477 >> v1:172.21.15.196:6789/0 conn(0x7fe1d015a010 legacy=0x7fe1d00d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:51.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.197+0000 7fe1d4a00640 1 -- 172.21.15.152:0/239673477 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1d015cf10 con 0x7fe1d00d0a70 2024-04-17T08:47:51.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.197+0000 7fe1d4a00640 1 -- 172.21.15.152:0/239673477 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2973887244 0 0) 0x7fe1c0001680 con 0x7fe1d00d0a70 2024-04-17T08:47:51.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.197+0000 7fe1d4a00640 1 -- 172.21.15.152:0/239673477 >> v1:172.21.15.152:6789/0 conn(0x7fe1d00d0a70 legacy=0x7fe1d0160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:51.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.197+0000 7fe1d4a00640 1 --2- 172.21.15.152:0/239673477 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe1b80039c0 0x7fe1b8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:51.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.197+0000 7fe1d4a00640 1 --2- 172.21.15.152:0/239673477 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe1b8004810 0x7fe1b8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:51.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.197+0000 7fe1d4a00640 1 --2- 172.21.15.152:0/239673477 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1b80051d0 0x7fe1b800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:51.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.197+0000 7fe1d4a00640 1 -- 172.21.15.152:0/239673477 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d015d280 con 0x7fe1b80051d0 2024-04-17T08:47:51.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.197+0000 7fe1d4a00640 1 -- 172.21.15.152:0/239673477 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b800c170 con 0x7fe1b8004810 2024-04-17T08:47:51.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.197+0000 7fe1d4a00640 1 -- 172.21.15.152:0/239673477 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fe1b800c370 con 0x7fe1b80039c0 2024-04-17T08:47:51.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.197+0000 7fe1d6800640 1 --2- 172.21.15.152:0/239673477 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1b80051d0 0x7fe1b800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:51.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.197+0000 7fe1d5400640 1 --2- 172.21.15.152:0/239673477 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe1b8004810 0x7fe1b8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:51.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.197+0000 7fe1d5e00640 1 --2- 172.21.15.152:0/239673477 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe1b80039c0 0x7fe1b8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:51.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.197+0000 7fe1d6800640 1 -- 172.21.15.152:0/239673477 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe1b80039c0 msgr2=0x7fe1b8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:51.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.197+0000 7fe1d6800640 1 --2- 172.21.15.152:0/239673477 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe1b80039c0 0x7fe1b8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:51.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.197+0000 7fe1d6800640 1 -- 172.21.15.152:0/239673477 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe1b8004810 msgr2=0x7fe1b8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:51.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.197+0000 7fe1d6800640 1 --2- 172.21.15.152:0/239673477 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe1b8004810 0x7fe1b8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:51.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.197+0000 7fe1d6800640 1 -- 172.21.15.152:0/239673477 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1b8003530 con 0x7fe1b80051d0 2024-04-17T08:47:51.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.197+0000 7fe1d5400640 1 --2- 172.21.15.152:0/239673477 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe1b8004810 0x7fe1b8004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:51.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.201+0000 7fe1d6800640 1 -- 172.21.15.152:0/239673477 reap_dead start 2024-04-17T08:47:51.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.201+0000 7fe1d6800640 1 --2- 172.21.15.152:0/239673477 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1b80051d0 0x7fe1b800b9d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc009fc0 tx=0x7fe1cc01ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1800b6ef4dd1ca1 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:51.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.201+0000 7fe1d4a00640 1 -- 172.21.15.152:0/239673477 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc009c10 con 0x7fe1b80051d0 2024-04-17T08:47:51.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.201+0000 7fe1d4a00640 1 -- 172.21.15.152:0/239673477 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1cc0a5bc0 con 0x7fe1b80051d0 2024-04-17T08:47:51.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.201+0000 7fe1d4a00640 1 -- 172.21.15.152:0/239673477 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc0039a0 con 0x7fe1b80051d0 2024-04-17T08:47:51.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.201+0000 7fe1d8800640 1 -- 172.21.15.152:0/239673477 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1b80051d0 msgr2=0x7fe1b800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:51.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.201+0000 7fe1d8800640 1 --2- 172.21.15.152:0/239673477 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1b80051d0 0x7fe1b800b9d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc009fc0 tx=0x7fe1cc01ccc0 comp rx=0 tx=0).stop 2024-04-17T08:47:51.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.201+0000 7fe1d8800640 1 -- 172.21.15.152:0/239673477 shutdown_connections 2024-04-17T08:47:51.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.201+0000 7fe1d8800640 1 --2- 172.21.15.152:0/239673477 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1b80051d0 0x7fe1b800b9d0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:51.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.201+0000 7fe1d8800640 1 -- 172.21.15.152:0/239673477 >> 172.21.15.152:0/239673477 conn(0x7fe1d00b3350 msgr2=0x7fe1d00b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:51.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.201+0000 7fe1d8800640 1 -- 172.21.15.152:0/239673477 shutdown_connections 2024-04-17T08:47:51.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.201+0000 7fe1d8800640 1 -- 172.21.15.152:0/239673477 wait complete. 2024-04-17T08:47:51.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.201+0000 7fe1d8800640 1 Processor -- start 2024-04-17T08:47:51.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.205+0000 7fe1d8800640 1 -- start start 2024-04-17T08:47:51.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.205+0000 7fe1d8800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe1b80051d0 0x7fe1d014a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:51.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.205+0000 7fe1d8800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe1d015b6c0 0x7fe1d015bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:51.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.205+0000 7fe1d8800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1d01f1eb0 0x7fe1d01f2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:51.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.205+0000 7fe1d8800640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d00d0360 con 0x7fe1d01f1eb0 2024-04-17T08:47:51.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.205+0000 7fe1d8800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d015c9d0 con 0x7fe1b80051d0 2024-04-17T08:47:51.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.205+0000 7fe1d8800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fe1d00d04e0 con 0x7fe1d015b6c0 2024-04-17T08:47:51.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.205+0000 7fe1d6800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1d01f1eb0 0x7fe1d01f2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:51.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.205+0000 7fe1d6800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1d01f1eb0 0x7fe1d01f2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50610/0 (socket says 172.21.15.152:50610) 2024-04-17T08:47:51.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.205+0000 7fe1d6800640 1 -- 172.21.15.152:0/593901547 learned_addr learned my addr 172.21.15.152:0/593901547 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:51.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.205+0000 7fe1d5e00640 1 --2- 172.21.15.152:0/593901547 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe1b80051d0 0x7fe1d014a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:51.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.205+0000 7fe1d5400640 1 --2- 172.21.15.152:0/593901547 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe1d015b6c0 0x7fe1d015bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:51.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.205+0000 7fe1d6800640 1 -- 172.21.15.152:0/593901547 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe1d015b6c0 msgr2=0x7fe1d015bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:51.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.205+0000 7fe1d6800640 1 --2- 172.21.15.152:0/593901547 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe1d015b6c0 0x7fe1d015bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:51.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.205+0000 7fe1d6800640 1 -- 172.21.15.152:0/593901547 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe1b80051d0 msgr2=0x7fe1d014a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:51.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.205+0000 7fe1d6800640 1 --2- 172.21.15.152:0/593901547 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe1b80051d0 0x7fe1d014a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:51.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.205+0000 7fe1d6800640 1 -- 172.21.15.152:0/593901547 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1d01f2c80 con 0x7fe1d01f1eb0 2024-04-17T08:47:51.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.205+0000 7fe1d5e00640 1 --2- 172.21.15.152:0/593901547 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe1b80051d0 0x7fe1d014a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:51.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.205+0000 7fe1d6800640 1 --2- 172.21.15.152:0/593901547 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1d01f1eb0 0x7fe1d01f2360 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc0986e0 tx=0x7fe1cc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:51.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.205+0000 7fe1ca000640 1 -- 172.21.15.152:0/593901547 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc0aed70 con 0x7fe1d01f1eb0 2024-04-17T08:47:51.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.205+0000 7fe1ca000640 1 -- 172.21.15.152:0/593901547 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1cc0bd070 con 0x7fe1d01f1eb0 2024-04-17T08:47:51.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.205+0000 7fe1ca000640 1 -- 172.21.15.152:0/593901547 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc003ba0 con 0x7fe1d01f1eb0 2024-04-17T08:47:51.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.205+0000 7fe1d8800640 1 -- 172.21.15.152:0/593901547 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1d01f3240 con 0x7fe1d01f1eb0 2024-04-17T08:47:51.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.205+0000 7fe1d8800640 1 -- 172.21.15.152:0/593901547 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1d01f3800 con 0x7fe1d01f1eb0 2024-04-17T08:47:51.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.205+0000 7fe1d8800640 1 -- 172.21.15.152:0/593901547 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1d0068a30 con 0x7fe1d01f1eb0 2024-04-17T08:47:51.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.209+0000 7fe1ca000640 1 -- 172.21.15.152:0/593901547 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe1cc004030 con 0x7fe1d01f1eb0 2024-04-17T08:47:51.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.209+0000 7fe1ca000640 1 --2- 172.21.15.152:0/593901547 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fe1b40683b0 0x7fe1b406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:51.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.209+0000 7fe1ca000640 1 -- 172.21.15.152:0/593901547 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6412+0+0 (secure 0 0 0) 0x7fe1cc122960 con 0x7fe1d01f1eb0 2024-04-17T08:47:51.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.209+0000 7fe1d5e00640 1 --2- 172.21.15.152:0/593901547 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fe1b40683b0 0x7fe1b406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:51.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.209+0000 7fe1d5e00640 1 --2- 172.21.15.152:0/593901547 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fe1b40683b0 0x7fe1b406a870 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe1d009e3b0 tx=0x7fe1c4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:51.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.213+0000 7fe1ca000640 1 -- 172.21.15.152:0/593901547 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fe1cc0169d0 con 0x7fe1d01f1eb0 2024-04-17T08:47:51.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:51.373+0000 7fe1d8800640 1 -- 172.21.15.152:0/593901547 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe1d006d660 con 0x7fe1d01f1eb0 2024-04-17T08:47:52.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.033+0000 7fe1ca000640 1 -- 172.21.15.152:0/593901547 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) ==== 169+0+0 (secure 0 0 0) 0x7fe1cc0f2bc0 con 0x7fe1d01f1eb0 2024-04-17T08:47:52.035 INFO:teuthology.orchestra.run.smithi152.stderr:pool 'cephfs_data' removed 2024-04-17T08:47:52.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.037+0000 7fe1d8800640 1 -- 172.21.15.152:0/593901547 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fe1b40683b0 msgr2=0x7fe1b406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:52.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.037+0000 7fe1d8800640 1 --2- 172.21.15.152:0/593901547 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fe1b40683b0 0x7fe1b406a870 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe1d009e3b0 tx=0x7fe1c4009040 comp rx=0 tx=0).stop 2024-04-17T08:47:52.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.037+0000 7fe1d8800640 1 -- 172.21.15.152:0/593901547 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1d01f1eb0 msgr2=0x7fe1d01f2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:52.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.037+0000 7fe1d8800640 1 --2- 172.21.15.152:0/593901547 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1d01f1eb0 0x7fe1d01f2360 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc0986e0 tx=0x7fe1cc009750 comp rx=0 tx=0).stop 2024-04-17T08:47:52.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.037+0000 7fe1d8800640 1 -- 172.21.15.152:0/593901547 shutdown_connections 2024-04-17T08:47:52.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.037+0000 7fe1d8800640 1 --2- 172.21.15.152:0/593901547 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1d01f1eb0 0x7fe1d01f2360 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:52.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.037+0000 7fe1d8800640 1 --2- 172.21.15.152:0/593901547 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fe1b40683b0 0x7fe1b406a870 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:52.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.037+0000 7fe1d8800640 1 --2- 172.21.15.152:0/593901547 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe1d015b6c0 0x7fe1d015bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:52.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.037+0000 7fe1d8800640 1 --2- 172.21.15.152:0/593901547 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe1b80051d0 0x7fe1d014a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:52.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.037+0000 7fe1d8800640 1 -- 172.21.15.152:0/593901547 >> 172.21.15.152:0/593901547 conn(0x7fe1d00b3350 msgr2=0x7fe1d00afcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:52.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.037+0000 7fe1d8800640 1 -- 172.21.15.152:0/593901547 shutdown_connections 2024-04-17T08:47:52.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.037+0000 7fe1d8800640 1 -- 172.21.15.152:0/593901547 wait complete. 2024-04-17T08:47:52.064 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-04-17T08:47:52.116 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T08:47:52.120 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T08:47:52.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.201+0000 7f9609600640 1 Processor -- start 2024-04-17T08:47:52.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.201+0000 7f9609600640 1 -- start start 2024-04-17T08:47:52.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.205+0000 7f9609600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f960415e8a0 0x7f96040d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:52.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.205+0000 7f9609600640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f960406d1d0 0x7f960415f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:52.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.205+0000 7f9609600640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f960415f930 con 0x7f960415ee70 2024-04-17T08:47:52.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.205+0000 7f9609600640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f960415ec80 con 0x7f960406d1d0 2024-04-17T08:47:52.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.205+0000 7f9609600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f9604073a50 con 0x7f960415e8a0 2024-04-17T08:47:52.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.205+0000 7f9603400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f960406d1d0 0x7f960415f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:52.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.205+0000 7f9603400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f960406d1d0 0x7f960415f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50616/0 (socket says 172.21.15.152:50616) 2024-04-17T08:47:52.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.205+0000 7f9603400640 1 -- 172.21.15.152:0/575568052 learned_addr learned my addr 172.21.15.152:0/575568052 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:52.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.205+0000 7f9602a00640 1 --2- 172.21.15.152:0/575568052 >> v2:172.21.15.196:3300/0 conn(0x7f960415e8a0 0x7f96040d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:52.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.205+0000 7f9603400640 1 -- 172.21.15.152:0/575568052 >> v2:172.21.15.196:3300/0 conn(0x7f960415e8a0 msgr2=0x7f96040d0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:52.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.205+0000 7f9603400640 1 --2- 172.21.15.152:0/575568052 >> v2:172.21.15.196:3300/0 conn(0x7f960415e8a0 0x7f96040d0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:52.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.205+0000 7f9603400640 1 -- 172.21.15.152:0/575568052 >> v1:172.21.15.196:6789/0 conn(0x7f960415ee70 legacy=0x7f960406cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:52.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.205+0000 7f9603400640 1 -- 172.21.15.152:0/575568052 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f960415fc10 con 0x7f960406d1d0 2024-04-17T08:47:52.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.205+0000 7f9603400640 1 --2- 172.21.15.152:0/575568052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f960406d1d0 0x7f960415f300 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f95fc009e80 tx=0x7f95fc01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a01fc3b08a67cfa server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:52.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.205+0000 7f9602000640 1 -- 172.21.15.152:0/575568052 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95fc0a56b0 con 0x7f960406d1d0 2024-04-17T08:47:52.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.209+0000 7f9602000640 1 -- 172.21.15.152:0/575568052 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95fc0a5850 con 0x7f960406d1d0 2024-04-17T08:47:52.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.209+0000 7f9602000640 1 -- 172.21.15.152:0/575568052 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95fc0a5c20 con 0x7f960406d1d0 2024-04-17T08:47:52.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.209+0000 7f9609600640 1 -- 172.21.15.152:0/575568052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f960406d1d0 msgr2=0x7f960415f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:52.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.209+0000 7f9609600640 1 --2- 172.21.15.152:0/575568052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f960406d1d0 0x7f960415f300 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f95fc009e80 tx=0x7f95fc01c900 comp rx=0 tx=0).stop 2024-04-17T08:47:52.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.209+0000 7f9609600640 1 -- 172.21.15.152:0/575568052 shutdown_connections 2024-04-17T08:47:52.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.209+0000 7f9609600640 1 --2- 172.21.15.152:0/575568052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f960406d1d0 0x7f960415f300 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:52.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.209+0000 7f9609600640 1 --2- 172.21.15.152:0/575568052 >> v2:172.21.15.196:3300/0 conn(0x7f960415e8a0 0x7f96040d0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:52.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.209+0000 7f9609600640 1 -- 172.21.15.152:0/575568052 >> 172.21.15.152:0/575568052 conn(0x7f96040b3220 msgr2=0x7f96040b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:52.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.209+0000 7f9609600640 1 -- 172.21.15.152:0/575568052 shutdown_connections 2024-04-17T08:47:52.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.209+0000 7f9609600640 1 -- 172.21.15.152:0/575568052 wait complete. 2024-04-17T08:47:52.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.209+0000 7f9609600640 1 Processor -- start 2024-04-17T08:47:52.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.209+0000 7f9609600640 1 -- start start 2024-04-17T08:47:52.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.209+0000 7f9609600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f960406d1d0 0x7f9604156540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:52.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.209+0000 7f9609600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f960415e8a0 0x7f960415c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:52.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.209+0000 7f9609600640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f960415ee70 0x7f960415c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:52.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.209+0000 7f9609600640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f96040d0ec0 con 0x7f960415ee70 2024-04-17T08:47:52.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.209+0000 7f9609600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f96040d0d40 con 0x7f960406d1d0 2024-04-17T08:47:52.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.209+0000 7f9609600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f9604168210 con 0x7f960415e8a0 2024-04-17T08:47:52.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.209+0000 7f9603400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f960415ee70 0x7f960415c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:52.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.209+0000 7f9603400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f960415ee70 0x7f960415c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50618/0 (socket says 172.21.15.152:50618) 2024-04-17T08:47:52.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.209+0000 7f9603400640 1 -- 172.21.15.152:0/139520081 learned_addr learned my addr 172.21.15.152:0/139520081 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:52.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.209+0000 7f9602a00640 1 --2- 172.21.15.152:0/139520081 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f960406d1d0 0x7f9604156540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:52.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.209+0000 7f95fbe00640 1 --2- 172.21.15.152:0/139520081 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f960415e8a0 0x7f960415c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:52.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.209+0000 7f9603400640 1 -- 172.21.15.152:0/139520081 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f960415e8a0 msgr2=0x7f960415c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:52.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.209+0000 7f9603400640 1 --2- 172.21.15.152:0/139520081 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f960415e8a0 0x7f960415c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:52.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.213+0000 7f9603400640 1 -- 172.21.15.152:0/139520081 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f960406d1d0 msgr2=0x7f9604156540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:52.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.213+0000 7f9603400640 1 --2- 172.21.15.152:0/139520081 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f960406d1d0 0x7f9604156540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:52.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.213+0000 7f9603400640 1 -- 172.21.15.152:0/139520081 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9604158ca0 con 0x7f960415ee70 2024-04-17T08:47:52.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.213+0000 7f9603400640 1 --2- 172.21.15.152:0/139520081 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f960415ee70 0x7f960415c960 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f95fc01a530 tx=0x7f95fc0196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:52.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.213+0000 7f95faa00640 1 -- 172.21.15.152:0/139520081 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95fc0bc020 con 0x7f960415ee70 2024-04-17T08:47:52.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.213+0000 7f95faa00640 1 -- 172.21.15.152:0/139520081 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95fc0b8670 con 0x7f960415ee70 2024-04-17T08:47:52.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.213+0000 7f95faa00640 1 -- 172.21.15.152:0/139520081 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95fc009510 con 0x7f960415ee70 2024-04-17T08:47:52.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.213+0000 7f9609600640 1 -- 172.21.15.152:0/139520081 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9604158f40 con 0x7f960415ee70 2024-04-17T08:47:52.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.213+0000 7f9609600640 1 -- 172.21.15.152:0/139520081 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9604159500 con 0x7f960415ee70 2024-04-17T08:47:52.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.213+0000 7f9609600640 1 -- 172.21.15.152:0/139520081 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9604068a30 con 0x7f960415ee70 2024-04-17T08:47:52.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.213+0000 7f95faa00640 1 -- 172.21.15.152:0/139520081 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f95fc0bf020 con 0x7f960415ee70 2024-04-17T08:47:52.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.213+0000 7f95faa00640 1 --2- 172.21.15.152:0/139520081 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f95e0068380 0x7f95e006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:52.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.213+0000 7f95faa00640 1 -- 172.21.15.152:0/139520081 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5853+0+0 (secure 0 0 0) 0x7f95fc121960 con 0x7f960415ee70 2024-04-17T08:47:52.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.213+0000 7f9602a00640 1 --2- 172.21.15.152:0/139520081 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f95e0068380 0x7f95e006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:52.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.217+0000 7f9602a00640 1 --2- 172.21.15.152:0/139520081 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f95e0068380 0x7f95e006a840 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f95f4007a60 tx=0x7f95f4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:52.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.217+0000 7f95faa00640 1 -- 172.21.15.152:0/139520081 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f95fc0c6030 con 0x7f960415ee70 2024-04-17T08:47:52.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:52.393+0000 7f9609600640 1 -- 172.21.15.152:0/139520081 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f96040b1240 con 0x7f960415ee70 2024-04-17T08:47:53.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.033+0000 7f95faa00640 1 -- 172.21.15.152:0/139520081 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v30) ==== 178+0+0 (secure 0 0 0) 0x7f95fc016580 con 0x7f960415ee70 2024-04-17T08:47:53.037 INFO:teuthology.orchestra.run.smithi152.stderr:pool 'cephfs_data_ec' removed 2024-04-17T08:47:53.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.037+0000 7f9609600640 1 -- 172.21.15.152:0/139520081 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f95e0068380 msgr2=0x7f95e006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:53.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.037+0000 7f9609600640 1 --2- 172.21.15.152:0/139520081 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f95e0068380 0x7f95e006a840 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f95f4007a60 tx=0x7f95f4008040 comp rx=0 tx=0).stop 2024-04-17T08:47:53.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.037+0000 7f9609600640 1 -- 172.21.15.152:0/139520081 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f960415ee70 msgr2=0x7f960415c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:53.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.037+0000 7f9609600640 1 --2- 172.21.15.152:0/139520081 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f960415ee70 0x7f960415c960 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f95fc01a530 tx=0x7f95fc0196a0 comp rx=0 tx=0).stop 2024-04-17T08:47:53.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.037+0000 7f9609600640 1 -- 172.21.15.152:0/139520081 shutdown_connections 2024-04-17T08:47:53.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.037+0000 7f9609600640 1 --2- 172.21.15.152:0/139520081 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f960415ee70 0x7f960415c960 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:53.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.037+0000 7f9609600640 1 --2- 172.21.15.152:0/139520081 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f95e0068380 0x7f95e006a840 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:53.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.037+0000 7f9609600640 1 --2- 172.21.15.152:0/139520081 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f960415e8a0 0x7f960415c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:53.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.037+0000 7f9609600640 1 --2- 172.21.15.152:0/139520081 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f960406d1d0 0x7f9604156540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:53.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.037+0000 7f9609600640 1 -- 172.21.15.152:0/139520081 >> 172.21.15.152:0/139520081 conn(0x7f96040b3220 msgr2=0x7f960415d590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:53.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.037+0000 7f9609600640 1 -- 172.21.15.152:0/139520081 shutdown_connections 2024-04-17T08:47:53.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.037+0000 7f9609600640 1 -- 172.21.15.152:0/139520081 wait complete. 2024-04-17T08:47:53.066 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-17T08:47:53.066 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-17T08:47:53.066 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-17T08:47:53.066 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T08:47:53.066 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-17T08:47:53.067 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-17T08:47:53.067 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-17T08:47:53.067 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T08:47:53.067 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-17T08:47:53.067 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-17T08:47:53.067 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-17T08:47:53.067 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T08:47:53.067 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-17T08:47:53.068 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-17T08:47:53.068 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-17T08:47:53.068 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T08:47:53.082 INFO:tasks.ceph.mds.b:Stopped 2024-04-17T08:47:53.082 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-17T08:47:53.083 INFO:tasks.ceph.mds.d:Stopped 2024-04-17T08:47:53.083 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-17T08:47:53.122 INFO:tasks.ceph.mds.c:Stopped 2024-04-17T08:47:53.122 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-17T08:47:53.123 INFO:tasks.ceph.mds.a:Stopped 2024-04-17T08:47:53.123 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-17T08:47:53.127 INFO:tasks.ceph.mds.b:Started 2024-04-17T08:47:53.127 DEBUG:teuthology.parallel:result is None 2024-04-17T08:47:53.129 INFO:tasks.ceph.mds.d:Started 2024-04-17T08:47:53.129 DEBUG:teuthology.parallel:result is None 2024-04-17T08:47:53.173 INFO:tasks.ceph.mds.c:Started 2024-04-17T08:47:53.173 DEBUG:teuthology.parallel:result is None 2024-04-17T08:47:53.174 INFO:tasks.ceph.mds.a:Started 2024-04-17T08:47:53.175 DEBUG:teuthology.parallel:result is None 2024-04-17T08:47:53.175 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-17T08:47:53.222 INFO:tasks.ceph.mds.b.smithi196.stdout:starting mds.b at 2024-04-17T08:47:53.223 INFO:tasks.ceph.mds.d.smithi196.stdout:starting mds.d at 2024-04-17T08:47:53.266 INFO:tasks.ceph.mds.c.smithi152.stdout:starting mds.c at 2024-04-17T08:47:53.271 INFO:tasks.ceph.mds.a.smithi152.stdout:starting mds.a at 2024-04-17T08:47:53.328 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.325+0000 7f9bbd800640 1 Processor -- start 2024-04-17T08:47:53.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.325+0000 7f9bbd800640 1 -- start start 2024-04-17T08:47:53.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.329+0000 7f9bbd800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f9bb8161b70 0x7f9bb806dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:53.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.329+0000 7f9bbd800640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bb806e6b0 con 0x7f9bb80d0a70 2024-04-17T08:47:53.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.329+0000 7f9bbd800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bb806e990 con 0x7f9bb806e1a0 2024-04-17T08:47:53.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.329+0000 7f9bbd800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f9bb8161f50 con 0x7f9bb8161b70 2024-04-17T08:47:53.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.329+0000 7f9bb7400640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f9bb80d0a70 0x7f9bb80ad3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:50250/0 (socket says 172.21.15.152:50250) 2024-04-17T08:47:53.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.329+0000 7f9bb7400640 1 -- 172.21.15.152:0/3614995244 learned_addr learned my addr 172.21.15.152:0/3614995244 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:53.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.329+0000 7f9bb6a00640 1 --2- 172.21.15.152:0/3614995244 >> v2:172.21.15.196:3300/0 conn(0x7f9bb8161b70 0x7f9bb806dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:53.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.329+0000 7f9bb5600640 1 -- 172.21.15.152:0/3614995244 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1607041562 0 0) 0x7f9bb806e6b0 con 0x7f9bb80d0a70 2024-04-17T08:47:53.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.329+0000 7f9bb6a00640 1 -- 172.21.15.152:0/3614995244 >> v1:172.21.15.196:6789/0 conn(0x7f9bb806e1a0 legacy=0x7f9bb80d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:53.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.329+0000 7f9bb6a00640 1 -- 172.21.15.152:0/3614995244 >> v1:172.21.15.152:6789/0 conn(0x7f9bb80d0a70 legacy=0x7f9bb80ad3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:53.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.329+0000 7f9bb6a00640 1 -- 172.21.15.152:0/3614995244 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bb806ec70 con 0x7f9bb8161b70 2024-04-17T08:47:53.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.329+0000 7f9bb6a00640 1 --2- 172.21.15.152:0/3614995244 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9bb8161b70 0x7f9bb806dc60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9bb81620d0 tx=0x7f9ba001c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68a0d0710927c73b server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:53.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.329+0000 7f9bb5600640 1 -- 172.21.15.152:0/3614995244 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ba00b0070 con 0x7f9bb8161b70 2024-04-17T08:47:53.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.333+0000 7f9bb5600640 1 -- 172.21.15.152:0/3614995244 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ba00ab600 con 0x7f9bb8161b70 2024-04-17T08:47:53.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.333+0000 7f9bb5600640 1 -- 172.21.15.152:0/3614995244 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ba00ab9d0 con 0x7f9bb8161b70 2024-04-17T08:47:53.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.333+0000 7f9bbd800640 1 -- 172.21.15.152:0/3614995244 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9bb8161b70 msgr2=0x7f9bb806dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:53.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.333+0000 7f9bbd800640 1 --2- 172.21.15.152:0/3614995244 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9bb8161b70 0x7f9bb806dc60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9bb81620d0 tx=0x7f9ba001c410 comp rx=0 tx=0).stop 2024-04-17T08:47:53.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.333+0000 7f9bbd800640 1 -- 172.21.15.152:0/3614995244 shutdown_connections 2024-04-17T08:47:53.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.333+0000 7f9bbd800640 1 --2- 172.21.15.152:0/3614995244 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9bb8161b70 0x7f9bb806dc60 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:53.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.333+0000 7f9bbd800640 1 -- 172.21.15.152:0/3614995244 >> 172.21.15.152:0/3614995244 conn(0x7f9bb80b3350 msgr2=0x7f9bb80b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:53.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.333+0000 7f9bbd800640 1 -- 172.21.15.152:0/3614995244 shutdown_connections 2024-04-17T08:47:53.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.333+0000 7f9bbd800640 1 -- 172.21.15.152:0/3614995244 wait complete. 2024-04-17T08:47:53.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.333+0000 7f9bbd800640 1 Processor -- start 2024-04-17T08:47:53.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.333+0000 7f9bbd800640 1 -- start start 2024-04-17T08:47:53.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.333+0000 7f9bbd800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9bb806e1a0 0x7f9bb8157230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:53.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.333+0000 7f9bbd800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9bb80d0a70 0x7f9bb814d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:53.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.333+0000 7f9bbd800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bb8161b70 0x7f9bb8154ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:53.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.333+0000 7f9bbd800640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb816c1d0 con 0x7f9bb8161b70 2024-04-17T08:47:53.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.333+0000 7f9bbd800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb80ae5c0 con 0x7f9bb80d0a70 2024-04-17T08:47:53.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.333+0000 7f9bbd800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f9bb816c350 con 0x7f9bb806e1a0 2024-04-17T08:47:53.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.333+0000 7f9bb7400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bb8161b70 0x7f9bb8154ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:53.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.333+0000 7f9bb6a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9bb806e1a0 0x7f9bb8157230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:53.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.333+0000 7f9bb7400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bb8161b70 0x7f9bb8154ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50676/0 (socket says 172.21.15.152:50676) 2024-04-17T08:47:53.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.333+0000 7f9bb6a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9bb806e1a0 0x7f9bb8157230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.152:50902/0 (socket says 172.21.15.152:50902) 2024-04-17T08:47:53.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.333+0000 7f9bb7400640 1 -- 172.21.15.152:0/2118380108 learned_addr learned my addr 172.21.15.152:0/2118380108 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:53.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.333+0000 7f9bb6000640 1 --2- 172.21.15.152:0/2118380108 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9bb80d0a70 0x7f9bb814d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:53.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.333+0000 7f9bb6000640 1 -- 172.21.15.152:0/2118380108 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9bb806e1a0 msgr2=0x7f9bb8157230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:53.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.333+0000 7f9bb6000640 1 --2- 172.21.15.152:0/2118380108 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9bb806e1a0 0x7f9bb8157230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:53.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.333+0000 7f9bb6000640 1 -- 172.21.15.152:0/2118380108 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bb8161b70 msgr2=0x7f9bb8154ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:53.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.333+0000 7f9bb6000640 1 --2- 172.21.15.152:0/2118380108 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bb8161b70 0x7f9bb8154ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:53.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.337+0000 7f9bb6000640 1 -- 172.21.15.152:0/2118380108 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bb8157770 con 0x7f9bb80d0a70 2024-04-17T08:47:53.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.337+0000 7f9bb6a00640 1 --2- 172.21.15.152:0/2118380108 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9bb806e1a0 0x7f9bb8157230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T08:47:53.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.337+0000 7f9bb7400640 1 --2- 172.21.15.152:0/2118380108 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bb8161b70 0x7f9bb8154ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T08:47:53.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.337+0000 7f9bb6000640 1 --2- 172.21.15.152:0/2118380108 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9bb80d0a70 0x7f9bb814d720 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8000f70 tx=0x7f9ba800c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:53.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.337+0000 7f9baea00640 1 -- 172.21.15.152:0/2118380108 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ba8017070 con 0x7f9bb80d0a70 2024-04-17T08:47:53.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.337+0000 7f9baea00640 1 -- 172.21.15.152:0/2118380108 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ba80052d0 con 0x7f9bb80d0a70 2024-04-17T08:47:53.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.337+0000 7f9baea00640 1 -- 172.21.15.152:0/2118380108 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ba80054c0 con 0x7f9bb80d0a70 2024-04-17T08:47:53.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.337+0000 7f9bbd800640 1 -- 172.21.15.152:0/2118380108 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bb8156190 con 0x7f9bb80d0a70 2024-04-17T08:47:53.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.337+0000 7f9bbd800640 1 -- 172.21.15.152:0/2118380108 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bb8156750 con 0x7f9bb80d0a70 2024-04-17T08:47:53.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.337+0000 7f9bbd800640 1 -- 172.21.15.152:0/2118380108 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bb8068a30 con 0x7f9bb80d0a70 2024-04-17T08:47:53.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.337+0000 7f9baea00640 1 -- 172.21.15.152:0/2118380108 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9ba801a070 con 0x7f9bb80d0a70 2024-04-17T08:47:53.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.337+0000 7f9baea00640 1 --2- 172.21.15.152:0/2118380108 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9b94068380 0x7f9b9406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:53.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.337+0000 7f9baea00640 1 -- 172.21.15.152:0/2118380108 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5335+0+0 (secure 0 0 0) 0x7f9ba8085a90 con 0x7f9bb80d0a70 2024-04-17T08:47:53.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.337+0000 7f9bb6a00640 1 --2- 172.21.15.152:0/2118380108 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9b94068380 0x7f9b9406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:53.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.341+0000 7f9bb6a00640 1 --2- 172.21.15.152:0/2118380108 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9b94068380 0x7f9b9406a840 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9ba00ad000 tx=0x7f9ba00a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:53.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.341+0000 7f9baea00640 1 -- 172.21.15.152:0/2118380108 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f9ba8055b50 con 0x7f9bb80d0a70 2024-04-17T08:47:53.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:53.513+0000 7f9bbd800640 1 -- 172.21.15.152:0/2118380108 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f9bb81558c0 con 0x7f9bb80d0a70 2024-04-17T08:47:54.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.065+0000 7f9baea00640 1 -- 172.21.15.152:0/2118380108 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v32) ==== 97+0+0 (secure 0 0 0) 0x7f9ba8059e50 con 0x7f9bb80d0a70 2024-04-17T08:47:54.067 INFO:teuthology.orchestra.run.smithi152.stderr: removed all blocklist entries 2024-04-17T08:47:54.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.065+0000 7f9bbd800640 1 -- 172.21.15.152:0/2118380108 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9b94068380 msgr2=0x7f9b9406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:54.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.065+0000 7f9bbd800640 1 --2- 172.21.15.152:0/2118380108 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9b94068380 0x7f9b9406a840 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9ba00ad000 tx=0x7f9ba00a6000 comp rx=0 tx=0).stop 2024-04-17T08:47:54.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.065+0000 7f9bbd800640 1 -- 172.21.15.152:0/2118380108 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9bb80d0a70 msgr2=0x7f9bb814d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:54.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.065+0000 7f9bbd800640 1 --2- 172.21.15.152:0/2118380108 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9bb80d0a70 0x7f9bb814d720 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8000f70 tx=0x7f9ba800c890 comp rx=0 tx=0).stop 2024-04-17T08:47:54.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.069+0000 7f9bbd800640 1 -- 172.21.15.152:0/2118380108 shutdown_connections 2024-04-17T08:47:54.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.069+0000 7f9bbd800640 1 --2- 172.21.15.152:0/2118380108 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bb8161b70 0x7f9bb8154ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:54.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.069+0000 7f9bbd800640 1 --2- 172.21.15.152:0/2118380108 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9bb80d0a70 0x7f9bb814d720 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:54.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.069+0000 7f9bbd800640 1 --2- 172.21.15.152:0/2118380108 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9b94068380 0x7f9b9406a840 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:54.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.069+0000 7f9bbd800640 1 --2- 172.21.15.152:0/2118380108 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9bb806e1a0 0x7f9bb8157230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:54.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.069+0000 7f9bbd800640 1 -- 172.21.15.152:0/2118380108 >> 172.21.15.152:0/2118380108 conn(0x7f9bb80b3350 msgr2=0x7f9bb814e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:54.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.069+0000 7f9bbd800640 1 -- 172.21.15.152:0/2118380108 shutdown_connections 2024-04-17T08:47:54.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.069+0000 7f9bbd800640 1 -- 172.21.15.152:0/2118380108 wait complete. 2024-04-17T08:47:54.095 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-17T08:47:54.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.229+0000 7f3071e00640 1 Processor -- start 2024-04-17T08:47:54.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.233+0000 7f3071e00640 1 -- start start 2024-04-17T08:47:54.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.233+0000 7f3071e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f306c15d710 0x7f306c160720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:54.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.233+0000 7f3071e00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f306c160d20 con 0x7f306c15a010 2024-04-17T08:47:54.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.233+0000 7f3071e00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f306c15cc30 con 0x7f306c0d0a70 2024-04-17T08:47:54.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.233+0000 7f3071e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f306c15d280 con 0x7f306c15d710 2024-04-17T08:47:54.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.233+0000 7f306aa00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f306c15a010 0x7f306c0d0360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:50256/0 (socket says 172.21.15.152:50256) 2024-04-17T08:47:54.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.233+0000 7f306aa00640 1 -- 172.21.15.152:0/2458830992 learned_addr learned my addr 172.21.15.152:0/2458830992 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:54.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.233+0000 7f306b400640 1 --2- 172.21.15.152:0/2458830992 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f306c15d710 0x7f306c160720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:54.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.233+0000 7f306a000640 1 -- 172.21.15.152:0/2458830992 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3249196096 0 0) 0x7f306c160d20 con 0x7f306c15a010 2024-04-17T08:47:54.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.233+0000 7f306a000640 1 -- 172.21.15.152:0/2458830992 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3050003530 con 0x7f306c15a010 2024-04-17T08:47:54.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.233+0000 7f306b400640 1 -- 172.21.15.152:0/2458830992 >> v1:172.21.15.196:6789/0 conn(0x7f306c0d0a70 legacy=0x7f306c160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:54.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.233+0000 7f306a000640 1 -- 172.21.15.152:0/2458830992 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 637668992 0 0) 0x7f306c15cc30 con 0x7f306c0d0a70 2024-04-17T08:47:54.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.233+0000 7f306b400640 1 -- 172.21.15.152:0/2458830992 >> v1:172.21.15.152:6789/0 conn(0x7f306c15a010 legacy=0x7f306c0d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:54.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.233+0000 7f306b400640 1 -- 172.21.15.152:0/2458830992 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f306c15cf10 con 0x7f306c15d710 2024-04-17T08:47:54.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.237+0000 7f306b400640 1 --2- 172.21.15.152:0/2458830992 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f306c15d710 0x7f306c160720 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3064009dc0 tx=0x7f306401c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=723e0086c032f974 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:54.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.237+0000 7f306a000640 1 -- 172.21.15.152:0/2458830992 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30640b2070 con 0x7f306c15d710 2024-04-17T08:47:54.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.237+0000 7f306a000640 1 -- 172.21.15.152:0/2458830992 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30640a57c0 con 0x7f306c15d710 2024-04-17T08:47:54.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.237+0000 7f306a000640 1 -- 172.21.15.152:0/2458830992 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30640a5b70 con 0x7f306c15d710 2024-04-17T08:47:54.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.237+0000 7f3071e00640 1 -- 172.21.15.152:0/2458830992 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f306c15d710 msgr2=0x7f306c160720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:54.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.237+0000 7f3071e00640 1 --2- 172.21.15.152:0/2458830992 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f306c15d710 0x7f306c160720 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3064009dc0 tx=0x7f306401c900 comp rx=0 tx=0).stop 2024-04-17T08:47:54.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.237+0000 7f3071e00640 1 -- 172.21.15.152:0/2458830992 shutdown_connections 2024-04-17T08:47:54.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.237+0000 7f3071e00640 1 --2- 172.21.15.152:0/2458830992 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f306c15d710 0x7f306c160720 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:54.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.237+0000 7f3071e00640 1 -- 172.21.15.152:0/2458830992 >> 172.21.15.152:0/2458830992 conn(0x7f306c0b3350 msgr2=0x7f306c0b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:54.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.237+0000 7f3071e00640 1 -- 172.21.15.152:0/2458830992 shutdown_connections 2024-04-17T08:47:54.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.237+0000 7f3071e00640 1 -- 172.21.15.152:0/2458830992 wait complete. 2024-04-17T08:47:54.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.237+0000 7f3071e00640 1 Processor -- start 2024-04-17T08:47:54.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.237+0000 7f3071e00640 1 -- start start 2024-04-17T08:47:54.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.241+0000 7f3071e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f306c0d0a70 0x7f306c0b1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:54.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.241+0000 7f3071e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f306c15a010 0x7f306c06ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:54.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.241+0000 7f3071e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f306c15d710 0x7f306c06f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:54.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.241+0000 7f3071e00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f306c169f50 con 0x7f306c0d0a70 2024-04-17T08:47:54.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.241+0000 7f3071e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f306c169dd0 con 0x7f306c15a010 2024-04-17T08:47:54.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.241+0000 7f3071e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f306c16a0d0 con 0x7f306c15d710 2024-04-17T08:47:54.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.241+0000 7f306aa00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f306c0d0a70 0x7f306c0b1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:54.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.241+0000 7f306aa00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f306c0d0a70 0x7f306c0b1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50690/0 (socket says 172.21.15.152:50690) 2024-04-17T08:47:54.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.241+0000 7f306aa00640 1 -- 172.21.15.152:0/3005749619 learned_addr learned my addr 172.21.15.152:0/3005749619 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:54.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.241+0000 7f306b400640 1 --2- 172.21.15.152:0/3005749619 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f306c15d710 0x7f306c06f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:54.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.241+0000 7f3063e00640 1 --2- 172.21.15.152:0/3005749619 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f306c15a010 0x7f306c06ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:54.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.241+0000 7f306aa00640 1 -- 172.21.15.152:0/3005749619 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f306c15d710 msgr2=0x7f306c06f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:54.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.241+0000 7f306aa00640 1 --2- 172.21.15.152:0/3005749619 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f306c15d710 0x7f306c06f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:54.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.241+0000 7f306aa00640 1 -- 172.21.15.152:0/3005749619 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f306c15a010 msgr2=0x7f306c06ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:54.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.241+0000 7f306aa00640 1 --2- 172.21.15.152:0/3005749619 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f306c15a010 0x7f306c06ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:54.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.241+0000 7f306aa00640 1 -- 172.21.15.152:0/3005749619 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f306c158d70 con 0x7f306c0d0a70 2024-04-17T08:47:54.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.241+0000 7f306aa00640 1 --2- 172.21.15.152:0/3005749619 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f306c0d0a70 0x7f306c0b1070 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f305c00c450 tx=0x7f305c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:54.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.241+0000 7f3063400640 1 -- 172.21.15.152:0/3005749619 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305c017070 con 0x7f306c0d0a70 2024-04-17T08:47:54.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.241+0000 7f3063400640 1 -- 172.21.15.152:0/3005749619 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f305c005cf0 con 0x7f306c0d0a70 2024-04-17T08:47:54.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.241+0000 7f3071e00640 1 -- 172.21.15.152:0/3005749619 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f306c159050 con 0x7f306c0d0a70 2024-04-17T08:47:54.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.241+0000 7f3063400640 1 -- 172.21.15.152:0/3005749619 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305c007290 con 0x7f306c0d0a70 2024-04-17T08:47:54.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.241+0000 7f3071e00640 1 -- 172.21.15.152:0/3005749619 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f306c157ec0 con 0x7f306c0d0a70 2024-04-17T08:47:54.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.241+0000 7f3071e00640 1 -- 172.21.15.152:0/3005749619 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f306c068a30 con 0x7f306c0d0a70 2024-04-17T08:47:54.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.245+0000 7f3063400640 1 -- 172.21.15.152:0/3005749619 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f305c01a070 con 0x7f306c0d0a70 2024-04-17T08:47:54.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.245+0000 7f3063400640 1 --2- 172.21.15.152:0/3005749619 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3048068380 0x7f304806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:54.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.245+0000 7f3063400640 1 -- 172.21.15.152:0/3005749619 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7f305c085b20 con 0x7f306c0d0a70 2024-04-17T08:47:54.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.245+0000 7f3063e00640 1 --2- 172.21.15.152:0/3005749619 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3048068380 0x7f304806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:54.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.245+0000 7f3063e00640 1 --2- 172.21.15.152:0/3005749619 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3048068380 0x7f304806a840 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3054000f70 tx=0x7f3054009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:54.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.249+0000 7f3063400640 1 -- 172.21.15.152:0/3005749619 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f305c055c50 con 0x7f306c0d0a70 2024-04-17T08:47:54.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.461+0000 7f3071e00640 1 -- 172.21.15.152:0/3005749619 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f306c157090 con 0x7f306c0d0a70 2024-04-17T08:47:54.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.461+0000 7f3063400640 1 -- 172.21.15.152:0/3005749619 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) ==== 80+0+6645 (secure 0 0 0) 0x7f305c059f50 con 0x7f306c0d0a70 2024-04-17T08:47:54.465 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:47:54.465 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-17T08:47:54.465 INFO:teuthology.orchestra.run.smithi152.stdout: "auth_dump": [ 2024-04-17T08:47:54.466 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-04-17T08:47:54.466 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "mds.a", 2024-04-17T08:47:54.466 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQAkjB9m+ilEABAAVK3i5UGqk/+TD4cpzTIlJQ==", 2024-04-17T08:47:54.466 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2024-04-17T08:47:54.466 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": "allow", 2024-04-17T08:47:54.466 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": "allow *", 2024-04-17T08:47:54.466 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow *", 2024-04-17T08:47:54.466 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow *" 2024-04-17T08:47:54.466 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-17T08:47:54.466 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-17T08:47:54.466 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-04-17T08:47:54.466 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "mds.b", 2024-04-17T08:47:54.466 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQAkjB9mF6ZbDBAAI4unnmSecCm8KoQVXSsVqQ==", 2024-04-17T08:47:54.466 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2024-04-17T08:47:54.467 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": "allow", 2024-04-17T08:47:54.467 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": "allow *", 2024-04-17T08:47:54.467 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow *", 2024-04-17T08:47:54.467 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow *" 2024-04-17T08:47:54.467 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-17T08:47:54.467 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-17T08:47:54.467 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-04-17T08:47:54.467 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "mds.c", 2024-04-17T08:47:54.467 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQAkjB9mGf5xBxAA1/A1rbRX6Z+qzsmQNAb1Lw==", 2024-04-17T08:47:54.467 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2024-04-17T08:47:54.467 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": "allow", 2024-04-17T08:47:54.467 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": "allow *", 2024-04-17T08:47:54.467 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow *", 2024-04-17T08:47:54.467 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow *" 2024-04-17T08:47:54.467 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-17T08:47:54.467 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-17T08:47:54.468 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-04-17T08:47:54.468 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "mds.d", 2024-04-17T08:47:54.468 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQAkjB9mW7vLExAAtNjXP6TgkRsyeE67PovPoQ==", 2024-04-17T08:47:54.468 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2024-04-17T08:47:54.468 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": "allow", 2024-04-17T08:47:54.468 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": "allow *", 2024-04-17T08:47:54.468 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow *", 2024-04-17T08:47:54.468 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow *" 2024-04-17T08:47:54.468 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-17T08:47:54.468 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-17T08:47:54.468 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-04-17T08:47:54.468 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "osd.0", 2024-04-17T08:47:54.468 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQAnjB9m/8LNGBAAZFSeoFLldMHcRxotT6tmPw==", 2024-04-17T08:47:54.468 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2024-04-17T08:47:54.468 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": "allow profile osd", 2024-04-17T08:47:54.468 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow profile osd", 2024-04-17T08:47:54.469 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow *" 2024-04-17T08:47:54.469 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-17T08:47:54.469 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-17T08:47:54.469 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-04-17T08:47:54.469 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "osd.1", 2024-04-17T08:47:54.469 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQAqjB9m5SbCIxAA+Jf9yKW3yTCOWVI1gpv0OQ==", 2024-04-17T08:47:54.469 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2024-04-17T08:47:54.469 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": "allow profile osd", 2024-04-17T08:47:54.469 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow profile osd", 2024-04-17T08:47:54.469 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow *" 2024-04-17T08:47:54.469 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-17T08:47:54.469 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-17T08:47:54.469 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-04-17T08:47:54.469 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "osd.2", 2024-04-17T08:47:54.469 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQAtjB9mlZn6KxAAaKgc/jLBHOS8YTJ6BTNfpQ==", 2024-04-17T08:47:54.469 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2024-04-17T08:47:54.470 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": "allow profile osd", 2024-04-17T08:47:54.470 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow profile osd", 2024-04-17T08:47:54.470 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow *" 2024-04-17T08:47:54.470 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-17T08:47:54.470 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-17T08:47:54.470 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-04-17T08:47:54.470 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "osd.3", 2024-04-17T08:47:54.470 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQAwjB9mT/NoNRAA7Fzs3L3df3qjKWYlMio71w==", 2024-04-17T08:47:54.470 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2024-04-17T08:47:54.470 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": "allow profile osd", 2024-04-17T08:47:54.470 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow profile osd", 2024-04-17T08:47:54.470 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow *" 2024-04-17T08:47:54.470 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-17T08:47:54.470 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-17T08:47:54.470 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-04-17T08:47:54.470 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "osd.4", 2024-04-17T08:47:54.471 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQA2jB9mHS3OKxAAP/3nMCB6mlZT8y+FJBPp1w==", 2024-04-17T08:47:54.471 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2024-04-17T08:47:54.471 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": "allow profile osd", 2024-04-17T08:47:54.471 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow profile osd", 2024-04-17T08:47:54.471 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow *" 2024-04-17T08:47:54.471 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-17T08:47:54.471 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-17T08:47:54.471 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-04-17T08:47:54.471 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "osd.5", 2024-04-17T08:47:54.471 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQA5jB9meACWNRAAYx2W7obCh6nwVn+RWoO6AQ==", 2024-04-17T08:47:54.471 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2024-04-17T08:47:54.471 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": "allow profile osd", 2024-04-17T08:47:54.471 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow profile osd", 2024-04-17T08:47:54.471 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow *" 2024-04-17T08:47:54.471 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-17T08:47:54.471 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-17T08:47:54.472 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-04-17T08:47:54.472 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "osd.6", 2024-04-17T08:47:54.472 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQA9jB9mz7cRBRAAlN7o8BUpJ0Zy8swnx2gU0g==", 2024-04-17T08:47:54.472 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2024-04-17T08:47:54.472 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": "allow profile osd", 2024-04-17T08:47:54.472 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow profile osd", 2024-04-17T08:47:54.472 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow *" 2024-04-17T08:47:54.472 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-17T08:47:54.472 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-17T08:47:54.472 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-04-17T08:47:54.472 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "osd.7", 2024-04-17T08:47:54.472 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQBAjB9mjjdVERAA1BVeJPViaZojOl/Oz/tsXw==", 2024-04-17T08:47:54.472 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2024-04-17T08:47:54.472 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": "allow profile osd", 2024-04-17T08:47:54.472 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow profile osd", 2024-04-17T08:47:54.472 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow *" 2024-04-17T08:47:54.473 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-17T08:47:54.473 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-17T08:47:54.473 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-04-17T08:47:54.473 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "client.0", 2024-04-17T08:47:54.473 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQAkjB9mPgvRFxAAe9v2psm5V7QNTuK9ytMuxQ==", 2024-04-17T08:47:54.473 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2024-04-17T08:47:54.473 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": "allow", 2024-04-17T08:47:54.473 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": "allow r", 2024-04-17T08:47:54.473 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow rw", 2024-04-17T08:47:54.473 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow rwx" 2024-04-17T08:47:54.473 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-17T08:47:54.473 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-17T08:47:54.473 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-04-17T08:47:54.473 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "client.1", 2024-04-17T08:47:54.474 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQAkjB9mfMx7IRAAfvDOCRPcGBXZj7zKg4lHYw==", 2024-04-17T08:47:54.474 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2024-04-17T08:47:54.474 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": "allow", 2024-04-17T08:47:54.474 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": "allow r", 2024-04-17T08:47:54.474 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow rw", 2024-04-17T08:47:54.474 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow rwx" 2024-04-17T08:47:54.474 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-17T08:47:54.474 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-17T08:47:54.474 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-04-17T08:47:54.474 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "client.2", 2024-04-17T08:47:54.474 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQAkjB9me8XUHRAAeFZRw9wxA8VPklmbWIvDOg==", 2024-04-17T08:47:54.474 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2024-04-17T08:47:54.474 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": "allow", 2024-04-17T08:47:54.474 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": "allow r", 2024-04-17T08:47:54.475 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow rw", 2024-04-17T08:47:54.475 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow rwx" 2024-04-17T08:47:54.475 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-17T08:47:54.475 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-17T08:47:54.475 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-04-17T08:47:54.475 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "client.3", 2024-04-17T08:47:54.475 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQAkjB9mnJWUJxAAz4RbvyEAn77/12N82VHHIw==", 2024-04-17T08:47:54.475 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2024-04-17T08:47:54.475 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": "allow", 2024-04-17T08:47:54.475 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": "allow r", 2024-04-17T08:47:54.475 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow rw", 2024-04-17T08:47:54.475 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow rwx" 2024-04-17T08:47:54.475 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-17T08:47:54.475 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-17T08:47:54.476 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-04-17T08:47:54.476 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "client.admin", 2024-04-17T08:47:54.476 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQAjjB9mh5hdIBAAHhKWoi+B6qOBfNOftL3wUA==", 2024-04-17T08:47:54.476 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2024-04-17T08:47:54.476 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": "allow *", 2024-04-17T08:47:54.476 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": "allow *", 2024-04-17T08:47:54.476 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow *", 2024-04-17T08:47:54.476 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow *" 2024-04-17T08:47:54.476 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-17T08:47:54.476 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-17T08:47:54.476 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-04-17T08:47:54.476 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "client.bootstrap-mds", 2024-04-17T08:47:54.476 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQBQjB9m1BAhFRAAB83h9paFZcL0Gfa1lOQZww==", 2024-04-17T08:47:54.476 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2024-04-17T08:47:54.476 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow profile bootstrap-mds" 2024-04-17T08:47:54.476 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-17T08:47:54.477 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-17T08:47:54.477 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-04-17T08:47:54.477 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "client.bootstrap-mgr", 2024-04-17T08:47:54.477 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQBQjB9mRCYhFRAAOh7ExbFixkAih7yg/Hs1BQ==", 2024-04-17T08:47:54.477 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2024-04-17T08:47:54.477 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow profile bootstrap-mgr" 2024-04-17T08:47:54.477 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-17T08:47:54.477 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-17T08:47:54.477 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-04-17T08:47:54.477 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "client.bootstrap-osd", 2024-04-17T08:47:54.477 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQBQjB9mlzchFRAAY0alxRlsEi1/Gs4+4Ry4Ig==", 2024-04-17T08:47:54.477 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2024-04-17T08:47:54.477 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow profile bootstrap-osd" 2024-04-17T08:47:54.477 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-17T08:47:54.477 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-17T08:47:54.477 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-04-17T08:47:54.478 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "client.bootstrap-rbd", 2024-04-17T08:47:54.478 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQBQjB9m+0chFRAA+Ui2InJ6rFZ1pboZYuELtA==", 2024-04-17T08:47:54.478 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2024-04-17T08:47:54.478 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow profile bootstrap-rbd" 2024-04-17T08:47:54.478 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-17T08:47:54.478 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-17T08:47:54.478 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-04-17T08:47:54.478 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-04-17T08:47:54.478 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQBQjB9mTFIhFRAAZyATtsyzwswoqhPMhGpaiQ==", 2024-04-17T08:47:54.478 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2024-04-17T08:47:54.478 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-04-17T08:47:54.478 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-17T08:47:54.478 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-17T08:47:54.478 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-04-17T08:47:54.479 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "client.bootstrap-rgw", 2024-04-17T08:47:54.479 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQBQjB9mzFshFRAAd2bjOC9CChVJyWpkl/DhPg==", 2024-04-17T08:47:54.479 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2024-04-17T08:47:54.479 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow profile bootstrap-rgw" 2024-04-17T08:47:54.479 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-17T08:47:54.479 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-17T08:47:54.479 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-04-17T08:47:54.479 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "mgr.x", 2024-04-17T08:47:54.479 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQAjjB9mR+fQNxAAJM0Z33u1iYNtMqGYFak5tQ==", 2024-04-17T08:47:54.479 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2024-04-17T08:47:54.479 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": "allow *", 2024-04-17T08:47:54.479 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow profile mgr", 2024-04-17T08:47:54.479 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow *" 2024-04-17T08:47:54.479 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-17T08:47:54.479 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-17T08:47:54.480 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-04-17T08:47:54.480 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "mgr.y", 2024-04-17T08:47:54.480 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQAjjB9mPxPpMxAAaNmkmPoNfoRHO9Jd/x8SeA==", 2024-04-17T08:47:54.480 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2024-04-17T08:47:54.480 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": "allow *", 2024-04-17T08:47:54.480 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow profile mgr", 2024-04-17T08:47:54.480 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow *" 2024-04-17T08:47:54.480 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-17T08:47:54.480 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-17T08:47:54.480 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-04-17T08:47:54.480 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-17T08:47:54.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.465+0000 7f3071e00640 1 -- 172.21.15.152:0/3005749619 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3048068380 msgr2=0x7f304806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:54.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.465+0000 7f3071e00640 1 --2- 172.21.15.152:0/3005749619 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3048068380 0x7f304806a840 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3054000f70 tx=0x7f3054009040 comp rx=0 tx=0).stop 2024-04-17T08:47:54.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.465+0000 7f3071e00640 1 -- 172.21.15.152:0/3005749619 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f306c0d0a70 msgr2=0x7f306c0b1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:54.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.465+0000 7f3071e00640 1 --2- 172.21.15.152:0/3005749619 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f306c0d0a70 0x7f306c0b1070 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f305c00c450 tx=0x7f305c00c910 comp rx=0 tx=0).stop 2024-04-17T08:47:54.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.465+0000 7f3071e00640 1 -- 172.21.15.152:0/3005749619 shutdown_connections 2024-04-17T08:47:54.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.465+0000 7f3071e00640 1 --2- 172.21.15.152:0/3005749619 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3048068380 0x7f304806a840 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:54.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.465+0000 7f3071e00640 1 --2- 172.21.15.152:0/3005749619 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f306c15d710 0x7f306c06f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:54.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.465+0000 7f3071e00640 1 --2- 172.21.15.152:0/3005749619 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f306c15a010 0x7f306c06ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:54.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.465+0000 7f3071e00640 1 --2- 172.21.15.152:0/3005749619 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f306c0d0a70 0x7f306c0b1070 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:54.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.465+0000 7f3071e00640 1 -- 172.21.15.152:0/3005749619 >> 172.21.15.152:0/3005749619 conn(0x7f306c0b3350 msgr2=0x7f306c159350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:54.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.465+0000 7f3071e00640 1 -- 172.21.15.152:0/3005749619 shutdown_connections 2024-04-17T08:47:54.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.465+0000 7f3071e00640 1 -- 172.21.15.152:0/3005749619 wait complete. 2024-04-17T08:47:54.486 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-04-17T08:47:54.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.621+0000 7f0b2d400640 1 Processor -- start 2024-04-17T08:47:54.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.621+0000 7f0b2d400640 1 -- start start 2024-04-17T08:47:54.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.621+0000 7f0b2d400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f0b280d0cd0 0x7f0b280d2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:54.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.621+0000 7f0b2d400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0b280d2970 0x7f0b2815dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:54.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.621+0000 7f0b2d400640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b280d1390 con 0x7f0b28156950 2024-04-17T08:47:54.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.621+0000 7f0b2d400640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f0b280d1160 con 0x7f0b280d0cd0 2024-04-17T08:47:54.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.621+0000 7f0b2d400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f0b280d1670 con 0x7f0b280d2970 2024-04-17T08:47:54.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.621+0000 7f0b27e00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f0b28156950 0x7f0b280b6330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:50268/0 (socket says 172.21.15.152:50268) 2024-04-17T08:47:54.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.621+0000 7f0b27e00640 1 -- 172.21.15.152:0/2573245073 learned_addr learned my addr 172.21.15.152:0/2573245073 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:54.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.621+0000 7f0b27400640 1 --2- 172.21.15.152:0/2573245073 >> v2:172.21.15.152:3300/0 conn(0x7f0b280d0cd0 0x7f0b280d2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:54.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.621+0000 7f0b2ca00640 1 --2- 172.21.15.152:0/2573245073 >> v2:172.21.15.196:3300/0 conn(0x7f0b280d2970 0x7f0b2815dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:54.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.621+0000 7f0b26a00640 1 -- 172.21.15.152:0/2573245073 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4199814164 0 0) 0x7f0b280d1390 con 0x7f0b28156950 2024-04-17T08:47:54.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.621+0000 7f0b26a00640 1 -- 172.21.15.152:0/2573245073 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b0c003530 con 0x7f0b28156950 2024-04-17T08:47:54.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.621+0000 7f0b27400640 1 -- 172.21.15.152:0/2573245073 >> v2:172.21.15.196:3300/0 conn(0x7f0b280d2970 msgr2=0x7f0b2815dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:54.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.621+0000 7f0b27400640 1 --2- 172.21.15.152:0/2573245073 >> v2:172.21.15.196:3300/0 conn(0x7f0b280d2970 0x7f0b2815dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:54.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.621+0000 7f0b27400640 1 -- 172.21.15.152:0/2573245073 >> v1:172.21.15.152:6789/0 conn(0x7f0b28156950 legacy=0x7f0b280b6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:54.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.621+0000 7f0b27400640 1 -- 172.21.15.152:0/2573245073 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b280d1950 con 0x7f0b280d0cd0 2024-04-17T08:47:54.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.625+0000 7f0b27400640 1 --2- 172.21.15.152:0/2573245073 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b280d0cd0 0x7f0b280d2430 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f0b280b72e0 tx=0x7f0b1401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee20a9d58c5d1e9c server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:54.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.625+0000 7f0b26a00640 1 -- 172.21.15.152:0/2573245073 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b140b2070 con 0x7f0b280d0cd0 2024-04-17T08:47:54.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.625+0000 7f0b26a00640 1 -- 172.21.15.152:0/2573245073 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b140a9070 con 0x7f0b280d0cd0 2024-04-17T08:47:54.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.625+0000 7f0b26a00640 1 -- 172.21.15.152:0/2573245073 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b140ad880 con 0x7f0b280d0cd0 2024-04-17T08:47:54.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.625+0000 7f0b2d400640 1 -- 172.21.15.152:0/2573245073 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b280d0cd0 msgr2=0x7f0b280d2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:54.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.625+0000 7f0b2d400640 1 --2- 172.21.15.152:0/2573245073 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b280d0cd0 0x7f0b280d2430 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f0b280b72e0 tx=0x7f0b1401c450 comp rx=0 tx=0).stop 2024-04-17T08:47:54.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.625+0000 7f0b2d400640 1 -- 172.21.15.152:0/2573245073 shutdown_connections 2024-04-17T08:47:54.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.625+0000 7f0b2d400640 1 --2- 172.21.15.152:0/2573245073 >> v2:172.21.15.196:3300/0 conn(0x7f0b280d2970 0x7f0b2815dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:54.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.625+0000 7f0b2d400640 1 --2- 172.21.15.152:0/2573245073 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b280d0cd0 0x7f0b280d2430 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:54.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.625+0000 7f0b2d400640 1 -- 172.21.15.152:0/2573245073 >> 172.21.15.152:0/2573245073 conn(0x7f0b280b7690 msgr2=0x7f0b280b7aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:54.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.625+0000 7f0b2d400640 1 -- 172.21.15.152:0/2573245073 shutdown_connections 2024-04-17T08:47:54.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.625+0000 7f0b2d400640 1 -- 172.21.15.152:0/2573245073 wait complete. 2024-04-17T08:47:54.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.625+0000 7f0b2d400640 1 Processor -- start 2024-04-17T08:47:54.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.629+0000 7f0b2d400640 1 -- start start 2024-04-17T08:47:54.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.629+0000 7f0b2d400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b280d0cd0 0x7f0b28139840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:54.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.629+0000 7f0b2d400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b28156950 0x7f0b2815a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:54.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.629+0000 7f0b2d400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b2814b160 0x7f0b2815bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:54.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.629+0000 7f0b2d400640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0b28169400 con 0x7f0b280d0cd0 2024-04-17T08:47:54.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.629+0000 7f0b2d400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0b28169280 con 0x7f0b2814b160 2024-04-17T08:47:54.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.629+0000 7f0b2d400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f0b28169580 con 0x7f0b28156950 2024-04-17T08:47:54.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.629+0000 7f0b27e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b280d0cd0 0x7f0b28139840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:54.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.629+0000 7f0b27e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b280d0cd0 0x7f0b28139840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50708/0 (socket says 172.21.15.152:50708) 2024-04-17T08:47:54.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.629+0000 7f0b27e00640 1 -- 172.21.15.152:0/2489552567 learned_addr learned my addr 172.21.15.152:0/2489552567 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:54.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.629+0000 7f0b2ca00640 1 --2- 172.21.15.152:0/2489552567 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b2814b160 0x7f0b2815bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:54.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.629+0000 7f0b27400640 1 --2- 172.21.15.152:0/2489552567 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b28156950 0x7f0b2815a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:54.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.629+0000 7f0b27e00640 1 -- 172.21.15.152:0/2489552567 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b28156950 msgr2=0x7f0b2815a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:54.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.629+0000 7f0b27e00640 1 --2- 172.21.15.152:0/2489552567 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b28156950 0x7f0b2815a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:54.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.629+0000 7f0b27e00640 1 -- 172.21.15.152:0/2489552567 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b2814b160 msgr2=0x7f0b2815bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:54.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.629+0000 7f0b27e00640 1 --2- 172.21.15.152:0/2489552567 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b2814b160 0x7f0b2815bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:54.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.629+0000 7f0b27e00640 1 -- 172.21.15.152:0/2489552567 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b2815aae0 con 0x7f0b280d0cd0 2024-04-17T08:47:54.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.629+0000 7f0b27e00640 1 --2- 172.21.15.152:0/2489552567 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b280d0cd0 0x7f0b28139840 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f0b1800c3c0 tx=0x7f0b1800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:54.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.629+0000 7f0b1fe00640 1 -- 172.21.15.152:0/2489552567 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b18017070 con 0x7f0b280d0cd0 2024-04-17T08:47:54.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.629+0000 7f0b1fe00640 1 -- 172.21.15.152:0/2489552567 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b18005cf0 con 0x7f0b280d0cd0 2024-04-17T08:47:54.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.629+0000 7f0b1fe00640 1 -- 172.21.15.152:0/2489552567 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b180072f0 con 0x7f0b280d0cd0 2024-04-17T08:47:54.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.629+0000 7f0b2d400640 1 -- 172.21.15.152:0/2489552567 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b2815c470 con 0x7f0b280d0cd0 2024-04-17T08:47:54.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.629+0000 7f0b2d400640 1 -- 172.21.15.152:0/2489552567 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b2813a250 con 0x7f0b280d0cd0 2024-04-17T08:47:54.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.629+0000 7f0b2d400640 1 -- 172.21.15.152:0/2489552567 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b28075c10 con 0x7f0b280d0cd0 2024-04-17T08:47:54.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.633+0000 7f0b1fe00640 1 -- 172.21.15.152:0/2489552567 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0b1801a070 con 0x7f0b280d0cd0 2024-04-17T08:47:54.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.633+0000 7f0b1fe00640 1 --2- 172.21.15.152:0/2489552567 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0b08068380 0x7f0b0806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:54.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.633+0000 7f0b1fe00640 1 -- 172.21.15.152:0/2489552567 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7f0b18085c00 con 0x7f0b280d0cd0 2024-04-17T08:47:54.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.633+0000 7f0b27400640 1 --2- 172.21.15.152:0/2489552567 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0b08068380 0x7f0b0806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:54.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.633+0000 7f0b27400640 1 --2- 172.21.15.152:0/2489552567 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0b08068380 0x7f0b0806a840 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0b140af000 tx=0x7f0b14008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:54.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.637+0000 7f0b1fe00640 1 -- 172.21.15.152:0/2489552567 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f0b18055c90 con 0x7f0b280d0cd0 2024-04-17T08:47:54.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.845+0000 7f0b2d400640 1 -- 172.21.15.152:0/2489552567 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f0b280b3950 con 0x7f0b280d0cd0 2024-04-17T08:47:54.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.849+0000 7f0b1fe00640 1 -- 172.21.15.152:0/2489552567 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7f0b18059f90 con 0x7f0b280d0cd0 2024-04-17T08:47:54.854 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.853+0000 7f0b2d400640 1 -- 172.21.15.152:0/2489552567 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0b08068380 msgr2=0x7f0b0806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:54.854 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.853+0000 7f0b2d400640 1 --2- 172.21.15.152:0/2489552567 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0b08068380 0x7f0b0806a840 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0b140af000 tx=0x7f0b14008040 comp rx=0 tx=0).stop 2024-04-17T08:47:54.854 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.853+0000 7f0b2d400640 1 -- 172.21.15.152:0/2489552567 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b280d0cd0 msgr2=0x7f0b28139840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:54.854 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.853+0000 7f0b2d400640 1 --2- 172.21.15.152:0/2489552567 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b280d0cd0 0x7f0b28139840 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f0b1800c3c0 tx=0x7f0b1800c880 comp rx=0 tx=0).stop 2024-04-17T08:47:54.854 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.853+0000 7f0b2d400640 1 -- 172.21.15.152:0/2489552567 shutdown_connections 2024-04-17T08:47:54.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.853+0000 7f0b2d400640 1 --2- 172.21.15.152:0/2489552567 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b2814b160 0x7f0b2815bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:54.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.853+0000 7f0b2d400640 1 --2- 172.21.15.152:0/2489552567 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0b08068380 0x7f0b0806a840 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:54.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.853+0000 7f0b2d400640 1 --2- 172.21.15.152:0/2489552567 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b28156950 0x7f0b2815a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:54.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.853+0000 7f0b2d400640 1 --2- 172.21.15.152:0/2489552567 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b280d0cd0 0x7f0b28139840 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:54.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.853+0000 7f0b2d400640 1 -- 172.21.15.152:0/2489552567 >> 172.21.15.152:0/2489552567 conn(0x7f0b280b7690 msgr2=0x7f0b280b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:54.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.853+0000 7f0b2d400640 1 -- 172.21.15.152:0/2489552567 shutdown_connections 2024-04-17T08:47:54.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:54.853+0000 7f0b2d400640 1 -- 172.21.15.152:0/2489552567 wait complete. 2024-04-17T08:47:54.873 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-04-17T08:47:55.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.009+0000 7f1f24c00640 1 Processor -- start 2024-04-17T08:47:55.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.009+0000 7f1f24c00640 1 -- start start 2024-04-17T08:47:55.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.009+0000 7f1f24c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f200af670 0x7f1f2015b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:55.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.009+0000 7f1f24c00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f1f200d0360 0x7f1f200d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:55.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.009+0000 7f1f24c00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f20072c40 con 0x7f1f2006f980 2024-04-17T08:47:55.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.009+0000 7f1f24c00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f1f2015c820 con 0x7f1f200d0360 2024-04-17T08:47:55.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.009+0000 7f1f24c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f1f2015c260 con 0x7f1f200af670 2024-04-17T08:47:55.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.009+0000 7f1f1e800640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f1f200d0360 0x7f1f200d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:55.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.009+0000 7f1f1e800640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f1f200d0360 0x7f1f200d07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50712/0 (socket says 172.21.15.152:50712) 2024-04-17T08:47:55.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.009+0000 7f1f1e800640 1 -- 172.21.15.152:0/1994756377 learned_addr learned my addr 172.21.15.152:0/1994756377 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:55.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.009+0000 7f1f1de00640 1 --2- 172.21.15.152:0/1994756377 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f200af670 0x7f1f2015b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:55.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.009+0000 7f1f1e800640 1 -- 172.21.15.152:0/1994756377 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f200af670 msgr2=0x7f1f2015b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:55.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.009+0000 7f1f1e800640 1 --2- 172.21.15.152:0/1994756377 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f200af670 0x7f1f2015b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:55.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.009+0000 7f1f1e800640 1 -- 172.21.15.152:0/1994756377 >> v1:172.21.15.196:6789/0 conn(0x7f1f2006f980 legacy=0x7f1f20072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:55.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.009+0000 7f1f1e800640 1 -- 172.21.15.152:0/1994756377 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f2015c540 con 0x7f1f200d0360 2024-04-17T08:47:55.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.009+0000 7f1f1de00640 1 --2- 172.21.15.152:0/1994756377 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f200af670 0x7f1f2015b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:47:55.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.013+0000 7f1f1e800640 1 --2- 172.21.15.152:0/1994756377 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f200d0360 0x7f1f200d07f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f1f18009e50 tx=0x7f1f1801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49bfa680639b34e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:55.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.013+0000 7f1f1d400640 1 -- 172.21.15.152:0/1994756377 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f180a56d0 con 0x7f1f200d0360 2024-04-17T08:47:55.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.013+0000 7f1f1d400640 1 -- 172.21.15.152:0/1994756377 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f180a5870 con 0x7f1f200d0360 2024-04-17T08:47:55.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.013+0000 7f1f1d400640 1 -- 172.21.15.152:0/1994756377 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f180a5c40 con 0x7f1f200d0360 2024-04-17T08:47:55.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.013+0000 7f1f24c00640 1 -- 172.21.15.152:0/1994756377 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f200d0360 msgr2=0x7f1f200d07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:55.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.013+0000 7f1f24c00640 1 --2- 172.21.15.152:0/1994756377 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f200d0360 0x7f1f200d07f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f1f18009e50 tx=0x7f1f1801c960 comp rx=0 tx=0).stop 2024-04-17T08:47:55.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.013+0000 7f1f24c00640 1 -- 172.21.15.152:0/1994756377 shutdown_connections 2024-04-17T08:47:55.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.013+0000 7f1f24c00640 1 --2- 172.21.15.152:0/1994756377 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f200d0360 0x7f1f200d07f0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:55.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.013+0000 7f1f24c00640 1 --2- 172.21.15.152:0/1994756377 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f200af670 0x7f1f2015b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:55.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.013+0000 7f1f24c00640 1 -- 172.21.15.152:0/1994756377 >> 172.21.15.152:0/1994756377 conn(0x7f1f200b3350 msgr2=0x7f1f200b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:55.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.013+0000 7f1f24c00640 1 -- 172.21.15.152:0/1994756377 shutdown_connections 2024-04-17T08:47:55.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.013+0000 7f1f24c00640 1 -- 172.21.15.152:0/1994756377 wait complete. 2024-04-17T08:47:55.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.013+0000 7f1f24c00640 1 Processor -- start 2024-04-17T08:47:55.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.017+0000 7f1f24c00640 1 -- start start 2024-04-17T08:47:55.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.017+0000 7f1f24c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f2006f980 0x7f1f2014b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:55.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.017+0000 7f1f24c00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f200af670 0x7f1f200b1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:55.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.017+0000 7f1f24c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f200d0360 0x7f1f201550d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:55.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.017+0000 7f1f24c00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1f2015bf80 con 0x7f1f200af670 2024-04-17T08:47:55.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.017+0000 7f1f24c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1f2015be00 con 0x7f1f2006f980 2024-04-17T08:47:55.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.017+0000 7f1f24c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f1f20168050 con 0x7f1f200d0360 2024-04-17T08:47:55.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.017+0000 7f1f17e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f200af670 0x7f1f200b1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:55.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.017+0000 7f1f17e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f200af670 0x7f1f200b1dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50726/0 (socket says 172.21.15.152:50726) 2024-04-17T08:47:55.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.017+0000 7f1f17e00640 1 -- 172.21.15.152:0/2931761132 learned_addr learned my addr 172.21.15.152:0/2931761132 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:55.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.017+0000 7f1f1e800640 1 --2- 172.21.15.152:0/2931761132 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f200d0360 0x7f1f201550d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:55.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.017+0000 7f1f1de00640 1 --2- 172.21.15.152:0/2931761132 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f2006f980 0x7f1f2014b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:55.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.017+0000 7f1f17e00640 1 -- 172.21.15.152:0/2931761132 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f200d0360 msgr2=0x7f1f201550d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:55.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.017+0000 7f1f17e00640 1 --2- 172.21.15.152:0/2931761132 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f200d0360 0x7f1f201550d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:55.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.017+0000 7f1f17e00640 1 -- 172.21.15.152:0/2931761132 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f2006f980 msgr2=0x7f1f2014b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:55.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.017+0000 7f1f17e00640 1 --2- 172.21.15.152:0/2931761132 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f2006f980 0x7f1f2014b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:55.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.017+0000 7f1f17e00640 1 -- 172.21.15.152:0/2931761132 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f200b2c70 con 0x7f1f200af670 2024-04-17T08:47:55.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.017+0000 7f1f1de00640 1 --2- 172.21.15.152:0/2931761132 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f2006f980 0x7f1f2014b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:55.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.017+0000 7f1f17e00640 1 --2- 172.21.15.152:0/2931761132 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f200af670 0x7f1f200b1dd0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f1f0800c440 tx=0x7f1f0800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:55.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.017+0000 7f1f16000640 1 -- 172.21.15.152:0/2931761132 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f08016020 con 0x7f1f200af670 2024-04-17T08:47:55.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.017+0000 7f1f16000640 1 -- 172.21.15.152:0/2931761132 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f08012830 con 0x7f1f200af670 2024-04-17T08:47:55.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.017+0000 7f1f24c00640 1 -- 172.21.15.152:0/2931761132 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f2014bd60 con 0x7f1f200af670 2024-04-17T08:47:55.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.017+0000 7f1f16000640 1 -- 172.21.15.152:0/2931761132 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f08012c20 con 0x7f1f200af670 2024-04-17T08:47:55.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.017+0000 7f1f24c00640 1 -- 172.21.15.152:0/2931761132 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f200b2990 con 0x7f1f200af670 2024-04-17T08:47:55.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.017+0000 7f1f24c00640 1 -- 172.21.15.152:0/2931761132 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f20068a30 con 0x7f1f200af670 2024-04-17T08:47:55.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.021+0000 7f1f16000640 1 -- 172.21.15.152:0/2931761132 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1f08019020 con 0x7f1f200af670 2024-04-17T08:47:55.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.021+0000 7f1f16000640 1 --2- 172.21.15.152:0/2931761132 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1efc068380 0x7f1efc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:55.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.021+0000 7f1f16000640 1 -- 172.21.15.152:0/2931761132 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7f1f080865f0 con 0x7f1f200af670 2024-04-17T08:47:55.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.021+0000 7f1f1de00640 1 --2- 172.21.15.152:0/2931761132 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1efc068380 0x7f1efc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:55.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.021+0000 7f1f1de00640 1 --2- 172.21.15.152:0/2931761132 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1efc068380 0x7f1efc06a840 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1f10006fd0 tx=0x7f1f10008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:55.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.025+0000 7f1f16000640 1 -- 172.21.15.152:0/2931761132 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f1f08020030 con 0x7f1f200af670 2024-04-17T08:47:55.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.241+0000 7f1f24c00640 1 -- 172.21.15.152:0/2931761132 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f1f20074e80 con 0x7f1f200af670 2024-04-17T08:47:55.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.245+0000 7f1f16000640 1 -- 172.21.15.152:0/2931761132 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7f1f08056c40 con 0x7f1f200af670 2024-04-17T08:47:55.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.245+0000 7f1f24c00640 1 -- 172.21.15.152:0/2931761132 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1efc068380 msgr2=0x7f1efc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:55.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.245+0000 7f1f24c00640 1 --2- 172.21.15.152:0/2931761132 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1efc068380 0x7f1efc06a840 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1f10006fd0 tx=0x7f1f10008040 comp rx=0 tx=0).stop 2024-04-17T08:47:55.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.245+0000 7f1f24c00640 1 -- 172.21.15.152:0/2931761132 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f200af670 msgr2=0x7f1f200b1dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:55.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.245+0000 7f1f24c00640 1 --2- 172.21.15.152:0/2931761132 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f200af670 0x7f1f200b1dd0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f1f0800c440 tx=0x7f1f0800c900 comp rx=0 tx=0).stop 2024-04-17T08:47:55.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.245+0000 7f1f24c00640 1 -- 172.21.15.152:0/2931761132 shutdown_connections 2024-04-17T08:47:55.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.245+0000 7f1f24c00640 1 --2- 172.21.15.152:0/2931761132 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f1efc068380 0x7f1efc06a840 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:55.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.245+0000 7f1f24c00640 1 --2- 172.21.15.152:0/2931761132 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f200d0360 0x7f1f201550d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:55.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.245+0000 7f1f24c00640 1 --2- 172.21.15.152:0/2931761132 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f200af670 0x7f1f200b1dd0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:55.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.245+0000 7f1f24c00640 1 --2- 172.21.15.152:0/2931761132 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f2006f980 0x7f1f2014b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:55.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.245+0000 7f1f24c00640 1 -- 172.21.15.152:0/2931761132 >> 172.21.15.152:0/2931761132 conn(0x7f1f200b3350 msgr2=0x7f1f2015e230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:55.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.245+0000 7f1f24c00640 1 -- 172.21.15.152:0/2931761132 shutdown_connections 2024-04-17T08:47:55.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.245+0000 7f1f24c00640 1 -- 172.21.15.152:0/2931761132 wait complete. 2024-04-17T08:47:55.268 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-04-17T08:47:55.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.405+0000 7f65c0a00640 1 Processor -- start 2024-04-17T08:47:55.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.405+0000 7f65c0a00640 1 -- start start 2024-04-17T08:47:55.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.405+0000 7f65c0a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f65bc06f980 0x7f65bc072530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:55.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.405+0000 7f65c0a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65bc0d0360 0x7f65bc0d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:55.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.405+0000 7f65c0a00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65bc15bfd0 con 0x7f65bc0af670 2024-04-17T08:47:55.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.405+0000 7f65c0a00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f65bc15c820 con 0x7f65bc06f980 2024-04-17T08:47:55.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.405+0000 7f65c0a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f65bc15c260 con 0x7f65bc0d0360 2024-04-17T08:47:55.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.405+0000 7f65b9e00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f65bc0af670 0x7f65bc15b8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:50276/0 (socket says 172.21.15.152:50276) 2024-04-17T08:47:55.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.405+0000 7f65b9e00640 1 -- 172.21.15.152:0/828293561 learned_addr learned my addr 172.21.15.152:0/828293561 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:55.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.405+0000 7f65b8a00640 1 -- 172.21.15.152:0/828293561 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1096373517 0 0) 0x7f65bc15bfd0 con 0x7f65bc0af670 2024-04-17T08:47:55.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.405+0000 7f65b8a00640 1 -- 172.21.15.152:0/828293561 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65a0003530 con 0x7f65bc0af670 2024-04-17T08:47:55.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.405+0000 7f65b9400640 1 --2- 172.21.15.152:0/828293561 >> v2:172.21.15.196:3300/0 conn(0x7f65bc06f980 0x7f65bc072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:55.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.405+0000 7f65ba800640 1 --2- 172.21.15.152:0/828293561 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65bc0d0360 0x7f65bc0d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:55.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.405+0000 7f65b8a00640 1 -- 172.21.15.152:0/828293561 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3062513019 0 0) 0x7f65a0003530 con 0x7f65bc0af670 2024-04-17T08:47:55.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.405+0000 7f65b8a00640 1 -- 172.21.15.152:0/828293561 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65bc0d0360 msgr2=0x7f65bc0d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:55.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.405+0000 7f65b8a00640 1 --2- 172.21.15.152:0/828293561 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65bc0d0360 0x7f65bc0d07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:55.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.405+0000 7f65b8a00640 1 -- 172.21.15.152:0/828293561 >> v2:172.21.15.196:3300/0 conn(0x7f65bc06f980 msgr2=0x7f65bc072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:55.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.405+0000 7f65b8a00640 1 --2- 172.21.15.152:0/828293561 >> v2:172.21.15.196:3300/0 conn(0x7f65bc06f980 0x7f65bc072530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:55.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.405+0000 7f65b8a00640 1 -- 172.21.15.152:0/828293561 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65bc15c540 con 0x7f65bc0af670 2024-04-17T08:47:55.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.405+0000 7f65b8a00640 1 -- 172.21.15.152:0/828293561 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2973887244 0 0) 0x7f65ac001a00 con 0x7f65bc0af670 2024-04-17T08:47:55.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.405+0000 7f65ba800640 1 --2- 172.21.15.152:0/828293561 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65bc0d0360 0x7f65bc0d07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:55.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.405+0000 7f65b8a00640 1 -- 172.21.15.152:0/828293561 >> v1:172.21.15.152:6789/0 conn(0x7f65bc0af670 legacy=0x7f65bc15b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:55.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.405+0000 7f65b8a00640 1 --2- 172.21.15.152:0/828293561 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65a00039c0 0x7f65a0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:55.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.405+0000 7f65b8a00640 1 --2- 172.21.15.152:0/828293561 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65a0004810 0x7f65a0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:55.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.405+0000 7f65b8a00640 1 --2- 172.21.15.152:0/828293561 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65bc0d0360 0x7f65a00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:55.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.405+0000 7f65b8a00640 1 -- 172.21.15.152:0/828293561 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f65bc15c820 con 0x7f65a0004810 2024-04-17T08:47:55.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.405+0000 7f65b8a00640 1 -- 172.21.15.152:0/828293561 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f65bc15c260 con 0x7f65a00039c0 2024-04-17T08:47:55.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.405+0000 7f65b8a00640 1 -- 172.21.15.152:0/828293561 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f65a000dc90 con 0x7f65bc0d0360 2024-04-17T08:47:55.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.405+0000 7f65b9400640 1 --2- 172.21.15.152:0/828293561 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65a0004810 0x7f65a0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:55.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.405+0000 7f65b9e00640 1 --2- 172.21.15.152:0/828293561 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65a00039c0 0x7f65a0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:55.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.405+0000 7f65ba800640 1 --2- 172.21.15.152:0/828293561 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65bc0d0360 0x7f65a00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:55.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.405+0000 7f65b9400640 1 -- 172.21.15.152:0/828293561 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65bc0d0360 msgr2=0x7f65a00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:55.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.405+0000 7f65b9400640 1 --2- 172.21.15.152:0/828293561 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65bc0d0360 0x7f65a00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:55.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.405+0000 7f65b9400640 1 -- 172.21.15.152:0/828293561 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65a00039c0 msgr2=0x7f65a0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:55.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.405+0000 7f65b9400640 1 --2- 172.21.15.152:0/828293561 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65a00039c0 0x7f65a0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:55.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.405+0000 7f65b9400640 1 -- 172.21.15.152:0/828293561 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65a0003530 con 0x7f65a0004810 2024-04-17T08:47:55.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.405+0000 7f65ba800640 1 --2- 172.21.15.152:0/828293561 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65bc0d0360 0x7f65a00051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:55.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.409+0000 7f65b9400640 1 --2- 172.21.15.152:0/828293561 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65a0004810 0x7f65a0004c90 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f65bc06fdc0 tx=0x7f65a801ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd6425dc9e562a68 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:55.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.409+0000 7f65b8a00640 1 -- 172.21.15.152:0/828293561 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a80b2070 con 0x7f65a0004810 2024-04-17T08:47:55.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.409+0000 7f65b8a00640 1 -- 172.21.15.152:0/828293561 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65a80a55d0 con 0x7f65a0004810 2024-04-17T08:47:55.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.409+0000 7f65b8a00640 1 -- 172.21.15.152:0/828293561 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a80096b0 con 0x7f65a0004810 2024-04-17T08:47:55.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.409+0000 7f65c0a00640 1 -- 172.21.15.152:0/828293561 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65a0004810 msgr2=0x7f65a0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:55.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.409+0000 7f65c0a00640 1 --2- 172.21.15.152:0/828293561 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65a0004810 0x7f65a0004c90 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f65bc06fdc0 tx=0x7f65a801ca00 comp rx=0 tx=0).stop 2024-04-17T08:47:55.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.409+0000 7f65ba800640 1 -- 172.21.15.152:0/828293561 reap_dead start 2024-04-17T08:47:55.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.413+0000 7f65c0a00640 1 -- 172.21.15.152:0/828293561 shutdown_connections 2024-04-17T08:47:55.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.413+0000 7f65c0a00640 1 -- 172.21.15.152:0/828293561 >> 172.21.15.152:0/828293561 conn(0x7f65bc0b3350 msgr2=0x7f65bc0b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:55.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.413+0000 7f65c0a00640 1 -- 172.21.15.152:0/828293561 shutdown_connections 2024-04-17T08:47:55.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.413+0000 7f65c0a00640 1 -- 172.21.15.152:0/828293561 wait complete. 2024-04-17T08:47:55.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.413+0000 7f65c0a00640 1 Processor -- start 2024-04-17T08:47:55.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.413+0000 7f65c0a00640 1 -- start start 2024-04-17T08:47:55.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.413+0000 7f65c0a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65a0004810 0x7f65bc1f7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:55.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.413+0000 7f65c0a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65bc14fa20 0x7f65bc14ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:55.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.413+0000 7f65c0a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65bc14dde0 0x7f65bc14b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:55.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.413+0000 7f65c0a00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f65bc0d0b80 con 0x7f65bc14dde0 2024-04-17T08:47:55.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.413+0000 7f65c0a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f65bc072a70 con 0x7f65bc14fa20 2024-04-17T08:47:55.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.413+0000 7f65c0a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f65bc14efe0 con 0x7f65a0004810 2024-04-17T08:47:55.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.413+0000 7f65ba800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65bc14dde0 0x7f65bc14b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:55.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.413+0000 7f65ba800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65bc14dde0 0x7f65bc14b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50746/0 (socket says 172.21.15.152:50746) 2024-04-17T08:47:55.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.413+0000 7f65b9400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65bc14fa20 0x7f65bc14ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:55.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.413+0000 7f65b9e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65a0004810 0x7f65bc1f7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:55.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.413+0000 7f65ba800640 1 -- 172.21.15.152:0/3168447176 learned_addr learned my addr 172.21.15.152:0/3168447176 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:55.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.413+0000 7f65ba800640 1 -- 172.21.15.152:0/3168447176 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65a0004810 msgr2=0x7f65bc1f7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:55.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.413+0000 7f65ba800640 1 --2- 172.21.15.152:0/3168447176 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65a0004810 0x7f65bc1f7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:55.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.413+0000 7f65ba800640 1 -- 172.21.15.152:0/3168447176 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65bc14fa20 msgr2=0x7f65bc14ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:55.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.413+0000 7f65ba800640 1 --2- 172.21.15.152:0/3168447176 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65bc14fa20 0x7f65bc14ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:55.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.413+0000 7f65ba800640 1 -- 172.21.15.152:0/3168447176 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65bc14f2c0 con 0x7f65bc14dde0 2024-04-17T08:47:55.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.413+0000 7f65ba800640 1 --2- 172.21.15.152:0/3168447176 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65bc14dde0 0x7f65bc14b240 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f65bc15ffc0 tx=0x7f65b40108b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:55.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.417+0000 7f65b2000640 1 -- 172.21.15.152:0/3168447176 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65b4018020 con 0x7f65bc14dde0 2024-04-17T08:47:55.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.417+0000 7f65b2000640 1 -- 172.21.15.152:0/3168447176 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65b4004440 con 0x7f65bc14dde0 2024-04-17T08:47:55.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.417+0000 7f65b2000640 1 -- 172.21.15.152:0/3168447176 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65b400f040 con 0x7f65bc14dde0 2024-04-17T08:47:55.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.417+0000 7f65c0a00640 1 -- 172.21.15.152:0/3168447176 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65bc14f5a0 con 0x7f65bc14dde0 2024-04-17T08:47:55.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.417+0000 7f65c0a00640 1 -- 172.21.15.152:0/3168447176 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65bc1f7a70 con 0x7f65bc14dde0 2024-04-17T08:47:55.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.417+0000 7f65c0a00640 1 -- 172.21.15.152:0/3168447176 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65bc068a30 con 0x7f65bc14dde0 2024-04-17T08:47:55.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.417+0000 7f65b2000640 1 -- 172.21.15.152:0/3168447176 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f65b401b020 con 0x7f65bc14dde0 2024-04-17T08:47:55.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.417+0000 7f65b2000640 1 --2- 172.21.15.152:0/3168447176 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f659c068380 0x7f659c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:55.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.417+0000 7f65b2000640 1 -- 172.21.15.152:0/3168447176 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7f65b4086400 con 0x7f65bc14dde0 2024-04-17T08:47:55.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.417+0000 7f65b9e00640 1 --2- 172.21.15.152:0/3168447176 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f659c068380 0x7f659c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:55.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.421+0000 7f65b9e00640 1 --2- 172.21.15.152:0/3168447176 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f659c068380 0x7f659c06a840 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f65ac000f90 tx=0x7f65ac006040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:55.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.421+0000 7f65b2000640 1 -- 172.21.15.152:0/3168447176 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f65b4022020 con 0x7f65bc14dde0 2024-04-17T08:47:55.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.633+0000 7f65c0a00640 1 -- 172.21.15.152:0/3168447176 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f65bc14f770 con 0x7f65bc14dde0 2024-04-17T08:47:55.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.637+0000 7f65b2000640 1 -- 172.21.15.152:0/3168447176 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f65b4056520 con 0x7f65bc14dde0 2024-04-17T08:47:55.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.637+0000 7f65c0a00640 1 -- 172.21.15.152:0/3168447176 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f659c068380 msgr2=0x7f659c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:55.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.637+0000 7f65c0a00640 1 --2- 172.21.15.152:0/3168447176 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f659c068380 0x7f659c06a840 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f65ac000f90 tx=0x7f65ac006040 comp rx=0 tx=0).stop 2024-04-17T08:47:55.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.637+0000 7f65c0a00640 1 -- 172.21.15.152:0/3168447176 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65bc14dde0 msgr2=0x7f65bc14b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:55.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.637+0000 7f65c0a00640 1 --2- 172.21.15.152:0/3168447176 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65bc14dde0 0x7f65bc14b240 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f65bc15ffc0 tx=0x7f65b40108b0 comp rx=0 tx=0).stop 2024-04-17T08:47:55.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.637+0000 7f65c0a00640 1 -- 172.21.15.152:0/3168447176 shutdown_connections 2024-04-17T08:47:55.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.637+0000 7f65c0a00640 1 --2- 172.21.15.152:0/3168447176 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65bc14dde0 0x7f65bc14b240 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:55.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.637+0000 7f65c0a00640 1 --2- 172.21.15.152:0/3168447176 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65bc14fa20 0x7f65bc14ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:55.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.637+0000 7f65c0a00640 1 --2- 172.21.15.152:0/3168447176 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f659c068380 0x7f659c06a840 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:55.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.637+0000 7f65c0a00640 1 --2- 172.21.15.152:0/3168447176 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65a0004810 0x7f65bc1f7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:55.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.637+0000 7f65c0a00640 1 -- 172.21.15.152:0/3168447176 >> 172.21.15.152:0/3168447176 conn(0x7f65bc0b3350 msgr2=0x7f65bc15a830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:55.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.637+0000 7f65c0a00640 1 -- 172.21.15.152:0/3168447176 shutdown_connections 2024-04-17T08:47:55.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.637+0000 7f65c0a00640 1 -- 172.21.15.152:0/3168447176 wait complete. 2024-04-17T08:47:55.660 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-04-17T08:47:55.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.793+0000 7fbc3b000640 1 Processor -- start 2024-04-17T08:47:55.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.793+0000 7fbc3b000640 1 -- start start 2024-04-17T08:47:55.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.793+0000 7fbc3b000640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fbc3415a010 0x7fbc340d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:55.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.793+0000 7fbc3b000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbc3415d710 0x7fbc340d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:55.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.793+0000 7fbc3b000640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc34160d20 con 0x7fbc34160010 2024-04-17T08:47:55.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.793+0000 7fbc3b000640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fbc3415d280 con 0x7fbc3415a010 2024-04-17T08:47:55.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.793+0000 7fbc3b000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fbc3415c9d0 con 0x7fbc3415d710 2024-04-17T08:47:55.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.793+0000 7fbc39000640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fbc34160010 0x7fbc34160480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:50288/0 (socket says 172.21.15.152:50288) 2024-04-17T08:47:55.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.793+0000 7fbc39000640 1 -- 172.21.15.152:0/419873637 learned_addr learned my addr 172.21.15.152:0/419873637 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:55.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.793+0000 7fbc33e00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fbc3415a010 0x7fbc340d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:55.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.793+0000 7fbc2b400640 1 --2- 172.21.15.152:0/419873637 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbc3415d710 0x7fbc340d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:55.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.793+0000 7fbc33e00640 1 -- 172.21.15.152:0/419873637 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbc3415d710 msgr2=0x7fbc340d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:55.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.793+0000 7fbc33e00640 1 --2- 172.21.15.152:0/419873637 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbc3415d710 0x7fbc340d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:55.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.793+0000 7fbc33e00640 1 -- 172.21.15.152:0/419873637 >> v1:172.21.15.152:6789/0 conn(0x7fbc34160010 legacy=0x7fbc34160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:55.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.793+0000 7fbc33e00640 1 -- 172.21.15.152:0/419873637 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc3415cc30 con 0x7fbc3415a010 2024-04-17T08:47:55.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.793+0000 7fbc33400640 1 -- 172.21.15.152:0/419873637 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1405854747 0 0) 0x7fbc34160d20 con 0x7fbc34160010 2024-04-17T08:47:55.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.797+0000 7fbc33e00640 1 --2- 172.21.15.152:0/419873637 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc3415a010 0x7fbc340d0360 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fbc24009d90 tx=0x7fbc2401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c09c91c24bdbbe23 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:55.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.797+0000 7fbc33400640 1 -- 172.21.15.152:0/419873637 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc240b2070 con 0x7fbc3415a010 2024-04-17T08:47:55.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.797+0000 7fbc33400640 1 -- 172.21.15.152:0/419873637 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc240a5870 con 0x7fbc3415a010 2024-04-17T08:47:55.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.797+0000 7fbc33400640 1 -- 172.21.15.152:0/419873637 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc240a5c40 con 0x7fbc3415a010 2024-04-17T08:47:55.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.797+0000 7fbc3b000640 1 -- 172.21.15.152:0/419873637 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc3415a010 msgr2=0x7fbc340d0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:55.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.797+0000 7fbc3b000640 1 --2- 172.21.15.152:0/419873637 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc3415a010 0x7fbc340d0360 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fbc24009d90 tx=0x7fbc2401c8e0 comp rx=0 tx=0).stop 2024-04-17T08:47:55.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.797+0000 7fbc3b000640 1 -- 172.21.15.152:0/419873637 shutdown_connections 2024-04-17T08:47:55.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.797+0000 7fbc3b000640 1 --2- 172.21.15.152:0/419873637 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbc3415d710 0x7fbc340d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:55.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.797+0000 7fbc3b000640 1 --2- 172.21.15.152:0/419873637 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc3415a010 0x7fbc340d0360 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:55.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.797+0000 7fbc3b000640 1 -- 172.21.15.152:0/419873637 >> 172.21.15.152:0/419873637 conn(0x7fbc340b3350 msgr2=0x7fbc340b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:55.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.797+0000 7fbc3b000640 1 -- 172.21.15.152:0/419873637 shutdown_connections 2024-04-17T08:47:55.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.797+0000 7fbc3b000640 1 -- 172.21.15.152:0/419873637 wait complete. 2024-04-17T08:47:55.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.801+0000 7fbc3b000640 1 Processor -- start 2024-04-17T08:47:55.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.801+0000 7fbc3b000640 1 -- start start 2024-04-17T08:47:55.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.801+0000 7fbc3b000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc3415a010 0x7fbc34142800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:55.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.801+0000 7fbc3b000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbc3415d710 0x7fbc34151ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:55.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.801+0000 7fbc3b000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbc34160010 0x7fbc3415a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:55.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.801+0000 7fbc3b000640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3415e780 con 0x7fbc3415a010 2024-04-17T08:47:55.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.801+0000 7fbc3b000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3415e600 con 0x7fbc3415d710 2024-04-17T08:47:55.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.801+0000 7fbc3b000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fbc3415e900 con 0x7fbc34160010 2024-04-17T08:47:55.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.801+0000 7fbc33e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc3415a010 0x7fbc34142800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:55.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.801+0000 7fbc33e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc3415a010 0x7fbc34142800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50764/0 (socket says 172.21.15.152:50764) 2024-04-17T08:47:55.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.801+0000 7fbc33e00640 1 -- 172.21.15.152:0/452114476 learned_addr learned my addr 172.21.15.152:0/452114476 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:55.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.801+0000 7fbc2b400640 1 --2- 172.21.15.152:0/452114476 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbc3415d710 0x7fbc34151ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:55.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.801+0000 7fbc39000640 1 --2- 172.21.15.152:0/452114476 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbc34160010 0x7fbc3415a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:55.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.801+0000 7fbc33e00640 1 -- 172.21.15.152:0/452114476 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbc34160010 msgr2=0x7fbc3415a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:55.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.801+0000 7fbc33e00640 1 --2- 172.21.15.152:0/452114476 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbc34160010 0x7fbc3415a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:55.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.801+0000 7fbc33e00640 1 -- 172.21.15.152:0/452114476 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbc3415d710 msgr2=0x7fbc34151ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:55.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.801+0000 7fbc33e00640 1 --2- 172.21.15.152:0/452114476 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbc3415d710 0x7fbc34151ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:55.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.801+0000 7fbc33e00640 1 -- 172.21.15.152:0/452114476 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc3414f2c0 con 0x7fbc3415a010 2024-04-17T08:47:55.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.801+0000 7fbc39000640 1 --2- 172.21.15.152:0/452114476 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbc34160010 0x7fbc3415a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:47:55.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.801+0000 7fbc33e00640 1 --2- 172.21.15.152:0/452114476 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc3415a010 0x7fbc34142800 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fbc2401a510 tx=0x7fbc24019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:55.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.801+0000 7fbc30c00640 1 -- 172.21.15.152:0/452114476 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc240bd020 con 0x7fbc3415a010 2024-04-17T08:47:55.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.801+0000 7fbc30c00640 1 -- 172.21.15.152:0/452114476 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc240b8670 con 0x7fbc3415a010 2024-04-17T08:47:55.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.801+0000 7fbc30c00640 1 -- 172.21.15.152:0/452114476 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc240b2040 con 0x7fbc3415a010 2024-04-17T08:47:55.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.801+0000 7fbc3b000640 1 -- 172.21.15.152:0/452114476 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc34152220 con 0x7fbc3415a010 2024-04-17T08:47:55.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.801+0000 7fbc3b000640 1 -- 172.21.15.152:0/452114476 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc3414f530 con 0x7fbc3415a010 2024-04-17T08:47:55.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.805+0000 7fbc3b000640 1 -- 172.21.15.152:0/452114476 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc34068a30 con 0x7fbc3415a010 2024-04-17T08:47:55.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.805+0000 7fbc30c00640 1 -- 172.21.15.152:0/452114476 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbc240c0020 con 0x7fbc3415a010 2024-04-17T08:47:55.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.805+0000 7fbc30c00640 1 --2- 172.21.15.152:0/452114476 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fbc100683b0 0x7fbc1006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:55.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.805+0000 7fbc30c00640 1 -- 172.21.15.152:0/452114476 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7fbc24121350 con 0x7fbc3415a010 2024-04-17T08:47:55.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.805+0000 7fbc2b400640 1 --2- 172.21.15.152:0/452114476 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fbc100683b0 0x7fbc1006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:55.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.805+0000 7fbc2b400640 1 --2- 172.21.15.152:0/452114476 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fbc100683b0 0x7fbc1006a870 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbc34097690 tx=0x7fbc1c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:55.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:55.809+0000 7fbc30c00640 1 -- 172.21.15.152:0/452114476 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fbc34152220 con 0x7fbc3415a010 2024-04-17T08:47:56.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.021+0000 7fbc3b000640 1 -- 172.21.15.152:0/452114476 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7fbc3406d660 con 0x7fbc3415a010 2024-04-17T08:47:56.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.025+0000 7fbc30c00640 1 -- 172.21.15.152:0/452114476 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7fbc24016560 con 0x7fbc3415a010 2024-04-17T08:47:56.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.025+0000 7fbc3b000640 1 -- 172.21.15.152:0/452114476 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fbc100683b0 msgr2=0x7fbc1006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:56.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.025+0000 7fbc3b000640 1 --2- 172.21.15.152:0/452114476 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fbc100683b0 0x7fbc1006a870 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbc34097690 tx=0x7fbc1c009190 comp rx=0 tx=0).stop 2024-04-17T08:47:56.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.025+0000 7fbc3b000640 1 -- 172.21.15.152:0/452114476 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc3415a010 msgr2=0x7fbc34142800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:56.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.025+0000 7fbc3b000640 1 --2- 172.21.15.152:0/452114476 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc3415a010 0x7fbc34142800 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fbc2401a510 tx=0x7fbc24019680 comp rx=0 tx=0).stop 2024-04-17T08:47:56.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.025+0000 7fbc3b000640 1 -- 172.21.15.152:0/452114476 shutdown_connections 2024-04-17T08:47:56.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.025+0000 7fbc3b000640 1 --2- 172.21.15.152:0/452114476 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fbc100683b0 0x7fbc1006a870 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:56.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.025+0000 7fbc3b000640 1 --2- 172.21.15.152:0/452114476 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbc34160010 0x7fbc3415a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:56.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.025+0000 7fbc3b000640 1 --2- 172.21.15.152:0/452114476 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbc3415d710 0x7fbc34151ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:56.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.025+0000 7fbc3b000640 1 --2- 172.21.15.152:0/452114476 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc3415a010 0x7fbc34142800 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:56.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.025+0000 7fbc3b000640 1 -- 172.21.15.152:0/452114476 >> 172.21.15.152:0/452114476 conn(0x7fbc340b3350 msgr2=0x7fbc34072930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:56.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.025+0000 7fbc3b000640 1 -- 172.21.15.152:0/452114476 shutdown_connections 2024-04-17T08:47:56.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.025+0000 7fbc3b000640 1 -- 172.21.15.152:0/452114476 wait complete. 2024-04-17T08:47:56.048 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-04-17T08:47:56.184 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.181+0000 7f3276200640 1 Processor -- start 2024-04-17T08:47:56.184 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.181+0000 7f3276200640 1 -- start start 2024-04-17T08:47:56.185 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.181+0000 7f3276200640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f32700d0a70 0x7f3270160010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:56.185 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.181+0000 7f3276200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f327015d710 0x7f3270160550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:56.185 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.181+0000 7f3276200640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3270160a90 con 0x7f327015a010 2024-04-17T08:47:56.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.181+0000 7f3276200640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f327015d280 con 0x7f32700d0a70 2024-04-17T08:47:56.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.181+0000 7f3276200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f327015c9d0 con 0x7f327015d710 2024-04-17T08:47:56.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.181+0000 7f326f400640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f327015a010 0x7f32700d0360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:50296/0 (socket says 172.21.15.152:50296) 2024-04-17T08:47:56.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.181+0000 7f326f400640 1 -- 172.21.15.152:0/3144075579 learned_addr learned my addr 172.21.15.152:0/3144075579 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:56.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.181+0000 7f3266a00640 1 --2- 172.21.15.152:0/3144075579 >> v2:172.21.15.152:3300/0 conn(0x7f32700d0a70 0x7f3270160010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:56.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.185+0000 7f326fe00640 1 --2- 172.21.15.152:0/3144075579 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f327015d710 0x7f3270160550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:56.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.185+0000 7f3266a00640 1 -- 172.21.15.152:0/3144075579 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f327015d710 msgr2=0x7f3270160550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:56.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.185+0000 7f3266a00640 1 --2- 172.21.15.152:0/3144075579 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f327015d710 0x7f3270160550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:56.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.185+0000 7f3266a00640 1 -- 172.21.15.152:0/3144075579 >> v1:172.21.15.152:6789/0 conn(0x7f327015a010 legacy=0x7f32700d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:56.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.185+0000 7f3266a00640 1 -- 172.21.15.152:0/3144075579 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3270160d20 con 0x7f32700d0a70 2024-04-17T08:47:56.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.185+0000 7f326ea00640 1 -- 172.21.15.152:0/3144075579 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 991496761 0 0) 0x7f3270160a90 con 0x7f327015a010 2024-04-17T08:47:56.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.185+0000 7f3266a00640 1 --2- 172.21.15.152:0/3144075579 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32700d0a70 0x7f3270160010 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f327015d400 tx=0x7f325801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fcaf19fea5010b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:56.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.185+0000 7f326ea00640 1 -- 172.21.15.152:0/3144075579 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32580b0070 con 0x7f32700d0a70 2024-04-17T08:47:56.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.185+0000 7f326ea00640 1 -- 172.21.15.152:0/3144075579 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32580ab600 con 0x7f32700d0a70 2024-04-17T08:47:56.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.185+0000 7f326ea00640 1 -- 172.21.15.152:0/3144075579 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32580ab9d0 con 0x7f32700d0a70 2024-04-17T08:47:56.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.189+0000 7f3276200640 1 -- 172.21.15.152:0/3144075579 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32700d0a70 msgr2=0x7f3270160010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:56.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.189+0000 7f3276200640 1 --2- 172.21.15.152:0/3144075579 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32700d0a70 0x7f3270160010 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f327015d400 tx=0x7f325801c410 comp rx=0 tx=0).stop 2024-04-17T08:47:56.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.189+0000 7f3276200640 1 -- 172.21.15.152:0/3144075579 shutdown_connections 2024-04-17T08:47:56.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.189+0000 7f3276200640 1 --2- 172.21.15.152:0/3144075579 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f327015d710 0x7f3270160550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:56.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.189+0000 7f3276200640 1 --2- 172.21.15.152:0/3144075579 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32700d0a70 0x7f3270160010 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:56.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.189+0000 7f3276200640 1 -- 172.21.15.152:0/3144075579 >> 172.21.15.152:0/3144075579 conn(0x7f32700b3350 msgr2=0x7f32700b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:56.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.189+0000 7f3276200640 1 -- 172.21.15.152:0/3144075579 shutdown_connections 2024-04-17T08:47:56.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.189+0000 7f3276200640 1 -- 172.21.15.152:0/3144075579 wait complete. 2024-04-17T08:47:56.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.189+0000 7f3276200640 1 Processor -- start 2024-04-17T08:47:56.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.189+0000 7f3276200640 1 -- start start 2024-04-17T08:47:56.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.189+0000 7f3276200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32700d0a70 0x7f327014e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:56.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.189+0000 7f3276200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f327015a010 0x7f3270150510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:56.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.189+0000 7f3276200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f327015d710 0x7f3270157f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:56.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.189+0000 7f3276200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f327015e570 con 0x7f32700d0a70 2024-04-17T08:47:56.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.189+0000 7f3276200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f327015e3f0 con 0x7f327015a010 2024-04-17T08:47:56.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.189+0000 7f3276200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f327015e6f0 con 0x7f327015d710 2024-04-17T08:47:56.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.189+0000 7f326f400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32700d0a70 0x7f327014e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:56.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.189+0000 7f326f400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32700d0a70 0x7f327014e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50786/0 (socket says 172.21.15.152:50786) 2024-04-17T08:47:56.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.189+0000 7f326f400640 1 -- 172.21.15.152:0/3932016935 learned_addr learned my addr 172.21.15.152:0/3932016935 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:56.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.189+0000 7f326fe00640 1 --2- 172.21.15.152:0/3932016935 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f327015d710 0x7f3270157f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:56.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.189+0000 7f3266a00640 1 --2- 172.21.15.152:0/3932016935 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f327015a010 0x7f3270150510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:56.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.189+0000 7f326f400640 1 -- 172.21.15.152:0/3932016935 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f327015d710 msgr2=0x7f3270157f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:56.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.189+0000 7f326f400640 1 --2- 172.21.15.152:0/3932016935 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f327015d710 0x7f3270157f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:56.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.189+0000 7f326f400640 1 -- 172.21.15.152:0/3932016935 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f327015a010 msgr2=0x7f3270150510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:56.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.189+0000 7f326f400640 1 --2- 172.21.15.152:0/3932016935 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f327015a010 0x7f3270150510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:56.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.189+0000 7f326f400640 1 -- 172.21.15.152:0/3932016935 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f327014ed80 con 0x7f32700d0a70 2024-04-17T08:47:56.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.189+0000 7f326f400640 1 --2- 172.21.15.152:0/3932016935 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32700d0a70 0x7f327014e840 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f326000c520 tx=0x7f326000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:56.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.193+0000 7f3267e00640 1 -- 172.21.15.152:0/3932016935 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3260018070 con 0x7f32700d0a70 2024-04-17T08:47:56.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.193+0000 7f3267e00640 1 -- 172.21.15.152:0/3932016935 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32600074e0 con 0x7f32700d0a70 2024-04-17T08:47:56.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.193+0000 7f3276200640 1 -- 172.21.15.152:0/3932016935 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f327015a6a0 con 0x7f32700d0a70 2024-04-17T08:47:56.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.193+0000 7f3267e00640 1 -- 172.21.15.152:0/3932016935 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32600049f0 con 0x7f32700d0a70 2024-04-17T08:47:56.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.193+0000 7f3276200640 1 -- 172.21.15.152:0/3932016935 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f327015ac60 con 0x7f32700d0a70 2024-04-17T08:47:56.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.193+0000 7f3276200640 1 -- 172.21.15.152:0/3932016935 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3270068a30 con 0x7f32700d0a70 2024-04-17T08:47:56.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.193+0000 7f3267e00640 1 -- 172.21.15.152:0/3932016935 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f326001b070 con 0x7f32700d0a70 2024-04-17T08:47:56.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.193+0000 7f3267e00640 1 --2- 172.21.15.152:0/3932016935 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f324c068380 0x7f324c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:56.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.193+0000 7f3267e00640 1 -- 172.21.15.152:0/3932016935 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7f3260085cb0 con 0x7f32700d0a70 2024-04-17T08:47:56.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.193+0000 7f3266a00640 1 --2- 172.21.15.152:0/3932016935 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f324c068380 0x7f324c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:56.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.193+0000 7f3266a00640 1 --2- 172.21.15.152:0/3932016935 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f324c068380 0x7f324c06a840 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f32580ad000 tx=0x7f32580a4f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:56.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.197+0000 7f3267e00640 1 -- 172.21.15.152:0/3932016935 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f3260055cb0 con 0x7f32700d0a70 2024-04-17T08:47:56.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.413+0000 7f3276200640 1 -- 172.21.15.152:0/3932016935 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f327006d660 con 0x7f32700d0a70 2024-04-17T08:47:56.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.413+0000 7f3267e00640 1 -- 172.21.15.152:0/3932016935 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) ==== 97+0+0 (secure 0 0 0) 0x7f3260059fb0 con 0x7f32700d0a70 2024-04-17T08:47:56.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.417+0000 7f3276200640 1 -- 172.21.15.152:0/3932016935 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f324c068380 msgr2=0x7f324c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:56.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.417+0000 7f3276200640 1 --2- 172.21.15.152:0/3932016935 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f324c068380 0x7f324c06a840 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f32580ad000 tx=0x7f32580a4f90 comp rx=0 tx=0).stop 2024-04-17T08:47:56.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.417+0000 7f3276200640 1 -- 172.21.15.152:0/3932016935 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32700d0a70 msgr2=0x7f327014e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:56.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.417+0000 7f3276200640 1 --2- 172.21.15.152:0/3932016935 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32700d0a70 0x7f327014e840 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f326000c520 tx=0x7f326000c9e0 comp rx=0 tx=0).stop 2024-04-17T08:47:56.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.417+0000 7f3276200640 1 -- 172.21.15.152:0/3932016935 shutdown_connections 2024-04-17T08:47:56.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.417+0000 7f3276200640 1 --2- 172.21.15.152:0/3932016935 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f324c068380 0x7f324c06a840 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:56.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.417+0000 7f3276200640 1 --2- 172.21.15.152:0/3932016935 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f327015d710 0x7f3270157f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:56.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.417+0000 7f3276200640 1 --2- 172.21.15.152:0/3932016935 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f327015a010 0x7f3270150510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:56.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.417+0000 7f3276200640 1 --2- 172.21.15.152:0/3932016935 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32700d0a70 0x7f327014e840 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:56.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.417+0000 7f3276200640 1 -- 172.21.15.152:0/3932016935 >> 172.21.15.152:0/3932016935 conn(0x7f32700b3350 msgr2=0x7f32700aee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:56.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.417+0000 7f3276200640 1 -- 172.21.15.152:0/3932016935 shutdown_connections 2024-04-17T08:47:56.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.417+0000 7f3276200640 1 -- 172.21.15.152:0/3932016935 wait complete. 2024-04-17T08:47:56.438 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-04-17T08:47:56.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.573+0000 7f7d14200640 1 Processor -- start 2024-04-17T08:47:56.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.573+0000 7f7d14200640 1 -- start start 2024-04-17T08:47:56.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.573+0000 7f7d14200640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7d0c15a010 0x7f7d0c0d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:56.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.573+0000 7f7d14200640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d0c160d20 con 0x7f7d0c160720 2024-04-17T08:47:56.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.573+0000 7f7d14200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d0c15cc30 con 0x7f7d0c15d710 2024-04-17T08:47:56.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.573+0000 7f7d14200640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f7d0c15d280 con 0x7f7d0c15a010 2024-04-17T08:47:56.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.573+0000 7f7d12200640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f7d0c160720 0x7f7d0c15dbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:50306/0 (socket says 172.21.15.152:50306) 2024-04-17T08:47:56.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.573+0000 7f7d12200640 1 -- 172.21.15.152:0/4141357171 learned_addr learned my addr 172.21.15.152:0/4141357171 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:56.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.573+0000 7f7d11800640 1 --2- 172.21.15.152:0/4141357171 >> v2:172.21.15.152:3300/0 conn(0x7f7d0c15a010 0x7f7d0c0d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:56.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.573+0000 7f7d11800640 1 -- 172.21.15.152:0/4141357171 >> v1:172.21.15.196:6789/0 conn(0x7f7d0c15d710 legacy=0x7f7d0c160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:56.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.573+0000 7f7d11800640 1 -- 172.21.15.152:0/4141357171 >> v1:172.21.15.152:6789/0 conn(0x7f7d0c160720 legacy=0x7f7d0c15dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:56.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.573+0000 7f7d0be00640 1 -- 172.21.15.152:0/4141357171 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 114979239 0 0) 0x7f7d0c160d20 con 0x7f7d0c160720 2024-04-17T08:47:56.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.573+0000 7f7d11800640 1 -- 172.21.15.152:0/4141357171 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d0c15cf10 con 0x7f7d0c15a010 2024-04-17T08:47:56.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.577+0000 7f7d11800640 1 --2- 172.21.15.152:0/4141357171 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d0c15a010 0x7f7d0c0d0360 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c15d400 tx=0x7f7d0001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c458d33835c61014 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:56.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.577+0000 7f7d0be00640 1 -- 172.21.15.152:0/4141357171 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d000b0070 con 0x7f7d0c15a010 2024-04-17T08:47:56.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.577+0000 7f7d0be00640 1 -- 172.21.15.152:0/4141357171 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d000ab600 con 0x7f7d0c15a010 2024-04-17T08:47:56.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.577+0000 7f7d0be00640 1 -- 172.21.15.152:0/4141357171 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d000ab9d0 con 0x7f7d0c15a010 2024-04-17T08:47:56.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.577+0000 7f7d14200640 1 -- 172.21.15.152:0/4141357171 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d0c15a010 msgr2=0x7f7d0c0d0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:56.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.577+0000 7f7d14200640 1 --2- 172.21.15.152:0/4141357171 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d0c15a010 0x7f7d0c0d0360 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c15d400 tx=0x7f7d0001c3d0 comp rx=0 tx=0).stop 2024-04-17T08:47:56.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.577+0000 7f7d14200640 1 -- 172.21.15.152:0/4141357171 shutdown_connections 2024-04-17T08:47:56.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.577+0000 7f7d14200640 1 --2- 172.21.15.152:0/4141357171 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d0c15a010 0x7f7d0c0d0360 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:56.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.577+0000 7f7d14200640 1 -- 172.21.15.152:0/4141357171 >> 172.21.15.152:0/4141357171 conn(0x7f7d0c0b3350 msgr2=0x7f7d0c0b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:56.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.577+0000 7f7d14200640 1 -- 172.21.15.152:0/4141357171 shutdown_connections 2024-04-17T08:47:56.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.577+0000 7f7d14200640 1 -- 172.21.15.152:0/4141357171 wait complete. 2024-04-17T08:47:56.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.581+0000 7f7d14200640 1 Processor -- start 2024-04-17T08:47:56.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.581+0000 7f7d14200640 1 -- start start 2024-04-17T08:47:56.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.581+0000 7f7d14200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d0c15a010 0x7f7d0c0cc440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:56.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.581+0000 7f7d14200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7d0c15d710 0x7f7d0c15bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:56.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.581+0000 7f7d14200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7d0c160720 0x7f7d0c155db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:56.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.581+0000 7f7d14200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7d0c0d0cb0 con 0x7f7d0c15a010 2024-04-17T08:47:56.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.581+0000 7f7d14200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f7d0c15c9d0 con 0x7f7d0c160720 2024-04-17T08:47:56.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.581+0000 7f7d14200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f7d0c16a5d0 con 0x7f7d0c15d710 2024-04-17T08:47:56.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.581+0000 7f7d11800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d0c15a010 0x7f7d0c0cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:56.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.581+0000 7f7d11800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d0c15a010 0x7f7d0c0cc440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50794/0 (socket says 172.21.15.152:50794) 2024-04-17T08:47:56.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.581+0000 7f7d11800640 1 -- 172.21.15.152:0/1064604344 learned_addr learned my addr 172.21.15.152:0/1064604344 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:56.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.581+0000 7f7d10e00640 1 --2- 172.21.15.152:0/1064604344 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7d0c15d710 0x7f7d0c15bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:56.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.581+0000 7f7d12200640 1 --2- 172.21.15.152:0/1064604344 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7d0c160720 0x7f7d0c155db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:56.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.581+0000 7f7d11800640 1 -- 172.21.15.152:0/1064604344 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7d0c15d710 msgr2=0x7f7d0c15bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:56.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.581+0000 7f7d11800640 1 --2- 172.21.15.152:0/1064604344 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7d0c15d710 0x7f7d0c15bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:56.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.581+0000 7f7d11800640 1 -- 172.21.15.152:0/1064604344 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7d0c160720 msgr2=0x7f7d0c155db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:56.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.581+0000 7f7d11800640 1 --2- 172.21.15.152:0/1064604344 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7d0c160720 0x7f7d0c155db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:56.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.581+0000 7f7d11800640 1 -- 172.21.15.152:0/1064604344 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d0c15c480 con 0x7f7d0c15a010 2024-04-17T08:47:56.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.581+0000 7f7d11800640 1 --2- 172.21.15.152:0/1064604344 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d0c15a010 0x7f7d0c0cc440 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f7d000ae040 tx=0x7f7d0001ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:56.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.581+0000 7f7d09600640 1 -- 172.21.15.152:0/1064604344 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d000b0050 con 0x7f7d0c15a010 2024-04-17T08:47:56.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.581+0000 7f7d09600640 1 -- 172.21.15.152:0/1064604344 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d000bc070 con 0x7f7d0c15a010 2024-04-17T08:47:56.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.581+0000 7f7d14200640 1 -- 172.21.15.152:0/1064604344 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d0c0cde70 con 0x7f7d0c15a010 2024-04-17T08:47:56.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.581+0000 7f7d09600640 1 -- 172.21.15.152:0/1064604344 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d000aaa90 con 0x7f7d0c15a010 2024-04-17T08:47:56.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.581+0000 7f7d14200640 1 -- 172.21.15.152:0/1064604344 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d0c153b20 con 0x7f7d0c15a010 2024-04-17T08:47:56.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.581+0000 7f7d14200640 1 -- 172.21.15.152:0/1064604344 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d0c068a30 con 0x7f7d0c15a010 2024-04-17T08:47:56.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.585+0000 7f7d09600640 1 -- 172.21.15.152:0/1064604344 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7d000aac30 con 0x7f7d0c15a010 2024-04-17T08:47:56.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.585+0000 7f7d09600640 1 --2- 172.21.15.152:0/1064604344 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f7cec068380 0x7f7cec06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:56.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.585+0000 7f7d09600640 1 -- 172.21.15.152:0/1064604344 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7f7d00121240 con 0x7f7d0c15a010 2024-04-17T08:47:56.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.585+0000 7f7d10e00640 1 --2- 172.21.15.152:0/1064604344 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f7cec068380 0x7f7cec06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:56.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.585+0000 7f7d10e00640 1 --2- 172.21.15.152:0/1064604344 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f7cec068380 0x7f7cec06a840 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c155210 tx=0x7f7cf8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:56.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.589+0000 7f7d09600640 1 -- 172.21.15.152:0/1064604344 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f7d0c15c480 con 0x7f7d0c15a010 2024-04-17T08:47:56.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.797+0000 7f7d14200640 1 -- 172.21.15.152:0/1064604344 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f7d0c06d660 con 0x7f7d0c15a010 2024-04-17T08:47:56.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.801+0000 7f7d09600640 1 -- 172.21.15.152:0/1064604344 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f7d00016050 con 0x7f7d0c15a010 2024-04-17T08:47:56.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.801+0000 7f7d14200640 1 -- 172.21.15.152:0/1064604344 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f7cec068380 msgr2=0x7f7cec06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:56.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.801+0000 7f7d14200640 1 --2- 172.21.15.152:0/1064604344 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f7cec068380 0x7f7cec06a840 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c155210 tx=0x7f7cf8009040 comp rx=0 tx=0).stop 2024-04-17T08:47:56.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.801+0000 7f7d14200640 1 -- 172.21.15.152:0/1064604344 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d0c15a010 msgr2=0x7f7d0c0cc440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:56.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.801+0000 7f7d14200640 1 --2- 172.21.15.152:0/1064604344 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d0c15a010 0x7f7d0c0cc440 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f7d000ae040 tx=0x7f7d0001ac10 comp rx=0 tx=0).stop 2024-04-17T08:47:56.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.805+0000 7f7d14200640 1 -- 172.21.15.152:0/1064604344 shutdown_connections 2024-04-17T08:47:56.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.805+0000 7f7d14200640 1 --2- 172.21.15.152:0/1064604344 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7d0c160720 0x7f7d0c155db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:56.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.805+0000 7f7d14200640 1 --2- 172.21.15.152:0/1064604344 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f7cec068380 0x7f7cec06a840 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:56.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.805+0000 7f7d14200640 1 --2- 172.21.15.152:0/1064604344 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7d0c15d710 0x7f7d0c15bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:56.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.805+0000 7f7d14200640 1 --2- 172.21.15.152:0/1064604344 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d0c15a010 0x7f7d0c0cc440 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:56.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.805+0000 7f7d14200640 1 -- 172.21.15.152:0/1064604344 >> 172.21.15.152:0/1064604344 conn(0x7f7d0c0b3350 msgr2=0x7f7d0c0aee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:56.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.805+0000 7f7d14200640 1 -- 172.21.15.152:0/1064604344 shutdown_connections 2024-04-17T08:47:56.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.805+0000 7f7d14200640 1 -- 172.21.15.152:0/1064604344 wait complete. 2024-04-17T08:47:56.824 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T08:47:56.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.957+0000 7fb754c00640 1 Processor -- start 2024-04-17T08:47:56.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.957+0000 7fb754c00640 1 -- start start 2024-04-17T08:47:56.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.957+0000 7fb754c00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb75015a010 0x7fb7500d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:56.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.957+0000 7fb754c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb75015d710 0x7fb7500d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:56.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.957+0000 7fb754c00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fb750160010 0x7fb750160480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:56.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.957+0000 7fb754c00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fb75015d280 con 0x7fb75015a010 2024-04-17T08:47:56.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.957+0000 7fb754c00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fb75015c9d0 con 0x7fb750160010 2024-04-17T08:47:56.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.957+0000 7fb754c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fb750160d20 con 0x7fb75015d710 2024-04-17T08:47:56.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.957+0000 7fb74de00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb75015a010 0x7fb7500d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:56.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.957+0000 7fb74de00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb75015a010 0x7fb7500d0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50804/0 (socket says 172.21.15.152:50804) 2024-04-17T08:47:56.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.957+0000 7fb74de00640 1 -- 172.21.15.152:0/3229609867 learned_addr learned my addr 172.21.15.152:0/3229609867 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:56.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.957+0000 7fb74e800640 1 --2- 172.21.15.152:0/3229609867 >> v2:172.21.15.196:3300/0 conn(0x7fb750160010 0x7fb750160480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:56.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.957+0000 7fb745400640 1 --2- 172.21.15.152:0/3229609867 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb75015d710 0x7fb7500d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:56.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.957+0000 7fb74de00640 1 -- 172.21.15.152:0/3229609867 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb75015d710 msgr2=0x7fb7500d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:56.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.957+0000 7fb74de00640 1 --2- 172.21.15.152:0/3229609867 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb75015d710 0x7fb7500d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:56.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.957+0000 7fb74de00640 1 -- 172.21.15.152:0/3229609867 >> v2:172.21.15.196:3300/0 conn(0x7fb750160010 msgr2=0x7fb750160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:56.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.957+0000 7fb74de00640 1 --2- 172.21.15.152:0/3229609867 >> v2:172.21.15.196:3300/0 conn(0x7fb750160010 0x7fb750160480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:56.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.957+0000 7fb74de00640 1 -- 172.21.15.152:0/3229609867 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb75015cc30 con 0x7fb75015a010 2024-04-17T08:47:56.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.961+0000 7fb74de00640 1 --2- 172.21.15.152:0/3229609867 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb75015a010 0x7fb7500d0360 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fb7500b1d10 tx=0x7fb74001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55b72843008d4ae3 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:56.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.961+0000 7fb74d400640 1 -- 172.21.15.152:0/3229609867 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7400b0070 con 0x7fb75015a010 2024-04-17T08:47:56.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.961+0000 7fb74d400640 1 -- 172.21.15.152:0/3229609867 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7400ab600 con 0x7fb75015a010 2024-04-17T08:47:56.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.961+0000 7fb74d400640 1 -- 172.21.15.152:0/3229609867 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7400ab9d0 con 0x7fb75015a010 2024-04-17T08:47:56.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.961+0000 7fb754c00640 1 -- 172.21.15.152:0/3229609867 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb75015a010 msgr2=0x7fb7500d0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:56.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.961+0000 7fb754c00640 1 --2- 172.21.15.152:0/3229609867 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb75015a010 0x7fb7500d0360 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fb7500b1d10 tx=0x7fb74001c490 comp rx=0 tx=0).stop 2024-04-17T08:47:56.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.961+0000 7fb754c00640 1 -- 172.21.15.152:0/3229609867 shutdown_connections 2024-04-17T08:47:56.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.961+0000 7fb754c00640 1 --2- 172.21.15.152:0/3229609867 >> v2:172.21.15.196:3300/0 conn(0x7fb750160010 0x7fb750160480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:56.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.961+0000 7fb754c00640 1 --2- 172.21.15.152:0/3229609867 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb75015d710 0x7fb7500d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:56.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.961+0000 7fb754c00640 1 --2- 172.21.15.152:0/3229609867 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb75015a010 0x7fb7500d0360 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:56.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.961+0000 7fb754c00640 1 -- 172.21.15.152:0/3229609867 >> 172.21.15.152:0/3229609867 conn(0x7fb7500b3350 msgr2=0x7fb7500b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:56.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.961+0000 7fb754c00640 1 -- 172.21.15.152:0/3229609867 shutdown_connections 2024-04-17T08:47:56.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.961+0000 7fb754c00640 1 -- 172.21.15.152:0/3229609867 wait complete. 2024-04-17T08:47:56.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.965+0000 7fb754c00640 1 Processor -- start 2024-04-17T08:47:56.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.965+0000 7fb754c00640 1 -- start start 2024-04-17T08:47:56.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.965+0000 7fb754c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb75015a010 0x7fb75014f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:56.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.965+0000 7fb754c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb75015d710 0x7fb750156280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:56.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.965+0000 7fb754c00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb750160010 0x7fb750154560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:56.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.965+0000 7fb754c00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb75006c340 con 0x7fb750160010 2024-04-17T08:47:56.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.965+0000 7fb754c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb75006c1c0 con 0x7fb75015a010 2024-04-17T08:47:56.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.965+0000 7fb754c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fb75006c4c0 con 0x7fb75015d710 2024-04-17T08:47:56.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.965+0000 7fb74e800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb750160010 0x7fb750154560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:56.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.965+0000 7fb74e800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb750160010 0x7fb750154560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50816/0 (socket says 172.21.15.152:50816) 2024-04-17T08:47:56.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.965+0000 7fb74e800640 1 -- 172.21.15.152:0/3928941936 learned_addr learned my addr 172.21.15.152:0/3928941936 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:56.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.965+0000 7fb74de00640 1 --2- 172.21.15.152:0/3928941936 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb75015a010 0x7fb75014f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:56.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.965+0000 7fb745400640 1 --2- 172.21.15.152:0/3928941936 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb75015d710 0x7fb750156280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:56.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.965+0000 7fb74e800640 1 -- 172.21.15.152:0/3928941936 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb75015d710 msgr2=0x7fb750156280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:56.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.965+0000 7fb74e800640 1 --2- 172.21.15.152:0/3928941936 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb75015d710 0x7fb750156280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:56.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.965+0000 7fb74e800640 1 -- 172.21.15.152:0/3928941936 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb75015a010 msgr2=0x7fb75014f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:56.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.965+0000 7fb74e800640 1 --2- 172.21.15.152:0/3928941936 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb75015a010 0x7fb75014f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:56.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.965+0000 7fb74e800640 1 -- 172.21.15.152:0/3928941936 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7500b1280 con 0x7fb750160010 2024-04-17T08:47:56.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.965+0000 7fb74e800640 1 --2- 172.21.15.152:0/3928941936 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb750160010 0x7fb750154560 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb748007e60 tx=0x7fb74800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:56.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.965+0000 7fb746a00640 1 -- 172.21.15.152:0/3928941936 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb748014420 con 0x7fb750160010 2024-04-17T08:47:56.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.965+0000 7fb746a00640 1 -- 172.21.15.152:0/3928941936 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb748019070 con 0x7fb750160010 2024-04-17T08:47:56.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.965+0000 7fb746a00640 1 -- 172.21.15.152:0/3928941936 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb748014820 con 0x7fb750160010 2024-04-17T08:47:56.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.965+0000 7fb754c00640 1 -- 172.21.15.152:0/3928941936 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb750153a90 con 0x7fb750160010 2024-04-17T08:47:56.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.965+0000 7fb754c00640 1 -- 172.21.15.152:0/3928941936 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb750154050 con 0x7fb750160010 2024-04-17T08:47:56.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.965+0000 7fb754c00640 1 -- 172.21.15.152:0/3928941936 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb750068a30 con 0x7fb750160010 2024-04-17T08:47:56.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.969+0000 7fb746a00640 1 -- 172.21.15.152:0/3928941936 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb7480149c0 con 0x7fb750160010 2024-04-17T08:47:56.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.969+0000 7fb746a00640 1 --2- 172.21.15.152:0/3928941936 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb72c068380 0x7fb72c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:56.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.969+0000 7fb746a00640 1 -- 172.21.15.152:0/3928941936 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7fb748086e60 con 0x7fb750160010 2024-04-17T08:47:56.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.969+0000 7fb74de00640 1 --2- 172.21.15.152:0/3928941936 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb72c068380 0x7fb72c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:56.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.969+0000 7fb74de00640 1 --2- 172.21.15.152:0/3928941936 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb72c068380 0x7fb72c06a840 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb7400ad000 tx=0x7fb7400a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:56.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:56.973+0000 7fb746a00640 1 -- 172.21.15.152:0/3928941936 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fb748057670 con 0x7fb750160010 2024-04-17T08:47:57.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.129+0000 7fb754c00640 1 -- 172.21.15.152:0/3928941936 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb750159840 con 0x7fb750160010 2024-04-17T08:47:57.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.129+0000 7fb746a00640 1 -- 172.21.15.152:0/3928941936 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+13188 (secure 0 0 0) 0x7fb748056f70 con 0x7fb750160010 2024-04-17T08:47:57.133 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:47:57.133 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":34,"fsid":"ce68f82e-ec5f-4205-9fd5-bdfdf6ef31e2","created":"2024-04-17T08:46:08.353546+0000","modified":"2024-04-17T08:47:54.075390+0000","last_up_change":"2024-04-17T08:46:20.738799+0000","last_in_change":"2024-04-17T08:46:11.210050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T08:46:21.386856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"682f0192-187c-404e-bc7a-b6b4e23825e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6819","nonce":3603799291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6823","nonce":3603799291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6831","nonce":3603799291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6827","nonce":3603799291}]},"public_addr":"172.21.15.152:6819/3603799291","cluster_addr":"172.21.15.152:6823/3603799291","heartbeat_back_addr":"172.21.15.152:6831/3603799291","heartbeat_front_addr":"172.21.15.152:6827/3603799291","state":["exists","up"]},{"osd":1,"uuid":"f0fe8fef-60ec-4a39-83b6-2fa6a5adb0f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6801","nonce":4133383142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6803","nonce":4133383142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6807","nonce":4133383142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6805","nonce":4133383142}]},"public_addr":"172.21.15.152:6801/4133383142","cluster_addr":"172.21.15.152:6803/4133383142","heartbeat_back_addr":"172.21.15.152:6807/4133383142","heartbeat_front_addr":"172.21.15.152:6805/4133383142","state":["exists","up"]},{"osd":2,"uuid":"35f36d9c-5245-4431-a618-f4df0fa380ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6809","nonce":3826143898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6811","nonce":3826143898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6815","nonce":3826143898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6813","nonce":3826143898}]},"public_addr":"172.21.15.152:6809/3826143898","cluster_addr":"172.21.15.152:6811/3826143898","heartbeat_back_addr":"172.21.15.152:6815/3826143898","heartbeat_front_addr":"172.21.15.152:6813/3826143898","state":["exists","up"]},{"osd":3,"uuid":"96e56ca5-15b4-4895-9b79-da2c92043159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6818","nonce":165717826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6822","nonce":165717826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6830","nonce":165717826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6826","nonce":165717826}]},"public_addr":"172.21.15.152:6818/165717826","cluster_addr":"172.21.15.152:6822/165717826","heartbeat_back_addr":"172.21.15.152:6830/165717826","heartbeat_front_addr":"172.21.15.152:6826/165717826","state":["exists","up"]},{"osd":4,"uuid":"f5aa10a4-9ff9-41fe-a5c9-15326f982cc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6817","nonce":4080159297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6819","nonce":4080159297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6823","nonce":4080159297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6821","nonce":4080159297}]},"public_addr":"172.21.15.196:6817/4080159297","cluster_addr":"172.21.15.196:6819/4080159297","heartbeat_back_addr":"172.21.15.196:6823/4080159297","heartbeat_front_addr":"172.21.15.196:6821/4080159297","state":["exists","up"]},{"osd":5,"uuid":"42bab884-3476-47ae-ac65-935fa6e0f055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6801","nonce":3519444232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6803","nonce":3519444232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6807","nonce":3519444232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6805","nonce":3519444232}]},"public_addr":"172.21.15.196:6801/3519444232","cluster_addr":"172.21.15.196:6803/3519444232","heartbeat_back_addr":"172.21.15.196:6807/3519444232","heartbeat_front_addr":"172.21.15.196:6805/3519444232","state":["exists","up"]},{"osd":6,"uuid":"460b6167-f57b-4224-9c92-cfc9b80bbe99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6809","nonce":275739834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6811","nonce":275739834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6815","nonce":275739834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6813","nonce":275739834}]},"public_addr":"172.21.15.196:6809/275739834","cluster_addr":"172.21.15.196:6811/275739834","heartbeat_back_addr":"172.21.15.196:6815/275739834","heartbeat_front_addr":"172.21.15.196:6813/275739834","state":["exists","up"]},{"osd":7,"uuid":"d695643f-5e07-4e2a-a646-c06bd97b6650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6825","nonce":307626968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6827","nonce":307626968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6831","nonce":307626968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6829","nonce":307626968}]},"public_addr":"172.21.15.196:6825/307626968","cluster_addr":"172.21.15.196:6827/307626968","heartbeat_back_addr":"172.21.15.196:6831/307626968","heartbeat_front_addr":"172.21.15.196:6829/307626968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.293257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.964533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.248895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.010000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.832554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.743704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930171+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930962+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T08:47:57.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.133+0000 7fb754c00640 1 -- 172.21.15.152:0/3928941936 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb72c068380 msgr2=0x7fb72c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:57.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.133+0000 7fb754c00640 1 --2- 172.21.15.152:0/3928941936 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb72c068380 0x7fb72c06a840 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb7400ad000 tx=0x7fb7400a6000 comp rx=0 tx=0).stop 2024-04-17T08:47:57.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.133+0000 7fb754c00640 1 -- 172.21.15.152:0/3928941936 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb750160010 msgr2=0x7fb750154560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:57.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.133+0000 7fb754c00640 1 --2- 172.21.15.152:0/3928941936 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb750160010 0x7fb750154560 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb748007e60 tx=0x7fb74800e4b0 comp rx=0 tx=0).stop 2024-04-17T08:47:57.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.133+0000 7fb754c00640 1 -- 172.21.15.152:0/3928941936 shutdown_connections 2024-04-17T08:47:57.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.133+0000 7fb754c00640 1 --2- 172.21.15.152:0/3928941936 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb750160010 0x7fb750154560 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:57.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.133+0000 7fb754c00640 1 --2- 172.21.15.152:0/3928941936 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb72c068380 0x7fb72c06a840 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:57.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.133+0000 7fb754c00640 1 --2- 172.21.15.152:0/3928941936 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb75015d710 0x7fb750156280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:57.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.133+0000 7fb754c00640 1 --2- 172.21.15.152:0/3928941936 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb75015a010 0x7fb75014f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:57.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.133+0000 7fb754c00640 1 -- 172.21.15.152:0/3928941936 >> 172.21.15.152:0/3928941936 conn(0x7fb7500b3350 msgr2=0x7fb750152f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:57.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.133+0000 7fb754c00640 1 -- 172.21.15.152:0/3928941936 shutdown_connections 2024-04-17T08:47:57.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.133+0000 7fb754c00640 1 -- 172.21.15.152:0/3928941936 wait complete. 2024-04-17T08:47:57.154 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T08:46:21.386856+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-17T08:47:57.154 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T08:47:57.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.293+0000 7f75eee00640 1 Processor -- start 2024-04-17T08:47:57.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.293+0000 7f75eee00640 1 -- start start 2024-04-17T08:47:57.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.293+0000 7f75eee00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75e80af670 0x7f75e815b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:57.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.293+0000 7f75eee00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f75e806f980 0x7f75e8072530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:57.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.293+0000 7f75eee00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75e815c260 con 0x7f75e80d0360 2024-04-17T08:47:57.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.293+0000 7f75eee00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f75e815c820 con 0x7f75e806f980 2024-04-17T08:47:57.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.293+0000 7f75eee00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f75e815c540 con 0x7f75e80af670 2024-04-17T08:47:57.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.293+0000 7f75df400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f75e806f980 0x7f75e8072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:57.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.293+0000 7f75df400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f75e806f980 0x7f75e8072530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50826/0 (socket says 172.21.15.152:50826) 2024-04-17T08:47:57.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.293+0000 7f75df400640 1 -- 172.21.15.152:0/2629554006 learned_addr learned my addr 172.21.15.152:0/2629554006 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:57.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.293+0000 7f75e7e00640 1 --2- 172.21.15.152:0/2629554006 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75e80af670 0x7f75e815b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:57.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.293+0000 7f75df400640 1 -- 172.21.15.152:0/2629554006 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75e80af670 msgr2=0x7f75e815b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:57.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.293+0000 7f75df400640 1 --2- 172.21.15.152:0/2629554006 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75e80af670 0x7f75e815b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:57.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.293+0000 7f75df400640 1 -- 172.21.15.152:0/2629554006 >> v1:172.21.15.196:6789/0 conn(0x7f75e80d0360 legacy=0x7f75e806dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:57.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.293+0000 7f75df400640 1 -- 172.21.15.152:0/2629554006 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75e8071d30 con 0x7f75e806f980 2024-04-17T08:47:57.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.297+0000 7f75df400640 1 --2- 172.21.15.152:0/2629554006 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75e806f980 0x7f75e8072530 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f75d0009870 tx=0x7f75d001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b5bfbe33a7e010b server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:57.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.297+0000 7f75e7400640 1 -- 172.21.15.152:0/2629554006 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d00ab430 con 0x7f75e806f980 2024-04-17T08:47:57.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.297+0000 7f75e7400640 1 -- 172.21.15.152:0/2629554006 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75d00b0070 con 0x7f75e806f980 2024-04-17T08:47:57.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.297+0000 7f75e7400640 1 -- 172.21.15.152:0/2629554006 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d00ab7f0 con 0x7f75e806f980 2024-04-17T08:47:57.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.297+0000 7f75eee00640 1 -- 172.21.15.152:0/2629554006 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75e806f980 msgr2=0x7f75e8072530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:57.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.297+0000 7f75eee00640 1 --2- 172.21.15.152:0/2629554006 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75e806f980 0x7f75e8072530 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f75d0009870 tx=0x7f75d001c4a0 comp rx=0 tx=0).stop 2024-04-17T08:47:57.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.297+0000 7f75eee00640 1 -- 172.21.15.152:0/2629554006 shutdown_connections 2024-04-17T08:47:57.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.297+0000 7f75eee00640 1 --2- 172.21.15.152:0/2629554006 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75e806f980 0x7f75e8072530 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:57.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.297+0000 7f75eee00640 1 --2- 172.21.15.152:0/2629554006 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75e80af670 0x7f75e815b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:57.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.297+0000 7f75eee00640 1 -- 172.21.15.152:0/2629554006 >> 172.21.15.152:0/2629554006 conn(0x7f75e80b3350 msgr2=0x7f75e80b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:57.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.297+0000 7f75eee00640 1 -- 172.21.15.152:0/2629554006 shutdown_connections 2024-04-17T08:47:57.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.297+0000 7f75eee00640 1 -- 172.21.15.152:0/2629554006 wait complete. 2024-04-17T08:47:57.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.301+0000 7f75eee00640 1 Processor -- start 2024-04-17T08:47:57.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.301+0000 7f75eee00640 1 -- start start 2024-04-17T08:47:57.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.301+0000 7f75eee00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75e806f980 0x7f75e80b1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:57.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.301+0000 7f75eee00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f75e80af670 0x7f75e8141d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:57.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.301+0000 7f75eee00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75e80d0360 0x7f75e80998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:57.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.301+0000 7f75eee00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f75e815bf80 con 0x7f75e80d0360 2024-04-17T08:47:57.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.301+0000 7f75eee00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f75e815be00 con 0x7f75e80af670 2024-04-17T08:47:57.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.301+0000 7f75eee00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f75e8072a70 con 0x7f75e806f980 2024-04-17T08:47:57.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.301+0000 7f75ece00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75e80d0360 0x7f75e80998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:57.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.301+0000 7f75e7e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75e806f980 0x7f75e80b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:57.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.301+0000 7f75ece00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75e80d0360 0x7f75e80998b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50836/0 (socket says 172.21.15.152:50836) 2024-04-17T08:47:57.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.301+0000 7f75ece00640 1 -- 172.21.15.152:0/3030559183 learned_addr learned my addr 172.21.15.152:0/3030559183 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:57.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.301+0000 7f75df400640 1 --2- 172.21.15.152:0/3030559183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f75e80af670 0x7f75e8141d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:57.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.301+0000 7f75ece00640 1 -- 172.21.15.152:0/3030559183 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75e806f980 msgr2=0x7f75e80b1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:57.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.301+0000 7f75ece00640 1 --2- 172.21.15.152:0/3030559183 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75e806f980 0x7f75e80b1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:57.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.301+0000 7f75ece00640 1 -- 172.21.15.152:0/3030559183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f75e80af670 msgr2=0x7f75e8141d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:57.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.301+0000 7f75ece00640 1 --2- 172.21.15.152:0/3030559183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f75e80af670 0x7f75e8141d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:57.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.301+0000 7f75ece00640 1 -- 172.21.15.152:0/3030559183 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75e80b2970 con 0x7f75e80d0360 2024-04-17T08:47:57.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.301+0000 7f75ece00640 1 --2- 172.21.15.152:0/3030559183 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75e80d0360 0x7f75e80998b0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f75e000c760 tx=0x7f75e000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:57.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.301+0000 7f75e4c00640 1 -- 172.21.15.152:0/3030559183 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e0003b80 con 0x7f75e80d0360 2024-04-17T08:47:57.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.301+0000 7f75e4c00640 1 -- 172.21.15.152:0/3030559183 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75e0003d20 con 0x7f75e80d0360 2024-04-17T08:47:57.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.301+0000 7f75eee00640 1 -- 172.21.15.152:0/3030559183 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75e8142260 con 0x7f75e80d0360 2024-04-17T08:47:57.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.301+0000 7f75e4c00640 1 -- 172.21.15.152:0/3030559183 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e000aa30 con 0x7f75e80d0360 2024-04-17T08:47:57.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.301+0000 7f75eee00640 1 -- 172.21.15.152:0/3030559183 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75e80b1bb0 con 0x7f75e80d0360 2024-04-17T08:47:57.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.301+0000 7f75eee00640 1 -- 172.21.15.152:0/3030559183 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75e8068a30 con 0x7f75e80d0360 2024-04-17T08:47:57.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.305+0000 7f75e4c00640 1 -- 172.21.15.152:0/3030559183 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f75e000abd0 con 0x7f75e80d0360 2024-04-17T08:47:57.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.305+0000 7f75e4c00640 1 --2- 172.21.15.152:0/3030559183 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f75c4068380 0x7f75c406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:57.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.305+0000 7f75e4c00640 1 -- 172.21.15.152:0/3030559183 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7f75e00865a0 con 0x7f75e80d0360 2024-04-17T08:47:57.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.305+0000 7f75e7e00640 1 --2- 172.21.15.152:0/3030559183 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f75c4068380 0x7f75c406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:57.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.305+0000 7f75e7e00640 1 --2- 172.21.15.152:0/3030559183 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f75c4068380 0x7f75c406a840 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f75d8006aa0 tx=0x7f75d8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:57.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.309+0000 7f75e4c00640 1 -- 172.21.15.152:0/3030559183 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f75e0056630 con 0x7f75e80d0360 2024-04-17T08:47:57.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.465+0000 7f75eee00640 1 -- 172.21.15.152:0/3030559183 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f75e815e100 con 0x7f75e80d0360 2024-04-17T08:47:57.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.469+0000 7f75e4c00640 1 -- 172.21.15.152:0/3030559183 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) ==== 93+0+10 (secure 0 0 0) 0x7f75e005a930 con 0x7f75e80d0360 2024-04-17T08:47:57.470 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2024-04-17T08:47:57.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.469+0000 7f75eee00640 1 -- 172.21.15.152:0/3030559183 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f75c4068380 msgr2=0x7f75c406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:57.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.469+0000 7f75eee00640 1 --2- 172.21.15.152:0/3030559183 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f75c4068380 0x7f75c406a840 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f75d8006aa0 tx=0x7f75d8008040 comp rx=0 tx=0).stop 2024-04-17T08:47:57.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.469+0000 7f75eee00640 1 -- 172.21.15.152:0/3030559183 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75e80d0360 msgr2=0x7f75e80998b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:57.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.469+0000 7f75eee00640 1 --2- 172.21.15.152:0/3030559183 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75e80d0360 0x7f75e80998b0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f75e000c760 tx=0x7f75e000cc20 comp rx=0 tx=0).stop 2024-04-17T08:47:57.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.469+0000 7f75eee00640 1 -- 172.21.15.152:0/3030559183 shutdown_connections 2024-04-17T08:47:57.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.469+0000 7f75eee00640 1 --2- 172.21.15.152:0/3030559183 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75e80d0360 0x7f75e80998b0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:57.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.469+0000 7f75eee00640 1 --2- 172.21.15.152:0/3030559183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f75e80af670 0x7f75e8141d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:57.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.469+0000 7f75eee00640 1 --2- 172.21.15.152:0/3030559183 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f75c4068380 0x7f75c406a840 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:57.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.469+0000 7f75eee00640 1 --2- 172.21.15.152:0/3030559183 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75e806f980 0x7f75e80b1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:57.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.469+0000 7f75eee00640 1 -- 172.21.15.152:0/3030559183 >> 172.21.15.152:0/3030559183 conn(0x7f75e80b3350 msgr2=0x7f75e8073290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:57.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.469+0000 7f75eee00640 1 -- 172.21.15.152:0/3030559183 shutdown_connections 2024-04-17T08:47:57.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.469+0000 7f75eee00640 1 -- 172.21.15.152:0/3030559183 wait complete. 2024-04-17T08:47:57.493 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-17T08:47:57.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.625+0000 7fb05ae00640 1 Processor -- start 2024-04-17T08:47:57.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.625+0000 7fb05ae00640 1 -- start start 2024-04-17T08:47:57.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.625+0000 7fb05ae00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb054145ea0 0x7fb0540d0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:57.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.625+0000 7fb05ae00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0540d0790 0x7fb0540c7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:57.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.625+0000 7fb05ae00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fb0540c7770 0x7fb054071790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:57.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.625+0000 7fb05ae00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fb0540ccbb0 con 0x7fb054145ea0 2024-04-17T08:47:57.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.625+0000 7fb05ae00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fb0540cce90 con 0x7fb0540c7770 2024-04-17T08:47:57.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.625+0000 7fb05ae00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fb0540cd170 con 0x7fb0540d0790 2024-04-17T08:47:57.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.625+0000 7fb053e00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb054145ea0 0x7fb0540d0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:57.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.625+0000 7fb053e00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb054145ea0 0x7fb0540d0250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50850/0 (socket says 172.21.15.152:50850) 2024-04-17T08:47:57.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.625+0000 7fb053e00640 1 -- 172.21.15.152:0/657686313 learned_addr learned my addr 172.21.15.152:0/657686313 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:57.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.625+0000 7fb058e00640 1 --2- 172.21.15.152:0/657686313 >> v2:172.21.15.196:3300/0 conn(0x7fb0540c7770 0x7fb054071790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:57.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.625+0000 7fb04b400640 1 --2- 172.21.15.152:0/657686313 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0540d0790 0x7fb0540c7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:57.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.625+0000 7fb053e00640 1 -- 172.21.15.152:0/657686313 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0540d0790 msgr2=0x7fb0540c7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:57.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.625+0000 7fb053e00640 1 --2- 172.21.15.152:0/657686313 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0540d0790 0x7fb0540c7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:57.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.625+0000 7fb053e00640 1 -- 172.21.15.152:0/657686313 >> v2:172.21.15.196:3300/0 conn(0x7fb0540c7770 msgr2=0x7fb054071790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:57.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.625+0000 7fb053e00640 1 --2- 172.21.15.152:0/657686313 >> v2:172.21.15.196:3300/0 conn(0x7fb0540c7770 0x7fb054071790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:57.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.625+0000 7fb053e00640 1 -- 172.21.15.152:0/657686313 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0540cd450 con 0x7fb054145ea0 2024-04-17T08:47:57.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.625+0000 7fb04b400640 1 --2- 172.21.15.152:0/657686313 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0540d0790 0x7fb0540c7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:47:57.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.629+0000 7fb053e00640 1 --2- 172.21.15.152:0/657686313 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb054145ea0 0x7fb0540d0250 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fb05415cc00 tx=0x7fb04401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3014083025ff39a server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:57.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.629+0000 7fb053400640 1 -- 172.21.15.152:0/657686313 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0440a5650 con 0x7fb054145ea0 2024-04-17T08:47:57.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.629+0000 7fb053400640 1 -- 172.21.15.152:0/657686313 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0440a57f0 con 0x7fb054145ea0 2024-04-17T08:47:57.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.629+0000 7fb053400640 1 -- 172.21.15.152:0/657686313 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0440a5bc0 con 0x7fb054145ea0 2024-04-17T08:47:57.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.629+0000 7fb05ae00640 1 -- 172.21.15.152:0/657686313 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb054145ea0 msgr2=0x7fb0540d0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:57.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.629+0000 7fb05ae00640 1 --2- 172.21.15.152:0/657686313 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb054145ea0 0x7fb0540d0250 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fb05415cc00 tx=0x7fb04401c9d0 comp rx=0 tx=0).stop 2024-04-17T08:47:57.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.629+0000 7fb05ae00640 1 -- 172.21.15.152:0/657686313 shutdown_connections 2024-04-17T08:47:57.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.629+0000 7fb05ae00640 1 --2- 172.21.15.152:0/657686313 >> v2:172.21.15.196:3300/0 conn(0x7fb0540c7770 0x7fb054071790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:57.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.629+0000 7fb05ae00640 1 --2- 172.21.15.152:0/657686313 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0540d0790 0x7fb0540c7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:57.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.629+0000 7fb05ae00640 1 --2- 172.21.15.152:0/657686313 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb054145ea0 0x7fb0540d0250 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:57.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.629+0000 7fb05ae00640 1 -- 172.21.15.152:0/657686313 >> 172.21.15.152:0/657686313 conn(0x7fb0540d2350 msgr2=0x7fb0540d2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:57.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.629+0000 7fb05ae00640 1 -- 172.21.15.152:0/657686313 shutdown_connections 2024-04-17T08:47:57.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.629+0000 7fb05ae00640 1 -- 172.21.15.152:0/657686313 wait complete. 2024-04-17T08:47:57.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.633+0000 7fb05ae00640 1 Processor -- start 2024-04-17T08:47:57.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.633+0000 7fb05ae00640 1 -- start start 2024-04-17T08:47:57.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.633+0000 7fb05ae00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0540c7770 0x7fb05406e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:57.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.633+0000 7fb05ae00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0540d0790 0x7fb054166d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:57.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.633+0000 7fb05ae00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb054145ea0 0x7fb0541f7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:57.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.633+0000 7fb05ae00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb054160340 con 0x7fb054145ea0 2024-04-17T08:47:57.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.633+0000 7fb05ae00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb0540c7b80 con 0x7fb0540c7770 2024-04-17T08:47:57.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.633+0000 7fb05ae00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fb0541604c0 con 0x7fb0540d0790 2024-04-17T08:47:57.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.633+0000 7fb058e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb054145ea0 0x7fb0541f7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:57.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.633+0000 7fb058e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb054145ea0 0x7fb0541f7c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50864/0 (socket says 172.21.15.152:50864) 2024-04-17T08:47:57.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.633+0000 7fb058e00640 1 -- 172.21.15.152:0/4003342917 learned_addr learned my addr 172.21.15.152:0/4003342917 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:57.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.633+0000 7fb04b400640 1 --2- 172.21.15.152:0/4003342917 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0540d0790 0x7fb054166d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:57.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.633+0000 7fb053e00640 1 --2- 172.21.15.152:0/4003342917 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0540c7770 0x7fb05406e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:57.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.633+0000 7fb058e00640 1 -- 172.21.15.152:0/4003342917 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0540d0790 msgr2=0x7fb054166d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:57.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.633+0000 7fb058e00640 1 --2- 172.21.15.152:0/4003342917 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0540d0790 0x7fb054166d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:57.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.633+0000 7fb058e00640 1 -- 172.21.15.152:0/4003342917 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0540c7770 msgr2=0x7fb05406e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:57.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.633+0000 7fb058e00640 1 --2- 172.21.15.152:0/4003342917 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0540c7770 0x7fb05406e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:57.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.633+0000 7fb058e00640 1 -- 172.21.15.152:0/4003342917 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0541662a0 con 0x7fb054145ea0 2024-04-17T08:47:57.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.633+0000 7fb058e00640 1 --2- 172.21.15.152:0/4003342917 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb054145ea0 0x7fb0541f7c80 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fb04c00d830 tx=0x7fb04c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:57.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.633+0000 7fb050c00640 1 -- 172.21.15.152:0/4003342917 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04c018020 con 0x7fb054145ea0 2024-04-17T08:47:57.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.633+0000 7fb050c00640 1 -- 172.21.15.152:0/4003342917 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb04c0096c0 con 0x7fb054145ea0 2024-04-17T08:47:57.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.633+0000 7fb050c00640 1 -- 172.21.15.152:0/4003342917 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04c009ab0 con 0x7fb054145ea0 2024-04-17T08:47:57.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.633+0000 7fb05ae00640 1 -- 172.21.15.152:0/4003342917 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb054167280 con 0x7fb054145ea0 2024-04-17T08:47:57.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.633+0000 7fb05ae00640 1 -- 172.21.15.152:0/4003342917 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0541f8820 con 0x7fb054145ea0 2024-04-17T08:47:57.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.637+0000 7fb05ae00640 1 -- 172.21.15.152:0/4003342917 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb054068a30 con 0x7fb054145ea0 2024-04-17T08:47:57.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.637+0000 7fb050c00640 1 -- 172.21.15.152:0/4003342917 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb04c01b020 con 0x7fb054145ea0 2024-04-17T08:47:57.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.637+0000 7fb050c00640 1 --2- 172.21.15.152:0/4003342917 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb030068380 0x7fb03006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:57.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.637+0000 7fb050c00640 1 -- 172.21.15.152:0/4003342917 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7fb04c086c40 con 0x7fb054145ea0 2024-04-17T08:47:57.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.637+0000 7fb053e00640 1 --2- 172.21.15.152:0/4003342917 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb030068380 0x7fb03006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:57.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.637+0000 7fb053e00640 1 --2- 172.21.15.152:0/4003342917 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb030068380 0x7fb03006a840 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb0440ae000 tx=0x7fb0440a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:57.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.641+0000 7fb050c00640 1 -- 172.21.15.152:0/4003342917 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fb04c022020 con 0x7fb054145ea0 2024-04-17T08:47:57.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.797+0000 7fb05ae00640 1 -- 172.21.15.152:0/4003342917 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fb0540b36c0 con 0x7fb054145ea0 2024-04-17T08:47:57.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.797+0000 7fb050c00640 1 -- 172.21.15.152:0/4003342917 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v34) ==== 84+0+65 (secure 0 0 0) 0x7fb04c056cd0 con 0x7fb054145ea0 2024-04-17T08:47:57.801 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:47:57.801 INFO:teuthology.orchestra.run.smithi152.stdout:[ 2024-04-17T08:47:57.801 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-04-17T08:47:57.801 INFO:teuthology.orchestra.run.smithi152.stdout: "poolnum": 1, 2024-04-17T08:47:57.801 INFO:teuthology.orchestra.run.smithi152.stdout: "poolname": ".mgr" 2024-04-17T08:47:57.802 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-17T08:47:57.802 INFO:teuthology.orchestra.run.smithi152.stdout:] 2024-04-17T08:47:57.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.801+0000 7fb05ae00640 1 -- 172.21.15.152:0/4003342917 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb030068380 msgr2=0x7fb03006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:57.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.801+0000 7fb05ae00640 1 --2- 172.21.15.152:0/4003342917 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb030068380 0x7fb03006a840 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb0440ae000 tx=0x7fb0440a7070 comp rx=0 tx=0).stop 2024-04-17T08:47:57.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.801+0000 7fb05ae00640 1 -- 172.21.15.152:0/4003342917 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb054145ea0 msgr2=0x7fb0541f7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:57.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.801+0000 7fb05ae00640 1 --2- 172.21.15.152:0/4003342917 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb054145ea0 0x7fb0541f7c80 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fb04c00d830 tx=0x7fb04c00dcf0 comp rx=0 tx=0).stop 2024-04-17T08:47:57.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.801+0000 7fb05ae00640 1 -- 172.21.15.152:0/4003342917 shutdown_connections 2024-04-17T08:47:57.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.801+0000 7fb05ae00640 1 --2- 172.21.15.152:0/4003342917 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb054145ea0 0x7fb0541f7c80 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:57.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.801+0000 7fb05ae00640 1 --2- 172.21.15.152:0/4003342917 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb030068380 0x7fb03006a840 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:57.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.801+0000 7fb05ae00640 1 --2- 172.21.15.152:0/4003342917 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0540d0790 0x7fb054166d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:57.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.801+0000 7fb05ae00640 1 --2- 172.21.15.152:0/4003342917 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0540c7770 0x7fb05406e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:57.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.801+0000 7fb05ae00640 1 -- 172.21.15.152:0/4003342917 >> 172.21.15.152:0/4003342917 conn(0x7fb0540d2350 msgr2=0x7fb0540cb430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:57.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.801+0000 7fb05ae00640 1 -- 172.21.15.152:0/4003342917 shutdown_connections 2024-04-17T08:47:57.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.801+0000 7fb05ae00640 1 -- 172.21.15.152:0/4003342917 wait complete. 2024-04-17T08:47:57.822 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-17T08:47:57.822 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-17T08:47:57.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.957+0000 7f2760800640 1 Processor -- start 2024-04-17T08:47:57.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.957+0000 7f2760800640 1 -- start start 2024-04-17T08:47:57.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.961+0000 7f2760800640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f27580d0a70 0x7f2758160010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:57.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.961+0000 7f2760800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f275815d710 0x7f2758160550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:57.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.961+0000 7f2760800640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2758160a90 con 0x7f275815a010 2024-04-17T08:47:57.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.961+0000 7f2760800640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f275815d280 con 0x7f27580d0a70 2024-04-17T08:47:57.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.961+0000 7f2760800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f275815c9d0 con 0x7f275815d710 2024-04-17T08:47:57.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.961+0000 7f275de00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f275815a010 0x7f27580d0360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:50320/0 (socket says 172.21.15.152:50320) 2024-04-17T08:47:57.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.961+0000 7f275de00640 1 -- 172.21.15.152:0/3313284391 learned_addr learned my addr 172.21.15.152:0/3313284391 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:47:57.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.961+0000 7f275d400640 1 --2- 172.21.15.152:0/3313284391 >> v2:172.21.15.152:3300/0 conn(0x7f27580d0a70 0x7f2758160010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:57.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.961+0000 7f275e800640 1 --2- 172.21.15.152:0/3313284391 >> v2:172.21.15.196:3300/0 conn(0x7f275815d710 0x7f2758160550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:57.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.961+0000 7f275ca00640 1 -- 172.21.15.152:0/3313284391 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1436192572 0 0) 0x7f2758160a90 con 0x7f275815a010 2024-04-17T08:47:57.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.961+0000 7f275ca00640 1 -- 172.21.15.152:0/3313284391 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2740003530 con 0x7f275815a010 2024-04-17T08:47:57.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.961+0000 7f275d400640 1 -- 172.21.15.152:0/3313284391 >> v2:172.21.15.196:3300/0 conn(0x7f275815d710 msgr2=0x7f2758160550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:57.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.961+0000 7f275d400640 1 --2- 172.21.15.152:0/3313284391 >> v2:172.21.15.196:3300/0 conn(0x7f275815d710 0x7f2758160550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:57.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.961+0000 7f275d400640 1 -- 172.21.15.152:0/3313284391 >> v1:172.21.15.152:6789/0 conn(0x7f275815a010 legacy=0x7f27580d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:57.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.961+0000 7f275d400640 1 -- 172.21.15.152:0/3313284391 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2758160d20 con 0x7f27580d0a70 2024-04-17T08:47:57.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.965+0000 7f275d400640 1 --2- 172.21.15.152:0/3313284391 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27580d0a70 0x7f2758160010 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f275815ff70 tx=0x7f274801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4176a084a0a6a00 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:57.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.965+0000 7f275ca00640 1 -- 172.21.15.152:0/3313284391 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27480b0070 con 0x7f27580d0a70 2024-04-17T08:47:57.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.965+0000 7f275ca00640 1 -- 172.21.15.152:0/3313284391 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27480ab600 con 0x7f27580d0a70 2024-04-17T08:47:57.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.965+0000 7f275ca00640 1 -- 172.21.15.152:0/3313284391 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27480ab9d0 con 0x7f27580d0a70 2024-04-17T08:47:57.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.965+0000 7f2760800640 1 -- 172.21.15.152:0/3313284391 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27580d0a70 msgr2=0x7f2758160010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:57.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.965+0000 7f2760800640 1 --2- 172.21.15.152:0/3313284391 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27580d0a70 0x7f2758160010 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f275815ff70 tx=0x7f274801c3f0 comp rx=0 tx=0).stop 2024-04-17T08:47:57.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.965+0000 7f2760800640 1 -- 172.21.15.152:0/3313284391 shutdown_connections 2024-04-17T08:47:57.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.965+0000 7f2760800640 1 --2- 172.21.15.152:0/3313284391 >> v2:172.21.15.196:3300/0 conn(0x7f275815d710 0x7f2758160550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:57.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.965+0000 7f2760800640 1 --2- 172.21.15.152:0/3313284391 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27580d0a70 0x7f2758160010 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:57.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.965+0000 7f2760800640 1 -- 172.21.15.152:0/3313284391 >> 172.21.15.152:0/3313284391 conn(0x7f27580b3350 msgr2=0x7f27580b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:57.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.965+0000 7f2760800640 1 -- 172.21.15.152:0/3313284391 shutdown_connections 2024-04-17T08:47:57.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.965+0000 7f2760800640 1 -- 172.21.15.152:0/3313284391 wait complete. 2024-04-17T08:47:57.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.965+0000 7f2760800640 1 Processor -- start 2024-04-17T08:47:57.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.965+0000 7f2760800640 1 -- start start 2024-04-17T08:47:57.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.969+0000 7f2760800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f27580d0a70 0x7f275815b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:57.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.969+0000 7f2760800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f275815a010 0x7f27580993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:57.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.969+0000 7f2760800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f275815d710 0x7f27580998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:57.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.969+0000 7f2760800640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f275815e570 con 0x7f275815a010 2024-04-17T08:47:57.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.969+0000 7f2760800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f275815e3f0 con 0x7f275815d710 2024-04-17T08:47:57.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.969+0000 7f2760800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f275815e6f0 con 0x7f27580d0a70 2024-04-17T08:47:57.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.969+0000 7f275d400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f275815a010 0x7f27580993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:57.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.969+0000 7f275d400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f275815a010 0x7f27580993b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50878/0 (socket says 172.21.15.152:50878) 2024-04-17T08:47:57.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.969+0000 7f275d400640 1 -- 172.21.15.152:0/1113499228 learned_addr learned my addr 172.21.15.152:0/1113499228 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:57.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.969+0000 7f275e800640 1 --2- 172.21.15.152:0/1113499228 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f275815d710 0x7f27580998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:57.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.969+0000 7f275de00640 1 --2- 172.21.15.152:0/1113499228 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f27580d0a70 0x7f275815b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:57.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.969+0000 7f275d400640 1 -- 172.21.15.152:0/1113499228 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f27580d0a70 msgr2=0x7f275815b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:57.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.969+0000 7f275d400640 1 --2- 172.21.15.152:0/1113499228 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f27580d0a70 0x7f275815b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:57.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.969+0000 7f275d400640 1 -- 172.21.15.152:0/1113499228 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f275815d710 msgr2=0x7f27580998f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:57.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.969+0000 7f275d400640 1 --2- 172.21.15.152:0/1113499228 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f275815d710 0x7f27580998f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:57.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.969+0000 7f275d400640 1 -- 172.21.15.152:0/1113499228 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2758167140 con 0x7f275815a010 2024-04-17T08:47:57.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.969+0000 7f275d400640 1 --2- 172.21.15.152:0/1113499228 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f275815a010 0x7f27580993b0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f27480ae040 tx=0x7f2748019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:57.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.969+0000 7f2752000640 1 -- 172.21.15.152:0/1113499228 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27480b0040 con 0x7f275815a010 2024-04-17T08:47:57.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.969+0000 7f2752000640 1 -- 172.21.15.152:0/1113499228 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27480b9070 con 0x7f275815a010 2024-04-17T08:47:57.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.969+0000 7f2752000640 1 -- 172.21.15.152:0/1113499228 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27480b4690 con 0x7f275815a010 2024-04-17T08:47:57.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.969+0000 7f2760800640 1 -- 172.21.15.152:0/1113499228 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f275806f270 con 0x7f275815a010 2024-04-17T08:47:57.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.969+0000 7f2760800640 1 -- 172.21.15.152:0/1113499228 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f275806f830 con 0x7f275815a010 2024-04-17T08:47:57.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.969+0000 7f2760800640 1 -- 172.21.15.152:0/1113499228 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2758068a30 con 0x7f275815a010 2024-04-17T08:47:57.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.969+0000 7f2752000640 1 -- 172.21.15.152:0/1113499228 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f27480b4830 con 0x7f275815a010 2024-04-17T08:47:57.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.973+0000 7f2752000640 1 --2- 172.21.15.152:0/1113499228 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f273c068380 0x7f273c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:57.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.973+0000 7f2752000640 1 -- 172.21.15.152:0/1113499228 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7f27481206f0 con 0x7f275815a010 2024-04-17T08:47:57.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.973+0000 7f275de00640 1 --2- 172.21.15.152:0/1113499228 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f273c068380 0x7f273c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:57.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.973+0000 7f275de00640 1 --2- 172.21.15.152:0/1113499228 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f273c068380 0x7f273c06a840 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f274c005890 tx=0x7f274c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:57.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:57.977+0000 7f2752000640 1 -- 172.21.15.152:0/1113499228 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f2748016070 con 0x7f275815a010 2024-04-17T08:47:58.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.133+0000 7f2760800640 1 -- 172.21.15.152:0/1113499228 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f275806c940 con 0x7f275815a010 2024-04-17T08:47:58.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.253+0000 7f2752000640 1 -- 172.21.15.152:0/1113499228 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v35) ==== 138+0+0 (secure 0 0 0) 0x7f27480f0d40 con 0x7f275815a010 2024-04-17T08:47:58.257 INFO:teuthology.orchestra.run.smithi152.stderr:pool 'cephfs_metadata' created 2024-04-17T08:47:58.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.257+0000 7f2760800640 1 -- 172.21.15.152:0/1113499228 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f273c068380 msgr2=0x7f273c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:58.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.257+0000 7f2760800640 1 --2- 172.21.15.152:0/1113499228 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f273c068380 0x7f273c06a840 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f274c005890 tx=0x7f274c009040 comp rx=0 tx=0).stop 2024-04-17T08:47:58.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.257+0000 7f2760800640 1 -- 172.21.15.152:0/1113499228 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f275815a010 msgr2=0x7f27580993b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:58.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.257+0000 7f2760800640 1 --2- 172.21.15.152:0/1113499228 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f275815a010 0x7f27580993b0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f27480ae040 tx=0x7f2748019190 comp rx=0 tx=0).stop 2024-04-17T08:47:58.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.257+0000 7f2760800640 1 -- 172.21.15.152:0/1113499228 shutdown_connections 2024-04-17T08:47:58.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.257+0000 7f2760800640 1 --2- 172.21.15.152:0/1113499228 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f275815d710 0x7f27580998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:58.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.257+0000 7f2760800640 1 --2- 172.21.15.152:0/1113499228 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f275815a010 0x7f27580993b0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:58.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.257+0000 7f2760800640 1 --2- 172.21.15.152:0/1113499228 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f273c068380 0x7f273c06a840 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:58.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.257+0000 7f2760800640 1 --2- 172.21.15.152:0/1113499228 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f27580d0a70 0x7f275815b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:58.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.257+0000 7f2760800640 1 -- 172.21.15.152:0/1113499228 >> 172.21.15.152:0/1113499228 conn(0x7f27580b3350 msgr2=0x7f2758165fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:58.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.257+0000 7f2760800640 1 -- 172.21.15.152:0/1113499228 shutdown_connections 2024-04-17T08:47:58.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.257+0000 7f2760800640 1 -- 172.21.15.152:0/1113499228 wait complete. 2024-04-17T08:47:58.283 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-17T08:47:58.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.421+0000 7fb337800640 1 Processor -- start 2024-04-17T08:47:58.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.425+0000 7fb337800640 1 -- start start 2024-04-17T08:47:58.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.425+0000 7fb337800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fb33015a010 0x7fb3300d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:58.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.425+0000 7fb337800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb33015d710 0x7fb3300d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:58.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.425+0000 7fb337800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb330160d20 con 0x7fb330160010 2024-04-17T08:47:58.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.425+0000 7fb337800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fb33015d280 con 0x7fb33015a010 2024-04-17T08:47:58.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.425+0000 7fb337800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fb33015c9d0 con 0x7fb33015d710 2024-04-17T08:47:58.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.425+0000 7fb327e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb33015d710 0x7fb3300d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:58.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.425+0000 7fb334e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fb33015a010 0x7fb3300d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:58.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.425+0000 7fb327e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb33015d710 0x7fb3300d08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.152:41290/0 (socket says 172.21.15.152:41290) 2024-04-17T08:47:58.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.425+0000 7fb327e00640 1 -- 172.21.15.152:0/1667062001 learned_addr learned my addr 172.21.15.152:0/1667062001 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:58.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.425+0000 7fb334e00640 1 -- 172.21.15.152:0/1667062001 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb33015d710 msgr2=0x7fb3300d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:58.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.425+0000 7fb334e00640 1 --2- 172.21.15.152:0/1667062001 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb33015d710 0x7fb3300d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:58.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.425+0000 7fb334e00640 1 -- 172.21.15.152:0/1667062001 >> v1:172.21.15.196:6789/0 conn(0x7fb330160010 legacy=0x7fb330160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:58.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.425+0000 7fb334e00640 1 -- 172.21.15.152:0/1667062001 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb33015cc30 con 0x7fb33015a010 2024-04-17T08:47:58.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.425+0000 7fb327e00640 1 --2- 172.21.15.152:0/1667062001 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb33015d710 0x7fb3300d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T08:47:58.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.425+0000 7fb32fe00640 1 -- 172.21.15.152:0/1667062001 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 708278957 0 0) 0x7fb330160d20 con 0x7fb330160010 2024-04-17T08:47:58.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.429+0000 7fb334e00640 1 --2- 172.21.15.152:0/1667062001 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb33015a010 0x7fb3300d0360 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb3200097c0 tx=0x7fb32001c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=786bfb7290e40a5d server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:58.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.429+0000 7fb32fe00640 1 -- 172.21.15.152:0/1667062001 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3200b0070 con 0x7fb33015a010 2024-04-17T08:47:58.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.429+0000 7fb32fe00640 1 -- 172.21.15.152:0/1667062001 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3200ab600 con 0x7fb33015a010 2024-04-17T08:47:58.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.429+0000 7fb32fe00640 1 -- 172.21.15.152:0/1667062001 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3200ab9d0 con 0x7fb33015a010 2024-04-17T08:47:58.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.429+0000 7fb337800640 1 -- 172.21.15.152:0/1667062001 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb33015a010 msgr2=0x7fb3300d0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:58.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.429+0000 7fb337800640 1 --2- 172.21.15.152:0/1667062001 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb33015a010 0x7fb3300d0360 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb3200097c0 tx=0x7fb32001c410 comp rx=0 tx=0).stop 2024-04-17T08:47:58.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.429+0000 7fb337800640 1 -- 172.21.15.152:0/1667062001 shutdown_connections 2024-04-17T08:47:58.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.429+0000 7fb337800640 1 --2- 172.21.15.152:0/1667062001 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb33015d710 0x7fb3300d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:58.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.429+0000 7fb337800640 1 --2- 172.21.15.152:0/1667062001 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb33015a010 0x7fb3300d0360 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:58.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.429+0000 7fb337800640 1 -- 172.21.15.152:0/1667062001 >> 172.21.15.152:0/1667062001 conn(0x7fb3300b3350 msgr2=0x7fb3300b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:58.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.429+0000 7fb337800640 1 -- 172.21.15.152:0/1667062001 shutdown_connections 2024-04-17T08:47:58.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.429+0000 7fb337800640 1 -- 172.21.15.152:0/1667062001 wait complete. 2024-04-17T08:47:58.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.429+0000 7fb337800640 1 Processor -- start 2024-04-17T08:47:58.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.433+0000 7fb337800640 1 -- start start 2024-04-17T08:47:58.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.433+0000 7fb337800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb33015a010 0x7fb330157170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:58.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.433+0000 7fb337800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb33015d710 0x7fb3300b10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:58.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.433+0000 7fb337800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb330160010 0x7fb3300ce380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:58.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.433+0000 7fb337800640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb33015e780 con 0x7fb33015d710 2024-04-17T08:47:58.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.433+0000 7fb337800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb33015e600 con 0x7fb330160010 2024-04-17T08:47:58.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.433+0000 7fb337800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fb33015e900 con 0x7fb33015a010 2024-04-17T08:47:58.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.433+0000 7fb327e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb33015d710 0x7fb3300b10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:58.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.433+0000 7fb327e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb33015d710 0x7fb3300b10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51798/0 (socket says 172.21.15.152:51798) 2024-04-17T08:47:58.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.433+0000 7fb327e00640 1 -- 172.21.15.152:0/1731359938 learned_addr learned my addr 172.21.15.152:0/1731359938 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:58.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.433+0000 7fb334e00640 1 --2- 172.21.15.152:0/1731359938 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb33015a010 0x7fb330157170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:58.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.433+0000 7fb335800640 1 --2- 172.21.15.152:0/1731359938 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb330160010 0x7fb3300ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:58.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.433+0000 7fb327e00640 1 -- 172.21.15.152:0/1731359938 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb33015a010 msgr2=0x7fb330157170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:58.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.433+0000 7fb327e00640 1 --2- 172.21.15.152:0/1731359938 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb33015a010 0x7fb330157170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:58.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.433+0000 7fb327e00640 1 -- 172.21.15.152:0/1731359938 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb330160010 msgr2=0x7fb3300ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:58.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.433+0000 7fb327e00640 1 --2- 172.21.15.152:0/1731359938 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb330160010 0x7fb3300ce380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:58.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.433+0000 7fb327e00640 1 -- 172.21.15.152:0/1731359938 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3300cedf0 con 0x7fb33015d710 2024-04-17T08:47:58.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.433+0000 7fb327e00640 1 --2- 172.21.15.152:0/1731359938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb33015d710 0x7fb3300b10d0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fb31800e9d0 tx=0x7fb31800ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:58.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.433+0000 7fb32d600640 1 -- 172.21.15.152:0/1731359938 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb318017070 con 0x7fb33015d710 2024-04-17T08:47:58.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.433+0000 7fb32d600640 1 -- 172.21.15.152:0/1731359938 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb31800ca60 con 0x7fb33015d710 2024-04-17T08:47:58.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.433+0000 7fb32d600640 1 -- 172.21.15.152:0/1731359938 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb31800ce10 con 0x7fb33015d710 2024-04-17T08:47:58.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.433+0000 7fb337800640 1 -- 172.21.15.152:0/1731359938 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3300cf0d0 con 0x7fb33015d710 2024-04-17T08:47:58.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.433+0000 7fb337800640 1 -- 172.21.15.152:0/1731359938 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb33014eb70 con 0x7fb33015d710 2024-04-17T08:47:58.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.433+0000 7fb337800640 1 -- 172.21.15.152:0/1731359938 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb330068a30 con 0x7fb33015d710 2024-04-17T08:47:58.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.437+0000 7fb32d600640 1 -- 172.21.15.152:0/1731359938 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb31801a070 con 0x7fb33015d710 2024-04-17T08:47:58.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.437+0000 7fb32d600640 1 --2- 172.21.15.152:0/1731359938 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb30c068380 0x7fb30c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:58.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.437+0000 7fb32d600640 1 -- 172.21.15.152:0/1731359938 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5619+0+0 (secure 0 0 0) 0x7fb318086ff0 con 0x7fb33015d710 2024-04-17T08:47:58.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.437+0000 7fb334e00640 1 --2- 172.21.15.152:0/1731359938 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb30c068380 0x7fb30c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:58.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.437+0000 7fb334e00640 1 --2- 172.21.15.152:0/1731359938 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb30c068380 0x7fb30c06a840 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb3200ad000 tx=0x7fb3200a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:58.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.441+0000 7fb32d600640 1 -- 172.21.15.152:0/1731359938 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fb318057010 con 0x7fb33015d710 2024-04-17T08:47:58.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:58.597+0000 7fb337800640 1 -- 172.21.15.152:0/1731359938 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fb3300adce0 con 0x7fb33015d710 2024-04-17T08:47:59.260 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.257+0000 7fb32d600640 1 -- 172.21.15.152:0/1731359938 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v36) ==== 170+0+0 (secure 0 0 0) 0x7fb31805b310 con 0x7fb33015d710 2024-04-17T08:47:59.260 INFO:teuthology.orchestra.run.smithi152.stderr:pool 'cephfs_data' created 2024-04-17T08:47:59.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.261+0000 7fb337800640 1 -- 172.21.15.152:0/1731359938 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb30c068380 msgr2=0x7fb30c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:59.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.261+0000 7fb337800640 1 --2- 172.21.15.152:0/1731359938 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb30c068380 0x7fb30c06a840 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb3200ad000 tx=0x7fb3200a6000 comp rx=0 tx=0).stop 2024-04-17T08:47:59.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.261+0000 7fb337800640 1 -- 172.21.15.152:0/1731359938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb33015d710 msgr2=0x7fb3300b10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:59.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.261+0000 7fb337800640 1 --2- 172.21.15.152:0/1731359938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb33015d710 0x7fb3300b10d0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fb31800e9d0 tx=0x7fb31800ee90 comp rx=0 tx=0).stop 2024-04-17T08:47:59.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.261+0000 7fb337800640 1 -- 172.21.15.152:0/1731359938 shutdown_connections 2024-04-17T08:47:59.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.261+0000 7fb337800640 1 --2- 172.21.15.152:0/1731359938 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb330160010 0x7fb3300ce380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:59.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.261+0000 7fb337800640 1 --2- 172.21.15.152:0/1731359938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb33015d710 0x7fb3300b10d0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:59.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.261+0000 7fb337800640 1 --2- 172.21.15.152:0/1731359938 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb30c068380 0x7fb30c06a840 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:59.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.261+0000 7fb337800640 1 --2- 172.21.15.152:0/1731359938 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb33015a010 0x7fb330157170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:59.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.261+0000 7fb337800640 1 -- 172.21.15.152:0/1731359938 >> 172.21.15.152:0/1731359938 conn(0x7fb3300b3350 msgr2=0x7fb330160440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:59.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.261+0000 7fb337800640 1 -- 172.21.15.152:0/1731359938 shutdown_connections 2024-04-17T08:47:59.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.261+0000 7fb337800640 1 -- 172.21.15.152:0/1731359938 wait complete. 2024-04-17T08:47:59.301 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-17T08:47:59.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.437+0000 7f8c7be00640 1 Processor -- start 2024-04-17T08:47:59.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.437+0000 7f8c7be00640 1 -- start start 2024-04-17T08:47:59.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.441+0000 7f8c7be00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f8c7c15e340 0x7f8c7c0aec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:59.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.441+0000 7f8c7be00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f8c7c15e720 0x7f8c7c072d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:59.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.441+0000 7f8c7be00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c7c06d250 0x7f8c7c06d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:59.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.441+0000 7f8c7be00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f8c7c06dc00 con 0x7f8c7c15e340 2024-04-17T08:47:59.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.441+0000 7f8c7be00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f8c7c0adbe0 con 0x7f8c7c15e720 2024-04-17T08:47:59.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.441+0000 7f8c7be00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f8c7c073430 con 0x7f8c7c06d250 2024-04-17T08:47:59.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.441+0000 7f8c7aa00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f8c7c15e340 0x7f8c7c0aec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:59.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.441+0000 7f8c7aa00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f8c7c15e340 0x7f8c7c0aec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51810/0 (socket says 172.21.15.152:51810) 2024-04-17T08:47:59.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.441+0000 7f8c7aa00640 1 -- 172.21.15.152:0/1410667928 learned_addr learned my addr 172.21.15.152:0/1410667928 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:59.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.441+0000 7f8c7b400640 1 --2- 172.21.15.152:0/1410667928 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c7c06d250 0x7f8c7c06d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:59.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.441+0000 7f8c72000640 1 --2- 172.21.15.152:0/1410667928 >> v2:172.21.15.196:3300/0 conn(0x7f8c7c15e720 0x7f8c7c072d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:59.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.441+0000 7f8c7aa00640 1 -- 172.21.15.152:0/1410667928 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c7c06d250 msgr2=0x7f8c7c06d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:59.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.441+0000 7f8c7aa00640 1 --2- 172.21.15.152:0/1410667928 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c7c06d250 0x7f8c7c06d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:59.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.441+0000 7f8c7aa00640 1 -- 172.21.15.152:0/1410667928 >> v2:172.21.15.196:3300/0 conn(0x7f8c7c15e720 msgr2=0x7f8c7c072d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:47:59.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.441+0000 7f8c7aa00640 1 --2- 172.21.15.152:0/1410667928 >> v2:172.21.15.196:3300/0 conn(0x7f8c7c15e720 0x7f8c7c072d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:59.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.441+0000 7f8c7aa00640 1 -- 172.21.15.152:0/1410667928 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c7c0b37b0 con 0x7f8c7c15e340 2024-04-17T08:47:59.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.441+0000 7f8c7b400640 1 --2- 172.21.15.152:0/1410667928 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c7c06d250 0x7f8c7c06d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:47:59.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.441+0000 7f8c72000640 1 --2- 172.21.15.152:0/1410667928 >> v2:172.21.15.196:3300/0 conn(0x7f8c7c15e720 0x7f8c7c072d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:47:59.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.441+0000 7f8c7aa00640 1 --2- 172.21.15.152:0/1410667928 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c7c15e340 0x7f8c7c0aec20 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c0749c0 tx=0x7f8c6c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfa2f1226681c0f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:59.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.445+0000 7f8c7a000640 1 -- 172.21.15.152:0/1410667928 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c0aa610 con 0x7f8c7c15e340 2024-04-17T08:47:59.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.445+0000 7f8c7a000640 1 -- 172.21.15.152:0/1410667928 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c6c0af070 con 0x7f8c7c15e340 2024-04-17T08:47:59.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.445+0000 7f8c7a000640 1 -- 172.21.15.152:0/1410667928 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c0aa9d0 con 0x7f8c7c15e340 2024-04-17T08:47:59.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.445+0000 7f8c7be00640 1 -- 172.21.15.152:0/1410667928 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c7c15e340 msgr2=0x7f8c7c0aec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:59.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.445+0000 7f8c7be00640 1 --2- 172.21.15.152:0/1410667928 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c7c15e340 0x7f8c7c0aec20 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c0749c0 tx=0x7f8c6c01c4f0 comp rx=0 tx=0).stop 2024-04-17T08:47:59.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.445+0000 7f8c7be00640 1 -- 172.21.15.152:0/1410667928 shutdown_connections 2024-04-17T08:47:59.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.445+0000 7f8c7be00640 1 --2- 172.21.15.152:0/1410667928 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c7c06d250 0x7f8c7c06d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:59.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.445+0000 7f8c7be00640 1 --2- 172.21.15.152:0/1410667928 >> v2:172.21.15.196:3300/0 conn(0x7f8c7c15e720 0x7f8c7c072d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:59.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.445+0000 7f8c7be00640 1 --2- 172.21.15.152:0/1410667928 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c7c15e340 0x7f8c7c0aec20 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:59.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.445+0000 7f8c7be00640 1 -- 172.21.15.152:0/1410667928 >> 172.21.15.152:0/1410667928 conn(0x7f8c7c072250 msgr2=0x7f8c7c072660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:47:59.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.445+0000 7f8c7be00640 1 -- 172.21.15.152:0/1410667928 shutdown_connections 2024-04-17T08:47:59.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.445+0000 7f8c7be00640 1 -- 172.21.15.152:0/1410667928 wait complete. 2024-04-17T08:47:59.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.445+0000 7f8c7be00640 1 Processor -- start 2024-04-17T08:47:59.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.445+0000 7f8c7be00640 1 -- start start 2024-04-17T08:47:59.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.445+0000 7f8c7be00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c7c06d250 0x7f8c7c153580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:59.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.445+0000 7f8c7be00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c7c15e340 0x7f8c7c15fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:59.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.445+0000 7f8c7be00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c7c15e720 0x7f8c7c151050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:59.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.445+0000 7f8c7be00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8c7c162920 con 0x7f8c7c15e340 2024-04-17T08:47:59.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.445+0000 7f8c7be00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8c7c06e300 con 0x7f8c7c15e720 2024-04-17T08:47:59.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.445+0000 7f8c7be00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f8c7c162aa0 con 0x7f8c7c06d250 2024-04-17T08:47:59.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.445+0000 7f8c72000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c7c15e340 0x7f8c7c15fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:59.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.445+0000 7f8c72000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c7c15e340 0x7f8c7c15fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51826/0 (socket says 172.21.15.152:51826) 2024-04-17T08:47:59.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.445+0000 7f8c72000640 1 -- 172.21.15.152:0/2056006607 learned_addr learned my addr 172.21.15.152:0/2056006607 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:47:59.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.449+0000 7f8c7aa00640 1 --2- 172.21.15.152:0/2056006607 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c7c06d250 0x7f8c7c153580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:59.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.449+0000 7f8c7b400640 1 --2- 172.21.15.152:0/2056006607 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c7c15e720 0x7f8c7c151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:59.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.449+0000 7f8c72000640 1 -- 172.21.15.152:0/2056006607 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c7c06d250 msgr2=0x7f8c7c153580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:59.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.449+0000 7f8c72000640 1 --2- 172.21.15.152:0/2056006607 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c7c06d250 0x7f8c7c153580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:59.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.449+0000 7f8c72000640 1 -- 172.21.15.152:0/2056006607 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c7c15e720 msgr2=0x7f8c7c151050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:47:59.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.449+0000 7f8c72000640 1 --2- 172.21.15.152:0/2056006607 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c7c15e720 0x7f8c7c151050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:47:59.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.449+0000 7f8c72000640 1 -- 172.21.15.152:0/2056006607 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c7c15eda0 con 0x7f8c7c15e340 2024-04-17T08:47:59.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.449+0000 7f8c72000640 1 --2- 172.21.15.152:0/2056006607 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c7c15e340 0x7f8c7c15fe40 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f8c6400c820 tx=0x7f8c6400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:59.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.449+0000 7f8c73400640 1 -- 172.21.15.152:0/2056006607 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c64015070 con 0x7f8c7c15e340 2024-04-17T08:47:59.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.449+0000 7f8c73400640 1 -- 172.21.15.152:0/2056006607 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c64007a30 con 0x7f8c7c15e340 2024-04-17T08:47:59.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.449+0000 7f8c73400640 1 -- 172.21.15.152:0/2056006607 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c64007e40 con 0x7f8c7c15e340 2024-04-17T08:47:59.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.449+0000 7f8c7be00640 1 -- 172.21.15.152:0/2056006607 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c7c15f080 con 0x7f8c7c15e340 2024-04-17T08:47:59.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.449+0000 7f8c7be00640 1 -- 172.21.15.152:0/2056006607 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c7c15f640 con 0x7f8c7c15e340 2024-04-17T08:47:59.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.449+0000 7f8c7be00640 1 -- 172.21.15.152:0/2056006607 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c7c075be0 con 0x7f8c7c15e340 2024-04-17T08:47:59.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.449+0000 7f8c73400640 1 -- 172.21.15.152:0/2056006607 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8c64018070 con 0x7f8c7c15e340 2024-04-17T08:47:59.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.449+0000 7f8c73400640 1 --2- 172.21.15.152:0/2056006607 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8c58068380 0x7f8c5806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:47:59.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.453+0000 7f8c73400640 1 -- 172.21.15.152:0/2056006607 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6001+0+0 (secure 0 0 0) 0x7f8c64086a10 con 0x7f8c7c15e340 2024-04-17T08:47:59.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.453+0000 7f8c7aa00640 1 --2- 172.21.15.152:0/2056006607 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8c58068380 0x7f8c5806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:47:59.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.453+0000 7f8c7aa00640 1 --2- 172.21.15.152:0/2056006607 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8c58068380 0x7f8c5806a840 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c0ae000 tx=0x7f8c6c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:47:59.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.457+0000 7f8c73400640 1 -- 172.21.15.152:0/2056006607 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f8c64056ea0 con 0x7f8c7c15e340 2024-04-17T08:47:59.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:47:59.649+0000 7f8c7be00640 1 -- 172.21.15.152:0/2056006607 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f8c7c14ea30 con 0x7f8c7c15e340 2024-04-17T08:48:00.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.289+0000 7f8c73400640 1 -- 172.21.15.152:0/2056006607 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v14) ==== 172+0+0 (secure 0 0 0) 0x7f8c640567a0 con 0x7f8c7c15e340 2024-04-17T08:48:00.301 INFO:teuthology.orchestra.run.smithi152.stderr:new fs with metadata pool 5 and data pool 6 2024-04-17T08:48:00.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.309+0000 7f8c7be00640 1 -- 172.21.15.152:0/2056006607 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8c58068380 msgr2=0x7f8c5806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:00.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.309+0000 7f8c7be00640 1 --2- 172.21.15.152:0/2056006607 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8c58068380 0x7f8c5806a840 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c0ae000 tx=0x7f8c6c0a7000 comp rx=0 tx=0).stop 2024-04-17T08:48:00.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.309+0000 7f8c7be00640 1 -- 172.21.15.152:0/2056006607 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c7c15e340 msgr2=0x7f8c7c15fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:00.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.309+0000 7f8c7be00640 1 --2- 172.21.15.152:0/2056006607 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c7c15e340 0x7f8c7c15fe40 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f8c6400c820 tx=0x7f8c6400cce0 comp rx=0 tx=0).stop 2024-04-17T08:48:00.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.309+0000 7f8c7be00640 1 -- 172.21.15.152:0/2056006607 shutdown_connections 2024-04-17T08:48:00.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.309+0000 7f8c7be00640 1 --2- 172.21.15.152:0/2056006607 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c7c15e720 0x7f8c7c151050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:00.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.309+0000 7f8c7be00640 1 --2- 172.21.15.152:0/2056006607 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c7c15e340 0x7f8c7c15fe40 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:00.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.309+0000 7f8c7be00640 1 --2- 172.21.15.152:0/2056006607 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8c58068380 0x7f8c5806a840 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:00.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.309+0000 7f8c7be00640 1 --2- 172.21.15.152:0/2056006607 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c7c06d250 0x7f8c7c153580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:00.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.309+0000 7f8c7be00640 1 -- 172.21.15.152:0/2056006607 >> 172.21.15.152:0/2056006607 conn(0x7f8c7c072250 msgr2=0x7f8c7c06ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:48:00.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.313+0000 7f8c7be00640 1 -- 172.21.15.152:0/2056006607 shutdown_connections 2024-04-17T08:48:00.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.313+0000 7f8c7be00640 1 -- 172.21.15.152:0/2056006607 wait complete. 2024-04-17T08:48:00.338 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T08:48:00.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.473+0000 7f4241400640 1 Processor -- start 2024-04-17T08:48:00.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.473+0000 7f4241400640 1 -- start start 2024-04-17T08:48:00.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.473+0000 7f4241400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f423c15e4b0 0x7f423c0cd250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:00.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.473+0000 7f4241400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f423c15e890 0x7f423c06f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:00.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.473+0000 7f4241400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f423c0cb8f0 0x7f423c06f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:00.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.473+0000 7f4241400640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f423c0cee70 con 0x7f423c15e4b0 2024-04-17T08:48:00.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.473+0000 7f4241400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f423c0cf0c0 con 0x7f423c15e890 2024-04-17T08:48:00.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.473+0000 7f4241400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f423c0cf3a0 con 0x7f423c0cb8f0 2024-04-17T08:48:00.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.473+0000 7f423a800640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f423c15e4b0 0x7f423c0cd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:00.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.473+0000 7f4233e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f423c15e890 0x7f423c06f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:00.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.473+0000 7f423b200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f423c0cb8f0 0x7f423c06f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:00.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.473+0000 7f423a800640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f423c15e4b0 0x7f423c0cd250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51840/0 (socket says 172.21.15.152:51840) 2024-04-17T08:48:00.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.473+0000 7f4233e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f423c15e890 0x7f423c06f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.152:52408/0 (socket says 172.21.15.152:52408) 2024-04-17T08:48:00.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.473+0000 7f423a800640 1 -- 172.21.15.152:0/373448315 learned_addr learned my addr 172.21.15.152:0/373448315 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:48:00.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.473+0000 7f423a800640 1 -- 172.21.15.152:0/373448315 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f423c0cb8f0 msgr2=0x7f423c06f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:48:00.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.473+0000 7f423a800640 1 --2- 172.21.15.152:0/373448315 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f423c0cb8f0 0x7f423c06f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:00.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.473+0000 7f423a800640 1 -- 172.21.15.152:0/373448315 >> v2:172.21.15.196:3300/0 conn(0x7f423c15e890 msgr2=0x7f423c06f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:48:00.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.473+0000 7f423a800640 1 --2- 172.21.15.152:0/373448315 >> v2:172.21.15.196:3300/0 conn(0x7f423c15e890 0x7f423c06f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:00.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.473+0000 7f423a800640 1 -- 172.21.15.152:0/373448315 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f423c0cf680 con 0x7f423c15e4b0 2024-04-17T08:48:00.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.477+0000 7f423a800640 1 --2- 172.21.15.152:0/373448315 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f423c15e4b0 0x7f423c0cd250 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f423c074120 tx=0x7f422c01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89b82fd58fba6d06 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:48:00.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.477+0000 7f4239e00640 1 -- 172.21.15.152:0/373448315 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f422c0b1070 con 0x7f423c15e4b0 2024-04-17T08:48:00.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.477+0000 7f4239e00640 1 -- 172.21.15.152:0/373448315 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f422c0ac410 con 0x7f423c15e4b0 2024-04-17T08:48:00.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.477+0000 7f4239e00640 1 -- 172.21.15.152:0/373448315 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f422c0ac7e0 con 0x7f423c15e4b0 2024-04-17T08:48:00.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.477+0000 7f4241400640 1 -- 172.21.15.152:0/373448315 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f423c15e4b0 msgr2=0x7f423c0cd250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:00.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.477+0000 7f4241400640 1 --2- 172.21.15.152:0/373448315 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f423c15e4b0 0x7f423c0cd250 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f423c074120 tx=0x7f422c01c3d0 comp rx=0 tx=0).stop 2024-04-17T08:48:00.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.477+0000 7f4241400640 1 -- 172.21.15.152:0/373448315 shutdown_connections 2024-04-17T08:48:00.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.477+0000 7f4241400640 1 --2- 172.21.15.152:0/373448315 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f423c0cb8f0 0x7f423c06f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:00.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.477+0000 7f4241400640 1 --2- 172.21.15.152:0/373448315 >> v2:172.21.15.196:3300/0 conn(0x7f423c15e890 0x7f423c06f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:00.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.477+0000 7f4241400640 1 --2- 172.21.15.152:0/373448315 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f423c15e4b0 0x7f423c0cd250 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:00.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.477+0000 7f4241400640 1 -- 172.21.15.152:0/373448315 >> 172.21.15.152:0/373448315 conn(0x7f423c072ca0 msgr2=0x7f423c073080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:48:00.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.477+0000 7f4241400640 1 -- 172.21.15.152:0/373448315 shutdown_connections 2024-04-17T08:48:00.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.477+0000 7f4241400640 1 -- 172.21.15.152:0/373448315 wait complete. 2024-04-17T08:48:00.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.481+0000 7f4241400640 1 Processor -- start 2024-04-17T08:48:00.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.481+0000 7f4241400640 1 -- start start 2024-04-17T08:48:00.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.481+0000 7f4241400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f423c0cb8f0 0x7f423c152970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:00.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.481+0000 7f4241400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f423c15e4b0 0x7f423c160b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:00.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.481+0000 7f4241400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f423c15e890 0x7f423c0ca710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:00.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.481+0000 7f4241400640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f423c162bf0 con 0x7f423c0cb8f0 2024-04-17T08:48:00.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.481+0000 7f4241400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f423c162a70 con 0x7f423c15e4b0 2024-04-17T08:48:00.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.481+0000 7f4241400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f423c162d70 con 0x7f423c15e890 2024-04-17T08:48:00.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.481+0000 7f423a800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f423c0cb8f0 0x7f423c152970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:00.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.481+0000 7f4233e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f423c15e4b0 0x7f423c160b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:00.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.481+0000 7f423a800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f423c0cb8f0 0x7f423c152970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51842/0 (socket says 172.21.15.152:51842) 2024-04-17T08:48:00.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.481+0000 7f423a800640 1 -- 172.21.15.152:0/511831142 learned_addr learned my addr 172.21.15.152:0/511831142 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:48:00.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.481+0000 7f423b200640 1 --2- 172.21.15.152:0/511831142 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f423c15e890 0x7f423c0ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:00.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.481+0000 7f423a800640 1 -- 172.21.15.152:0/511831142 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f423c15e890 msgr2=0x7f423c0ca710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:00.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.481+0000 7f423a800640 1 --2- 172.21.15.152:0/511831142 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f423c15e890 0x7f423c0ca710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:00.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.481+0000 7f423a800640 1 -- 172.21.15.152:0/511831142 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f423c15e4b0 msgr2=0x7f423c160b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:00.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.481+0000 7f423a800640 1 --2- 172.21.15.152:0/511831142 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f423c15e4b0 0x7f423c160b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:00.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.481+0000 7f423a800640 1 -- 172.21.15.152:0/511831142 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f423c152eb0 con 0x7f423c0cb8f0 2024-04-17T08:48:00.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.481+0000 7f4233e00640 1 --2- 172.21.15.152:0/511831142 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f423c15e4b0 0x7f423c160b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T08:48:00.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.481+0000 7f423a800640 1 --2- 172.21.15.152:0/511831142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f423c0cb8f0 0x7f423c152970 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f422c0af040 tx=0x7f422c019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:48:00.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.481+0000 7f4232a00640 1 -- 172.21.15.152:0/511831142 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f422c0bc070 con 0x7f423c0cb8f0 2024-04-17T08:48:00.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.481+0000 7f4232a00640 1 -- 172.21.15.152:0/511831142 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f422c0acc40 con 0x7f423c0cb8f0 2024-04-17T08:48:00.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.481+0000 7f4232a00640 1 -- 172.21.15.152:0/511831142 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f422c0b1040 con 0x7f423c0cb8f0 2024-04-17T08:48:00.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.481+0000 7f4241400640 1 -- 172.21.15.152:0/511831142 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f423c0cb0f0 con 0x7f423c0cb8f0 2024-04-17T08:48:00.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.481+0000 7f4241400640 1 -- 172.21.15.152:0/511831142 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f423c151e90 con 0x7f423c0cb8f0 2024-04-17T08:48:00.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.485+0000 7f4241400640 1 -- 172.21.15.152:0/511831142 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f423c068a30 con 0x7f423c0cb8f0 2024-04-17T08:48:00.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.485+0000 7f4232a00640 1 -- 172.21.15.152:0/511831142 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f422c0b63d0 con 0x7f423c0cb8f0 2024-04-17T08:48:00.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.485+0000 7f4232a00640 1 --2- 172.21.15.152:0/511831142 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f42180683b0 0x7f421806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:00.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.485+0000 7f4232a00640 1 -- 172.21.15.152:0/511831142 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f422c11fff0 con 0x7f423c0cb8f0 2024-04-17T08:48:00.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.485+0000 7f4233e00640 1 --2- 172.21.15.152:0/511831142 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f42180683b0 0x7f421806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:00.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.485+0000 7f4233e00640 1 --2- 172.21.15.152:0/511831142 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f42180683b0 0x7f421806a870 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f423c06c2f0 tx=0x7f4224009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:48:00.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.489+0000 7f4232a00640 1 -- 172.21.15.152:0/511831142 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f422c016110 con 0x7f423c0cb8f0 2024-04-17T08:48:00.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.649+0000 7f4241400640 1 -- 172.21.15.152:0/511831142 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f423c0c7670 con 0x7f423c0cb8f0 2024-04-17T08:48:00.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.649+0000 7f4232a00640 1 -- 172.21.15.152:0/511831142 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+16979 (secure 0 0 0) 0x7f422c0efe20 con 0x7f423c0cb8f0 2024-04-17T08:48:00.653 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:48:00.653 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":37,"fsid":"ce68f82e-ec5f-4205-9fd5-bdfdf6ef31e2","created":"2024-04-17T08:46:08.353546+0000","modified":"2024-04-17T08:47:59.653436+0000","last_up_change":"2024-04-17T08:46:20.738799+0000","last_in_change":"2024-04-17T08:46:11.210050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T08:46:21.386856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-17T08:47:58.148039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-17T08:47:58.612261+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"682f0192-187c-404e-bc7a-b6b4e23825e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6819","nonce":3603799291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6823","nonce":3603799291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6831","nonce":3603799291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6827","nonce":3603799291}]},"public_addr":"172.21.15.152:6819/3603799291","cluster_addr":"172.21.15.152:6823/3603799291","heartbeat_back_addr":"172.21.15.152:6831/3603799291","heartbeat_front_addr":"172.21.15.152:6827/3603799291","state":["exists","up"]},{"osd":1,"uuid":"f0fe8fef-60ec-4a39-83b6-2fa6a5adb0f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6801","nonce":4133383142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6803","nonce":4133383142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6807","nonce":4133383142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6805","nonce":4133383142}]},"public_addr":"172.21.15.152:6801/4133383142","cluster_addr":"172.21.15.152:6803/4133383142","heartbeat_back_addr":"172.21.15.152:6807/4133383142","heartbeat_front_addr":"172.21.15.152:6805/4133383142","state":["exists","up"]},{"osd":2,"uuid":"35f36d9c-5245-4431-a618-f4df0fa380ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6809","nonce":3826143898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6811","nonce":3826143898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6815","nonce":3826143898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6813","nonce":3826143898}]},"public_addr":"172.21.15.152:6809/3826143898","cluster_addr":"172.21.15.152:6811/3826143898","heartbeat_back_addr":"172.21.15.152:6815/3826143898","heartbeat_front_addr":"172.21.15.152:6813/3826143898","state":["exists","up"]},{"osd":3,"uuid":"96e56ca5-15b4-4895-9b79-da2c92043159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6818","nonce":165717826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6822","nonce":165717826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6830","nonce":165717826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6826","nonce":165717826}]},"public_addr":"172.21.15.152:6818/165717826","cluster_addr":"172.21.15.152:6822/165717826","heartbeat_back_addr":"172.21.15.152:6830/165717826","heartbeat_front_addr":"172.21.15.152:6826/165717826","state":["exists","up"]},{"osd":4,"uuid":"f5aa10a4-9ff9-41fe-a5c9-15326f982cc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6817","nonce":4080159297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6819","nonce":4080159297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6823","nonce":4080159297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6821","nonce":4080159297}]},"public_addr":"172.21.15.196:6817/4080159297","cluster_addr":"172.21.15.196:6819/4080159297","heartbeat_back_addr":"172.21.15.196:6823/4080159297","heartbeat_front_addr":"172.21.15.196:6821/4080159297","state":["exists","up"]},{"osd":5,"uuid":"42bab884-3476-47ae-ac65-935fa6e0f055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6801","nonce":3519444232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6803","nonce":3519444232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6807","nonce":3519444232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6805","nonce":3519444232}]},"public_addr":"172.21.15.196:6801/3519444232","cluster_addr":"172.21.15.196:6803/3519444232","heartbeat_back_addr":"172.21.15.196:6807/3519444232","heartbeat_front_addr":"172.21.15.196:6805/3519444232","state":["exists","up"]},{"osd":6,"uuid":"460b6167-f57b-4224-9c92-cfc9b80bbe99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6809","nonce":275739834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6811","nonce":275739834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6815","nonce":275739834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6813","nonce":275739834}]},"public_addr":"172.21.15.196:6809/275739834","cluster_addr":"172.21.15.196:6811/275739834","heartbeat_back_addr":"172.21.15.196:6815/275739834","heartbeat_front_addr":"172.21.15.196:6813/275739834","state":["exists","up"]},{"osd":7,"uuid":"d695643f-5e07-4e2a-a646-c06bd97b6650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6825","nonce":307626968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6827","nonce":307626968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6831","nonce":307626968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6829","nonce":307626968}]},"public_addr":"172.21.15.196:6825/307626968","cluster_addr":"172.21.15.196:6827/307626968","heartbeat_back_addr":"172.21.15.196:6831/307626968","heartbeat_front_addr":"172.21.15.196:6829/307626968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.293257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.964533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.248895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.010000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.832554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.743704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930171+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930962+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T08:48:00.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.653+0000 7f4241400640 1 -- 172.21.15.152:0/511831142 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f42180683b0 msgr2=0x7f421806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:00.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.653+0000 7f4241400640 1 --2- 172.21.15.152:0/511831142 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f42180683b0 0x7f421806a870 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f423c06c2f0 tx=0x7f4224009190 comp rx=0 tx=0).stop 2024-04-17T08:48:00.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.653+0000 7f4241400640 1 -- 172.21.15.152:0/511831142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f423c0cb8f0 msgr2=0x7f423c152970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:00.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.653+0000 7f4241400640 1 --2- 172.21.15.152:0/511831142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f423c0cb8f0 0x7f423c152970 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f422c0af040 tx=0x7f422c019170 comp rx=0 tx=0).stop 2024-04-17T08:48:00.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.653+0000 7f4241400640 1 -- 172.21.15.152:0/511831142 shutdown_connections 2024-04-17T08:48:00.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.653+0000 7f4241400640 1 --2- 172.21.15.152:0/511831142 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f42180683b0 0x7f421806a870 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:00.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.653+0000 7f4241400640 1 --2- 172.21.15.152:0/511831142 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f423c15e890 0x7f423c0ca710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:00.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.653+0000 7f4241400640 1 --2- 172.21.15.152:0/511831142 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f423c15e4b0 0x7f423c160b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:00.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.653+0000 7f4241400640 1 --2- 172.21.15.152:0/511831142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f423c0cb8f0 0x7f423c152970 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:00.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.653+0000 7f4241400640 1 -- 172.21.15.152:0/511831142 >> 172.21.15.152:0/511831142 conn(0x7f423c072ca0 msgr2=0x7f423c0c6180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:48:00.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.653+0000 7f4241400640 1 -- 172.21.15.152:0/511831142 shutdown_connections 2024-04-17T08:48:00.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.653+0000 7f4241400640 1 -- 172.21.15.152:0/511831142 wait complete. 2024-04-17T08:48:00.675 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T08:48:00.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.809+0000 7fed46000640 1 Processor -- start 2024-04-17T08:48:00.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.809+0000 7fed46000640 1 -- start start 2024-04-17T08:48:00.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.809+0000 7fed46000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fed400d15b0 0x7fed4015ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:00.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.809+0000 7fed46000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fed400c7230 0x7fed400d0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:00.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.809+0000 7fed46000640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed400cfeb0 con 0x7fed40071790 2024-04-17T08:48:00.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.809+0000 7fed46000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fed4015f4f0 con 0x7fed400c7230 2024-04-17T08:48:00.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.809+0000 7fed46000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fed4015f7d0 con 0x7fed400d15b0 2024-04-17T08:48:00.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.809+0000 7fed3f400640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fed40071790 0x7fed40071b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:33312/0 (socket says 172.21.15.152:33312) 2024-04-17T08:48:00.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.809+0000 7fed3f400640 1 -- 172.21.15.152:0/3248721347 learned_addr learned my addr 172.21.15.152:0/3248721347 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:48:00.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.809+0000 7fed3ea00640 1 --2- 172.21.15.152:0/3248721347 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fed400d15b0 0x7fed4015ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:00.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.809+0000 7fed3fe00640 1 --2- 172.21.15.152:0/3248721347 >> v2:172.21.15.196:3300/0 conn(0x7fed400c7230 0x7fed400d0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:00.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.809+0000 7fed3e000640 1 -- 172.21.15.152:0/3248721347 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3074009859 0 0) 0x7fed400cfeb0 con 0x7fed40071790 2024-04-17T08:48:00.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.809+0000 7fed3e000640 1 -- 172.21.15.152:0/3248721347 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed24003530 con 0x7fed40071790 2024-04-17T08:48:00.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.809+0000 7fed3e000640 1 -- 172.21.15.152:0/3248721347 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 249885470 0 0) 0x7fed24003530 con 0x7fed40071790 2024-04-17T08:48:00.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.809+0000 7fed3e000640 1 -- 172.21.15.152:0/3248721347 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fed400d15b0 msgr2=0x7fed4015ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:48:00.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.809+0000 7fed3e000640 1 --2- 172.21.15.152:0/3248721347 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fed400d15b0 0x7fed4015ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:00.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.809+0000 7fed3e000640 1 -- 172.21.15.152:0/3248721347 >> v2:172.21.15.196:3300/0 conn(0x7fed400c7230 msgr2=0x7fed400d0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:48:00.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.809+0000 7fed3e000640 1 --2- 172.21.15.152:0/3248721347 >> v2:172.21.15.196:3300/0 conn(0x7fed400c7230 0x7fed400d0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:00.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.809+0000 7fed3e000640 1 -- 172.21.15.152:0/3248721347 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed4015fab0 con 0x7fed40071790 2024-04-17T08:48:00.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.809+0000 7fed3e000640 1 -- 172.21.15.152:0/3248721347 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2973887244 0 0) 0x7fed30001680 con 0x7fed40071790 2024-04-17T08:48:00.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.809+0000 7fed3e000640 1 -- 172.21.15.152:0/3248721347 >> v1:172.21.15.152:6789/0 conn(0x7fed40071790 legacy=0x7fed40071b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:00.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.809+0000 7fed3e000640 1 --2- 172.21.15.152:0/3248721347 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fed240039c0 0x7fed24003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:00.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.809+0000 7fed3e000640 1 --2- 172.21.15.152:0/3248721347 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed24004810 0x7fed24004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:00.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.809+0000 7fed3e000640 1 --2- 172.21.15.152:0/3248721347 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fed400d15b0 0x7fed240051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:00.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.809+0000 7fed3e000640 1 -- 172.21.15.152:0/3248721347 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fed4015f4f0 con 0x7fed24004810 2024-04-17T08:48:00.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.809+0000 7fed3e000640 1 -- 172.21.15.152:0/3248721347 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fed4015f7d0 con 0x7fed240039c0 2024-04-17T08:48:00.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.809+0000 7fed3e000640 1 -- 172.21.15.152:0/3248721347 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fed2400b9d0 con 0x7fed400d15b0 2024-04-17T08:48:00.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.809+0000 7fed3ea00640 1 --2- 172.21.15.152:0/3248721347 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed24004810 0x7fed24004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:00.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.809+0000 7fed3f400640 1 --2- 172.21.15.152:0/3248721347 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fed240039c0 0x7fed24003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:00.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.809+0000 7fed3fe00640 1 --2- 172.21.15.152:0/3248721347 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fed400d15b0 0x7fed240051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:00.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.809+0000 7fed3ea00640 1 -- 172.21.15.152:0/3248721347 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fed400d15b0 msgr2=0x7fed240051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:48:00.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.809+0000 7fed3ea00640 1 --2- 172.21.15.152:0/3248721347 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fed400d15b0 0x7fed240051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:00.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.809+0000 7fed3ea00640 1 -- 172.21.15.152:0/3248721347 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fed240039c0 msgr2=0x7fed24003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:48:00.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.809+0000 7fed3ea00640 1 --2- 172.21.15.152:0/3248721347 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fed240039c0 0x7fed24003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:00.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.809+0000 7fed3ea00640 1 -- 172.21.15.152:0/3248721347 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed24003530 con 0x7fed24004810 2024-04-17T08:48:00.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.809+0000 7fed3fe00640 1 --2- 172.21.15.152:0/3248721347 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fed400d15b0 0x7fed240051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:48:00.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.813+0000 7fed3ea00640 1 --2- 172.21.15.152:0/3248721347 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed24004810 0x7fed24004c90 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fed2c009ae0 tx=0x7fed2c01c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb18586eea4e205f server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:48:00.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.813+0000 7fed3e000640 1 -- 172.21.15.152:0/3248721347 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed2c0b1070 con 0x7fed24004810 2024-04-17T08:48:00.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.813+0000 7fed3e000640 1 -- 172.21.15.152:0/3248721347 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed2c0a4ab0 con 0x7fed24004810 2024-04-17T08:48:00.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.813+0000 7fed3e000640 1 -- 172.21.15.152:0/3248721347 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed2c0096b0 con 0x7fed24004810 2024-04-17T08:48:00.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.813+0000 7fed46000640 1 -- 172.21.15.152:0/3248721347 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed24004810 msgr2=0x7fed24004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:00.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.813+0000 7fed46000640 1 --2- 172.21.15.152:0/3248721347 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed24004810 0x7fed24004c90 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fed2c009ae0 tx=0x7fed2c01c750 comp rx=0 tx=0).stop 2024-04-17T08:48:00.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.813+0000 7fed3fe00640 1 -- 172.21.15.152:0/3248721347 reap_dead start 2024-04-17T08:48:00.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.813+0000 7fed46000640 1 -- 172.21.15.152:0/3248721347 shutdown_connections 2024-04-17T08:48:00.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.813+0000 7fed46000640 1 -- 172.21.15.152:0/3248721347 >> 172.21.15.152:0/3248721347 conn(0x7fed400cedf0 msgr2=0x7fed400cf200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:48:00.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.813+0000 7fed46000640 1 -- 172.21.15.152:0/3248721347 shutdown_connections 2024-04-17T08:48:00.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.813+0000 7fed46000640 1 -- 172.21.15.152:0/3248721347 wait complete. 2024-04-17T08:48:00.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.817+0000 7fed46000640 1 Processor -- start 2024-04-17T08:48:00.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.817+0000 7fed46000640 1 -- start start 2024-04-17T08:48:00.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.817+0000 7fed46000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed24004810 0x7fed401f5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:00.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.817+0000 7fed46000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fed400ca2b0 0x7fed400b4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:00.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.817+0000 7fed46000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fed400cbc90 0x7fed401ea2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:00.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.817+0000 7fed46000640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fed400d0d50 con 0x7fed24004810 2024-04-17T08:48:00.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.817+0000 7fed46000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fed400d0bd0 con 0x7fed400cbc90 2024-04-17T08:48:00.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.817+0000 7fed46000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fed400d0ed0 con 0x7fed400ca2b0 2024-04-17T08:48:00.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.817+0000 7fed3f400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed24004810 0x7fed401f5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:00.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.817+0000 7fed3f400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed24004810 0x7fed401f5500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51862/0 (socket says 172.21.15.152:51862) 2024-04-17T08:48:00.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.817+0000 7fed3f400640 1 -- 172.21.15.152:0/69003348 learned_addr learned my addr 172.21.15.152:0/69003348 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:48:00.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.817+0000 7fed3ea00640 1 --2- 172.21.15.152:0/69003348 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fed400ca2b0 0x7fed400b4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:00.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.817+0000 7fed3fe00640 1 --2- 172.21.15.152:0/69003348 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fed400cbc90 0x7fed401ea2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:00.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.817+0000 7fed3f400640 1 -- 172.21.15.152:0/69003348 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fed400ca2b0 msgr2=0x7fed400b4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:00.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.817+0000 7fed3f400640 1 --2- 172.21.15.152:0/69003348 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fed400ca2b0 0x7fed400b4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:00.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.817+0000 7fed3f400640 1 -- 172.21.15.152:0/69003348 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fed400cbc90 msgr2=0x7fed401ea2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:00.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.817+0000 7fed3f400640 1 --2- 172.21.15.152:0/69003348 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fed400cbc90 0x7fed401ea2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:00.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.817+0000 7fed3f400640 1 -- 172.21.15.152:0/69003348 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed401f5a40 con 0x7fed24004810 2024-04-17T08:48:00.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.817+0000 7fed3f400640 1 --2- 172.21.15.152:0/69003348 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed24004810 0x7fed401f5500 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fed30012310 tx=0x7fed300127d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:48:00.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.817+0000 7fed37400640 1 -- 172.21.15.152:0/69003348 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed3001c070 con 0x7fed24004810 2024-04-17T08:48:00.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.817+0000 7fed37400640 1 -- 172.21.15.152:0/69003348 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed30014750 con 0x7fed24004810 2024-04-17T08:48:00.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.817+0000 7fed37400640 1 -- 172.21.15.152:0/69003348 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed30014b40 con 0x7fed24004810 2024-04-17T08:48:00.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.817+0000 7fed46000640 1 -- 172.21.15.152:0/69003348 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed400cabf0 con 0x7fed24004810 2024-04-17T08:48:00.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.817+0000 7fed46000640 1 -- 172.21.15.152:0/69003348 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed400cb1b0 con 0x7fed24004810 2024-04-17T08:48:00.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.821+0000 7fed46000640 1 -- 172.21.15.152:0/69003348 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed40068a30 con 0x7fed24004810 2024-04-17T08:48:00.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.821+0000 7fed37400640 1 -- 172.21.15.152:0/69003348 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fed30014ce0 con 0x7fed24004810 2024-04-17T08:48:00.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.821+0000 7fed37400640 1 --2- 172.21.15.152:0/69003348 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fed20068380 0x7fed2006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:00.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.821+0000 7fed37400640 1 -- 172.21.15.152:0/69003348 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7fed30089390 con 0x7fed24004810 2024-04-17T08:48:00.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.821+0000 7fed3ea00640 1 --2- 172.21.15.152:0/69003348 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fed20068380 0x7fed2006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:00.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.821+0000 7fed3ea00640 1 --2- 172.21.15.152:0/69003348 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fed20068380 0x7fed2006a840 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fed2c0ae000 tx=0x7fed2c0046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:48:00.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.825+0000 7fed37400640 1 -- 172.21.15.152:0/69003348 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fed401f5a40 con 0x7fed24004810 2024-04-17T08:48:00.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.985+0000 7fed46000640 1 -- 172.21.15.152:0/69003348 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fed400d20e0 con 0x7fed24004810 2024-04-17T08:48:00.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.985+0000 7fed37400640 1 -- 172.21.15.152:0/69003348 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+16979 (secure 0 0 0) 0x7fed30059200 con 0x7fed24004810 2024-04-17T08:48:00.987 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:48:00.987 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":37,"fsid":"ce68f82e-ec5f-4205-9fd5-bdfdf6ef31e2","created":"2024-04-17T08:46:08.353546+0000","modified":"2024-04-17T08:47:59.653436+0000","last_up_change":"2024-04-17T08:46:20.738799+0000","last_in_change":"2024-04-17T08:46:11.210050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T08:46:21.386856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-17T08:47:58.148039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-17T08:47:58.612261+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"682f0192-187c-404e-bc7a-b6b4e23825e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6819","nonce":3603799291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6823","nonce":3603799291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6831","nonce":3603799291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6827","nonce":3603799291}]},"public_addr":"172.21.15.152:6819/3603799291","cluster_addr":"172.21.15.152:6823/3603799291","heartbeat_back_addr":"172.21.15.152:6831/3603799291","heartbeat_front_addr":"172.21.15.152:6827/3603799291","state":["exists","up"]},{"osd":1,"uuid":"f0fe8fef-60ec-4a39-83b6-2fa6a5adb0f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6801","nonce":4133383142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6803","nonce":4133383142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6807","nonce":4133383142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6805","nonce":4133383142}]},"public_addr":"172.21.15.152:6801/4133383142","cluster_addr":"172.21.15.152:6803/4133383142","heartbeat_back_addr":"172.21.15.152:6807/4133383142","heartbeat_front_addr":"172.21.15.152:6805/4133383142","state":["exists","up"]},{"osd":2,"uuid":"35f36d9c-5245-4431-a618-f4df0fa380ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6809","nonce":3826143898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6811","nonce":3826143898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6815","nonce":3826143898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6813","nonce":3826143898}]},"public_addr":"172.21.15.152:6809/3826143898","cluster_addr":"172.21.15.152:6811/3826143898","heartbeat_back_addr":"172.21.15.152:6815/3826143898","heartbeat_front_addr":"172.21.15.152:6813/3826143898","state":["exists","up"]},{"osd":3,"uuid":"96e56ca5-15b4-4895-9b79-da2c92043159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6818","nonce":165717826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6822","nonce":165717826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6830","nonce":165717826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6826","nonce":165717826}]},"public_addr":"172.21.15.152:6818/165717826","cluster_addr":"172.21.15.152:6822/165717826","heartbeat_back_addr":"172.21.15.152:6830/165717826","heartbeat_front_addr":"172.21.15.152:6826/165717826","state":["exists","up"]},{"osd":4,"uuid":"f5aa10a4-9ff9-41fe-a5c9-15326f982cc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6817","nonce":4080159297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6819","nonce":4080159297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6823","nonce":4080159297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6821","nonce":4080159297}]},"public_addr":"172.21.15.196:6817/4080159297","cluster_addr":"172.21.15.196:6819/4080159297","heartbeat_back_addr":"172.21.15.196:6823/4080159297","heartbeat_front_addr":"172.21.15.196:6821/4080159297","state":["exists","up"]},{"osd":5,"uuid":"42bab884-3476-47ae-ac65-935fa6e0f055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6801","nonce":3519444232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6803","nonce":3519444232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6807","nonce":3519444232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6805","nonce":3519444232}]},"public_addr":"172.21.15.196:6801/3519444232","cluster_addr":"172.21.15.196:6803/3519444232","heartbeat_back_addr":"172.21.15.196:6807/3519444232","heartbeat_front_addr":"172.21.15.196:6805/3519444232","state":["exists","up"]},{"osd":6,"uuid":"460b6167-f57b-4224-9c92-cfc9b80bbe99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6809","nonce":275739834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6811","nonce":275739834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6815","nonce":275739834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6813","nonce":275739834}]},"public_addr":"172.21.15.196:6809/275739834","cluster_addr":"172.21.15.196:6811/275739834","heartbeat_back_addr":"172.21.15.196:6815/275739834","heartbeat_front_addr":"172.21.15.196:6813/275739834","state":["exists","up"]},{"osd":7,"uuid":"d695643f-5e07-4e2a-a646-c06bd97b6650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6825","nonce":307626968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6827","nonce":307626968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6831","nonce":307626968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6829","nonce":307626968}]},"public_addr":"172.21.15.196:6825/307626968","cluster_addr":"172.21.15.196:6827/307626968","heartbeat_back_addr":"172.21.15.196:6831/307626968","heartbeat_front_addr":"172.21.15.196:6829/307626968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.293257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.964533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.248895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.010000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.832554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.743704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930171+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930962+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T08:48:00.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.985+0000 7fed46000640 1 -- 172.21.15.152:0/69003348 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fed20068380 msgr2=0x7fed2006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:00.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.985+0000 7fed46000640 1 --2- 172.21.15.152:0/69003348 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fed20068380 0x7fed2006a840 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fed2c0ae000 tx=0x7fed2c0046d0 comp rx=0 tx=0).stop 2024-04-17T08:48:00.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.985+0000 7fed46000640 1 -- 172.21.15.152:0/69003348 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed24004810 msgr2=0x7fed401f5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:00.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.985+0000 7fed46000640 1 --2- 172.21.15.152:0/69003348 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed24004810 0x7fed401f5500 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fed30012310 tx=0x7fed300127d0 comp rx=0 tx=0).stop 2024-04-17T08:48:00.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.985+0000 7fed46000640 1 -- 172.21.15.152:0/69003348 shutdown_connections 2024-04-17T08:48:00.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.985+0000 7fed46000640 1 --2- 172.21.15.152:0/69003348 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fed400cbc90 0x7fed401ea2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:00.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.985+0000 7fed46000640 1 --2- 172.21.15.152:0/69003348 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fed20068380 0x7fed2006a840 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:00.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.985+0000 7fed46000640 1 --2- 172.21.15.152:0/69003348 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fed400ca2b0 0x7fed400b4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:00.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.985+0000 7fed46000640 1 --2- 172.21.15.152:0/69003348 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed24004810 0x7fed401f5500 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:00.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.985+0000 7fed46000640 1 -- 172.21.15.152:0/69003348 >> 172.21.15.152:0/69003348 conn(0x7fed400cedf0 msgr2=0x7fed4006d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:48:00.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.985+0000 7fed46000640 1 -- 172.21.15.152:0/69003348 shutdown_connections 2024-04-17T08:48:00.990 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:00.985+0000 7fed46000640 1 -- 172.21.15.152:0/69003348 wait complete. 2024-04-17T08:48:01.009 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-17T08:48:01.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.145+0000 7fc76f600640 1 Processor -- start 2024-04-17T08:48:01.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.145+0000 7fc76f600640 1 -- start start 2024-04-17T08:48:01.148 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.145+0000 7fc76f600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc768161b70 0x7fc76806dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:01.148 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.145+0000 7fc76f600640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc7680d0a70 0x7fc7680ad3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:01.148 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.145+0000 7fc76f600640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc76806e6b0 con 0x7fc76806e1a0 2024-04-17T08:48:01.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.145+0000 7fc76f600640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fc768161f50 con 0x7fc7680d0a70 2024-04-17T08:48:01.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.145+0000 7fc76f600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fc76806f230 con 0x7fc768161b70 2024-04-17T08:48:01.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.145+0000 7fc76d600640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc7680d0a70 0x7fc7680ad3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:01.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.145+0000 7fc767e00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fc76806e1a0 0x7fc7680d0360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:33324/0 (socket says 172.21.15.152:33324) 2024-04-17T08:48:01.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.145+0000 7fc767e00640 1 -- 172.21.15.152:0/2531644017 learned_addr learned my addr 172.21.15.152:0/2531644017 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:48:01.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.145+0000 7fc76cc00640 1 --2- 172.21.15.152:0/2531644017 >> v2:172.21.15.196:3300/0 conn(0x7fc768161b70 0x7fc76806dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:01.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.145+0000 7fc76d600640 1 -- 172.21.15.152:0/2531644017 >> v2:172.21.15.196:3300/0 conn(0x7fc768161b70 msgr2=0x7fc76806dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:48:01.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.145+0000 7fc76d600640 1 --2- 172.21.15.152:0/2531644017 >> v2:172.21.15.196:3300/0 conn(0x7fc768161b70 0x7fc76806dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:01.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.145+0000 7fc76d600640 1 -- 172.21.15.152:0/2531644017 >> v1:172.21.15.152:6789/0 conn(0x7fc76806e1a0 legacy=0x7fc7680d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:01.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.145+0000 7fc76d600640 1 -- 172.21.15.152:0/2531644017 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc76806e990 con 0x7fc7680d0a70 2024-04-17T08:48:01.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.145+0000 7fc767400640 1 -- 172.21.15.152:0/2531644017 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 772185988 0 0) 0x7fc76806e6b0 con 0x7fc76806e1a0 2024-04-17T08:48:01.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.149+0000 7fc76d600640 1 --2- 172.21.15.152:0/2531644017 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7680d0a70 0x7fc7680ad3d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fc7680d1200 tx=0x7fc76001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec15b8a35bc64ad server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:48:01.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.149+0000 7fc767400640 1 -- 172.21.15.152:0/2531644017 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7600b1070 con 0x7fc7680d0a70 2024-04-17T08:48:01.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.149+0000 7fc767400640 1 -- 172.21.15.152:0/2531644017 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7600ac620 con 0x7fc7680d0a70 2024-04-17T08:48:01.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.149+0000 7fc767400640 1 -- 172.21.15.152:0/2531644017 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7600ac9f0 con 0x7fc7680d0a70 2024-04-17T08:48:01.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.149+0000 7fc76f600640 1 -- 172.21.15.152:0/2531644017 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7680d0a70 msgr2=0x7fc7680ad3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:01.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.149+0000 7fc76f600640 1 --2- 172.21.15.152:0/2531644017 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7680d0a70 0x7fc7680ad3d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fc7680d1200 tx=0x7fc76001c3c0 comp rx=0 tx=0).stop 2024-04-17T08:48:01.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.149+0000 7fc76f600640 1 -- 172.21.15.152:0/2531644017 shutdown_connections 2024-04-17T08:48:01.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.149+0000 7fc76f600640 1 --2- 172.21.15.152:0/2531644017 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7680d0a70 0x7fc7680ad3d0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:01.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.149+0000 7fc76f600640 1 --2- 172.21.15.152:0/2531644017 >> v2:172.21.15.196:3300/0 conn(0x7fc768161b70 0x7fc76806dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:01.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.149+0000 7fc76f600640 1 -- 172.21.15.152:0/2531644017 >> 172.21.15.152:0/2531644017 conn(0x7fc7680b3350 msgr2=0x7fc7680b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:48:01.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.149+0000 7fc76f600640 1 -- 172.21.15.152:0/2531644017 shutdown_connections 2024-04-17T08:48:01.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.149+0000 7fc76f600640 1 -- 172.21.15.152:0/2531644017 wait complete. 2024-04-17T08:48:01.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.153+0000 7fc76f600640 1 Processor -- start 2024-04-17T08:48:01.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.153+0000 7fc76f600640 1 -- start start 2024-04-17T08:48:01.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.153+0000 7fc76f600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc76806e1a0 0x7fc76814ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:01.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.153+0000 7fc76f600640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7680d0a70 0x7fc7680ae7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:01.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.153+0000 7fc76f600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc768161b70 0x7fc76815ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:01.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.153+0000 7fc76f600640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc7680ae2a0 con 0x7fc7680d0a70 2024-04-17T08:48:01.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.153+0000 7fc76f600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc7680ae120 con 0x7fc76806e1a0 2024-04-17T08:48:01.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.153+0000 7fc76f600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fc7680ae420 con 0x7fc768161b70 2024-04-17T08:48:01.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.153+0000 7fc767e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7680d0a70 0x7fc7680ae7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:01.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.153+0000 7fc767e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7680d0a70 0x7fc7680ae7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51872/0 (socket says 172.21.15.152:51872) 2024-04-17T08:48:01.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.153+0000 7fc767e00640 1 -- 172.21.15.152:0/2110122364 learned_addr learned my addr 172.21.15.152:0/2110122364 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:48:01.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.153+0000 7fc76cc00640 1 --2- 172.21.15.152:0/2110122364 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc76806e1a0 0x7fc76814ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:01.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.153+0000 7fc76d600640 1 --2- 172.21.15.152:0/2110122364 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc768161b70 0x7fc76815ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:01.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.153+0000 7fc767e00640 1 -- 172.21.15.152:0/2110122364 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc768161b70 msgr2=0x7fc76815ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:01.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.153+0000 7fc767e00640 1 --2- 172.21.15.152:0/2110122364 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc768161b70 0x7fc76815ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:01.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.153+0000 7fc767e00640 1 -- 172.21.15.152:0/2110122364 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc76806e1a0 msgr2=0x7fc76814ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:01.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.153+0000 7fc767e00640 1 --2- 172.21.15.152:0/2110122364 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc76806e1a0 0x7fc76814ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:01.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.153+0000 7fc767e00640 1 -- 172.21.15.152:0/2110122364 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7680af1c0 con 0x7fc7680d0a70 2024-04-17T08:48:01.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.153+0000 7fc76cc00640 1 --2- 172.21.15.152:0/2110122364 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc76806e1a0 0x7fc76814ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:48:01.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.153+0000 7fc767e00640 1 --2- 172.21.15.152:0/2110122364 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7680d0a70 0x7fc7680ae7e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fc75400c4b0 tx=0x7fc75400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:48:01.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.153+0000 7fc764c00640 1 -- 172.21.15.152:0/2110122364 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc754018070 con 0x7fc7680d0a70 2024-04-17T08:48:01.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.153+0000 7fc764c00640 1 -- 172.21.15.152:0/2110122364 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc754007500 con 0x7fc7680d0a70 2024-04-17T08:48:01.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.153+0000 7fc764c00640 1 -- 172.21.15.152:0/2110122364 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc754004a30 con 0x7fc7680d0a70 2024-04-17T08:48:01.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.153+0000 7fc76f600640 1 -- 172.21.15.152:0/2110122364 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7680af4a0 con 0x7fc7680d0a70 2024-04-17T08:48:01.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.153+0000 7fc76f600640 1 -- 172.21.15.152:0/2110122364 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7680afcc0 con 0x7fc7680d0a70 2024-04-17T08:48:01.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.157+0000 7fc76f600640 1 -- 172.21.15.152:0/2110122364 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7680b0190 con 0x7fc7680d0a70 2024-04-17T08:48:01.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.157+0000 7fc764c00640 1 -- 172.21.15.152:0/2110122364 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc75401b070 con 0x7fc7680d0a70 2024-04-17T08:48:01.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.157+0000 7fc764c00640 1 --2- 172.21.15.152:0/2110122364 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc748068380 0x7fc74806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:01.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.157+0000 7fc764c00640 1 -- 172.21.15.152:0/2110122364 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7fc754085e70 con 0x7fc7680d0a70 2024-04-17T08:48:01.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.157+0000 7fc76cc00640 1 --2- 172.21.15.152:0/2110122364 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc748068380 0x7fc74806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:01.160 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.157+0000 7fc76cc00640 1 --2- 172.21.15.152:0/2110122364 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc748068380 0x7fc74806a840 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc7680b1c80 tx=0x7fc75800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:48:01.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.161+0000 7fc764c00640 1 -- 172.21.15.152:0/2110122364 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fc754056360 con 0x7fc7680d0a70 2024-04-17T08:48:01.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:01.361+0000 7fc76f600640 1 -- 172.21.15.152:0/2110122364 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fc768068a30 con 0x7fc7680d0a70 2024-04-17T08:48:02.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.305+0000 7fc764c00640 1 -- 172.21.15.152:0/2110122364 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7fc754055c60 con 0x7fc7680d0a70 2024-04-17T08:48:02.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.309+0000 7fc76f600640 1 -- 172.21.15.152:0/2110122364 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc748068380 msgr2=0x7fc74806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:02.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.309+0000 7fc76f600640 1 --2- 172.21.15.152:0/2110122364 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc748068380 0x7fc74806a840 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc7680b1c80 tx=0x7fc75800b040 comp rx=0 tx=0).stop 2024-04-17T08:48:02.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.309+0000 7fc76f600640 1 -- 172.21.15.152:0/2110122364 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7680d0a70 msgr2=0x7fc7680ae7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:02.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.309+0000 7fc76f600640 1 --2- 172.21.15.152:0/2110122364 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7680d0a70 0x7fc7680ae7e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fc75400c4b0 tx=0x7fc75400c970 comp rx=0 tx=0).stop 2024-04-17T08:48:02.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.309+0000 7fc76f600640 1 -- 172.21.15.152:0/2110122364 shutdown_connections 2024-04-17T08:48:02.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.309+0000 7fc76f600640 1 --2- 172.21.15.152:0/2110122364 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc748068380 0x7fc74806a840 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:02.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.309+0000 7fc76f600640 1 --2- 172.21.15.152:0/2110122364 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc768161b70 0x7fc76815ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:02.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.309+0000 7fc76f600640 1 --2- 172.21.15.152:0/2110122364 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7680d0a70 0x7fc7680ae7e0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:02.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.309+0000 7fc76f600640 1 --2- 172.21.15.152:0/2110122364 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc76806e1a0 0x7fc76814ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:02.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.309+0000 7fc76f600640 1 -- 172.21.15.152:0/2110122364 >> 172.21.15.152:0/2110122364 conn(0x7fc7680b3350 msgr2=0x7fc7680726d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:48:02.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.309+0000 7fc76f600640 1 -- 172.21.15.152:0/2110122364 shutdown_connections 2024-04-17T08:48:02.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.309+0000 7fc76f600640 1 -- 172.21.15.152:0/2110122364 wait complete. 2024-04-17T08:48:02.335 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-17T08:48:02.336 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-17T08:48:02.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.477+0000 7fda98e00640 1 Processor -- start 2024-04-17T08:48:02.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.477+0000 7fda98e00640 1 -- start start 2024-04-17T08:48:02.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.477+0000 7fda98e00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fda94145b40 0x7fda9415c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:02.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.477+0000 7fda98e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fda9406c930 0x7fda9415e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:02.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.477+0000 7fda98e00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda94145f20 con 0x7fda940b5300 2024-04-17T08:48:02.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.477+0000 7fda98e00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fda940737b0 con 0x7fda94145b40 2024-04-17T08:48:02.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.477+0000 7fda98e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fda9415d040 con 0x7fda9406c930 2024-04-17T08:48:02.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.477+0000 7fda93400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fda94145b40 0x7fda9415c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:02.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.477+0000 7fda93400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fda94145b40 0x7fda9415c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51884/0 (socket says 172.21.15.152:51884) 2024-04-17T08:48:02.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.477+0000 7fda93400640 1 -- 172.21.15.152:0/717738259 learned_addr learned my addr 172.21.15.152:0/717738259 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:48:02.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.477+0000 7fda93e00640 1 --2- 172.21.15.152:0/717738259 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fda9406c930 0x7fda9415e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:02.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.477+0000 7fda93400640 1 -- 172.21.15.152:0/717738259 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fda9406c930 msgr2=0x7fda9415e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:48:02.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.477+0000 7fda93400640 1 --2- 172.21.15.152:0/717738259 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fda9406c930 0x7fda9415e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:02.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.477+0000 7fda93400640 1 -- 172.21.15.152:0/717738259 >> v1:172.21.15.196:6789/0 conn(0x7fda940b5300 legacy=0x7fda9406c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:48:02.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.477+0000 7fda93400640 1 -- 172.21.15.152:0/717738259 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda9415d320 con 0x7fda94145b40 2024-04-17T08:48:02.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.477+0000 7fda93e00640 1 --2- 172.21.15.152:0/717738259 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fda9406c930 0x7fda9415e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:48:02.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.481+0000 7fda93400640 1 --2- 172.21.15.152:0/717738259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda94145b40 0x7fda9415c900 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fda84009870 tx=0x7fda8401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55345fa16e14a72e server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:48:02.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.481+0000 7fda92000640 1 -- 172.21.15.152:0/717738259 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda840b1070 con 0x7fda94145b40 2024-04-17T08:48:02.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.481+0000 7fda92000640 1 -- 172.21.15.152:0/717738259 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda840ac630 con 0x7fda94145b40 2024-04-17T08:48:02.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.481+0000 7fda92000640 1 -- 172.21.15.152:0/717738259 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda840a8050 con 0x7fda94145b40 2024-04-17T08:48:02.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.481+0000 7fda98e00640 1 -- 172.21.15.152:0/717738259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda94145b40 msgr2=0x7fda9415c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:02.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.481+0000 7fda98e00640 1 --2- 172.21.15.152:0/717738259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda94145b40 0x7fda9415c900 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fda84009870 tx=0x7fda8401c520 comp rx=0 tx=0).stop 2024-04-17T08:48:02.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.481+0000 7fda98e00640 1 -- 172.21.15.152:0/717738259 shutdown_connections 2024-04-17T08:48:02.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.481+0000 7fda98e00640 1 --2- 172.21.15.152:0/717738259 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fda9406c930 0x7fda9415e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:02.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.481+0000 7fda98e00640 1 --2- 172.21.15.152:0/717738259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda94145b40 0x7fda9415c900 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:02.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.481+0000 7fda98e00640 1 -- 172.21.15.152:0/717738259 >> 172.21.15.152:0/717738259 conn(0x7fda94072ad0 msgr2=0x7fda94072ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:48:02.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.481+0000 7fda98e00640 1 -- 172.21.15.152:0/717738259 shutdown_connections 2024-04-17T08:48:02.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.481+0000 7fda98e00640 1 -- 172.21.15.152:0/717738259 wait complete. 2024-04-17T08:48:02.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.481+0000 7fda98e00640 1 Processor -- start 2024-04-17T08:48:02.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.485+0000 7fda98e00640 1 -- start start 2024-04-17T08:48:02.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.485+0000 7fda98e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fda9406c930 0x7fda9413f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:02.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.485+0000 7fda98e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fda940b5300 0x7fda940ad010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:02.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.485+0000 7fda98e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda94145b40 0x7fda9406e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:02.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.485+0000 7fda98e00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fda9415efb0 con 0x7fda94145b40 2024-04-17T08:48:02.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.485+0000 7fda98e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fda9415ee30 con 0x7fda940b5300 2024-04-17T08:48:02.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.485+0000 7fda98e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fda9415f130 con 0x7fda9406c930 2024-04-17T08:48:02.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.485+0000 7fda93e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda94145b40 0x7fda9406e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:02.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.485+0000 7fda93e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda94145b40 0x7fda9406e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51892/0 (socket says 172.21.15.152:51892) 2024-04-17T08:48:02.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.485+0000 7fda93e00640 1 -- 172.21.15.152:0/787945100 learned_addr learned my addr 172.21.15.152:0/787945100 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:48:02.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.485+0000 7fda93400640 1 --2- 172.21.15.152:0/787945100 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fda9406c930 0x7fda9413f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:02.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.485+0000 7fda92a00640 1 --2- 172.21.15.152:0/787945100 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fda940b5300 0x7fda940ad010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:02.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.485+0000 7fda93e00640 1 -- 172.21.15.152:0/787945100 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fda9406c930 msgr2=0x7fda9413f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:02.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.485+0000 7fda93e00640 1 --2- 172.21.15.152:0/787945100 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fda9406c930 0x7fda9413f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:02.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.485+0000 7fda93e00640 1 -- 172.21.15.152:0/787945100 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fda940b5300 msgr2=0x7fda940ad010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:02.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.485+0000 7fda93e00640 1 --2- 172.21.15.152:0/787945100 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fda940b5300 0x7fda940ad010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:02.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.485+0000 7fda93e00640 1 -- 172.21.15.152:0/787945100 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda9413f710 con 0x7fda94145b40 2024-04-17T08:48:02.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.485+0000 7fda93e00640 1 --2- 172.21.15.152:0/787945100 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda94145b40 0x7fda9406e750 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fda8c00ced0 tx=0x7fda8c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:48:02.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.485+0000 7fda8b400640 1 -- 172.21.15.152:0/787945100 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda8c003ba0 con 0x7fda94145b40 2024-04-17T08:48:02.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.485+0000 7fda8b400640 1 -- 172.21.15.152:0/787945100 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda8c003d60 con 0x7fda94145b40 2024-04-17T08:48:02.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.485+0000 7fda8b400640 1 -- 172.21.15.152:0/787945100 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda8c00d880 con 0x7fda94145b40 2024-04-17T08:48:02.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.485+0000 7fda98e00640 1 -- 172.21.15.152:0/787945100 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda940a9500 con 0x7fda94145b40 2024-04-17T08:48:02.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.485+0000 7fda98e00640 1 -- 172.21.15.152:0/787945100 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda940a9ac0 con 0x7fda94145b40 2024-04-17T08:48:02.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.485+0000 7fda98e00640 1 -- 172.21.15.152:0/787945100 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda94075be0 con 0x7fda94145b40 2024-04-17T08:48:02.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.489+0000 7fda8b400640 1 -- 172.21.15.152:0/787945100 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fda8c00da20 con 0x7fda94145b40 2024-04-17T08:48:02.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.489+0000 7fda8b400640 1 --2- 172.21.15.152:0/787945100 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fda74068380 0x7fda7406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:02.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.489+0000 7fda8b400640 1 -- 172.21.15.152:0/787945100 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fda8c0875e0 con 0x7fda94145b40 2024-04-17T08:48:02.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.489+0000 7fda93400640 1 --2- 172.21.15.152:0/787945100 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fda74068380 0x7fda7406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:02.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.489+0000 7fda93400640 1 --2- 172.21.15.152:0/787945100 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fda74068380 0x7fda7406a840 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fda840ae000 tx=0x7fda84008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:48:02.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.493+0000 7fda8b400640 1 -- 172.21.15.152:0/787945100 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fda8c057a30 con 0x7fda94145b40 2024-04-17T08:48:02.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:02.685+0000 7fda98e00640 1 -- 172.21.15.152:0/787945100 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fda940d0f20 con 0x7fda94145b40 2024-04-17T08:48:03.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.309+0000 7fda8b400640 1 -- 172.21.15.152:0/787945100 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7fda8c057330 con 0x7fda94145b40 2024-04-17T08:48:03.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.309+0000 7fda98e00640 1 -- 172.21.15.152:0/787945100 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fda74068380 msgr2=0x7fda7406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:03.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.309+0000 7fda98e00640 1 --2- 172.21.15.152:0/787945100 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fda74068380 0x7fda7406a840 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fda840ae000 tx=0x7fda84008040 comp rx=0 tx=0).stop 2024-04-17T08:48:03.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.309+0000 7fda98e00640 1 -- 172.21.15.152:0/787945100 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda94145b40 msgr2=0x7fda9406e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:03.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.309+0000 7fda98e00640 1 --2- 172.21.15.152:0/787945100 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda94145b40 0x7fda9406e750 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fda8c00ced0 tx=0x7fda8c00a710 comp rx=0 tx=0).stop 2024-04-17T08:48:03.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.313+0000 7fda98e00640 1 -- 172.21.15.152:0/787945100 shutdown_connections 2024-04-17T08:48:03.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.313+0000 7fda98e00640 1 --2- 172.21.15.152:0/787945100 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda94145b40 0x7fda9406e750 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:03.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.313+0000 7fda98e00640 1 --2- 172.21.15.152:0/787945100 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fda940b5300 0x7fda940ad010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:03.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.313+0000 7fda98e00640 1 --2- 172.21.15.152:0/787945100 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fda74068380 0x7fda7406a840 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:03.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.313+0000 7fda98e00640 1 --2- 172.21.15.152:0/787945100 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fda9406c930 0x7fda9413f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:03.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.313+0000 7fda98e00640 1 -- 172.21.15.152:0/787945100 >> 172.21.15.152:0/787945100 conn(0x7fda94072ad0 msgr2=0x7fda941615d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:48:03.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.313+0000 7fda98e00640 1 -- 172.21.15.152:0/787945100 shutdown_connections 2024-04-17T08:48:03.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.313+0000 7fda98e00640 1 -- 172.21.15.152:0/787945100 wait complete. 2024-04-17T08:48:03.334 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-17T08:48:03.334 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T08:48:03.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.469+0000 7fe3b9200640 1 Processor -- start 2024-04-17T08:48:03.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.469+0000 7fe3b9200640 1 -- start start 2024-04-17T08:48:03.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.469+0000 7fe3b9200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe3b4147f70 0x7fe3b4071790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:03.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.469+0000 7fe3b9200640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3b406db40 con 0x7fe3b4071cd0 2024-04-17T08:48:03.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.469+0000 7fe3b9200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3b406de20 con 0x7fe3b40d1d00 2024-04-17T08:48:03.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.469+0000 7fe3b9200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fe3b406e100 con 0x7fe3b4147f70 2024-04-17T08:48:03.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.469+0000 7fe3b2800640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fe3b4071cd0 0x7fe3b40d0250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:33330/0 (socket says 172.21.15.152:33330) 2024-04-17T08:48:03.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.469+0000 7fe3b2800640 1 -- 172.21.15.152:0/2851648510 learned_addr learned my addr 172.21.15.152:0/2851648510 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:48:03.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.469+0000 7fe3a9400640 1 --2- 172.21.15.152:0/2851648510 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe3b4147f70 0x7fe3b4071790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:03.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.469+0000 7fe3b1400640 1 -- 172.21.15.152:0/2851648510 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3811283236 0 0) 0x7fe3b406db40 con 0x7fe3b4071cd0 2024-04-17T08:48:03.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.469+0000 7fe3b1400640 1 -- 172.21.15.152:0/2851648510 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe398003530 con 0x7fe3b4071cd0 2024-04-17T08:48:03.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.469+0000 7fe3b1400640 1 -- 172.21.15.152:0/2851648510 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4065244865 0 0) 0x7fe3b406de20 con 0x7fe3b40d1d00 2024-04-17T08:48:03.474 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.469+0000 7fe3b1400640 1 -- 172.21.15.152:0/2851648510 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3b406db40 con 0x7fe3b40d1d00 2024-04-17T08:48:03.474 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.469+0000 7fe3a9400640 1 -- 172.21.15.152:0/2851648510 >> v1:172.21.15.196:6789/0 conn(0x7fe3b40d1d00 legacy=0x7fe3b406d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:03.474 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.469+0000 7fe3a9400640 1 -- 172.21.15.152:0/2851648510 >> v1:172.21.15.152:6789/0 conn(0x7fe3b4071cd0 legacy=0x7fe3b40d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:03.474 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.469+0000 7fe3b1400640 1 -- 172.21.15.152:0/2851648510 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1522922042 0 0) 0x7fe398003530 con 0x7fe3b4071cd0 2024-04-17T08:48:03.474 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.469+0000 7fe3a9400640 1 -- 172.21.15.152:0/2851648510 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3b406e3e0 con 0x7fe3b4147f70 2024-04-17T08:48:03.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.473+0000 7fe3a9400640 1 --2- 172.21.15.152:0/2851648510 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe3b4147f70 0x7fe3b4071790 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe39c0097f0 tx=0x7fe39c01c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a7ef5c0a075299f server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:48:03.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.473+0000 7fe3b1400640 1 -- 172.21.15.152:0/2851648510 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39c0b0070 con 0x7fe3b4147f70 2024-04-17T08:48:03.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.473+0000 7fe3b1400640 1 -- 172.21.15.152:0/2851648510 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe39c0ab400 con 0x7fe3b4147f70 2024-04-17T08:48:03.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.473+0000 7fe3b1400640 1 -- 172.21.15.152:0/2851648510 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac001a00 con 0x7fe3b4147f70 2024-04-17T08:48:03.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.473+0000 7fe3b9200640 1 -- 172.21.15.152:0/2851648510 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe3b4147f70 msgr2=0x7fe3b4071790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:03.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.473+0000 7fe3b9200640 1 --2- 172.21.15.152:0/2851648510 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe3b4147f70 0x7fe3b4071790 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe39c0097f0 tx=0x7fe39c01c400 comp rx=0 tx=0).stop 2024-04-17T08:48:03.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.473+0000 7fe3b9200640 1 -- 172.21.15.152:0/2851648510 shutdown_connections 2024-04-17T08:48:03.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.473+0000 7fe3b9200640 1 --2- 172.21.15.152:0/2851648510 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe3b4147f70 0x7fe3b4071790 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:03.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.473+0000 7fe3b9200640 1 -- 172.21.15.152:0/2851648510 >> 172.21.15.152:0/2851648510 conn(0x7fe3b40d2350 msgr2=0x7fe3b40d2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:48:03.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.473+0000 7fe3b9200640 1 -- 172.21.15.152:0/2851648510 shutdown_connections 2024-04-17T08:48:03.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.473+0000 7fe3b9200640 1 -- 172.21.15.152:0/2851648510 wait complete. 2024-04-17T08:48:03.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.477+0000 7fe3b9200640 1 Processor -- start 2024-04-17T08:48:03.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.477+0000 7fe3b9200640 1 -- start start 2024-04-17T08:48:03.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.477+0000 7fe3b9200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe3b4071cd0 0x7fe3b4140060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:03.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.477+0000 7fe3b9200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3b40d1d00 0x7fe3b415ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:03.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.477+0000 7fe3b9200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe3b4147f70 0x7fe3b4161380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:03.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.477+0000 7fe3b9200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe3b416c890 con 0x7fe3b40d1d00 2024-04-17T08:48:03.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.477+0000 7fe3b9200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe3b416c710 con 0x7fe3b4147f70 2024-04-17T08:48:03.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.477+0000 7fe3b9200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fe3b416ca10 con 0x7fe3b4071cd0 2024-04-17T08:48:03.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.477+0000 7fe3a9400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3b40d1d00 0x7fe3b415ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:03.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.477+0000 7fe3a9400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3b40d1d00 0x7fe3b415ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51896/0 (socket says 172.21.15.152:51896) 2024-04-17T08:48:03.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.477+0000 7fe3a9400640 1 -- 172.21.15.152:0/3595587264 learned_addr learned my addr 172.21.15.152:0/3595587264 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:48:03.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.477+0000 7fe3a9400640 1 -- 172.21.15.152:0/3595587264 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe3b4071cd0 msgr2=0x7fe3b4140060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:03.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.477+0000 7fe3a9400640 1 --2- 172.21.15.152:0/3595587264 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe3b4071cd0 0x7fe3b4140060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:03.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.477+0000 7fe3a9400640 1 -- 172.21.15.152:0/3595587264 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe3b4147f70 msgr2=0x7fe3b4161380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:03.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.477+0000 7fe3b2800640 1 --2- 172.21.15.152:0/3595587264 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe3b4147f70 0x7fe3b4161380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:03.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.477+0000 7fe3a9400640 1 --2- 172.21.15.152:0/3595587264 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe3b4147f70 0x7fe3b4161380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:03.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.477+0000 7fe3a9400640 1 -- 172.21.15.152:0/3595587264 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3b41405a0 con 0x7fe3b40d1d00 2024-04-17T08:48:03.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.477+0000 7fe3b2800640 1 --2- 172.21.15.152:0/3595587264 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe3b4147f70 0x7fe3b4161380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:48:03.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.477+0000 7fe3a9400640 1 --2- 172.21.15.152:0/3595587264 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3b40d1d00 0x7fe3b415ed00 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fe39c0097f0 tx=0x7fe39c0191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:48:03.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.477+0000 7fe3aaa00640 1 -- 172.21.15.152:0/3595587264 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39c0b0040 con 0x7fe3b40d1d00 2024-04-17T08:48:03.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.477+0000 7fe3aaa00640 1 -- 172.21.15.152:0/3595587264 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe39c0abc90 con 0x7fe3b40d1d00 2024-04-17T08:48:03.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.477+0000 7fe3aaa00640 1 -- 172.21.15.152:0/3595587264 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39c004220 con 0x7fe3b40d1d00 2024-04-17T08:48:03.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.477+0000 7fe3b9200640 1 -- 172.21.15.152:0/3595587264 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3b415f550 con 0x7fe3b40d1d00 2024-04-17T08:48:03.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.477+0000 7fe3b9200640 1 -- 172.21.15.152:0/3595587264 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3b415fb10 con 0x7fe3b40d1d00 2024-04-17T08:48:03.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.481+0000 7fe3b9200640 1 -- 172.21.15.152:0/3595587264 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3b4068a30 con 0x7fe3b40d1d00 2024-04-17T08:48:03.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.481+0000 7fe3aaa00640 1 -- 172.21.15.152:0/3595587264 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe39c0bd020 con 0x7fe3b40d1d00 2024-04-17T08:48:03.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.481+0000 7fe3aaa00640 1 --2- 172.21.15.152:0/3595587264 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fe390068380 0x7fe39006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:03.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.481+0000 7fe3aaa00640 1 -- 172.21.15.152:0/3595587264 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fe39c120070 con 0x7fe3b40d1d00 2024-04-17T08:48:03.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.481+0000 7fe3b1e00640 1 --2- 172.21.15.152:0/3595587264 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fe390068380 0x7fe39006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:03.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.481+0000 7fe3b1e00640 1 --2- 172.21.15.152:0/3595587264 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fe390068380 0x7fe39006a840 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe3a4007fd0 tx=0x7fe3a4007900 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:48:03.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.485+0000 7fe3aaa00640 1 -- 172.21.15.152:0/3595587264 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fe39c015ff0 con 0x7fe3b40d1d00 2024-04-17T08:48:03.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.673+0000 7fe3b9200640 1 -- 172.21.15.152:0/3595587264 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe3b40b3690 con 0x7fe3b40d1d00 2024-04-17T08:48:03.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.673+0000 7fe3aaa00640 1 -- 172.21.15.152:0/3595587264 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5211 (secure 0 0 0) 0x7fe39c0f0400 con 0x7fe3b40d1d00 2024-04-17T08:48:03.677 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:48:03.677 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4973,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6835/1356093111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6833","nonce":1356093111},{"type":"v1","addr":"172.21.15.196:6835","nonce":1356093111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4982,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1048040532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1048040532},{"type":"v1","addr":"172.21.15.152:6837","nonce":1048040532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5275,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6834/2151645018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":2151645018},{"type":"v1","addr":"172.21.15.196:6834","nonce":2151645018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-17T08:47:59.653400+0000","modified":"2024-04-17T08:48:02.688952+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5508":{"gid":5508,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6835/4144515289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":4144515289},{"type":"v1","addr":"172.21.15.152:6835","nonce":4144515289}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5508,"qdb_cluster":[5508]},"id":2}]} 2024-04-17T08:48:03.677 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 18 2024-04-17T08:48:03.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.677+0000 7fe3b9200640 1 -- 172.21.15.152:0/3595587264 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fe390068380 msgr2=0x7fe39006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:03.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.677+0000 7fe3b9200640 1 --2- 172.21.15.152:0/3595587264 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fe390068380 0x7fe39006a840 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe3a4007fd0 tx=0x7fe3a4007900 comp rx=0 tx=0).stop 2024-04-17T08:48:03.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.677+0000 7fe3b9200640 1 -- 172.21.15.152:0/3595587264 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3b40d1d00 msgr2=0x7fe3b415ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:03.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.677+0000 7fe3b9200640 1 --2- 172.21.15.152:0/3595587264 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3b40d1d00 0x7fe3b415ed00 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fe39c0097f0 tx=0x7fe39c0191a0 comp rx=0 tx=0).stop 2024-04-17T08:48:03.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.677+0000 7fe3b9200640 1 -- 172.21.15.152:0/3595587264 shutdown_connections 2024-04-17T08:48:03.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.677+0000 7fe3b9200640 1 --2- 172.21.15.152:0/3595587264 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe3b4147f70 0x7fe3b4161380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:03.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.677+0000 7fe3b9200640 1 --2- 172.21.15.152:0/3595587264 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3b40d1d00 0x7fe3b415ed00 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:03.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.677+0000 7fe3b9200640 1 --2- 172.21.15.152:0/3595587264 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fe390068380 0x7fe39006a840 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:03.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.677+0000 7fe3b9200640 1 --2- 172.21.15.152:0/3595587264 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe3b4071cd0 0x7fe3b4140060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:03.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.677+0000 7fe3b9200640 1 -- 172.21.15.152:0/3595587264 >> 172.21.15.152:0/3595587264 conn(0x7fe3b40d2350 msgr2=0x7fe3b41430c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:48:03.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.677+0000 7fe3b9200640 1 -- 172.21.15.152:0/3595587264 shutdown_connections 2024-04-17T08:48:03.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.677+0000 7fe3b9200640 1 -- 172.21.15.152:0/3595587264 wait complete. 2024-04-17T08:48:03.698 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T08:48:03.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.829+0000 7fe46c200640 1 Processor -- start 2024-04-17T08:48:03.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.829+0000 7fe46c200640 1 -- start start 2024-04-17T08:48:03.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.833+0000 7fe46c200640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fe4640af670 0x7fe46415b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:03.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.833+0000 7fe46c200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fe4640d0360 0x7fe4640d07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:03.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.833+0000 7fe46c200640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe464072c40 con 0x7fe46406f980 2024-04-17T08:48:03.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.833+0000 7fe46c200640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fe4640d0cf0 con 0x7fe4640af670 2024-04-17T08:48:03.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.833+0000 7fe46c200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fe46415c820 con 0x7fe4640d0360 2024-04-17T08:48:03.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.833+0000 7fe469800640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fe4640af670 0x7fe46415b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:03.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.833+0000 7fe468e00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fe46406f980 0x7fe464072530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:33346/0 (socket says 172.21.15.152:33346) 2024-04-17T08:48:03.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.833+0000 7fe468e00640 1 -- 172.21.15.152:0/2794956634 learned_addr learned my addr 172.21.15.152:0/2794956634 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:48:03.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.833+0000 7fe46a200640 1 --2- 172.21.15.152:0/2794956634 >> v2:172.21.15.196:3300/0 conn(0x7fe4640d0360 0x7fe4640d07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:03.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.833+0000 7fe469800640 1 -- 172.21.15.152:0/2794956634 >> v2:172.21.15.196:3300/0 conn(0x7fe4640d0360 msgr2=0x7fe4640d07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:48:03.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.833+0000 7fe469800640 1 --2- 172.21.15.152:0/2794956634 >> v2:172.21.15.196:3300/0 conn(0x7fe4640d0360 0x7fe4640d07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:03.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.833+0000 7fe469800640 1 -- 172.21.15.152:0/2794956634 >> v1:172.21.15.152:6789/0 conn(0x7fe46406f980 legacy=0x7fe464072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:03.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.833+0000 7fe469800640 1 -- 172.21.15.152:0/2794956634 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe46415c260 con 0x7fe4640af670 2024-04-17T08:48:03.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.833+0000 7fe463e00640 1 -- 172.21.15.152:0/2794956634 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 204991815 0 0) 0x7fe464072c40 con 0x7fe46406f980 2024-04-17T08:48:03.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.833+0000 7fe46a200640 1 --2- 172.21.15.152:0/2794956634 >> v2:172.21.15.196:3300/0 conn(0x7fe4640d0360 0x7fe4640d07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:48:03.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.837+0000 7fe469800640 1 --2- 172.21.15.152:0/2794956634 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4640af670 0x7fe46415b8c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fe46406d680 tx=0x7fe45801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed0cc22c8d10aba7 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:48:03.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.837+0000 7fe463e00640 1 -- 172.21.15.152:0/2794956634 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4580b1070 con 0x7fe4640af670 2024-04-17T08:48:03.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.837+0000 7fe463e00640 1 -- 172.21.15.152:0/2794956634 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4580ac620 con 0x7fe4640af670 2024-04-17T08:48:03.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.837+0000 7fe463e00640 1 -- 172.21.15.152:0/2794956634 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4580ac9f0 con 0x7fe4640af670 2024-04-17T08:48:03.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.837+0000 7fe46c200640 1 -- 172.21.15.152:0/2794956634 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4640af670 msgr2=0x7fe46415b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:03.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.837+0000 7fe46c200640 1 --2- 172.21.15.152:0/2794956634 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4640af670 0x7fe46415b8c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fe46406d680 tx=0x7fe45801c3c0 comp rx=0 tx=0).stop 2024-04-17T08:48:03.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.837+0000 7fe46c200640 1 -- 172.21.15.152:0/2794956634 shutdown_connections 2024-04-17T08:48:03.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.837+0000 7fe46c200640 1 --2- 172.21.15.152:0/2794956634 >> v2:172.21.15.196:3300/0 conn(0x7fe4640d0360 0x7fe4640d07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:03.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.837+0000 7fe46c200640 1 --2- 172.21.15.152:0/2794956634 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4640af670 0x7fe46415b8c0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:03.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.837+0000 7fe46c200640 1 -- 172.21.15.152:0/2794956634 >> 172.21.15.152:0/2794956634 conn(0x7fe4640b3350 msgr2=0x7fe4640b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:48:03.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.837+0000 7fe46c200640 1 -- 172.21.15.152:0/2794956634 shutdown_connections 2024-04-17T08:48:03.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.837+0000 7fe46c200640 1 -- 172.21.15.152:0/2794956634 wait complete. 2024-04-17T08:48:03.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.837+0000 7fe46c200640 1 Processor -- start 2024-04-17T08:48:03.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.837+0000 7fe46c200640 1 -- start start 2024-04-17T08:48:03.842 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.837+0000 7fe46c200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe46406f980 0x7fe464150300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:03.842 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.837+0000 7fe46c200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe4640af670 0x7fe4640b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:03.842 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.837+0000 7fe46c200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4640d0360 0x7fe4640b2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:03.842 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.837+0000 7fe46c200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe46415be00 con 0x7fe4640d0360 2024-04-17T08:48:03.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.837+0000 7fe46c200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe4640afa50 con 0x7fe46406f980 2024-04-17T08:48:03.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.837+0000 7fe46c200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fe46415bf80 con 0x7fe4640af670 2024-04-17T08:48:03.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.837+0000 7fe46a200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4640d0360 0x7fe4640b2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:03.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.837+0000 7fe46a200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4640d0360 0x7fe4640b2110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51906/0 (socket says 172.21.15.152:51906) 2024-04-17T08:48:03.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.837+0000 7fe46a200640 1 -- 172.21.15.152:0/3417691880 learned_addr learned my addr 172.21.15.152:0/3417691880 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:48:03.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.837+0000 7fe468e00640 1 --2- 172.21.15.152:0/3417691880 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe4640af670 0x7fe4640b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:03.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.837+0000 7fe469800640 1 --2- 172.21.15.152:0/3417691880 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe46406f980 0x7fe464150300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:03.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.841+0000 7fe46a200640 1 -- 172.21.15.152:0/3417691880 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe4640af670 msgr2=0x7fe4640b1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:03.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.841+0000 7fe46a200640 1 --2- 172.21.15.152:0/3417691880 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe4640af670 0x7fe4640b1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:03.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.841+0000 7fe46a200640 1 -- 172.21.15.152:0/3417691880 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe46406f980 msgr2=0x7fe464150300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:03.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.841+0000 7fe46a200640 1 --2- 172.21.15.152:0/3417691880 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe46406f980 0x7fe464150300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:03.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.841+0000 7fe46a200640 1 -- 172.21.15.152:0/3417691880 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4640b0ae0 con 0x7fe4640d0360 2024-04-17T08:48:03.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.841+0000 7fe46a200640 1 --2- 172.21.15.152:0/3417691880 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4640d0360 0x7fe4640b2110 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fe45c007e70 tx=0x7fe45c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:48:03.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.841+0000 7fe461600640 1 -- 172.21.15.152:0/3417691880 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe45c01a070 con 0x7fe4640d0360 2024-04-17T08:48:03.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.841+0000 7fe461600640 1 -- 172.21.15.152:0/3417691880 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe45c003bc0 con 0x7fe4640d0360 2024-04-17T08:48:03.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.841+0000 7fe461600640 1 -- 172.21.15.152:0/3417691880 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe45c004030 con 0x7fe4640d0360 2024-04-17T08:48:03.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.841+0000 7fe46c200640 1 -- 172.21.15.152:0/3417691880 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4640b0dc0 con 0x7fe4640d0360 2024-04-17T08:48:03.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.841+0000 7fe46c200640 1 -- 172.21.15.152:0/3417691880 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe464150840 con 0x7fe4640d0360 2024-04-17T08:48:03.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.841+0000 7fe46c200640 1 -- 172.21.15.152:0/3417691880 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe464068a30 con 0x7fe4640d0360 2024-04-17T08:48:03.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.841+0000 7fe461600640 1 -- 172.21.15.152:0/3417691880 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe45c01d070 con 0x7fe4640d0360 2024-04-17T08:48:03.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.841+0000 7fe461600640 1 --2- 172.21.15.152:0/3417691880 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fe444068380 0x7fe44406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:03.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.841+0000 7fe461600640 1 -- 172.21.15.152:0/3417691880 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fe45c086da0 con 0x7fe4640d0360 2024-04-17T08:48:03.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.841+0000 7fe469800640 1 --2- 172.21.15.152:0/3417691880 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fe444068380 0x7fe44406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:03.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.845+0000 7fe469800640 1 --2- 172.21.15.152:0/3417691880 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fe444068380 0x7fe44406a840 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe4580ae000 tx=0x7fe458008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:48:03.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:03.845+0000 7fe461600640 1 -- 172.21.15.152:0/3417691880 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fe45c010070 con 0x7fe4640d0360 2024-04-17T08:48:04.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.005+0000 7fe46c200640 1 -- 172.21.15.152:0/3417691880 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe4640aeb70 con 0x7fe4640d0360 2024-04-17T08:48:04.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.009+0000 7fe461600640 1 -- 172.21.15.152:0/3417691880 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+16966 (secure 0 0 0) 0x7fe45c056ae0 con 0x7fe4640d0360 2024-04-17T08:48:04.010 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:48:04.010 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":38,"fsid":"ce68f82e-ec5f-4205-9fd5-bdfdf6ef31e2","created":"2024-04-17T08:46:08.353546+0000","modified":"2024-04-17T08:48:01.277574+0000","last_up_change":"2024-04-17T08:46:20.738799+0000","last_in_change":"2024-04-17T08:46:11.210050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T08:46:21.386856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-17T08:47:58.148039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-17T08:47:58.612261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"682f0192-187c-404e-bc7a-b6b4e23825e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6819","nonce":3603799291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6823","nonce":3603799291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6831","nonce":3603799291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6827","nonce":3603799291}]},"public_addr":"172.21.15.152:6819/3603799291","cluster_addr":"172.21.15.152:6823/3603799291","heartbeat_back_addr":"172.21.15.152:6831/3603799291","heartbeat_front_addr":"172.21.15.152:6827/3603799291","state":["exists","up"]},{"osd":1,"uuid":"f0fe8fef-60ec-4a39-83b6-2fa6a5adb0f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6801","nonce":4133383142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6803","nonce":4133383142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6807","nonce":4133383142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6805","nonce":4133383142}]},"public_addr":"172.21.15.152:6801/4133383142","cluster_addr":"172.21.15.152:6803/4133383142","heartbeat_back_addr":"172.21.15.152:6807/4133383142","heartbeat_front_addr":"172.21.15.152:6805/4133383142","state":["exists","up"]},{"osd":2,"uuid":"35f36d9c-5245-4431-a618-f4df0fa380ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6809","nonce":3826143898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6811","nonce":3826143898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6815","nonce":3826143898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6813","nonce":3826143898}]},"public_addr":"172.21.15.152:6809/3826143898","cluster_addr":"172.21.15.152:6811/3826143898","heartbeat_back_addr":"172.21.15.152:6815/3826143898","heartbeat_front_addr":"172.21.15.152:6813/3826143898","state":["exists","up"]},{"osd":3,"uuid":"96e56ca5-15b4-4895-9b79-da2c92043159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6818","nonce":165717826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6822","nonce":165717826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6830","nonce":165717826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6826","nonce":165717826}]},"public_addr":"172.21.15.152:6818/165717826","cluster_addr":"172.21.15.152:6822/165717826","heartbeat_back_addr":"172.21.15.152:6830/165717826","heartbeat_front_addr":"172.21.15.152:6826/165717826","state":["exists","up"]},{"osd":4,"uuid":"f5aa10a4-9ff9-41fe-a5c9-15326f982cc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6817","nonce":4080159297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6819","nonce":4080159297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6823","nonce":4080159297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6821","nonce":4080159297}]},"public_addr":"172.21.15.196:6817/4080159297","cluster_addr":"172.21.15.196:6819/4080159297","heartbeat_back_addr":"172.21.15.196:6823/4080159297","heartbeat_front_addr":"172.21.15.196:6821/4080159297","state":["exists","up"]},{"osd":5,"uuid":"42bab884-3476-47ae-ac65-935fa6e0f055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6801","nonce":3519444232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6803","nonce":3519444232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6807","nonce":3519444232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6805","nonce":3519444232}]},"public_addr":"172.21.15.196:6801/3519444232","cluster_addr":"172.21.15.196:6803/3519444232","heartbeat_back_addr":"172.21.15.196:6807/3519444232","heartbeat_front_addr":"172.21.15.196:6805/3519444232","state":["exists","up"]},{"osd":6,"uuid":"460b6167-f57b-4224-9c92-cfc9b80bbe99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6809","nonce":275739834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6811","nonce":275739834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6815","nonce":275739834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6813","nonce":275739834}]},"public_addr":"172.21.15.196:6809/275739834","cluster_addr":"172.21.15.196:6811/275739834","heartbeat_back_addr":"172.21.15.196:6815/275739834","heartbeat_front_addr":"172.21.15.196:6813/275739834","state":["exists","up"]},{"osd":7,"uuid":"d695643f-5e07-4e2a-a646-c06bd97b6650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6825","nonce":307626968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6827","nonce":307626968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6831","nonce":307626968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6829","nonce":307626968}]},"public_addr":"172.21.15.196:6825/307626968","cluster_addr":"172.21.15.196:6827/307626968","heartbeat_back_addr":"172.21.15.196:6831/307626968","heartbeat_front_addr":"172.21.15.196:6829/307626968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.293257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.964533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.248895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.010000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.832554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.743704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930171+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930962+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T08:48:04.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.009+0000 7fe46c200640 1 -- 172.21.15.152:0/3417691880 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fe444068380 msgr2=0x7fe44406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:04.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.009+0000 7fe46c200640 1 --2- 172.21.15.152:0/3417691880 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fe444068380 0x7fe44406a840 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe4580ae000 tx=0x7fe458008040 comp rx=0 tx=0).stop 2024-04-17T08:48:04.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.009+0000 7fe46c200640 1 -- 172.21.15.152:0/3417691880 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4640d0360 msgr2=0x7fe4640b2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:04.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.009+0000 7fe46c200640 1 --2- 172.21.15.152:0/3417691880 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4640d0360 0x7fe4640b2110 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fe45c007e70 tx=0x7fe45c00d4a0 comp rx=0 tx=0).stop 2024-04-17T08:48:04.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.009+0000 7fe46c200640 1 -- 172.21.15.152:0/3417691880 shutdown_connections 2024-04-17T08:48:04.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.009+0000 7fe46c200640 1 --2- 172.21.15.152:0/3417691880 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4640d0360 0x7fe4640b2110 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:04.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.009+0000 7fe46c200640 1 --2- 172.21.15.152:0/3417691880 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fe444068380 0x7fe44406a840 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:04.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.009+0000 7fe46c200640 1 --2- 172.21.15.152:0/3417691880 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe4640af670 0x7fe4640b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:04.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.009+0000 7fe46c200640 1 --2- 172.21.15.152:0/3417691880 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe46406f980 0x7fe464150300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:04.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.009+0000 7fe46c200640 1 -- 172.21.15.152:0/3417691880 >> 172.21.15.152:0/3417691880 conn(0x7fe4640b3350 msgr2=0x7fe4641658b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:48:04.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.009+0000 7fe46c200640 1 -- 172.21.15.152:0/3417691880 shutdown_connections 2024-04-17T08:48:04.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.009+0000 7fe46c200640 1 -- 172.21.15.152:0/3417691880 wait complete. 2024-04-17T08:48:04.032 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-17T08:48:04.032 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T08:48:04.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.165+0000 7f84af400640 1 Processor -- start 2024-04-17T08:48:04.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.165+0000 7f84af400640 1 -- start start 2024-04-17T08:48:04.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.165+0000 7f84af400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f84a80d07c0 0x7f84a80adae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:04.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.165+0000 7f84af400640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84a806e6b0 con 0x7f84a8161b70 2024-04-17T08:48:04.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.165+0000 7f84af400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84a806e990 con 0x7f84a80d0360 2024-04-17T08:48:04.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.165+0000 7f84af400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f84a8161f50 con 0x7f84a80d07c0 2024-04-17T08:48:04.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.165+0000 7f84aca00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f84a8161b70 0x7f84a806dc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:33358/0 (socket says 172.21.15.152:33358) 2024-04-17T08:48:04.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.165+0000 7f84aca00640 1 -- 172.21.15.152:0/2641606853 learned_addr learned my addr 172.21.15.152:0/2641606853 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:48:04.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.165+0000 7f84a7e00640 1 -- 172.21.15.152:0/2641606853 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1245599484 0 0) 0x7f84a806e6b0 con 0x7f84a8161b70 2024-04-17T08:48:04.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.165+0000 7f84a7e00640 1 -- 172.21.15.152:0/2641606853 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f848c003530 con 0x7f84a8161b70 2024-04-17T08:48:04.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.165+0000 7f84ad400640 1 --2- 172.21.15.152:0/2641606853 >> v2:172.21.15.196:3300/0 conn(0x7f84a80d07c0 0x7f84a80adae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:04.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.165+0000 7f84a7e00640 1 -- 172.21.15.152:0/2641606853 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 652241309 0 0) 0x7f848c003530 con 0x7f84a8161b70 2024-04-17T08:48:04.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.165+0000 7f84a7e00640 1 -- 172.21.15.152:0/2641606853 >> v2:172.21.15.196:3300/0 conn(0x7f84a80d07c0 msgr2=0x7f84a80adae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:48:04.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.165+0000 7f84a7e00640 1 --2- 172.21.15.152:0/2641606853 >> v2:172.21.15.196:3300/0 conn(0x7f84a80d07c0 0x7f84a80adae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:04.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.165+0000 7f84a7e00640 1 -- 172.21.15.152:0/2641606853 >> v1:172.21.15.196:6789/0 conn(0x7f84a80d0360 legacy=0x7f84a80ad3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:04.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.165+0000 7f84a7e00640 1 -- 172.21.15.152:0/2641606853 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84a806ec70 con 0x7f84a8161b70 2024-04-17T08:48:04.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.165+0000 7f84a7e00640 1 -- 172.21.15.152:0/2641606853 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2973887244 0 0) 0x7f8498001680 con 0x7f84a8161b70 2024-04-17T08:48:04.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.165+0000 7f84a7e00640 1 -- 172.21.15.152:0/2641606853 >> v1:172.21.15.152:6789/0 conn(0x7f84a8161b70 legacy=0x7f84a806dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:04.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.165+0000 7f84a7e00640 1 --2- 172.21.15.152:0/2641606853 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f848c0039c0 0x7f848c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:04.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.165+0000 7f84a7e00640 1 --2- 172.21.15.152:0/2641606853 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f848c004810 0x7f848c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:04.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.165+0000 7f84a7e00640 1 --2- 172.21.15.152:0/2641606853 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f848c0051d0 0x7f848c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:04.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.165+0000 7f84a7e00640 1 -- 172.21.15.152:0/2641606853 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f84a8161f50 con 0x7f848c0039c0 2024-04-17T08:48:04.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.165+0000 7f84a7e00640 1 -- 172.21.15.152:0/2641606853 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f848c00c170 con 0x7f848c004810 2024-04-17T08:48:04.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.165+0000 7f84a7e00640 1 -- 172.21.15.152:0/2641606853 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f848c00c370 con 0x7f848c0051d0 2024-04-17T08:48:04.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.165+0000 7f84aca00640 1 --2- 172.21.15.152:0/2641606853 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f848c0039c0 0x7f848c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:04.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.165+0000 7f84ad400640 1 --2- 172.21.15.152:0/2641606853 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f848c0051d0 0x7f848c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:04.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.165+0000 7f849fe00640 1 --2- 172.21.15.152:0/2641606853 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f848c004810 0x7f848c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:04.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.169+0000 7f84aca00640 1 -- 172.21.15.152:0/2641606853 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f848c0051d0 msgr2=0x7f848c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:48:04.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.169+0000 7f84aca00640 1 --2- 172.21.15.152:0/2641606853 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f848c0051d0 0x7f848c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:04.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.169+0000 7f84aca00640 1 -- 172.21.15.152:0/2641606853 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f848c004810 msgr2=0x7f848c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:48:04.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.169+0000 7f84aca00640 1 --2- 172.21.15.152:0/2641606853 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f848c004810 0x7f848c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:04.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.169+0000 7f84aca00640 1 -- 172.21.15.152:0/2641606853 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f848c003530 con 0x7f848c0039c0 2024-04-17T08:48:04.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.169+0000 7f84ad400640 1 -- 172.21.15.152:0/2641606853 reap_dead start 2024-04-17T08:48:04.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.169+0000 7f84aca00640 1 --2- 172.21.15.152:0/2641606853 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f848c0039c0 0x7f848c003de0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f849800c1c0 tx=0x7f849801cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a9213784e315bc6 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:48:04.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.169+0000 7f84a7e00640 1 -- 172.21.15.152:0/2641606853 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8498007d00 con 0x7f848c0039c0 2024-04-17T08:48:04.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.169+0000 7f84a7e00640 1 -- 172.21.15.152:0/2641606853 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84980a9020 con 0x7f848c0039c0 2024-04-17T08:48:04.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.169+0000 7f84a7e00640 1 -- 172.21.15.152:0/2641606853 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a806e470 con 0x7f848c0039c0 2024-04-17T08:48:04.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.169+0000 7f84af400640 1 -- 172.21.15.152:0/2641606853 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f848c0039c0 msgr2=0x7f848c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:04.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.169+0000 7f84af400640 1 --2- 172.21.15.152:0/2641606853 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f848c0039c0 0x7f848c003de0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f849800c1c0 tx=0x7f849801cbe0 comp rx=0 tx=0).stop 2024-04-17T08:48:04.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.169+0000 7f84af400640 1 -- 172.21.15.152:0/2641606853 shutdown_connections 2024-04-17T08:48:04.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.169+0000 7f84af400640 1 --2- 172.21.15.152:0/2641606853 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f848c0039c0 0x7f848c003de0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:04.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.169+0000 7f84af400640 1 -- 172.21.15.152:0/2641606853 >> 172.21.15.152:0/2641606853 conn(0x7f84a80b3350 msgr2=0x7f84a80b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:48:04.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.169+0000 7f84af400640 1 -- 172.21.15.152:0/2641606853 shutdown_connections 2024-04-17T08:48:04.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.169+0000 7f84af400640 1 -- 172.21.15.152:0/2641606853 wait complete. 2024-04-17T08:48:04.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.173+0000 7f84af400640 1 Processor -- start 2024-04-17T08:48:04.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.173+0000 7f84af400640 1 -- start start 2024-04-17T08:48:04.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.173+0000 7f84af400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f848c0039c0 0x7f84a809a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:04.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.173+0000 7f84af400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f84a8152bc0 0x7f84a809ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:04.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.173+0000 7f84af400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84a809b260 0x7f84a809ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:04.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.173+0000 7f84af400640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f84a806bb30 con 0x7f848c0039c0 2024-04-17T08:48:04.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.173+0000 7f84af400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f84a806b9b0 con 0x7f84a809b260 2024-04-17T08:48:04.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.173+0000 7f84af400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f84a806bcb0 con 0x7f84a8152bc0 2024-04-17T08:48:04.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.173+0000 7f84aca00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f848c0039c0 0x7f84a809a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:04.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.173+0000 7f84aca00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f848c0039c0 0x7f84a809a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51926/0 (socket says 172.21.15.152:51926) 2024-04-17T08:48:04.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.173+0000 7f84aca00640 1 -- 172.21.15.152:0/2114059184 learned_addr learned my addr 172.21.15.152:0/2114059184 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:48:04.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.173+0000 7f849fe00640 1 --2- 172.21.15.152:0/2114059184 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f84a8152bc0 0x7f84a809ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:04.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.173+0000 7f84ad400640 1 --2- 172.21.15.152:0/2114059184 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84a809b260 0x7f84a809ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:04.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.173+0000 7f84aca00640 1 -- 172.21.15.152:0/2114059184 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f84a8152bc0 msgr2=0x7f84a809ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:04.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.173+0000 7f84aca00640 1 --2- 172.21.15.152:0/2114059184 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f84a8152bc0 0x7f84a809ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:04.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.173+0000 7f84aca00640 1 -- 172.21.15.152:0/2114059184 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84a809b260 msgr2=0x7f84a809ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:04.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.173+0000 7f84aca00640 1 --2- 172.21.15.152:0/2114059184 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84a809b260 0x7f84a809ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:04.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.173+0000 7f84aca00640 1 -- 172.21.15.152:0/2114059184 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84a8154c00 con 0x7f848c0039c0 2024-04-17T08:48:04.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.173+0000 7f849fe00640 1 --2- 172.21.15.152:0/2114059184 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f84a8152bc0 0x7f84a809ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:48:04.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.173+0000 7f84aca00640 1 --2- 172.21.15.152:0/2114059184 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f848c0039c0 0x7f84a809a170 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f84980ab040 tx=0x7f848c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:48:04.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.173+0000 7f84a5600640 1 -- 172.21.15.152:0/2114059184 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84980b4070 con 0x7f848c0039c0 2024-04-17T08:48:04.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.173+0000 7f84a5600640 1 -- 172.21.15.152:0/2114059184 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8498000ee0 con 0x7f848c0039c0 2024-04-17T08:48:04.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.173+0000 7f84a5600640 1 -- 172.21.15.152:0/2114059184 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8498007d00 con 0x7f848c0039c0 2024-04-17T08:48:04.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.173+0000 7f84af400640 1 -- 172.21.15.152:0/2114059184 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84a8153860 con 0x7f848c0039c0 2024-04-17T08:48:04.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.173+0000 7f84af400640 1 -- 172.21.15.152:0/2114059184 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84a8153e20 con 0x7f848c0039c0 2024-04-17T08:48:04.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.177+0000 7f84af400640 1 -- 172.21.15.152:0/2114059184 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84a8068a30 con 0x7f848c0039c0 2024-04-17T08:48:04.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.177+0000 7f84a5600640 1 -- 172.21.15.152:0/2114059184 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f84980bf060 con 0x7f848c0039c0 2024-04-17T08:48:04.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.177+0000 7f84a5600640 1 --2- 172.21.15.152:0/2114059184 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8484068380 0x7f848406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:04.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.177+0000 7f84a5600640 1 -- 172.21.15.152:0/2114059184 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f849811f6a0 con 0x7f848c0039c0 2024-04-17T08:48:04.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.177+0000 7f849fe00640 1 --2- 172.21.15.152:0/2114059184 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8484068380 0x7f848406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:04.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.177+0000 7f849fe00640 1 --2- 172.21.15.152:0/2114059184 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8484068380 0x7f848406a840 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8490000c10 tx=0x7f8490009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:48:04.184 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.181+0000 7f84a5600640 1 -- 172.21.15.152:0/2114059184 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f84980168f0 con 0x7f848c0039c0 2024-04-17T08:48:04.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.337+0000 7f84af400640 1 -- 172.21.15.152:0/2114059184 --> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f84a809b640 con 0x7f8484068380 2024-04-17T08:48:04.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.345+0000 7f84a5600640 1 -- 172.21.15.152:0/2114059184 <== mgr.4104 v2:172.21.15.152:6832/3078522445 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251953 (secure 0 0 0) 0x7f84a809b640 con 0x7f8484068380 2024-04-17T08:48:04.350 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:48:04.351 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2024-04-17T08:48:04.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.349+0000 7f84af400640 1 -- 172.21.15.152:0/2114059184 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8484068380 msgr2=0x7f848406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:04.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.349+0000 7f84af400640 1 --2- 172.21.15.152:0/2114059184 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8484068380 0x7f848406a840 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8490000c10 tx=0x7f8490009040 comp rx=0 tx=0).stop 2024-04-17T08:48:04.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.349+0000 7f84af400640 1 -- 172.21.15.152:0/2114059184 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f848c0039c0 msgr2=0x7f84a809a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:04.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.349+0000 7f84af400640 1 --2- 172.21.15.152:0/2114059184 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f848c0039c0 0x7f84a809a170 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f84980ab040 tx=0x7f848c005840 comp rx=0 tx=0).stop 2024-04-17T08:48:04.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.349+0000 7f84af400640 1 -- 172.21.15.152:0/2114059184 shutdown_connections 2024-04-17T08:48:04.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.349+0000 7f84af400640 1 --2- 172.21.15.152:0/2114059184 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84a809b260 0x7f84a809ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:04.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.349+0000 7f84af400640 1 --2- 172.21.15.152:0/2114059184 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8484068380 0x7f848406a840 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:04.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.349+0000 7f84af400640 1 --2- 172.21.15.152:0/2114059184 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f84a8152bc0 0x7f84a809ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:04.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.349+0000 7f84af400640 1 --2- 172.21.15.152:0/2114059184 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f848c0039c0 0x7f84a809a170 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:04.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.349+0000 7f84af400640 1 -- 172.21.15.152:0/2114059184 >> 172.21.15.152:0/2114059184 conn(0x7f84a80b3350 msgr2=0x7f84a8162100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:48:04.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.349+0000 7f84af400640 1 -- 172.21.15.152:0/2114059184 shutdown_connections 2024-04-17T08:48:04.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.349+0000 7f84af400640 1 -- 172.21.15.152:0/2114059184 wait complete. 2024-04-17T08:48:04.371 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2024-04-17T08:48:03.384416+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":71,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220764,"kb_used_data":4576,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753956,"statfs":{"total":773094113280,"available":772868050944,"internally_reserved":0,"allocated":4685824,"data_stored":2666988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.123861"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.291035+0000","last_change":"2024-04-17T08:48:00.296136+0000","last_active":"2024-04-17T08:48:01.291035+0000","last_peered":"2024-04-17T08:48:01.291035+0000","last_clean":"2024-04-17T08:48:01.291035+0000","last_became_active":"2024-04-17T08:48:00.295775+0000","last_became_peered":"2024-04-17T08:48:00.295775+0000","last_unstale":"2024-04-17T08:48:01.291035+0000","last_undegraded":"2024-04-17T08:48:01.291035+0000","last_fullsized":"2024-04-17T08:48:01.291035+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:59:12.677666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290700+0000","last_change":"2024-04-17T08:48:00.297219+0000","last_active":"2024-04-17T08:48:01.290700+0000","last_peered":"2024-04-17T08:48:01.290700+0000","last_clean":"2024-04-17T08:48:01.290700+0000","last_became_active":"2024-04-17T08:48:00.296960+0000","last_became_peered":"2024-04-17T08:48:00.296960+0000","last_unstale":"2024-04-17T08:48:01.290700+0000","last_undegraded":"2024-04-17T08:48:01.290700+0000","last_fullsized":"2024-04-17T08:48:01.290700+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:33:17.929953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290776+0000","last_change":"2024-04-17T08:48:00.300669+0000","last_active":"2024-04-17T08:48:01.290776+0000","last_peered":"2024-04-17T08:48:01.290776+0000","last_clean":"2024-04-17T08:48:01.290776+0000","last_became_active":"2024-04-17T08:48:00.300406+0000","last_became_peered":"2024-04-17T08:48:00.300406+0000","last_unstale":"2024-04-17T08:48:01.290776+0000","last_undegraded":"2024-04-17T08:48:01.290776+0000","last_fullsized":"2024-04-17T08:48:01.290776+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:08:34.262167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.281784+0000","last_change":"2024-04-17T08:48:00.287907+0000","last_active":"2024-04-17T08:48:01.281784+0000","last_peered":"2024-04-17T08:48:01.281784+0000","last_clean":"2024-04-17T08:48:01.281784+0000","last_became_active":"2024-04-17T08:48:00.287651+0000","last_became_peered":"2024-04-17T08:48:00.287651+0000","last_unstale":"2024-04-17T08:48:01.281784+0000","last_undegraded":"2024-04-17T08:48:01.281784+0000","last_fullsized":"2024-04-17T08:48:01.281784+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:19.423345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.281468+0000","last_change":"2024-04-17T08:48:00.284169+0000","last_active":"2024-04-17T08:48:01.281468+0000","last_peered":"2024-04-17T08:48:01.281468+0000","last_clean":"2024-04-17T08:48:01.281468+0000","last_became_active":"2024-04-17T08:48:00.283894+0000","last_became_peered":"2024-04-17T08:48:00.283894+0000","last_unstale":"2024-04-17T08:48:01.281468+0000","last_undegraded":"2024-04-17T08:48:01.281468+0000","last_fullsized":"2024-04-17T08:48:01.281468+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:31:50.585739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.289964+0000","last_change":"2024-04-17T08:48:00.309424+0000","last_active":"2024-04-17T08:48:01.289964+0000","last_peered":"2024-04-17T08:48:01.289964+0000","last_clean":"2024-04-17T08:48:01.289964+0000","last_became_active":"2024-04-17T08:48:00.308962+0000","last_became_peered":"2024-04-17T08:48:00.308962+0000","last_unstale":"2024-04-17T08:48:01.289964+0000","last_undegraded":"2024-04-17T08:48:01.289964+0000","last_fullsized":"2024-04-17T08:48:01.289964+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:42:46.274567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.282782+0000","last_change":"2024-04-17T08:48:00.308968+0000","last_active":"2024-04-17T08:48:01.282782+0000","last_peered":"2024-04-17T08:48:01.282782+0000","last_clean":"2024-04-17T08:48:01.282782+0000","last_became_active":"2024-04-17T08:48:00.308687+0000","last_became_peered":"2024-04-17T08:48:00.308687+0000","last_unstale":"2024-04-17T08:48:01.282782+0000","last_undegraded":"2024-04-17T08:48:01.282782+0000","last_fullsized":"2024-04-17T08:48:01.282782+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:17:09.519928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.289967+0000","last_change":"2024-04-17T08:48:00.308901+0000","last_active":"2024-04-17T08:48:01.289967+0000","last_peered":"2024-04-17T08:48:01.289967+0000","last_clean":"2024-04-17T08:48:01.289967+0000","last_became_active":"2024-04-17T08:48:00.308641+0000","last_became_peered":"2024-04-17T08:48:00.308641+0000","last_unstale":"2024-04-17T08:48:01.289967+0000","last_undegraded":"2024-04-17T08:48:01.289967+0000","last_fullsized":"2024-04-17T08:48:01.289967+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:06:22.290856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.291076+0000","last_change":"2024-04-17T08:48:00.303870+0000","last_active":"2024-04-17T08:48:01.291076+0000","last_peered":"2024-04-17T08:48:01.291076+0000","last_clean":"2024-04-17T08:48:01.291076+0000","last_became_active":"2024-04-17T08:48:00.303614+0000","last_became_peered":"2024-04-17T08:48:00.303614+0000","last_unstale":"2024-04-17T08:48:01.291076+0000","last_undegraded":"2024-04-17T08:48:01.291076+0000","last_fullsized":"2024-04-17T08:48:01.291076+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:17:09.519928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.283435+0000","last_change":"2024-04-17T08:48:00.300778+0000","last_active":"2024-04-17T08:48:01.283435+0000","last_peered":"2024-04-17T08:48:01.283435+0000","last_clean":"2024-04-17T08:48:01.283435+0000","last_became_active":"2024-04-17T08:48:00.300504+0000","last_became_peered":"2024-04-17T08:48:00.300504+0000","last_unstale":"2024-04-17T08:48:01.283435+0000","last_undegraded":"2024-04-17T08:48:01.283435+0000","last_fullsized":"2024-04-17T08:48:01.283435+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:13:04.976396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.283911+0000","last_change":"2024-04-17T08:48:00.293644+0000","last_active":"2024-04-17T08:48:01.283911+0000","last_peered":"2024-04-17T08:48:01.283911+0000","last_clean":"2024-04-17T08:48:01.283911+0000","last_became_active":"2024-04-17T08:48:00.293407+0000","last_became_peered":"2024-04-17T08:48:00.293407+0000","last_unstale":"2024-04-17T08:48:01.283911+0000","last_undegraded":"2024-04-17T08:48:01.283911+0000","last_fullsized":"2024-04-17T08:48:01.283911+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:40:50.099515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290473+0000","last_change":"2024-04-17T08:48:00.299562+0000","last_active":"2024-04-17T08:48:01.290473+0000","last_peered":"2024-04-17T08:48:01.290473+0000","last_clean":"2024-04-17T08:48:01.290473+0000","last_became_active":"2024-04-17T08:48:00.299316+0000","last_became_peered":"2024-04-17T08:48:00.299316+0000","last_unstale":"2024-04-17T08:48:01.290473+0000","last_undegraded":"2024-04-17T08:48:01.290473+0000","last_fullsized":"2024-04-17T08:48:01.290473+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:46:24.401088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.283265+0000","last_change":"2024-04-17T08:48:00.300794+0000","last_active":"2024-04-17T08:48:01.283265+0000","last_peered":"2024-04-17T08:48:01.283265+0000","last_clean":"2024-04-17T08:48:01.283265+0000","last_became_active":"2024-04-17T08:48:00.300471+0000","last_became_peered":"2024-04-17T08:48:00.300471+0000","last_unstale":"2024-04-17T08:48:01.283265+0000","last_undegraded":"2024-04-17T08:48:01.283265+0000","last_fullsized":"2024-04-17T08:48:01.283265+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:25:33.780377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.284192+0000","last_change":"2024-04-17T08:48:00.297456+0000","last_active":"2024-04-17T08:48:01.284192+0000","last_peered":"2024-04-17T08:48:01.284192+0000","last_clean":"2024-04-17T08:48:01.284192+0000","last_became_active":"2024-04-17T08:48:00.297196+0000","last_became_peered":"2024-04-17T08:48:00.297196+0000","last_unstale":"2024-04-17T08:48:01.284192+0000","last_undegraded":"2024-04-17T08:48:01.284192+0000","last_fullsized":"2024-04-17T08:48:01.284192+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:42:29.371041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.282913+0000","last_change":"2024-04-17T08:48:00.300797+0000","last_active":"2024-04-17T08:48:01.282913+0000","last_peered":"2024-04-17T08:48:01.282913+0000","last_clean":"2024-04-17T08:48:01.282913+0000","last_became_active":"2024-04-17T08:48:00.300534+0000","last_became_peered":"2024-04-17T08:48:00.300534+0000","last_unstale":"2024-04-17T08:48:01.282913+0000","last_undegraded":"2024-04-17T08:48:01.282913+0000","last_fullsized":"2024-04-17T08:48:01.282913+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:05:53.196243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290061+0000","last_change":"2024-04-17T08:48:00.302491+0000","last_active":"2024-04-17T08:48:01.290061+0000","last_peered":"2024-04-17T08:48:01.290061+0000","last_clean":"2024-04-17T08:48:01.290061+0000","last_became_active":"2024-04-17T08:48:00.302250+0000","last_became_peered":"2024-04-17T08:48:00.302250+0000","last_unstale":"2024-04-17T08:48:01.290061+0000","last_undegraded":"2024-04-17T08:48:01.290061+0000","last_fullsized":"2024-04-17T08:48:01.290061+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:08:34.262167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.291267+0000","last_change":"2024-04-17T08:48:00.308164+0000","last_active":"2024-04-17T08:48:01.291267+0000","last_peered":"2024-04-17T08:48:01.291267+0000","last_clean":"2024-04-17T08:48:01.291267+0000","last_became_active":"2024-04-17T08:48:00.307930+0000","last_became_peered":"2024-04-17T08:48:00.307930+0000","last_unstale":"2024-04-17T08:48:01.291267+0000","last_undegraded":"2024-04-17T08:48:01.291267+0000","last_fullsized":"2024-04-17T08:48:01.291267+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:13:04.976396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290487+0000","last_change":"2024-04-17T08:48:00.302338+0000","last_active":"2024-04-17T08:48:01.290487+0000","last_peered":"2024-04-17T08:48:01.290487+0000","last_clean":"2024-04-17T08:48:01.290487+0000","last_became_active":"2024-04-17T08:48:00.302113+0000","last_became_peered":"2024-04-17T08:48:00.302113+0000","last_unstale":"2024-04-17T08:48:01.290487+0000","last_undegraded":"2024-04-17T08:48:01.290487+0000","last_fullsized":"2024-04-17T08:48:01.290487+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:18:25.830807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.281656+0000","last_change":"2024-04-17T08:48:00.311880+0000","last_active":"2024-04-17T08:48:01.281656+0000","last_peered":"2024-04-17T08:48:01.281656+0000","last_clean":"2024-04-17T08:48:01.281656+0000","last_became_active":"2024-04-17T08:48:00.311586+0000","last_became_peered":"2024-04-17T08:48:00.311586+0000","last_unstale":"2024-04-17T08:48:01.281656+0000","last_undegraded":"2024-04-17T08:48:01.281656+0000","last_fullsized":"2024-04-17T08:48:01.281656+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:15:23.993492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290861+0000","last_change":"2024-04-17T08:48:00.304719+0000","last_active":"2024-04-17T08:48:01.290861+0000","last_peered":"2024-04-17T08:48:01.290861+0000","last_clean":"2024-04-17T08:48:01.290861+0000","last_became_active":"2024-04-17T08:48:00.301701+0000","last_became_peered":"2024-04-17T08:48:00.301701+0000","last_unstale":"2024-04-17T08:48:01.290861+0000","last_undegraded":"2024-04-17T08:48:01.290861+0000","last_fullsized":"2024-04-17T08:48:01.290861+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:49:55.588604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.283111+0000","last_change":"2024-04-17T08:48:00.302267+0000","last_active":"2024-04-17T08:48:01.283111+0000","last_peered":"2024-04-17T08:48:01.283111+0000","last_clean":"2024-04-17T08:48:01.283111+0000","last_became_active":"2024-04-17T08:48:00.301973+0000","last_became_peered":"2024-04-17T08:48:00.301973+0000","last_unstale":"2024-04-17T08:48:01.283111+0000","last_undegraded":"2024-04-17T08:48:01.283111+0000","last_fullsized":"2024-04-17T08:48:01.283111+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:33:17.929953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.284207+0000","last_change":"2024-04-17T08:48:00.291578+0000","last_active":"2024-04-17T08:48:01.284207+0000","last_peered":"2024-04-17T08:48:01.284207+0000","last_clean":"2024-04-17T08:48:01.284207+0000","last_became_active":"2024-04-17T08:48:00.291389+0000","last_became_peered":"2024-04-17T08:48:00.291389+0000","last_unstale":"2024-04-17T08:48:01.284207+0000","last_undegraded":"2024-04-17T08:48:01.284207+0000","last_fullsized":"2024-04-17T08:48:01.284207+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:08:12.402356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290382+0000","last_change":"2024-04-17T08:48:00.313211+0000","last_active":"2024-04-17T08:48:01.290382+0000","last_peered":"2024-04-17T08:48:01.290382+0000","last_clean":"2024-04-17T08:48:01.290382+0000","last_became_active":"2024-04-17T08:48:00.312036+0000","last_became_peered":"2024-04-17T08:48:00.312036+0000","last_unstale":"2024-04-17T08:48:01.290382+0000","last_undegraded":"2024-04-17T08:48:01.290382+0000","last_fullsized":"2024-04-17T08:48:01.290382+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:05:53.196243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.281469+0000","last_change":"2024-04-17T08:48:00.300261+0000","last_active":"2024-04-17T08:48:01.281469+0000","last_peered":"2024-04-17T08:48:01.281469+0000","last_clean":"2024-04-17T08:48:01.281469+0000","last_became_active":"2024-04-17T08:48:00.299969+0000","last_became_peered":"2024-04-17T08:48:00.299969+0000","last_unstale":"2024-04-17T08:48:01.281469+0000","last_undegraded":"2024-04-17T08:48:01.281469+0000","last_fullsized":"2024-04-17T08:48:01.281469+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:42:21.783161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290489+0000","last_change":"2024-04-17T08:48:00.296539+0000","last_active":"2024-04-17T08:48:01.290489+0000","last_peered":"2024-04-17T08:48:01.290489+0000","last_clean":"2024-04-17T08:48:01.290489+0000","last_became_active":"2024-04-17T08:48:00.296222+0000","last_became_peered":"2024-04-17T08:48:00.296222+0000","last_unstale":"2024-04-17T08:48:01.290489+0000","last_undegraded":"2024-04-17T08:48:01.290489+0000","last_fullsized":"2024-04-17T08:48:01.290489+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:05:06.591646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.291466+0000","last_change":"2024-04-17T08:48:00.304372+0000","last_active":"2024-04-17T08:48:01.291466+0000","last_peered":"2024-04-17T08:48:01.291466+0000","last_clean":"2024-04-17T08:48:01.291466+0000","last_became_active":"2024-04-17T08:48:00.299874+0000","last_became_peered":"2024-04-17T08:48:00.299874+0000","last_unstale":"2024-04-17T08:48:01.291466+0000","last_undegraded":"2024-04-17T08:48:01.291466+0000","last_fullsized":"2024-04-17T08:48:01.291466+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:36:22.503040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290831+0000","last_change":"2024-04-17T08:48:00.302632+0000","last_active":"2024-04-17T08:48:01.290831+0000","last_peered":"2024-04-17T08:48:01.290831+0000","last_clean":"2024-04-17T08:48:01.290831+0000","last_became_active":"2024-04-17T08:48:00.300665+0000","last_became_peered":"2024-04-17T08:48:00.300665+0000","last_unstale":"2024-04-17T08:48:01.290831+0000","last_undegraded":"2024-04-17T08:48:01.290831+0000","last_fullsized":"2024-04-17T08:48:01.290831+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:08:12.402356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.283372+0000","last_change":"2024-04-17T08:48:00.292447+0000","last_active":"2024-04-17T08:48:01.283372+0000","last_peered":"2024-04-17T08:48:01.283372+0000","last_clean":"2024-04-17T08:48:01.283372+0000","last_became_active":"2024-04-17T08:48:00.292191+0000","last_became_peered":"2024-04-17T08:48:00.292191+0000","last_unstale":"2024-04-17T08:48:01.283372+0000","last_undegraded":"2024-04-17T08:48:01.283372+0000","last_fullsized":"2024-04-17T08:48:01.283372+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:53:43.285669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290817+0000","last_change":"2024-04-17T08:48:00.314966+0000","last_active":"2024-04-17T08:48:01.290817+0000","last_peered":"2024-04-17T08:48:01.290817+0000","last_clean":"2024-04-17T08:48:01.290817+0000","last_became_active":"2024-04-17T08:48:00.314796+0000","last_became_peered":"2024-04-17T08:48:00.314796+0000","last_unstale":"2024-04-17T08:48:01.290817+0000","last_undegraded":"2024-04-17T08:48:01.290817+0000","last_fullsized":"2024-04-17T08:48:01.290817+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:42:29.371041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290407+0000","last_change":"2024-04-17T08:48:00.312391+0000","last_active":"2024-04-17T08:48:01.290407+0000","last_peered":"2024-04-17T08:48:01.290407+0000","last_clean":"2024-04-17T08:48:01.290407+0000","last_became_active":"2024-04-17T08:48:00.312167+0000","last_became_peered":"2024-04-17T08:48:00.312167+0000","last_unstale":"2024-04-17T08:48:01.290407+0000","last_undegraded":"2024-04-17T08:48:01.290407+0000","last_fullsized":"2024-04-17T08:48:01.290407+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:46:02.314706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290503+0000","last_change":"2024-04-17T08:48:00.313800+0000","last_active":"2024-04-17T08:48:01.290503+0000","last_peered":"2024-04-17T08:48:01.290503+0000","last_clean":"2024-04-17T08:48:01.290503+0000","last_became_active":"2024-04-17T08:48:00.313553+0000","last_became_peered":"2024-04-17T08:48:00.313553+0000","last_unstale":"2024-04-17T08:48:01.290503+0000","last_undegraded":"2024-04-17T08:48:01.290503+0000","last_fullsized":"2024-04-17T08:48:01.290503+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:50:13.616793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.291183+0000","last_change":"2024-04-17T08:48:00.303057+0000","last_active":"2024-04-17T08:48:01.291183+0000","last_peered":"2024-04-17T08:48:01.291183+0000","last_clean":"2024-04-17T08:48:01.291183+0000","last_became_active":"2024-04-17T08:48:00.302779+0000","last_became_peered":"2024-04-17T08:48:00.302779+0000","last_unstale":"2024-04-17T08:48:01.291183+0000","last_undegraded":"2024-04-17T08:48:01.291183+0000","last_fullsized":"2024-04-17T08:48:01.291183+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:18:31.581220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.291132+0000","last_change":"2024-04-17T08:48:00.311499+0000","last_active":"2024-04-17T08:48:01.291132+0000","last_peered":"2024-04-17T08:48:01.291132+0000","last_clean":"2024-04-17T08:48:01.291132+0000","last_became_active":"2024-04-17T08:48:00.310906+0000","last_became_peered":"2024-04-17T08:48:00.310906+0000","last_unstale":"2024-04-17T08:48:01.291132+0000","last_undegraded":"2024-04-17T08:48:01.291132+0000","last_fullsized":"2024-04-17T08:48:01.291132+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:33:17.929953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290590+0000","last_change":"2024-04-17T08:47:59.273488+0000","last_active":"2024-04-17T08:48:01.290590+0000","last_peered":"2024-04-17T08:48:01.290590+0000","last_clean":"2024-04-17T08:48:01.290590+0000","last_became_active":"2024-04-17T08:47:59.273172+0000","last_became_peered":"2024-04-17T08:47:59.273172+0000","last_unstale":"2024-04-17T08:48:01.290590+0000","last_undegraded":"2024-04-17T08:48:01.290590+0000","last_fullsized":"2024-04-17T08:48:01.290590+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:21:37.151671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.291624+0000","last_change":"2024-04-17T08:48:00.308279+0000","last_active":"2024-04-17T08:48:01.291624+0000","last_peered":"2024-04-17T08:48:01.291624+0000","last_clean":"2024-04-17T08:48:01.291624+0000","last_became_active":"2024-04-17T08:48:00.308020+0000","last_became_peered":"2024-04-17T08:48:00.308020+0000","last_unstale":"2024-04-17T08:48:01.291624+0000","last_undegraded":"2024-04-17T08:48:01.291624+0000","last_fullsized":"2024-04-17T08:48:01.291624+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:49:08.072885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290904+0000","last_change":"2024-04-17T08:47:59.289918+0000","last_active":"2024-04-17T08:48:01.290904+0000","last_peered":"2024-04-17T08:48:01.290904+0000","last_clean":"2024-04-17T08:48:01.290904+0000","last_became_active":"2024-04-17T08:47:59.289438+0000","last_became_peered":"2024-04-17T08:47:59.289438+0000","last_unstale":"2024-04-17T08:48:01.290904+0000","last_undegraded":"2024-04-17T08:48:01.290904+0000","last_fullsized":"2024-04-17T08:48:01.290904+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:46:01.309286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.284781+0000","last_change":"2024-04-17T08:48:00.303153+0000","last_active":"2024-04-17T08:48:01.284781+0000","last_peered":"2024-04-17T08:48:01.284781+0000","last_clean":"2024-04-17T08:48:01.284781+0000","last_became_active":"2024-04-17T08:48:00.302916+0000","last_became_peered":"2024-04-17T08:48:00.302916+0000","last_unstale":"2024-04-17T08:48:01.284781+0000","last_undegraded":"2024-04-17T08:48:01.284781+0000","last_fullsized":"2024-04-17T08:48:01.284781+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:18:31.581220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.291736+0000","last_change":"2024-04-17T08:47:59.281898+0000","last_active":"2024-04-17T08:48:01.291736+0000","last_peered":"2024-04-17T08:48:01.291736+0000","last_clean":"2024-04-17T08:48:01.291736+0000","last_became_active":"2024-04-17T08:47:59.281638+0000","last_became_peered":"2024-04-17T08:47:59.281638+0000","last_unstale":"2024-04-17T08:48:01.291736+0000","last_undegraded":"2024-04-17T08:48:01.291736+0000","last_fullsized":"2024-04-17T08:48:01.291736+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:19:30.561573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290939+0000","last_change":"2024-04-17T08:48:00.310858+0000","last_active":"2024-04-17T08:48:01.290939+0000","last_peered":"2024-04-17T08:48:01.290939+0000","last_clean":"2024-04-17T08:48:01.290939+0000","last_became_active":"2024-04-17T08:48:00.310455+0000","last_became_peered":"2024-04-17T08:48:00.310455+0000","last_unstale":"2024-04-17T08:48:01.290939+0000","last_undegraded":"2024-04-17T08:48:01.290939+0000","last_fullsized":"2024-04-17T08:48:01.290939+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:13:04.976396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.284497+0000","last_change":"2024-04-17T08:47:59.283415+0000","last_active":"2024-04-17T08:48:01.284497+0000","last_peered":"2024-04-17T08:48:01.284497+0000","last_clean":"2024-04-17T08:48:01.284497+0000","last_became_active":"2024-04-17T08:47:59.282926+0000","last_became_peered":"2024-04-17T08:47:59.282926+0000","last_unstale":"2024-04-17T08:48:01.284497+0000","last_undegraded":"2024-04-17T08:48:01.284497+0000","last_fullsized":"2024-04-17T08:48:01.284497+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:21:37.151671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.289732+0000","last_change":"2024-04-17T08:48:00.314813+0000","last_active":"2024-04-17T08:48:01.289732+0000","last_peered":"2024-04-17T08:48:01.289732+0000","last_clean":"2024-04-17T08:48:01.289732+0000","last_became_active":"2024-04-17T08:48:00.314552+0000","last_became_peered":"2024-04-17T08:48:00.314552+0000","last_unstale":"2024-04-17T08:48:01.289732+0000","last_undegraded":"2024-04-17T08:48:01.289732+0000","last_fullsized":"2024-04-17T08:48:01.289732+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:18:31.581220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.283228+0000","last_change":"2024-04-17T08:47:59.281271+0000","last_active":"2024-04-17T08:48:01.283228+0000","last_peered":"2024-04-17T08:48:01.283228+0000","last_clean":"2024-04-17T08:48:01.283228+0000","last_became_active":"2024-04-17T08:47:59.280933+0000","last_became_peered":"2024-04-17T08:47:59.280933+0000","last_unstale":"2024-04-17T08:48:01.283228+0000","last_undegraded":"2024-04-17T08:48:01.283228+0000","last_fullsized":"2024-04-17T08:48:01.283228+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:46:01.309286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.282947+0000","last_change":"2024-04-17T08:48:00.307095+0000","last_active":"2024-04-17T08:48:01.282947+0000","last_peered":"2024-04-17T08:48:01.282947+0000","last_clean":"2024-04-17T08:48:01.282947+0000","last_became_active":"2024-04-17T08:48:00.306839+0000","last_became_peered":"2024-04-17T08:48:00.306839+0000","last_unstale":"2024-04-17T08:48:01.282947+0000","last_undegraded":"2024-04-17T08:48:01.282947+0000","last_fullsized":"2024-04-17T08:48:01.282947+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:50:13.616793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290178+0000","last_change":"2024-04-17T08:47:59.294329+0000","last_active":"2024-04-17T08:48:01.290178+0000","last_peered":"2024-04-17T08:48:01.290178+0000","last_clean":"2024-04-17T08:48:01.290178+0000","last_became_active":"2024-04-17T08:47:59.293957+0000","last_became_peered":"2024-04-17T08:47:59.293957+0000","last_unstale":"2024-04-17T08:48:01.290178+0000","last_undegraded":"2024-04-17T08:48:01.290178+0000","last_fullsized":"2024-04-17T08:48:01.290178+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:42:28.365621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.284455+0000","last_change":"2024-04-17T08:48:00.288119+0000","last_active":"2024-04-17T08:48:01.284455+0000","last_peered":"2024-04-17T08:48:01.284455+0000","last_clean":"2024-04-17T08:48:01.284455+0000","last_became_active":"2024-04-17T08:48:00.287825+0000","last_became_peered":"2024-04-17T08:48:00.287825+0000","last_unstale":"2024-04-17T08:48:01.284455+0000","last_undegraded":"2024-04-17T08:48:01.284455+0000","last_fullsized":"2024-04-17T08:48:01.284455+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:35:03.594399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290226+0000","last_change":"2024-04-17T08:47:59.287685+0000","last_active":"2024-04-17T08:48:01.290226+0000","last_peered":"2024-04-17T08:48:01.290226+0000","last_clean":"2024-04-17T08:48:01.290226+0000","last_became_active":"2024-04-17T08:47:59.287319+0000","last_became_peered":"2024-04-17T08:47:59.287319+0000","last_unstale":"2024-04-17T08:48:01.290226+0000","last_undegraded":"2024-04-17T08:48:01.290226+0000","last_fullsized":"2024-04-17T08:48:01.290226+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:25:16.318975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290383+0000","last_change":"2024-04-17T08:48:00.305573+0000","last_active":"2024-04-17T08:48:01.290383+0000","last_peered":"2024-04-17T08:48:01.290383+0000","last_clean":"2024-04-17T08:48:01.290383+0000","last_became_active":"2024-04-17T08:48:00.302150+0000","last_became_peered":"2024-04-17T08:48:00.302150+0000","last_unstale":"2024-04-17T08:48:01.290383+0000","last_undegraded":"2024-04-17T08:48:01.290383+0000","last_fullsized":"2024-04-17T08:48:01.290383+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:05:53.196243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.283951+0000","last_change":"2024-04-17T08:47:59.275143+0000","last_active":"2024-04-17T08:48:01.283951+0000","last_peered":"2024-04-17T08:48:01.283951+0000","last_clean":"2024-04-17T08:48:01.283951+0000","last_became_active":"2024-04-17T08:47:59.274833+0000","last_became_peered":"2024-04-17T08:47:59.274833+0000","last_unstale":"2024-04-17T08:48:01.283951+0000","last_undegraded":"2024-04-17T08:48:01.283951+0000","last_fullsized":"2024-04-17T08:48:01.283951+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:27:45.300825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.281861+0000","last_change":"2024-04-17T08:48:00.286796+0000","last_active":"2024-04-17T08:48:01.281861+0000","last_peered":"2024-04-17T08:48:01.281861+0000","last_clean":"2024-04-17T08:48:01.281861+0000","last_became_active":"2024-04-17T08:48:00.286551+0000","last_became_peered":"2024-04-17T08:48:00.286551+0000","last_unstale":"2024-04-17T08:48:01.281861+0000","last_undegraded":"2024-04-17T08:48:01.281861+0000","last_fullsized":"2024-04-17T08:48:01.281861+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:30:10.502144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.291094+0000","last_change":"2024-04-17T08:47:59.283040+0000","last_active":"2024-04-17T08:48:01.291094+0000","last_peered":"2024-04-17T08:48:01.291094+0000","last_clean":"2024-04-17T08:48:01.291094+0000","last_became_active":"2024-04-17T08:47:59.282782+0000","last_became_peered":"2024-04-17T08:47:59.282782+0000","last_unstale":"2024-04-17T08:48:01.291094+0000","last_undegraded":"2024-04-17T08:48:01.291094+0000","last_fullsized":"2024-04-17T08:48:01.291094+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:08:11.396935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.291151+0000","last_change":"2024-04-17T08:48:00.307473+0000","last_active":"2024-04-17T08:48:01.291151+0000","last_peered":"2024-04-17T08:48:01.291151+0000","last_clean":"2024-04-17T08:48:01.291151+0000","last_became_active":"2024-04-17T08:48:00.307257+0000","last_became_peered":"2024-04-17T08:48:00.307257+0000","last_unstale":"2024-04-17T08:48:01.291151+0000","last_undegraded":"2024-04-17T08:48:01.291151+0000","last_fullsized":"2024-04-17T08:48:01.291151+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:25:33.780377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.283665+0000","last_change":"2024-04-17T08:47:59.287624+0000","last_active":"2024-04-17T08:48:01.283665+0000","last_peered":"2024-04-17T08:48:01.283665+0000","last_clean":"2024-04-17T08:48:01.283665+0000","last_became_active":"2024-04-17T08:47:59.287294+0000","last_became_peered":"2024-04-17T08:47:59.287294+0000","last_unstale":"2024-04-17T08:48:01.283665+0000","last_undegraded":"2024-04-17T08:48:01.283665+0000","last_fullsized":"2024-04-17T08:48:01.283665+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:08:11.396935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290817+0000","last_change":"2024-04-17T08:48:00.300499+0000","last_active":"2024-04-17T08:48:01.290817+0000","last_peered":"2024-04-17T08:48:01.290817+0000","last_clean":"2024-04-17T08:48:01.290817+0000","last_became_active":"2024-04-17T08:48:00.300217+0000","last_became_peered":"2024-04-17T08:48:00.300217+0000","last_unstale":"2024-04-17T08:48:01.290817+0000","last_undegraded":"2024-04-17T08:48:01.290817+0000","last_fullsized":"2024-04-17T08:48:01.290817+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:06:22.290856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.283681+0000","last_change":"2024-04-17T08:47:59.291971+0000","last_active":"2024-04-17T08:48:01.283681+0000","last_peered":"2024-04-17T08:48:01.283681+0000","last_clean":"2024-04-17T08:48:01.283681+0000","last_became_active":"2024-04-17T08:47:59.291650+0000","last_became_peered":"2024-04-17T08:47:59.291650+0000","last_unstale":"2024-04-17T08:48:01.283681+0000","last_undegraded":"2024-04-17T08:48:01.283681+0000","last_fullsized":"2024-04-17T08:48:01.283681+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:42:28.365621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.284587+0000","last_change":"2024-04-17T08:48:00.290725+0000","last_active":"2024-04-17T08:48:01.284587+0000","last_peered":"2024-04-17T08:48:01.284587+0000","last_clean":"2024-04-17T08:48:01.284587+0000","last_became_active":"2024-04-17T08:48:00.290109+0000","last_became_peered":"2024-04-17T08:48:00.290109+0000","last_unstale":"2024-04-17T08:48:01.284587+0000","last_undegraded":"2024-04-17T08:48:01.284587+0000","last_fullsized":"2024-04-17T08:48:01.284587+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:42:46.274567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290806+0000","last_change":"2024-04-17T08:47:59.291115+0000","last_active":"2024-04-17T08:48:01.290806+0000","last_peered":"2024-04-17T08:48:01.290806+0000","last_clean":"2024-04-17T08:48:01.290806+0000","last_became_active":"2024-04-17T08:47:59.290874+0000","last_became_peered":"2024-04-17T08:47:59.290874+0000","last_unstale":"2024-04-17T08:48:01.290806+0000","last_undegraded":"2024-04-17T08:48:01.290806+0000","last_fullsized":"2024-04-17T08:48:01.290806+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:05:05.586225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.289753+0000","last_change":"2024-04-17T08:48:00.310777+0000","last_active":"2024-04-17T08:48:01.289753+0000","last_peered":"2024-04-17T08:48:01.289753+0000","last_clean":"2024-04-17T08:48:01.289753+0000","last_became_active":"2024-04-17T08:48:00.305848+0000","last_became_peered":"2024-04-17T08:48:00.305848+0000","last_unstale":"2024-04-17T08:48:01.289753+0000","last_undegraded":"2024-04-17T08:48:01.289753+0000","last_fullsized":"2024-04-17T08:48:01.289753+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:42:56.610988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290616+0000","last_change":"2024-04-17T08:47:59.281532+0000","last_active":"2024-04-17T08:48:01.290616+0000","last_peered":"2024-04-17T08:48:01.290616+0000","last_clean":"2024-04-17T08:48:01.290616+0000","last_became_active":"2024-04-17T08:47:59.281254+0000","last_became_peered":"2024-04-17T08:47:59.281254+0000","last_unstale":"2024-04-17T08:48:01.290616+0000","last_undegraded":"2024-04-17T08:48:01.290616+0000","last_fullsized":"2024-04-17T08:48:01.290616+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:42:28.365621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290180+0000","last_change":"2024-04-17T08:48:00.298543+0000","last_active":"2024-04-17T08:48:01.290180+0000","last_peered":"2024-04-17T08:48:01.290180+0000","last_clean":"2024-04-17T08:48:01.290180+0000","last_became_active":"2024-04-17T08:48:00.298270+0000","last_became_peered":"2024-04-17T08:48:00.298270+0000","last_unstale":"2024-04-17T08:48:01.290180+0000","last_undegraded":"2024-04-17T08:48:01.290180+0000","last_fullsized":"2024-04-17T08:48:01.290180+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:17:09.519928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.291637+0000","last_change":"2024-04-17T08:47:59.286195+0000","last_active":"2024-04-17T08:48:01.291637+0000","last_peered":"2024-04-17T08:48:01.291637+0000","last_clean":"2024-04-17T08:48:01.291637+0000","last_became_active":"2024-04-17T08:47:59.285965+0000","last_became_peered":"2024-04-17T08:47:59.285965+0000","last_unstale":"2024-04-17T08:48:01.291637+0000","last_undegraded":"2024-04-17T08:48:01.291637+0000","last_fullsized":"2024-04-17T08:48:01.291637+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:46:01.309286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290139+0000","last_change":"2024-04-17T08:48:00.314956+0000","last_active":"2024-04-17T08:48:01.290139+0000","last_peered":"2024-04-17T08:48:01.290139+0000","last_clean":"2024-04-17T08:48:01.290139+0000","last_became_active":"2024-04-17T08:48:00.314788+0000","last_became_peered":"2024-04-17T08:48:00.314788+0000","last_unstale":"2024-04-17T08:48:01.290139+0000","last_undegraded":"2024-04-17T08:48:01.290139+0000","last_fullsized":"2024-04-17T08:48:01.290139+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:06:22.290856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290217+0000","last_change":"2024-04-17T08:47:59.279371+0000","last_active":"2024-04-17T08:48:01.290217+0000","last_peered":"2024-04-17T08:48:01.290217+0000","last_clean":"2024-04-17T08:48:01.290217+0000","last_became_active":"2024-04-17T08:47:59.279095+0000","last_became_peered":"2024-04-17T08:47:59.279095+0000","last_unstale":"2024-04-17T08:48:01.290217+0000","last_undegraded":"2024-04-17T08:48:01.290217+0000","last_fullsized":"2024-04-17T08:48:01.290217+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:30:09.496723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290518+0000","last_change":"2024-04-17T08:48:00.296689+0000","last_active":"2024-04-17T08:48:01.290518+0000","last_peered":"2024-04-17T08:48:01.290518+0000","last_clean":"2024-04-17T08:48:01.290518+0000","last_became_active":"2024-04-17T08:48:00.296425+0000","last_became_peered":"2024-04-17T08:48:00.296425+0000","last_unstale":"2024-04-17T08:48:01.290518+0000","last_undegraded":"2024-04-17T08:48:01.290518+0000","last_fullsized":"2024-04-17T08:48:01.290518+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:50:13.616793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290036+0000","last_change":"2024-04-17T08:47:59.294161+0000","last_active":"2024-04-17T08:48:01.290036+0000","last_peered":"2024-04-17T08:48:01.290036+0000","last_clean":"2024-04-17T08:48:01.290036+0000","last_became_active":"2024-04-17T08:47:59.293863+0000","last_became_peered":"2024-04-17T08:47:59.293863+0000","last_unstale":"2024-04-17T08:48:01.290036+0000","last_undegraded":"2024-04-17T08:48:01.290036+0000","last_fullsized":"2024-04-17T08:48:01.290036+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:46:01.309286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290756+0000","last_change":"2024-04-17T08:48:00.311923+0000","last_active":"2024-04-17T08:48:01.290756+0000","last_peered":"2024-04-17T08:48:01.290756+0000","last_clean":"2024-04-17T08:48:01.290756+0000","last_became_active":"2024-04-17T08:48:00.311634+0000","last_became_peered":"2024-04-17T08:48:00.311634+0000","last_unstale":"2024-04-17T08:48:01.290756+0000","last_undegraded":"2024-04-17T08:48:01.290756+0000","last_fullsized":"2024-04-17T08:48:01.290756+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:25:33.780377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.283662+0000","last_change":"2024-04-17T08:47:59.284659+0000","last_active":"2024-04-17T08:48:01.283662+0000","last_peered":"2024-04-17T08:48:01.283662+0000","last_clean":"2024-04-17T08:48:01.283662+0000","last_became_active":"2024-04-17T08:47:59.283619+0000","last_became_peered":"2024-04-17T08:47:59.283619+0000","last_unstale":"2024-04-17T08:48:01.283662+0000","last_undegraded":"2024-04-17T08:48:01.283662+0000","last_fullsized":"2024-04-17T08:48:01.283662+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:05:05.586225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.283592+0000","last_change":"2024-04-17T08:48:00.307128+0000","last_active":"2024-04-17T08:48:01.283592+0000","last_peered":"2024-04-17T08:48:01.283592+0000","last_clean":"2024-04-17T08:48:01.283592+0000","last_became_active":"2024-04-17T08:48:00.306856+0000","last_became_peered":"2024-04-17T08:48:00.306856+0000","last_unstale":"2024-04-17T08:48:01.283592+0000","last_undegraded":"2024-04-17T08:48:01.283592+0000","last_fullsized":"2024-04-17T08:48:01.283592+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:44:03.351045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.284819+0000","last_change":"2024-04-17T08:47:59.284921+0000","last_active":"2024-04-17T08:48:01.284819+0000","last_peered":"2024-04-17T08:48:01.284819+0000","last_clean":"2024-04-17T08:48:01.284819+0000","last_became_active":"2024-04-17T08:47:59.284583+0000","last_became_peered":"2024-04-17T08:47:59.284583+0000","last_unstale":"2024-04-17T08:48:01.284819+0000","last_undegraded":"2024-04-17T08:48:01.284819+0000","last_fullsized":"2024-04-17T08:48:01.284819+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:38:18.319758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.284724+0000","last_change":"2024-04-17T08:48:00.301815+0000","last_active":"2024-04-17T08:48:01.284724+0000","last_peered":"2024-04-17T08:48:01.284724+0000","last_clean":"2024-04-17T08:48:01.284724+0000","last_became_active":"2024-04-17T08:48:00.301486+0000","last_became_peered":"2024-04-17T08:48:00.301486+0000","last_unstale":"2024-04-17T08:48:01.284724+0000","last_undegraded":"2024-04-17T08:48:01.284724+0000","last_fullsized":"2024-04-17T08:48:01.284724+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:35:16.148243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.281756+0000","last_change":"2024-04-17T08:47:59.290230+0000","last_active":"2024-04-17T08:48:01.281756+0000","last_peered":"2024-04-17T08:48:01.281756+0000","last_clean":"2024-04-17T08:48:01.281756+0000","last_became_active":"2024-04-17T08:47:59.289837+0000","last_became_peered":"2024-04-17T08:47:59.289837+0000","last_unstale":"2024-04-17T08:48:01.281756+0000","last_undegraded":"2024-04-17T08:48:01.281756+0000","last_fullsized":"2024-04-17T08:48:01.281756+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:31:26.241182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.282049+0000","last_change":"2024-04-17T08:48:00.292089+0000","last_active":"2024-04-17T08:48:01.282049+0000","last_peered":"2024-04-17T08:48:01.282049+0000","last_clean":"2024-04-17T08:48:01.282049+0000","last_became_active":"2024-04-17T08:48:00.289536+0000","last_became_peered":"2024-04-17T08:48:00.289536+0000","last_unstale":"2024-04-17T08:48:01.282049+0000","last_undegraded":"2024-04-17T08:48:01.282049+0000","last_fullsized":"2024-04-17T08:48:01.282049+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:27:46.306245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.291351+0000","last_change":"2024-04-17T08:47:59.283477+0000","last_active":"2024-04-17T08:48:01.291351+0000","last_peered":"2024-04-17T08:48:01.291351+0000","last_clean":"2024-04-17T08:48:01.291351+0000","last_became_active":"2024-04-17T08:47:59.283235+0000","last_became_peered":"2024-04-17T08:47:59.283235+0000","last_unstale":"2024-04-17T08:48:01.291351+0000","last_undegraded":"2024-04-17T08:48:01.291351+0000","last_fullsized":"2024-04-17T08:48:01.291351+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:12:48.821601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290223+0000","last_change":"2024-04-17T08:48:00.311345+0000","last_active":"2024-04-17T08:48:01.290223+0000","last_peered":"2024-04-17T08:48:01.290223+0000","last_clean":"2024-04-17T08:48:01.290223+0000","last_became_active":"2024-04-17T08:48:00.311187+0000","last_became_peered":"2024-04-17T08:48:00.311187+0000","last_unstale":"2024-04-17T08:48:01.290223+0000","last_undegraded":"2024-04-17T08:48:01.290223+0000","last_fullsized":"2024-04-17T08:48:01.290223+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:17:09.519928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.281566+0000","last_change":"2024-04-17T08:47:59.278117+0000","last_active":"2024-04-17T08:48:01.281566+0000","last_peered":"2024-04-17T08:48:01.281566+0000","last_clean":"2024-04-17T08:48:01.281566+0000","last_became_active":"2024-04-17T08:47:59.277694+0000","last_became_peered":"2024-04-17T08:47:59.277694+0000","last_unstale":"2024-04-17T08:48:01.281566+0000","last_undegraded":"2024-04-17T08:48:01.281566+0000","last_fullsized":"2024-04-17T08:48:01.281566+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:33:18.814021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290134+0000","last_change":"2024-04-17T08:48:00.302860+0000","last_active":"2024-04-17T08:48:01.290134+0000","last_peered":"2024-04-17T08:48:01.290134+0000","last_clean":"2024-04-17T08:48:01.290134+0000","last_became_active":"2024-04-17T08:48:00.302567+0000","last_became_peered":"2024-04-17T08:48:00.302567+0000","last_unstale":"2024-04-17T08:48:01.290134+0000","last_undegraded":"2024-04-17T08:48:01.290134+0000","last_fullsized":"2024-04-17T08:48:01.290134+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:49:08.072885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.281440+0000","last_change":"2024-04-17T08:47:59.274760+0000","last_active":"2024-04-17T08:48:01.281440+0000","last_peered":"2024-04-17T08:48:01.281440+0000","last_clean":"2024-04-17T08:48:01.281440+0000","last_became_active":"2024-04-17T08:47:59.274463+0000","last_became_peered":"2024-04-17T08:47:59.274463+0000","last_unstale":"2024-04-17T08:48:01.281440+0000","last_undegraded":"2024-04-17T08:48:01.281440+0000","last_fullsized":"2024-04-17T08:48:01.281440+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:22:32.126573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.283108+0000","last_change":"2024-04-17T08:48:00.303513+0000","last_active":"2024-04-17T08:48:01.283108+0000","last_peered":"2024-04-17T08:48:01.283108+0000","last_clean":"2024-04-17T08:48:01.283108+0000","last_became_active":"2024-04-17T08:48:00.303358+0000","last_became_peered":"2024-04-17T08:48:00.303358+0000","last_unstale":"2024-04-17T08:48:01.283108+0000","last_undegraded":"2024-04-17T08:48:01.283108+0000","last_fullsized":"2024-04-17T08:48:01.283108+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:11:32.043287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290485+0000","last_change":"2024-04-17T08:47:59.292947+0000","last_active":"2024-04-17T08:48:01.290485+0000","last_peered":"2024-04-17T08:48:01.290485+0000","last_clean":"2024-04-17T08:48:01.290485+0000","last_became_active":"2024-04-17T08:47:59.292663+0000","last_became_peered":"2024-04-17T08:47:59.292663+0000","last_unstale":"2024-04-17T08:48:01.290485+0000","last_undegraded":"2024-04-17T08:48:01.290485+0000","last_fullsized":"2024-04-17T08:48:01.290485+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:18:24.825386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290577+0000","last_change":"2024-04-17T08:48:00.302513+0000","last_active":"2024-04-17T08:48:01.290577+0000","last_peered":"2024-04-17T08:48:01.290577+0000","last_clean":"2024-04-17T08:48:01.290577+0000","last_became_active":"2024-04-17T08:48:00.302171+0000","last_became_peered":"2024-04-17T08:48:00.302171+0000","last_unstale":"2024-04-17T08:48:01.290577+0000","last_undegraded":"2024-04-17T08:48:01.290577+0000","last_fullsized":"2024-04-17T08:48:01.290577+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:11:32.043287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.281540+0000","last_change":"2024-04-17T08:47:59.278526+0000","last_active":"2024-04-17T08:48:01.281540+0000","last_peered":"2024-04-17T08:48:01.281540+0000","last_clean":"2024-04-17T08:48:01.281540+0000","last_became_active":"2024-04-17T08:47:59.277947+0000","last_became_peered":"2024-04-17T08:47:59.277947+0000","last_unstale":"2024-04-17T08:48:01.281540+0000","last_undegraded":"2024-04-17T08:48:01.281540+0000","last_fullsized":"2024-04-17T08:48:01.281540+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:49:04.609158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.291435+0000","last_change":"2024-04-17T08:48:00.309614+0000","last_active":"2024-04-17T08:48:01.291435+0000","last_peered":"2024-04-17T08:48:01.291435+0000","last_clean":"2024-04-17T08:48:01.291435+0000","last_became_active":"2024-04-17T08:48:00.309299+0000","last_became_peered":"2024-04-17T08:48:00.309299+0000","last_unstale":"2024-04-17T08:48:01.291435+0000","last_undegraded":"2024-04-17T08:48:01.291435+0000","last_fullsized":"2024-04-17T08:48:01.291435+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:42:56.610988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.283807+0000","last_change":"2024-04-17T08:47:59.291848+0000","last_active":"2024-04-17T08:48:01.283807+0000","last_peered":"2024-04-17T08:48:01.283807+0000","last_clean":"2024-04-17T08:48:01.283807+0000","last_became_active":"2024-04-17T08:47:59.291387+0000","last_became_peered":"2024-04-17T08:47:59.291387+0000","last_unstale":"2024-04-17T08:48:01.283807+0000","last_undegraded":"2024-04-17T08:48:01.283807+0000","last_fullsized":"2024-04-17T08:48:01.283807+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:18:24.825386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.291223+0000","last_change":"2024-04-17T08:48:00.315177+0000","last_active":"2024-04-17T08:48:01.291223+0000","last_peered":"2024-04-17T08:48:01.291223+0000","last_clean":"2024-04-17T08:48:01.291223+0000","last_became_active":"2024-04-17T08:48:00.313644+0000","last_became_peered":"2024-04-17T08:48:00.313644+0000","last_unstale":"2024-04-17T08:48:01.291223+0000","last_undegraded":"2024-04-17T08:48:01.291223+0000","last_fullsized":"2024-04-17T08:48:01.291223+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:53:43.285669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"38'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.304022+0000","last_change":"2024-04-17T08:47:59.283284+0000","last_active":"2024-04-17T08:48:01.304022+0000","last_peered":"2024-04-17T08:48:01.304022+0000","last_clean":"2024-04-17T08:48:01.304022+0000","last_became_active":"2024-04-17T08:47:59.283009+0000","last_became_peered":"2024-04-17T08:47:59.283009+0000","last_unstale":"2024-04-17T08:48:01.304022+0000","last_undegraded":"2024-04-17T08:48:01.304022+0000","last_fullsized":"2024-04-17T08:48:01.304022+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:48:08.590782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290781+0000","last_change":"2024-04-17T08:48:00.289611+0000","last_active":"2024-04-17T08:48:01.290781+0000","last_peered":"2024-04-17T08:48:01.290781+0000","last_clean":"2024-04-17T08:48:01.290781+0000","last_became_active":"2024-04-17T08:48:00.289359+0000","last_became_peered":"2024-04-17T08:48:00.289359+0000","last_unstale":"2024-04-17T08:48:01.290781+0000","last_undegraded":"2024-04-17T08:48:01.290781+0000","last_fullsized":"2024-04-17T08:48:01.290781+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:53:43.285669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290862+0000","last_change":"2024-04-17T08:47:59.284708+0000","last_active":"2024-04-17T08:48:01.290862+0000","last_peered":"2024-04-17T08:48:01.290862+0000","last_clean":"2024-04-17T08:48:01.290862+0000","last_became_active":"2024-04-17T08:47:59.284430+0000","last_became_peered":"2024-04-17T08:47:59.284430+0000","last_unstale":"2024-04-17T08:48:01.290862+0000","last_undegraded":"2024-04-17T08:48:01.290862+0000","last_fullsized":"2024-04-17T08:48:01.290862+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:19:30.561573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.289870+0000","last_change":"2024-04-17T08:48:00.296700+0000","last_active":"2024-04-17T08:48:01.289870+0000","last_peered":"2024-04-17T08:48:01.289870+0000","last_clean":"2024-04-17T08:48:01.289870+0000","last_became_active":"2024-04-17T08:48:00.296235+0000","last_became_peered":"2024-04-17T08:48:00.296235+0000","last_unstale":"2024-04-17T08:48:01.289870+0000","last_undegraded":"2024-04-17T08:48:01.289870+0000","last_fullsized":"2024-04-17T08:48:01.289870+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:36:22.503040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290679+0000","last_change":"2024-04-17T08:47:59.286781+0000","last_active":"2024-04-17T08:48:01.290679+0000","last_peered":"2024-04-17T08:48:01.290679+0000","last_clean":"2024-04-17T08:48:01.290679+0000","last_became_active":"2024-04-17T08:47:59.286548+0000","last_became_peered":"2024-04-17T08:47:59.286548+0000","last_unstale":"2024-04-17T08:48:01.290679+0000","last_undegraded":"2024-04-17T08:48:01.290679+0000","last_fullsized":"2024-04-17T08:48:01.290679+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:12:48.821601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290132+0000","last_change":"2024-04-17T08:48:00.298735+0000","last_active":"2024-04-17T08:48:01.290132+0000","last_peered":"2024-04-17T08:48:01.290132+0000","last_clean":"2024-04-17T08:48:01.290132+0000","last_became_active":"2024-04-17T08:48:00.298475+0000","last_became_peered":"2024-04-17T08:48:00.298475+0000","last_unstale":"2024-04-17T08:48:01.290132+0000","last_undegraded":"2024-04-17T08:48:01.290132+0000","last_fullsized":"2024-04-17T08:48:01.290132+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:35:16.148243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290424+0000","last_change":"2024-04-17T08:47:59.279855+0000","last_active":"2024-04-17T08:48:01.290424+0000","last_peered":"2024-04-17T08:48:01.290424+0000","last_clean":"2024-04-17T08:48:01.290424+0000","last_became_active":"2024-04-17T08:47:59.278937+0000","last_became_peered":"2024-04-17T08:47:59.278937+0000","last_unstale":"2024-04-17T08:48:01.290424+0000","last_undegraded":"2024-04-17T08:48:01.290424+0000","last_fullsized":"2024-04-17T08:48:01.290424+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:27:45.300825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.284393+0000","last_change":"2024-04-17T08:48:00.289706+0000","last_active":"2024-04-17T08:48:01.284393+0000","last_peered":"2024-04-17T08:48:01.284393+0000","last_clean":"2024-04-17T08:48:01.284393+0000","last_became_active":"2024-04-17T08:48:00.289460+0000","last_became_peered":"2024-04-17T08:48:00.289460+0000","last_unstale":"2024-04-17T08:48:01.284393+0000","last_undegraded":"2024-04-17T08:48:01.284393+0000","last_fullsized":"2024-04-17T08:48:01.284393+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:49:55.588604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.284006+0000","last_change":"2024-04-17T08:47:59.282820+0000","last_active":"2024-04-17T08:48:01.284006+0000","last_peered":"2024-04-17T08:48:01.284006+0000","last_clean":"2024-04-17T08:48:01.284006+0000","last_became_active":"2024-04-17T08:47:59.282543+0000","last_became_peered":"2024-04-17T08:47:59.282543+0000","last_unstale":"2024-04-17T08:48:01.284006+0000","last_undegraded":"2024-04-17T08:48:01.284006+0000","last_fullsized":"2024-04-17T08:48:01.284006+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:30:09.496723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.291016+0000","last_change":"2024-04-17T08:48:00.306389+0000","last_active":"2024-04-17T08:48:01.291016+0000","last_peered":"2024-04-17T08:48:01.291016+0000","last_clean":"2024-04-17T08:48:01.291016+0000","last_became_active":"2024-04-17T08:48:00.305919+0000","last_became_peered":"2024-04-17T08:48:00.305919+0000","last_unstale":"2024-04-17T08:48:01.291016+0000","last_undegraded":"2024-04-17T08:48:01.291016+0000","last_fullsized":"2024-04-17T08:48:01.291016+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:11:32.043287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.289915+0000","last_change":"2024-04-17T08:47:59.285828+0000","last_active":"2024-04-17T08:48:01.289915+0000","last_peered":"2024-04-17T08:48:01.289915+0000","last_clean":"2024-04-17T08:48:01.289915+0000","last_became_active":"2024-04-17T08:47:59.285493+0000","last_became_peered":"2024-04-17T08:47:59.285493+0000","last_unstale":"2024-04-17T08:48:01.289915+0000","last_undegraded":"2024-04-17T08:48:01.289915+0000","last_fullsized":"2024-04-17T08:48:01.289915+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:49:54.583183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.283521+0000","last_change":"2024-04-17T08:48:00.299211+0000","last_active":"2024-04-17T08:48:01.283521+0000","last_peered":"2024-04-17T08:48:01.283521+0000","last_clean":"2024-04-17T08:48:01.283521+0000","last_became_active":"2024-04-17T08:48:00.298523+0000","last_became_peered":"2024-04-17T08:48:00.298523+0000","last_unstale":"2024-04-17T08:48:01.283521+0000","last_undegraded":"2024-04-17T08:48:01.283521+0000","last_fullsized":"2024-04-17T08:48:01.283521+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:59:12.677666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.291077+0000","last_change":"2024-04-17T08:47:59.292178+0000","last_active":"2024-04-17T08:48:01.291077+0000","last_peered":"2024-04-17T08:48:01.291077+0000","last_clean":"2024-04-17T08:48:01.291077+0000","last_became_active":"2024-04-17T08:47:59.291868+0000","last_became_peered":"2024-04-17T08:47:59.291868+0000","last_unstale":"2024-04-17T08:48:01.291077+0000","last_undegraded":"2024-04-17T08:48:01.291077+0000","last_fullsized":"2024-04-17T08:48:01.291077+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:05:05.586225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":202,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290132+0000","last_change":"2024-04-17T08:46:22.807988+0000","last_active":"2024-04-17T08:48:01.290132+0000","last_peered":"2024-04-17T08:48:01.290132+0000","last_clean":"2024-04-17T08:48:01.290132+0000","last_became_active":"2024-04-17T08:46:22.806843+0000","last_became_peered":"2024-04-17T08:46:22.806843+0000","last_unstale":"2024-04-17T08:48:01.290132+0000","last_undegraded":"2024-04-17T08:48:01.290132+0000","last_fullsized":"2024-04-17T08:48:01.290132+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:21.741557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:21.741557+0000","last_clean_scrub_stamp":"2024-04-17T08:46:21.741557+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:28:38.254696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":1036288,"data_stored":775556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":184088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":434176,"data_stored":183618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":434176,"data_stored":184110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":191844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":430080,"data_stored":183576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":183596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":1036288,"data_stored":780600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T08:48:04.376 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T08:48:04.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.545+0000 7f62ec200640 1 Processor -- start 2024-04-17T08:48:04.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.545+0000 7f62ec200640 1 -- start start 2024-04-17T08:48:04.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.545+0000 7f62ec200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f62e4147690 0x7f62e41622e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:04.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.545+0000 7f62ec200640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f62e4147a90 0x7f62e4071790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:04.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.545+0000 7f62ec200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f62e4071cd0 0x7f62e415ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:04.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.545+0000 7f62ec200640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f62e4162820 con 0x7f62e4147a90 2024-04-17T08:48:04.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.545+0000 7f62ec200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f62e4162aa0 con 0x7f62e4147690 2024-04-17T08:48:04.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.545+0000 7f62ec200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f62e4162d80 con 0x7f62e4071cd0 2024-04-17T08:48:04.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.545+0000 7f62e8e00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f62e4147a90 0x7f62e4071790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:04.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.545+0000 7f62e8e00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f62e4147a90 0x7f62e4071790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51936/0 (socket says 172.21.15.152:51936) 2024-04-17T08:48:04.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.545+0000 7f62e8e00640 1 -- 172.21.15.152:0/1111434229 learned_addr learned my addr 172.21.15.152:0/1111434229 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:48:04.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.545+0000 7f62ea200640 1 --2- 172.21.15.152:0/1111434229 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f62e4071cd0 0x7f62e415ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:04.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.545+0000 7f62e9800640 1 --2- 172.21.15.152:0/1111434229 >> v2:172.21.15.196:3300/0 conn(0x7f62e4147690 0x7f62e41622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:04.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.545+0000 7f62e8e00640 1 -- 172.21.15.152:0/1111434229 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f62e4071cd0 msgr2=0x7f62e415ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:48:04.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.545+0000 7f62e8e00640 1 --2- 172.21.15.152:0/1111434229 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f62e4071cd0 0x7f62e415ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:04.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.545+0000 7f62e8e00640 1 -- 172.21.15.152:0/1111434229 >> v2:172.21.15.196:3300/0 conn(0x7f62e4147690 msgr2=0x7f62e41622e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:48:04.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.545+0000 7f62e8e00640 1 --2- 172.21.15.152:0/1111434229 >> v2:172.21.15.196:3300/0 conn(0x7f62e4147690 0x7f62e41622e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:04.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.545+0000 7f62e8e00640 1 -- 172.21.15.152:0/1111434229 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62e4163060 con 0x7f62e4147a90 2024-04-17T08:48:04.551 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.549+0000 7f62e8e00640 1 --2- 172.21.15.152:0/1111434229 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62e4147a90 0x7f62e4071790 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f62e40b31f0 tx=0x7f62d001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=981d53197a027972 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:48:04.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.549+0000 7f62e3e00640 1 -- 172.21.15.152:0/1111434229 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d00b0070 con 0x7f62e4147a90 2024-04-17T08:48:04.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.549+0000 7f62e3e00640 1 -- 172.21.15.152:0/1111434229 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62d00ab600 con 0x7f62e4147a90 2024-04-17T08:48:04.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.549+0000 7f62e3e00640 1 -- 172.21.15.152:0/1111434229 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d00ab9d0 con 0x7f62e4147a90 2024-04-17T08:48:04.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.549+0000 7f62ec200640 1 -- 172.21.15.152:0/1111434229 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62e4147a90 msgr2=0x7f62e4071790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:04.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.549+0000 7f62ec200640 1 --2- 172.21.15.152:0/1111434229 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62e4147a90 0x7f62e4071790 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f62e40b31f0 tx=0x7f62d001c520 comp rx=0 tx=0).stop 2024-04-17T08:48:04.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.549+0000 7f62ec200640 1 -- 172.21.15.152:0/1111434229 shutdown_connections 2024-04-17T08:48:04.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.549+0000 7f62ec200640 1 --2- 172.21.15.152:0/1111434229 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f62e4071cd0 0x7f62e415ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:04.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.549+0000 7f62ec200640 1 --2- 172.21.15.152:0/1111434229 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62e4147a90 0x7f62e4071790 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:04.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.549+0000 7f62ec200640 1 --2- 172.21.15.152:0/1111434229 >> v2:172.21.15.196:3300/0 conn(0x7f62e4147690 0x7f62e41622e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:04.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.549+0000 7f62ec200640 1 -- 172.21.15.152:0/1111434229 >> 172.21.15.152:0/1111434229 conn(0x7f62e40d2350 msgr2=0x7f62e40d2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:48:04.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.549+0000 7f62ec200640 1 -- 172.21.15.152:0/1111434229 shutdown_connections 2024-04-17T08:48:04.553 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.549+0000 7f62ec200640 1 -- 172.21.15.152:0/1111434229 wait complete. 2024-04-17T08:48:04.554 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.553+0000 7f62ec200640 1 Processor -- start 2024-04-17T08:48:04.554 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.553+0000 7f62ec200640 1 -- start start 2024-04-17T08:48:04.556 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.553+0000 7f62ec200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f62e4071cd0 0x7f62e40b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:04.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.553+0000 7f62ec200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62e4147690 0x7f62e4140cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:04.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.553+0000 7f62ec200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f62e4147a90 0x7f62e40b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:04.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.553+0000 7f62ec200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f62e406e660 con 0x7f62e4147690 2024-04-17T08:48:04.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.553+0000 7f62ec200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f62e406e4e0 con 0x7f62e4071cd0 2024-04-17T08:48:04.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.553+0000 7f62ec200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f62e406e7e0 con 0x7f62e4147a90 2024-04-17T08:48:04.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.553+0000 7f62e8e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62e4147690 0x7f62e4140cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:04.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.553+0000 7f62e8e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62e4147690 0x7f62e4140cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51942/0 (socket says 172.21.15.152:51942) 2024-04-17T08:48:04.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.553+0000 7f62e8e00640 1 -- 172.21.15.152:0/325027111 learned_addr learned my addr 172.21.15.152:0/325027111 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:48:04.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.553+0000 7f62e9800640 1 --2- 172.21.15.152:0/325027111 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f62e4071cd0 0x7f62e40b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:04.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.553+0000 7f62ea200640 1 --2- 172.21.15.152:0/325027111 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f62e4147a90 0x7f62e40b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:04.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.553+0000 7f62e8e00640 1 -- 172.21.15.152:0/325027111 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f62e4147a90 msgr2=0x7f62e40b6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:04.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.553+0000 7f62e8e00640 1 --2- 172.21.15.152:0/325027111 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f62e4147a90 0x7f62e40b6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:04.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.553+0000 7f62e8e00640 1 -- 172.21.15.152:0/325027111 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f62e4071cd0 msgr2=0x7f62e40b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:04.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.553+0000 7f62e8e00640 1 --2- 172.21.15.152:0/325027111 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f62e4071cd0 0x7f62e40b5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:04.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.553+0000 7f62e8e00640 1 -- 172.21.15.152:0/325027111 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62e40b81c0 con 0x7f62e4147690 2024-04-17T08:48:04.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.553+0000 7f62e8e00640 1 --2- 172.21.15.152:0/325027111 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62e4147690 0x7f62e4140cc0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f62d001abd0 tx=0x7f62d00192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:48:04.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.553+0000 7f62e1600640 1 -- 172.21.15.152:0/325027111 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d00b9070 con 0x7f62e4147690 2024-04-17T08:48:04.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.553+0000 7f62e1600640 1 -- 172.21.15.152:0/325027111 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62d00b4600 con 0x7f62e4147690 2024-04-17T08:48:04.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.553+0000 7f62e1600640 1 -- 172.21.15.152:0/325027111 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d00b0040 con 0x7f62e4147690 2024-04-17T08:48:04.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.553+0000 7f62ec200640 1 -- 172.21.15.152:0/325027111 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62e40b77e0 con 0x7f62e4147690 2024-04-17T08:48:04.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.553+0000 7f62ec200640 1 -- 172.21.15.152:0/325027111 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62e40b55e0 con 0x7f62e4147690 2024-04-17T08:48:04.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.553+0000 7f62ec200640 1 -- 172.21.15.152:0/325027111 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62e4068a30 con 0x7f62e4147690 2024-04-17T08:48:04.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.557+0000 7f62e1600640 1 -- 172.21.15.152:0/325027111 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f62d00b33a0 con 0x7f62e4147690 2024-04-17T08:48:04.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.557+0000 7f62e1600640 1 --2- 172.21.15.152:0/325027111 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f62c4068380 0x7f62c406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:04.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.557+0000 7f62e1600640 1 -- 172.21.15.152:0/325027111 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f62d011ff20 con 0x7f62e4147690 2024-04-17T08:48:04.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.557+0000 7f62e9800640 1 --2- 172.21.15.152:0/325027111 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f62c4068380 0x7f62c406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:04.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.557+0000 7f62e9800640 1 --2- 172.21.15.152:0/325027111 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f62c4068380 0x7f62c406a840 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f62d8003fd0 tx=0x7f62d8003ce0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:48:04.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.561+0000 7f62e1600640 1 -- 172.21.15.152:0/325027111 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f62d0016110 con 0x7f62e4147690 2024-04-17T08:48:04.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.713+0000 7f62ec200640 1 -- 172.21.15.152:0/325027111 --> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f62e40b3da0 con 0x7f62c4068380 2024-04-17T08:48:04.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.721+0000 7f62e1600640 1 -- 172.21.15.152:0/325027111 <== mgr.4104 v2:172.21.15.152:6832/3078522445 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251953 (secure 0 0 0) 0x7f62e40b3da0 con 0x7f62c4068380 2024-04-17T08:48:04.724 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:48:04.726 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2024-04-17T08:48:04.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.721+0000 7f62ec200640 1 -- 172.21.15.152:0/325027111 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f62c4068380 msgr2=0x7f62c406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:04.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.721+0000 7f62ec200640 1 --2- 172.21.15.152:0/325027111 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f62c4068380 0x7f62c406a840 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f62d8003fd0 tx=0x7f62d8003ce0 comp rx=0 tx=0).stop 2024-04-17T08:48:04.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.721+0000 7f62ec200640 1 -- 172.21.15.152:0/325027111 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62e4147690 msgr2=0x7f62e4140cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:04.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.721+0000 7f62ec200640 1 --2- 172.21.15.152:0/325027111 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62e4147690 0x7f62e4140cc0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f62d001abd0 tx=0x7f62d00192c0 comp rx=0 tx=0).stop 2024-04-17T08:48:04.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.725+0000 7f62ec200640 1 -- 172.21.15.152:0/325027111 shutdown_connections 2024-04-17T08:48:04.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.725+0000 7f62ec200640 1 --2- 172.21.15.152:0/325027111 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f62c4068380 0x7f62c406a840 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:04.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.725+0000 7f62ec200640 1 --2- 172.21.15.152:0/325027111 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f62e4147a90 0x7f62e40b6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:04.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.725+0000 7f62ec200640 1 --2- 172.21.15.152:0/325027111 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62e4147690 0x7f62e4140cc0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:04.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.725+0000 7f62ec200640 1 --2- 172.21.15.152:0/325027111 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f62e4071cd0 0x7f62e40b5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:04.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.725+0000 7f62ec200640 1 -- 172.21.15.152:0/325027111 >> 172.21.15.152:0/325027111 conn(0x7f62e40d2350 msgr2=0x7f62e40d2730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:48:04.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.725+0000 7f62ec200640 1 -- 172.21.15.152:0/325027111 shutdown_connections 2024-04-17T08:48:04.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.725+0000 7f62ec200640 1 -- 172.21.15.152:0/325027111 wait complete. 2024-04-17T08:48:04.745 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2024-04-17T08:48:03.384416+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":71,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220764,"kb_used_data":4576,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753956,"statfs":{"total":773094113280,"available":772868050944,"internally_reserved":0,"allocated":4685824,"data_stored":2666988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.123861"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.291035+0000","last_change":"2024-04-17T08:48:00.296136+0000","last_active":"2024-04-17T08:48:01.291035+0000","last_peered":"2024-04-17T08:48:01.291035+0000","last_clean":"2024-04-17T08:48:01.291035+0000","last_became_active":"2024-04-17T08:48:00.295775+0000","last_became_peered":"2024-04-17T08:48:00.295775+0000","last_unstale":"2024-04-17T08:48:01.291035+0000","last_undegraded":"2024-04-17T08:48:01.291035+0000","last_fullsized":"2024-04-17T08:48:01.291035+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:59:12.677666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290700+0000","last_change":"2024-04-17T08:48:00.297219+0000","last_active":"2024-04-17T08:48:01.290700+0000","last_peered":"2024-04-17T08:48:01.290700+0000","last_clean":"2024-04-17T08:48:01.290700+0000","last_became_active":"2024-04-17T08:48:00.296960+0000","last_became_peered":"2024-04-17T08:48:00.296960+0000","last_unstale":"2024-04-17T08:48:01.290700+0000","last_undegraded":"2024-04-17T08:48:01.290700+0000","last_fullsized":"2024-04-17T08:48:01.290700+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:33:17.929953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290776+0000","last_change":"2024-04-17T08:48:00.300669+0000","last_active":"2024-04-17T08:48:01.290776+0000","last_peered":"2024-04-17T08:48:01.290776+0000","last_clean":"2024-04-17T08:48:01.290776+0000","last_became_active":"2024-04-17T08:48:00.300406+0000","last_became_peered":"2024-04-17T08:48:00.300406+0000","last_unstale":"2024-04-17T08:48:01.290776+0000","last_undegraded":"2024-04-17T08:48:01.290776+0000","last_fullsized":"2024-04-17T08:48:01.290776+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:08:34.262167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.281784+0000","last_change":"2024-04-17T08:48:00.287907+0000","last_active":"2024-04-17T08:48:01.281784+0000","last_peered":"2024-04-17T08:48:01.281784+0000","last_clean":"2024-04-17T08:48:01.281784+0000","last_became_active":"2024-04-17T08:48:00.287651+0000","last_became_peered":"2024-04-17T08:48:00.287651+0000","last_unstale":"2024-04-17T08:48:01.281784+0000","last_undegraded":"2024-04-17T08:48:01.281784+0000","last_fullsized":"2024-04-17T08:48:01.281784+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:19.423345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.281468+0000","last_change":"2024-04-17T08:48:00.284169+0000","last_active":"2024-04-17T08:48:01.281468+0000","last_peered":"2024-04-17T08:48:01.281468+0000","last_clean":"2024-04-17T08:48:01.281468+0000","last_became_active":"2024-04-17T08:48:00.283894+0000","last_became_peered":"2024-04-17T08:48:00.283894+0000","last_unstale":"2024-04-17T08:48:01.281468+0000","last_undegraded":"2024-04-17T08:48:01.281468+0000","last_fullsized":"2024-04-17T08:48:01.281468+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:31:50.585739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.289964+0000","last_change":"2024-04-17T08:48:00.309424+0000","last_active":"2024-04-17T08:48:01.289964+0000","last_peered":"2024-04-17T08:48:01.289964+0000","last_clean":"2024-04-17T08:48:01.289964+0000","last_became_active":"2024-04-17T08:48:00.308962+0000","last_became_peered":"2024-04-17T08:48:00.308962+0000","last_unstale":"2024-04-17T08:48:01.289964+0000","last_undegraded":"2024-04-17T08:48:01.289964+0000","last_fullsized":"2024-04-17T08:48:01.289964+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:42:46.274567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.282782+0000","last_change":"2024-04-17T08:48:00.308968+0000","last_active":"2024-04-17T08:48:01.282782+0000","last_peered":"2024-04-17T08:48:01.282782+0000","last_clean":"2024-04-17T08:48:01.282782+0000","last_became_active":"2024-04-17T08:48:00.308687+0000","last_became_peered":"2024-04-17T08:48:00.308687+0000","last_unstale":"2024-04-17T08:48:01.282782+0000","last_undegraded":"2024-04-17T08:48:01.282782+0000","last_fullsized":"2024-04-17T08:48:01.282782+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:17:09.519928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.289967+0000","last_change":"2024-04-17T08:48:00.308901+0000","last_active":"2024-04-17T08:48:01.289967+0000","last_peered":"2024-04-17T08:48:01.289967+0000","last_clean":"2024-04-17T08:48:01.289967+0000","last_became_active":"2024-04-17T08:48:00.308641+0000","last_became_peered":"2024-04-17T08:48:00.308641+0000","last_unstale":"2024-04-17T08:48:01.289967+0000","last_undegraded":"2024-04-17T08:48:01.289967+0000","last_fullsized":"2024-04-17T08:48:01.289967+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:06:22.290856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.291076+0000","last_change":"2024-04-17T08:48:00.303870+0000","last_active":"2024-04-17T08:48:01.291076+0000","last_peered":"2024-04-17T08:48:01.291076+0000","last_clean":"2024-04-17T08:48:01.291076+0000","last_became_active":"2024-04-17T08:48:00.303614+0000","last_became_peered":"2024-04-17T08:48:00.303614+0000","last_unstale":"2024-04-17T08:48:01.291076+0000","last_undegraded":"2024-04-17T08:48:01.291076+0000","last_fullsized":"2024-04-17T08:48:01.291076+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:17:09.519928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.283435+0000","last_change":"2024-04-17T08:48:00.300778+0000","last_active":"2024-04-17T08:48:01.283435+0000","last_peered":"2024-04-17T08:48:01.283435+0000","last_clean":"2024-04-17T08:48:01.283435+0000","last_became_active":"2024-04-17T08:48:00.300504+0000","last_became_peered":"2024-04-17T08:48:00.300504+0000","last_unstale":"2024-04-17T08:48:01.283435+0000","last_undegraded":"2024-04-17T08:48:01.283435+0000","last_fullsized":"2024-04-17T08:48:01.283435+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:13:04.976396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.283911+0000","last_change":"2024-04-17T08:48:00.293644+0000","last_active":"2024-04-17T08:48:01.283911+0000","last_peered":"2024-04-17T08:48:01.283911+0000","last_clean":"2024-04-17T08:48:01.283911+0000","last_became_active":"2024-04-17T08:48:00.293407+0000","last_became_peered":"2024-04-17T08:48:00.293407+0000","last_unstale":"2024-04-17T08:48:01.283911+0000","last_undegraded":"2024-04-17T08:48:01.283911+0000","last_fullsized":"2024-04-17T08:48:01.283911+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:40:50.099515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290473+0000","last_change":"2024-04-17T08:48:00.299562+0000","last_active":"2024-04-17T08:48:01.290473+0000","last_peered":"2024-04-17T08:48:01.290473+0000","last_clean":"2024-04-17T08:48:01.290473+0000","last_became_active":"2024-04-17T08:48:00.299316+0000","last_became_peered":"2024-04-17T08:48:00.299316+0000","last_unstale":"2024-04-17T08:48:01.290473+0000","last_undegraded":"2024-04-17T08:48:01.290473+0000","last_fullsized":"2024-04-17T08:48:01.290473+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:46:24.401088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.283265+0000","last_change":"2024-04-17T08:48:00.300794+0000","last_active":"2024-04-17T08:48:01.283265+0000","last_peered":"2024-04-17T08:48:01.283265+0000","last_clean":"2024-04-17T08:48:01.283265+0000","last_became_active":"2024-04-17T08:48:00.300471+0000","last_became_peered":"2024-04-17T08:48:00.300471+0000","last_unstale":"2024-04-17T08:48:01.283265+0000","last_undegraded":"2024-04-17T08:48:01.283265+0000","last_fullsized":"2024-04-17T08:48:01.283265+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:25:33.780377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.284192+0000","last_change":"2024-04-17T08:48:00.297456+0000","last_active":"2024-04-17T08:48:01.284192+0000","last_peered":"2024-04-17T08:48:01.284192+0000","last_clean":"2024-04-17T08:48:01.284192+0000","last_became_active":"2024-04-17T08:48:00.297196+0000","last_became_peered":"2024-04-17T08:48:00.297196+0000","last_unstale":"2024-04-17T08:48:01.284192+0000","last_undegraded":"2024-04-17T08:48:01.284192+0000","last_fullsized":"2024-04-17T08:48:01.284192+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:42:29.371041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.282913+0000","last_change":"2024-04-17T08:48:00.300797+0000","last_active":"2024-04-17T08:48:01.282913+0000","last_peered":"2024-04-17T08:48:01.282913+0000","last_clean":"2024-04-17T08:48:01.282913+0000","last_became_active":"2024-04-17T08:48:00.300534+0000","last_became_peered":"2024-04-17T08:48:00.300534+0000","last_unstale":"2024-04-17T08:48:01.282913+0000","last_undegraded":"2024-04-17T08:48:01.282913+0000","last_fullsized":"2024-04-17T08:48:01.282913+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:05:53.196243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290061+0000","last_change":"2024-04-17T08:48:00.302491+0000","last_active":"2024-04-17T08:48:01.290061+0000","last_peered":"2024-04-17T08:48:01.290061+0000","last_clean":"2024-04-17T08:48:01.290061+0000","last_became_active":"2024-04-17T08:48:00.302250+0000","last_became_peered":"2024-04-17T08:48:00.302250+0000","last_unstale":"2024-04-17T08:48:01.290061+0000","last_undegraded":"2024-04-17T08:48:01.290061+0000","last_fullsized":"2024-04-17T08:48:01.290061+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:08:34.262167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.291267+0000","last_change":"2024-04-17T08:48:00.308164+0000","last_active":"2024-04-17T08:48:01.291267+0000","last_peered":"2024-04-17T08:48:01.291267+0000","last_clean":"2024-04-17T08:48:01.291267+0000","last_became_active":"2024-04-17T08:48:00.307930+0000","last_became_peered":"2024-04-17T08:48:00.307930+0000","last_unstale":"2024-04-17T08:48:01.291267+0000","last_undegraded":"2024-04-17T08:48:01.291267+0000","last_fullsized":"2024-04-17T08:48:01.291267+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:13:04.976396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290487+0000","last_change":"2024-04-17T08:48:00.302338+0000","last_active":"2024-04-17T08:48:01.290487+0000","last_peered":"2024-04-17T08:48:01.290487+0000","last_clean":"2024-04-17T08:48:01.290487+0000","last_became_active":"2024-04-17T08:48:00.302113+0000","last_became_peered":"2024-04-17T08:48:00.302113+0000","last_unstale":"2024-04-17T08:48:01.290487+0000","last_undegraded":"2024-04-17T08:48:01.290487+0000","last_fullsized":"2024-04-17T08:48:01.290487+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:18:25.830807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.281656+0000","last_change":"2024-04-17T08:48:00.311880+0000","last_active":"2024-04-17T08:48:01.281656+0000","last_peered":"2024-04-17T08:48:01.281656+0000","last_clean":"2024-04-17T08:48:01.281656+0000","last_became_active":"2024-04-17T08:48:00.311586+0000","last_became_peered":"2024-04-17T08:48:00.311586+0000","last_unstale":"2024-04-17T08:48:01.281656+0000","last_undegraded":"2024-04-17T08:48:01.281656+0000","last_fullsized":"2024-04-17T08:48:01.281656+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:15:23.993492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290861+0000","last_change":"2024-04-17T08:48:00.304719+0000","last_active":"2024-04-17T08:48:01.290861+0000","last_peered":"2024-04-17T08:48:01.290861+0000","last_clean":"2024-04-17T08:48:01.290861+0000","last_became_active":"2024-04-17T08:48:00.301701+0000","last_became_peered":"2024-04-17T08:48:00.301701+0000","last_unstale":"2024-04-17T08:48:01.290861+0000","last_undegraded":"2024-04-17T08:48:01.290861+0000","last_fullsized":"2024-04-17T08:48:01.290861+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:49:55.588604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.283111+0000","last_change":"2024-04-17T08:48:00.302267+0000","last_active":"2024-04-17T08:48:01.283111+0000","last_peered":"2024-04-17T08:48:01.283111+0000","last_clean":"2024-04-17T08:48:01.283111+0000","last_became_active":"2024-04-17T08:48:00.301973+0000","last_became_peered":"2024-04-17T08:48:00.301973+0000","last_unstale":"2024-04-17T08:48:01.283111+0000","last_undegraded":"2024-04-17T08:48:01.283111+0000","last_fullsized":"2024-04-17T08:48:01.283111+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:33:17.929953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.284207+0000","last_change":"2024-04-17T08:48:00.291578+0000","last_active":"2024-04-17T08:48:01.284207+0000","last_peered":"2024-04-17T08:48:01.284207+0000","last_clean":"2024-04-17T08:48:01.284207+0000","last_became_active":"2024-04-17T08:48:00.291389+0000","last_became_peered":"2024-04-17T08:48:00.291389+0000","last_unstale":"2024-04-17T08:48:01.284207+0000","last_undegraded":"2024-04-17T08:48:01.284207+0000","last_fullsized":"2024-04-17T08:48:01.284207+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:08:12.402356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290382+0000","last_change":"2024-04-17T08:48:00.313211+0000","last_active":"2024-04-17T08:48:01.290382+0000","last_peered":"2024-04-17T08:48:01.290382+0000","last_clean":"2024-04-17T08:48:01.290382+0000","last_became_active":"2024-04-17T08:48:00.312036+0000","last_became_peered":"2024-04-17T08:48:00.312036+0000","last_unstale":"2024-04-17T08:48:01.290382+0000","last_undegraded":"2024-04-17T08:48:01.290382+0000","last_fullsized":"2024-04-17T08:48:01.290382+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:05:53.196243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.281469+0000","last_change":"2024-04-17T08:48:00.300261+0000","last_active":"2024-04-17T08:48:01.281469+0000","last_peered":"2024-04-17T08:48:01.281469+0000","last_clean":"2024-04-17T08:48:01.281469+0000","last_became_active":"2024-04-17T08:48:00.299969+0000","last_became_peered":"2024-04-17T08:48:00.299969+0000","last_unstale":"2024-04-17T08:48:01.281469+0000","last_undegraded":"2024-04-17T08:48:01.281469+0000","last_fullsized":"2024-04-17T08:48:01.281469+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:42:21.783161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290489+0000","last_change":"2024-04-17T08:48:00.296539+0000","last_active":"2024-04-17T08:48:01.290489+0000","last_peered":"2024-04-17T08:48:01.290489+0000","last_clean":"2024-04-17T08:48:01.290489+0000","last_became_active":"2024-04-17T08:48:00.296222+0000","last_became_peered":"2024-04-17T08:48:00.296222+0000","last_unstale":"2024-04-17T08:48:01.290489+0000","last_undegraded":"2024-04-17T08:48:01.290489+0000","last_fullsized":"2024-04-17T08:48:01.290489+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:05:06.591646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.291466+0000","last_change":"2024-04-17T08:48:00.304372+0000","last_active":"2024-04-17T08:48:01.291466+0000","last_peered":"2024-04-17T08:48:01.291466+0000","last_clean":"2024-04-17T08:48:01.291466+0000","last_became_active":"2024-04-17T08:48:00.299874+0000","last_became_peered":"2024-04-17T08:48:00.299874+0000","last_unstale":"2024-04-17T08:48:01.291466+0000","last_undegraded":"2024-04-17T08:48:01.291466+0000","last_fullsized":"2024-04-17T08:48:01.291466+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:36:22.503040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290831+0000","last_change":"2024-04-17T08:48:00.302632+0000","last_active":"2024-04-17T08:48:01.290831+0000","last_peered":"2024-04-17T08:48:01.290831+0000","last_clean":"2024-04-17T08:48:01.290831+0000","last_became_active":"2024-04-17T08:48:00.300665+0000","last_became_peered":"2024-04-17T08:48:00.300665+0000","last_unstale":"2024-04-17T08:48:01.290831+0000","last_undegraded":"2024-04-17T08:48:01.290831+0000","last_fullsized":"2024-04-17T08:48:01.290831+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:08:12.402356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.283372+0000","last_change":"2024-04-17T08:48:00.292447+0000","last_active":"2024-04-17T08:48:01.283372+0000","last_peered":"2024-04-17T08:48:01.283372+0000","last_clean":"2024-04-17T08:48:01.283372+0000","last_became_active":"2024-04-17T08:48:00.292191+0000","last_became_peered":"2024-04-17T08:48:00.292191+0000","last_unstale":"2024-04-17T08:48:01.283372+0000","last_undegraded":"2024-04-17T08:48:01.283372+0000","last_fullsized":"2024-04-17T08:48:01.283372+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:53:43.285669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290817+0000","last_change":"2024-04-17T08:48:00.314966+0000","last_active":"2024-04-17T08:48:01.290817+0000","last_peered":"2024-04-17T08:48:01.290817+0000","last_clean":"2024-04-17T08:48:01.290817+0000","last_became_active":"2024-04-17T08:48:00.314796+0000","last_became_peered":"2024-04-17T08:48:00.314796+0000","last_unstale":"2024-04-17T08:48:01.290817+0000","last_undegraded":"2024-04-17T08:48:01.290817+0000","last_fullsized":"2024-04-17T08:48:01.290817+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:42:29.371041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290407+0000","last_change":"2024-04-17T08:48:00.312391+0000","last_active":"2024-04-17T08:48:01.290407+0000","last_peered":"2024-04-17T08:48:01.290407+0000","last_clean":"2024-04-17T08:48:01.290407+0000","last_became_active":"2024-04-17T08:48:00.312167+0000","last_became_peered":"2024-04-17T08:48:00.312167+0000","last_unstale":"2024-04-17T08:48:01.290407+0000","last_undegraded":"2024-04-17T08:48:01.290407+0000","last_fullsized":"2024-04-17T08:48:01.290407+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:46:02.314706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290503+0000","last_change":"2024-04-17T08:48:00.313800+0000","last_active":"2024-04-17T08:48:01.290503+0000","last_peered":"2024-04-17T08:48:01.290503+0000","last_clean":"2024-04-17T08:48:01.290503+0000","last_became_active":"2024-04-17T08:48:00.313553+0000","last_became_peered":"2024-04-17T08:48:00.313553+0000","last_unstale":"2024-04-17T08:48:01.290503+0000","last_undegraded":"2024-04-17T08:48:01.290503+0000","last_fullsized":"2024-04-17T08:48:01.290503+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:50:13.616793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.291183+0000","last_change":"2024-04-17T08:48:00.303057+0000","last_active":"2024-04-17T08:48:01.291183+0000","last_peered":"2024-04-17T08:48:01.291183+0000","last_clean":"2024-04-17T08:48:01.291183+0000","last_became_active":"2024-04-17T08:48:00.302779+0000","last_became_peered":"2024-04-17T08:48:00.302779+0000","last_unstale":"2024-04-17T08:48:01.291183+0000","last_undegraded":"2024-04-17T08:48:01.291183+0000","last_fullsized":"2024-04-17T08:48:01.291183+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:18:31.581220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.291132+0000","last_change":"2024-04-17T08:48:00.311499+0000","last_active":"2024-04-17T08:48:01.291132+0000","last_peered":"2024-04-17T08:48:01.291132+0000","last_clean":"2024-04-17T08:48:01.291132+0000","last_became_active":"2024-04-17T08:48:00.310906+0000","last_became_peered":"2024-04-17T08:48:00.310906+0000","last_unstale":"2024-04-17T08:48:01.291132+0000","last_undegraded":"2024-04-17T08:48:01.291132+0000","last_fullsized":"2024-04-17T08:48:01.291132+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:33:17.929953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290590+0000","last_change":"2024-04-17T08:47:59.273488+0000","last_active":"2024-04-17T08:48:01.290590+0000","last_peered":"2024-04-17T08:48:01.290590+0000","last_clean":"2024-04-17T08:48:01.290590+0000","last_became_active":"2024-04-17T08:47:59.273172+0000","last_became_peered":"2024-04-17T08:47:59.273172+0000","last_unstale":"2024-04-17T08:48:01.290590+0000","last_undegraded":"2024-04-17T08:48:01.290590+0000","last_fullsized":"2024-04-17T08:48:01.290590+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:21:37.151671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.291624+0000","last_change":"2024-04-17T08:48:00.308279+0000","last_active":"2024-04-17T08:48:01.291624+0000","last_peered":"2024-04-17T08:48:01.291624+0000","last_clean":"2024-04-17T08:48:01.291624+0000","last_became_active":"2024-04-17T08:48:00.308020+0000","last_became_peered":"2024-04-17T08:48:00.308020+0000","last_unstale":"2024-04-17T08:48:01.291624+0000","last_undegraded":"2024-04-17T08:48:01.291624+0000","last_fullsized":"2024-04-17T08:48:01.291624+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:49:08.072885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290904+0000","last_change":"2024-04-17T08:47:59.289918+0000","last_active":"2024-04-17T08:48:01.290904+0000","last_peered":"2024-04-17T08:48:01.290904+0000","last_clean":"2024-04-17T08:48:01.290904+0000","last_became_active":"2024-04-17T08:47:59.289438+0000","last_became_peered":"2024-04-17T08:47:59.289438+0000","last_unstale":"2024-04-17T08:48:01.290904+0000","last_undegraded":"2024-04-17T08:48:01.290904+0000","last_fullsized":"2024-04-17T08:48:01.290904+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:46:01.309286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.284781+0000","last_change":"2024-04-17T08:48:00.303153+0000","last_active":"2024-04-17T08:48:01.284781+0000","last_peered":"2024-04-17T08:48:01.284781+0000","last_clean":"2024-04-17T08:48:01.284781+0000","last_became_active":"2024-04-17T08:48:00.302916+0000","last_became_peered":"2024-04-17T08:48:00.302916+0000","last_unstale":"2024-04-17T08:48:01.284781+0000","last_undegraded":"2024-04-17T08:48:01.284781+0000","last_fullsized":"2024-04-17T08:48:01.284781+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:18:31.581220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.291736+0000","last_change":"2024-04-17T08:47:59.281898+0000","last_active":"2024-04-17T08:48:01.291736+0000","last_peered":"2024-04-17T08:48:01.291736+0000","last_clean":"2024-04-17T08:48:01.291736+0000","last_became_active":"2024-04-17T08:47:59.281638+0000","last_became_peered":"2024-04-17T08:47:59.281638+0000","last_unstale":"2024-04-17T08:48:01.291736+0000","last_undegraded":"2024-04-17T08:48:01.291736+0000","last_fullsized":"2024-04-17T08:48:01.291736+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:19:30.561573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290939+0000","last_change":"2024-04-17T08:48:00.310858+0000","last_active":"2024-04-17T08:48:01.290939+0000","last_peered":"2024-04-17T08:48:01.290939+0000","last_clean":"2024-04-17T08:48:01.290939+0000","last_became_active":"2024-04-17T08:48:00.310455+0000","last_became_peered":"2024-04-17T08:48:00.310455+0000","last_unstale":"2024-04-17T08:48:01.290939+0000","last_undegraded":"2024-04-17T08:48:01.290939+0000","last_fullsized":"2024-04-17T08:48:01.290939+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:13:04.976396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.284497+0000","last_change":"2024-04-17T08:47:59.283415+0000","last_active":"2024-04-17T08:48:01.284497+0000","last_peered":"2024-04-17T08:48:01.284497+0000","last_clean":"2024-04-17T08:48:01.284497+0000","last_became_active":"2024-04-17T08:47:59.282926+0000","last_became_peered":"2024-04-17T08:47:59.282926+0000","last_unstale":"2024-04-17T08:48:01.284497+0000","last_undegraded":"2024-04-17T08:48:01.284497+0000","last_fullsized":"2024-04-17T08:48:01.284497+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:21:37.151671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.289732+0000","last_change":"2024-04-17T08:48:00.314813+0000","last_active":"2024-04-17T08:48:01.289732+0000","last_peered":"2024-04-17T08:48:01.289732+0000","last_clean":"2024-04-17T08:48:01.289732+0000","last_became_active":"2024-04-17T08:48:00.314552+0000","last_became_peered":"2024-04-17T08:48:00.314552+0000","last_unstale":"2024-04-17T08:48:01.289732+0000","last_undegraded":"2024-04-17T08:48:01.289732+0000","last_fullsized":"2024-04-17T08:48:01.289732+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:18:31.581220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.283228+0000","last_change":"2024-04-17T08:47:59.281271+0000","last_active":"2024-04-17T08:48:01.283228+0000","last_peered":"2024-04-17T08:48:01.283228+0000","last_clean":"2024-04-17T08:48:01.283228+0000","last_became_active":"2024-04-17T08:47:59.280933+0000","last_became_peered":"2024-04-17T08:47:59.280933+0000","last_unstale":"2024-04-17T08:48:01.283228+0000","last_undegraded":"2024-04-17T08:48:01.283228+0000","last_fullsized":"2024-04-17T08:48:01.283228+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:46:01.309286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.282947+0000","last_change":"2024-04-17T08:48:00.307095+0000","last_active":"2024-04-17T08:48:01.282947+0000","last_peered":"2024-04-17T08:48:01.282947+0000","last_clean":"2024-04-17T08:48:01.282947+0000","last_became_active":"2024-04-17T08:48:00.306839+0000","last_became_peered":"2024-04-17T08:48:00.306839+0000","last_unstale":"2024-04-17T08:48:01.282947+0000","last_undegraded":"2024-04-17T08:48:01.282947+0000","last_fullsized":"2024-04-17T08:48:01.282947+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:50:13.616793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290178+0000","last_change":"2024-04-17T08:47:59.294329+0000","last_active":"2024-04-17T08:48:01.290178+0000","last_peered":"2024-04-17T08:48:01.290178+0000","last_clean":"2024-04-17T08:48:01.290178+0000","last_became_active":"2024-04-17T08:47:59.293957+0000","last_became_peered":"2024-04-17T08:47:59.293957+0000","last_unstale":"2024-04-17T08:48:01.290178+0000","last_undegraded":"2024-04-17T08:48:01.290178+0000","last_fullsized":"2024-04-17T08:48:01.290178+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:42:28.365621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.284455+0000","last_change":"2024-04-17T08:48:00.288119+0000","last_active":"2024-04-17T08:48:01.284455+0000","last_peered":"2024-04-17T08:48:01.284455+0000","last_clean":"2024-04-17T08:48:01.284455+0000","last_became_active":"2024-04-17T08:48:00.287825+0000","last_became_peered":"2024-04-17T08:48:00.287825+0000","last_unstale":"2024-04-17T08:48:01.284455+0000","last_undegraded":"2024-04-17T08:48:01.284455+0000","last_fullsized":"2024-04-17T08:48:01.284455+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:35:03.594399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290226+0000","last_change":"2024-04-17T08:47:59.287685+0000","last_active":"2024-04-17T08:48:01.290226+0000","last_peered":"2024-04-17T08:48:01.290226+0000","last_clean":"2024-04-17T08:48:01.290226+0000","last_became_active":"2024-04-17T08:47:59.287319+0000","last_became_peered":"2024-04-17T08:47:59.287319+0000","last_unstale":"2024-04-17T08:48:01.290226+0000","last_undegraded":"2024-04-17T08:48:01.290226+0000","last_fullsized":"2024-04-17T08:48:01.290226+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:25:16.318975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290383+0000","last_change":"2024-04-17T08:48:00.305573+0000","last_active":"2024-04-17T08:48:01.290383+0000","last_peered":"2024-04-17T08:48:01.290383+0000","last_clean":"2024-04-17T08:48:01.290383+0000","last_became_active":"2024-04-17T08:48:00.302150+0000","last_became_peered":"2024-04-17T08:48:00.302150+0000","last_unstale":"2024-04-17T08:48:01.290383+0000","last_undegraded":"2024-04-17T08:48:01.290383+0000","last_fullsized":"2024-04-17T08:48:01.290383+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:05:53.196243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.283951+0000","last_change":"2024-04-17T08:47:59.275143+0000","last_active":"2024-04-17T08:48:01.283951+0000","last_peered":"2024-04-17T08:48:01.283951+0000","last_clean":"2024-04-17T08:48:01.283951+0000","last_became_active":"2024-04-17T08:47:59.274833+0000","last_became_peered":"2024-04-17T08:47:59.274833+0000","last_unstale":"2024-04-17T08:48:01.283951+0000","last_undegraded":"2024-04-17T08:48:01.283951+0000","last_fullsized":"2024-04-17T08:48:01.283951+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:27:45.300825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.281861+0000","last_change":"2024-04-17T08:48:00.286796+0000","last_active":"2024-04-17T08:48:01.281861+0000","last_peered":"2024-04-17T08:48:01.281861+0000","last_clean":"2024-04-17T08:48:01.281861+0000","last_became_active":"2024-04-17T08:48:00.286551+0000","last_became_peered":"2024-04-17T08:48:00.286551+0000","last_unstale":"2024-04-17T08:48:01.281861+0000","last_undegraded":"2024-04-17T08:48:01.281861+0000","last_fullsized":"2024-04-17T08:48:01.281861+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:30:10.502144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.291094+0000","last_change":"2024-04-17T08:47:59.283040+0000","last_active":"2024-04-17T08:48:01.291094+0000","last_peered":"2024-04-17T08:48:01.291094+0000","last_clean":"2024-04-17T08:48:01.291094+0000","last_became_active":"2024-04-17T08:47:59.282782+0000","last_became_peered":"2024-04-17T08:47:59.282782+0000","last_unstale":"2024-04-17T08:48:01.291094+0000","last_undegraded":"2024-04-17T08:48:01.291094+0000","last_fullsized":"2024-04-17T08:48:01.291094+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:08:11.396935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.291151+0000","last_change":"2024-04-17T08:48:00.307473+0000","last_active":"2024-04-17T08:48:01.291151+0000","last_peered":"2024-04-17T08:48:01.291151+0000","last_clean":"2024-04-17T08:48:01.291151+0000","last_became_active":"2024-04-17T08:48:00.307257+0000","last_became_peered":"2024-04-17T08:48:00.307257+0000","last_unstale":"2024-04-17T08:48:01.291151+0000","last_undegraded":"2024-04-17T08:48:01.291151+0000","last_fullsized":"2024-04-17T08:48:01.291151+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:25:33.780377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.283665+0000","last_change":"2024-04-17T08:47:59.287624+0000","last_active":"2024-04-17T08:48:01.283665+0000","last_peered":"2024-04-17T08:48:01.283665+0000","last_clean":"2024-04-17T08:48:01.283665+0000","last_became_active":"2024-04-17T08:47:59.287294+0000","last_became_peered":"2024-04-17T08:47:59.287294+0000","last_unstale":"2024-04-17T08:48:01.283665+0000","last_undegraded":"2024-04-17T08:48:01.283665+0000","last_fullsized":"2024-04-17T08:48:01.283665+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:08:11.396935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290817+0000","last_change":"2024-04-17T08:48:00.300499+0000","last_active":"2024-04-17T08:48:01.290817+0000","last_peered":"2024-04-17T08:48:01.290817+0000","last_clean":"2024-04-17T08:48:01.290817+0000","last_became_active":"2024-04-17T08:48:00.300217+0000","last_became_peered":"2024-04-17T08:48:00.300217+0000","last_unstale":"2024-04-17T08:48:01.290817+0000","last_undegraded":"2024-04-17T08:48:01.290817+0000","last_fullsized":"2024-04-17T08:48:01.290817+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:06:22.290856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.283681+0000","last_change":"2024-04-17T08:47:59.291971+0000","last_active":"2024-04-17T08:48:01.283681+0000","last_peered":"2024-04-17T08:48:01.283681+0000","last_clean":"2024-04-17T08:48:01.283681+0000","last_became_active":"2024-04-17T08:47:59.291650+0000","last_became_peered":"2024-04-17T08:47:59.291650+0000","last_unstale":"2024-04-17T08:48:01.283681+0000","last_undegraded":"2024-04-17T08:48:01.283681+0000","last_fullsized":"2024-04-17T08:48:01.283681+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:42:28.365621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.284587+0000","last_change":"2024-04-17T08:48:00.290725+0000","last_active":"2024-04-17T08:48:01.284587+0000","last_peered":"2024-04-17T08:48:01.284587+0000","last_clean":"2024-04-17T08:48:01.284587+0000","last_became_active":"2024-04-17T08:48:00.290109+0000","last_became_peered":"2024-04-17T08:48:00.290109+0000","last_unstale":"2024-04-17T08:48:01.284587+0000","last_undegraded":"2024-04-17T08:48:01.284587+0000","last_fullsized":"2024-04-17T08:48:01.284587+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:42:46.274567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290806+0000","last_change":"2024-04-17T08:47:59.291115+0000","last_active":"2024-04-17T08:48:01.290806+0000","last_peered":"2024-04-17T08:48:01.290806+0000","last_clean":"2024-04-17T08:48:01.290806+0000","last_became_active":"2024-04-17T08:47:59.290874+0000","last_became_peered":"2024-04-17T08:47:59.290874+0000","last_unstale":"2024-04-17T08:48:01.290806+0000","last_undegraded":"2024-04-17T08:48:01.290806+0000","last_fullsized":"2024-04-17T08:48:01.290806+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:05:05.586225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.289753+0000","last_change":"2024-04-17T08:48:00.310777+0000","last_active":"2024-04-17T08:48:01.289753+0000","last_peered":"2024-04-17T08:48:01.289753+0000","last_clean":"2024-04-17T08:48:01.289753+0000","last_became_active":"2024-04-17T08:48:00.305848+0000","last_became_peered":"2024-04-17T08:48:00.305848+0000","last_unstale":"2024-04-17T08:48:01.289753+0000","last_undegraded":"2024-04-17T08:48:01.289753+0000","last_fullsized":"2024-04-17T08:48:01.289753+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:42:56.610988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290616+0000","last_change":"2024-04-17T08:47:59.281532+0000","last_active":"2024-04-17T08:48:01.290616+0000","last_peered":"2024-04-17T08:48:01.290616+0000","last_clean":"2024-04-17T08:48:01.290616+0000","last_became_active":"2024-04-17T08:47:59.281254+0000","last_became_peered":"2024-04-17T08:47:59.281254+0000","last_unstale":"2024-04-17T08:48:01.290616+0000","last_undegraded":"2024-04-17T08:48:01.290616+0000","last_fullsized":"2024-04-17T08:48:01.290616+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:42:28.365621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290180+0000","last_change":"2024-04-17T08:48:00.298543+0000","last_active":"2024-04-17T08:48:01.290180+0000","last_peered":"2024-04-17T08:48:01.290180+0000","last_clean":"2024-04-17T08:48:01.290180+0000","last_became_active":"2024-04-17T08:48:00.298270+0000","last_became_peered":"2024-04-17T08:48:00.298270+0000","last_unstale":"2024-04-17T08:48:01.290180+0000","last_undegraded":"2024-04-17T08:48:01.290180+0000","last_fullsized":"2024-04-17T08:48:01.290180+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:17:09.519928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.291637+0000","last_change":"2024-04-17T08:47:59.286195+0000","last_active":"2024-04-17T08:48:01.291637+0000","last_peered":"2024-04-17T08:48:01.291637+0000","last_clean":"2024-04-17T08:48:01.291637+0000","last_became_active":"2024-04-17T08:47:59.285965+0000","last_became_peered":"2024-04-17T08:47:59.285965+0000","last_unstale":"2024-04-17T08:48:01.291637+0000","last_undegraded":"2024-04-17T08:48:01.291637+0000","last_fullsized":"2024-04-17T08:48:01.291637+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:46:01.309286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290139+0000","last_change":"2024-04-17T08:48:00.314956+0000","last_active":"2024-04-17T08:48:01.290139+0000","last_peered":"2024-04-17T08:48:01.290139+0000","last_clean":"2024-04-17T08:48:01.290139+0000","last_became_active":"2024-04-17T08:48:00.314788+0000","last_became_peered":"2024-04-17T08:48:00.314788+0000","last_unstale":"2024-04-17T08:48:01.290139+0000","last_undegraded":"2024-04-17T08:48:01.290139+0000","last_fullsized":"2024-04-17T08:48:01.290139+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:06:22.290856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290217+0000","last_change":"2024-04-17T08:47:59.279371+0000","last_active":"2024-04-17T08:48:01.290217+0000","last_peered":"2024-04-17T08:48:01.290217+0000","last_clean":"2024-04-17T08:48:01.290217+0000","last_became_active":"2024-04-17T08:47:59.279095+0000","last_became_peered":"2024-04-17T08:47:59.279095+0000","last_unstale":"2024-04-17T08:48:01.290217+0000","last_undegraded":"2024-04-17T08:48:01.290217+0000","last_fullsized":"2024-04-17T08:48:01.290217+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:30:09.496723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290518+0000","last_change":"2024-04-17T08:48:00.296689+0000","last_active":"2024-04-17T08:48:01.290518+0000","last_peered":"2024-04-17T08:48:01.290518+0000","last_clean":"2024-04-17T08:48:01.290518+0000","last_became_active":"2024-04-17T08:48:00.296425+0000","last_became_peered":"2024-04-17T08:48:00.296425+0000","last_unstale":"2024-04-17T08:48:01.290518+0000","last_undegraded":"2024-04-17T08:48:01.290518+0000","last_fullsized":"2024-04-17T08:48:01.290518+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:50:13.616793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290036+0000","last_change":"2024-04-17T08:47:59.294161+0000","last_active":"2024-04-17T08:48:01.290036+0000","last_peered":"2024-04-17T08:48:01.290036+0000","last_clean":"2024-04-17T08:48:01.290036+0000","last_became_active":"2024-04-17T08:47:59.293863+0000","last_became_peered":"2024-04-17T08:47:59.293863+0000","last_unstale":"2024-04-17T08:48:01.290036+0000","last_undegraded":"2024-04-17T08:48:01.290036+0000","last_fullsized":"2024-04-17T08:48:01.290036+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:46:01.309286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290756+0000","last_change":"2024-04-17T08:48:00.311923+0000","last_active":"2024-04-17T08:48:01.290756+0000","last_peered":"2024-04-17T08:48:01.290756+0000","last_clean":"2024-04-17T08:48:01.290756+0000","last_became_active":"2024-04-17T08:48:00.311634+0000","last_became_peered":"2024-04-17T08:48:00.311634+0000","last_unstale":"2024-04-17T08:48:01.290756+0000","last_undegraded":"2024-04-17T08:48:01.290756+0000","last_fullsized":"2024-04-17T08:48:01.290756+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:25:33.780377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.283662+0000","last_change":"2024-04-17T08:47:59.284659+0000","last_active":"2024-04-17T08:48:01.283662+0000","last_peered":"2024-04-17T08:48:01.283662+0000","last_clean":"2024-04-17T08:48:01.283662+0000","last_became_active":"2024-04-17T08:47:59.283619+0000","last_became_peered":"2024-04-17T08:47:59.283619+0000","last_unstale":"2024-04-17T08:48:01.283662+0000","last_undegraded":"2024-04-17T08:48:01.283662+0000","last_fullsized":"2024-04-17T08:48:01.283662+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:05:05.586225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.283592+0000","last_change":"2024-04-17T08:48:00.307128+0000","last_active":"2024-04-17T08:48:01.283592+0000","last_peered":"2024-04-17T08:48:01.283592+0000","last_clean":"2024-04-17T08:48:01.283592+0000","last_became_active":"2024-04-17T08:48:00.306856+0000","last_became_peered":"2024-04-17T08:48:00.306856+0000","last_unstale":"2024-04-17T08:48:01.283592+0000","last_undegraded":"2024-04-17T08:48:01.283592+0000","last_fullsized":"2024-04-17T08:48:01.283592+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:44:03.351045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.284819+0000","last_change":"2024-04-17T08:47:59.284921+0000","last_active":"2024-04-17T08:48:01.284819+0000","last_peered":"2024-04-17T08:48:01.284819+0000","last_clean":"2024-04-17T08:48:01.284819+0000","last_became_active":"2024-04-17T08:47:59.284583+0000","last_became_peered":"2024-04-17T08:47:59.284583+0000","last_unstale":"2024-04-17T08:48:01.284819+0000","last_undegraded":"2024-04-17T08:48:01.284819+0000","last_fullsized":"2024-04-17T08:48:01.284819+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:38:18.319758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.284724+0000","last_change":"2024-04-17T08:48:00.301815+0000","last_active":"2024-04-17T08:48:01.284724+0000","last_peered":"2024-04-17T08:48:01.284724+0000","last_clean":"2024-04-17T08:48:01.284724+0000","last_became_active":"2024-04-17T08:48:00.301486+0000","last_became_peered":"2024-04-17T08:48:00.301486+0000","last_unstale":"2024-04-17T08:48:01.284724+0000","last_undegraded":"2024-04-17T08:48:01.284724+0000","last_fullsized":"2024-04-17T08:48:01.284724+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:35:16.148243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.281756+0000","last_change":"2024-04-17T08:47:59.290230+0000","last_active":"2024-04-17T08:48:01.281756+0000","last_peered":"2024-04-17T08:48:01.281756+0000","last_clean":"2024-04-17T08:48:01.281756+0000","last_became_active":"2024-04-17T08:47:59.289837+0000","last_became_peered":"2024-04-17T08:47:59.289837+0000","last_unstale":"2024-04-17T08:48:01.281756+0000","last_undegraded":"2024-04-17T08:48:01.281756+0000","last_fullsized":"2024-04-17T08:48:01.281756+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:31:26.241182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.282049+0000","last_change":"2024-04-17T08:48:00.292089+0000","last_active":"2024-04-17T08:48:01.282049+0000","last_peered":"2024-04-17T08:48:01.282049+0000","last_clean":"2024-04-17T08:48:01.282049+0000","last_became_active":"2024-04-17T08:48:00.289536+0000","last_became_peered":"2024-04-17T08:48:00.289536+0000","last_unstale":"2024-04-17T08:48:01.282049+0000","last_undegraded":"2024-04-17T08:48:01.282049+0000","last_fullsized":"2024-04-17T08:48:01.282049+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:27:46.306245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.291351+0000","last_change":"2024-04-17T08:47:59.283477+0000","last_active":"2024-04-17T08:48:01.291351+0000","last_peered":"2024-04-17T08:48:01.291351+0000","last_clean":"2024-04-17T08:48:01.291351+0000","last_became_active":"2024-04-17T08:47:59.283235+0000","last_became_peered":"2024-04-17T08:47:59.283235+0000","last_unstale":"2024-04-17T08:48:01.291351+0000","last_undegraded":"2024-04-17T08:48:01.291351+0000","last_fullsized":"2024-04-17T08:48:01.291351+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:12:48.821601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290223+0000","last_change":"2024-04-17T08:48:00.311345+0000","last_active":"2024-04-17T08:48:01.290223+0000","last_peered":"2024-04-17T08:48:01.290223+0000","last_clean":"2024-04-17T08:48:01.290223+0000","last_became_active":"2024-04-17T08:48:00.311187+0000","last_became_peered":"2024-04-17T08:48:00.311187+0000","last_unstale":"2024-04-17T08:48:01.290223+0000","last_undegraded":"2024-04-17T08:48:01.290223+0000","last_fullsized":"2024-04-17T08:48:01.290223+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:17:09.519928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.281566+0000","last_change":"2024-04-17T08:47:59.278117+0000","last_active":"2024-04-17T08:48:01.281566+0000","last_peered":"2024-04-17T08:48:01.281566+0000","last_clean":"2024-04-17T08:48:01.281566+0000","last_became_active":"2024-04-17T08:47:59.277694+0000","last_became_peered":"2024-04-17T08:47:59.277694+0000","last_unstale":"2024-04-17T08:48:01.281566+0000","last_undegraded":"2024-04-17T08:48:01.281566+0000","last_fullsized":"2024-04-17T08:48:01.281566+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:33:18.814021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290134+0000","last_change":"2024-04-17T08:48:00.302860+0000","last_active":"2024-04-17T08:48:01.290134+0000","last_peered":"2024-04-17T08:48:01.290134+0000","last_clean":"2024-04-17T08:48:01.290134+0000","last_became_active":"2024-04-17T08:48:00.302567+0000","last_became_peered":"2024-04-17T08:48:00.302567+0000","last_unstale":"2024-04-17T08:48:01.290134+0000","last_undegraded":"2024-04-17T08:48:01.290134+0000","last_fullsized":"2024-04-17T08:48:01.290134+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:49:08.072885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.281440+0000","last_change":"2024-04-17T08:47:59.274760+0000","last_active":"2024-04-17T08:48:01.281440+0000","last_peered":"2024-04-17T08:48:01.281440+0000","last_clean":"2024-04-17T08:48:01.281440+0000","last_became_active":"2024-04-17T08:47:59.274463+0000","last_became_peered":"2024-04-17T08:47:59.274463+0000","last_unstale":"2024-04-17T08:48:01.281440+0000","last_undegraded":"2024-04-17T08:48:01.281440+0000","last_fullsized":"2024-04-17T08:48:01.281440+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T18:22:32.126573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.283108+0000","last_change":"2024-04-17T08:48:00.303513+0000","last_active":"2024-04-17T08:48:01.283108+0000","last_peered":"2024-04-17T08:48:01.283108+0000","last_clean":"2024-04-17T08:48:01.283108+0000","last_became_active":"2024-04-17T08:48:00.303358+0000","last_became_peered":"2024-04-17T08:48:00.303358+0000","last_unstale":"2024-04-17T08:48:01.283108+0000","last_undegraded":"2024-04-17T08:48:01.283108+0000","last_fullsized":"2024-04-17T08:48:01.283108+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:11:32.043287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290485+0000","last_change":"2024-04-17T08:47:59.292947+0000","last_active":"2024-04-17T08:48:01.290485+0000","last_peered":"2024-04-17T08:48:01.290485+0000","last_clean":"2024-04-17T08:48:01.290485+0000","last_became_active":"2024-04-17T08:47:59.292663+0000","last_became_peered":"2024-04-17T08:47:59.292663+0000","last_unstale":"2024-04-17T08:48:01.290485+0000","last_undegraded":"2024-04-17T08:48:01.290485+0000","last_fullsized":"2024-04-17T08:48:01.290485+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:18:24.825386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290577+0000","last_change":"2024-04-17T08:48:00.302513+0000","last_active":"2024-04-17T08:48:01.290577+0000","last_peered":"2024-04-17T08:48:01.290577+0000","last_clean":"2024-04-17T08:48:01.290577+0000","last_became_active":"2024-04-17T08:48:00.302171+0000","last_became_peered":"2024-04-17T08:48:00.302171+0000","last_unstale":"2024-04-17T08:48:01.290577+0000","last_undegraded":"2024-04-17T08:48:01.290577+0000","last_fullsized":"2024-04-17T08:48:01.290577+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:11:32.043287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.281540+0000","last_change":"2024-04-17T08:47:59.278526+0000","last_active":"2024-04-17T08:48:01.281540+0000","last_peered":"2024-04-17T08:48:01.281540+0000","last_clean":"2024-04-17T08:48:01.281540+0000","last_became_active":"2024-04-17T08:47:59.277947+0000","last_became_peered":"2024-04-17T08:47:59.277947+0000","last_unstale":"2024-04-17T08:48:01.281540+0000","last_undegraded":"2024-04-17T08:48:01.281540+0000","last_fullsized":"2024-04-17T08:48:01.281540+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:49:04.609158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.291435+0000","last_change":"2024-04-17T08:48:00.309614+0000","last_active":"2024-04-17T08:48:01.291435+0000","last_peered":"2024-04-17T08:48:01.291435+0000","last_clean":"2024-04-17T08:48:01.291435+0000","last_became_active":"2024-04-17T08:48:00.309299+0000","last_became_peered":"2024-04-17T08:48:00.309299+0000","last_unstale":"2024-04-17T08:48:01.291435+0000","last_undegraded":"2024-04-17T08:48:01.291435+0000","last_fullsized":"2024-04-17T08:48:01.291435+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:42:56.610988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.283807+0000","last_change":"2024-04-17T08:47:59.291848+0000","last_active":"2024-04-17T08:48:01.283807+0000","last_peered":"2024-04-17T08:48:01.283807+0000","last_clean":"2024-04-17T08:48:01.283807+0000","last_became_active":"2024-04-17T08:47:59.291387+0000","last_became_peered":"2024-04-17T08:47:59.291387+0000","last_unstale":"2024-04-17T08:48:01.283807+0000","last_undegraded":"2024-04-17T08:48:01.283807+0000","last_fullsized":"2024-04-17T08:48:01.283807+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:18:24.825386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.291223+0000","last_change":"2024-04-17T08:48:00.315177+0000","last_active":"2024-04-17T08:48:01.291223+0000","last_peered":"2024-04-17T08:48:01.291223+0000","last_clean":"2024-04-17T08:48:01.291223+0000","last_became_active":"2024-04-17T08:48:00.313644+0000","last_became_peered":"2024-04-17T08:48:00.313644+0000","last_unstale":"2024-04-17T08:48:01.291223+0000","last_undegraded":"2024-04-17T08:48:01.291223+0000","last_fullsized":"2024-04-17T08:48:01.291223+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:53:43.285669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"38'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.304022+0000","last_change":"2024-04-17T08:47:59.283284+0000","last_active":"2024-04-17T08:48:01.304022+0000","last_peered":"2024-04-17T08:48:01.304022+0000","last_clean":"2024-04-17T08:48:01.304022+0000","last_became_active":"2024-04-17T08:47:59.283009+0000","last_became_peered":"2024-04-17T08:47:59.283009+0000","last_unstale":"2024-04-17T08:48:01.304022+0000","last_undegraded":"2024-04-17T08:48:01.304022+0000","last_fullsized":"2024-04-17T08:48:01.304022+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:48:08.590782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290781+0000","last_change":"2024-04-17T08:48:00.289611+0000","last_active":"2024-04-17T08:48:01.290781+0000","last_peered":"2024-04-17T08:48:01.290781+0000","last_clean":"2024-04-17T08:48:01.290781+0000","last_became_active":"2024-04-17T08:48:00.289359+0000","last_became_peered":"2024-04-17T08:48:00.289359+0000","last_unstale":"2024-04-17T08:48:01.290781+0000","last_undegraded":"2024-04-17T08:48:01.290781+0000","last_fullsized":"2024-04-17T08:48:01.290781+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:53:43.285669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290862+0000","last_change":"2024-04-17T08:47:59.284708+0000","last_active":"2024-04-17T08:48:01.290862+0000","last_peered":"2024-04-17T08:48:01.290862+0000","last_clean":"2024-04-17T08:48:01.290862+0000","last_became_active":"2024-04-17T08:47:59.284430+0000","last_became_peered":"2024-04-17T08:47:59.284430+0000","last_unstale":"2024-04-17T08:48:01.290862+0000","last_undegraded":"2024-04-17T08:48:01.290862+0000","last_fullsized":"2024-04-17T08:48:01.290862+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:19:30.561573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.289870+0000","last_change":"2024-04-17T08:48:00.296700+0000","last_active":"2024-04-17T08:48:01.289870+0000","last_peered":"2024-04-17T08:48:01.289870+0000","last_clean":"2024-04-17T08:48:01.289870+0000","last_became_active":"2024-04-17T08:48:00.296235+0000","last_became_peered":"2024-04-17T08:48:00.296235+0000","last_unstale":"2024-04-17T08:48:01.289870+0000","last_undegraded":"2024-04-17T08:48:01.289870+0000","last_fullsized":"2024-04-17T08:48:01.289870+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:36:22.503040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290679+0000","last_change":"2024-04-17T08:47:59.286781+0000","last_active":"2024-04-17T08:48:01.290679+0000","last_peered":"2024-04-17T08:48:01.290679+0000","last_clean":"2024-04-17T08:48:01.290679+0000","last_became_active":"2024-04-17T08:47:59.286548+0000","last_became_peered":"2024-04-17T08:47:59.286548+0000","last_unstale":"2024-04-17T08:48:01.290679+0000","last_undegraded":"2024-04-17T08:48:01.290679+0000","last_fullsized":"2024-04-17T08:48:01.290679+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:12:48.821601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290132+0000","last_change":"2024-04-17T08:48:00.298735+0000","last_active":"2024-04-17T08:48:01.290132+0000","last_peered":"2024-04-17T08:48:01.290132+0000","last_clean":"2024-04-17T08:48:01.290132+0000","last_became_active":"2024-04-17T08:48:00.298475+0000","last_became_peered":"2024-04-17T08:48:00.298475+0000","last_unstale":"2024-04-17T08:48:01.290132+0000","last_undegraded":"2024-04-17T08:48:01.290132+0000","last_fullsized":"2024-04-17T08:48:01.290132+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:35:16.148243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290424+0000","last_change":"2024-04-17T08:47:59.279855+0000","last_active":"2024-04-17T08:48:01.290424+0000","last_peered":"2024-04-17T08:48:01.290424+0000","last_clean":"2024-04-17T08:48:01.290424+0000","last_became_active":"2024-04-17T08:47:59.278937+0000","last_became_peered":"2024-04-17T08:47:59.278937+0000","last_unstale":"2024-04-17T08:48:01.290424+0000","last_undegraded":"2024-04-17T08:48:01.290424+0000","last_fullsized":"2024-04-17T08:48:01.290424+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:27:45.300825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.284393+0000","last_change":"2024-04-17T08:48:00.289706+0000","last_active":"2024-04-17T08:48:01.284393+0000","last_peered":"2024-04-17T08:48:01.284393+0000","last_clean":"2024-04-17T08:48:01.284393+0000","last_became_active":"2024-04-17T08:48:00.289460+0000","last_became_peered":"2024-04-17T08:48:00.289460+0000","last_unstale":"2024-04-17T08:48:01.284393+0000","last_undegraded":"2024-04-17T08:48:01.284393+0000","last_fullsized":"2024-04-17T08:48:01.284393+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:49:55.588604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.284006+0000","last_change":"2024-04-17T08:47:59.282820+0000","last_active":"2024-04-17T08:48:01.284006+0000","last_peered":"2024-04-17T08:48:01.284006+0000","last_clean":"2024-04-17T08:48:01.284006+0000","last_became_active":"2024-04-17T08:47:59.282543+0000","last_became_peered":"2024-04-17T08:47:59.282543+0000","last_unstale":"2024-04-17T08:48:01.284006+0000","last_undegraded":"2024-04-17T08:48:01.284006+0000","last_fullsized":"2024-04-17T08:48:01.284006+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:30:09.496723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.291016+0000","last_change":"2024-04-17T08:48:00.306389+0000","last_active":"2024-04-17T08:48:01.291016+0000","last_peered":"2024-04-17T08:48:01.291016+0000","last_clean":"2024-04-17T08:48:01.291016+0000","last_became_active":"2024-04-17T08:48:00.305919+0000","last_became_peered":"2024-04-17T08:48:00.305919+0000","last_unstale":"2024-04-17T08:48:01.291016+0000","last_undegraded":"2024-04-17T08:48:01.291016+0000","last_fullsized":"2024-04-17T08:48:01.291016+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:11:32.043287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.289915+0000","last_change":"2024-04-17T08:47:59.285828+0000","last_active":"2024-04-17T08:48:01.289915+0000","last_peered":"2024-04-17T08:48:01.289915+0000","last_clean":"2024-04-17T08:48:01.289915+0000","last_became_active":"2024-04-17T08:47:59.285493+0000","last_became_peered":"2024-04-17T08:47:59.285493+0000","last_unstale":"2024-04-17T08:48:01.289915+0000","last_undegraded":"2024-04-17T08:48:01.289915+0000","last_fullsized":"2024-04-17T08:48:01.289915+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:49:54.583183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.283521+0000","last_change":"2024-04-17T08:48:00.299211+0000","last_active":"2024-04-17T08:48:01.283521+0000","last_peered":"2024-04-17T08:48:01.283521+0000","last_clean":"2024-04-17T08:48:01.283521+0000","last_became_active":"2024-04-17T08:48:00.298523+0000","last_became_peered":"2024-04-17T08:48:00.298523+0000","last_unstale":"2024-04-17T08:48:01.283521+0000","last_undegraded":"2024-04-17T08:48:01.283521+0000","last_fullsized":"2024-04-17T08:48:01.283521+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:59.259782+0000","last_clean_scrub_stamp":"2024-04-17T08:47:59.259782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T19:59:12.677666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.291077+0000","last_change":"2024-04-17T08:47:59.292178+0000","last_active":"2024-04-17T08:48:01.291077+0000","last_peered":"2024-04-17T08:48:01.291077+0000","last_clean":"2024-04-17T08:48:01.291077+0000","last_became_active":"2024-04-17T08:47:59.291868+0000","last_became_peered":"2024-04-17T08:47:59.291868+0000","last_unstale":"2024-04-17T08:48:01.291077+0000","last_undegraded":"2024-04-17T08:48:01.291077+0000","last_fullsized":"2024-04-17T08:48:01.291077+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:47:58.254362+0000","last_clean_scrub_stamp":"2024-04-17T08:47:58.254362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:05:05.586225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":202,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-17T08:48:01.290132+0000","last_change":"2024-04-17T08:46:22.807988+0000","last_active":"2024-04-17T08:48:01.290132+0000","last_peered":"2024-04-17T08:48:01.290132+0000","last_clean":"2024-04-17T08:48:01.290132+0000","last_became_active":"2024-04-17T08:46:22.806843+0000","last_became_peered":"2024-04-17T08:46:22.806843+0000","last_unstale":"2024-04-17T08:48:01.290132+0000","last_undegraded":"2024-04-17T08:48:01.290132+0000","last_fullsized":"2024-04-17T08:48:01.290132+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:21.741557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:21.741557+0000","last_clean_scrub_stamp":"2024-04-17T08:46:21.741557+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:28:38.254696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":1036288,"data_stored":775556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":184088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":434176,"data_stored":183618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":434176,"data_stored":184110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":191844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":430080,"data_stored":183576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":183596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":1036288,"data_stored":780600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T08:48:04.748 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-17T08:48:04.749 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-17T08:48:04.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.925+0000 7f3da5c00640 1 Processor -- start 2024-04-17T08:48:04.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.925+0000 7f3da5c00640 1 -- start start 2024-04-17T08:48:04.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.925+0000 7f3da5c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3da00cfec0 0x7f3da01695d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:04.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.925+0000 7f3da5c00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3da0071230 con 0x7f3da006fa10 2024-04-17T08:48:04.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.925+0000 7f3da5c00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3da0071510 con 0x7f3da015e670 2024-04-17T08:48:04.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.925+0000 7f3da5c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f3da00b4870 con 0x7f3da00cfec0 2024-04-17T08:48:04.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.925+0000 7f3d96000640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f3da006fa10 0x7f3da00cf7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:33372/0 (socket says 172.21.15.152:33372) 2024-04-17T08:48:04.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.925+0000 7f3d96000640 1 -- 172.21.15.152:0/70181282 learned_addr learned my addr 172.21.15.152:0/70181282 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:48:04.928 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.925+0000 7f3d9f400640 1 --2- 172.21.15.152:0/70181282 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3da00cfec0 0x7f3da01695d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:04.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.925+0000 7f3d9e000640 1 -- 172.21.15.152:0/70181282 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3915416610 0 0) 0x7f3da0071230 con 0x7f3da006fa10 2024-04-17T08:48:04.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.925+0000 7f3d9e000640 1 -- 172.21.15.152:0/70181282 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d84003530 con 0x7f3da006fa10 2024-04-17T08:48:04.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.925+0000 7f3d9e000640 1 -- 172.21.15.152:0/70181282 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3276669964 0 0) 0x7f3da0071510 con 0x7f3da015e670 2024-04-17T08:48:04.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.925+0000 7f3d9e000640 1 -- 172.21.15.152:0/70181282 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3da0071230 con 0x7f3da015e670 2024-04-17T08:48:04.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.925+0000 7f3d9f400640 1 -- 172.21.15.152:0/70181282 >> v1:172.21.15.196:6789/0 conn(0x7f3da015e670 legacy=0x7f3da0162c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:04.929 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.925+0000 7f3d9f400640 1 -- 172.21.15.152:0/70181282 >> v1:172.21.15.152:6789/0 conn(0x7f3da006fa10 legacy=0x7f3da00cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:04.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.925+0000 7f3d9f400640 1 -- 172.21.15.152:0/70181282 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3da00b4500 con 0x7f3da00cfec0 2024-04-17T08:48:04.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.929+0000 7f3d9f400640 1 --2- 172.21.15.152:0/70181282 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3da00cfec0 0x7f3da01695d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3d98009dc0 tx=0x7f3d9801c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57d9dd23e124b91e server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:48:04.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.929+0000 7f3d9e000640 1 -- 172.21.15.152:0/70181282 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d980b2070 con 0x7f3da00cfec0 2024-04-17T08:48:04.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.929+0000 7f3d9e000640 1 -- 172.21.15.152:0/70181282 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d980a5850 con 0x7f3da00cfec0 2024-04-17T08:48:04.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.929+0000 7f3d9e000640 1 -- 172.21.15.152:0/70181282 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d980a5c20 con 0x7f3da00cfec0 2024-04-17T08:48:04.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.929+0000 7f3da5c00640 1 -- 172.21.15.152:0/70181282 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3da00cfec0 msgr2=0x7f3da01695d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:04.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.929+0000 7f3da5c00640 1 --2- 172.21.15.152:0/70181282 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3da00cfec0 0x7f3da01695d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3d98009dc0 tx=0x7f3d9801c990 comp rx=0 tx=0).stop 2024-04-17T08:48:04.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.929+0000 7f3da5c00640 1 -- 172.21.15.152:0/70181282 shutdown_connections 2024-04-17T08:48:04.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.929+0000 7f3da5c00640 1 --2- 172.21.15.152:0/70181282 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3da00cfec0 0x7f3da01695d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:04.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.929+0000 7f3da5c00640 1 -- 172.21.15.152:0/70181282 >> 172.21.15.152:0/70181282 conn(0x7f3da0070500 msgr2=0x7f3da0070910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:48:04.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.929+0000 7f3da5c00640 1 -- 172.21.15.152:0/70181282 shutdown_connections 2024-04-17T08:48:04.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.929+0000 7f3da5c00640 1 -- 172.21.15.152:0/70181282 wait complete. 2024-04-17T08:48:04.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.933+0000 7f3da5c00640 1 Processor -- start 2024-04-17T08:48:04.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.933+0000 7f3da5c00640 1 -- start start 2024-04-17T08:48:04.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.933+0000 7f3da5c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3da006fa10 0x7f3da01547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:04.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.933+0000 7f3da5c00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3da00cfec0 0x7f3da014cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:04.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.933+0000 7f3da5c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3da015e670 0x7f3da014d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:04.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.933+0000 7f3da5c00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3da016c950 con 0x7f3da00cfec0 2024-04-17T08:48:04.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.933+0000 7f3da5c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f3da00b5f20 con 0x7f3da006fa10 2024-04-17T08:48:04.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.933+0000 7f3da5c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f3da016cad0 con 0x7f3da015e670 2024-04-17T08:48:04.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.933+0000 7f3d96000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3da00cfec0 0x7f3da014cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:04.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.933+0000 7f3d96000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3da00cfec0 0x7f3da014cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51956/0 (socket says 172.21.15.152:51956) 2024-04-17T08:48:04.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.933+0000 7f3d96000640 1 -- 172.21.15.152:0/2952363316 learned_addr learned my addr 172.21.15.152:0/2952363316 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:48:04.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.933+0000 7f3d9ea00640 1 --2- 172.21.15.152:0/2952363316 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3da006fa10 0x7f3da01547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:04.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.933+0000 7f3d9f400640 1 --2- 172.21.15.152:0/2952363316 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3da015e670 0x7f3da014d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:04.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.933+0000 7f3d96000640 1 -- 172.21.15.152:0/2952363316 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3da015e670 msgr2=0x7f3da014d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:04.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.933+0000 7f3d96000640 1 --2- 172.21.15.152:0/2952363316 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3da015e670 0x7f3da014d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:04.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.933+0000 7f3d96000640 1 -- 172.21.15.152:0/2952363316 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3da006fa10 msgr2=0x7f3da01547c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:04.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.933+0000 7f3d96000640 1 --2- 172.21.15.152:0/2952363316 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3da006fa10 0x7f3da01547c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:04.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.933+0000 7f3d96000640 1 -- 172.21.15.152:0/2952363316 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3da014a4a0 con 0x7f3da00cfec0 2024-04-17T08:48:04.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.933+0000 7f3d96000640 1 --2- 172.21.15.152:0/2952363316 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3da00cfec0 0x7f3da014cb80 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f3d8800c500 tx=0x7f3d8800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:48:04.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.933+0000 7f3d97400640 1 -- 172.21.15.152:0/2952363316 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d88017070 con 0x7f3da00cfec0 2024-04-17T08:48:04.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.933+0000 7f3d97400640 1 -- 172.21.15.152:0/2952363316 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d88005cf0 con 0x7f3da00cfec0 2024-04-17T08:48:04.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.933+0000 7f3da5c00640 1 -- 172.21.15.152:0/2952363316 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3da014a780 con 0x7f3da00cfec0 2024-04-17T08:48:04.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.933+0000 7f3d97400640 1 -- 172.21.15.152:0/2952363316 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d88007330 con 0x7f3da00cfec0 2024-04-17T08:48:04.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.933+0000 7f3da5c00640 1 -- 172.21.15.152:0/2952363316 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3da0155240 con 0x7f3da00cfec0 2024-04-17T08:48:04.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.933+0000 7f3da5c00640 1 -- 172.21.15.152:0/2952363316 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3da0068a30 con 0x7f3da00cfec0 2024-04-17T08:48:04.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.937+0000 7f3d97400640 1 -- 172.21.15.152:0/2952363316 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3d8801a070 con 0x7f3da00cfec0 2024-04-17T08:48:04.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.937+0000 7f3d97400640 1 --2- 172.21.15.152:0/2952363316 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3d7c0683b0 0x7f3d7c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:04.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.937+0000 7f3d97400640 1 -- 172.21.15.152:0/2952363316 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f3d88085f00 con 0x7f3da00cfec0 2024-04-17T08:48:04.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.937+0000 7f3d9ea00640 1 --2- 172.21.15.152:0/2952363316 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3d7c0683b0 0x7f3d7c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:04.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.937+0000 7f3d9ea00640 1 --2- 172.21.15.152:0/2952363316 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3d7c0683b0 0x7f3d7c06a870 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3d90001720 tx=0x7f3d90009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:48:04.943 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:04.941+0000 7f3d97400640 1 -- 172.21.15.152:0/2952363316 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f3d88055cd0 con 0x7f3da00cfec0 2024-04-17T08:48:05.071 INFO:tasks.ceph.mds.c.smithi152.stderr:2024-04-17T08:48:05.069+0000 7f1eae200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-17T08:48:05.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.153+0000 7f3da5c00640 1 -- 172.21.15.152:0/2952363316 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f3da00af3f0 con 0x7f3da00cfec0 2024-04-17T08:48:05.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.157+0000 7f3d97400640 1 -- 172.21.15.152:0/2952363316 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) ==== 190+0+147 (secure 0 0 0) 0x7f3d88059fd0 con 0x7f3da00cfec0 2024-04-17T08:48:05.159 INFO:teuthology.orchestra.run.smithi152.stdout:[client.0] 2024-04-17T08:48:05.160 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQAkjB9mPgvRFxAAe9v2psm5V7QNTuK9ytMuxQ== 2024-04-17T08:48:05.160 INFO:teuthology.orchestra.run.smithi152.stdout: caps mds = "allow" 2024-04-17T08:48:05.160 INFO:teuthology.orchestra.run.smithi152.stdout: caps mon = "allow r" 2024-04-17T08:48:05.160 INFO:teuthology.orchestra.run.smithi152.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-17T08:48:05.160 INFO:teuthology.orchestra.run.smithi152.stderr:updated caps for client.0 2024-04-17T08:48:05.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.161+0000 7f3da5c00640 1 -- 172.21.15.152:0/2952363316 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3d7c0683b0 msgr2=0x7f3d7c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:05.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.161+0000 7f3da5c00640 1 --2- 172.21.15.152:0/2952363316 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3d7c0683b0 0x7f3d7c06a870 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3d90001720 tx=0x7f3d90009040 comp rx=0 tx=0).stop 2024-04-17T08:48:05.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.161+0000 7f3da5c00640 1 -- 172.21.15.152:0/2952363316 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3da00cfec0 msgr2=0x7f3da014cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:05.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.161+0000 7f3da5c00640 1 --2- 172.21.15.152:0/2952363316 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3da00cfec0 0x7f3da014cb80 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f3d8800c500 tx=0x7f3d8800c9c0 comp rx=0 tx=0).stop 2024-04-17T08:48:05.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.161+0000 7f3da5c00640 1 -- 172.21.15.152:0/2952363316 shutdown_connections 2024-04-17T08:48:05.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.161+0000 7f3da5c00640 1 --2- 172.21.15.152:0/2952363316 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3d7c0683b0 0x7f3d7c06a870 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:05.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.161+0000 7f3da5c00640 1 --2- 172.21.15.152:0/2952363316 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3da015e670 0x7f3da014d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:05.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.161+0000 7f3da5c00640 1 --2- 172.21.15.152:0/2952363316 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3da00cfec0 0x7f3da014cb80 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:05.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.161+0000 7f3da5c00640 1 --2- 172.21.15.152:0/2952363316 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3da006fa10 0x7f3da01547c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:05.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.161+0000 7f3da5c00640 1 -- 172.21.15.152:0/2952363316 >> 172.21.15.152:0/2952363316 conn(0x7f3da0070500 msgr2=0x7f3da0169300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:48:05.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.161+0000 7f3da5c00640 1 -- 172.21.15.152:0/2952363316 shutdown_connections 2024-04-17T08:48:05.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.161+0000 7f3da5c00640 1 -- 172.21.15.152:0/2952363316 wait complete. 2024-04-17T08:48:05.181 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T08:48:05.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.313+0000 7fd91ce00640 1 Processor -- start 2024-04-17T08:48:05.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.313+0000 7fd91ce00640 1 -- start start 2024-04-17T08:48:05.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.313+0000 7fd91ce00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd9180b5ac0 0x7fd9180d21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:05.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.313+0000 7fd91ce00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd91815fb00 con 0x7fd91815f4c0 2024-04-17T08:48:05.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.317+0000 7fd91ce00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9180b1d80 con 0x7fd9180d2710 2024-04-17T08:48:05.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.317+0000 7fd91ce00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fd9180d2b70 con 0x7fd9180b5ac0 2024-04-17T08:48:05.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.317+0000 7fd917e00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fd91815f4c0 0x7fd91806d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:33384/0 (socket says 172.21.15.152:33384) 2024-04-17T08:48:05.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.317+0000 7fd917e00640 1 -- 172.21.15.152:0/47261568 learned_addr learned my addr 172.21.15.152:0/47261568 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:48:05.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.317+0000 7fd917400640 1 --2- 172.21.15.152:0/47261568 >> v2:172.21.15.152:3300/0 conn(0x7fd9180b5ac0 0x7fd9180d21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:05.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.317+0000 7fd917400640 1 -- 172.21.15.152:0/47261568 >> v1:172.21.15.196:6789/0 conn(0x7fd9180d2710 legacy=0x7fd91815edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:05.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.317+0000 7fd917400640 1 -- 172.21.15.152:0/47261568 >> v1:172.21.15.152:6789/0 conn(0x7fd91815f4c0 legacy=0x7fd91806d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:05.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.317+0000 7fd916a00640 1 -- 172.21.15.152:0/47261568 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3932958528 0 0) 0x7fd91815fb00 con 0x7fd91815f4c0 2024-04-17T08:48:05.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.317+0000 7fd917400640 1 -- 172.21.15.152:0/47261568 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9180b2060 con 0x7fd9180b5ac0 2024-04-17T08:48:05.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.317+0000 7fd917400640 1 --2- 172.21.15.152:0/47261568 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9180b5ac0 0x7fd9180d21d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fd9080097c0 tx=0x7fd90801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55787d72dd077a83 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:48:05.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.317+0000 7fd916a00640 1 -- 172.21.15.152:0/47261568 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9080b0070 con 0x7fd9180b5ac0 2024-04-17T08:48:05.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.317+0000 7fd916a00640 1 -- 172.21.15.152:0/47261568 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9080ab400 con 0x7fd9180b5ac0 2024-04-17T08:48:05.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.317+0000 7fd916a00640 1 -- 172.21.15.152:0/47261568 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9080ab7d0 con 0x7fd9180b5ac0 2024-04-17T08:48:05.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.321+0000 7fd91ce00640 1 -- 172.21.15.152:0/47261568 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9180b5ac0 msgr2=0x7fd9180d21d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:05.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.321+0000 7fd91ce00640 1 --2- 172.21.15.152:0/47261568 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9180b5ac0 0x7fd9180d21d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fd9080097c0 tx=0x7fd90801c4a0 comp rx=0 tx=0).stop 2024-04-17T08:48:05.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.321+0000 7fd91ce00640 1 -- 172.21.15.152:0/47261568 shutdown_connections 2024-04-17T08:48:05.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.321+0000 7fd91ce00640 1 --2- 172.21.15.152:0/47261568 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9180b5ac0 0x7fd9180d21d0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:05.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.321+0000 7fd91ce00640 1 -- 172.21.15.152:0/47261568 >> 172.21.15.152:0/47261568 conn(0x7fd9180b7690 msgr2=0x7fd9180b7aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:48:05.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.321+0000 7fd91ce00640 1 -- 172.21.15.152:0/47261568 shutdown_connections 2024-04-17T08:48:05.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.321+0000 7fd91ce00640 1 -- 172.21.15.152:0/47261568 wait complete. 2024-04-17T08:48:05.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.321+0000 7fd91ce00640 1 Processor -- start 2024-04-17T08:48:05.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.321+0000 7fd91ce00640 1 -- start start 2024-04-17T08:48:05.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.321+0000 7fd91ce00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd9180b5ac0 0x7fd9181f9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:05.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.321+0000 7fd91ce00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9180d2710 0x7fd9181f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:05.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.321+0000 7fd91ce00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd91815f4c0 0x7fd918158870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:05.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.321+0000 7fd91ce00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd91816c710 con 0x7fd9180d2710 2024-04-17T08:48:05.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.321+0000 7fd91ce00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd91816c590 con 0x7fd9180b5ac0 2024-04-17T08:48:05.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.321+0000 7fd91ce00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fd91816c890 con 0x7fd91815f4c0 2024-04-17T08:48:05.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.321+0000 7fd90fe00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9180d2710 0x7fd9181f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:05.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.321+0000 7fd90fe00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9180d2710 0x7fd9181f8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51968/0 (socket says 172.21.15.152:51968) 2024-04-17T08:48:05.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.321+0000 7fd90fe00640 1 -- 172.21.15.152:0/3302949821 learned_addr learned my addr 172.21.15.152:0/3302949821 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:48:05.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.321+0000 7fd917400640 1 --2- 172.21.15.152:0/3302949821 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd9180b5ac0 0x7fd9181f9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:05.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.321+0000 7fd917e00640 1 --2- 172.21.15.152:0/3302949821 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd91815f4c0 0x7fd918158870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:05.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.325+0000 7fd90fe00640 1 -- 172.21.15.152:0/3302949821 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd91815f4c0 msgr2=0x7fd918158870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:05.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.325+0000 7fd90fe00640 1 --2- 172.21.15.152:0/3302949821 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd91815f4c0 0x7fd918158870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:05.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.325+0000 7fd90fe00640 1 -- 172.21.15.152:0/3302949821 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd9180b5ac0 msgr2=0x7fd9181f9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:05.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.325+0000 7fd90fe00640 1 --2- 172.21.15.152:0/3302949821 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd9180b5ac0 0x7fd9181f9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:05.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.325+0000 7fd90fe00640 1 -- 172.21.15.152:0/3302949821 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9181f8da0 con 0x7fd9180d2710 2024-04-17T08:48:05.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.325+0000 7fd90fe00640 1 --2- 172.21.15.152:0/3302949821 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9180d2710 0x7fd9181f8540 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fd90000c500 tx=0x7fd90000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:48:05.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.325+0000 7fd90f400640 1 -- 172.21.15.152:0/3302949821 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd900016020 con 0x7fd9180d2710 2024-04-17T08:48:05.328 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.325+0000 7fd90f400640 1 -- 172.21.15.152:0/3302949821 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd900005220 con 0x7fd9180d2710 2024-04-17T08:48:05.328 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.325+0000 7fd91ce00640 1 -- 172.21.15.152:0/3302949821 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9181f9080 con 0x7fd9180d2710 2024-04-17T08:48:05.328 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.325+0000 7fd90f400640 1 -- 172.21.15.152:0/3302949821 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd900007030 con 0x7fd9180d2710 2024-04-17T08:48:05.328 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.325+0000 7fd91ce00640 1 -- 172.21.15.152:0/3302949821 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9181f8a80 con 0x7fd9180d2710 2024-04-17T08:48:05.328 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.325+0000 7fd91ce00640 1 -- 172.21.15.152:0/3302949821 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd918075c10 con 0x7fd9180d2710 2024-04-17T08:48:05.328 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.325+0000 7fd90f400640 1 -- 172.21.15.152:0/3302949821 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd9000071f0 con 0x7fd9180d2710 2024-04-17T08:48:05.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.325+0000 7fd90f400640 1 --2- 172.21.15.152:0/3302949821 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fd8f4068380 0x7fd8f406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:05.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.325+0000 7fd90f400640 1 -- 172.21.15.152:0/3302949821 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fd900086500 con 0x7fd9180d2710 2024-04-17T08:48:05.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.325+0000 7fd917400640 1 --2- 172.21.15.152:0/3302949821 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fd8f4068380 0x7fd8f406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:05.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.329+0000 7fd917400640 1 --2- 172.21.15.152:0/3302949821 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fd8f4068380 0x7fd8f406a840 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd9080ad000 tx=0x7fd9080a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:48:05.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.329+0000 7fd90f400640 1 -- 172.21.15.152:0/3302949821 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fd900020020 con 0x7fd9180d2710 2024-04-17T08:48:05.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.521+0000 7fd91ce00640 1 -- 172.21.15.152:0/3302949821 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd918074e80 con 0x7fd9180d2710 2024-04-17T08:48:05.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.525+0000 7fd90f400640 1 -- 172.21.15.152:0/3302949821 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5211 (secure 0 0 0) 0x7fd900056250 con 0x7fd9180d2710 2024-04-17T08:48:05.526 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:48:05.526 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4973,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6835/1356093111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6833","nonce":1356093111},{"type":"v1","addr":"172.21.15.196:6835","nonce":1356093111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4982,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1048040532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1048040532},{"type":"v1","addr":"172.21.15.152:6837","nonce":1048040532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5275,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6834/2151645018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":2151645018},{"type":"v1","addr":"172.21.15.196:6834","nonce":2151645018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-17T08:47:59.653400+0000","modified":"2024-04-17T08:48:02.688952+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5508":{"gid":5508,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6835/4144515289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":4144515289},{"type":"v1","addr":"172.21.15.152:6835","nonce":4144515289}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5508,"qdb_cluster":[5508]},"id":2}]} 2024-04-17T08:48:05.526 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 18 2024-04-17T08:48:05.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.525+0000 7fd91ce00640 1 -- 172.21.15.152:0/3302949821 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fd8f4068380 msgr2=0x7fd8f406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:05.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.525+0000 7fd91ce00640 1 --2- 172.21.15.152:0/3302949821 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fd8f4068380 0x7fd8f406a840 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd9080ad000 tx=0x7fd9080a6000 comp rx=0 tx=0).stop 2024-04-17T08:48:05.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.525+0000 7fd91ce00640 1 -- 172.21.15.152:0/3302949821 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9180d2710 msgr2=0x7fd9181f8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:05.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.525+0000 7fd91ce00640 1 --2- 172.21.15.152:0/3302949821 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9180d2710 0x7fd9181f8540 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fd90000c500 tx=0x7fd90000c9c0 comp rx=0 tx=0).stop 2024-04-17T08:48:05.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.525+0000 7fd91ce00640 1 -- 172.21.15.152:0/3302949821 shutdown_connections 2024-04-17T08:48:05.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.525+0000 7fd91ce00640 1 --2- 172.21.15.152:0/3302949821 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fd8f4068380 0x7fd8f406a840 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:05.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.525+0000 7fd91ce00640 1 --2- 172.21.15.152:0/3302949821 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd91815f4c0 0x7fd918158870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:05.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.525+0000 7fd91ce00640 1 --2- 172.21.15.152:0/3302949821 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9180d2710 0x7fd9181f8540 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:05.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.525+0000 7fd91ce00640 1 --2- 172.21.15.152:0/3302949821 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd9180b5ac0 0x7fd9181f9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:05.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.525+0000 7fd91ce00640 1 -- 172.21.15.152:0/3302949821 >> 172.21.15.152:0/3302949821 conn(0x7fd9180b7690 msgr2=0x7fd918070040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:48:05.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.525+0000 7fd91ce00640 1 -- 172.21.15.152:0/3302949821 shutdown_connections 2024-04-17T08:48:05.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:05.525+0000 7fd91ce00640 1 -- 172.21.15.152:0/3302949821 wait complete. 2024-04-17T08:48:05.949 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-17T08:47:59.653400+0000', 'modified': '2024-04-17T08:48:02.688952+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'snap_rstat': True, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5508}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5508': {'gid': 5508, 'name': 'c', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.152:6835/4144515289', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6834', 'nonce': 4144515289}, {'type': 'v1', 'addr': '172.21.15.152:6835', 'nonce': 4144515289}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5508, 'qdb_cluster': [5508]} 2024-04-17T08:48:05.949 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-17T08:48:05.949 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-17T08:48:06.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.085+0000 7f17e3e00640 1 Processor -- start 2024-04-17T08:48:06.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.085+0000 7f17e3e00640 1 -- start start 2024-04-17T08:48:06.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.085+0000 7f17e3e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f17dc0af670 0x7f17dc15b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:06.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.085+0000 7f17e3e00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f17dc06f980 0x7f17dc072530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:06.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.085+0000 7f17e3e00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17dc15c260 con 0x7f17dc0d0360 2024-04-17T08:48:06.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.085+0000 7f17e3e00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f17dc15c820 con 0x7f17dc06f980 2024-04-17T08:48:06.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.085+0000 7f17e3e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f17dc15c540 con 0x7f17dc0af670 2024-04-17T08:48:06.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.085+0000 7f17e1e00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f17dc0d0360 0x7f17dc06dc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:33396/0 (socket says 172.21.15.152:33396) 2024-04-17T08:48:06.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.085+0000 7f17e0a00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f17dc06f980 0x7f17dc072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:06.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.085+0000 7f17e1e00640 1 -- 172.21.15.152:0/412103722 learned_addr learned my addr 172.21.15.152:0/412103722 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:48:06.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.085+0000 7f17e1400640 1 --2- 172.21.15.152:0/412103722 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f17dc0af670 0x7f17dc15b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:06.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.085+0000 7f17e0a00640 1 -- 172.21.15.152:0/412103722 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f17dc0af670 msgr2=0x7f17dc15b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:48:06.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.085+0000 7f17e0a00640 1 --2- 172.21.15.152:0/412103722 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f17dc0af670 0x7f17dc15b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:06.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.085+0000 7f17e0a00640 1 -- 172.21.15.152:0/412103722 >> v1:172.21.15.152:6789/0 conn(0x7f17dc0d0360 legacy=0x7f17dc06dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:06.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.085+0000 7f17e0a00640 1 -- 172.21.15.152:0/412103722 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17dc071d30 con 0x7f17dc06f980 2024-04-17T08:48:06.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.085+0000 7f17dbe00640 1 -- 172.21.15.152:0/412103722 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4178523944 0 0) 0x7f17dc15c260 con 0x7f17dc0d0360 2024-04-17T08:48:06.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.085+0000 7f17e1400640 1 --2- 172.21.15.152:0/412103722 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f17dc0af670 0x7f17dc15b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:48:06.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.089+0000 7f17e0a00640 1 --2- 172.21.15.152:0/412103722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17dc06f980 0x7f17dc072530 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f17c80097c0 tx=0x7f17c801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98549098ce727f06 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:48:06.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.089+0000 7f17dbe00640 1 -- 172.21.15.152:0/412103722 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17c80b0070 con 0x7f17dc06f980 2024-04-17T08:48:06.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.089+0000 7f17dbe00640 1 -- 172.21.15.152:0/412103722 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17c80ab600 con 0x7f17dc06f980 2024-04-17T08:48:06.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.089+0000 7f17dbe00640 1 -- 172.21.15.152:0/412103722 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17c80ab9d0 con 0x7f17dc06f980 2024-04-17T08:48:06.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.089+0000 7f17e3e00640 1 -- 172.21.15.152:0/412103722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17dc06f980 msgr2=0x7f17dc072530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:06.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.089+0000 7f17e3e00640 1 --2- 172.21.15.152:0/412103722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17dc06f980 0x7f17dc072530 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f17c80097c0 tx=0x7f17c801c3e0 comp rx=0 tx=0).stop 2024-04-17T08:48:06.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.089+0000 7f17e3e00640 1 -- 172.21.15.152:0/412103722 shutdown_connections 2024-04-17T08:48:06.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.089+0000 7f17e3e00640 1 --2- 172.21.15.152:0/412103722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17dc06f980 0x7f17dc072530 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:06.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.089+0000 7f17e3e00640 1 --2- 172.21.15.152:0/412103722 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f17dc0af670 0x7f17dc15b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:06.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.089+0000 7f17e3e00640 1 -- 172.21.15.152:0/412103722 >> 172.21.15.152:0/412103722 conn(0x7f17dc0b3350 msgr2=0x7f17dc0b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:48:06.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.089+0000 7f17e3e00640 1 -- 172.21.15.152:0/412103722 shutdown_connections 2024-04-17T08:48:06.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.089+0000 7f17e3e00640 1 -- 172.21.15.152:0/412103722 wait complete. 2024-04-17T08:48:06.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.093+0000 7f17e3e00640 1 Processor -- start 2024-04-17T08:48:06.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.093+0000 7f17e3e00640 1 -- start start 2024-04-17T08:48:06.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.093+0000 7f17e3e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f17dc06f980 0x7f17dc14f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:06.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.093+0000 7f17e3e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17dc0af670 0x7f17dc148ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:06.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.093+0000 7f17e3e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f17dc0d0360 0x7f17dc164490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:06.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.093+0000 7f17e3e00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f17dc15bf80 con 0x7f17dc0af670 2024-04-17T08:48:06.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.093+0000 7f17e3e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f17dc15be00 con 0x7f17dc0d0360 2024-04-17T08:48:06.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.093+0000 7f17e3e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f17dc072a70 con 0x7f17dc06f980 2024-04-17T08:48:06.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.093+0000 7f17e0a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17dc0af670 0x7f17dc148ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:06.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.093+0000 7f17e0a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17dc0af670 0x7f17dc148ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51982/0 (socket says 172.21.15.152:51982) 2024-04-17T08:48:06.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.093+0000 7f17e0a00640 1 -- 172.21.15.152:0/1850176989 learned_addr learned my addr 172.21.15.152:0/1850176989 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:48:06.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.093+0000 7f17e0a00640 1 -- 172.21.15.152:0/1850176989 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f17dc06f980 msgr2=0x7f17dc14f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:06.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.093+0000 7f17e0a00640 1 --2- 172.21.15.152:0/1850176989 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f17dc06f980 0x7f17dc14f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:06.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.093+0000 7f17e0a00640 1 -- 172.21.15.152:0/1850176989 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f17dc0d0360 msgr2=0x7f17dc164490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:06.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.093+0000 7f17e0a00640 1 --2- 172.21.15.152:0/1850176989 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f17dc0d0360 0x7f17dc164490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:06.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.093+0000 7f17e0a00640 1 -- 172.21.15.152:0/1850176989 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17dc14ea00 con 0x7f17dc0af670 2024-04-17T08:48:06.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.093+0000 7f17e0a00640 1 --2- 172.21.15.152:0/1850176989 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17dc0af670 0x7f17dc148ed0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f17c80097c0 tx=0x7f17c801ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:48:06.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.093+0000 7f17d9600640 1 -- 172.21.15.152:0/1850176989 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17c80b0050 con 0x7f17dc0af670 2024-04-17T08:48:06.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.093+0000 7f17d9600640 1 -- 172.21.15.152:0/1850176989 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17c80bc070 con 0x7f17dc0af670 2024-04-17T08:48:06.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.093+0000 7f17d9600640 1 -- 172.21.15.152:0/1850176989 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17c80b5a70 con 0x7f17dc0af670 2024-04-17T08:48:06.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.093+0000 7f17e3e00640 1 -- 172.21.15.152:0/1850176989 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17dc14ec70 con 0x7f17dc0af670 2024-04-17T08:48:06.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.093+0000 7f17e3e00640 1 -- 172.21.15.152:0/1850176989 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17dc151590 con 0x7f17dc0af670 2024-04-17T08:48:06.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.097+0000 7f17d9600640 1 -- 172.21.15.152:0/1850176989 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f17c80ab480 con 0x7f17dc0af670 2024-04-17T08:48:06.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.097+0000 7f17d9600640 1 --2- 172.21.15.152:0/1850176989 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f17bc068380 0x7f17bc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:06.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.097+0000 7f17d9600640 1 -- 172.21.15.152:0/1850176989 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f17c81215d0 con 0x7f17dc0af670 2024-04-17T08:48:06.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.097+0000 7f17e1400640 1 --2- 172.21.15.152:0/1850176989 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f17bc068380 0x7f17bc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:06.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.097+0000 7f17e730a000 1 Processor -- start 2024-04-17T08:48:06.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.097+0000 7f17e730a000 1 -- start start 2024-04-17T08:48:06.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.097+0000 7f17e1400640 1 --2- 172.21.15.152:0/1850176989 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f17bc068380 0x7f17bc06a840 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f17d0008ea0 tx=0x7f17d00083d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:48:06.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.097+0000 7f17e730a000 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562ba78f8b50 0x562ba78f8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:06.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.097+0000 7f17e730a000 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ba78f9470 0x562ba78ae7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:06.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.097+0000 7f17e730a000 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562ba78aecf0 0x562ba78af0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:06.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.097+0000 7f17e730a000 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x562ba76fc4d0 con 0x562ba78f8b50 2024-04-17T08:48:06.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.097+0000 7f17e730a000 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x562ba7696bf0 con 0x562ba78f9470 2024-04-17T08:48:06.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.097+0000 7f17e730a000 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x562ba76f8490 con 0x562ba78aecf0 2024-04-17T08:48:06.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.097+0000 7f17e1400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562ba78f8b50 0x562ba78f8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:06.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.097+0000 7f17e1400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562ba78f8b50 0x562ba78f8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51984/0 (socket says 172.21.15.152:51984) 2024-04-17T08:48:06.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.097+0000 7f17e1400640 1 -- 172.21.15.152:0/133245012 learned_addr learned my addr 172.21.15.152:0/133245012 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:48:06.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.101+0000 7f17e1400640 1 -- 172.21.15.152:0/133245012 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562ba78aecf0 msgr2=0x562ba78af0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:48:06.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.101+0000 7f17e1e00640 1 --2- 172.21.15.152:0/133245012 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562ba78aecf0 0x562ba78af0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:06.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.101+0000 7f17e0a00640 1 --2- 172.21.15.152:0/133245012 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ba78f9470 0x562ba78ae7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:06.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.101+0000 7f17e1400640 1 --2- 172.21.15.152:0/133245012 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562ba78aecf0 0x562ba78af0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:06.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.101+0000 7f17e1400640 1 -- 172.21.15.152:0/133245012 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ba78f9470 msgr2=0x562ba78ae7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:48:06.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.101+0000 7f17e1400640 1 --2- 172.21.15.152:0/133245012 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ba78f9470 0x562ba78ae7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:06.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.101+0000 7f17e1400640 1 -- 172.21.15.152:0/133245012 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ba7682e80 con 0x562ba78f8b50 2024-04-17T08:48:06.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.101+0000 7f17e1e00640 1 --2- 172.21.15.152:0/133245012 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562ba78aecf0 0x562ba78af0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:48:06.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.101+0000 7f17e0a00640 1 --2- 172.21.15.152:0/133245012 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ba78f9470 0x562ba78ae7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T08:48:06.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.101+0000 7f17e1400640 1 --2- 172.21.15.152:0/133245012 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562ba78f8b50 0x562ba78f8f30 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f17d000e760 tx=0x7f17d0010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2751a6f3260946df server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:48:06.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.101+0000 7f17ce000640 1 -- 172.21.15.152:0/133245012 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d000ba40 con 0x562ba78f8b50 2024-04-17T08:48:06.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.101+0000 7f17ce000640 1 -- 172.21.15.152:0/133245012 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17d000bc00 con 0x562ba78f8b50 2024-04-17T08:48:06.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.101+0000 7f17ce000640 1 -- 172.21.15.152:0/133245012 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d001b420 con 0x562ba78f8b50 2024-04-17T08:48:06.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.101+0000 7f17e730a000 1 -- 172.21.15.152:0/133245012 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562ba78f8b50 msgr2=0x562ba78f8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:06.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.101+0000 7f17e730a000 1 --2- 172.21.15.152:0/133245012 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562ba78f8b50 0x562ba78f8f30 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f17d000e760 tx=0x7f17d0010000 comp rx=0 tx=0).stop 2024-04-17T08:48:06.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.101+0000 7f17e730a000 1 -- 172.21.15.152:0/133245012 shutdown_connections 2024-04-17T08:48:06.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.101+0000 7f17e730a000 1 --2- 172.21.15.152:0/133245012 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562ba78aecf0 0x562ba78af0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:06.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.101+0000 7f17e730a000 1 --2- 172.21.15.152:0/133245012 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ba78f9470 0x562ba78ae7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:06.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.101+0000 7f17e730a000 1 --2- 172.21.15.152:0/133245012 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562ba78f8b50 0x562ba78f8f30 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:06.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.101+0000 7f17e730a000 1 -- 172.21.15.152:0/133245012 >> 172.21.15.152:0/133245012 conn(0x562ba78b4470 msgr2=0x562ba78ad090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:48:06.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.101+0000 7f17e730a000 1 -- 172.21.15.152:0/133245012 shutdown_connections 2024-04-17T08:48:06.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.101+0000 7f17e730a000 1 -- 172.21.15.152:0/133245012 wait complete. 2024-04-17T08:48:06.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.101+0000 7f17e730a000 1 -- start start 2024-04-17T08:48:06.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.101+0000 7f17e730a000 1 Processor -- start 2024-04-17T08:48:06.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.101+0000 7f17e730a000 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562ba78aecf0 0x562ba78b37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:06.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.101+0000 7f17e730a000 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ba78f8b50 0x562ba78e6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:06.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.101+0000 7f17e730a000 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562ba78f9470 0x562ba78e6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:06.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.101+0000 7f17e730a000 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x562ba76b9a60 con 0x562ba78aecf0 2024-04-17T08:48:06.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.101+0000 7f17e730a000 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x562ba76a0e80 con 0x562ba78f8b50 2024-04-17T08:48:06.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.101+0000 7f17e730a000 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x562ba76b7cf0 con 0x562ba78f9470 2024-04-17T08:48:06.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.101+0000 7f17e730a000 10 client.0 _ll_register_callbacks cb 0x562ba7899a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-17T08:48:06.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.101+0000 7f17e1400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562ba78aecf0 0x562ba78b37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:06.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.101+0000 7f17e1400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562ba78aecf0 0x562ba78b37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52000/0 (socket says 172.21.15.152:52000) 2024-04-17T08:48:06.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.101+0000 7f17e1400640 1 -- 172.21.15.152:0/3531894549 learned_addr learned my addr 172.21.15.152:0/3531894549 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:48:06.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.101+0000 7f17e0a00640 1 --2- 172.21.15.152:0/3531894549 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ba78f8b50 0x562ba78e6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:06.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.101+0000 7f17e1e00640 1 --2- 172.21.15.152:0/3531894549 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562ba78f9470 0x562ba78e6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:06.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.101+0000 7f17e1400640 1 -- 172.21.15.152:0/3531894549 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562ba78f9470 msgr2=0x562ba78e6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:48:06.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.101+0000 7f17e1400640 1 --2- 172.21.15.152:0/3531894549 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562ba78f9470 0x562ba78e6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:06.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.101+0000 7f17e1400640 1 -- 172.21.15.152:0/3531894549 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ba78f8b50 msgr2=0x562ba78e6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:48:06.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.101+0000 7f17e1400640 1 --2- 172.21.15.152:0/3531894549 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ba78f8b50 0x562ba78e6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:06.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.105+0000 7f17e1400640 1 -- 172.21.15.152:0/3531894549 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ba7696e40 con 0x562ba78aecf0 2024-04-17T08:48:06.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.105+0000 7f17e1e00640 1 --2- 172.21.15.152:0/3531894549 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562ba78f9470 0x562ba78e6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:48:06.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.105+0000 7f17e1400640 1 --2- 172.21.15.152:0/3531894549 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562ba78aecf0 0x562ba78b37e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x562ba787a8c0 tx=0x7f17d0005d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e24a2e26df12c4e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:48:06.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.105+0000 7f17c2a00640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-04-17T08:48:06.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.105+0000 7f17c2a00640 1 -- 172.21.15.152:0/3531894549 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d0031060 con 0x562ba78aecf0 2024-04-17T08:48:06.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.105+0000 7f17c2a00640 1 -- 172.21.15.152:0/3531894549 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f17d002c650 con 0x562ba78aecf0 2024-04-17T08:48:06.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.105+0000 7f17e730a000 1 -- 172.21.15.152:0/3531894549 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17d000bc00 con 0x562ba78aecf0 2024-04-17T08:48:06.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.105+0000 7f17c2a00640 1 -- 172.21.15.152:0/3531894549 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f17d0037050 con 0x562ba78aecf0 2024-04-17T08:48:06.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.105+0000 7f17e730a000 10 client.5691 fetch_fsmap learned FSMap version 18 2024-04-17T08:48:06.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.105+0000 7f17e730a000 1 -- 172.21.15.152:0/3531894549 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x562ba76c7e00 con 0x562ba78aecf0 2024-04-17T08:48:06.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.105+0000 7f17c2a00640 1 -- 172.21.15.152:0/3531894549 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17d000bc00 con 0x562ba78aecf0 2024-04-17T08:48:06.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.105+0000 7f17c2a00640 1 -- 172.21.15.152:0/3531894549 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 18) ==== 3495+0+0 (secure 0 0 0) 0x7f17d003a020 con 0x562ba78aecf0 2024-04-17T08:48:06.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.105+0000 7f17e730a000 10 client.5691 fetch_fsmap finished waiting for FSMap version 18 2024-04-17T08:48:06.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.105+0000 7f17e730a000 10 client.5691 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-17T08:48:06.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.105+0000 7f17e730a000 20 client.5691 populate_metadata read hostname 'smithi152' 2024-04-17T08:48:06.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.105+0000 7f17e730a000 1 --2- 172.21.15.152:0/3531894549 >> [v2:172.21.15.152:6834/4144515289,v1:172.21.15.152:6835/4144515289] conn(0x562ba79080b0 0x562ba790a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:06.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.105+0000 7f17e730a000 4 client.5691 mds_command: new command op to 5508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-17T08:48:06.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.105+0000 7f17e730a000 1 -- 172.21.15.152:0/3531894549 --> [v2:172.21.15.152:6834/4144515289,v1:172.21.15.152:6835/4144515289] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562ba7695bc0 con 0x562ba79080b0 2024-04-17T08:48:06.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.105+0000 7f17e0a00640 1 --2- 172.21.15.152:0/3531894549 >> [v2:172.21.15.152:6834/4144515289,v1:172.21.15.152:6835/4144515289] conn(0x562ba79080b0 0x562ba790a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:06.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.105+0000 7f17e0a00640 1 --2- 172.21.15.152:0/3531894549 >> [v2:172.21.15.152:6834/4144515289,v1:172.21.15.152:6835/4144515289] conn(0x562ba79080b0 0x562ba790a4a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44710c6822081add server_cookie=ce7acdbb06c98d57 in_seq=0 out_seq=0 2024-04-17T08:48:06.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.105+0000 7f17c2a00640 10 client.5691 ms_handle_connect on v2:172.21.15.152:6834/4144515289 2024-04-17T08:48:06.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.105+0000 7f17c2a00640 1 -- 172.21.15.152:0/3531894549 <== mds.0 v2:172.21.15.152:6834/4144515289 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562ba7695bc0 con 0x562ba79080b0 2024-04-17T08:48:06.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.105+0000 7f17c2a00640 10 client.5691 handle_command_reply: tid=0 2024-04-17T08:48:06.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.105+0000 7f17e730a000 1 client.5691 shutdown 2024-04-17T08:48:06.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.105+0000 7f17e730a000 1 -- 172.21.15.152:0/3531894549 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562ba78aecf0 msgr2=0x562ba78b37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:06.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.105+0000 7f17e730a000 1 --2- 172.21.15.152:0/3531894549 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562ba78aecf0 0x562ba78b37e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x562ba787a8c0 tx=0x7f17d0005d20 comp rx=0 tx=0).stop 2024-04-17T08:48:06.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.105+0000 7f17e730a000 1 -- 172.21.15.152:0/3531894549 shutdown_connections 2024-04-17T08:48:06.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.105+0000 7f17e730a000 1 --2- 172.21.15.152:0/3531894549 >> [v2:172.21.15.152:6834/4144515289,v1:172.21.15.152:6835/4144515289] conn(0x562ba79080b0 0x562ba790a4a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:06.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.105+0000 7f17e730a000 1 --2- 172.21.15.152:0/3531894549 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562ba78f9470 0x562ba78e6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:06.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.105+0000 7f17e730a000 1 --2- 172.21.15.152:0/3531894549 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ba78f8b50 0x562ba78e6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:06.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.105+0000 7f17e730a000 1 --2- 172.21.15.152:0/3531894549 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562ba78aecf0 0x562ba78b37e0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:06.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.105+0000 7f17c2a00640 0 client.5691 ms_handle_reset on v2:172.21.15.152:6834/4144515289 2024-04-17T08:48:06.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.105+0000 7f17e730a000 1 -- 172.21.15.152:0/3531894549 >> 172.21.15.152:0/3531894549 conn(0x562ba78b4470 msgr2=0x562ba78ad7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:48:06.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.105+0000 7f17e730a000 1 -- 172.21.15.152:0/3531894549 shutdown_connections 2024-04-17T08:48:06.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.105+0000 7f17e730a000 1 -- 172.21.15.152:0/3531894549 wait complete. 2024-04-17T08:48:06.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.105+0000 7f17e730a000 20 client.5691 trim_cache size 0 max 16384 2024-04-17T08:48:06.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.125+0000 7f17e730a000 1 Processor -- start 2024-04-17T08:48:06.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.125+0000 7f17e730a000 1 -- start start 2024-04-17T08:48:06.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.125+0000 7f17e730a000 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ba78aecf0 0x562ba78e6020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:06.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.125+0000 7f17e730a000 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562ba78f8b50 0x562ba78e6560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:06.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.125+0000 7f17e730a000 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562ba78f9470 0x562ba79094a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:06.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.125+0000 7f17e730a000 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f17dc1f7d20 con 0x562ba78f8b50 2024-04-17T08:48:06.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.125+0000 7f17e730a000 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f17dc149df0 con 0x562ba78aecf0 2024-04-17T08:48:06.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.125+0000 7f17e730a000 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f17dc1f76d0 con 0x562ba78f9470 2024-04-17T08:48:06.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.125+0000 7f17e0a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562ba78f8b50 0x562ba78e6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:06.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.125+0000 7f17e0a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562ba78f8b50 0x562ba78e6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52004/0 (socket says 172.21.15.152:52004) 2024-04-17T08:48:06.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.125+0000 7f17e0a00640 1 -- 172.21.15.152:0/3954354337 learned_addr learned my addr 172.21.15.152:0/3954354337 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:48:06.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.125+0000 7f17e1400640 1 --2- 172.21.15.152:0/3954354337 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ba78aecf0 0x562ba78e6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:06.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.125+0000 7f17e1e00640 1 --2- 172.21.15.152:0/3954354337 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562ba78f9470 0x562ba79094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:06.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.125+0000 7f17e0a00640 1 -- 172.21.15.152:0/3954354337 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562ba78f9470 msgr2=0x562ba79094a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:48:06.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.125+0000 7f17e0a00640 1 --2- 172.21.15.152:0/3954354337 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562ba78f9470 0x562ba79094a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:06.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.125+0000 7f17e0a00640 1 -- 172.21.15.152:0/3954354337 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ba78aecf0 msgr2=0x562ba78e6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:48:06.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.125+0000 7f17e0a00640 1 --2- 172.21.15.152:0/3954354337 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ba78aecf0 0x562ba78e6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:06.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.125+0000 7f17e0a00640 1 -- 172.21.15.152:0/3954354337 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ba777dd30 con 0x562ba78f8b50 2024-04-17T08:48:06.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.125+0000 7f17e0a00640 1 --2- 172.21.15.152:0/3954354337 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562ba78f8b50 0x562ba78e6560 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f17c8006cf0 tx=0x7f17c811f7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6e2771560698790 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:48:06.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.125+0000 7f17cd600640 1 -- 172.21.15.152:0/3954354337 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17c80f9e40 con 0x562ba78f8b50 2024-04-17T08:48:06.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.125+0000 7f17cd600640 1 -- 172.21.15.152:0/3954354337 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17c80b1040 con 0x562ba78f8b50 2024-04-17T08:48:06.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.125+0000 7f17cd600640 1 -- 172.21.15.152:0/3954354337 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17c80ef560 con 0x562ba78f8b50 2024-04-17T08:48:06.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.125+0000 7f17e730a000 1 -- 172.21.15.152:0/3954354337 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562ba78f8b50 msgr2=0x562ba78e6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:06.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.125+0000 7f17e730a000 1 --2- 172.21.15.152:0/3954354337 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562ba78f8b50 0x562ba78e6560 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f17c8006cf0 tx=0x7f17c811f7a0 comp rx=0 tx=0).stop 2024-04-17T08:48:06.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.125+0000 7f17e730a000 1 -- 172.21.15.152:0/3954354337 shutdown_connections 2024-04-17T08:48:06.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.125+0000 7f17e730a000 1 --2- 172.21.15.152:0/3954354337 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562ba78f9470 0x562ba79094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:06.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.125+0000 7f17e730a000 1 --2- 172.21.15.152:0/3954354337 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562ba78f8b50 0x562ba78e6560 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:06.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.125+0000 7f17e730a000 1 --2- 172.21.15.152:0/3954354337 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ba78aecf0 0x562ba78e6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:06.131 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.125+0000 7f17e730a000 1 -- 172.21.15.152:0/3954354337 >> 172.21.15.152:0/3954354337 conn(0x562ba78b4470 msgr2=0x562ba78e5910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:48:06.131 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.125+0000 7f17e730a000 1 -- 172.21.15.152:0/3954354337 shutdown_connections 2024-04-17T08:48:06.131 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.125+0000 7f17e730a000 1 -- 172.21.15.152:0/3954354337 wait complete. 2024-04-17T08:48:06.131 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.129+0000 7f17e730a000 1 -- start start 2024-04-17T08:48:06.131 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.129+0000 7f17e730a000 1 Processor -- start 2024-04-17T08:48:06.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.129+0000 7f17e730a000 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562ba78aecf0 0x562ba790cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:06.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.129+0000 7f17e730a000 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562ba78f8b50 0x562ba7924030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:06.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.129+0000 7f17e730a000 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ba78f9470 0x562ba7924570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:06.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.129+0000 7f17e730a000 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x562ba7700b00 con 0x562ba78aecf0 2024-04-17T08:48:06.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.129+0000 7f17e730a000 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x562ba76fb7e0 con 0x562ba78f9470 2024-04-17T08:48:06.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.129+0000 7f17e730a000 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x562ba77096e0 con 0x562ba78f8b50 2024-04-17T08:48:06.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.129+0000 7f17e730a000 10 client.0 _ll_register_callbacks cb 0x7f17d000e660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-17T08:48:06.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.129+0000 7f17e1400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562ba78aecf0 0x562ba790cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:06.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.129+0000 7f17e1400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562ba78aecf0 0x562ba790cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52018/0 (socket says 172.21.15.152:52018) 2024-04-17T08:48:06.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.129+0000 7f17e1400640 1 -- 172.21.15.152:0/1177104883 learned_addr learned my addr 172.21.15.152:0/1177104883 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:48:06.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.129+0000 7f17e1e00640 1 --2- 172.21.15.152:0/1177104883 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ba78f9470 0x562ba7924570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:06.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.129+0000 7f17e0a00640 1 --2- 172.21.15.152:0/1177104883 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562ba78f8b50 0x562ba7924030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:06.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.129+0000 7f17e1400640 1 -- 172.21.15.152:0/1177104883 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562ba78f8b50 msgr2=0x562ba7924030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:48:06.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.129+0000 7f17e1400640 1 --2- 172.21.15.152:0/1177104883 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562ba78f8b50 0x562ba7924030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:06.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.129+0000 7f17e1400640 1 -- 172.21.15.152:0/1177104883 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ba78f9470 msgr2=0x562ba7924570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:48:06.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.129+0000 7f17e1400640 1 --2- 172.21.15.152:0/1177104883 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ba78f9470 0x562ba7924570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:06.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.129+0000 7f17e1400640 1 -- 172.21.15.152:0/1177104883 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ba768e7c0 con 0x562ba78aecf0 2024-04-17T08:48:06.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.129+0000 7f17e1400640 1 --2- 172.21.15.152:0/1177104883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562ba78aecf0 0x562ba790cac0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f17d000dc30 tx=0x7f17d0013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d5fece973f74df6 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:48:06.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.129+0000 7f17c2a00640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-04-17T08:48:06.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.129+0000 7f17c2a00640 1 -- 172.21.15.152:0/1177104883 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d0028070 con 0x562ba78aecf0 2024-04-17T08:48:06.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.129+0000 7f17c2a00640 1 -- 172.21.15.152:0/1177104883 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f17d002cc10 con 0x562ba78aecf0 2024-04-17T08:48:06.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.129+0000 7f17e730a000 1 -- 172.21.15.152:0/1177104883 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17c80b1040 con 0x562ba78aecf0 2024-04-17T08:48:06.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.129+0000 7f17c2a00640 1 -- 172.21.15.152:0/1177104883 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f17d004a050 con 0x562ba78aecf0 2024-04-17T08:48:06.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.129+0000 7f17e730a000 10 client.5697 fetch_fsmap learned FSMap version 18 2024-04-17T08:48:06.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.129+0000 7f17e730a000 1 -- 172.21.15.152:0/1177104883 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x562ba76a1650 con 0x562ba78aecf0 2024-04-17T08:48:06.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.129+0000 7f17c2a00640 1 -- 172.21.15.152:0/1177104883 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17c80b1040 con 0x562ba78aecf0 2024-04-17T08:48:06.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.129+0000 7f17c2a00640 1 -- 172.21.15.152:0/1177104883 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 18) ==== 3495+0+0 (secure 0 0 0) 0x7f17d004d020 con 0x562ba78aecf0 2024-04-17T08:48:06.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.129+0000 7f17e730a000 10 client.5697 fetch_fsmap finished waiting for FSMap version 18 2024-04-17T08:48:06.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.129+0000 7f17e730a000 10 client.5697 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-17T08:48:06.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.129+0000 7f17e730a000 20 client.5697 populate_metadata read hostname 'smithi152' 2024-04-17T08:48:06.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.129+0000 7f17e730a000 1 --2- 172.21.15.152:0/1177104883 >> [v2:172.21.15.152:6834/4144515289,v1:172.21.15.152:6835/4144515289] conn(0x562ba7967670 0x562ba7967a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:06.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.129+0000 7f17e730a000 4 client.5697 mds_command: new command op to 5508 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-17T08:48:06.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.129+0000 7f17e730a000 1 -- 172.21.15.152:0/1177104883 --> [v2:172.21.15.152:6834/4144515289,v1:172.21.15.152:6835/4144515289] -- command(tid 0: {"prefix": "status"}) -- 0x562ba7709ef0 con 0x562ba7967670 2024-04-17T08:48:06.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.129+0000 7f17e0a00640 1 --2- 172.21.15.152:0/1177104883 >> [v2:172.21.15.152:6834/4144515289,v1:172.21.15.152:6835/4144515289] conn(0x562ba7967670 0x562ba7967a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:06.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.129+0000 7f17e0a00640 1 --2- 172.21.15.152:0/1177104883 >> [v2:172.21.15.152:6834/4144515289,v1:172.21.15.152:6835/4144515289] conn(0x562ba7967670 0x562ba7967a50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77d9aab30746b3ec server_cookie=7899cc731015b631 in_seq=0 out_seq=0 2024-04-17T08:48:06.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.129+0000 7f17c2a00640 10 client.5697 ms_handle_connect on v2:172.21.15.152:6834/4144515289 2024-04-17T08:48:06.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.129+0000 7f17c2a00640 1 -- 172.21.15.152:0/1177104883 <== mds.0 v2:172.21.15.152:6834/4144515289 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x562ba7709ef0 con 0x562ba7967670 2024-04-17T08:48:06.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.129+0000 7f17c2a00640 10 client.5697 handle_command_reply: tid=0 2024-04-17T08:48:06.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.129+0000 7f17e730a000 1 client.5697 shutdown 2024-04-17T08:48:06.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.129+0000 7f17e730a000 1 -- 172.21.15.152:0/1177104883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562ba78aecf0 msgr2=0x562ba790cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:06.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.129+0000 7f17e730a000 1 --2- 172.21.15.152:0/1177104883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562ba78aecf0 0x562ba790cac0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f17d000dc30 tx=0x7f17d0013000 comp rx=0 tx=0).stop 2024-04-17T08:48:06.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.133+0000 7f17e730a000 1 -- 172.21.15.152:0/1177104883 shutdown_connections 2024-04-17T08:48:06.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.133+0000 7f17e730a000 1 --2- 172.21.15.152:0/1177104883 >> [v2:172.21.15.152:6834/4144515289,v1:172.21.15.152:6835/4144515289] conn(0x562ba7967670 0x562ba7967a50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:06.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.133+0000 7f17e730a000 1 --2- 172.21.15.152:0/1177104883 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ba78f9470 0x562ba7924570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:06.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.133+0000 7f17e730a000 1 --2- 172.21.15.152:0/1177104883 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562ba78f8b50 0x562ba7924030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:06.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.133+0000 7f17e730a000 1 --2- 172.21.15.152:0/1177104883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562ba78aecf0 0x562ba790cac0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:06.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.133+0000 7f17c2a00640 0 client.5697 ms_handle_reset on v2:172.21.15.152:6834/4144515289 2024-04-17T08:48:06.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.133+0000 7f17e730a000 1 -- 172.21.15.152:0/1177104883 >> 172.21.15.152:0/1177104883 conn(0x562ba78b4470 msgr2=0x562ba78b0070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:48:06.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.133+0000 7f17e730a000 1 -- 172.21.15.152:0/1177104883 shutdown_connections 2024-04-17T08:48:06.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.133+0000 7f17e730a000 1 -- 172.21.15.152:0/1177104883 wait complete. 2024-04-17T08:48:06.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.133+0000 7f17e730a000 20 client.5697 trim_cache size 0 max 16384 2024-04-17T08:48:06.138 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-17T08:48:06.138 INFO:teuthology.orchestra.run.smithi152.stdout: "cluster_fsid": "ce68f82e-ec5f-4205-9fd5-bdfdf6ef31e2", 2024-04-17T08:48:06.138 INFO:teuthology.orchestra.run.smithi152.stdout: "whoami": 0, 2024-04-17T08:48:06.138 INFO:teuthology.orchestra.run.smithi152.stdout: "id": 5508, 2024-04-17T08:48:06.138 INFO:teuthology.orchestra.run.smithi152.stdout: "want_state": "up:active", 2024-04-17T08:48:06.138 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "up:active", 2024-04-17T08:48:06.138 INFO:teuthology.orchestra.run.smithi152.stdout: "fs_name": "cephfs", 2024-04-17T08:48:06.138 INFO:teuthology.orchestra.run.smithi152.stdout: "rank_uptime": 5.8448591929999996, 2024-04-17T08:48:06.138 INFO:teuthology.orchestra.run.smithi152.stdout: "mdsmap_epoch": 18, 2024-04-17T08:48:06.138 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_epoch": 38, 2024-04-17T08:48:06.138 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_epoch_barrier": 38, 2024-04-17T08:48:06.138 INFO:teuthology.orchestra.run.smithi152.stdout: "uptime": 12.862557578000001 2024-04-17T08:48:06.139 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-17T08:48:06.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.133+0000 7f17e3e00640 1 -- 172.21.15.152:0/1850176989 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f17bc068380 msgr2=0x7f17bc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:06.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.133+0000 7f17e3e00640 1 --2- 172.21.15.152:0/1850176989 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f17bc068380 0x7f17bc06a840 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f17d0008ea0 tx=0x7f17d00083d0 comp rx=0 tx=0).stop 2024-04-17T08:48:06.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.133+0000 7f17e3e00640 1 -- 172.21.15.152:0/1850176989 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17dc0af670 msgr2=0x7f17dc148ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:06.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.133+0000 7f17e3e00640 1 --2- 172.21.15.152:0/1850176989 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17dc0af670 0x7f17dc148ed0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f17c80097c0 tx=0x7f17c801ac20 comp rx=0 tx=0).stop 2024-04-17T08:48:06.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.133+0000 7f17e3e00640 1 -- 172.21.15.152:0/1850176989 shutdown_connections 2024-04-17T08:48:06.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.133+0000 7f17e3e00640 1 --2- 172.21.15.152:0/1850176989 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f17dc0d0360 0x7f17dc164490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:06.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.133+0000 7f17e3e00640 1 --2- 172.21.15.152:0/1850176989 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17dc0af670 0x7f17dc148ed0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:06.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.133+0000 7f17e3e00640 1 --2- 172.21.15.152:0/1850176989 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f17bc068380 0x7f17bc06a840 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:06.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.133+0000 7f17e3e00640 1 --2- 172.21.15.152:0/1850176989 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f17dc06f980 0x7f17dc14f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:06.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.133+0000 7f17e3e00640 1 -- 172.21.15.152:0/1850176989 >> 172.21.15.152:0/1850176989 conn(0x7f17dc0b3350 msgr2=0x7f17dc0ae210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:48:06.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.133+0000 7f17e3e00640 1 -- 172.21.15.152:0/1850176989 shutdown_connections 2024-04-17T08:48:06.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.133+0000 7f17e3e00640 1 -- 172.21.15.152:0/1850176989 wait complete. 2024-04-17T08:48:06.153 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-17T08:48:06.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.285+0000 7f0a80a00640 1 Processor -- start 2024-04-17T08:48:06.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.285+0000 7f0a80a00640 1 -- start start 2024-04-17T08:48:06.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.289+0000 7f0a80a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0a7c145ea0 0x7f0a7c0d0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:06.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.289+0000 7f0a80a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0a7c071790 0x7f0a7c071be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:06.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.289+0000 7f0a80a00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a7c0ccbb0 con 0x7f0a7c0d0790 2024-04-17T08:48:06.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.289+0000 7f0a80a00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f0a7c072120 con 0x7f0a7c145ea0 2024-04-17T08:48:06.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.289+0000 7f0a80a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f0a7c0cce90 con 0x7f0a7c071790 2024-04-17T08:48:06.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.289+0000 7f0a79e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0a7c145ea0 0x7f0a7c0d0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:06.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.289+0000 7f0a7a800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0a7c071790 0x7f0a7c071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:06.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.289+0000 7f0a71400640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f0a7c0d0790 0x7f0a7c0c7230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.152:57356/0 (socket says 172.21.15.152:57356) 2024-04-17T08:48:06.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.289+0000 7f0a71400640 1 -- 172.21.15.152:0/540169837 learned_addr learned my addr 172.21.15.152:0/540169837 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:48:06.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.289+0000 7f0a7a800640 1 -- 172.21.15.152:0/540169837 >> v2:172.21.15.196:3300/0 conn(0x7f0a7c145ea0 msgr2=0x7f0a7c0d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:48:06.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.289+0000 7f0a7a800640 1 --2- 172.21.15.152:0/540169837 >> v2:172.21.15.196:3300/0 conn(0x7f0a7c145ea0 0x7f0a7c0d0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:06.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.289+0000 7f0a7a800640 1 -- 172.21.15.152:0/540169837 >> v1:172.21.15.196:6789/0 conn(0x7f0a7c0d0790 legacy=0x7f0a7c0c7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:06.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.289+0000 7f0a7a800640 1 -- 172.21.15.152:0/540169837 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a7c0cd170 con 0x7f0a7c071790 2024-04-17T08:48:06.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.289+0000 7f0a79400640 1 -- 172.21.15.152:0/540169837 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2600122017 0 0) 0x7f0a7c0ccbb0 con 0x7f0a7c0d0790 2024-04-17T08:48:06.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.289+0000 7f0a79e00640 1 --2- 172.21.15.152:0/540169837 >> v2:172.21.15.196:3300/0 conn(0x7f0a7c145ea0 0x7f0a7c0d0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T08:48:06.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.293+0000 7f0a7a800640 1 --2- 172.21.15.152:0/540169837 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0a7c071790 0x7f0a7c071be0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0a74009d90 tx=0x7f0a7401c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc6a03a336858cd0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:48:06.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.293+0000 7f0a79400640 1 -- 172.21.15.152:0/540169837 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a740b2070 con 0x7f0a7c071790 2024-04-17T08:48:06.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.293+0000 7f0a79400640 1 -- 172.21.15.152:0/540169837 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a740a5830 con 0x7f0a7c071790 2024-04-17T08:48:06.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.293+0000 7f0a79400640 1 -- 172.21.15.152:0/540169837 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a740a5c00 con 0x7f0a7c071790 2024-04-17T08:48:06.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.293+0000 7f0a80a00640 1 -- 172.21.15.152:0/540169837 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0a7c071790 msgr2=0x7f0a7c071be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:06.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.293+0000 7f0a80a00640 1 --2- 172.21.15.152:0/540169837 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0a7c071790 0x7f0a7c071be0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0a74009d90 tx=0x7f0a7401c970 comp rx=0 tx=0).stop 2024-04-17T08:48:06.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.293+0000 7f0a80a00640 1 -- 172.21.15.152:0/540169837 shutdown_connections 2024-04-17T08:48:06.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.293+0000 7f0a80a00640 1 --2- 172.21.15.152:0/540169837 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0a7c071790 0x7f0a7c071be0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:06.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.293+0000 7f0a80a00640 1 --2- 172.21.15.152:0/540169837 >> v2:172.21.15.196:3300/0 conn(0x7f0a7c145ea0 0x7f0a7c0d0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:06.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.293+0000 7f0a80a00640 1 -- 172.21.15.152:0/540169837 >> 172.21.15.152:0/540169837 conn(0x7f0a7c0d2350 msgr2=0x7f0a7c0d2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:48:06.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.293+0000 7f0a80a00640 1 -- 172.21.15.152:0/540169837 shutdown_connections 2024-04-17T08:48:06.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.293+0000 7f0a80a00640 1 -- 172.21.15.152:0/540169837 wait complete. 2024-04-17T08:48:06.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.297+0000 7f0a80a00640 1 Processor -- start 2024-04-17T08:48:06.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.297+0000 7f0a80a00640 1 -- start start 2024-04-17T08:48:06.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.297+0000 7f0a80a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0a7c071790 0x7f0a7c15bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:06.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.297+0000 7f0a80a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a7c0d0790 0x7f0a7c0cb340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:06.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.297+0000 7f0a80a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0a7c145ea0 0x7f0a7c15dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:06.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.297+0000 7f0a80a00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0a7c0c7ac0 con 0x7f0a7c0d0790 2024-04-17T08:48:06.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.297+0000 7f0a80a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0a7c0c7940 con 0x7f0a7c071790 2024-04-17T08:48:06.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.297+0000 7f0a80a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f0a7c169490 con 0x7f0a7c145ea0 2024-04-17T08:48:06.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.297+0000 7f0a71400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a7c0d0790 0x7f0a7c0cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:06.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.297+0000 7f0a71400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a7c0d0790 0x7f0a7c0cb340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52020/0 (socket says 172.21.15.152:52020) 2024-04-17T08:48:06.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.297+0000 7f0a71400640 1 -- 172.21.15.152:0/2609649923 learned_addr learned my addr 172.21.15.152:0/2609649923 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:48:06.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.297+0000 7f0a79e00640 1 --2- 172.21.15.152:0/2609649923 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0a7c071790 0x7f0a7c15bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:06.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.297+0000 7f0a7a800640 1 --2- 172.21.15.152:0/2609649923 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0a7c145ea0 0x7f0a7c15dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:06.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.297+0000 7f0a71400640 1 -- 172.21.15.152:0/2609649923 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0a7c145ea0 msgr2=0x7f0a7c15dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:06.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.297+0000 7f0a71400640 1 --2- 172.21.15.152:0/2609649923 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0a7c145ea0 0x7f0a7c15dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:06.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.297+0000 7f0a71400640 1 -- 172.21.15.152:0/2609649923 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0a7c071790 msgr2=0x7f0a7c15bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:06.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.297+0000 7f0a71400640 1 --2- 172.21.15.152:0/2609649923 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0a7c071790 0x7f0a7c15bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:06.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.297+0000 7f0a71400640 1 -- 172.21.15.152:0/2609649923 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a7c06ece0 con 0x7f0a7c0d0790 2024-04-17T08:48:06.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.297+0000 7f0a71400640 1 --2- 172.21.15.152:0/2609649923 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a7c0d0790 0x7f0a7c0cb340 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f0a6400c520 tx=0x7f0a6400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:48:06.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.297+0000 7f0a72a00640 1 -- 172.21.15.152:0/2609649923 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a64018070 con 0x7f0a7c0d0790 2024-04-17T08:48:06.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.297+0000 7f0a72a00640 1 -- 172.21.15.152:0/2609649923 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a640074e0 con 0x7f0a7c0d0790 2024-04-17T08:48:06.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.297+0000 7f0a72a00640 1 -- 172.21.15.152:0/2609649923 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a640049f0 con 0x7f0a7c0d0790 2024-04-17T08:48:06.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.297+0000 7f0a80a00640 1 -- 172.21.15.152:0/2609649923 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a7c06efc0 con 0x7f0a7c0d0790 2024-04-17T08:48:06.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.297+0000 7f0a80a00640 1 -- 172.21.15.152:0/2609649923 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a7c13db50 con 0x7f0a7c0d0790 2024-04-17T08:48:06.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.297+0000 7f0a80a00640 1 -- 172.21.15.152:0/2609649923 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a7c068a30 con 0x7f0a7c0d0790 2024-04-17T08:48:06.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.301+0000 7f0a72a00640 1 -- 172.21.15.152:0/2609649923 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0a64004b90 con 0x7f0a7c0d0790 2024-04-17T08:48:06.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.301+0000 7f0a72a00640 1 --2- 172.21.15.152:0/2609649923 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0a580683b0 0x7f0a5806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:06.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.301+0000 7f0a72a00640 1 -- 172.21.15.152:0/2609649923 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f0a64085f00 con 0x7f0a7c0d0790 2024-04-17T08:48:06.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.301+0000 7f0a79e00640 1 --2- 172.21.15.152:0/2609649923 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0a580683b0 0x7f0a5806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:06.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.301+0000 7f0a79e00640 1 --2- 172.21.15.152:0/2609649923 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0a580683b0 0x7f0a5806a870 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c009580 tx=0x7f0a6c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:48:06.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.305+0000 7f0a72a00640 1 -- 172.21.15.152:0/2609649923 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f0a64055c40 con 0x7f0a7c0d0790 2024-04-17T08:48:06.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.497+0000 7f0a80a00640 1 -- 172.21.15.152:0/2609649923 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f0a7c0c7230 con 0x7f0a7c0d0790 2024-04-17T08:48:06.502 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.501+0000 7f0a72a00640 1 -- 172.21.15.152:0/2609649923 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) ==== 53+0+73 (secure 0 0 0) 0x7f0a64059f40 con 0x7f0a7c0d0790 2024-04-17T08:48:06.502 INFO:teuthology.orchestra.run.smithi152.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-17T08:48:06.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.501+0000 7f0a80a00640 1 -- 172.21.15.152:0/2609649923 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0a580683b0 msgr2=0x7f0a5806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:06.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.501+0000 7f0a80a00640 1 --2- 172.21.15.152:0/2609649923 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0a580683b0 0x7f0a5806a870 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c009580 tx=0x7f0a6c009190 comp rx=0 tx=0).stop 2024-04-17T08:48:06.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.501+0000 7f0a80a00640 1 -- 172.21.15.152:0/2609649923 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a7c0d0790 msgr2=0x7f0a7c0cb340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:06.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.501+0000 7f0a80a00640 1 --2- 172.21.15.152:0/2609649923 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a7c0d0790 0x7f0a7c0cb340 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f0a6400c520 tx=0x7f0a6400c9e0 comp rx=0 tx=0).stop 2024-04-17T08:48:06.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.501+0000 7f0a80a00640 1 -- 172.21.15.152:0/2609649923 shutdown_connections 2024-04-17T08:48:06.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.501+0000 7f0a80a00640 1 --2- 172.21.15.152:0/2609649923 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0a580683b0 0x7f0a5806a870 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:06.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.501+0000 7f0a80a00640 1 --2- 172.21.15.152:0/2609649923 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0a7c145ea0 0x7f0a7c15dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:06.504 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.501+0000 7f0a80a00640 1 --2- 172.21.15.152:0/2609649923 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a7c0d0790 0x7f0a7c0cb340 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:06.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.501+0000 7f0a80a00640 1 --2- 172.21.15.152:0/2609649923 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0a7c071790 0x7f0a7c15bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:06.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.501+0000 7f0a80a00640 1 -- 172.21.15.152:0/2609649923 >> 172.21.15.152:0/2609649923 conn(0x7f0a7c0d2350 msgr2=0x7f0a7c0b1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:48:06.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.501+0000 7f0a80a00640 1 -- 172.21.15.152:0/2609649923 shutdown_connections 2024-04-17T08:48:06.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06.501+0000 7f0a80a00640 1 -- 172.21.15.152:0/2609649923 wait complete. 2024-04-17T08:48:06.523 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-17T08:48:06.523 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-17T08:48:06.523 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi152.front.sepia.ceph.com 2024-04-17T08:48:06.523 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-17T08:48:06.523 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-17T08:48:06.523 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-17T08:48:06.524 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-17T08:48:06.524 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-17T08:48:06.524 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-17T08:48:06.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:48:06.524 DEBUG:teuthology.orchestra.run.smithi152:> ip addr 2024-04-17T08:48:06.533 INFO:teuthology.orchestra.run.smithi152.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-17T08:48:06.533 INFO:teuthology.orchestra.run.smithi152.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-17T08:48:06.533 INFO:teuthology.orchestra.run.smithi152.stdout: inet 127.0.0.1/8 scope host lo 2024-04-17T08:48:06.533 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-04-17T08:48:06.533 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 ::1/128 scope host 2024-04-17T08:48:06.533 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-04-17T08:48:06.533 INFO:teuthology.orchestra.run.smithi152.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-17T08:48:06.533 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:da:6c:44 brd ff:ff:ff:ff:ff:ff 2024-04-17T08:48:06.533 INFO:teuthology.orchestra.run.smithi152.stdout: altname enp7s0f0 2024-04-17T08:48:06.533 INFO:teuthology.orchestra.run.smithi152.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-17T08:48:06.533 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:da:6c:45 brd ff:ff:ff:ff:ff:ff 2024-04-17T08:48:06.533 INFO:teuthology.orchestra.run.smithi152.stdout: altname enp7s0f1 2024-04-17T08:48:06.533 INFO:teuthology.orchestra.run.smithi152.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-17T08:48:06.533 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:88:6d:e2 brd ff:ff:ff:ff:ff:ff 2024-04-17T08:48:06.534 INFO:teuthology.orchestra.run.smithi152.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-17T08:48:06.534 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:88:6d:e3 brd ff:ff:ff:ff:ff:ff 2024-04-17T08:48:06.534 INFO:teuthology.orchestra.run.smithi152.stdout: inet 172.21.15.152/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-17T08:48:06.534 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft 42348sec preferred_lft 42348sec 2024-04-17T08:48:06.534 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 fe80::ec4:7aff:fe88:6de3/64 scope link 2024-04-17T08:48:06.534 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-04-17T08:48:06.534 INFO:teuthology.orchestra.run.smithi152.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-17T08:48:06.534 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 02:42:bf:a8:e8:00 brd ff:ff:ff:ff:ff:ff 2024-04-17T08:48:06.534 INFO:teuthology.orchestra.run.smithi152.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-17T08:48:06.534 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-04-17T08:48:06.534 INFO:teuthology.orchestra.run.smithi152.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-17T08:48:06.534 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-17T08:48:06.534 INFO:teuthology.orchestra.run.smithi152.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-17T08:48:06.534 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-04-17T08:48:06.535 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-17T08:48:06.535 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-04-17T08:48:06.535 INFO:teuthology.orchestra.run.smithi152.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-17T08:48:06.535 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-17T08:48:06.535 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-17T08:48:06.535 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-04-17T08:48:06.535 INFO:teuthology.orchestra.run.smithi152.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-17T08:48:06.535 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-17T08:48:06.535 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-17T08:48:06.535 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-04-17T08:48:06.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:48:06.536 DEBUG:teuthology.orchestra.run.smithi152:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-17T08:48:06.594 INFO:teuthology.orchestra.run.smithi152.stdout:1 2024-04-17T08:48:06.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:48:06.596 DEBUG:teuthology.orchestra.run.smithi152:> route 2024-04-17T08:48:06.648 INFO:teuthology.orchestra.run.smithi152.stdout:Kernel IP routing table 2024-04-17T08:48:06.648 INFO:teuthology.orchestra.run.smithi152.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-17T08:48:06.648 INFO:teuthology.orchestra.run.smithi152.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-17T08:48:06.648 INFO:teuthology.orchestra.run.smithi152.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-17T08:48:06.648 INFO:teuthology.orchestra.run.smithi152.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-17T08:48:06.648 INFO:teuthology.orchestra.run.smithi152.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-17T08:48:06.648 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-17T08:48:06.648 INFO:teuthology.orchestra.run.smithi152.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-17T08:48:06.648 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-17T08:48:06.648 INFO:teuthology.orchestra.run.smithi152.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-17T08:48:06.648 INFO:teuthology.orchestra.run.smithi152.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-17T08:48:06.649 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T08:48:06.649 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2024-04-17T08:48:06.649 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-17T08:48:06.649 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-17T08:48:06.649 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-17T08:48:06.649 DEBUG:teuthology.orchestra.run.smithi152:> ') 2024-04-17T08:48:06.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T08:48:06.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T08:48:06.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:48:06.781 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list 2024-04-17T08:48:06.790 INFO:teuthology.orchestra.run.smithi152.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-17T08:48:06.790 INFO:teuthology.orchestra.run.smithi152.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-17T08:48:06.790 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-17T08:48:06.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:48:06.790 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link set brx.0 up 2024-04-17T08:48:06.852 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-17T08:48:06.852 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-17T08:48:06.853 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-17T08:48:06.905 INFO:teuthology.orchestra.run.smithi152.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-17T08:48:06.905 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-17T08:48:06.905 DEBUG:teuthology.orchestra.run.smithi152:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-17T08:48:06.956 DEBUG:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2024-04-17T08:48:07.020 DEBUG:teuthology.orchestra.run.smithi152:> cat /proc/self/mounts | awk '{print $2}' 2024-04-17T08:48:07.074 INFO:teuthology.orchestra.run.smithi152.stdout:/sys 2024-04-17T08:48:07.075 INFO:teuthology.orchestra.run.smithi152.stdout:/proc 2024-04-17T08:48:07.075 INFO:teuthology.orchestra.run.smithi152.stdout:/dev 2024-04-17T08:48:07.075 INFO:teuthology.orchestra.run.smithi152.stdout:/dev/pts 2024-04-17T08:48:07.075 INFO:teuthology.orchestra.run.smithi152.stdout:/run 2024-04-17T08:48:07.075 INFO:teuthology.orchestra.run.smithi152.stdout:/ 2024-04-17T08:48:07.075 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/kernel/security 2024-04-17T08:48:07.075 INFO:teuthology.orchestra.run.smithi152.stdout:/dev/shm 2024-04-17T08:48:07.075 INFO:teuthology.orchestra.run.smithi152.stdout:/run/lock 2024-04-17T08:48:07.075 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/cgroup 2024-04-17T08:48:07.075 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/pstore 2024-04-17T08:48:07.075 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/bpf 2024-04-17T08:48:07.075 INFO:teuthology.orchestra.run.smithi152.stdout:/proc/sys/fs/binfmt_misc 2024-04-17T08:48:07.075 INFO:teuthology.orchestra.run.smithi152.stdout:/dev/hugepages 2024-04-17T08:48:07.075 INFO:teuthology.orchestra.run.smithi152.stdout:/dev/mqueue 2024-04-17T08:48:07.076 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/kernel/debug 2024-04-17T08:48:07.076 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/kernel/tracing 2024-04-17T08:48:07.076 INFO:teuthology.orchestra.run.smithi152.stdout:/proc/fs/nfsd 2024-04-17T08:48:07.076 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/fuse/connections 2024-04-17T08:48:07.076 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/kernel/config 2024-04-17T08:48:07.076 INFO:teuthology.orchestra.run.smithi152.stdout:/run/credentials/systemd-sysusers.service 2024-04-17T08:48:07.076 INFO:teuthology.orchestra.run.smithi152.stdout:/run/rpc_pipefs 2024-04-17T08:48:07.076 INFO:teuthology.orchestra.run.smithi152.stdout:/run/user/1000 2024-04-17T08:48:07.076 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph 2024-04-17T08:48:07.076 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph/osd/ceph-0 2024-04-17T08:48:07.076 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph/osd/ceph-1 2024-04-17T08:48:07.076 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph/osd/ceph-2 2024-04-17T08:48:07.076 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph/osd/ceph-3 2024-04-17T08:48:07.076 INFO:teuthology.orchestra.run.smithi152.stdout:/run/netns 2024-04-17T08:48:07.076 INFO:teuthology.orchestra.run.smithi152.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-17T08:48:07.076 INFO:teuthology.orchestra.run.smithi152.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-17T08:48:07.077 INFO:teuthology.orchestra.run.smithi152.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-17T08:48:07.077 INFO:teuthology.orchestra.run.smithi152.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-17T08:48:07.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:48:07.077 DEBUG:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2024-04-17T08:48:07.133 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-17T08:48:07.133 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-17T08:48:07.180 DEBUG:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2024-04-17T08:48:07.200 DEBUG:teuthology.orchestra.run.smithi152:> cat /proc/self/mounts | awk '{print $2}' 2024-04-17T08:48:07.254 INFO:teuthology.orchestra.run.smithi152.stdout:/sys 2024-04-17T08:48:07.254 INFO:teuthology.orchestra.run.smithi152.stdout:/proc 2024-04-17T08:48:07.255 INFO:teuthology.orchestra.run.smithi152.stdout:/dev 2024-04-17T08:48:07.255 INFO:teuthology.orchestra.run.smithi152.stdout:/dev/pts 2024-04-17T08:48:07.255 INFO:teuthology.orchestra.run.smithi152.stdout:/run 2024-04-17T08:48:07.255 INFO:teuthology.orchestra.run.smithi152.stdout:/ 2024-04-17T08:48:07.255 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/kernel/security 2024-04-17T08:48:07.255 INFO:teuthology.orchestra.run.smithi152.stdout:/dev/shm 2024-04-17T08:48:07.255 INFO:teuthology.orchestra.run.smithi152.stdout:/run/lock 2024-04-17T08:48:07.255 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/cgroup 2024-04-17T08:48:07.255 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/pstore 2024-04-17T08:48:07.255 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/bpf 2024-04-17T08:48:07.255 INFO:teuthology.orchestra.run.smithi152.stdout:/proc/sys/fs/binfmt_misc 2024-04-17T08:48:07.255 INFO:teuthology.orchestra.run.smithi152.stdout:/dev/hugepages 2024-04-17T08:48:07.255 INFO:teuthology.orchestra.run.smithi152.stdout:/dev/mqueue 2024-04-17T08:48:07.255 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/kernel/debug 2024-04-17T08:48:07.255 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/kernel/tracing 2024-04-17T08:48:07.255 INFO:teuthology.orchestra.run.smithi152.stdout:/proc/fs/nfsd 2024-04-17T08:48:07.255 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/fuse/connections 2024-04-17T08:48:07.256 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/kernel/config 2024-04-17T08:48:07.256 INFO:teuthology.orchestra.run.smithi152.stdout:/run/credentials/systemd-sysusers.service 2024-04-17T08:48:07.256 INFO:teuthology.orchestra.run.smithi152.stdout:/run/rpc_pipefs 2024-04-17T08:48:07.256 INFO:teuthology.orchestra.run.smithi152.stdout:/run/user/1000 2024-04-17T08:48:07.256 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph 2024-04-17T08:48:07.256 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph/osd/ceph-0 2024-04-17T08:48:07.256 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph/osd/ceph-1 2024-04-17T08:48:07.256 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph/osd/ceph-2 2024-04-17T08:48:07.256 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph/osd/ceph-3 2024-04-17T08:48:07.256 INFO:teuthology.orchestra.run.smithi152.stdout:/run/netns 2024-04-17T08:48:07.256 INFO:teuthology.orchestra.run.smithi152.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-17T08:48:07.256 INFO:teuthology.orchestra.run.smithi152.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-17T08:48:07.256 INFO:teuthology.orchestra.run.smithi152.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-17T08:48:07.256 INFO:teuthology.orchestra.run.smithi152.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-17T08:48:07.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:48:07.257 DEBUG:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2024-04-17T08:48:07.272 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:2024-04-17T08:48:07.269+0000 7f9dc04d3580 -1 init, newargv = 0x562021826b10 newargc=15 2024-04-17T08:48:07.272 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:ceph-fuse[39245]: starting ceph client 2024-04-17T08:48:07.280 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:ceph-fuse[39245]: starting fuse 2024-04-17T08:48:07.281 INFO:teuthology.orchestra.run.smithi152.stdout:44 2024-04-17T08:48:07.281 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-04-17T08:48:07.281 DEBUG:teuthology.orchestra.run.smithi152:> sudo stdin-killer -- python3 -c ' 2024-04-17T08:48:07.281 DEBUG:teuthology.orchestra.run.smithi152:> import glob 2024-04-17T08:48:07.281 DEBUG:teuthology.orchestra.run.smithi152:> import re 2024-04-17T08:48:07.282 DEBUG:teuthology.orchestra.run.smithi152:> import os 2024-04-17T08:48:07.282 DEBUG:teuthology.orchestra.run.smithi152:> import subprocess 2024-04-17T08:48:07.282 DEBUG:teuthology.orchestra.run.smithi152:> 2024-04-17T08:48:07.282 DEBUG:teuthology.orchestra.run.smithi152:> def _find_admin_socket(client_name): 2024-04-17T08:48:07.282 DEBUG:teuthology.orchestra.run.smithi152:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-17T08:48:07.282 DEBUG:teuthology.orchestra.run.smithi152:> files = glob.glob(asok_path) 2024-04-17T08:48:07.282 DEBUG:teuthology.orchestra.run.smithi152:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-17T08:48:07.282 DEBUG:teuthology.orchestra.run.smithi152:> 2024-04-17T08:48:07.282 DEBUG:teuthology.orchestra.run.smithi152:> # Given a non-glob path, it better be there 2024-04-17T08:48:07.282 DEBUG:teuthology.orchestra.run.smithi152:> if "*" not in asok_path: 2024-04-17T08:48:07.282 DEBUG:teuthology.orchestra.run.smithi152:> assert(len(files) == 1) 2024-04-17T08:48:07.282 DEBUG:teuthology.orchestra.run.smithi152:> return files[0] 2024-04-17T08:48:07.282 DEBUG:teuthology.orchestra.run.smithi152:> 2024-04-17T08:48:07.283 DEBUG:teuthology.orchestra.run.smithi152:> for f in files: 2024-04-17T08:48:07.283 DEBUG:teuthology.orchestra.run.smithi152:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-17T08:48:07.283 DEBUG:teuthology.orchestra.run.smithi152:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-17T08:48:07.283 DEBUG:teuthology.orchestra.run.smithi152:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-17T08:48:07.283 DEBUG:teuthology.orchestra.run.smithi152:> contents = proc_f.read() 2024-04-17T08:48:07.283 DEBUG:teuthology.orchestra.run.smithi152:> if mountpoint in contents: 2024-04-17T08:48:07.283 DEBUG:teuthology.orchestra.run.smithi152:> return f 2024-04-17T08:48:07.283 DEBUG:teuthology.orchestra.run.smithi152:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-17T08:48:07.283 DEBUG:teuthology.orchestra.run.smithi152:> 2024-04-17T08:48:07.283 DEBUG:teuthology.orchestra.run.smithi152:> print(_find_admin_socket("client.0")) 2024-04-17T08:48:07.283 DEBUG:teuthology.orchestra.run.smithi152:> ' 2024-04-17T08:48:07.405 INFO:teuthology.orchestra.run.smithi152.stdout:/var/run/ceph/ceph-client.0.39245.asok 2024-04-17T08:48:07.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T08:48:07.416 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.39245.asok 2024-04-17T08:48:07.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:48:07.416 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.39245.asok status 2024-04-17T08:48:07.588 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-17T08:48:07.588 INFO:teuthology.orchestra.run.smithi152.stdout: "metadata": { 2024-04-17T08:48:07.588 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_sha1": "a8c84f5997950fd7d008204839253291d52e6eda", 2024-04-17T08:48:07.588 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_version": "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)", 2024-04-17T08:48:07.588 INFO:teuthology.orchestra.run.smithi152.stdout: "entity_id": "0", 2024-04-17T08:48:07.588 INFO:teuthology.orchestra.run.smithi152.stdout: "hostname": "smithi152", 2024-04-17T08:48:07.588 INFO:teuthology.orchestra.run.smithi152.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-17T08:48:07.588 INFO:teuthology.orchestra.run.smithi152.stdout: "pid": "39245", 2024-04-17T08:48:07.588 INFO:teuthology.orchestra.run.smithi152.stdout: "root": "/" 2024-04-17T08:48:07.588 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-17T08:48:07.588 INFO:teuthology.orchestra.run.smithi152.stdout: "dentry_count": 0, 2024-04-17T08:48:07.588 INFO:teuthology.orchestra.run.smithi152.stdout: "dentry_pinned_count": 0, 2024-04-17T08:48:07.588 INFO:teuthology.orchestra.run.smithi152.stdout: "id": 5706, 2024-04-17T08:48:07.589 INFO:teuthology.orchestra.run.smithi152.stdout: "inst": { 2024-04-17T08:48:07.589 INFO:teuthology.orchestra.run.smithi152.stdout: "name": { 2024-04-17T08:48:07.589 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "client", 2024-04-17T08:48:07.589 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 5706 2024-04-17T08:48:07.589 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-17T08:48:07.589 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": { 2024-04-17T08:48:07.589 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2024-04-17T08:48:07.589 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "192.168.0.1:0", 2024-04-17T08:48:07.589 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 2898839903 2024-04-17T08:48:07.589 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-04-17T08:48:07.589 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-17T08:48:07.589 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": { 2024-04-17T08:48:07.589 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2024-04-17T08:48:07.589 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "192.168.0.1:0", 2024-04-17T08:48:07.589 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 2898839903 2024-04-17T08:48:07.590 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-04-17T08:48:07.590 INFO:teuthology.orchestra.run.smithi152.stdout: "inst_str": "client.5706 192.168.0.1:0/2898839903", 2024-04-17T08:48:07.590 INFO:teuthology.orchestra.run.smithi152.stdout: "addr_str": "192.168.0.1:0/2898839903", 2024-04-17T08:48:07.590 INFO:teuthology.orchestra.run.smithi152.stdout: "inode_count": 1, 2024-04-17T08:48:07.590 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_epoch": 18, 2024-04-17T08:48:07.590 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_epoch": 38, 2024-04-17T08:48:07.590 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_epoch_barrier": 0, 2024-04-17T08:48:07.590 INFO:teuthology.orchestra.run.smithi152.stdout: "blocklisted": false, 2024-04-17T08:48:07.590 INFO:teuthology.orchestra.run.smithi152.stdout: "fs_name": "cephfs" 2024-04-17T08:48:07.590 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-17T08:48:07.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:48:07.603 DEBUG:teuthology.orchestra.run.smithi152:> stat --file-system '--printf=%T 2024-04-17T08:48:07.603 DEBUG:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-17T08:48:07.612 INFO:teuthology.orchestra.run.smithi152.stdout:fuseblk 2024-04-17T08:48:07.612 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-17T08:48:07.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:48:07.613 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-17T08:48:07.676 DEBUG:teuthology.orchestra.run.smithi152:> mktemp -d --suffix=xfstests-dev 2024-04-17T08:48:07.724 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/tmp.pJW3k3pP3vxfstests-dev 2024-04-17T08:48:07.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:48:07.725 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.pJW3k3pP3vxfstests-dev) 2024-04-17T08:48:07.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:48:07.786 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.pJW3k3pP3vxfstests-dev) 2024-04-17T08:48:07.847 INFO:teuthology.orchestra.run.smithi152.stderr:Cloning into '/tmp/tmp.pJW3k3pP3vxfstests-dev'... 2024-04-17T08:48:08.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:48:08.735 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2024-04-17T08:48:08.792 DEBUG:teuthology.orchestra.run.smithi152:> mktemp -d --suffix=test 2024-04-17T08:48:08.841 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/tmp.N9QxrNRIp4test 2024-04-17T08:48:08.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:48:08.841 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2024-04-17T08:48:08.896 DEBUG:teuthology.orchestra.run.smithi152:> mktemp -d --suffix=scratch 2024-04-17T08:48:08.944 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/tmp.nJOkJrBaf6scratch 2024-04-17T08:48:08.945 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "ubuntu" and "22.04". 2024-04-17T08:48:08.945 DEBUG:teuthology.orchestra.run.smithi152:> sudo apt-get install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc git indent libacl1-dev libaio-dev libcap-dev libgdbm-dev libtool libtool-bin liburing-dev libuuid1 lvm2 make psmisc python3 quota sed uuid-dev uuid-runtime xfsprogs sqlite3 exfatprogs f2fs-tools ocfs2-tools udftools xfsdump xfslibs-dev 2024-04-17T08:48:09.062 INFO:teuthology.orchestra.run.smithi152.stdout:Reading package lists... 2024-04-17T08:48:09.238 INFO:teuthology.orchestra.run.smithi152.stdout:Building dependency tree... 2024-04-17T08:48:09.239 INFO:teuthology.orchestra.run.smithi152.stdout:Reading state information... 2024-04-17T08:48:09.419 INFO:teuthology.orchestra.run.smithi152.stdout:acl is already the newest version (2.3.1-1). 2024-04-17T08:48:09.419 INFO:teuthology.orchestra.run.smithi152.stdout:acl set to manually installed. 2024-04-17T08:48:09.419 INFO:teuthology.orchestra.run.smithi152.stdout:attr is already the newest version (1:2.5.1-1build1). 2024-04-17T08:48:09.419 INFO:teuthology.orchestra.run.smithi152.stdout:automake is already the newest version (1:1.16.5-1.3). 2024-04-17T08:48:09.419 INFO:teuthology.orchestra.run.smithi152.stdout:bc is already the newest version (1.07.1-3build1). 2024-04-17T08:48:09.419 INFO:teuthology.orchestra.run.smithi152.stdout:gcc is already the newest version (4:11.2.0-1ubuntu1). 2024-04-17T08:48:09.419 INFO:teuthology.orchestra.run.smithi152.stdout:gcc set to manually installed. 2024-04-17T08:48:09.420 INFO:teuthology.orchestra.run.smithi152.stdout:libacl1-dev is already the newest version (2.3.1-1). 2024-04-17T08:48:09.420 INFO:teuthology.orchestra.run.smithi152.stdout:libaio-dev is already the newest version (0.3.112-13build1). 2024-04-17T08:48:09.420 INFO:teuthology.orchestra.run.smithi152.stdout:libtool is already the newest version (2.4.6-15build2). 2024-04-17T08:48:09.420 INFO:teuthology.orchestra.run.smithi152.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-17T08:48:09.420 INFO:teuthology.orchestra.run.smithi152.stdout:lvm2 is already the newest version (2.03.11-2.1ubuntu4). 2024-04-17T08:48:09.420 INFO:teuthology.orchestra.run.smithi152.stdout:make is already the newest version (4.3-4.1build1). 2024-04-17T08:48:09.420 INFO:teuthology.orchestra.run.smithi152.stdout:make set to manually installed. 2024-04-17T08:48:09.420 INFO:teuthology.orchestra.run.smithi152.stdout:psmisc is already the newest version (23.4-2build3). 2024-04-17T08:48:09.420 INFO:teuthology.orchestra.run.smithi152.stdout:quota is already the newest version (4.06-1build2). 2024-04-17T08:48:09.420 INFO:teuthology.orchestra.run.smithi152.stdout:sed is already the newest version (4.8-1ubuntu2). 2024-04-17T08:48:09.420 INFO:teuthology.orchestra.run.smithi152.stdout:xfsdump is already the newest version (3.1.9+0+nmu2). 2024-04-17T08:48:09.420 INFO:teuthology.orchestra.run.smithi152.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-17T08:48:09.420 INFO:teuthology.orchestra.run.smithi152.stdout:xfsprogs is already the newest version (5.13.0-1ubuntu2). 2024-04-17T08:48:09.420 INFO:teuthology.orchestra.run.smithi152.stdout:dbench is already the newest version (4.0-2build1). 2024-04-17T08:48:09.420 INFO:teuthology.orchestra.run.smithi152.stdout:dump is already the newest version (0.4b47-3). 2024-04-17T08:48:09.420 INFO:teuthology.orchestra.run.smithi152.stdout:e2fsprogs is already the newest version (1.46.5-2ubuntu1.1). 2024-04-17T08:48:09.421 INFO:teuthology.orchestra.run.smithi152.stdout:git is already the newest version (1:2.34.1-1ubuntu1.10). 2024-04-17T08:48:09.421 INFO:teuthology.orchestra.run.smithi152.stdout:indent is already the newest version (2.2.12-1ubuntu0.22.04.1). 2024-04-17T08:48:09.421 INFO:teuthology.orchestra.run.smithi152.stdout:libuuid1 is already the newest version (2.37.2-4ubuntu3.4). 2024-04-17T08:48:09.421 INFO:teuthology.orchestra.run.smithi152.stdout:python3 is already the newest version (3.10.6-1~22.04). 2024-04-17T08:48:09.421 INFO:teuthology.orchestra.run.smithi152.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3.4). 2024-04-17T08:48:09.421 INFO:teuthology.orchestra.run.smithi152.stdout:The following packages were automatically installed and are no longer required: 2024-04-17T08:48:09.421 INFO:teuthology.orchestra.run.smithi152.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libiscsi7 libpmemobj1 2024-04-17T08:48:09.421 INFO:teuthology.orchestra.run.smithi152.stdout: libpython2-dev libpython2-stdlib libpython2.7 libpython2.7-dev 2024-04-17T08:48:09.421 INFO:teuthology.orchestra.run.smithi152.stdout: libpython2.7-minimal libpython2.7-stdlib linux-image-5.4.0-135-generic 2024-04-17T08:48:09.421 INFO:teuthology.orchestra.run.smithi152.stdout: linux-modules-5.4.0-135-generic python2 python2-dev python2-minimal 2024-04-17T08:48:09.422 INFO:teuthology.orchestra.run.smithi152.stdout: python2.7 python2.7-dev python2.7-minimal 2024-04-17T08:48:09.422 INFO:teuthology.orchestra.run.smithi152.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-17T08:48:09.422 INFO:teuthology.orchestra.run.smithi152.stdout:The following additional packages will be installed: 2024-04-17T08:48:09.422 INFO:teuthology.orchestra.run.smithi152.stdout: libcap2 libcmap4 libcorosync-common4 libdlm3 libpmemblk1 libqb100 2024-04-17T08:48:09.422 INFO:teuthology.orchestra.run.smithi152.stdout: libsqlite3-0 2024-04-17T08:48:09.422 INFO:teuthology.orchestra.run.smithi152.stdout:Suggested packages: 2024-04-17T08:48:09.423 INFO:teuthology.orchestra.run.smithi152.stdout: gnuplot gfio python-scipy gawk-doc sqlite3-doc dvd+rw-tools udfclient 2024-04-17T08:48:09.466 INFO:teuthology.orchestra.run.smithi152.stdout:The following NEW packages will be installed: 2024-04-17T08:48:09.466 INFO:teuthology.orchestra.run.smithi152.stdout: exfatprogs f2fs-tools fio libcap-dev libcmap4 libcorosync-common4 libdlm3 2024-04-17T08:48:09.467 INFO:teuthology.orchestra.run.smithi152.stdout: libgdbm-dev libpmemblk1 libqb100 liburing-dev ocfs2-tools sqlite3 udftools 2024-04-17T08:48:09.468 INFO:teuthology.orchestra.run.smithi152.stdout:The following packages will be upgraded: 2024-04-17T08:48:09.469 INFO:teuthology.orchestra.run.smithi152.stdout: gawk libcap2 libsqlite3-0 uuid-runtime 2024-04-17T08:48:09.650 INFO:teuthology.orchestra.run.smithi152.stdout:4 upgraded, 14 newly installed, 0 to remove and 297 not upgraded. 2024-04-17T08:48:09.650 INFO:teuthology.orchestra.run.smithi152.stdout:Need to get 7,314 kB of archives. 2024-04-17T08:48:09.651 INFO:teuthology.orchestra.run.smithi152.stdout:After this operation, 14.2 MB of additional disk space will be used. 2024-04-17T08:48:09.651 INFO:teuthology.orchestra.run.smithi152.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-runtime amd64 2.37.2-4ubuntu3.4 [32.0 kB] 2024-04-17T08:48:09.855 INFO:teuthology.orchestra.run.smithi152.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 gawk amd64 1:5.1.0-1ubuntu0.1 [447 kB] 2024-04-17T08:48:10.210 INFO:teuthology.orchestra.run.smithi152.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 libcorosync-common4 amd64 3.1.6-1ubuntu1 [7,322 B] 2024-04-17T08:48:10.212 INFO:teuthology.orchestra.run.smithi152.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqb100 amd64 2.0.4-1ubuntu0.2 [74.2 kB] 2024-04-17T08:48:10.230 INFO:teuthology.orchestra.run.smithi152.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 libcmap4 amd64 3.1.6-1ubuntu1 [10.4 kB] 2024-04-17T08:48:10.233 INFO:teuthology.orchestra.run.smithi152.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libdlm3 amd64 4.1.1-1build1 [14.4 kB] 2024-04-17T08:48:10.236 INFO:teuthology.orchestra.run.smithi152.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 ocfs2-tools amd64 1.8.7-1build1 [646 kB] 2024-04-17T08:48:10.325 INFO:teuthology.orchestra.run.smithi152.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libcap2 amd64 1:2.44-1ubuntu0.22.04.1 [18.3 kB] 2024-04-17T08:48:10.327 INFO:teuthology.orchestra.run.smithi152.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libsqlite3-0 amd64 3.37.2-2ubuntu0.3 [641 kB] 2024-04-17T08:48:10.376 INFO:teuthology.orchestra.run.smithi152.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 exfatprogs amd64 1.1.3-1 [40.3 kB] 2024-04-17T08:48:10.378 INFO:teuthology.orchestra.run.smithi152.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 f2fs-tools amd64 1.14.0-2build1 [169 kB] 2024-04-17T08:48:10.552 INFO:teuthology.orchestra.run.smithi152.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libpmemblk1 amd64 1.11.1-3build1 [65.6 kB] 2024-04-17T08:48:10.837 INFO:teuthology.orchestra.run.smithi152.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 fio amd64 3.28-1 [4,047 kB] 2024-04-17T08:48:11.357 INFO:teuthology.orchestra.run.smithi152.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libcap-dev amd64 1:2.44-1ubuntu0.22.04.1 [39.4 kB] 2024-04-17T08:48:11.358 INFO:teuthology.orchestra.run.smithi152.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libgdbm-dev amd64 1.23-1 [117 kB] 2024-04-17T08:48:11.360 INFO:teuthology.orchestra.run.smithi152.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 liburing-dev amd64 2.1-2build1 [51.8 kB] 2024-04-17T08:48:11.361 INFO:teuthology.orchestra.run.smithi152.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 sqlite3 amd64 3.37.2-2ubuntu0.3 [768 kB] 2024-04-17T08:48:11.381 INFO:teuthology.orchestra.run.smithi152.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 udftools amd64 2.3-1 [125 kB] 2024-04-17T08:48:11.651 INFO:teuthology.orchestra.run.smithi152.stderr:debconf: unable to initialize frontend: Dialog 2024-04-17T08:48:11.652 INFO:teuthology.orchestra.run.smithi152.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2024-04-17T08:48:11.652 INFO:teuthology.orchestra.run.smithi152.stderr:debconf: falling back to frontend: Readline 2024-04-17T08:48:11.672 INFO:teuthology.orchestra.run.smithi152.stderr:debconf: unable to initialize frontend: Readline 2024-04-17T08:48:11.673 INFO:teuthology.orchestra.run.smithi152.stderr:debconf: (This frontend requires a controlling tty.) 2024-04-17T08:48:11.673 INFO:teuthology.orchestra.run.smithi152.stderr:debconf: falling back to frontend: Teletype 2024-04-17T08:48:11.679 INFO:teuthology.orchestra.run.smithi152.stderr:dpkg-preconfigure: unable to re-open stdin: 2024-04-17T08:48:11.718 INFO:teuthology.orchestra.run.smithi152.stdout:Fetched 7,314 kB in 2s (3,834 kB/s) 2024-04-17T08:48:11.965 INFO:teuthology.orchestra.run.smithi152.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143725 files and directories currently installed.) 2024-04-17T08:48:11.968 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../0-uuid-runtime_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-17T08:48:12.099 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking uuid-runtime (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-17T08:48:12.504 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../1-gawk_1%3a5.1.0-1ubuntu0.1_amd64.deb ... 2024-04-17T08:48:12.623 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking gawk (1:5.1.0-1ubuntu0.1) over (1:5.1.0-1build3) ... 2024-04-17T08:48:13.109 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libcorosync-common4:amd64. 2024-04-17T08:48:13.125 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../2-libcorosync-common4_3.1.6-1ubuntu1_amd64.deb ... 2024-04-17T08:48:13.210 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libcorosync-common4:amd64 (3.1.6-1ubuntu1) ... 2024-04-17T08:48:13.539 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libqb100:amd64. 2024-04-17T08:48:13.554 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../3-libqb100_2.0.4-1ubuntu0.2_amd64.deb ... 2024-04-17T08:48:13.597 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libqb100:amd64 (2.0.4-1ubuntu0.2) ... 2024-04-17T08:48:13.926 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libcmap4:amd64. 2024-04-17T08:48:13.941 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../4-libcmap4_3.1.6-1ubuntu1_amd64.deb ... 2024-04-17T08:48:13.984 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libcmap4:amd64 (3.1.6-1ubuntu1) ... 2024-04-17T08:48:14.288 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libdlm3:amd64. 2024-04-17T08:48:14.304 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../5-libdlm3_4.1.1-1build1_amd64.deb ... 2024-04-17T08:48:14.338 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libdlm3:amd64 (4.1.1-1build1) ... 2024-04-17T08:48:14.725 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ocfs2-tools. 2024-04-17T08:48:14.741 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../6-ocfs2-tools_1.8.7-1build1_amd64.deb ... 2024-04-17T08:48:14.783 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ocfs2-tools (1.8.7-1build1) ... 2024-04-17T08:48:15.164 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../7-libcap2_1%3a2.44-1ubuntu0.22.04.1_amd64.deb ... 2024-04-17T08:48:15.290 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libcap2:amd64 (1:2.44-1ubuntu0.22.04.1) over (1:2.44-1build3) ... 2024-04-17T08:48:15.628 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libcap2:amd64 (1:2.44-1ubuntu0.22.04.1) ... 2024-04-17T08:48:16.082 INFO:teuthology.orchestra.run.smithi152.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143799 files and directories currently installed.) 2024-04-17T08:48:16.086 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../0-libsqlite3-0_3.37.2-2ubuntu0.3_amd64.deb ... 2024-04-17T08:48:16.225 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libsqlite3-0:amd64 (3.37.2-2ubuntu0.3) over (3.37.2-2ubuntu0.1) ... 2024-04-17T08:48:16.579 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package exfatprogs. 2024-04-17T08:48:16.595 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../1-exfatprogs_1.1.3-1_amd64.deb ... 2024-04-17T08:48:16.638 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking exfatprogs (1.1.3-1) ... 2024-04-17T08:48:16.967 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package f2fs-tools. 2024-04-17T08:48:16.982 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../2-f2fs-tools_1.14.0-2build1_amd64.deb ... 2024-04-17T08:48:17.067 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking f2fs-tools (1.14.0-2build1) ... 2024-04-17T08:48:17.429 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libpmemblk1:amd64. 2024-04-17T08:48:17.444 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../3-libpmemblk1_1.11.1-3build1_amd64.deb ... 2024-04-17T08:48:17.488 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libpmemblk1:amd64 (1.11.1-3build1) ... 2024-04-17T08:48:17.808 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package fio. 2024-04-17T08:48:17.823 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../4-fio_3.28-1_amd64.deb ... 2024-04-17T08:48:17.858 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking fio (3.28-1) ... 2024-04-17T08:48:18.296 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libcap-dev:amd64. 2024-04-17T08:48:18.311 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../5-libcap-dev_1%3a2.44-1ubuntu0.22.04.1_amd64.deb ... 2024-04-17T08:48:18.346 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libcap-dev:amd64 (1:2.44-1ubuntu0.22.04.1) ... 2024-04-17T08:48:18.610 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libgdbm-dev:amd64. 2024-04-17T08:48:18.624 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../6-libgdbm-dev_1.23-1_amd64.deb ... 2024-04-17T08:48:18.668 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libgdbm-dev:amd64 (1.23-1) ... 2024-04-17T08:48:19.206 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package liburing-dev:amd64. 2024-04-17T08:48:19.221 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../7-liburing-dev_2.1-2build1_amd64.deb ... 2024-04-17T08:48:19.264 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking liburing-dev:amd64 (2.1-2build1) ... 2024-04-17T08:48:19.510 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package sqlite3. 2024-04-17T08:48:19.525 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../8-sqlite3_3.37.2-2ubuntu0.3_amd64.deb ... 2024-04-17T08:48:19.559 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking sqlite3 (3.37.2-2ubuntu0.3) ... 2024-04-17T08:48:19.930 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package udftools. 2024-04-17T08:48:19.945 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../9-udftools_2.3-1_amd64.deb ... 2024-04-17T08:48:20.026 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking udftools (2.3-1) ... 2024-04-17T08:48:20.332 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up exfatprogs (1.1.3-1) ... 2024-04-17T08:48:20.453 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up gawk (1:5.1.0-1ubuntu0.1) ... 2024-04-17T08:48:20.689 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up f2fs-tools (1.14.0-2build1) ... 2024-04-17T08:48:20.940 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libsqlite3-0:amd64 (3.37.2-2ubuntu0.3) ... 2024-04-17T08:48:21.066 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libqb100:amd64 (2.0.4-1ubuntu0.2) ... 2024-04-17T08:48:21.193 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libcorosync-common4:amd64 (3.1.6-1ubuntu1) ... 2024-04-17T08:48:21.319 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libpmemblk1:amd64 (1.11.1-3build1) ... 2024-04-17T08:48:21.437 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up uuid-runtime (2.37.2-4ubuntu3.4) ... 2024-04-17T08:48:22.165 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T08:48:22.168 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T08:48:22.486 INFO:teuthology.orchestra.run.smithi152.stdout:uuidd.service is a disabled or a static unit not running, not starting it. 2024-04-17T08:48:22.548 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up udftools (2.3-1) ... 2024-04-17T08:48:22.699 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libdlm3:amd64 (4.1.1-1build1) ... 2024-04-17T08:48:22.817 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libgdbm-dev:amd64 (1.23-1) ... 2024-04-17T08:48:22.918 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libcap-dev:amd64 (1:2.44-1ubuntu0.22.04.1) ... 2024-04-17T08:48:23.045 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up sqlite3 (3.37.2-2ubuntu0.3) ... 2024-04-17T08:48:23.179 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up liburing-dev:amd64 (2.1-2build1) ... 2024-04-17T08:48:23.306 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libcmap4:amd64 (3.1.6-1ubuntu1) ... 2024-04-17T08:48:23.432 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up fio (3.28-1) ... 2024-04-17T08:48:24.159 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ocfs2-tools (1.8.7-1build1) ... 2024-04-17T08:48:24.414 INFO:teuthology.orchestra.run.smithi152.stdout:debconf: unable to initialize frontend: Dialog 2024-04-17T08:48:24.415 INFO:teuthology.orchestra.run.smithi152.stdout:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2024-04-17T08:48:24.415 INFO:teuthology.orchestra.run.smithi152.stdout:debconf: falling back to frontend: Readline 2024-04-17T08:48:25.479 INFO:teuthology.orchestra.run.smithi152.stdout:Processing triggers for initramfs-tools (0.140ubuntu13.1) ... 2024-04-17T08:48:25.576 INFO:teuthology.orchestra.run.smithi152.stdout:update-initramfs: Generating /boot/initrd.img-6.9.0-rc3-g3f60ed14f7c1 2024-04-17T08:48:40.268 INFO:teuthology.orchestra.run.smithi152.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-17T08:48:40.419 INFO:teuthology.orchestra.run.smithi152.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-17T08:48:41.773 INFO:teuthology.orchestra.run.smithi152.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-17T08:48:42.301 DEBUG:teuthology.orchestra.run.smithi152:> sudo useradd -m fsgqa 2024-04-17T08:48:42.320 INFO:teuthology.orchestra.run.smithi152.stderr:useradd: user 'fsgqa' already exists 2024-04-17T08:48:42.322 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-04-17T08:48:42.322 DEBUG:teuthology.orchestra.run.smithi152:> sudo groupadd fsgqa 2024-04-17T08:48:42.382 INFO:teuthology.orchestra.run.smithi152.stderr:groupadd: group 'fsgqa' already exists 2024-04-17T08:48:42.384 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-04-17T08:48:42.384 DEBUG:teuthology.orchestra.run.smithi152:> sudo useradd fsgqa2 2024-04-17T08:48:42.797 DEBUG:teuthology.orchestra.run.smithi152:> sudo useradd 123456-fsgqa 2024-04-17T08:48:43.176 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2024-04-17T08:48:43.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.309+0000 7f2b68200640 1 Processor -- start 2024-04-17T08:48:43.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.309+0000 7f2b68200640 1 -- start start 2024-04-17T08:48:43.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.313+0000 7f2b68200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f2b6015a010 0x7f2b600d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:43.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.313+0000 7f2b68200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2b60160720 0x7f2b600d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:43.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.313+0000 7f2b68200640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b60160d20 con 0x7f2b6015d710 2024-04-17T08:48:43.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.313+0000 7f2b68200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f2b6015d280 con 0x7f2b6015a010 2024-04-17T08:48:43.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.313+0000 7f2b68200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f2b6015c9d0 con 0x7f2b60160720 2024-04-17T08:48:43.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.313+0000 7f2b64e00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f2b6015d710 0x7f2b60160010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:34540/0 (socket says 172.21.15.152:34540) 2024-04-17T08:48:43.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.313+0000 7f2b64e00640 1 -- 172.21.15.152:0/2406578833 learned_addr learned my addr 172.21.15.152:0/2406578833 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:48:43.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.313+0000 7f2b66200640 1 --2- 172.21.15.152:0/2406578833 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2b60160720 0x7f2b600d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:43.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.313+0000 7f2b65800640 1 --2- 172.21.15.152:0/2406578833 >> v2:172.21.15.196:3300/0 conn(0x7f2b6015a010 0x7f2b600d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:43.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.313+0000 7f2b5fe00640 1 -- 172.21.15.152:0/2406578833 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1922554515 0 0) 0x7f2b60160d20 con 0x7f2b6015d710 2024-04-17T08:48:43.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.313+0000 7f2b5fe00640 1 -- 172.21.15.152:0/2406578833 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b48003530 con 0x7f2b6015d710 2024-04-17T08:48:43.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.313+0000 7f2b66200640 1 -- 172.21.15.152:0/2406578833 >> v2:172.21.15.196:3300/0 conn(0x7f2b6015a010 msgr2=0x7f2b600d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T08:48:43.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.313+0000 7f2b66200640 1 --2- 172.21.15.152:0/2406578833 >> v2:172.21.15.196:3300/0 conn(0x7f2b6015a010 0x7f2b600d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:43.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.313+0000 7f2b66200640 1 -- 172.21.15.152:0/2406578833 >> v1:172.21.15.152:6789/0 conn(0x7f2b6015d710 legacy=0x7f2b60160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:43.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.313+0000 7f2b66200640 1 -- 172.21.15.152:0/2406578833 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b6015cc30 con 0x7f2b60160720 2024-04-17T08:48:43.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.313+0000 7f2b65800640 1 --2- 172.21.15.152:0/2406578833 >> v2:172.21.15.196:3300/0 conn(0x7f2b6015a010 0x7f2b600d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T08:48:43.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.317+0000 7f2b66200640 1 --2- 172.21.15.152:0/2406578833 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2b60160720 0x7f2b600d08a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2b58009d90 tx=0x7f2b5801c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ff0580af887d910 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:48:43.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.317+0000 7f2b5fe00640 1 -- 172.21.15.152:0/2406578833 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b580b2070 con 0x7f2b60160720 2024-04-17T08:48:43.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.317+0000 7f2b5fe00640 1 -- 172.21.15.152:0/2406578833 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b580a5870 con 0x7f2b60160720 2024-04-17T08:48:43.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.317+0000 7f2b5fe00640 1 -- 172.21.15.152:0/2406578833 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b580a5c40 con 0x7f2b60160720 2024-04-17T08:48:43.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.317+0000 7f2b68200640 1 -- 172.21.15.152:0/2406578833 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2b60160720 msgr2=0x7f2b600d08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:43.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.317+0000 7f2b68200640 1 --2- 172.21.15.152:0/2406578833 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2b60160720 0x7f2b600d08a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2b58009d90 tx=0x7f2b5801c8e0 comp rx=0 tx=0).stop 2024-04-17T08:48:43.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.317+0000 7f2b68200640 1 -- 172.21.15.152:0/2406578833 shutdown_connections 2024-04-17T08:48:43.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.317+0000 7f2b68200640 1 --2- 172.21.15.152:0/2406578833 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2b60160720 0x7f2b600d08a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:43.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.317+0000 7f2b68200640 1 --2- 172.21.15.152:0/2406578833 >> v2:172.21.15.196:3300/0 conn(0x7f2b6015a010 0x7f2b600d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:43.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.317+0000 7f2b68200640 1 -- 172.21.15.152:0/2406578833 >> 172.21.15.152:0/2406578833 conn(0x7f2b600b3350 msgr2=0x7f2b600b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:48:43.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.317+0000 7f2b68200640 1 -- 172.21.15.152:0/2406578833 shutdown_connections 2024-04-17T08:48:43.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.317+0000 7f2b68200640 1 -- 172.21.15.152:0/2406578833 wait complete. 2024-04-17T08:48:43.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.317+0000 7f2b68200640 1 Processor -- start 2024-04-17T08:48:43.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.317+0000 7f2b68200640 1 -- start start 2024-04-17T08:48:43.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.321+0000 7f2b68200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2b6015a010 0x7f2b60151790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:43.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.321+0000 7f2b68200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2b6015d710 0x7f2b600b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:43.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.321+0000 7f2b68200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2b60160720 0x7f2b600b2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:43.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.321+0000 7f2b68200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2b6015e780 con 0x7f2b60160720 2024-04-17T08:48:43.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.321+0000 7f2b68200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f2b6015e600 con 0x7f2b6015d710 2024-04-17T08:48:43.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.321+0000 7f2b68200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f2b6015e900 con 0x7f2b6015a010 2024-04-17T08:48:43.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.321+0000 7f2b66200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2b60160720 0x7f2b600b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:43.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.321+0000 7f2b66200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2b60160720 0x7f2b600b2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51554/0 (socket says 172.21.15.152:51554) 2024-04-17T08:48:43.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.321+0000 7f2b66200640 1 -- 172.21.15.152:0/591435734 learned_addr learned my addr 172.21.15.152:0/591435734 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:48:43.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.321+0000 7f2b65800640 1 --2- 172.21.15.152:0/591435734 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2b6015a010 0x7f2b60151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:43.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.321+0000 7f2b64e00640 1 --2- 172.21.15.152:0/591435734 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2b6015d710 0x7f2b600b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:43.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.321+0000 7f2b66200640 1 -- 172.21.15.152:0/591435734 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2b6015a010 msgr2=0x7f2b60151790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:43.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.321+0000 7f2b66200640 1 --2- 172.21.15.152:0/591435734 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2b6015a010 0x7f2b60151790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:43.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.321+0000 7f2b66200640 1 -- 172.21.15.152:0/591435734 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2b6015d710 msgr2=0x7f2b600b22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:43.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.321+0000 7f2b66200640 1 --2- 172.21.15.152:0/591435734 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2b6015d710 0x7f2b600b22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:43.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.321+0000 7f2b66200640 1 -- 172.21.15.152:0/591435734 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b6015bae0 con 0x7f2b60160720 2024-04-17T08:48:43.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.321+0000 7f2b66200640 1 --2- 172.21.15.152:0/591435734 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2b60160720 0x7f2b600b2820 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f2b580b0040 tx=0x7f2b58019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:48:43.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.321+0000 7f2b5d600640 1 -- 172.21.15.152:0/591435734 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b580b2050 con 0x7f2b60160720 2024-04-17T08:48:43.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.321+0000 7f2b5d600640 1 -- 172.21.15.152:0/591435734 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b580be070 con 0x7f2b60160720 2024-04-17T08:48:43.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.321+0000 7f2b5d600640 1 -- 172.21.15.152:0/591435734 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b580ad890 con 0x7f2b60160720 2024-04-17T08:48:43.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.321+0000 7f2b68200640 1 -- 172.21.15.152:0/591435734 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b6015bdc0 con 0x7f2b60160720 2024-04-17T08:48:43.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.321+0000 7f2b68200640 1 -- 172.21.15.152:0/591435734 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b6015c380 con 0x7f2b60160720 2024-04-17T08:48:43.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.321+0000 7f2b68200640 1 -- 172.21.15.152:0/591435734 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b60068a30 con 0x7f2b60160720 2024-04-17T08:48:43.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.321+0000 7f2b5d600640 1 -- 172.21.15.152:0/591435734 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2b580ada30 con 0x7f2b60160720 2024-04-17T08:48:43.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.325+0000 7f2b5d600640 1 --2- 172.21.15.152:0/591435734 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f2b400683b0 0x7f2b4006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:43.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.325+0000 7f2b5d600640 1 -- 172.21.15.152:0/591435734 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6130+0+0 (secure 0 0 0) 0x7f2b58121470 con 0x7f2b60160720 2024-04-17T08:48:43.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.325+0000 7f2b65800640 1 --2- 172.21.15.152:0/591435734 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f2b400683b0 0x7f2b4006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:43.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.325+0000 7f2b65800640 1 --2- 172.21.15.152:0/591435734 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f2b400683b0 0x7f2b4006a870 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2b54009580 tx=0x7f2b54009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:48:43.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.329+0000 7f2b5d600640 1 -- 172.21.15.152:0/591435734 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f2b580c7020 con 0x7f2b60160720 2024-04-17T08:48:43.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.549+0000 7f2b68200640 1 -- 172.21.15.152:0/591435734 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f2b6006d100 con 0x7f2b60160720 2024-04-17T08:48:43.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.549+0000 7f2b5d600640 1 -- 172.21.15.152:0/591435734 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+1289 (secure 0 0 0) 0x7f2b58016560 con 0x7f2b60160720 2024-04-17T08:48:43.553 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:48:43.553 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":1,"fsid":"ce68f82e-ec5f-4205-9fd5-bdfdf6ef31e2","modified":"2024-04-17T08:45:23.321761Z","created":"2024-04-17T08:45:23.321761Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:3300","nonce":0},{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3301","nonce":0},{"type":"v1","addr":"172.21.15.196:6790","nonce":0}]},"addr":"172.21.15.196:6790/0","public_addr":"172.21.15.196:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-04-17T08:48:43.553 INFO:teuthology.orchestra.run.smithi152.stderr:dumped monmap epoch 1 2024-04-17T08:48:43.554 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.553+0000 7f2b68200640 1 -- 172.21.15.152:0/591435734 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f2b400683b0 msgr2=0x7f2b4006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:43.554 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.553+0000 7f2b68200640 1 --2- 172.21.15.152:0/591435734 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f2b400683b0 0x7f2b4006a870 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2b54009580 tx=0x7f2b54009190 comp rx=0 tx=0).stop 2024-04-17T08:48:43.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.553+0000 7f2b68200640 1 -- 172.21.15.152:0/591435734 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2b60160720 msgr2=0x7f2b600b2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:43.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.553+0000 7f2b68200640 1 --2- 172.21.15.152:0/591435734 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2b60160720 0x7f2b600b2820 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f2b580b0040 tx=0x7f2b58019680 comp rx=0 tx=0).stop 2024-04-17T08:48:43.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.553+0000 7f2b68200640 1 -- 172.21.15.152:0/591435734 shutdown_connections 2024-04-17T08:48:43.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.553+0000 7f2b68200640 1 --2- 172.21.15.152:0/591435734 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2b60160720 0x7f2b600b2820 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:43.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.553+0000 7f2b68200640 1 --2- 172.21.15.152:0/591435734 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2b6015d710 0x7f2b600b22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:43.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.553+0000 7f2b68200640 1 --2- 172.21.15.152:0/591435734 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f2b400683b0 0x7f2b4006a870 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:43.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.553+0000 7f2b68200640 1 --2- 172.21.15.152:0/591435734 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2b6015a010 0x7f2b60151790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:43.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.553+0000 7f2b68200640 1 -- 172.21.15.152:0/591435734 >> 172.21.15.152:0/591435734 conn(0x7f2b600b3350 msgr2=0x7f2b600732f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:48:43.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.553+0000 7f2b68200640 1 -- 172.21.15.152:0/591435734 shutdown_connections 2024-04-17T08:48:43.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.553+0000 7f2b68200640 1 -- 172.21.15.152:0/591435734 wait complete. 2024-04-17T08:48:43.575 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.admin 2024-04-17T08:48:43.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.709+0000 7fc7d6000640 1 Processor -- start 2024-04-17T08:48:43.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.709+0000 7fc7d6000640 1 -- start start 2024-04-17T08:48:43.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.709+0000 7fc7d6000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc7d0162ba0 0x7fc7d006caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:43.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.709+0000 7fc7d6000640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7d01631c0 con 0x7fc7d00d07d0 2024-04-17T08:48:43.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.709+0000 7fc7d6000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7d015edf0 con 0x7fc7d006e450 2024-04-17T08:48:43.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.709+0000 7fc7d6000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fc7d015f720 con 0x7fc7d0162ba0 2024-04-17T08:48:43.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.709+0000 7fc7c6a00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fc7d00d07d0 0x7fc7d0162490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:34548/0 (socket says 172.21.15.152:34548) 2024-04-17T08:48:43.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.709+0000 7fc7c6a00640 1 -- 172.21.15.152:0/900613489 learned_addr learned my addr 172.21.15.152:0/900613489 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T08:48:43.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.709+0000 7fc7cfe00640 1 --2- 172.21.15.152:0/900613489 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc7d0162ba0 0x7fc7d006caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:43.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.709+0000 7fc7cea00640 1 -- 172.21.15.152:0/900613489 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2557948686 0 0) 0x7fc7d01631c0 con 0x7fc7d00d07d0 2024-04-17T08:48:43.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.709+0000 7fc7cea00640 1 -- 172.21.15.152:0/900613489 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7b4003530 con 0x7fc7d00d07d0 2024-04-17T08:48:43.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.709+0000 7fc7cea00640 1 -- 172.21.15.152:0/900613489 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3982323270 0 0) 0x7fc7d015edf0 con 0x7fc7d006e450 2024-04-17T08:48:43.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.709+0000 7fc7cea00640 1 -- 172.21.15.152:0/900613489 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7d01631c0 con 0x7fc7d006e450 2024-04-17T08:48:43.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.709+0000 7fc7cea00640 1 -- 172.21.15.152:0/900613489 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 860115343 0 0) 0x7fc7b4003530 con 0x7fc7d00d07d0 2024-04-17T08:48:43.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.709+0000 7fc7cfe00640 1 -- 172.21.15.152:0/900613489 >> v1:172.21.15.196:6789/0 conn(0x7fc7d006e450 legacy=0x7fc7d00d00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:43.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.709+0000 7fc7cfe00640 1 -- 172.21.15.152:0/900613489 >> v1:172.21.15.152:6789/0 conn(0x7fc7d00d07d0 legacy=0x7fc7d0162490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:43.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.709+0000 7fc7cfe00640 1 -- 172.21.15.152:0/900613489 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7d015f0d0 con 0x7fc7d0162ba0 2024-04-17T08:48:43.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.713+0000 7fc7cfe00640 1 --2- 172.21.15.152:0/900613489 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc7d0162ba0 0x7fc7d006caa0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc7d015f8a0 tx=0x7fc7c801c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db47a94f0e5dcf40 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:48:43.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.713+0000 7fc7cea00640 1 -- 172.21.15.152:0/900613489 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c80ac070 con 0x7fc7d0162ba0 2024-04-17T08:48:43.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.713+0000 7fc7cea00640 1 -- 172.21.15.152:0/900613489 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7c80a6470 con 0x7fc7d0162ba0 2024-04-17T08:48:43.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.713+0000 7fc7cea00640 1 -- 172.21.15.152:0/900613489 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b8001680 con 0x7fc7d0162ba0 2024-04-17T08:48:43.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.713+0000 7fc7d6000640 1 -- 172.21.15.152:0/900613489 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc7d0162ba0 msgr2=0x7fc7d006caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:43.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.713+0000 7fc7d6000640 1 --2- 172.21.15.152:0/900613489 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc7d0162ba0 0x7fc7d006caa0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc7d015f8a0 tx=0x7fc7c801c820 comp rx=0 tx=0).stop 2024-04-17T08:48:43.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.713+0000 7fc7d6000640 1 -- 172.21.15.152:0/900613489 shutdown_connections 2024-04-17T08:48:43.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.713+0000 7fc7d6000640 1 --2- 172.21.15.152:0/900613489 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc7d0162ba0 0x7fc7d006caa0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:43.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.713+0000 7fc7d6000640 1 -- 172.21.15.152:0/900613489 >> 172.21.15.152:0/900613489 conn(0x7fc7d0072140 msgr2=0x7fc7d00b4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:48:43.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.713+0000 7fc7d6000640 1 -- 172.21.15.152:0/900613489 shutdown_connections 2024-04-17T08:48:43.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.713+0000 7fc7d6000640 1 -- 172.21.15.152:0/900613489 wait complete. 2024-04-17T08:48:43.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.717+0000 7fc7d6000640 1 Processor -- start 2024-04-17T08:48:43.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.717+0000 7fc7d6000640 1 -- start start 2024-04-17T08:48:43.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.717+0000 7fc7d6000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc7d006e450 0x7fc7d0154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:43.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.717+0000 7fc7d6000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7d00d07d0 0x7fc7d00afcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:43.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.717+0000 7fc7d6000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc7d0162ba0 0x7fc7d01474c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:43.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.717+0000 7fc7d6000640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d016ca10 con 0x7fc7d00d07d0 2024-04-17T08:48:43.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.717+0000 7fc7d6000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d016c890 con 0x7fc7d006e450 2024-04-17T08:48:43.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.717+0000 7fc7d6000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fc7d016cb90 con 0x7fc7d0162ba0 2024-04-17T08:48:43.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.717+0000 7fc7c6a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7d00d07d0 0x7fc7d00afcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:43.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.717+0000 7fc7c6a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7d00d07d0 0x7fc7d00afcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51564/0 (socket says 172.21.15.152:51564) 2024-04-17T08:48:43.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.717+0000 7fc7c6a00640 1 -- 172.21.15.152:0/4236952590 learned_addr learned my addr 172.21.15.152:0/4236952590 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T08:48:43.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.717+0000 7fc7cf400640 1 --2- 172.21.15.152:0/4236952590 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc7d006e450 0x7fc7d0154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:43.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.717+0000 7fc7cfe00640 1 --2- 172.21.15.152:0/4236952590 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc7d0162ba0 0x7fc7d01474c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:43.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.717+0000 7fc7c6a00640 1 -- 172.21.15.152:0/4236952590 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc7d0162ba0 msgr2=0x7fc7d01474c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:43.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.717+0000 7fc7c6a00640 1 --2- 172.21.15.152:0/4236952590 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc7d0162ba0 0x7fc7d01474c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:43.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.717+0000 7fc7c6a00640 1 -- 172.21.15.152:0/4236952590 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc7d006e450 msgr2=0x7fc7d0154620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:43.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.717+0000 7fc7c6a00640 1 --2- 172.21.15.152:0/4236952590 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc7d006e450 0x7fc7d0154620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:43.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.717+0000 7fc7c6a00640 1 -- 172.21.15.152:0/4236952590 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7d00b0740 con 0x7fc7d00d07d0 2024-04-17T08:48:43.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.717+0000 7fc7cfe00640 1 --2- 172.21.15.152:0/4236952590 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc7d0162ba0 0x7fc7d01474c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T08:48:43.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.717+0000 7fc7c6a00640 1 --2- 172.21.15.152:0/4236952590 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7d00d07d0 0x7fc7d00afcf0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fc7b800c750 tx=0x7fc7b800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:48:43.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.717+0000 7fc7c7e00640 1 -- 172.21.15.152:0/4236952590 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b8005af0 con 0x7fc7d00d07d0 2024-04-17T08:48:43.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.717+0000 7fc7c7e00640 1 -- 172.21.15.152:0/4236952590 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7b8005c90 con 0x7fc7d00d07d0 2024-04-17T08:48:43.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.717+0000 7fc7d6000640 1 -- 172.21.15.152:0/4236952590 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7d00b0a20 con 0x7fc7d00d07d0 2024-04-17T08:48:43.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.717+0000 7fc7c7e00640 1 -- 172.21.15.152:0/4236952590 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b80072b0 con 0x7fc7d00d07d0 2024-04-17T08:48:43.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.717+0000 7fc7d6000640 1 -- 172.21.15.152:0/4236952590 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7d0154b60 con 0x7fc7d00d07d0 2024-04-17T08:48:43.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.721+0000 7fc7d6000640 1 -- 172.21.15.152:0/4236952590 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7d0068a30 con 0x7fc7d00d07d0 2024-04-17T08:48:43.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.721+0000 7fc7c7e00640 1 -- 172.21.15.152:0/4236952590 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc7b8007450 con 0x7fc7d00d07d0 2024-04-17T08:48:43.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.721+0000 7fc7c7e00640 1 --2- 172.21.15.152:0/4236952590 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc7ac068380 0x7fc7ac06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T08:48:43.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.721+0000 7fc7c7e00640 1 -- 172.21.15.152:0/4236952590 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6130+0+0 (secure 0 0 0) 0x7fc7b8086a40 con 0x7fc7d00d07d0 2024-04-17T08:48:43.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.721+0000 7fc7cf400640 1 --2- 172.21.15.152:0/4236952590 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc7ac068380 0x7fc7ac06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T08:48:43.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.721+0000 7fc7cf400640 1 --2- 172.21.15.152:0/4236952590 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc7ac068380 0x7fc7ac06a840 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc7c00011f0 tx=0x7fc7c0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T08:48:43.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.725+0000 7fc7c7e00640 1 -- 172.21.15.152:0/4236952590 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fc7b8056e70 con 0x7fc7d00d07d0 2024-04-17T08:48:43.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.941+0000 7fc7d6000640 1 -- 172.21.15.152:0/4236952590 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.admin"} v 0) -- 0x7fc7d00692d0 con 0x7fc7d00d07d0 2024-04-17T08:48:43.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.941+0000 7fc7c7e00640 1 -- 172.21.15.152:0/4236952590 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.admin"}]=0 v11) ==== 82+0+151 (secure 0 0 0) 0x7fc7b8056770 con 0x7fc7d00d07d0 2024-04-17T08:48:43.942 INFO:teuthology.orchestra.run.smithi152.stdout:[client.admin] 2024-04-17T08:48:43.942 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQAjjB9mh5hdIBAAHhKWoi+B6qOBfNOftL3wUA== 2024-04-17T08:48:43.942 INFO:teuthology.orchestra.run.smithi152.stdout: caps mds = "allow *" 2024-04-17T08:48:43.943 INFO:teuthology.orchestra.run.smithi152.stdout: caps mgr = "allow *" 2024-04-17T08:48:43.943 INFO:teuthology.orchestra.run.smithi152.stdout: caps mon = "allow *" 2024-04-17T08:48:43.943 INFO:teuthology.orchestra.run.smithi152.stdout: caps osd = "allow *" 2024-04-17T08:48:43.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.941+0000 7fc7d6000640 1 -- 172.21.15.152:0/4236952590 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc7ac068380 msgr2=0x7fc7ac06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:43.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.941+0000 7fc7d6000640 1 --2- 172.21.15.152:0/4236952590 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc7ac068380 0x7fc7ac06a840 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc7c00011f0 tx=0x7fc7c0009040 comp rx=0 tx=0).stop 2024-04-17T08:48:43.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.941+0000 7fc7d6000640 1 -- 172.21.15.152:0/4236952590 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7d00d07d0 msgr2=0x7fc7d00afcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T08:48:43.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.941+0000 7fc7d6000640 1 --2- 172.21.15.152:0/4236952590 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7d00d07d0 0x7fc7d00afcf0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fc7b800c750 tx=0x7fc7b800cc10 comp rx=0 tx=0).stop 2024-04-17T08:48:43.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.941+0000 7fc7d6000640 1 -- 172.21.15.152:0/4236952590 shutdown_connections 2024-04-17T08:48:43.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.941+0000 7fc7d6000640 1 --2- 172.21.15.152:0/4236952590 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc7ac068380 0x7fc7ac06a840 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:43.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.941+0000 7fc7d6000640 1 --2- 172.21.15.152:0/4236952590 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc7d0162ba0 0x7fc7d01474c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:43.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.941+0000 7fc7d6000640 1 --2- 172.21.15.152:0/4236952590 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7d00d07d0 0x7fc7d00afcf0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:43.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.941+0000 7fc7d6000640 1 --2- 172.21.15.152:0/4236952590 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc7d006e450 0x7fc7d0154620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T08:48:43.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.941+0000 7fc7d6000640 1 -- 172.21.15.152:0/4236952590 >> 172.21.15.152:0/4236952590 conn(0x7fc7d0072140 msgr2=0x7fc7d0160e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T08:48:43.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.941+0000 7fc7d6000640 1 -- 172.21.15.152:0/4236952590 shutdown_connections 2024-04-17T08:48:43.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T08:48:43.941+0000 7fc7d6000640 1 -- 172.21.15.152:0/4236952590 wait complete. 2024-04-17T08:48:43.962 DEBUG:teuthology.orchestra.run.smithi152:> mktemp 2024-04-17T08:48:43.970 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/tmp.HFwcAI9hV6 2024-04-17T08:48:43.971 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-17T08:48:43.971 DEBUG:teuthology.orchestra.run.smithi152:> dd of=/tmp/tmp.HFwcAI9hV6 2024-04-17T08:48:44.021 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-17T08:48:44.021 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/tmp/tmp.pJW3k3pP3vxfstests-dev/local.config 2024-04-17T08:48:44.083 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph-fuse export CEPH_FUSE_BIN_PATH=ceph-fuse export TEST_DEV=ceph-fuse # without this tests won't get started export TEST_DIR=/tmp/tmp.N9QxrNRIp4test export SCRATCH_DEV= export SCRATCH_MNT=/tmp/tmp.nJOkJrBaf6scratch export CEPHFS_MOUNT_OPTIONS="-m 172.21.15.152:6789 -k /tmp/tmp.HFwcAI9hV6 --client_mountpoint /test" 2024-04-17T08:48:44.084 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-17T08:48:44.084 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/tmp/tmp.pJW3k3pP3vxfstests-dev/ceph.exclude 2024-04-17T08:48:44.143 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo make) 2024-04-17T08:48:44.208 INFO:teuthology.orchestra.run.smithi152.stdout:libtoolize -cfi 2024-04-17T08:48:44.557 INFO:teuthology.orchestra.run.smithi152.stdout:libtoolize: putting auxiliary files in '.'. 2024-04-17T08:48:44.557 INFO:teuthology.orchestra.run.smithi152.stdout:libtoolize: copying file './config.guess' 2024-04-17T08:48:44.567 INFO:teuthology.orchestra.run.smithi152.stdout:libtoolize: copying file './config.sub' 2024-04-17T08:48:44.591 INFO:teuthology.orchestra.run.smithi152.stdout:libtoolize: copying file './install-sh' 2024-04-17T08:48:44.601 INFO:teuthology.orchestra.run.smithi152.stdout:libtoolize: copying file './ltmain.sh' 2024-04-17T08:48:44.642 INFO:teuthology.orchestra.run.smithi152.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2024-04-17T08:48:44.642 INFO:teuthology.orchestra.run.smithi152.stdout:libtoolize: copying file 'm4/libtool.m4' 2024-04-17T08:48:44.656 INFO:teuthology.orchestra.run.smithi152.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2024-04-17T08:48:44.667 INFO:teuthology.orchestra.run.smithi152.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2024-04-17T08:48:44.677 INFO:teuthology.orchestra.run.smithi152.stdout:libtoolize: copying file 'm4/ltversion.m4' 2024-04-17T08:48:44.687 INFO:teuthology.orchestra.run.smithi152.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2024-04-17T08:48:44.697 INFO:teuthology.orchestra.run.smithi152.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2024-04-17T08:48:44.699 INFO:teuthology.orchestra.run.smithi152.stdout:cp include/install-sh . 2024-04-17T08:48:44.701 INFO:teuthology.orchestra.run.smithi152.stdout:aclocal -I m4 2024-04-17T08:48:45.748 INFO:teuthology.orchestra.run.smithi152.stdout:autoheader 2024-04-17T08:48:46.105 INFO:teuthology.orchestra.run.smithi152.stdout:autoconf 2024-04-17T08:48:46.516 INFO:teuthology.orchestra.run.smithi152.stdout:./configure \ 2024-04-17T08:48:46.516 INFO:teuthology.orchestra.run.smithi152.stdout: --libexecdir=/usr/lib \ 2024-04-17T08:48:46.516 INFO:teuthology.orchestra.run.smithi152.stdout: --exec_prefix=/var/lib 2024-04-17T08:48:47.019 INFO:teuthology.orchestra.run.smithi152.stdout:checking build system type... x86_64-pc-linux-gnu 2024-04-17T08:48:47.019 INFO:teuthology.orchestra.run.smithi152.stdout:checking host system type... x86_64-pc-linux-gnu 2024-04-17T08:48:47.061 INFO:teuthology.orchestra.run.smithi152.stdout:checking how to print strings... printf 2024-04-17T08:48:47.062 INFO:teuthology.orchestra.run.smithi152.stdout:checking for gcc... gcc 2024-04-17T08:48:47.278 INFO:teuthology.orchestra.run.smithi152.stdout:checking whether the C compiler works... yes 2024-04-17T08:48:47.278 INFO:teuthology.orchestra.run.smithi152.stdout:checking for C compiler default output file name... a.out 2024-04-17T08:48:47.321 INFO:teuthology.orchestra.run.smithi152.stdout:checking for suffix of executables... 2024-04-17T08:48:47.477 INFO:teuthology.orchestra.run.smithi152.stdout:checking whether we are cross compiling... no 2024-04-17T08:48:47.504 INFO:teuthology.orchestra.run.smithi152.stdout:checking for suffix of object files... o 2024-04-17T08:48:47.527 INFO:teuthology.orchestra.run.smithi152.stdout:checking whether the compiler supports GNU C... yes 2024-04-17T08:48:47.550 INFO:teuthology.orchestra.run.smithi152.stdout:checking whether gcc accepts -g... yes 2024-04-17T08:48:47.697 INFO:teuthology.orchestra.run.smithi152.stdout:checking for gcc option to enable C11 features... none needed 2024-04-17T08:48:47.703 INFO:teuthology.orchestra.run.smithi152.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2024-04-17T08:48:47.708 INFO:teuthology.orchestra.run.smithi152.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-04-17T08:48:47.711 INFO:teuthology.orchestra.run.smithi152.stdout:checking for egrep... /usr/bin/grep -E 2024-04-17T08:48:47.714 INFO:teuthology.orchestra.run.smithi152.stdout:checking for fgrep... /usr/bin/grep -F 2024-04-17T08:48:47.721 INFO:teuthology.orchestra.run.smithi152.stdout:checking for ld used by gcc... /usr/bin/ld 2024-04-17T08:48:47.725 INFO:teuthology.orchestra.run.smithi152.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2024-04-17T08:48:47.738 INFO:teuthology.orchestra.run.smithi152.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2024-04-17T08:48:47.768 INFO:teuthology.orchestra.run.smithi152.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2024-04-17T08:48:47.768 INFO:teuthology.orchestra.run.smithi152.stdout:checking whether ln -s works... yes 2024-04-17T08:48:47.784 INFO:teuthology.orchestra.run.smithi152.stdout:checking the maximum length of command line arguments... 1572864 2024-04-17T08:48:47.789 INFO:teuthology.orchestra.run.smithi152.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2024-04-17T08:48:47.789 INFO:teuthology.orchestra.run.smithi152.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2024-04-17T08:48:47.790 INFO:teuthology.orchestra.run.smithi152.stdout:checking for /usr/bin/ld option to reload object files... -r 2024-04-17T08:48:47.790 INFO:teuthology.orchestra.run.smithi152.stdout:checking for objdump... objdump 2024-04-17T08:48:47.791 INFO:teuthology.orchestra.run.smithi152.stdout:checking how to recognize dependent libraries... pass_all 2024-04-17T08:48:47.791 INFO:teuthology.orchestra.run.smithi152.stdout:checking for dlltool... no 2024-04-17T08:48:47.791 INFO:teuthology.orchestra.run.smithi152.stdout:checking how to associate runtime and link libraries... printf %s\n 2024-04-17T08:48:47.791 INFO:teuthology.orchestra.run.smithi152.stdout:checking for ar... ar 2024-04-17T08:48:47.847 INFO:teuthology.orchestra.run.smithi152.stdout:checking for archiver @FILE support... @ 2024-04-17T08:48:47.847 INFO:teuthology.orchestra.run.smithi152.stdout:checking for strip... strip 2024-04-17T08:48:47.848 INFO:teuthology.orchestra.run.smithi152.stdout:checking for ranlib... ranlib 2024-04-17T08:48:47.848 INFO:teuthology.orchestra.run.smithi152.stdout:checking for gawk... gawk 2024-04-17T08:48:47.935 INFO:teuthology.orchestra.run.smithi152.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2024-04-17T08:48:47.937 INFO:teuthology.orchestra.run.smithi152.stdout:checking for sysroot... no 2024-04-17T08:48:47.944 INFO:teuthology.orchestra.run.smithi152.stdout:checking for a working dd... /usr/bin/dd 2024-04-17T08:48:47.951 INFO:teuthology.orchestra.run.smithi152.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2024-04-17T08:48:47.970 INFO:teuthology.orchestra.run.smithi152.stdout:checking for mt... mt 2024-04-17T08:48:47.990 INFO:teuthology.orchestra.run.smithi152.stdout:checking if mt is a manifest tool... no 2024-04-17T08:48:48.019 INFO:teuthology.orchestra.run.smithi152.stdout:checking for stdio.h... yes 2024-04-17T08:48:48.083 INFO:teuthology.orchestra.run.smithi152.stdout:checking for stdlib.h... yes 2024-04-17T08:48:48.118 INFO:teuthology.orchestra.run.smithi152.stdout:checking for string.h... yes 2024-04-17T08:48:48.173 INFO:teuthology.orchestra.run.smithi152.stdout:checking for inttypes.h... yes 2024-04-17T08:48:48.205 INFO:teuthology.orchestra.run.smithi152.stdout:checking for stdint.h... yes 2024-04-17T08:48:48.237 INFO:teuthology.orchestra.run.smithi152.stdout:checking for strings.h... yes 2024-04-17T08:48:48.271 INFO:teuthology.orchestra.run.smithi152.stdout:checking for sys/stat.h... yes 2024-04-17T08:48:48.305 INFO:teuthology.orchestra.run.smithi152.stdout:checking for sys/types.h... yes 2024-04-17T08:48:48.347 INFO:teuthology.orchestra.run.smithi152.stdout:checking for unistd.h... yes 2024-04-17T08:48:48.385 INFO:teuthology.orchestra.run.smithi152.stdout:checking for dlfcn.h... yes 2024-04-17T08:48:48.391 INFO:teuthology.orchestra.run.smithi152.stdout:checking for objdir... .libs 2024-04-17T08:48:48.501 INFO:teuthology.orchestra.run.smithi152.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2024-04-17T08:48:48.501 INFO:teuthology.orchestra.run.smithi152.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2024-04-17T08:48:48.528 INFO:teuthology.orchestra.run.smithi152.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2024-04-17T08:48:48.752 INFO:teuthology.orchestra.run.smithi152.stdout:checking if gcc static flag -static works... yes 2024-04-17T08:48:48.792 INFO:teuthology.orchestra.run.smithi152.stdout:checking if gcc supports -c -o file.o... yes 2024-04-17T08:48:48.792 INFO:teuthology.orchestra.run.smithi152.stdout:checking if gcc supports -c -o file.o... (cached) yes 2024-04-17T08:48:48.806 INFO:teuthology.orchestra.run.smithi152.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2024-04-17T08:48:48.841 INFO:teuthology.orchestra.run.smithi152.stdout:checking whether -lc should be explicitly linked in... no 2024-04-17T08:48:48.944 INFO:teuthology.orchestra.run.smithi152.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2024-04-17T08:48:48.944 INFO:teuthology.orchestra.run.smithi152.stdout:checking how to hardcode library paths into programs... immediate 2024-04-17T08:48:48.951 INFO:teuthology.orchestra.run.smithi152.stdout:checking whether stripping libraries is possible... yes 2024-04-17T08:48:48.951 INFO:teuthology.orchestra.run.smithi152.stdout:checking if libtool supports shared libraries... yes 2024-04-17T08:48:48.951 INFO:teuthology.orchestra.run.smithi152.stdout:checking whether to build shared libraries... yes 2024-04-17T08:48:48.951 INFO:teuthology.orchestra.run.smithi152.stdout:checking whether to build static libraries... yes 2024-04-17T08:48:48.966 INFO:teuthology.orchestra.run.smithi152.stdout:checking for gcc... (cached) gcc 2024-04-17T08:48:49.007 INFO:teuthology.orchestra.run.smithi152.stdout:checking whether the compiler supports GNU C... (cached) yes 2024-04-17T08:48:49.007 INFO:teuthology.orchestra.run.smithi152.stdout:checking whether gcc accepts -g... (cached) yes 2024-04-17T08:48:49.007 INFO:teuthology.orchestra.run.smithi152.stdout:checking for gcc option to enable C11 features... (cached) none needed 2024-04-17T08:48:49.007 INFO:teuthology.orchestra.run.smithi152.stdout:checking for gmake... /usr/bin/gmake 2024-04-17T08:48:49.008 INFO:teuthology.orchestra.run.smithi152.stderr:./configure: line 12753: test: $(SHELL): binary operator expected 2024-04-17T08:48:49.008 INFO:teuthology.orchestra.run.smithi152.stdout:checking for tar... /bin/tar 2024-04-17T08:48:49.008 INFO:teuthology.orchestra.run.smithi152.stdout:checking for gzip... /bin/gzip 2024-04-17T08:48:49.024 INFO:teuthology.orchestra.run.smithi152.stdout:checking whether gcc -MM is supported... yes 2024-04-17T08:48:49.025 INFO:teuthology.orchestra.run.smithi152.stdout:checking for sort... /bin/sort 2024-04-17T08:48:49.025 INFO:teuthology.orchestra.run.smithi152.stdout:checking whether ln -s works... yes 2024-04-17T08:48:49.025 INFO:teuthology.orchestra.run.smithi152.stdout:checking for rpm... no 2024-04-17T08:48:49.062 INFO:teuthology.orchestra.run.smithi152.stdout:checking for assert.h... yes 2024-04-17T08:48:49.102 INFO:teuthology.orchestra.run.smithi152.stdout:checking for bstring.h... no 2024-04-17T08:48:49.140 INFO:teuthology.orchestra.run.smithi152.stdout:checking for libgen.h... yes 2024-04-17T08:48:49.207 INFO:teuthology.orchestra.run.smithi152.stdout:checking for dirent.h... yes 2024-04-17T08:48:49.287 INFO:teuthology.orchestra.run.smithi152.stdout:checking for errno.h... yes 2024-04-17T08:48:49.325 INFO:teuthology.orchestra.run.smithi152.stdout:checking for malloc.h... yes 2024-04-17T08:48:49.366 INFO:teuthology.orchestra.run.smithi152.stdout:checking for uuid.h... no 2024-04-17T08:48:49.408 INFO:teuthology.orchestra.run.smithi152.stdout:checking for uuid/uuid.h... yes 2024-04-17T08:48:49.449 INFO:teuthology.orchestra.run.smithi152.stdout:checking for sys/uuid.h... no 2024-04-17T08:48:49.489 INFO:teuthology.orchestra.run.smithi152.stdout:checking for sys/file.h... yes 2024-04-17T08:48:49.528 INFO:teuthology.orchestra.run.smithi152.stdout:checking for sys/fcntl.h... yes 2024-04-17T08:48:49.569 INFO:teuthology.orchestra.run.smithi152.stdout:checking for sys/syssgi.h... no 2024-04-17T08:48:49.640 INFO:teuthology.orchestra.run.smithi152.stdout:checking for sys/param.h... yes 2024-04-17T08:48:49.640 INFO:teuthology.orchestra.run.smithi152.stdout:checking for sys/stat.h... (cached) yes 2024-04-17T08:48:49.678 INFO:teuthology.orchestra.run.smithi152.stdout:checking for sys/statvfs.h... yes 2024-04-17T08:48:49.715 INFO:teuthology.orchestra.run.smithi152.stdout:checking for sys/time.h... yes 2024-04-17T08:48:49.764 INFO:teuthology.orchestra.run.smithi152.stdout:checking for sys/ioctl.h... yes 2024-04-17T08:48:49.805 INFO:teuthology.orchestra.run.smithi152.stdout:checking for sys/wait.h... yes 2024-04-17T08:48:49.805 INFO:teuthology.orchestra.run.smithi152.stdout:checking for sys/types.h... (cached) yes 2024-04-17T08:48:49.805 INFO:teuthology.orchestra.run.smithi152.stdout:checking for strings.h... (cached) yes 2024-04-17T08:48:49.842 INFO:teuthology.orchestra.run.smithi152.stdout:checking for err.h... yes 2024-04-17T08:48:49.880 INFO:teuthology.orchestra.run.smithi152.stdout:checking for linux/falloc.h... yes 2024-04-17T08:48:49.921 INFO:teuthology.orchestra.run.smithi152.stdout:checking for sys/fs/xfs_fsops.h... no 2024-04-17T08:48:49.962 INFO:teuthology.orchestra.run.smithi152.stdout:checking for sys/fs/xfs_itable.h... no 2024-04-17T08:48:50.004 INFO:teuthology.orchestra.run.smithi152.stdout:checking for xfs/platform_defs.h... no 2024-04-17T08:48:50.045 INFO:teuthology.orchestra.run.smithi152.stdout:checking for btrfs/ioctl.h... no 2024-04-17T08:48:50.086 INFO:teuthology.orchestra.run.smithi152.stdout:checking for cifs/ioctl.h... no 2024-04-17T08:48:50.126 INFO:teuthology.orchestra.run.smithi152.stdout:checking for sys/mman.h... yes 2024-04-17T08:48:50.166 INFO:teuthology.orchestra.run.smithi152.stdout:checking for linux/ext4.h... no 2024-04-17T08:48:50.189 INFO:teuthology.orchestra.run.smithi152.stdout:checking for xfs/xfs_log_format.h... no 2024-04-17T08:48:50.246 INFO:teuthology.orchestra.run.smithi152.stdout:checking for uuid_compare... no 2024-04-17T08:48:50.294 INFO:teuthology.orchestra.run.smithi152.stdout:checking for uuid_compare in -luuid... yes 2024-04-17T08:48:50.409 INFO:teuthology.orchestra.run.smithi152.stdout:checking for xfs/xfs.h... yes 2024-04-17T08:48:50.432 INFO:teuthology.orchestra.run.smithi152.stdout:checking for xfs/libxfs.h... no 2024-04-17T08:48:50.492 INFO:teuthology.orchestra.run.smithi152.stdout:checking for gcc options needed to detect all undeclared functions... none needed 2024-04-17T08:48:50.523 INFO:teuthology.orchestra.run.smithi152.stdout:checking whether xlog_assign_lsn is declared... no 2024-04-17T08:48:50.570 INFO:teuthology.orchestra.run.smithi152.stdout:checking for xfs/xqm.h... yes 2024-04-17T08:48:50.642 INFO:teuthology.orchestra.run.smithi152.stdout:checking xfsctl from xfs/xfs.h... ok 2024-04-17T08:48:50.682 INFO:teuthology.orchestra.run.smithi152.stdout:checking for xfs/handle.h... yes 2024-04-17T08:48:50.731 INFO:teuthology.orchestra.run.smithi152.stdout:checking for attr_list_by_handle in -lhandle... yes 2024-04-17T08:48:50.777 INFO:teuthology.orchestra.run.smithi152.stdout:checking for sys/acl.h... yes 2024-04-17T08:48:50.818 INFO:teuthology.orchestra.run.smithi152.stdout:checking for acl/libacl.h... yes 2024-04-17T08:48:50.867 INFO:teuthology.orchestra.run.smithi152.stdout:checking for acl_init in -lacl... yes 2024-04-17T08:48:50.908 INFO:teuthology.orchestra.run.smithi152.stdout:checking for gdbm-ndbm.h... no 2024-04-17T08:48:50.948 INFO:teuthology.orchestra.run.smithi152.stdout:checking for gdbm/ndbm.h... no 2024-04-17T08:48:50.988 INFO:teuthology.orchestra.run.smithi152.stdout:checking for ndbm.h... no 2024-04-17T08:48:51.029 INFO:teuthology.orchestra.run.smithi152.stdout:checking for libaio.h... yes 2024-04-17T08:48:51.121 INFO:teuthology.orchestra.run.smithi152.stdout:checking for liburing.h... yes 2024-04-17T08:48:51.164 INFO:teuthology.orchestra.run.smithi152.stdout:checking for sys/capability.h... yes 2024-04-17T08:48:51.203 INFO:teuthology.orchestra.run.smithi152.stdout:checking for linux/fiemap.h... yes 2024-04-17T08:48:51.252 INFO:teuthology.orchestra.run.smithi152.stdout:checking for fallocate... yes 2024-04-17T08:48:51.305 INFO:teuthology.orchestra.run.smithi152.stdout:checking for open_by_handle_at... yes 2024-04-17T08:48:51.345 INFO:teuthology.orchestra.run.smithi152.stdout:checking for linux/fs.h... yes 2024-04-17T08:48:51.386 INFO:teuthology.orchestra.run.smithi152.stdout:checking for btrfsutil.h... no 2024-04-17T08:48:51.443 INFO:teuthology.orchestra.run.smithi152.stdout:checking for copy_file_range... yes 2024-04-17T08:48:51.502 INFO:teuthology.orchestra.run.smithi152.stdout:checking for SEEK_DATA... yes 2024-04-17T08:48:51.578 INFO:teuthology.orchestra.run.smithi152.stdout:checking for BMV_OF_SHARED... yes 2024-04-17T08:48:51.633 INFO:teuthology.orchestra.run.smithi152.stdout:checking for nftw... yes 2024-04-17T08:48:51.687 INFO:teuthology.orchestra.run.smithi152.stdout:checking for RLIMIT_NOFILE... yes 2024-04-17T08:48:51.739 INFO:teuthology.orchestra.run.smithi152.stdout:checking for XFS_IOC_EXCHANGE_RANGE... no 2024-04-17T08:48:51.791 INFO:teuthology.orchestra.run.smithi152.stdout:checking for FICLONE... yes 2024-04-17T08:48:51.843 INFO:teuthology.orchestra.run.smithi152.stdout:checking for renameat2... yes 2024-04-17T08:48:51.893 INFO:teuthology.orchestra.run.smithi152.stdout:checking for reallocarray... yes 2024-04-17T08:48:51.943 INFO:teuthology.orchestra.run.smithi152.stdout:checking for struct mount_attr... yes 2024-04-17T08:48:52.003 INFO:teuthology.orchestra.run.smithi152.stdout:checking for struct btrfs_qgroup_limit... yes 2024-04-17T08:48:52.055 INFO:teuthology.orchestra.run.smithi152.stdout:checking for struct btrfs_qgroup_inherit... yes 2024-04-17T08:48:52.107 INFO:teuthology.orchestra.run.smithi152.stdout:checking for struct btrfs_ioctl_vol_args... yes 2024-04-17T08:48:52.159 INFO:teuthology.orchestra.run.smithi152.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2024-04-17T08:48:52.211 INFO:teuthology.orchestra.run.smithi152.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2024-04-17T08:48:52.216 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T08:48:52.219 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T08:48:52.278 INFO:teuthology.orchestra.run.smithi152.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2024-04-17T08:48:52.330 INFO:teuthology.orchestra.run.smithi152.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2024-04-17T08:48:52.369 INFO:teuthology.orchestra.run.smithi152.stdout:checking for linux/btrfs.h... yes 2024-04-17T08:48:52.409 INFO:teuthology.orchestra.run.smithi152.stdout:checking for linux/btrfs_tree.h... yes 2024-04-17T08:48:52.436 INFO:teuthology.orchestra.run.smithi152.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2024-04-17T08:48:52.476 INFO:teuthology.orchestra.run.smithi152.stdout:checking whether BTRFS_IOC_SNAP_DESTROY_V2 is declared... yes 2024-04-17T08:48:52.501 INFO:teuthology.orchestra.run.smithi152.stdout:configure: creating ./config.status 2024-04-17T08:48:53.291 INFO:teuthology.orchestra.run.smithi152.stdout:config.status: creating include/builddefs 2024-04-17T08:48:53.318 INFO:teuthology.orchestra.run.smithi152.stdout:config.status: creating include/config.h 2024-04-17T08:48:53.339 INFO:teuthology.orchestra.run.smithi152.stdout:config.status: executing libtool commands 2024-04-17T08:48:53.407 INFO:teuthology.orchestra.run.smithi152.stdout:Building include 2024-04-17T08:48:53.413 INFO:teuthology.orchestra.run.smithi152.stdout:Building lib 2024-04-17T08:48:53.418 INFO:teuthology.orchestra.run.smithi152.stdout: [LTDEP] 2024-04-17T08:48:53.612 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] dataascii.lo 2024-04-17T08:48:53.755 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] databin.lo 2024-04-17T08:48:53.939 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] datapid.lo 2024-04-17T08:48:54.075 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] file_lock.lo 2024-04-17T08:48:54.261 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] forker.lo 2024-04-17T08:48:54.431 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] pattern.lo 2024-04-17T08:48:54.572 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] open_flags.lo 2024-04-17T08:48:54.745 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] random_range.lo 2024-04-17T08:48:55.000 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] string_to_tokens.lo 2024-04-17T08:48:55.125 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] str_to_bytes.lo 2024-04-17T08:48:55.292 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] tlibio.lo 2024-04-17T08:48:55.576 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] write_log.lo 2024-04-17T08:48:55.660 INFO:teuthology.orchestra.run.smithi152.stderr:write_log.c: In function 'wlog_record_write': 2024-04-17T08:48:55.660 INFO:teuthology.orchestra.run.smithi152.stderr:write_log.c:205:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:48:55.660 INFO:teuthology.orchestra.run.smithi152.stderr: 205 | write(wfile->w_afd, wbuf, reclen); 2024-04-17T08:48:55.660 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:48:55.660 INFO:teuthology.orchestra.run.smithi152.stderr:write_log.c:209:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:48:55.660 INFO:teuthology.orchestra.run.smithi152.stderr: 209 | write(wfile->w_rfd, wbuf, reclen); 2024-04-17T08:48:55.660 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:48:55.850 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] random.lo 2024-04-17T08:48:55.976 INFO:teuthology.orchestra.run.smithi152.stdout: [LD] 2024-04-17T08:48:56.094 INFO:teuthology.orchestra.run.smithi152.stdout:Building ltp 2024-04-17T08:48:56.099 INFO:teuthology.orchestra.run.smithi152.stdout: [DEP] 2024-04-17T08:48:56.325 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] doio 2024-04-17T08:48:57.039 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] fsstress 2024-04-17T08:48:58.535 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] fsx 2024-04-17T08:48:59.331 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] growfiles 2024-04-17T08:48:59.903 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] iogen 2024-04-17T08:49:00.065 INFO:teuthology.orchestra.run.smithi152.stderr:iogen.c: In function 'main': 2024-04-17T08:49:00.065 INFO:teuthology.orchestra.run.smithi152.stderr:iogen.c:280:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:00.065 INFO:teuthology.orchestra.run.smithi152.stderr: 280 | write(outfd, (char *)&req, sizeof(req)); 2024-04-17T08:49:00.065 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:00.067 INFO:teuthology.orchestra.run.smithi152.stderr:iogen.c: In function 'parse_cmdline': 2024-04-17T08:49:00.067 INFO:teuthology.orchestra.run.smithi152.stderr:iogen.c:1535:17: warning: ignoring return value of 'getcwd' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:00.068 INFO:teuthology.orchestra.run.smithi152.stderr: 1535 | getcwd(fptr->f_path, 2024-04-17T08:49:00.068 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:00.068 INFO:teuthology.orchestra.run.smithi152.stderr: 1536 | sizeof(fptr->f_path)-1); 2024-04-17T08:49:00.068 INFO:teuthology.orchestra.run.smithi152.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:00.345 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] aio-stress 2024-04-17T08:49:00.526 INFO:teuthology.orchestra.run.smithi152.stderr:aio-stress.c: In function 'setup_shared_mem': 2024-04-17T08:49:00.526 INFO:teuthology.orchestra.run.smithi152.stderr:aio-stress.c:1013:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:00.526 INFO:teuthology.orchestra.run.smithi152.stderr: 1013 | ftruncate(fd, total_ram); 2024-04-17T08:49:00.526 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:00.843 INFO:teuthology.orchestra.run.smithi152.stdout:Building src 2024-04-17T08:49:00.851 INFO:teuthology.orchestra.run.smithi152.stdout: [DEP] 2024-04-17T08:49:03.339 INFO:teuthology.orchestra.run.smithi152.stdout: [DEP] 2024-04-17T08:49:03.385 INFO:teuthology.orchestra.run.smithi152.stdout: [DEP] 2024-04-17T08:49:03.398 INFO:teuthology.orchestra.run.smithi152.stdout: [DEP] 2024-04-17T08:49:03.725 INFO:teuthology.orchestra.run.smithi152.stdout: [DEP] 2024-04-17T08:49:03.760 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] dirstress 2024-04-17T08:49:04.047 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] fill 2024-04-17T08:49:04.236 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] fill2 2024-04-17T08:49:04.510 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] getpagesize 2024-04-17T08:49:04.681 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] holes 2024-04-17T08:49:04.918 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] lstat64 2024-04-17T08:49:05.141 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] nametest 2024-04-17T08:49:05.301 INFO:teuthology.orchestra.run.smithi152.stderr:nametest.c: In function 'main': 2024-04-17T08:49:05.301 INFO:teuthology.orchestra.run.smithi152.stderr:nametest.c:236:33: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:05.301 INFO:teuthology.orchestra.run.smithi152.stderr: 236 | write(1, "\n", 1); 2024-04-17T08:49:05.302 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~ 2024-04-17T08:49:05.302 INFO:teuthology.orchestra.run.smithi152.stderr:nametest.c:238:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:05.302 INFO:teuthology.orchestra.run.smithi152.stderr: 238 | write(1, ".", 1); 2024-04-17T08:49:05.302 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~ 2024-04-17T08:49:05.302 INFO:teuthology.orchestra.run.smithi152.stderr:nametest.c:288:33: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:05.302 INFO:teuthology.orchestra.run.smithi152.stderr: 288 | write(1, ".", 1); 2024-04-17T08:49:05.302 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~ 2024-04-17T08:49:05.425 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] permname 2024-04-17T08:49:05.666 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] randholes 2024-04-17T08:49:05.957 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] runas 2024-04-17T08:49:06.173 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] truncfile 2024-04-17T08:49:06.393 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] usemem 2024-04-17T08:49:06.581 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] mmapcat 2024-04-17T08:49:06.725 INFO:teuthology.orchestra.run.smithi152.stderr:mmapcat.c: In function 'main': 2024-04-17T08:49:06.725 INFO:teuthology.orchestra.run.smithi152.stderr:mmapcat.c:29:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:06.725 INFO:teuthology.orchestra.run.smithi152.stderr: 29 | write(1,ptr2,ptr - ptr2); 2024-04-17T08:49:06.725 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:06.768 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] append_reader 2024-04-17T08:49:06.959 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] append_writer 2024-04-17T08:49:07.150 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] dirperf 2024-04-17T08:49:07.414 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] metaperf 2024-04-17T08:49:07.567 INFO:teuthology.orchestra.run.smithi152.stderr:metaperf.c: In function 'crfiles': 2024-04-17T08:49:07.567 INFO:teuthology.orchestra.run.smithi152.stderr:metaperf.c:166:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:07.567 INFO:teuthology.orchestra.run.smithi152.stderr: 166 | write(fd, buf, fsize); 2024-04-17T08:49:07.567 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:07.569 INFO:teuthology.orchestra.run.smithi152.stderr:metaperf.c: In function 't_linkun': 2024-04-17T08:49:07.569 INFO:teuthology.orchestra.run.smithi152.stderr:metaperf.c:454:25: warning: ignoring return value of 'link' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:07.569 INFO:teuthology.orchestra.run.smithi152.stderr: 454 | link("a", *fnp); 2024-04-17T08:49:07.569 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~ 2024-04-17T08:49:07.569 INFO:teuthology.orchestra.run.smithi152.stderr:metaperf.c: In function 't_chown': 2024-04-17T08:49:07.569 INFO:teuthology.orchestra.run.smithi152.stderr:metaperf.c:404:33: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:07.569 INFO:teuthology.orchestra.run.smithi152.stderr: 404 | chown(*fnp, 2, -1); 2024-04-17T08:49:07.569 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:07.569 INFO:teuthology.orchestra.run.smithi152.stderr:metaperf.c:406:33: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:07.569 INFO:teuthology.orchestra.run.smithi152.stderr: 406 | chown(*fnp, 1, -1); 2024-04-17T08:49:07.569 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:07.569 INFO:teuthology.orchestra.run.smithi152.stderr:metaperf.c: In function 'i_chown': 2024-04-17T08:49:07.569 INFO:teuthology.orchestra.run.smithi152.stderr:metaperf.c:291:17: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:07.570 INFO:teuthology.orchestra.run.smithi152.stderr: 291 | chown(*fnp, 1, -1); 2024-04-17T08:49:07.570 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:07.570 INFO:teuthology.orchestra.run.smithi152.stderr:metaperf.c: In function 'main': 2024-04-17T08:49:07.570 INFO:teuthology.orchestra.run.smithi152.stderr:metaperf.c:152:9: warning: ignoring return value of 'chdir' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:07.570 INFO:teuthology.orchestra.run.smithi152.stderr: 152 | chdir(".."); 2024-04-17T08:49:07.570 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~ 2024-04-17T08:49:07.734 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] devzero 2024-04-17T08:49:07.951 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] feature 2024-04-17T08:49:08.218 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] alloc 2024-04-17T08:49:08.378 INFO:teuthology.orchestra.run.smithi152.stderr:alloc.c: In function 'main': 2024-04-17T08:49:08.378 INFO:teuthology.orchestra.run.smithi152.stderr:alloc.c:247:17: warning: ignoring return value of 'mkstemp' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:08.378 INFO:teuthology.orchestra.run.smithi152.stderr: 247 | mkstemp(tmpfile); 2024-04-17T08:49:08.378 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~ 2024-04-17T08:49:08.474 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] fault 2024-04-17T08:49:08.677 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] fstest 2024-04-17T08:49:08.958 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_access_root 2024-04-17T08:49:09.102 INFO:teuthology.orchestra.run.smithi152.stderr:t_access_root.c: In function 'main': 2024-04-17T08:49:09.102 INFO:teuthology.orchestra.run.smithi152.stderr:t_access_root.c:55:5: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:09.102 INFO:teuthology.orchestra.run.smithi152.stderr: 55 | system(cmd); 2024-04-17T08:49:09.102 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~ 2024-04-17T08:49:09.152 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] godown 2024-04-17T08:49:09.366 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] resvtest 2024-04-17T08:49:09.596 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] writemod 2024-04-17T08:49:09.778 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] writev_on_pagefault 2024-04-17T08:49:09.977 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] makeextents 2024-04-17T08:49:10.200 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] itrash 2024-04-17T08:49:10.391 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] rename 2024-04-17T08:49:10.564 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] multi_open_unlink 2024-04-17T08:49:10.780 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] unwritten_sync 2024-04-17T08:49:11.042 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] genhashnames 2024-04-17T08:49:11.268 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_holes 2024-04-17T08:49:11.457 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_mmap_writev 2024-04-17T08:49:11.647 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_truncate_cmtime 2024-04-17T08:49:11.844 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] dirhash_collide 2024-04-17T08:49:12.064 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_rename_overwrite 2024-04-17T08:49:12.240 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] holetest 2024-04-17T08:49:12.396 INFO:teuthology.orchestra.run.smithi152.stderr:holetest.c: In function 'pt_write_marker': 2024-04-17T08:49:12.396 INFO:teuthology.orchestra.run.smithi152.stderr:holetest.c:140:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:12.396 INFO:teuthology.orchestra.run.smithi152.stderr: 140 | pwrite(fd, &tid, sizeof(tid), i * page_size + pgoff); 2024-04-17T08:49:12.396 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:12.511 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_truncate_self 2024-04-17T08:49:12.687 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] af_unix 2024-04-17T08:49:12.879 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_mmap_stale_pmd 2024-04-17T08:49:13.024 INFO:teuthology.orchestra.run.smithi152.stderr:t_mmap_stale_pmd.c: In function 'main': 2024-04-17T08:49:13.024 INFO:teuthology.orchestra.run.smithi152.stderr:t_mmap_stale_pmd.c:42:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:13.024 INFO:teuthology.orchestra.run.smithi152.stderr: 42 | ftruncate(fd, 0); 2024-04-17T08:49:13.024 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~ 2024-04-17T08:49:13.024 INFO:teuthology.orchestra.run.smithi152.stderr:t_mmap_stale_pmd.c:43:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:13.024 INFO:teuthology.orchestra.run.smithi152.stderr: 43 | ftruncate(fd, MiB(4)); 2024-04-17T08:49:13.024 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:13.024 INFO:teuthology.orchestra.run.smithi152.stderr:t_mmap_stale_pmd.c:55:9: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:13.024 INFO:teuthology.orchestra.run.smithi152.stderr: 55 | pwrite(fd, buffer, strlen(buffer), MiB(2)); 2024-04-17T08:49:13.025 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:13.071 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_mmap_cow_race 2024-04-17T08:49:13.220 INFO:teuthology.orchestra.run.smithi152.stderr:t_mmap_cow_race.c: In function 'main': 2024-04-17T08:49:13.220 INFO:teuthology.orchestra.run.smithi152.stderr:t_mmap_cow_race.c:61:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:13.220 INFO:teuthology.orchestra.run.smithi152.stderr: 61 | ftruncate(fd, 0); 2024-04-17T08:49:13.220 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~ 2024-04-17T08:49:13.220 INFO:teuthology.orchestra.run.smithi152.stderr:t_mmap_cow_race.c:62:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:13.220 INFO:teuthology.orchestra.run.smithi152.stderr: 62 | ftruncate(fd, MiB(2)); 2024-04-17T08:49:13.220 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:13.275 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_mmap_fallocate 2024-04-17T08:49:13.469 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] fsync-err 2024-04-17T08:49:13.696 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_mmap_write_ro 2024-04-17T08:49:13.888 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_ext4_dax_journal_corruption 2024-04-17T08:49:14.035 INFO:teuthology.orchestra.run.smithi152.stderr:t_ext4_dax_journal_corruption.c: In function 'main': 2024-04-17T08:49:14.035 INFO:teuthology.orchestra.run.smithi152.stderr:t_ext4_dax_journal_corruption.c:61:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:14.035 INFO:teuthology.orchestra.run.smithi152.stderr: 61 | ftruncate(fd, 0); 2024-04-17T08:49:14.035 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~ 2024-04-17T08:49:14.088 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_ext4_dax_inline_corruption 2024-04-17T08:49:14.284 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_ofd_locks 2024-04-17T08:49:14.522 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_mmap_collision 2024-04-17T08:49:14.763 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] mmap-write-concurrent 2024-04-17T08:49:14.973 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_get_file_time 2024-04-17T08:49:15.158 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_create_short_dirs 2024-04-17T08:49:15.364 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_create_long_dirs 2024-04-17T08:49:15.568 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_enospc 2024-04-17T08:49:15.810 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_mmap_writev_overlap 2024-04-17T08:49:16.020 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] checkpoint_journal 2024-04-17T08:49:16.261 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] mmap-rw-fault 2024-04-17T08:49:16.486 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] allocstale 2024-04-17T08:49:16.695 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_mmap_cow_memory_failure 2024-04-17T08:49:16.904 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] fake-dump-rootino 2024-04-17T08:49:17.092 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] dio-buf-fault 2024-04-17T08:49:17.285 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] rewinddir-test 2024-04-17T08:49:17.499 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] readdir-while-renames 2024-04-17T08:49:17.703 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] xfsctl 2024-04-17T08:49:17.934 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] bstat 2024-04-17T08:49:18.185 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_mtab 2024-04-17T08:49:18.335 INFO:teuthology.orchestra.run.smithi152.stderr:t_mtab.c: In function 'update_mtab': 2024-04-17T08:49:18.335 INFO:teuthology.orchestra.run.smithi152.stderr:t_mtab.c:256:17: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:18.335 INFO:teuthology.orchestra.run.smithi152.stderr: 256 | chown (mounted_temp, sbuf.st_uid, sbuf.st_gid); 2024-04-17T08:49:18.335 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:18.416 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] getdevicesize 2024-04-17T08:49:18.598 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] preallo_rw_pattern_reader 2024-04-17T08:49:18.755 INFO:teuthology.orchestra.run.smithi152.stderr:In file included from preallo_rw_pattern_reader.c:2: 2024-04-17T08:49:18.755 INFO:teuthology.orchestra.run.smithi152.stderr:iopat.c: In function 'main': 2024-04-17T08:49:18.755 INFO:teuthology.orchestra.run.smithi152.stderr:iopat.c:38:4: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:18.756 INFO:teuthology.orchestra.run.smithi152.stderr: 38 | read(fd, &x, 1048576); 2024-04-17T08:49:18.756 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:18.799 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] preallo_rw_pattern_writer 2024-04-17T08:49:18.955 INFO:teuthology.orchestra.run.smithi152.stderr:In file included from preallo_rw_pattern_writer.c:2: 2024-04-17T08:49:18.955 INFO:teuthology.orchestra.run.smithi152.stderr:iopat.c: In function 'main': 2024-04-17T08:49:18.955 INFO:teuthology.orchestra.run.smithi152.stderr:iopat.c:34:4: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:18.955 INFO:teuthology.orchestra.run.smithi152.stderr: 34 | write(fd, &x, 1048576); 2024-04-17T08:49:18.955 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:18.997 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] ftrunc 2024-04-17T08:49:19.185 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] trunc 2024-04-17T08:49:19.392 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] fs_perms 2024-04-17T08:49:19.541 INFO:teuthology.orchestra.run.smithi152.stderr:fs_perms.c: In function 'main': 2024-04-17T08:49:19.541 INFO:teuthology.orchestra.run.smithi152.stderr:fs_perms.c:54:4: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:19.542 INFO:teuthology.orchestra.run.smithi152.stderr: 54 | system("rm -f test.file"); 2024-04-17T08:49:19.542 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:19.542 INFO:teuthology.orchestra.run.smithi152.stderr:fs_perms.c: In function 'testsetup': 2024-04-17T08:49:19.542 INFO:teuthology.orchestra.run.smithi152.stderr:fs_perms.c:67:4: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:19.542 INFO:teuthology.orchestra.run.smithi152.stderr: 67 | system("cp testx.file test.file"); 2024-04-17T08:49:19.542 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:19.542 INFO:teuthology.orchestra.run.smithi152.stderr:fs_perms.c:69:4: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:19.542 INFO:teuthology.orchestra.run.smithi152.stderr: 69 | chown("test.file",cuserId,cgroupId); 2024-04-17T08:49:19.542 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:19.542 INFO:teuthology.orchestra.run.smithi152.stderr:fs_perms.c: In function 'testfperm': 2024-04-17T08:49:19.542 INFO:teuthology.orchestra.run.smithi152.stderr:fs_perms.c:123:5: warning: ignoring return value of 'seteuid' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:19.542 INFO:teuthology.orchestra.run.smithi152.stderr: 123 | seteuid(0); 2024-04-17T08:49:19.542 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~ 2024-04-17T08:49:19.542 INFO:teuthology.orchestra.run.smithi152.stderr:fs_perms.c:124:5: warning: ignoring return value of 'setegid' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:19.543 INFO:teuthology.orchestra.run.smithi152.stderr: 124 | setegid(0); 2024-04-17T08:49:19.543 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~ 2024-04-17T08:49:19.596 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] testx 2024-04-17T08:49:19.761 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] looptest 2024-04-17T08:49:19.995 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] locktest 2024-04-17T08:49:20.349 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] unwritten_mmap 2024-04-17T08:49:20.554 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] bulkstat_unlink_test 2024-04-17T08:49:20.710 INFO:teuthology.orchestra.run.smithi152.stderr:bulkstat_unlink_test.c: In function 'main': 2024-04-17T08:49:20.710 INFO:teuthology.orchestra.run.smithi152.stderr:bulkstat_unlink_test.c:106:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:20.710 INFO:teuthology.orchestra.run.smithi152.stderr: 106 | write(fd[i], fname, sizeof(fname)); 2024-04-17T08:49:20.710 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:20.711 INFO:teuthology.orchestra.run.smithi152.stderr:bulkstat_unlink_test.c:178:17: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:20.711 INFO:teuthology.orchestra.run.smithi152.stderr: 178 | system(fname); 2024-04-17T08:49:20.711 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~ 2024-04-17T08:49:20.797 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] deduperace 2024-04-17T08:49:21.036 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] bulkstat_unlink_test_modified 2024-04-17T08:49:21.191 INFO:teuthology.orchestra.run.smithi152.stderr:bulkstat_unlink_test_modified.c: In function 'main': 2024-04-17T08:49:21.192 INFO:teuthology.orchestra.run.smithi152.stderr:bulkstat_unlink_test_modified.c:83:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.192 INFO:teuthology.orchestra.run.smithi152.stderr: 83 | write(fd, fname, sizeof(fname)); 2024-04-17T08:49:21.192 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:21.192 INFO:teuthology.orchestra.run.smithi152.stderr:bulkstat_unlink_test_modified.c:139:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.192 INFO:teuthology.orchestra.run.smithi152.stderr: 139 | write(fd, fname, sizeof(fname)); 2024-04-17T08:49:21.192 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:21.192 INFO:teuthology.orchestra.run.smithi152.stderr:bulkstat_unlink_test_modified.c:185:9: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.192 INFO:teuthology.orchestra.run.smithi152.stderr: 185 | system(fname); 2024-04-17T08:49:21.192 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~ 2024-04-17T08:49:21.274 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_dir_offset 2024-04-17T08:49:21.464 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_futimens 2024-04-17T08:49:21.642 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_immutable 2024-04-17T08:49:21.812 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c: In function 'create_test_area': 2024-04-17T08:49:21.812 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c:2061:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.812 INFO:teuthology.orchestra.run.smithi152.stderr: 2061 | asprintf(&path, "%s/immutable.d", dir); 2024-04-17T08:49:21.812 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:21.812 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c:2096:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.812 INFO:teuthology.orchestra.run.smithi152.stderr: 2096 | asprintf(&path, "%s/append-only.d", dir); 2024-04-17T08:49:21.812 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:21.813 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c: In function 'remove_test_area': 2024-04-17T08:49:21.813 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c:2152:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.813 INFO:teuthology.orchestra.run.smithi152.stderr: 2152 | asprintf(&path, "%s/immutable.d", dir); 2024-04-17T08:49:21.813 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:21.814 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c:2163:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.814 INFO:teuthology.orchestra.run.smithi152.stderr: 2163 | asprintf(&path, "%s/empty-immutable.d", dir); 2024-04-17T08:49:21.814 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:21.814 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c:2175:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.814 INFO:teuthology.orchestra.run.smithi152.stderr: 2175 | asprintf(&path, "%s/append-only.d", dir); 2024-04-17T08:49:21.814 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:21.814 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c:2186:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.814 INFO:teuthology.orchestra.run.smithi152.stderr: 2186 | asprintf(&path, "%s/empty-append-only.d", dir); 2024-04-17T08:49:21.814 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:21.814 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c:2197:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.815 INFO:teuthology.orchestra.run.smithi152.stderr: 2197 | asprintf(&path, "%s/append-only.f", dir); 2024-04-17T08:49:21.815 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:21.815 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c:2209:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.815 INFO:teuthology.orchestra.run.smithi152.stderr: 2209 | asprintf(&path, "%s/immutable.f", dir); 2024-04-17T08:49:21.815 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:21.816 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c: In function 'check_test_area': 2024-04-17T08:49:21.816 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c:1788:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.816 INFO:teuthology.orchestra.run.smithi152.stderr: 1788 | asprintf(&path, "%s/", dir); 2024-04-17T08:49:21.816 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:21.816 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c:1800:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.816 INFO:teuthology.orchestra.run.smithi152.stderr: 1800 | asprintf(&path, "%s/immutable.f", dir); 2024-04-17T08:49:21.816 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:21.816 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c:1812:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.816 INFO:teuthology.orchestra.run.smithi152.stderr: 1812 | asprintf(&path, "%s/append-only.f", dir); 2024-04-17T08:49:21.816 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:21.817 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c:1824:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.817 INFO:teuthology.orchestra.run.smithi152.stderr: 1824 | asprintf(&path, "%s/immutable.d", dir); 2024-04-17T08:49:21.817 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:21.817 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c:1837:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.817 INFO:teuthology.orchestra.run.smithi152.stderr: 1837 | asprintf(&path, "%s/append-only.d", dir); 2024-04-17T08:49:21.817 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:21.817 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c:1850:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.817 INFO:teuthology.orchestra.run.smithi152.stderr: 1850 | asprintf(&path, "%s/immutable.d/file", dir); 2024-04-17T08:49:21.817 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:21.817 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c:1862:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.817 INFO:teuthology.orchestra.run.smithi152.stderr: 1862 | asprintf(&path, "%s/append-only.d/file", dir); 2024-04-17T08:49:21.817 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:21.817 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c:1874:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.817 INFO:teuthology.orchestra.run.smithi152.stderr: 1874 | asprintf(&path, "%s/immutable.d/dir", dir); 2024-04-17T08:49:21.817 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:21.817 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c:1887:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.817 INFO:teuthology.orchestra.run.smithi152.stderr: 1887 | asprintf(&path, "%s/append-only.d/dir", dir); 2024-04-17T08:49:21.818 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:21.819 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c: In function 'test_immutable': 2024-04-17T08:49:21.819 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c:151:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.819 INFO:teuthology.orchestra.run.smithi152.stderr: 151 | asprintf(&path, "%s/immutable.f", dir); 2024-04-17T08:49:21.820 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:21.820 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c:381:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.820 INFO:teuthology.orchestra.run.smithi152.stderr: 381 | asprintf(&linkpath, "%s/immutable.f.hardlink", dir); 2024-04-17T08:49:21.820 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:21.820 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c:408:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.820 INFO:teuthology.orchestra.run.smithi152.stderr: 408 | chown(path, 0, 0); 2024-04-17T08:49:21.820 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~ 2024-04-17T08:49:21.820 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c:485:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.820 INFO:teuthology.orchestra.run.smithi152.stderr: 485 | asprintf(&linkpath, "%s/immutable.f.newname", dir); 2024-04-17T08:49:21.820 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:21.820 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c:532:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.820 INFO:teuthology.orchestra.run.smithi152.stderr: 532 | asprintf(&path, "%s/immutable.d/file", dir); 2024-04-17T08:49:21.820 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:21.820 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c:553:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.820 INFO:teuthology.orchestra.run.smithi152.stderr: 553 | chown(path, 0, 0); 2024-04-17T08:49:21.820 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~ 2024-04-17T08:49:21.821 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c:556:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.821 INFO:teuthology.orchestra.run.smithi152.stderr: 556 | asprintf(&linkpath, "%s/immutable.d/file.link", dir); 2024-04-17T08:49:21.821 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:21.821 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c:575:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.821 INFO:teuthology.orchestra.run.smithi152.stderr: 575 | asprintf(&linkpath, "%s/immutable.d/file.newname", dir); 2024-04-17T08:49:21.821 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:21.821 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c:595:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.821 INFO:teuthology.orchestra.run.smithi152.stderr: 595 | asprintf(&path, "%s/immutable.d/newfile", dir); 2024-04-17T08:49:21.821 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:21.821 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c:619:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.821 INFO:teuthology.orchestra.run.smithi152.stderr: 619 | asprintf(&path, "%s/immutable.d/newdir", dir); 2024-04-17T08:49:21.821 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:21.821 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c:631:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.821 INFO:teuthology.orchestra.run.smithi152.stderr: 631 | asprintf(&path, "%s/immutable.d/dir/newfile-%d", dir, getuid()); 2024-04-17T08:49:21.821 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:21.821 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c:653:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.821 INFO:teuthology.orchestra.run.smithi152.stderr: 653 | chown(path, 0, 0); 2024-04-17T08:49:21.822 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~ 2024-04-17T08:49:21.822 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c:657:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.822 INFO:teuthology.orchestra.run.smithi152.stderr: 657 | asprintf(&path, "%s/immutable.d/dir", dir); 2024-04-17T08:49:21.822 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:21.822 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c:668:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.822 INFO:teuthology.orchestra.run.smithi152.stderr: 668 | asprintf(&path, "%s/immutable.d", dir); 2024-04-17T08:49:21.822 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:21.822 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c:705:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.822 INFO:teuthology.orchestra.run.smithi152.stderr: 705 | chown(path, 0, 0); 2024-04-17T08:49:21.822 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~ 2024-04-17T08:49:21.822 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c:782:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.822 INFO:teuthology.orchestra.run.smithi152.stderr: 782 | asprintf(&path, "%s/empty-immutable.d", dir); 2024-04-17T08:49:21.822 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:21.824 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c: In function 'test_append': 2024-04-17T08:49:21.825 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c:822:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.825 INFO:teuthology.orchestra.run.smithi152.stderr: 822 | asprintf(&path, "%s/append-only.f", dir); 2024-04-17T08:49:21.825 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:21.825 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c:1024:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.825 INFO:teuthology.orchestra.run.smithi152.stderr: 1024 | asprintf(&linkpath, "%s/append-only.f.hardlink", dir); 2024-04-17T08:49:21.825 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:21.825 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c:1051:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.825 INFO:teuthology.orchestra.run.smithi152.stderr: 1051 | chown(path, 0, 0); 2024-04-17T08:49:21.825 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~ 2024-04-17T08:49:21.825 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c:1126:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.825 INFO:teuthology.orchestra.run.smithi152.stderr: 1126 | asprintf(&linkpath, "%s/append-only.f.newname", dir); 2024-04-17T08:49:21.825 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:21.825 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c:1495:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.825 INFO:teuthology.orchestra.run.smithi152.stderr: 1495 | asprintf(&path, "%s/append-only.d/file", dir); 2024-04-17T08:49:21.826 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:21.826 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c:1516:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.826 INFO:teuthology.orchestra.run.smithi152.stderr: 1516 | chown(path, 0, 0); 2024-04-17T08:49:21.826 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~ 2024-04-17T08:49:21.826 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c:1519:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.826 INFO:teuthology.orchestra.run.smithi152.stderr: 1519 | asprintf(&linkpath, "%s/append-only.d/file.link-%d", dir, getuid()); 2024-04-17T08:49:21.826 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:21.826 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c:1529:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.826 INFO:teuthology.orchestra.run.smithi152.stderr: 1529 | asprintf(&linkpath, "%s/append-only.d/file.symlink-%d", dir, getuid()); 2024-04-17T08:49:21.826 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:21.826 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c:1539:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.826 INFO:teuthology.orchestra.run.smithi152.stderr: 1539 | asprintf(&linkpath, "%s/append-only.d/file.newname", dir); 2024-04-17T08:49:21.826 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:21.826 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c:1559:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.826 INFO:teuthology.orchestra.run.smithi152.stderr: 1559 | asprintf(&path, "%s/append-only.d/newfile-%d", dir, getuid()); 2024-04-17T08:49:21.826 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:21.827 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c:1573:11: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.827 INFO:teuthology.orchestra.run.smithi152.stderr: 1573 | asprintf(&path, "%s/append-only.d/newdev-%d", dir, getuid()); 2024-04-17T08:49:21.827 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:21.827 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c:1586:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.827 INFO:teuthology.orchestra.run.smithi152.stderr: 1586 | asprintf(&path, "%s/append-only.d/newdir-%d", dir, getuid()); 2024-04-17T08:49:21.827 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:21.827 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c:1596:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.827 INFO:teuthology.orchestra.run.smithi152.stderr: 1596 | asprintf(&path, "%s/append-only.d/newdir-%d/newfile-%d", dir, getuid(), getuid()); 2024-04-17T08:49:21.827 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:21.827 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c:1618:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.827 INFO:teuthology.orchestra.run.smithi152.stderr: 1618 | chown(path, 0, 0); 2024-04-17T08:49:21.827 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~ 2024-04-17T08:49:21.827 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c:1622:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.827 INFO:teuthology.orchestra.run.smithi152.stderr: 1622 | asprintf(&path, "%s/append-only.d/dir/newfile-%d", dir, getuid()); 2024-04-17T08:49:21.827 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:21.827 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c:1644:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.828 INFO:teuthology.orchestra.run.smithi152.stderr: 1644 | chown(path, 0, 0); 2024-04-17T08:49:21.828 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~ 2024-04-17T08:49:21.828 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c:1648:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.828 INFO:teuthology.orchestra.run.smithi152.stderr: 1648 | asprintf(&path, "%s/append-only.d/dir", dir); 2024-04-17T08:49:21.828 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:21.828 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c:1659:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.828 INFO:teuthology.orchestra.run.smithi152.stderr: 1659 | asprintf(&path, "%s/append-only.d", dir); 2024-04-17T08:49:21.828 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:21.828 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c:1692:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.828 INFO:teuthology.orchestra.run.smithi152.stderr: 1692 | chown(path, 0, 0); 2024-04-17T08:49:21.828 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~ 2024-04-17T08:49:21.828 INFO:teuthology.orchestra.run.smithi152.stderr:t_immutable.c:1769:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:21.828 INFO:teuthology.orchestra.run.smithi152.stderr: 1769 | asprintf(&path, "%s/empty-append-only.d", dir); 2024-04-17T08:49:21.828 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:22.286 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T08:49:22.289 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T08:49:22.366 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] stale_handle 2024-04-17T08:49:22.522 INFO:teuthology.orchestra.run.smithi152.stderr:stale_handle.c: In function 'main': 2024-04-17T08:49:22.522 INFO:teuthology.orchestra.run.smithi152.stderr:stale_handle.c:102:9: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:22.522 INFO:teuthology.orchestra.run.smithi152.stderr: 102 | system("echo 3 > /proc/sys/vm/drop_caches"); 2024-04-17T08:49:22.522 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:22.579 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] pwrite_mmap_blocked 2024-04-17T08:49:22.771 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_dir_offset2 2024-04-17T08:49:23.004 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] seek_sanity_test 2024-04-17T08:49:23.168 INFO:teuthology.orchestra.run.smithi152.stderr:seek_sanity_test.c: In function 'test18': 2024-04-17T08:49:23.168 INFO:teuthology.orchestra.run.smithi152.stderr:seek_sanity_test.c:460:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:23.168 INFO:teuthology.orchestra.run.smithi152.stderr: 460 | ftruncate(fd, 0); 2024-04-17T08:49:23.168 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~ 2024-04-17T08:49:23.171 INFO:teuthology.orchestra.run.smithi152.stderr:seek_sanity_test.c: In function 'test_basic_support': 2024-04-17T08:49:23.171 INFO:teuthology.orchestra.run.smithi152.stderr:seek_sanity_test.c:1207:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:23.171 INFO:teuthology.orchestra.run.smithi152.stderr: 1207 | ftruncate(fd, 0); 2024-04-17T08:49:23.171 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~ 2024-04-17T08:49:23.171 INFO:teuthology.orchestra.run.smithi152.stderr:seek_sanity_test.c:1256:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:23.171 INFO:teuthology.orchestra.run.smithi152.stderr: 1256 | ftruncate(fd, 0); 2024-04-17T08:49:23.171 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~ 2024-04-17T08:49:23.171 INFO:teuthology.orchestra.run.smithi152.stderr:seek_sanity_test.c: In function 'get_io_sizes': 2024-04-17T08:49:23.171 INFO:teuthology.orchestra.run.smithi152.stderr:seek_sanity_test.c:88:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:23.171 INFO:teuthology.orchestra.run.smithi152.stderr: 88 | ftruncate(fd, 0); 2024-04-17T08:49:23.171 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~ 2024-04-17T08:49:23.172 INFO:teuthology.orchestra.run.smithi152.stderr:seek_sanity_test.c:89:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:23.172 INFO:teuthology.orchestra.run.smithi152.stderr: 89 | pwrite(fd, "a", 1, offset); 2024-04-17T08:49:23.172 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:23.172 INFO:teuthology.orchestra.run.smithi152.stderr:seek_sanity_test.c:98:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:23.172 INFO:teuthology.orchestra.run.smithi152.stderr: 98 | ftruncate(fd, 0); 2024-04-17T08:49:23.172 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~ 2024-04-17T08:49:23.172 INFO:teuthology.orchestra.run.smithi152.stderr:seek_sanity_test.c:99:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:23.172 INFO:teuthology.orchestra.run.smithi152.stderr: 99 | pwrite(fd, "a", 1, offset); 2024-04-17T08:49:23.172 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:23.486 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] seek_copy_test 2024-04-17T08:49:23.704 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_readdir_1 2024-04-17T08:49:23.849 INFO:teuthology.orchestra.run.smithi152.stderr:t_readdir_1.c: In function 'main': 2024-04-17T08:49:23.849 INFO:teuthology.orchestra.run.smithi152.stderr:t_readdir_1.c:30:25: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:23.850 INFO:teuthology.orchestra.run.smithi152.stderr: 30 | read(fd, buf, 100); 2024-04-17T08:49:23.850 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:23.891 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_readdir_2 2024-04-17T08:49:24.081 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] fsync-tester 2024-04-17T08:49:24.228 INFO:teuthology.orchestra.run.smithi152.stderr:fsync-tester.c: In function 'main': 2024-04-17T08:49:24.228 INFO:teuthology.orchestra.run.smithi152.stderr:fsync-tester.c:391:17: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:24.229 INFO:teuthology.orchestra.run.smithi152.stderr: 391 | read(fd, &seed, sizeof(seed)); 2024-04-17T08:49:24.229 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:24.229 INFO:teuthology.orchestra.run.smithi152.stderr:fsync-tester.c:541:17: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:24.229 INFO:teuthology.orchestra.run.smithi152.stderr: 541 | system("reboot -fn"); 2024-04-17T08:49:24.229 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:24.229 INFO:teuthology.orchestra.run.smithi152.stderr:fsync-tester.c: In function 'drop_all_caches': 2024-04-17T08:49:24.229 INFO:teuthology.orchestra.run.smithi152.stderr:fsync-tester.c:90:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:24.229 INFO:teuthology.orchestra.run.smithi152.stderr: 90 | write(fd, value, sizeof(value)-1); 2024-04-17T08:49:24.229 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:24.379 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] nsexec 2024-04-17T08:49:24.601 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] cloner 2024-04-17T08:49:24.817 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] renameat2 2024-04-17T08:49:25.022 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_getcwd 2024-04-17T08:49:25.168 INFO:teuthology.orchestra.run.smithi152.stderr:t_getcwd.c: In function 'test_getcwd': 2024-04-17T08:49:25.168 INFO:teuthology.orchestra.run.smithi152.stderr:t_getcwd.c:21:17: warning: ignoring return value of 'getcwd' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:25.168 INFO:teuthology.orchestra.run.smithi152.stderr: 21 | getcwd(cur_cwd, BUF_SIZE); 2024-04-17T08:49:25.168 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:25.223 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] e4compact 2024-04-17T08:49:25.471 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] test-nextquota 2024-04-17T08:49:25.686 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] punch-alternating 2024-04-17T08:49:25.898 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] attr-list-by-handle-cursor-test 2024-04-17T08:49:26.107 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] listxattr 2024-04-17T08:49:26.291 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] dio-interleaved 2024-04-17T08:49:26.494 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_dir_type 2024-04-17T08:49:26.689 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] dio-invalidate-cache 2024-04-17T08:49:26.837 INFO:teuthology.orchestra.run.smithi152.stderr:dio-invalidate-cache.c: In function 'main': 2024-04-17T08:49:26.837 INFO:teuthology.orchestra.run.smithi152.stderr:dio-invalidate-cache.c:286:17: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:26.837 INFO:teuthology.orchestra.run.smithi152.stderr: 286 | write(fd, buf, blksz * nr_child); 2024-04-17T08:49:26.837 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:26.936 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] stat_test 2024-04-17T08:49:27.270 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_encrypted_d_revalidate 2024-04-17T08:49:27.478 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] attr_replace_test 2024-04-17T08:49:27.684 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] swapon 2024-04-17T08:49:27.889 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] mkswap 2024-04-17T08:49:28.080 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_attr_corruption 2024-04-17T08:49:28.269 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_open_tmpfiles 2024-04-17T08:49:28.493 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] fscrypt-crypt-util 2024-04-17T08:49:29.168 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] bulkstat_null_ocount 2024-04-17T08:49:29.365 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] splice-test 2024-04-17T08:49:29.590 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] chprojid_fail 2024-04-17T08:49:29.794 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] detached_mounts_propagation 2024-04-17T08:49:30.022 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] ext4_resize 2024-04-17T08:49:30.213 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_readdir_3 2024-04-17T08:49:30.448 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] splice2pipe 2024-04-17T08:49:30.592 INFO:teuthology.orchestra.run.smithi152.stderr:splice2pipe.c: In function 'prepare_pipe': 2024-04-17T08:49:30.593 INFO:teuthology.orchestra.run.smithi152.stderr:splice2pipe.c:57:17: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:30.593 INFO:teuthology.orchestra.run.smithi152.stderr: 57 | write(p[1], buffer, n); 2024-04-17T08:49:30.593 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:30.593 INFO:teuthology.orchestra.run.smithi152.stderr:splice2pipe.c:65:17: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:30.593 INFO:teuthology.orchestra.run.smithi152.stderr: 65 | read(p[0], buffer, n); 2024-04-17T08:49:30.593 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:30.651 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] uuid_ioctl 2024-04-17T08:49:30.847 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_snapshot_deleted_subvolume 2024-04-17T08:49:31.054 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] fiemap-fault 2024-04-17T08:49:31.250 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] fiemap-tester 2024-04-17T08:49:31.559 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_stripealign 2024-04-17T08:49:31.754 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] open_by_handle 2024-04-17T08:49:32.044 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_mmap_dio 2024-04-17T08:49:32.246 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] uring_read_fault 2024-04-17T08:49:32.472 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] xfsfind 2024-04-17T08:49:32.711 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_reflink_read_race 2024-04-17T08:49:32.947 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] fssum 2024-04-17T08:49:33.427 INFO:teuthology.orchestra.run.smithi152.stdout:Building log-writes 2024-04-17T08:49:33.435 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] replay-log 2024-04-17T08:49:33.807 INFO:teuthology.orchestra.run.smithi152.stdout:Building perf 2024-04-17T08:49:33.813 INFO:teuthology.orchestra.run.smithi152.stdout:Building aio-dio-regress 2024-04-17T08:49:33.822 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] aiocp 2024-04-17T08:49:34.098 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] aio-dio-append-write-fallocate-race 2024-04-17T08:49:34.314 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] aio-dio-append-write-read-race 2024-04-17T08:49:34.537 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] aio-dio-cow-race 2024-04-17T08:49:34.735 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] aio-dio-cycle-write 2024-04-17T08:49:34.879 INFO:teuthology.orchestra.run.smithi152.stderr:aio-dio-cycle-write.c: In function 'init_test': 2024-04-17T08:49:34.879 INFO:teuthology.orchestra.run.smithi152.stderr:aio-dio-cycle-write.c:83:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:34.879 INFO:teuthology.orchestra.run.smithi152.stderr: 83 | ftruncate(fd, buf_size); 2024-04-17T08:49:34.879 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:34.968 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] aio-dio-eof-race 2024-04-17T08:49:35.198 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] aio-dio-extend-stat 2024-04-17T08:49:35.411 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] aio-dio-fcntl-race 2024-04-17T08:49:35.622 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] aio-dio-hole-filling-race 2024-04-17T08:49:35.817 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] aio-dio-invalidate-failure 2024-04-17T08:49:36.020 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] aio-dio-invalidate-readahead 2024-04-17T08:49:36.232 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] aiodio_sparse2 2024-04-17T08:49:36.380 INFO:teuthology.orchestra.run.smithi152.stderr:aiodio_sparse2.c: In function 'aiodio_sparse': 2024-04-17T08:49:36.380 INFO:teuthology.orchestra.run.smithi152.stderr:aiodio_sparse2.c:111:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:36.380 INFO:teuthology.orchestra.run.smithi152.stderr: 111 | ftruncate(fd, filesize); 2024-04-17T08:49:36.380 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:36.381 INFO:teuthology.orchestra.run.smithi152.stderr:aiodio_sparse2.c: In function 'dirty_freeblocks': 2024-04-17T08:49:36.381 INFO:teuthology.orchestra.run.smithi152.stderr:aiodio_sparse2.c:274:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-04-17T08:49:36.381 INFO:teuthology.orchestra.run.smithi152.stderr: 274 | ftruncate(fd, size); 2024-04-17T08:49:36.381 INFO:teuthology.orchestra.run.smithi152.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-04-17T08:49:36.503 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] aio-dio-subblock-eof-read 2024-04-17T08:49:36.692 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] aio-dio-write-verify 2024-04-17T08:49:36.938 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2024-04-17T08:49:37.116 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2024-04-17T08:49:37.294 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] aio-last-ref-held-by-io 2024-04-17T08:49:37.517 INFO:teuthology.orchestra.run.smithi152.stdout:Building vfs 2024-04-17T08:49:37.526 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] vfstest 2024-04-17T08:49:41.691 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] mount-idmapped 2024-04-17T08:49:42.158 INFO:teuthology.orchestra.run.smithi152.stdout:Building m4 2024-04-17T08:49:42.164 INFO:teuthology.orchestra.run.smithi152.stdout:Building common 2024-04-17T08:49:42.170 INFO:teuthology.orchestra.run.smithi152.stdout:Building tests 2024-04-17T08:49:42.179 INFO:teuthology.orchestra.run.smithi152.stdout:Building btrfs 2024-04-17T08:49:42.189 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/btrfs/group.list 2024-04-17T08:49:42.321 INFO:teuthology.orchestra.run.smithi152.stdout:Building ceph 2024-04-17T08:49:42.330 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/ceph/group.list 2024-04-17T08:49:42.360 INFO:teuthology.orchestra.run.smithi152.stdout:Building cifs 2024-04-17T08:49:42.369 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/cifs/group.list 2024-04-17T08:49:42.396 INFO:teuthology.orchestra.run.smithi152.stdout:Building ext4 2024-04-17T08:49:42.405 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/ext4/group.list 2024-04-17T08:49:42.485 INFO:teuthology.orchestra.run.smithi152.stdout:Building f2fs 2024-04-17T08:49:42.493 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/f2fs/group.list 2024-04-17T08:49:42.530 INFO:teuthology.orchestra.run.smithi152.stdout:Building generic 2024-04-17T08:49:42.540 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/generic/group.list 2024-04-17T08:49:42.752 INFO:teuthology.orchestra.run.smithi152.stdout:Building nfs 2024-04-17T08:49:42.760 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/nfs/group.list 2024-04-17T08:49:42.791 INFO:teuthology.orchestra.run.smithi152.stdout:Building ocfs2 2024-04-17T08:49:42.799 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/ocfs2/group.list 2024-04-17T08:49:42.828 INFO:teuthology.orchestra.run.smithi152.stdout:Building overlay 2024-04-17T08:49:42.836 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/overlay/group.list 2024-04-17T08:49:42.922 INFO:teuthology.orchestra.run.smithi152.stdout:Building perf 2024-04-17T08:49:42.931 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/perf/group.list 2024-04-17T08:49:42.955 INFO:teuthology.orchestra.run.smithi152.stdout:Building selftest 2024-04-17T08:49:42.964 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/selftest/group.list 2024-04-17T08:49:42.990 INFO:teuthology.orchestra.run.smithi152.stdout:Building shared 2024-04-17T08:49:42.999 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/shared/group.list 2024-04-17T08:49:43.036 INFO:teuthology.orchestra.run.smithi152.stdout:Building tmpfs 2024-04-17T08:49:43.044 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/tmpfs/group.list 2024-04-17T08:49:43.073 INFO:teuthology.orchestra.run.smithi152.stdout:Building udf 2024-04-17T08:49:43.081 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/udf/group.list 2024-04-17T08:49:43.105 INFO:teuthology.orchestra.run.smithi152.stdout:Building xfs 2024-04-17T08:49:43.116 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/xfs/group.list 2024-04-17T08:49:43.327 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo make install) 2024-04-17T08:49:43.368 INFO:teuthology.orchestra.run.smithi152.stdout:Building include 2024-04-17T08:49:43.374 INFO:teuthology.orchestra.run.smithi152.stdout:Building lib 2024-04-17T08:49:43.381 INFO:teuthology.orchestra.run.smithi152.stdout:Building ltp 2024-04-17T08:49:43.388 INFO:teuthology.orchestra.run.smithi152.stdout:Building src 2024-04-17T08:49:43.443 INFO:teuthology.orchestra.run.smithi152.stdout:Building log-writes 2024-04-17T08:49:43.450 INFO:teuthology.orchestra.run.smithi152.stdout:Building perf 2024-04-17T08:49:43.456 INFO:teuthology.orchestra.run.smithi152.stdout:Building aio-dio-regress 2024-04-17T08:49:43.463 INFO:teuthology.orchestra.run.smithi152.stdout:Building vfs 2024-04-17T08:49:43.470 INFO:teuthology.orchestra.run.smithi152.stdout:Building m4 2024-04-17T08:49:43.476 INFO:teuthology.orchestra.run.smithi152.stdout:Building common 2024-04-17T08:49:43.483 INFO:teuthology.orchestra.run.smithi152.stdout:Building tests 2024-04-17T08:49:43.491 INFO:teuthology.orchestra.run.smithi152.stdout:Building btrfs 2024-04-17T08:49:43.501 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/btrfs/group.list 2024-04-17T08:49:43.631 INFO:teuthology.orchestra.run.smithi152.stdout:Building ceph 2024-04-17T08:49:43.639 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/ceph/group.list 2024-04-17T08:49:43.670 INFO:teuthology.orchestra.run.smithi152.stdout:Building cifs 2024-04-17T08:49:43.679 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/cifs/group.list 2024-04-17T08:49:43.706 INFO:teuthology.orchestra.run.smithi152.stdout:Building ext4 2024-04-17T08:49:43.715 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/ext4/group.list 2024-04-17T08:49:43.795 INFO:teuthology.orchestra.run.smithi152.stdout:Building f2fs 2024-04-17T08:49:43.803 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/f2fs/group.list 2024-04-17T08:49:43.840 INFO:teuthology.orchestra.run.smithi152.stdout:Building generic 2024-04-17T08:49:43.851 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/generic/group.list 2024-04-17T08:49:44.055 INFO:teuthology.orchestra.run.smithi152.stdout:Building nfs 2024-04-17T08:49:44.064 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/nfs/group.list 2024-04-17T08:49:44.094 INFO:teuthology.orchestra.run.smithi152.stdout:Building ocfs2 2024-04-17T08:49:44.103 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/ocfs2/group.list 2024-04-17T08:49:44.132 INFO:teuthology.orchestra.run.smithi152.stdout:Building overlay 2024-04-17T08:49:44.140 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/overlay/group.list 2024-04-17T08:49:44.226 INFO:teuthology.orchestra.run.smithi152.stdout:Building perf 2024-04-17T08:49:44.235 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/perf/group.list 2024-04-17T08:49:44.259 INFO:teuthology.orchestra.run.smithi152.stdout:Building selftest 2024-04-17T08:49:44.268 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/selftest/group.list 2024-04-17T08:49:44.296 INFO:teuthology.orchestra.run.smithi152.stdout:Building shared 2024-04-17T08:49:44.305 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/shared/group.list 2024-04-17T08:49:44.343 INFO:teuthology.orchestra.run.smithi152.stdout:Building tmpfs 2024-04-17T08:49:44.351 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/tmpfs/group.list 2024-04-17T08:49:44.382 INFO:teuthology.orchestra.run.smithi152.stdout:Building udf 2024-04-17T08:49:44.390 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/udf/group.list 2024-04-17T08:49:44.414 INFO:teuthology.orchestra.run.smithi152.stdout:Building xfs 2024-04-17T08:49:44.425 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/xfs/group.list 2024-04-17T08:49:44.625 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2024-04-17T08:49:44.628 INFO:teuthology.orchestra.run.smithi152.stdout:gmake[1]: Nothing to be done for 'install'. 2024-04-17T08:49:44.629 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2024-04-17T08:49:44.633 INFO:teuthology.orchestra.run.smithi152.stdout:gmake[1]: Nothing to be done for 'install'. 2024-04-17T08:49:44.633 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2024-04-17T08:49:44.638 INFO:teuthology.orchestra.run.smithi152.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2024-04-17T08:49:44.657 INFO:teuthology.orchestra.run.smithi152.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2024-04-17T08:49:44.810 INFO:teuthology.orchestra.run.smithi152.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2024-04-17T08:49:44.830 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2024-04-17T08:49:44.857 INFO:teuthology.orchestra.run.smithi152.stdout:Building log-writes 2024-04-17T08:49:44.864 INFO:teuthology.orchestra.run.smithi152.stdout:Building perf 2024-04-17T08:49:44.870 INFO:teuthology.orchestra.run.smithi152.stdout:Building aio-dio-regress 2024-04-17T08:49:44.877 INFO:teuthology.orchestra.run.smithi152.stdout:Building vfs 2024-04-17T08:49:44.882 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/gmake -C log-writes install 2024-04-17T08:49:44.886 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2024-04-17T08:49:44.905 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2024-04-17T08:49:44.925 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/gmake -C perf install 2024-04-17T08:49:44.929 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2024-04-17T08:49:44.947 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2024-04-17T08:49:44.994 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/gmake -C aio-dio-regress install 2024-04-17T08:49:44.998 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2024-04-17T08:49:45.018 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2024-04-17T08:49:45.126 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/gmake -C vfs install 2024-04-17T08:49:45.130 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2024-04-17T08:49:45.149 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2024-04-17T08:49:45.177 INFO:teuthology.orchestra.run.smithi152.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2024-04-17T08:49:45.196 INFO:teuthology.orchestra.run.smithi152.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test readdir-while-renames xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl t_snapshot_deleted_subvolume fiemap-fault fiemap-tester t_stripealign open_by_handle t_mmap_dio uring_read_fault xfsfind t_reflink_read_race fssum /var/lib/xfstests/src 2024-04-17T08:49:47.949 INFO:teuthology.orchestra.run.smithi152.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2024-04-17T08:49:48.160 INFO:teuthology.orchestra.run.smithi152.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2024-04-17T08:49:48.206 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2024-04-17T08:49:48.210 INFO:teuthology.orchestra.run.smithi152.stdout:gmake[1]: Nothing to be done for 'install'. 2024-04-17T08:49:48.210 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2024-04-17T08:49:48.214 INFO:teuthology.orchestra.run.smithi152.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2024-04-17T08:49:48.233 INFO:teuthology.orchestra.run.smithi152.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2024-04-17T08:49:48.512 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2024-04-17T08:49:48.516 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/btrfs/ install 2024-04-17T08:49:48.522 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/btrfs/group.list 2024-04-17T08:49:48.651 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2024-04-17T08:49:48.671 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 320 330 /var/lib/xfstests/tests/btrfs 2024-04-17T08:49:50.409 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2024-04-17T08:49:50.429 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 320.out 330.out /var/lib/xfstests/tests/btrfs 2024-04-17T08:49:52.180 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/ceph/ install 2024-04-17T08:49:52.186 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/ceph/group.list 2024-04-17T08:49:52.215 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2024-04-17T08:49:52.234 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2024-04-17T08:49:52.275 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2024-04-17T08:49:52.296 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2024-04-17T08:49:52.339 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/cifs/ install 2024-04-17T08:49:52.344 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/cifs/group.list 2024-04-17T08:49:52.369 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2024-04-17T08:49:52.377 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T08:49:52.381 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T08:49:52.389 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2024-04-17T08:49:52.409 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2024-04-17T08:49:52.428 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2024-04-17T08:49:52.448 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/ext4/ install 2024-04-17T08:49:52.454 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/ext4/group.list 2024-04-17T08:49:52.531 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2024-04-17T08:49:52.551 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2024-04-17T08:49:52.930 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2024-04-17T08:49:52.949 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2024-04-17T08:49:53.350 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/f2fs/ install 2024-04-17T08:49:53.355 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/f2fs/group.list 2024-04-17T08:49:53.391 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2024-04-17T08:49:53.410 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2024-04-17T08:49:53.435 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2024-04-17T08:49:53.455 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2024-04-17T08:49:53.481 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/generic/ install 2024-04-17T08:49:53.488 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/generic/group.list 2024-04-17T08:49:53.695 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2024-04-17T08:49:53.715 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 741 742 743 /var/lib/xfstests/tests/generic 2024-04-17T08:49:57.783 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2024-04-17T08:49:57.803 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 741.out 742.out 743.out /var/lib/xfstests/tests/generic 2024-04-17T08:50:01.909 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/nfs/ install 2024-04-17T08:50:01.915 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/nfs/group.list 2024-04-17T08:50:01.944 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2024-04-17T08:50:01.963 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2024-04-17T08:50:01.983 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2024-04-17T08:50:02.002 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2024-04-17T08:50:02.022 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/ocfs2/ install 2024-04-17T08:50:02.027 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/ocfs2/group.list 2024-04-17T08:50:02.055 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2024-04-17T08:50:02.074 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2024-04-17T08:50:02.093 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2024-04-17T08:50:02.113 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2024-04-17T08:50:02.132 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/overlay/ install 2024-04-17T08:50:02.138 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/overlay/group.list 2024-04-17T08:50:02.222 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2024-04-17T08:50:02.241 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2024-04-17T08:50:02.822 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2024-04-17T08:50:02.841 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2024-04-17T08:50:03.421 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/perf/ install 2024-04-17T08:50:03.426 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/perf/group.list 2024-04-17T08:50:03.449 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2024-04-17T08:50:03.469 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2024-04-17T08:50:03.489 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2024-04-17T08:50:03.508 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2024-04-17T08:50:03.528 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/selftest/ install 2024-04-17T08:50:03.534 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/selftest/group.list 2024-04-17T08:50:03.559 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2024-04-17T08:50:03.578 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2024-04-17T08:50:03.625 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2024-04-17T08:50:03.644 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2024-04-17T08:50:03.690 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/shared/ install 2024-04-17T08:50:03.695 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/shared/group.list 2024-04-17T08:50:03.730 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2024-04-17T08:50:03.750 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2024-04-17T08:50:03.780 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2024-04-17T08:50:03.799 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 002.out 032.out 298.out /var/lib/xfstests/tests/shared 2024-04-17T08:50:03.830 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/tmpfs/ install 2024-04-17T08:50:03.835 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/tmpfs/group.list 2024-04-17T08:50:03.862 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2024-04-17T08:50:03.882 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2024-04-17T08:50:03.901 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2024-04-17T08:50:03.920 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2024-04-17T08:50:03.940 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/udf/ install 2024-04-17T08:50:03.945 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/udf/group.list 2024-04-17T08:50:03.968 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2024-04-17T08:50:03.987 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2024-04-17T08:50:04.007 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2024-04-17T08:50:04.027 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2024-04-17T08:50:04.046 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/xfs/ install 2024-04-17T08:50:04.053 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.pJW3k3pP3vxfstests-dev/tests/xfs/group.list 2024-04-17T08:50:04.254 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2024-04-17T08:50:04.273 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2024-04-17T08:50:08.099 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2024-04-17T08:50:08.119 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.32 071.out.64 096.out.external 096.out.internal 216.out.64mblog 216.out.classic 033.cfg 216.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out /var/lib/xfstests/tests/xfs 2024-04-17T08:50:11.998 INFO:teuthology.orchestra.run.smithi152.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2024-04-17T08:50:12.017 INFO:teuthology.orchestra.run.smithi152.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2024-04-17T08:50:12.036 INFO:teuthology.orchestra.run.smithi152.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2024-04-17T08:50:12.056 INFO:teuthology.orchestra.run.smithi152.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2024-04-17T08:50:12.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T08:50:12.078 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec ls tests/generic) 2024-04-17T08:50:12.131 INFO:teuthology.orchestra.run.smithi152.stdout:001 2024-04-17T08:50:12.131 INFO:teuthology.orchestra.run.smithi152.stdout:001.out 2024-04-17T08:50:12.131 INFO:teuthology.orchestra.run.smithi152.stdout:002 2024-04-17T08:50:12.131 INFO:teuthology.orchestra.run.smithi152.stdout:002.out 2024-04-17T08:50:12.131 INFO:teuthology.orchestra.run.smithi152.stdout:003 2024-04-17T08:50:12.131 INFO:teuthology.orchestra.run.smithi152.stdout:003.out 2024-04-17T08:50:12.132 INFO:teuthology.orchestra.run.smithi152.stdout:004 2024-04-17T08:50:12.132 INFO:teuthology.orchestra.run.smithi152.stdout:004.out 2024-04-17T08:50:12.132 INFO:teuthology.orchestra.run.smithi152.stdout:005 2024-04-17T08:50:12.132 INFO:teuthology.orchestra.run.smithi152.stdout:005.out 2024-04-17T08:50:12.132 INFO:teuthology.orchestra.run.smithi152.stdout:006 2024-04-17T08:50:12.132 INFO:teuthology.orchestra.run.smithi152.stdout:006.out 2024-04-17T08:50:12.132 INFO:teuthology.orchestra.run.smithi152.stdout:007 2024-04-17T08:50:12.132 INFO:teuthology.orchestra.run.smithi152.stdout:007.out 2024-04-17T08:50:12.132 INFO:teuthology.orchestra.run.smithi152.stdout:008 2024-04-17T08:50:12.132 INFO:teuthology.orchestra.run.smithi152.stdout:008.out 2024-04-17T08:50:12.132 INFO:teuthology.orchestra.run.smithi152.stdout:009 2024-04-17T08:50:12.132 INFO:teuthology.orchestra.run.smithi152.stdout:009.out 2024-04-17T08:50:12.132 INFO:teuthology.orchestra.run.smithi152.stdout:010 2024-04-17T08:50:12.132 INFO:teuthology.orchestra.run.smithi152.stdout:010.out 2024-04-17T08:50:12.132 INFO:teuthology.orchestra.run.smithi152.stdout:011 2024-04-17T08:50:12.132 INFO:teuthology.orchestra.run.smithi152.stdout:011.out 2024-04-17T08:50:12.133 INFO:teuthology.orchestra.run.smithi152.stdout:012 2024-04-17T08:50:12.133 INFO:teuthology.orchestra.run.smithi152.stdout:012.out 2024-04-17T08:50:12.133 INFO:teuthology.orchestra.run.smithi152.stdout:013 2024-04-17T08:50:12.133 INFO:teuthology.orchestra.run.smithi152.stdout:013.out 2024-04-17T08:50:12.133 INFO:teuthology.orchestra.run.smithi152.stdout:014 2024-04-17T08:50:12.133 INFO:teuthology.orchestra.run.smithi152.stdout:014.out 2024-04-17T08:50:12.133 INFO:teuthology.orchestra.run.smithi152.stdout:015 2024-04-17T08:50:12.133 INFO:teuthology.orchestra.run.smithi152.stdout:015.out 2024-04-17T08:50:12.133 INFO:teuthology.orchestra.run.smithi152.stdout:016 2024-04-17T08:50:12.133 INFO:teuthology.orchestra.run.smithi152.stdout:016.out 2024-04-17T08:50:12.133 INFO:teuthology.orchestra.run.smithi152.stdout:017 2024-04-17T08:50:12.133 INFO:teuthology.orchestra.run.smithi152.stdout:017.out 2024-04-17T08:50:12.133 INFO:teuthology.orchestra.run.smithi152.stdout:018 2024-04-17T08:50:12.133 INFO:teuthology.orchestra.run.smithi152.stdout:018.out 2024-04-17T08:50:12.133 INFO:teuthology.orchestra.run.smithi152.stdout:019 2024-04-17T08:50:12.134 INFO:teuthology.orchestra.run.smithi152.stdout:019.out 2024-04-17T08:50:12.134 INFO:teuthology.orchestra.run.smithi152.stdout:020 2024-04-17T08:50:12.134 INFO:teuthology.orchestra.run.smithi152.stdout:020.out 2024-04-17T08:50:12.134 INFO:teuthology.orchestra.run.smithi152.stdout:021 2024-04-17T08:50:12.134 INFO:teuthology.orchestra.run.smithi152.stdout:021.out 2024-04-17T08:50:12.134 INFO:teuthology.orchestra.run.smithi152.stdout:022 2024-04-17T08:50:12.134 INFO:teuthology.orchestra.run.smithi152.stdout:022.out 2024-04-17T08:50:12.134 INFO:teuthology.orchestra.run.smithi152.stdout:023 2024-04-17T08:50:12.134 INFO:teuthology.orchestra.run.smithi152.stdout:023.out 2024-04-17T08:50:12.134 INFO:teuthology.orchestra.run.smithi152.stdout:024 2024-04-17T08:50:12.134 INFO:teuthology.orchestra.run.smithi152.stdout:024.out 2024-04-17T08:50:12.134 INFO:teuthology.orchestra.run.smithi152.stdout:025 2024-04-17T08:50:12.134 INFO:teuthology.orchestra.run.smithi152.stdout:025.out 2024-04-17T08:50:12.134 INFO:teuthology.orchestra.run.smithi152.stdout:026 2024-04-17T08:50:12.134 INFO:teuthology.orchestra.run.smithi152.stdout:026.out 2024-04-17T08:50:12.135 INFO:teuthology.orchestra.run.smithi152.stdout:027 2024-04-17T08:50:12.135 INFO:teuthology.orchestra.run.smithi152.stdout:027.out 2024-04-17T08:50:12.135 INFO:teuthology.orchestra.run.smithi152.stdout:028 2024-04-17T08:50:12.135 INFO:teuthology.orchestra.run.smithi152.stdout:028.out 2024-04-17T08:50:12.135 INFO:teuthology.orchestra.run.smithi152.stdout:029 2024-04-17T08:50:12.135 INFO:teuthology.orchestra.run.smithi152.stdout:029.out 2024-04-17T08:50:12.135 INFO:teuthology.orchestra.run.smithi152.stdout:030 2024-04-17T08:50:12.135 INFO:teuthology.orchestra.run.smithi152.stdout:030.out 2024-04-17T08:50:12.135 INFO:teuthology.orchestra.run.smithi152.stdout:031 2024-04-17T08:50:12.135 INFO:teuthology.orchestra.run.smithi152.stdout:031.out 2024-04-17T08:50:12.135 INFO:teuthology.orchestra.run.smithi152.stdout:032 2024-04-17T08:50:12.135 INFO:teuthology.orchestra.run.smithi152.stdout:032.out 2024-04-17T08:50:12.135 INFO:teuthology.orchestra.run.smithi152.stdout:033 2024-04-17T08:50:12.135 INFO:teuthology.orchestra.run.smithi152.stdout:033.out 2024-04-17T08:50:12.136 INFO:teuthology.orchestra.run.smithi152.stdout:034 2024-04-17T08:50:12.136 INFO:teuthology.orchestra.run.smithi152.stdout:034.out 2024-04-17T08:50:12.136 INFO:teuthology.orchestra.run.smithi152.stdout:035 2024-04-17T08:50:12.136 INFO:teuthology.orchestra.run.smithi152.stdout:035.cfg 2024-04-17T08:50:12.136 INFO:teuthology.orchestra.run.smithi152.stdout:035.out.default 2024-04-17T08:50:12.136 INFO:teuthology.orchestra.run.smithi152.stdout:035.out.nfs 2024-04-17T08:50:12.136 INFO:teuthology.orchestra.run.smithi152.stdout:036 2024-04-17T08:50:12.136 INFO:teuthology.orchestra.run.smithi152.stdout:036.out 2024-04-17T08:50:12.136 INFO:teuthology.orchestra.run.smithi152.stdout:037 2024-04-17T08:50:12.136 INFO:teuthology.orchestra.run.smithi152.stdout:037.out 2024-04-17T08:50:12.136 INFO:teuthology.orchestra.run.smithi152.stdout:038 2024-04-17T08:50:12.136 INFO:teuthology.orchestra.run.smithi152.stdout:038.out 2024-04-17T08:50:12.136 INFO:teuthology.orchestra.run.smithi152.stdout:039 2024-04-17T08:50:12.136 INFO:teuthology.orchestra.run.smithi152.stdout:039.out 2024-04-17T08:50:12.136 INFO:teuthology.orchestra.run.smithi152.stdout:040 2024-04-17T08:50:12.137 INFO:teuthology.orchestra.run.smithi152.stdout:040.out 2024-04-17T08:50:12.137 INFO:teuthology.orchestra.run.smithi152.stdout:041 2024-04-17T08:50:12.137 INFO:teuthology.orchestra.run.smithi152.stdout:041.out 2024-04-17T08:50:12.137 INFO:teuthology.orchestra.run.smithi152.stdout:042 2024-04-17T08:50:12.137 INFO:teuthology.orchestra.run.smithi152.stdout:042.out 2024-04-17T08:50:12.137 INFO:teuthology.orchestra.run.smithi152.stdout:043 2024-04-17T08:50:12.137 INFO:teuthology.orchestra.run.smithi152.stdout:043.out 2024-04-17T08:50:12.137 INFO:teuthology.orchestra.run.smithi152.stdout:044 2024-04-17T08:50:12.137 INFO:teuthology.orchestra.run.smithi152.stdout:044.out 2024-04-17T08:50:12.137 INFO:teuthology.orchestra.run.smithi152.stdout:045 2024-04-17T08:50:12.137 INFO:teuthology.orchestra.run.smithi152.stdout:045.out 2024-04-17T08:50:12.137 INFO:teuthology.orchestra.run.smithi152.stdout:046 2024-04-17T08:50:12.137 INFO:teuthology.orchestra.run.smithi152.stdout:046.out 2024-04-17T08:50:12.137 INFO:teuthology.orchestra.run.smithi152.stdout:047 2024-04-17T08:50:12.137 INFO:teuthology.orchestra.run.smithi152.stdout:047.out 2024-04-17T08:50:12.138 INFO:teuthology.orchestra.run.smithi152.stdout:048 2024-04-17T08:50:12.138 INFO:teuthology.orchestra.run.smithi152.stdout:048.out 2024-04-17T08:50:12.138 INFO:teuthology.orchestra.run.smithi152.stdout:049 2024-04-17T08:50:12.138 INFO:teuthology.orchestra.run.smithi152.stdout:049.out 2024-04-17T08:50:12.138 INFO:teuthology.orchestra.run.smithi152.stdout:050 2024-04-17T08:50:12.138 INFO:teuthology.orchestra.run.smithi152.stdout:050.cfg 2024-04-17T08:50:12.138 INFO:teuthology.orchestra.run.smithi152.stdout:050.out.default 2024-04-17T08:50:12.138 INFO:teuthology.orchestra.run.smithi152.stdout:050.out.nojournal 2024-04-17T08:50:12.138 INFO:teuthology.orchestra.run.smithi152.stdout:050.out.xfsquota 2024-04-17T08:50:12.138 INFO:teuthology.orchestra.run.smithi152.stdout:051 2024-04-17T08:50:12.138 INFO:teuthology.orchestra.run.smithi152.stdout:051.out 2024-04-17T08:50:12.138 INFO:teuthology.orchestra.run.smithi152.stdout:052 2024-04-17T08:50:12.138 INFO:teuthology.orchestra.run.smithi152.stdout:052.out 2024-04-17T08:50:12.138 INFO:teuthology.orchestra.run.smithi152.stdout:053 2024-04-17T08:50:12.139 INFO:teuthology.orchestra.run.smithi152.stdout:053.out 2024-04-17T08:50:12.139 INFO:teuthology.orchestra.run.smithi152.stdout:054 2024-04-17T08:50:12.139 INFO:teuthology.orchestra.run.smithi152.stdout:054.out 2024-04-17T08:50:12.139 INFO:teuthology.orchestra.run.smithi152.stdout:055 2024-04-17T08:50:12.139 INFO:teuthology.orchestra.run.smithi152.stdout:055.out 2024-04-17T08:50:12.139 INFO:teuthology.orchestra.run.smithi152.stdout:056 2024-04-17T08:50:12.139 INFO:teuthology.orchestra.run.smithi152.stdout:056.out 2024-04-17T08:50:12.139 INFO:teuthology.orchestra.run.smithi152.stdout:057 2024-04-17T08:50:12.139 INFO:teuthology.orchestra.run.smithi152.stdout:057.out 2024-04-17T08:50:12.139 INFO:teuthology.orchestra.run.smithi152.stdout:058 2024-04-17T08:50:12.139 INFO:teuthology.orchestra.run.smithi152.stdout:058.out 2024-04-17T08:50:12.139 INFO:teuthology.orchestra.run.smithi152.stdout:059 2024-04-17T08:50:12.139 INFO:teuthology.orchestra.run.smithi152.stdout:059.out 2024-04-17T08:50:12.139 INFO:teuthology.orchestra.run.smithi152.stdout:060 2024-04-17T08:50:12.140 INFO:teuthology.orchestra.run.smithi152.stdout:060.out 2024-04-17T08:50:12.140 INFO:teuthology.orchestra.run.smithi152.stdout:061 2024-04-17T08:50:12.140 INFO:teuthology.orchestra.run.smithi152.stdout:061.out 2024-04-17T08:50:12.140 INFO:teuthology.orchestra.run.smithi152.stdout:062 2024-04-17T08:50:12.140 INFO:teuthology.orchestra.run.smithi152.stdout:062.out 2024-04-17T08:50:12.140 INFO:teuthology.orchestra.run.smithi152.stdout:063 2024-04-17T08:50:12.140 INFO:teuthology.orchestra.run.smithi152.stdout:063.out 2024-04-17T08:50:12.140 INFO:teuthology.orchestra.run.smithi152.stdout:064 2024-04-17T08:50:12.140 INFO:teuthology.orchestra.run.smithi152.stdout:064.out 2024-04-17T08:50:12.140 INFO:teuthology.orchestra.run.smithi152.stdout:065 2024-04-17T08:50:12.140 INFO:teuthology.orchestra.run.smithi152.stdout:065.out 2024-04-17T08:50:12.140 INFO:teuthology.orchestra.run.smithi152.stdout:066 2024-04-17T08:50:12.140 INFO:teuthology.orchestra.run.smithi152.stdout:066.out 2024-04-17T08:50:12.140 INFO:teuthology.orchestra.run.smithi152.stdout:067 2024-04-17T08:50:12.140 INFO:teuthology.orchestra.run.smithi152.stdout:067.out 2024-04-17T08:50:12.141 INFO:teuthology.orchestra.run.smithi152.stdout:068 2024-04-17T08:50:12.141 INFO:teuthology.orchestra.run.smithi152.stdout:068.out 2024-04-17T08:50:12.141 INFO:teuthology.orchestra.run.smithi152.stdout:069 2024-04-17T08:50:12.141 INFO:teuthology.orchestra.run.smithi152.stdout:069.out 2024-04-17T08:50:12.141 INFO:teuthology.orchestra.run.smithi152.stdout:070 2024-04-17T08:50:12.141 INFO:teuthology.orchestra.run.smithi152.stdout:070.out 2024-04-17T08:50:12.141 INFO:teuthology.orchestra.run.smithi152.stdout:071 2024-04-17T08:50:12.141 INFO:teuthology.orchestra.run.smithi152.stdout:071.out 2024-04-17T08:50:12.141 INFO:teuthology.orchestra.run.smithi152.stdout:072 2024-04-17T08:50:12.141 INFO:teuthology.orchestra.run.smithi152.stdout:072.out 2024-04-17T08:50:12.141 INFO:teuthology.orchestra.run.smithi152.stdout:073 2024-04-17T08:50:12.141 INFO:teuthology.orchestra.run.smithi152.stdout:073.out 2024-04-17T08:50:12.141 INFO:teuthology.orchestra.run.smithi152.stdout:074 2024-04-17T08:50:12.141 INFO:teuthology.orchestra.run.smithi152.stdout:074.out 2024-04-17T08:50:12.141 INFO:teuthology.orchestra.run.smithi152.stdout:075 2024-04-17T08:50:12.141 INFO:teuthology.orchestra.run.smithi152.stdout:075.out 2024-04-17T08:50:12.141 INFO:teuthology.orchestra.run.smithi152.stdout:076 2024-04-17T08:50:12.142 INFO:teuthology.orchestra.run.smithi152.stdout:076.out 2024-04-17T08:50:12.142 INFO:teuthology.orchestra.run.smithi152.stdout:077 2024-04-17T08:50:12.142 INFO:teuthology.orchestra.run.smithi152.stdout:077.out 2024-04-17T08:50:12.142 INFO:teuthology.orchestra.run.smithi152.stdout:078 2024-04-17T08:50:12.142 INFO:teuthology.orchestra.run.smithi152.stdout:078.out 2024-04-17T08:50:12.142 INFO:teuthology.orchestra.run.smithi152.stdout:079 2024-04-17T08:50:12.142 INFO:teuthology.orchestra.run.smithi152.stdout:079.out 2024-04-17T08:50:12.142 INFO:teuthology.orchestra.run.smithi152.stdout:080 2024-04-17T08:50:12.142 INFO:teuthology.orchestra.run.smithi152.stdout:080.out 2024-04-17T08:50:12.142 INFO:teuthology.orchestra.run.smithi152.stdout:081 2024-04-17T08:50:12.142 INFO:teuthology.orchestra.run.smithi152.stdout:081.out 2024-04-17T08:50:12.142 INFO:teuthology.orchestra.run.smithi152.stdout:082 2024-04-17T08:50:12.142 INFO:teuthology.orchestra.run.smithi152.stdout:082.out 2024-04-17T08:50:12.142 INFO:teuthology.orchestra.run.smithi152.stdout:083 2024-04-17T08:50:12.142 INFO:teuthology.orchestra.run.smithi152.stdout:083.out 2024-04-17T08:50:12.142 INFO:teuthology.orchestra.run.smithi152.stdout:084 2024-04-17T08:50:12.143 INFO:teuthology.orchestra.run.smithi152.stdout:084.out 2024-04-17T08:50:12.143 INFO:teuthology.orchestra.run.smithi152.stdout:085 2024-04-17T08:50:12.143 INFO:teuthology.orchestra.run.smithi152.stdout:085.out 2024-04-17T08:50:12.143 INFO:teuthology.orchestra.run.smithi152.stdout:086 2024-04-17T08:50:12.143 INFO:teuthology.orchestra.run.smithi152.stdout:086.out 2024-04-17T08:50:12.143 INFO:teuthology.orchestra.run.smithi152.stdout:087 2024-04-17T08:50:12.143 INFO:teuthology.orchestra.run.smithi152.stdout:087.out 2024-04-17T08:50:12.143 INFO:teuthology.orchestra.run.smithi152.stdout:088 2024-04-17T08:50:12.143 INFO:teuthology.orchestra.run.smithi152.stdout:088.out 2024-04-17T08:50:12.143 INFO:teuthology.orchestra.run.smithi152.stdout:089 2024-04-17T08:50:12.143 INFO:teuthology.orchestra.run.smithi152.stdout:089.out 2024-04-17T08:50:12.143 INFO:teuthology.orchestra.run.smithi152.stdout:090 2024-04-17T08:50:12.143 INFO:teuthology.orchestra.run.smithi152.stdout:090.out 2024-04-17T08:50:12.143 INFO:teuthology.orchestra.run.smithi152.stdout:091 2024-04-17T08:50:12.143 INFO:teuthology.orchestra.run.smithi152.stdout:091.out 2024-04-17T08:50:12.143 INFO:teuthology.orchestra.run.smithi152.stdout:092 2024-04-17T08:50:12.144 INFO:teuthology.orchestra.run.smithi152.stdout:092.out 2024-04-17T08:50:12.144 INFO:teuthology.orchestra.run.smithi152.stdout:093 2024-04-17T08:50:12.144 INFO:teuthology.orchestra.run.smithi152.stdout:093.out 2024-04-17T08:50:12.144 INFO:teuthology.orchestra.run.smithi152.stdout:094 2024-04-17T08:50:12.144 INFO:teuthology.orchestra.run.smithi152.stdout:094.out 2024-04-17T08:50:12.144 INFO:teuthology.orchestra.run.smithi152.stdout:095 2024-04-17T08:50:12.144 INFO:teuthology.orchestra.run.smithi152.stdout:095.out 2024-04-17T08:50:12.144 INFO:teuthology.orchestra.run.smithi152.stdout:096 2024-04-17T08:50:12.144 INFO:teuthology.orchestra.run.smithi152.stdout:096.out 2024-04-17T08:50:12.144 INFO:teuthology.orchestra.run.smithi152.stdout:097 2024-04-17T08:50:12.144 INFO:teuthology.orchestra.run.smithi152.stdout:097.out 2024-04-17T08:50:12.144 INFO:teuthology.orchestra.run.smithi152.stdout:098 2024-04-17T08:50:12.144 INFO:teuthology.orchestra.run.smithi152.stdout:098.out 2024-04-17T08:50:12.144 INFO:teuthology.orchestra.run.smithi152.stdout:099 2024-04-17T08:50:12.144 INFO:teuthology.orchestra.run.smithi152.stdout:099.out 2024-04-17T08:50:12.145 INFO:teuthology.orchestra.run.smithi152.stdout:100 2024-04-17T08:50:12.145 INFO:teuthology.orchestra.run.smithi152.stdout:100.out 2024-04-17T08:50:12.145 INFO:teuthology.orchestra.run.smithi152.stdout:101 2024-04-17T08:50:12.145 INFO:teuthology.orchestra.run.smithi152.stdout:101.out 2024-04-17T08:50:12.145 INFO:teuthology.orchestra.run.smithi152.stdout:102 2024-04-17T08:50:12.145 INFO:teuthology.orchestra.run.smithi152.stdout:102.out 2024-04-17T08:50:12.145 INFO:teuthology.orchestra.run.smithi152.stdout:103 2024-04-17T08:50:12.145 INFO:teuthology.orchestra.run.smithi152.stdout:103.out 2024-04-17T08:50:12.145 INFO:teuthology.orchestra.run.smithi152.stdout:104 2024-04-17T08:50:12.145 INFO:teuthology.orchestra.run.smithi152.stdout:104.out 2024-04-17T08:50:12.145 INFO:teuthology.orchestra.run.smithi152.stdout:105 2024-04-17T08:50:12.145 INFO:teuthology.orchestra.run.smithi152.stdout:105.out 2024-04-17T08:50:12.145 INFO:teuthology.orchestra.run.smithi152.stdout:106 2024-04-17T08:50:12.145 INFO:teuthology.orchestra.run.smithi152.stdout:106.out 2024-04-17T08:50:12.146 INFO:teuthology.orchestra.run.smithi152.stdout:107 2024-04-17T08:50:12.146 INFO:teuthology.orchestra.run.smithi152.stdout:107.out 2024-04-17T08:50:12.146 INFO:teuthology.orchestra.run.smithi152.stdout:108 2024-04-17T08:50:12.146 INFO:teuthology.orchestra.run.smithi152.stdout:108.out 2024-04-17T08:50:12.146 INFO:teuthology.orchestra.run.smithi152.stdout:109 2024-04-17T08:50:12.146 INFO:teuthology.orchestra.run.smithi152.stdout:109.out 2024-04-17T08:50:12.146 INFO:teuthology.orchestra.run.smithi152.stdout:110 2024-04-17T08:50:12.146 INFO:teuthology.orchestra.run.smithi152.stdout:110.out 2024-04-17T08:50:12.146 INFO:teuthology.orchestra.run.smithi152.stdout:111 2024-04-17T08:50:12.146 INFO:teuthology.orchestra.run.smithi152.stdout:111.out 2024-04-17T08:50:12.146 INFO:teuthology.orchestra.run.smithi152.stdout:112 2024-04-17T08:50:12.146 INFO:teuthology.orchestra.run.smithi152.stdout:112.out 2024-04-17T08:50:12.146 INFO:teuthology.orchestra.run.smithi152.stdout:113 2024-04-17T08:50:12.146 INFO:teuthology.orchestra.run.smithi152.stdout:113.out 2024-04-17T08:50:12.147 INFO:teuthology.orchestra.run.smithi152.stdout:114 2024-04-17T08:50:12.147 INFO:teuthology.orchestra.run.smithi152.stdout:114.out 2024-04-17T08:50:12.147 INFO:teuthology.orchestra.run.smithi152.stdout:115 2024-04-17T08:50:12.147 INFO:teuthology.orchestra.run.smithi152.stdout:115.out 2024-04-17T08:50:12.147 INFO:teuthology.orchestra.run.smithi152.stdout:116 2024-04-17T08:50:12.147 INFO:teuthology.orchestra.run.smithi152.stdout:116.out 2024-04-17T08:50:12.147 INFO:teuthology.orchestra.run.smithi152.stdout:117 2024-04-17T08:50:12.147 INFO:teuthology.orchestra.run.smithi152.stdout:117.out 2024-04-17T08:50:12.147 INFO:teuthology.orchestra.run.smithi152.stdout:118 2024-04-17T08:50:12.147 INFO:teuthology.orchestra.run.smithi152.stdout:118.out 2024-04-17T08:50:12.147 INFO:teuthology.orchestra.run.smithi152.stdout:119 2024-04-17T08:50:12.147 INFO:teuthology.orchestra.run.smithi152.stdout:119.out 2024-04-17T08:50:12.147 INFO:teuthology.orchestra.run.smithi152.stdout:120 2024-04-17T08:50:12.147 INFO:teuthology.orchestra.run.smithi152.stdout:120.out 2024-04-17T08:50:12.147 INFO:teuthology.orchestra.run.smithi152.stdout:121 2024-04-17T08:50:12.147 INFO:teuthology.orchestra.run.smithi152.stdout:121.out 2024-04-17T08:50:12.148 INFO:teuthology.orchestra.run.smithi152.stdout:122 2024-04-17T08:50:12.148 INFO:teuthology.orchestra.run.smithi152.stdout:122.out 2024-04-17T08:50:12.148 INFO:teuthology.orchestra.run.smithi152.stdout:123 2024-04-17T08:50:12.148 INFO:teuthology.orchestra.run.smithi152.stdout:123.out 2024-04-17T08:50:12.148 INFO:teuthology.orchestra.run.smithi152.stdout:124 2024-04-17T08:50:12.148 INFO:teuthology.orchestra.run.smithi152.stdout:124.out 2024-04-17T08:50:12.148 INFO:teuthology.orchestra.run.smithi152.stdout:125 2024-04-17T08:50:12.148 INFO:teuthology.orchestra.run.smithi152.stdout:125.out 2024-04-17T08:50:12.148 INFO:teuthology.orchestra.run.smithi152.stdout:126 2024-04-17T08:50:12.148 INFO:teuthology.orchestra.run.smithi152.stdout:126.out 2024-04-17T08:50:12.148 INFO:teuthology.orchestra.run.smithi152.stdout:127 2024-04-17T08:50:12.148 INFO:teuthology.orchestra.run.smithi152.stdout:127.out 2024-04-17T08:50:12.148 INFO:teuthology.orchestra.run.smithi152.stdout:128 2024-04-17T08:50:12.148 INFO:teuthology.orchestra.run.smithi152.stdout:128.out 2024-04-17T08:50:12.149 INFO:teuthology.orchestra.run.smithi152.stdout:129 2024-04-17T08:50:12.149 INFO:teuthology.orchestra.run.smithi152.stdout:129.out 2024-04-17T08:50:12.149 INFO:teuthology.orchestra.run.smithi152.stdout:130 2024-04-17T08:50:12.149 INFO:teuthology.orchestra.run.smithi152.stdout:130.out 2024-04-17T08:50:12.149 INFO:teuthology.orchestra.run.smithi152.stdout:131 2024-04-17T08:50:12.149 INFO:teuthology.orchestra.run.smithi152.stdout:131.out 2024-04-17T08:50:12.149 INFO:teuthology.orchestra.run.smithi152.stdout:132 2024-04-17T08:50:12.149 INFO:teuthology.orchestra.run.smithi152.stdout:132.out 2024-04-17T08:50:12.149 INFO:teuthology.orchestra.run.smithi152.stdout:133 2024-04-17T08:50:12.149 INFO:teuthology.orchestra.run.smithi152.stdout:133.out 2024-04-17T08:50:12.149 INFO:teuthology.orchestra.run.smithi152.stdout:134 2024-04-17T08:50:12.149 INFO:teuthology.orchestra.run.smithi152.stdout:134.out 2024-04-17T08:50:12.149 INFO:teuthology.orchestra.run.smithi152.stdout:135 2024-04-17T08:50:12.149 INFO:teuthology.orchestra.run.smithi152.stdout:135.out 2024-04-17T08:50:12.149 INFO:teuthology.orchestra.run.smithi152.stdout:136 2024-04-17T08:50:12.150 INFO:teuthology.orchestra.run.smithi152.stdout:136.out 2024-04-17T08:50:12.150 INFO:teuthology.orchestra.run.smithi152.stdout:137 2024-04-17T08:50:12.150 INFO:teuthology.orchestra.run.smithi152.stdout:137.out 2024-04-17T08:50:12.150 INFO:teuthology.orchestra.run.smithi152.stdout:138 2024-04-17T08:50:12.150 INFO:teuthology.orchestra.run.smithi152.stdout:138.out 2024-04-17T08:50:12.150 INFO:teuthology.orchestra.run.smithi152.stdout:139 2024-04-17T08:50:12.150 INFO:teuthology.orchestra.run.smithi152.stdout:139.out 2024-04-17T08:50:12.150 INFO:teuthology.orchestra.run.smithi152.stdout:140 2024-04-17T08:50:12.150 INFO:teuthology.orchestra.run.smithi152.stdout:140.out 2024-04-17T08:50:12.150 INFO:teuthology.orchestra.run.smithi152.stdout:141 2024-04-17T08:50:12.150 INFO:teuthology.orchestra.run.smithi152.stdout:141.out 2024-04-17T08:50:12.150 INFO:teuthology.orchestra.run.smithi152.stdout:142 2024-04-17T08:50:12.150 INFO:teuthology.orchestra.run.smithi152.stdout:142.out 2024-04-17T08:50:12.151 INFO:teuthology.orchestra.run.smithi152.stdout:143 2024-04-17T08:50:12.151 INFO:teuthology.orchestra.run.smithi152.stdout:143.out 2024-04-17T08:50:12.151 INFO:teuthology.orchestra.run.smithi152.stdout:144 2024-04-17T08:50:12.151 INFO:teuthology.orchestra.run.smithi152.stdout:144.out 2024-04-17T08:50:12.151 INFO:teuthology.orchestra.run.smithi152.stdout:145 2024-04-17T08:50:12.151 INFO:teuthology.orchestra.run.smithi152.stdout:145.out 2024-04-17T08:50:12.151 INFO:teuthology.orchestra.run.smithi152.stdout:146 2024-04-17T08:50:12.151 INFO:teuthology.orchestra.run.smithi152.stdout:146.out 2024-04-17T08:50:12.151 INFO:teuthology.orchestra.run.smithi152.stdout:147 2024-04-17T08:50:12.151 INFO:teuthology.orchestra.run.smithi152.stdout:147.out 2024-04-17T08:50:12.151 INFO:teuthology.orchestra.run.smithi152.stdout:148 2024-04-17T08:50:12.151 INFO:teuthology.orchestra.run.smithi152.stdout:148.out 2024-04-17T08:50:12.151 INFO:teuthology.orchestra.run.smithi152.stdout:149 2024-04-17T08:50:12.151 INFO:teuthology.orchestra.run.smithi152.stdout:149.out 2024-04-17T08:50:12.151 INFO:teuthology.orchestra.run.smithi152.stdout:150 2024-04-17T08:50:12.152 INFO:teuthology.orchestra.run.smithi152.stdout:150.out 2024-04-17T08:50:12.152 INFO:teuthology.orchestra.run.smithi152.stdout:151 2024-04-17T08:50:12.152 INFO:teuthology.orchestra.run.smithi152.stdout:151.out 2024-04-17T08:50:12.152 INFO:teuthology.orchestra.run.smithi152.stdout:152 2024-04-17T08:50:12.152 INFO:teuthology.orchestra.run.smithi152.stdout:152.out 2024-04-17T08:50:12.152 INFO:teuthology.orchestra.run.smithi152.stdout:153 2024-04-17T08:50:12.152 INFO:teuthology.orchestra.run.smithi152.stdout:153.out 2024-04-17T08:50:12.152 INFO:teuthology.orchestra.run.smithi152.stdout:154 2024-04-17T08:50:12.152 INFO:teuthology.orchestra.run.smithi152.stdout:154.out 2024-04-17T08:50:12.152 INFO:teuthology.orchestra.run.smithi152.stdout:155 2024-04-17T08:50:12.152 INFO:teuthology.orchestra.run.smithi152.stdout:155.out 2024-04-17T08:50:12.152 INFO:teuthology.orchestra.run.smithi152.stdout:156 2024-04-17T08:50:12.152 INFO:teuthology.orchestra.run.smithi152.stdout:156.out 2024-04-17T08:50:12.152 INFO:teuthology.orchestra.run.smithi152.stdout:157 2024-04-17T08:50:12.153 INFO:teuthology.orchestra.run.smithi152.stdout:157.out 2024-04-17T08:50:12.153 INFO:teuthology.orchestra.run.smithi152.stdout:158 2024-04-17T08:50:12.153 INFO:teuthology.orchestra.run.smithi152.stdout:158.out 2024-04-17T08:50:12.153 INFO:teuthology.orchestra.run.smithi152.stdout:159 2024-04-17T08:50:12.153 INFO:teuthology.orchestra.run.smithi152.stdout:159.out 2024-04-17T08:50:12.153 INFO:teuthology.orchestra.run.smithi152.stdout:160 2024-04-17T08:50:12.153 INFO:teuthology.orchestra.run.smithi152.stdout:160.out 2024-04-17T08:50:12.153 INFO:teuthology.orchestra.run.smithi152.stdout:161 2024-04-17T08:50:12.153 INFO:teuthology.orchestra.run.smithi152.stdout:161.out 2024-04-17T08:50:12.153 INFO:teuthology.orchestra.run.smithi152.stdout:162 2024-04-17T08:50:12.153 INFO:teuthology.orchestra.run.smithi152.stdout:162.out 2024-04-17T08:50:12.153 INFO:teuthology.orchestra.run.smithi152.stdout:163 2024-04-17T08:50:12.153 INFO:teuthology.orchestra.run.smithi152.stdout:163.out 2024-04-17T08:50:12.153 INFO:teuthology.orchestra.run.smithi152.stdout:164 2024-04-17T08:50:12.154 INFO:teuthology.orchestra.run.smithi152.stdout:164.out 2024-04-17T08:50:12.154 INFO:teuthology.orchestra.run.smithi152.stdout:165 2024-04-17T08:50:12.154 INFO:teuthology.orchestra.run.smithi152.stdout:165.out 2024-04-17T08:50:12.154 INFO:teuthology.orchestra.run.smithi152.stdout:166 2024-04-17T08:50:12.154 INFO:teuthology.orchestra.run.smithi152.stdout:166.out 2024-04-17T08:50:12.154 INFO:teuthology.orchestra.run.smithi152.stdout:167 2024-04-17T08:50:12.154 INFO:teuthology.orchestra.run.smithi152.stdout:167.out 2024-04-17T08:50:12.154 INFO:teuthology.orchestra.run.smithi152.stdout:168 2024-04-17T08:50:12.154 INFO:teuthology.orchestra.run.smithi152.stdout:168.out 2024-04-17T08:50:12.154 INFO:teuthology.orchestra.run.smithi152.stdout:169 2024-04-17T08:50:12.154 INFO:teuthology.orchestra.run.smithi152.stdout:169.out 2024-04-17T08:50:12.154 INFO:teuthology.orchestra.run.smithi152.stdout:170 2024-04-17T08:50:12.154 INFO:teuthology.orchestra.run.smithi152.stdout:170.out 2024-04-17T08:50:12.155 INFO:teuthology.orchestra.run.smithi152.stdout:171 2024-04-17T08:50:12.155 INFO:teuthology.orchestra.run.smithi152.stdout:171.out 2024-04-17T08:50:12.155 INFO:teuthology.orchestra.run.smithi152.stdout:172 2024-04-17T08:50:12.155 INFO:teuthology.orchestra.run.smithi152.stdout:172.out 2024-04-17T08:50:12.155 INFO:teuthology.orchestra.run.smithi152.stdout:173 2024-04-17T08:50:12.155 INFO:teuthology.orchestra.run.smithi152.stdout:173.out 2024-04-17T08:50:12.155 INFO:teuthology.orchestra.run.smithi152.stdout:174 2024-04-17T08:50:12.155 INFO:teuthology.orchestra.run.smithi152.stdout:174.out 2024-04-17T08:50:12.155 INFO:teuthology.orchestra.run.smithi152.stdout:175 2024-04-17T08:50:12.155 INFO:teuthology.orchestra.run.smithi152.stdout:175.out 2024-04-17T08:50:12.155 INFO:teuthology.orchestra.run.smithi152.stdout:176 2024-04-17T08:50:12.155 INFO:teuthology.orchestra.run.smithi152.stdout:176.out 2024-04-17T08:50:12.155 INFO:teuthology.orchestra.run.smithi152.stdout:177 2024-04-17T08:50:12.155 INFO:teuthology.orchestra.run.smithi152.stdout:177.out 2024-04-17T08:50:12.155 INFO:teuthology.orchestra.run.smithi152.stdout:178 2024-04-17T08:50:12.156 INFO:teuthology.orchestra.run.smithi152.stdout:178.out 2024-04-17T08:50:12.156 INFO:teuthology.orchestra.run.smithi152.stdout:179 2024-04-17T08:50:12.156 INFO:teuthology.orchestra.run.smithi152.stdout:179.out 2024-04-17T08:50:12.156 INFO:teuthology.orchestra.run.smithi152.stdout:180 2024-04-17T08:50:12.156 INFO:teuthology.orchestra.run.smithi152.stdout:180.out 2024-04-17T08:50:12.156 INFO:teuthology.orchestra.run.smithi152.stdout:181 2024-04-17T08:50:12.156 INFO:teuthology.orchestra.run.smithi152.stdout:181.out 2024-04-17T08:50:12.156 INFO:teuthology.orchestra.run.smithi152.stdout:182 2024-04-17T08:50:12.156 INFO:teuthology.orchestra.run.smithi152.stdout:182.out 2024-04-17T08:50:12.156 INFO:teuthology.orchestra.run.smithi152.stdout:183 2024-04-17T08:50:12.156 INFO:teuthology.orchestra.run.smithi152.stdout:183.out 2024-04-17T08:50:12.156 INFO:teuthology.orchestra.run.smithi152.stdout:184 2024-04-17T08:50:12.156 INFO:teuthology.orchestra.run.smithi152.stdout:184.out 2024-04-17T08:50:12.156 INFO:teuthology.orchestra.run.smithi152.stdout:185 2024-04-17T08:50:12.156 INFO:teuthology.orchestra.run.smithi152.stdout:185.out 2024-04-17T08:50:12.157 INFO:teuthology.orchestra.run.smithi152.stdout:186 2024-04-17T08:50:12.157 INFO:teuthology.orchestra.run.smithi152.stdout:186.out 2024-04-17T08:50:12.157 INFO:teuthology.orchestra.run.smithi152.stdout:187 2024-04-17T08:50:12.157 INFO:teuthology.orchestra.run.smithi152.stdout:187.out 2024-04-17T08:50:12.157 INFO:teuthology.orchestra.run.smithi152.stdout:188 2024-04-17T08:50:12.157 INFO:teuthology.orchestra.run.smithi152.stdout:188.out 2024-04-17T08:50:12.157 INFO:teuthology.orchestra.run.smithi152.stdout:189 2024-04-17T08:50:12.157 INFO:teuthology.orchestra.run.smithi152.stdout:189.out 2024-04-17T08:50:12.157 INFO:teuthology.orchestra.run.smithi152.stdout:190 2024-04-17T08:50:12.157 INFO:teuthology.orchestra.run.smithi152.stdout:190.out 2024-04-17T08:50:12.157 INFO:teuthology.orchestra.run.smithi152.stdout:191 2024-04-17T08:50:12.157 INFO:teuthology.orchestra.run.smithi152.stdout:191.out 2024-04-17T08:50:12.157 INFO:teuthology.orchestra.run.smithi152.stdout:192 2024-04-17T08:50:12.157 INFO:teuthology.orchestra.run.smithi152.stdout:192.out 2024-04-17T08:50:12.157 INFO:teuthology.orchestra.run.smithi152.stdout:193 2024-04-17T08:50:12.158 INFO:teuthology.orchestra.run.smithi152.stdout:193.out 2024-04-17T08:50:12.158 INFO:teuthology.orchestra.run.smithi152.stdout:194 2024-04-17T08:50:12.158 INFO:teuthology.orchestra.run.smithi152.stdout:194.out 2024-04-17T08:50:12.158 INFO:teuthology.orchestra.run.smithi152.stdout:195 2024-04-17T08:50:12.158 INFO:teuthology.orchestra.run.smithi152.stdout:195.out 2024-04-17T08:50:12.158 INFO:teuthology.orchestra.run.smithi152.stdout:196 2024-04-17T08:50:12.158 INFO:teuthology.orchestra.run.smithi152.stdout:196.out 2024-04-17T08:50:12.158 INFO:teuthology.orchestra.run.smithi152.stdout:197 2024-04-17T08:50:12.158 INFO:teuthology.orchestra.run.smithi152.stdout:197.out 2024-04-17T08:50:12.158 INFO:teuthology.orchestra.run.smithi152.stdout:198 2024-04-17T08:50:12.158 INFO:teuthology.orchestra.run.smithi152.stdout:198.out 2024-04-17T08:50:12.158 INFO:teuthology.orchestra.run.smithi152.stdout:199 2024-04-17T08:50:12.158 INFO:teuthology.orchestra.run.smithi152.stdout:199.out 2024-04-17T08:50:12.158 INFO:teuthology.orchestra.run.smithi152.stdout:200 2024-04-17T08:50:12.159 INFO:teuthology.orchestra.run.smithi152.stdout:200.out 2024-04-17T08:50:12.159 INFO:teuthology.orchestra.run.smithi152.stdout:201 2024-04-17T08:50:12.159 INFO:teuthology.orchestra.run.smithi152.stdout:201.out 2024-04-17T08:50:12.159 INFO:teuthology.orchestra.run.smithi152.stdout:202 2024-04-17T08:50:12.159 INFO:teuthology.orchestra.run.smithi152.stdout:202.out 2024-04-17T08:50:12.159 INFO:teuthology.orchestra.run.smithi152.stdout:203 2024-04-17T08:50:12.159 INFO:teuthology.orchestra.run.smithi152.stdout:203.out 2024-04-17T08:50:12.159 INFO:teuthology.orchestra.run.smithi152.stdout:204 2024-04-17T08:50:12.159 INFO:teuthology.orchestra.run.smithi152.stdout:204.out 2024-04-17T08:50:12.159 INFO:teuthology.orchestra.run.smithi152.stdout:205 2024-04-17T08:50:12.159 INFO:teuthology.orchestra.run.smithi152.stdout:205.out 2024-04-17T08:50:12.159 INFO:teuthology.orchestra.run.smithi152.stdout:206 2024-04-17T08:50:12.159 INFO:teuthology.orchestra.run.smithi152.stdout:206.out 2024-04-17T08:50:12.159 INFO:teuthology.orchestra.run.smithi152.stdout:207 2024-04-17T08:50:12.160 INFO:teuthology.orchestra.run.smithi152.stdout:207.out 2024-04-17T08:50:12.160 INFO:teuthology.orchestra.run.smithi152.stdout:208 2024-04-17T08:50:12.160 INFO:teuthology.orchestra.run.smithi152.stdout:208.out 2024-04-17T08:50:12.160 INFO:teuthology.orchestra.run.smithi152.stdout:209 2024-04-17T08:50:12.160 INFO:teuthology.orchestra.run.smithi152.stdout:209.out 2024-04-17T08:50:12.160 INFO:teuthology.orchestra.run.smithi152.stdout:210 2024-04-17T08:50:12.160 INFO:teuthology.orchestra.run.smithi152.stdout:210.out 2024-04-17T08:50:12.160 INFO:teuthology.orchestra.run.smithi152.stdout:211 2024-04-17T08:50:12.160 INFO:teuthology.orchestra.run.smithi152.stdout:211.out 2024-04-17T08:50:12.160 INFO:teuthology.orchestra.run.smithi152.stdout:212 2024-04-17T08:50:12.160 INFO:teuthology.orchestra.run.smithi152.stdout:212.out 2024-04-17T08:50:12.160 INFO:teuthology.orchestra.run.smithi152.stdout:213 2024-04-17T08:50:12.161 INFO:teuthology.orchestra.run.smithi152.stdout:213.out 2024-04-17T08:50:12.161 INFO:teuthology.orchestra.run.smithi152.stdout:214 2024-04-17T08:50:12.161 INFO:teuthology.orchestra.run.smithi152.stdout:214.out 2024-04-17T08:50:12.161 INFO:teuthology.orchestra.run.smithi152.stdout:215 2024-04-17T08:50:12.161 INFO:teuthology.orchestra.run.smithi152.stdout:215.out 2024-04-17T08:50:12.161 INFO:teuthology.orchestra.run.smithi152.stdout:216 2024-04-17T08:50:12.161 INFO:teuthology.orchestra.run.smithi152.stdout:216.out 2024-04-17T08:50:12.161 INFO:teuthology.orchestra.run.smithi152.stdout:217 2024-04-17T08:50:12.161 INFO:teuthology.orchestra.run.smithi152.stdout:217.out 2024-04-17T08:50:12.161 INFO:teuthology.orchestra.run.smithi152.stdout:218 2024-04-17T08:50:12.161 INFO:teuthology.orchestra.run.smithi152.stdout:218.out 2024-04-17T08:50:12.161 INFO:teuthology.orchestra.run.smithi152.stdout:219 2024-04-17T08:50:12.161 INFO:teuthology.orchestra.run.smithi152.stdout:219.out 2024-04-17T08:50:12.161 INFO:teuthology.orchestra.run.smithi152.stdout:220 2024-04-17T08:50:12.162 INFO:teuthology.orchestra.run.smithi152.stdout:220.out 2024-04-17T08:50:12.162 INFO:teuthology.orchestra.run.smithi152.stdout:221 2024-04-17T08:50:12.162 INFO:teuthology.orchestra.run.smithi152.stdout:221.out 2024-04-17T08:50:12.162 INFO:teuthology.orchestra.run.smithi152.stdout:222 2024-04-17T08:50:12.162 INFO:teuthology.orchestra.run.smithi152.stdout:222.out 2024-04-17T08:50:12.162 INFO:teuthology.orchestra.run.smithi152.stdout:223 2024-04-17T08:50:12.162 INFO:teuthology.orchestra.run.smithi152.stdout:223.out 2024-04-17T08:50:12.162 INFO:teuthology.orchestra.run.smithi152.stdout:224 2024-04-17T08:50:12.162 INFO:teuthology.orchestra.run.smithi152.stdout:224.out 2024-04-17T08:50:12.162 INFO:teuthology.orchestra.run.smithi152.stdout:225 2024-04-17T08:50:12.162 INFO:teuthology.orchestra.run.smithi152.stdout:225.out 2024-04-17T08:50:12.162 INFO:teuthology.orchestra.run.smithi152.stdout:226 2024-04-17T08:50:12.162 INFO:teuthology.orchestra.run.smithi152.stdout:226.out 2024-04-17T08:50:12.162 INFO:teuthology.orchestra.run.smithi152.stdout:227 2024-04-17T08:50:12.163 INFO:teuthology.orchestra.run.smithi152.stdout:227.out 2024-04-17T08:50:12.163 INFO:teuthology.orchestra.run.smithi152.stdout:228 2024-04-17T08:50:12.163 INFO:teuthology.orchestra.run.smithi152.stdout:228.out 2024-04-17T08:50:12.163 INFO:teuthology.orchestra.run.smithi152.stdout:229 2024-04-17T08:50:12.163 INFO:teuthology.orchestra.run.smithi152.stdout:229.out 2024-04-17T08:50:12.163 INFO:teuthology.orchestra.run.smithi152.stdout:230 2024-04-17T08:50:12.163 INFO:teuthology.orchestra.run.smithi152.stdout:230.out 2024-04-17T08:50:12.163 INFO:teuthology.orchestra.run.smithi152.stdout:231 2024-04-17T08:50:12.163 INFO:teuthology.orchestra.run.smithi152.stdout:231.out 2024-04-17T08:50:12.163 INFO:teuthology.orchestra.run.smithi152.stdout:232 2024-04-17T08:50:12.163 INFO:teuthology.orchestra.run.smithi152.stdout:232.out 2024-04-17T08:50:12.163 INFO:teuthology.orchestra.run.smithi152.stdout:233 2024-04-17T08:50:12.163 INFO:teuthology.orchestra.run.smithi152.stdout:233.out 2024-04-17T08:50:12.163 INFO:teuthology.orchestra.run.smithi152.stdout:234 2024-04-17T08:50:12.163 INFO:teuthology.orchestra.run.smithi152.stdout:234.out 2024-04-17T08:50:12.163 INFO:teuthology.orchestra.run.smithi152.stdout:235 2024-04-17T08:50:12.164 INFO:teuthology.orchestra.run.smithi152.stdout:235.out 2024-04-17T08:50:12.164 INFO:teuthology.orchestra.run.smithi152.stdout:236 2024-04-17T08:50:12.164 INFO:teuthology.orchestra.run.smithi152.stdout:236.out 2024-04-17T08:50:12.164 INFO:teuthology.orchestra.run.smithi152.stdout:237 2024-04-17T08:50:12.164 INFO:teuthology.orchestra.run.smithi152.stdout:237.out 2024-04-17T08:50:12.164 INFO:teuthology.orchestra.run.smithi152.stdout:238 2024-04-17T08:50:12.164 INFO:teuthology.orchestra.run.smithi152.stdout:238.out 2024-04-17T08:50:12.164 INFO:teuthology.orchestra.run.smithi152.stdout:239 2024-04-17T08:50:12.164 INFO:teuthology.orchestra.run.smithi152.stdout:239.out 2024-04-17T08:50:12.164 INFO:teuthology.orchestra.run.smithi152.stdout:240 2024-04-17T08:50:12.164 INFO:teuthology.orchestra.run.smithi152.stdout:240.out 2024-04-17T08:50:12.164 INFO:teuthology.orchestra.run.smithi152.stdout:241 2024-04-17T08:50:12.164 INFO:teuthology.orchestra.run.smithi152.stdout:241.out 2024-04-17T08:50:12.164 INFO:teuthology.orchestra.run.smithi152.stdout:242 2024-04-17T08:50:12.165 INFO:teuthology.orchestra.run.smithi152.stdout:242.out 2024-04-17T08:50:12.165 INFO:teuthology.orchestra.run.smithi152.stdout:243 2024-04-17T08:50:12.165 INFO:teuthology.orchestra.run.smithi152.stdout:243.out 2024-04-17T08:50:12.165 INFO:teuthology.orchestra.run.smithi152.stdout:244 2024-04-17T08:50:12.165 INFO:teuthology.orchestra.run.smithi152.stdout:244.out 2024-04-17T08:50:12.165 INFO:teuthology.orchestra.run.smithi152.stdout:245 2024-04-17T08:50:12.165 INFO:teuthology.orchestra.run.smithi152.stdout:245.out 2024-04-17T08:50:12.165 INFO:teuthology.orchestra.run.smithi152.stdout:246 2024-04-17T08:50:12.165 INFO:teuthology.orchestra.run.smithi152.stdout:246.out 2024-04-17T08:50:12.165 INFO:teuthology.orchestra.run.smithi152.stdout:247 2024-04-17T08:50:12.165 INFO:teuthology.orchestra.run.smithi152.stdout:247.out 2024-04-17T08:50:12.165 INFO:teuthology.orchestra.run.smithi152.stdout:248 2024-04-17T08:50:12.165 INFO:teuthology.orchestra.run.smithi152.stdout:248.out 2024-04-17T08:50:12.165 INFO:teuthology.orchestra.run.smithi152.stdout:249 2024-04-17T08:50:12.165 INFO:teuthology.orchestra.run.smithi152.stdout:249.out 2024-04-17T08:50:12.165 INFO:teuthology.orchestra.run.smithi152.stdout:250 2024-04-17T08:50:12.166 INFO:teuthology.orchestra.run.smithi152.stdout:250.out 2024-04-17T08:50:12.166 INFO:teuthology.orchestra.run.smithi152.stdout:251 2024-04-17T08:50:12.166 INFO:teuthology.orchestra.run.smithi152.stdout:251.out 2024-04-17T08:50:12.166 INFO:teuthology.orchestra.run.smithi152.stdout:252 2024-04-17T08:50:12.166 INFO:teuthology.orchestra.run.smithi152.stdout:252.out 2024-04-17T08:50:12.166 INFO:teuthology.orchestra.run.smithi152.stdout:253 2024-04-17T08:50:12.166 INFO:teuthology.orchestra.run.smithi152.stdout:253.out 2024-04-17T08:50:12.166 INFO:teuthology.orchestra.run.smithi152.stdout:254 2024-04-17T08:50:12.166 INFO:teuthology.orchestra.run.smithi152.stdout:254.out 2024-04-17T08:50:12.166 INFO:teuthology.orchestra.run.smithi152.stdout:255 2024-04-17T08:50:12.166 INFO:teuthology.orchestra.run.smithi152.stdout:255.out 2024-04-17T08:50:12.166 INFO:teuthology.orchestra.run.smithi152.stdout:256 2024-04-17T08:50:12.166 INFO:teuthology.orchestra.run.smithi152.stdout:256.out 2024-04-17T08:50:12.166 INFO:teuthology.orchestra.run.smithi152.stdout:257 2024-04-17T08:50:12.166 INFO:teuthology.orchestra.run.smithi152.stdout:257.out 2024-04-17T08:50:12.167 INFO:teuthology.orchestra.run.smithi152.stdout:258 2024-04-17T08:50:12.167 INFO:teuthology.orchestra.run.smithi152.stdout:258.out 2024-04-17T08:50:12.167 INFO:teuthology.orchestra.run.smithi152.stdout:259 2024-04-17T08:50:12.167 INFO:teuthology.orchestra.run.smithi152.stdout:259.out 2024-04-17T08:50:12.167 INFO:teuthology.orchestra.run.smithi152.stdout:260 2024-04-17T08:50:12.167 INFO:teuthology.orchestra.run.smithi152.stdout:260.out 2024-04-17T08:50:12.167 INFO:teuthology.orchestra.run.smithi152.stdout:261 2024-04-17T08:50:12.167 INFO:teuthology.orchestra.run.smithi152.stdout:261.out 2024-04-17T08:50:12.167 INFO:teuthology.orchestra.run.smithi152.stdout:262 2024-04-17T08:50:12.167 INFO:teuthology.orchestra.run.smithi152.stdout:262.out 2024-04-17T08:50:12.167 INFO:teuthology.orchestra.run.smithi152.stdout:263 2024-04-17T08:50:12.167 INFO:teuthology.orchestra.run.smithi152.stdout:263.out 2024-04-17T08:50:12.167 INFO:teuthology.orchestra.run.smithi152.stdout:264 2024-04-17T08:50:12.167 INFO:teuthology.orchestra.run.smithi152.stdout:264.out 2024-04-17T08:50:12.168 INFO:teuthology.orchestra.run.smithi152.stdout:265 2024-04-17T08:50:12.168 INFO:teuthology.orchestra.run.smithi152.stdout:265.out 2024-04-17T08:50:12.168 INFO:teuthology.orchestra.run.smithi152.stdout:266 2024-04-17T08:50:12.168 INFO:teuthology.orchestra.run.smithi152.stdout:266.out 2024-04-17T08:50:12.168 INFO:teuthology.orchestra.run.smithi152.stdout:267 2024-04-17T08:50:12.168 INFO:teuthology.orchestra.run.smithi152.stdout:267.out 2024-04-17T08:50:12.168 INFO:teuthology.orchestra.run.smithi152.stdout:268 2024-04-17T08:50:12.168 INFO:teuthology.orchestra.run.smithi152.stdout:268.out 2024-04-17T08:50:12.168 INFO:teuthology.orchestra.run.smithi152.stdout:269 2024-04-17T08:50:12.168 INFO:teuthology.orchestra.run.smithi152.stdout:269.out 2024-04-17T08:50:12.168 INFO:teuthology.orchestra.run.smithi152.stdout:270 2024-04-17T08:50:12.168 INFO:teuthology.orchestra.run.smithi152.stdout:270.out 2024-04-17T08:50:12.168 INFO:teuthology.orchestra.run.smithi152.stdout:271 2024-04-17T08:50:12.168 INFO:teuthology.orchestra.run.smithi152.stdout:271.out 2024-04-17T08:50:12.168 INFO:teuthology.orchestra.run.smithi152.stdout:272 2024-04-17T08:50:12.169 INFO:teuthology.orchestra.run.smithi152.stdout:272.out 2024-04-17T08:50:12.169 INFO:teuthology.orchestra.run.smithi152.stdout:273 2024-04-17T08:50:12.169 INFO:teuthology.orchestra.run.smithi152.stdout:273.out 2024-04-17T08:50:12.169 INFO:teuthology.orchestra.run.smithi152.stdout:274 2024-04-17T08:50:12.169 INFO:teuthology.orchestra.run.smithi152.stdout:274.out 2024-04-17T08:50:12.169 INFO:teuthology.orchestra.run.smithi152.stdout:275 2024-04-17T08:50:12.169 INFO:teuthology.orchestra.run.smithi152.stdout:275.out 2024-04-17T08:50:12.169 INFO:teuthology.orchestra.run.smithi152.stdout:276 2024-04-17T08:50:12.169 INFO:teuthology.orchestra.run.smithi152.stdout:276.out 2024-04-17T08:50:12.169 INFO:teuthology.orchestra.run.smithi152.stdout:277 2024-04-17T08:50:12.169 INFO:teuthology.orchestra.run.smithi152.stdout:277.out 2024-04-17T08:50:12.169 INFO:teuthology.orchestra.run.smithi152.stdout:278 2024-04-17T08:50:12.169 INFO:teuthology.orchestra.run.smithi152.stdout:278.out 2024-04-17T08:50:12.169 INFO:teuthology.orchestra.run.smithi152.stdout:279 2024-04-17T08:50:12.169 INFO:teuthology.orchestra.run.smithi152.stdout:279.out 2024-04-17T08:50:12.170 INFO:teuthology.orchestra.run.smithi152.stdout:280 2024-04-17T08:50:12.170 INFO:teuthology.orchestra.run.smithi152.stdout:280.out 2024-04-17T08:50:12.170 INFO:teuthology.orchestra.run.smithi152.stdout:281 2024-04-17T08:50:12.170 INFO:teuthology.orchestra.run.smithi152.stdout:281.out 2024-04-17T08:50:12.170 INFO:teuthology.orchestra.run.smithi152.stdout:282 2024-04-17T08:50:12.170 INFO:teuthology.orchestra.run.smithi152.stdout:282.out 2024-04-17T08:50:12.170 INFO:teuthology.orchestra.run.smithi152.stdout:283 2024-04-17T08:50:12.170 INFO:teuthology.orchestra.run.smithi152.stdout:283.out 2024-04-17T08:50:12.170 INFO:teuthology.orchestra.run.smithi152.stdout:284 2024-04-17T08:50:12.170 INFO:teuthology.orchestra.run.smithi152.stdout:284.out 2024-04-17T08:50:12.170 INFO:teuthology.orchestra.run.smithi152.stdout:285 2024-04-17T08:50:12.170 INFO:teuthology.orchestra.run.smithi152.stdout:285.out 2024-04-17T08:50:12.170 INFO:teuthology.orchestra.run.smithi152.stdout:286 2024-04-17T08:50:12.170 INFO:teuthology.orchestra.run.smithi152.stdout:286.out 2024-04-17T08:50:12.170 INFO:teuthology.orchestra.run.smithi152.stdout:287 2024-04-17T08:50:12.171 INFO:teuthology.orchestra.run.smithi152.stdout:287.out 2024-04-17T08:50:12.171 INFO:teuthology.orchestra.run.smithi152.stdout:288 2024-04-17T08:50:12.171 INFO:teuthology.orchestra.run.smithi152.stdout:288.out 2024-04-17T08:50:12.171 INFO:teuthology.orchestra.run.smithi152.stdout:289 2024-04-17T08:50:12.171 INFO:teuthology.orchestra.run.smithi152.stdout:289.out 2024-04-17T08:50:12.171 INFO:teuthology.orchestra.run.smithi152.stdout:290 2024-04-17T08:50:12.171 INFO:teuthology.orchestra.run.smithi152.stdout:290.out 2024-04-17T08:50:12.171 INFO:teuthology.orchestra.run.smithi152.stdout:291 2024-04-17T08:50:12.171 INFO:teuthology.orchestra.run.smithi152.stdout:291.out 2024-04-17T08:50:12.171 INFO:teuthology.orchestra.run.smithi152.stdout:292 2024-04-17T08:50:12.171 INFO:teuthology.orchestra.run.smithi152.stdout:292.out 2024-04-17T08:50:12.171 INFO:teuthology.orchestra.run.smithi152.stdout:293 2024-04-17T08:50:12.171 INFO:teuthology.orchestra.run.smithi152.stdout:293.out 2024-04-17T08:50:12.171 INFO:teuthology.orchestra.run.smithi152.stdout:294 2024-04-17T08:50:12.171 INFO:teuthology.orchestra.run.smithi152.stdout:294.out 2024-04-17T08:50:12.171 INFO:teuthology.orchestra.run.smithi152.stdout:295 2024-04-17T08:50:12.172 INFO:teuthology.orchestra.run.smithi152.stdout:295.out 2024-04-17T08:50:12.172 INFO:teuthology.orchestra.run.smithi152.stdout:296 2024-04-17T08:50:12.172 INFO:teuthology.orchestra.run.smithi152.stdout:296.out 2024-04-17T08:50:12.172 INFO:teuthology.orchestra.run.smithi152.stdout:297 2024-04-17T08:50:12.172 INFO:teuthology.orchestra.run.smithi152.stdout:297.out 2024-04-17T08:50:12.172 INFO:teuthology.orchestra.run.smithi152.stdout:298 2024-04-17T08:50:12.172 INFO:teuthology.orchestra.run.smithi152.stdout:298.out 2024-04-17T08:50:12.172 INFO:teuthology.orchestra.run.smithi152.stdout:299 2024-04-17T08:50:12.172 INFO:teuthology.orchestra.run.smithi152.stdout:299.out 2024-04-17T08:50:12.172 INFO:teuthology.orchestra.run.smithi152.stdout:300 2024-04-17T08:50:12.172 INFO:teuthology.orchestra.run.smithi152.stdout:300.out 2024-04-17T08:50:12.172 INFO:teuthology.orchestra.run.smithi152.stdout:301 2024-04-17T08:50:12.172 INFO:teuthology.orchestra.run.smithi152.stdout:301.out 2024-04-17T08:50:12.172 INFO:teuthology.orchestra.run.smithi152.stdout:302 2024-04-17T08:50:12.172 INFO:teuthology.orchestra.run.smithi152.stdout:302.out 2024-04-17T08:50:12.173 INFO:teuthology.orchestra.run.smithi152.stdout:303 2024-04-17T08:50:12.173 INFO:teuthology.orchestra.run.smithi152.stdout:303.out 2024-04-17T08:50:12.173 INFO:teuthology.orchestra.run.smithi152.stdout:304 2024-04-17T08:50:12.173 INFO:teuthology.orchestra.run.smithi152.stdout:304.out 2024-04-17T08:50:12.173 INFO:teuthology.orchestra.run.smithi152.stdout:305 2024-04-17T08:50:12.173 INFO:teuthology.orchestra.run.smithi152.stdout:305.out 2024-04-17T08:50:12.173 INFO:teuthology.orchestra.run.smithi152.stdout:306 2024-04-17T08:50:12.173 INFO:teuthology.orchestra.run.smithi152.stdout:306.out 2024-04-17T08:50:12.173 INFO:teuthology.orchestra.run.smithi152.stdout:307 2024-04-17T08:50:12.173 INFO:teuthology.orchestra.run.smithi152.stdout:307.out 2024-04-17T08:50:12.173 INFO:teuthology.orchestra.run.smithi152.stdout:308 2024-04-17T08:50:12.173 INFO:teuthology.orchestra.run.smithi152.stdout:308.out 2024-04-17T08:50:12.173 INFO:teuthology.orchestra.run.smithi152.stdout:309 2024-04-17T08:50:12.173 INFO:teuthology.orchestra.run.smithi152.stdout:309.out 2024-04-17T08:50:12.173 INFO:teuthology.orchestra.run.smithi152.stdout:310 2024-04-17T08:50:12.173 INFO:teuthology.orchestra.run.smithi152.stdout:310.out 2024-04-17T08:50:12.173 INFO:teuthology.orchestra.run.smithi152.stdout:311 2024-04-17T08:50:12.174 INFO:teuthology.orchestra.run.smithi152.stdout:311.out 2024-04-17T08:50:12.174 INFO:teuthology.orchestra.run.smithi152.stdout:312 2024-04-17T08:50:12.174 INFO:teuthology.orchestra.run.smithi152.stdout:312.out 2024-04-17T08:50:12.174 INFO:teuthology.orchestra.run.smithi152.stdout:313 2024-04-17T08:50:12.174 INFO:teuthology.orchestra.run.smithi152.stdout:313.out 2024-04-17T08:50:12.174 INFO:teuthology.orchestra.run.smithi152.stdout:314 2024-04-17T08:50:12.174 INFO:teuthology.orchestra.run.smithi152.stdout:314.out 2024-04-17T08:50:12.174 INFO:teuthology.orchestra.run.smithi152.stdout:315 2024-04-17T08:50:12.174 INFO:teuthology.orchestra.run.smithi152.stdout:315.out 2024-04-17T08:50:12.174 INFO:teuthology.orchestra.run.smithi152.stdout:316 2024-04-17T08:50:12.174 INFO:teuthology.orchestra.run.smithi152.stdout:316.out 2024-04-17T08:50:12.174 INFO:teuthology.orchestra.run.smithi152.stdout:317 2024-04-17T08:50:12.174 INFO:teuthology.orchestra.run.smithi152.stdout:317.out 2024-04-17T08:50:12.174 INFO:teuthology.orchestra.run.smithi152.stdout:318 2024-04-17T08:50:12.174 INFO:teuthology.orchestra.run.smithi152.stdout:318.out 2024-04-17T08:50:12.174 INFO:teuthology.orchestra.run.smithi152.stdout:319 2024-04-17T08:50:12.175 INFO:teuthology.orchestra.run.smithi152.stdout:319.out 2024-04-17T08:50:12.175 INFO:teuthology.orchestra.run.smithi152.stdout:320 2024-04-17T08:50:12.175 INFO:teuthology.orchestra.run.smithi152.stdout:320.out 2024-04-17T08:50:12.175 INFO:teuthology.orchestra.run.smithi152.stdout:321 2024-04-17T08:50:12.175 INFO:teuthology.orchestra.run.smithi152.stdout:321.out 2024-04-17T08:50:12.175 INFO:teuthology.orchestra.run.smithi152.stdout:322 2024-04-17T08:50:12.175 INFO:teuthology.orchestra.run.smithi152.stdout:322.out 2024-04-17T08:50:12.175 INFO:teuthology.orchestra.run.smithi152.stdout:323 2024-04-17T08:50:12.175 INFO:teuthology.orchestra.run.smithi152.stdout:323.out 2024-04-17T08:50:12.175 INFO:teuthology.orchestra.run.smithi152.stdout:324 2024-04-17T08:50:12.175 INFO:teuthology.orchestra.run.smithi152.stdout:324.out 2024-04-17T08:50:12.175 INFO:teuthology.orchestra.run.smithi152.stdout:325 2024-04-17T08:50:12.175 INFO:teuthology.orchestra.run.smithi152.stdout:325.out 2024-04-17T08:50:12.175 INFO:teuthology.orchestra.run.smithi152.stdout:326 2024-04-17T08:50:12.175 INFO:teuthology.orchestra.run.smithi152.stdout:326.out 2024-04-17T08:50:12.176 INFO:teuthology.orchestra.run.smithi152.stdout:327 2024-04-17T08:50:12.176 INFO:teuthology.orchestra.run.smithi152.stdout:327.out 2024-04-17T08:50:12.176 INFO:teuthology.orchestra.run.smithi152.stdout:328 2024-04-17T08:50:12.176 INFO:teuthology.orchestra.run.smithi152.stdout:328.out 2024-04-17T08:50:12.176 INFO:teuthology.orchestra.run.smithi152.stdout:329 2024-04-17T08:50:12.176 INFO:teuthology.orchestra.run.smithi152.stdout:329.out 2024-04-17T08:50:12.176 INFO:teuthology.orchestra.run.smithi152.stdout:330 2024-04-17T08:50:12.176 INFO:teuthology.orchestra.run.smithi152.stdout:330.out 2024-04-17T08:50:12.176 INFO:teuthology.orchestra.run.smithi152.stdout:331 2024-04-17T08:50:12.176 INFO:teuthology.orchestra.run.smithi152.stdout:331.out 2024-04-17T08:50:12.176 INFO:teuthology.orchestra.run.smithi152.stdout:332 2024-04-17T08:50:12.176 INFO:teuthology.orchestra.run.smithi152.stdout:332.out 2024-04-17T08:50:12.176 INFO:teuthology.orchestra.run.smithi152.stdout:333 2024-04-17T08:50:12.176 INFO:teuthology.orchestra.run.smithi152.stdout:333.out 2024-04-17T08:50:12.176 INFO:teuthology.orchestra.run.smithi152.stdout:334 2024-04-17T08:50:12.176 INFO:teuthology.orchestra.run.smithi152.stdout:334.out 2024-04-17T08:50:12.176 INFO:teuthology.orchestra.run.smithi152.stdout:335 2024-04-17T08:50:12.177 INFO:teuthology.orchestra.run.smithi152.stdout:335.out 2024-04-17T08:50:12.177 INFO:teuthology.orchestra.run.smithi152.stdout:336 2024-04-17T08:50:12.177 INFO:teuthology.orchestra.run.smithi152.stdout:336.out 2024-04-17T08:50:12.177 INFO:teuthology.orchestra.run.smithi152.stdout:337 2024-04-17T08:50:12.177 INFO:teuthology.orchestra.run.smithi152.stdout:337.out 2024-04-17T08:50:12.177 INFO:teuthology.orchestra.run.smithi152.stdout:338 2024-04-17T08:50:12.177 INFO:teuthology.orchestra.run.smithi152.stdout:338.out 2024-04-17T08:50:12.177 INFO:teuthology.orchestra.run.smithi152.stdout:339 2024-04-17T08:50:12.177 INFO:teuthology.orchestra.run.smithi152.stdout:339.out 2024-04-17T08:50:12.177 INFO:teuthology.orchestra.run.smithi152.stdout:340 2024-04-17T08:50:12.177 INFO:teuthology.orchestra.run.smithi152.stdout:340.out 2024-04-17T08:50:12.177 INFO:teuthology.orchestra.run.smithi152.stdout:341 2024-04-17T08:50:12.177 INFO:teuthology.orchestra.run.smithi152.stdout:341.out 2024-04-17T08:50:12.177 INFO:teuthology.orchestra.run.smithi152.stdout:342 2024-04-17T08:50:12.177 INFO:teuthology.orchestra.run.smithi152.stdout:342.out 2024-04-17T08:50:12.177 INFO:teuthology.orchestra.run.smithi152.stdout:343 2024-04-17T08:50:12.178 INFO:teuthology.orchestra.run.smithi152.stdout:343.out 2024-04-17T08:50:12.178 INFO:teuthology.orchestra.run.smithi152.stdout:344 2024-04-17T08:50:12.178 INFO:teuthology.orchestra.run.smithi152.stdout:344.out 2024-04-17T08:50:12.178 INFO:teuthology.orchestra.run.smithi152.stdout:345 2024-04-17T08:50:12.178 INFO:teuthology.orchestra.run.smithi152.stdout:345.out 2024-04-17T08:50:12.178 INFO:teuthology.orchestra.run.smithi152.stdout:346 2024-04-17T08:50:12.178 INFO:teuthology.orchestra.run.smithi152.stdout:346.out 2024-04-17T08:50:12.178 INFO:teuthology.orchestra.run.smithi152.stdout:347 2024-04-17T08:50:12.178 INFO:teuthology.orchestra.run.smithi152.stdout:347.out 2024-04-17T08:50:12.178 INFO:teuthology.orchestra.run.smithi152.stdout:348 2024-04-17T08:50:12.178 INFO:teuthology.orchestra.run.smithi152.stdout:348.out 2024-04-17T08:50:12.178 INFO:teuthology.orchestra.run.smithi152.stdout:349 2024-04-17T08:50:12.178 INFO:teuthology.orchestra.run.smithi152.stdout:349.out 2024-04-17T08:50:12.178 INFO:teuthology.orchestra.run.smithi152.stdout:350 2024-04-17T08:50:12.179 INFO:teuthology.orchestra.run.smithi152.stdout:350.out 2024-04-17T08:50:12.179 INFO:teuthology.orchestra.run.smithi152.stdout:351 2024-04-17T08:50:12.179 INFO:teuthology.orchestra.run.smithi152.stdout:351.out 2024-04-17T08:50:12.179 INFO:teuthology.orchestra.run.smithi152.stdout:352 2024-04-17T08:50:12.179 INFO:teuthology.orchestra.run.smithi152.stdout:352.out 2024-04-17T08:50:12.179 INFO:teuthology.orchestra.run.smithi152.stdout:353 2024-04-17T08:50:12.179 INFO:teuthology.orchestra.run.smithi152.stdout:353.out 2024-04-17T08:50:12.179 INFO:teuthology.orchestra.run.smithi152.stdout:354 2024-04-17T08:50:12.179 INFO:teuthology.orchestra.run.smithi152.stdout:354.out 2024-04-17T08:50:12.179 INFO:teuthology.orchestra.run.smithi152.stdout:355 2024-04-17T08:50:12.179 INFO:teuthology.orchestra.run.smithi152.stdout:355.out 2024-04-17T08:50:12.179 INFO:teuthology.orchestra.run.smithi152.stdout:356 2024-04-17T08:50:12.179 INFO:teuthology.orchestra.run.smithi152.stdout:356.out 2024-04-17T08:50:12.179 INFO:teuthology.orchestra.run.smithi152.stdout:357 2024-04-17T08:50:12.179 INFO:teuthology.orchestra.run.smithi152.stdout:357.out 2024-04-17T08:50:12.180 INFO:teuthology.orchestra.run.smithi152.stdout:358 2024-04-17T08:50:12.180 INFO:teuthology.orchestra.run.smithi152.stdout:358.out 2024-04-17T08:50:12.180 INFO:teuthology.orchestra.run.smithi152.stdout:359 2024-04-17T08:50:12.180 INFO:teuthology.orchestra.run.smithi152.stdout:359.out 2024-04-17T08:50:12.180 INFO:teuthology.orchestra.run.smithi152.stdout:360 2024-04-17T08:50:12.180 INFO:teuthology.orchestra.run.smithi152.stdout:360.out 2024-04-17T08:50:12.180 INFO:teuthology.orchestra.run.smithi152.stdout:361 2024-04-17T08:50:12.180 INFO:teuthology.orchestra.run.smithi152.stdout:361.out 2024-04-17T08:50:12.180 INFO:teuthology.orchestra.run.smithi152.stdout:362 2024-04-17T08:50:12.180 INFO:teuthology.orchestra.run.smithi152.stdout:362.out 2024-04-17T08:50:12.180 INFO:teuthology.orchestra.run.smithi152.stdout:363 2024-04-17T08:50:12.180 INFO:teuthology.orchestra.run.smithi152.stdout:363.out 2024-04-17T08:50:12.180 INFO:teuthology.orchestra.run.smithi152.stdout:364 2024-04-17T08:50:12.180 INFO:teuthology.orchestra.run.smithi152.stdout:364.out 2024-04-17T08:50:12.181 INFO:teuthology.orchestra.run.smithi152.stdout:365 2024-04-17T08:50:12.181 INFO:teuthology.orchestra.run.smithi152.stdout:365.out 2024-04-17T08:50:12.181 INFO:teuthology.orchestra.run.smithi152.stdout:366 2024-04-17T08:50:12.181 INFO:teuthology.orchestra.run.smithi152.stdout:366.out 2024-04-17T08:50:12.181 INFO:teuthology.orchestra.run.smithi152.stdout:367 2024-04-17T08:50:12.181 INFO:teuthology.orchestra.run.smithi152.stdout:367.out 2024-04-17T08:50:12.181 INFO:teuthology.orchestra.run.smithi152.stdout:368 2024-04-17T08:50:12.181 INFO:teuthology.orchestra.run.smithi152.stdout:368.out 2024-04-17T08:50:12.181 INFO:teuthology.orchestra.run.smithi152.stdout:369 2024-04-17T08:50:12.181 INFO:teuthology.orchestra.run.smithi152.stdout:369.out 2024-04-17T08:50:12.181 INFO:teuthology.orchestra.run.smithi152.stdout:370 2024-04-17T08:50:12.181 INFO:teuthology.orchestra.run.smithi152.stdout:370.out 2024-04-17T08:50:12.181 INFO:teuthology.orchestra.run.smithi152.stdout:371 2024-04-17T08:50:12.181 INFO:teuthology.orchestra.run.smithi152.stdout:371.out 2024-04-17T08:50:12.182 INFO:teuthology.orchestra.run.smithi152.stdout:372 2024-04-17T08:50:12.182 INFO:teuthology.orchestra.run.smithi152.stdout:372.out 2024-04-17T08:50:12.182 INFO:teuthology.orchestra.run.smithi152.stdout:373 2024-04-17T08:50:12.182 INFO:teuthology.orchestra.run.smithi152.stdout:373.out 2024-04-17T08:50:12.182 INFO:teuthology.orchestra.run.smithi152.stdout:374 2024-04-17T08:50:12.182 INFO:teuthology.orchestra.run.smithi152.stdout:374.out 2024-04-17T08:50:12.182 INFO:teuthology.orchestra.run.smithi152.stdout:375 2024-04-17T08:50:12.182 INFO:teuthology.orchestra.run.smithi152.stdout:375.out 2024-04-17T08:50:12.182 INFO:teuthology.orchestra.run.smithi152.stdout:376 2024-04-17T08:50:12.182 INFO:teuthology.orchestra.run.smithi152.stdout:376.out 2024-04-17T08:50:12.182 INFO:teuthology.orchestra.run.smithi152.stdout:377 2024-04-17T08:50:12.182 INFO:teuthology.orchestra.run.smithi152.stdout:377.out 2024-04-17T08:50:12.182 INFO:teuthology.orchestra.run.smithi152.stdout:378 2024-04-17T08:50:12.182 INFO:teuthology.orchestra.run.smithi152.stdout:378.out 2024-04-17T08:50:12.183 INFO:teuthology.orchestra.run.smithi152.stdout:379 2024-04-17T08:50:12.183 INFO:teuthology.orchestra.run.smithi152.stdout:379.out 2024-04-17T08:50:12.183 INFO:teuthology.orchestra.run.smithi152.stdout:380 2024-04-17T08:50:12.183 INFO:teuthology.orchestra.run.smithi152.stdout:380.out 2024-04-17T08:50:12.183 INFO:teuthology.orchestra.run.smithi152.stdout:381 2024-04-17T08:50:12.183 INFO:teuthology.orchestra.run.smithi152.stdout:381.out 2024-04-17T08:50:12.183 INFO:teuthology.orchestra.run.smithi152.stdout:382 2024-04-17T08:50:12.183 INFO:teuthology.orchestra.run.smithi152.stdout:382.out 2024-04-17T08:50:12.183 INFO:teuthology.orchestra.run.smithi152.stdout:383 2024-04-17T08:50:12.183 INFO:teuthology.orchestra.run.smithi152.stdout:383.out 2024-04-17T08:50:12.183 INFO:teuthology.orchestra.run.smithi152.stdout:384 2024-04-17T08:50:12.183 INFO:teuthology.orchestra.run.smithi152.stdout:384.out 2024-04-17T08:50:12.183 INFO:teuthology.orchestra.run.smithi152.stdout:385 2024-04-17T08:50:12.183 INFO:teuthology.orchestra.run.smithi152.stdout:385.out 2024-04-17T08:50:12.183 INFO:teuthology.orchestra.run.smithi152.stdout:386 2024-04-17T08:50:12.184 INFO:teuthology.orchestra.run.smithi152.stdout:386.out 2024-04-17T08:50:12.184 INFO:teuthology.orchestra.run.smithi152.stdout:387 2024-04-17T08:50:12.184 INFO:teuthology.orchestra.run.smithi152.stdout:387.out 2024-04-17T08:50:12.184 INFO:teuthology.orchestra.run.smithi152.stdout:388 2024-04-17T08:50:12.184 INFO:teuthology.orchestra.run.smithi152.stdout:388.out 2024-04-17T08:50:12.184 INFO:teuthology.orchestra.run.smithi152.stdout:389 2024-04-17T08:50:12.184 INFO:teuthology.orchestra.run.smithi152.stdout:389.out 2024-04-17T08:50:12.184 INFO:teuthology.orchestra.run.smithi152.stdout:390 2024-04-17T08:50:12.184 INFO:teuthology.orchestra.run.smithi152.stdout:390.out 2024-04-17T08:50:12.184 INFO:teuthology.orchestra.run.smithi152.stdout:391 2024-04-17T08:50:12.184 INFO:teuthology.orchestra.run.smithi152.stdout:391.out 2024-04-17T08:50:12.184 INFO:teuthology.orchestra.run.smithi152.stdout:392 2024-04-17T08:50:12.184 INFO:teuthology.orchestra.run.smithi152.stdout:392.out 2024-04-17T08:50:12.184 INFO:teuthology.orchestra.run.smithi152.stdout:393 2024-04-17T08:50:12.184 INFO:teuthology.orchestra.run.smithi152.stdout:393.out 2024-04-17T08:50:12.185 INFO:teuthology.orchestra.run.smithi152.stdout:394 2024-04-17T08:50:12.185 INFO:teuthology.orchestra.run.smithi152.stdout:394.out 2024-04-17T08:50:12.185 INFO:teuthology.orchestra.run.smithi152.stdout:395 2024-04-17T08:50:12.185 INFO:teuthology.orchestra.run.smithi152.stdout:395.out 2024-04-17T08:50:12.185 INFO:teuthology.orchestra.run.smithi152.stdout:396 2024-04-17T08:50:12.185 INFO:teuthology.orchestra.run.smithi152.stdout:396.out 2024-04-17T08:50:12.185 INFO:teuthology.orchestra.run.smithi152.stdout:397 2024-04-17T08:50:12.185 INFO:teuthology.orchestra.run.smithi152.stdout:397.out 2024-04-17T08:50:12.185 INFO:teuthology.orchestra.run.smithi152.stdout:398 2024-04-17T08:50:12.185 INFO:teuthology.orchestra.run.smithi152.stdout:398.out 2024-04-17T08:50:12.185 INFO:teuthology.orchestra.run.smithi152.stdout:399 2024-04-17T08:50:12.185 INFO:teuthology.orchestra.run.smithi152.stdout:399.out 2024-04-17T08:50:12.185 INFO:teuthology.orchestra.run.smithi152.stdout:400 2024-04-17T08:50:12.185 INFO:teuthology.orchestra.run.smithi152.stdout:400.out 2024-04-17T08:50:12.185 INFO:teuthology.orchestra.run.smithi152.stdout:401 2024-04-17T08:50:12.185 INFO:teuthology.orchestra.run.smithi152.stdout:401.out 2024-04-17T08:50:12.186 INFO:teuthology.orchestra.run.smithi152.stdout:402 2024-04-17T08:50:12.186 INFO:teuthology.orchestra.run.smithi152.stdout:402.out 2024-04-17T08:50:12.186 INFO:teuthology.orchestra.run.smithi152.stdout:403 2024-04-17T08:50:12.186 INFO:teuthology.orchestra.run.smithi152.stdout:403.out 2024-04-17T08:50:12.186 INFO:teuthology.orchestra.run.smithi152.stdout:404 2024-04-17T08:50:12.186 INFO:teuthology.orchestra.run.smithi152.stdout:404.out 2024-04-17T08:50:12.186 INFO:teuthology.orchestra.run.smithi152.stdout:405 2024-04-17T08:50:12.186 INFO:teuthology.orchestra.run.smithi152.stdout:405.out 2024-04-17T08:50:12.186 INFO:teuthology.orchestra.run.smithi152.stdout:406 2024-04-17T08:50:12.186 INFO:teuthology.orchestra.run.smithi152.stdout:406.out 2024-04-17T08:50:12.186 INFO:teuthology.orchestra.run.smithi152.stdout:407 2024-04-17T08:50:12.186 INFO:teuthology.orchestra.run.smithi152.stdout:407.out 2024-04-17T08:50:12.186 INFO:teuthology.orchestra.run.smithi152.stdout:408 2024-04-17T08:50:12.186 INFO:teuthology.orchestra.run.smithi152.stdout:408.out 2024-04-17T08:50:12.186 INFO:teuthology.orchestra.run.smithi152.stdout:409 2024-04-17T08:50:12.186 INFO:teuthology.orchestra.run.smithi152.stdout:409.out 2024-04-17T08:50:12.187 INFO:teuthology.orchestra.run.smithi152.stdout:410 2024-04-17T08:50:12.187 INFO:teuthology.orchestra.run.smithi152.stdout:410.out 2024-04-17T08:50:12.187 INFO:teuthology.orchestra.run.smithi152.stdout:411 2024-04-17T08:50:12.187 INFO:teuthology.orchestra.run.smithi152.stdout:411.out 2024-04-17T08:50:12.187 INFO:teuthology.orchestra.run.smithi152.stdout:412 2024-04-17T08:50:12.187 INFO:teuthology.orchestra.run.smithi152.stdout:412.out 2024-04-17T08:50:12.187 INFO:teuthology.orchestra.run.smithi152.stdout:413 2024-04-17T08:50:12.187 INFO:teuthology.orchestra.run.smithi152.stdout:413.out 2024-04-17T08:50:12.187 INFO:teuthology.orchestra.run.smithi152.stdout:414 2024-04-17T08:50:12.187 INFO:teuthology.orchestra.run.smithi152.stdout:414.out 2024-04-17T08:50:12.187 INFO:teuthology.orchestra.run.smithi152.stdout:415 2024-04-17T08:50:12.187 INFO:teuthology.orchestra.run.smithi152.stdout:415.out 2024-04-17T08:50:12.187 INFO:teuthology.orchestra.run.smithi152.stdout:416 2024-04-17T08:50:12.187 INFO:teuthology.orchestra.run.smithi152.stdout:416.out 2024-04-17T08:50:12.187 INFO:teuthology.orchestra.run.smithi152.stdout:417 2024-04-17T08:50:12.187 INFO:teuthology.orchestra.run.smithi152.stdout:417.out 2024-04-17T08:50:12.188 INFO:teuthology.orchestra.run.smithi152.stdout:418 2024-04-17T08:50:12.188 INFO:teuthology.orchestra.run.smithi152.stdout:418.out 2024-04-17T08:50:12.188 INFO:teuthology.orchestra.run.smithi152.stdout:419 2024-04-17T08:50:12.188 INFO:teuthology.orchestra.run.smithi152.stdout:419.out 2024-04-17T08:50:12.188 INFO:teuthology.orchestra.run.smithi152.stdout:420 2024-04-17T08:50:12.188 INFO:teuthology.orchestra.run.smithi152.stdout:420.out 2024-04-17T08:50:12.188 INFO:teuthology.orchestra.run.smithi152.stdout:421 2024-04-17T08:50:12.188 INFO:teuthology.orchestra.run.smithi152.stdout:421.out 2024-04-17T08:50:12.188 INFO:teuthology.orchestra.run.smithi152.stdout:422 2024-04-17T08:50:12.188 INFO:teuthology.orchestra.run.smithi152.stdout:422.out 2024-04-17T08:50:12.188 INFO:teuthology.orchestra.run.smithi152.stdout:423 2024-04-17T08:50:12.188 INFO:teuthology.orchestra.run.smithi152.stdout:423.out 2024-04-17T08:50:12.188 INFO:teuthology.orchestra.run.smithi152.stdout:424 2024-04-17T08:50:12.189 INFO:teuthology.orchestra.run.smithi152.stdout:424.out 2024-04-17T08:50:12.189 INFO:teuthology.orchestra.run.smithi152.stdout:425 2024-04-17T08:50:12.189 INFO:teuthology.orchestra.run.smithi152.stdout:425.out 2024-04-17T08:50:12.189 INFO:teuthology.orchestra.run.smithi152.stdout:426 2024-04-17T08:50:12.189 INFO:teuthology.orchestra.run.smithi152.stdout:426.out 2024-04-17T08:50:12.189 INFO:teuthology.orchestra.run.smithi152.stdout:427 2024-04-17T08:50:12.189 INFO:teuthology.orchestra.run.smithi152.stdout:427.out 2024-04-17T08:50:12.189 INFO:teuthology.orchestra.run.smithi152.stdout:428 2024-04-17T08:50:12.189 INFO:teuthology.orchestra.run.smithi152.stdout:428.out 2024-04-17T08:50:12.189 INFO:teuthology.orchestra.run.smithi152.stdout:429 2024-04-17T08:50:12.189 INFO:teuthology.orchestra.run.smithi152.stdout:429.out 2024-04-17T08:50:12.189 INFO:teuthology.orchestra.run.smithi152.stdout:430 2024-04-17T08:50:12.189 INFO:teuthology.orchestra.run.smithi152.stdout:430.out 2024-04-17T08:50:12.189 INFO:teuthology.orchestra.run.smithi152.stdout:431 2024-04-17T08:50:12.189 INFO:teuthology.orchestra.run.smithi152.stdout:431.out 2024-04-17T08:50:12.190 INFO:teuthology.orchestra.run.smithi152.stdout:432 2024-04-17T08:50:12.190 INFO:teuthology.orchestra.run.smithi152.stdout:432.out 2024-04-17T08:50:12.190 INFO:teuthology.orchestra.run.smithi152.stdout:433 2024-04-17T08:50:12.190 INFO:teuthology.orchestra.run.smithi152.stdout:433.out 2024-04-17T08:50:12.190 INFO:teuthology.orchestra.run.smithi152.stdout:434 2024-04-17T08:50:12.190 INFO:teuthology.orchestra.run.smithi152.stdout:434.out 2024-04-17T08:50:12.190 INFO:teuthology.orchestra.run.smithi152.stdout:435 2024-04-17T08:50:12.190 INFO:teuthology.orchestra.run.smithi152.stdout:435.out 2024-04-17T08:50:12.190 INFO:teuthology.orchestra.run.smithi152.stdout:436 2024-04-17T08:50:12.190 INFO:teuthology.orchestra.run.smithi152.stdout:436.out 2024-04-17T08:50:12.190 INFO:teuthology.orchestra.run.smithi152.stdout:437 2024-04-17T08:50:12.190 INFO:teuthology.orchestra.run.smithi152.stdout:437.out 2024-04-17T08:50:12.190 INFO:teuthology.orchestra.run.smithi152.stdout:438 2024-04-17T08:50:12.190 INFO:teuthology.orchestra.run.smithi152.stdout:438.out 2024-04-17T08:50:12.191 INFO:teuthology.orchestra.run.smithi152.stdout:439 2024-04-17T08:50:12.191 INFO:teuthology.orchestra.run.smithi152.stdout:439.out 2024-04-17T08:50:12.191 INFO:teuthology.orchestra.run.smithi152.stdout:440 2024-04-17T08:50:12.191 INFO:teuthology.orchestra.run.smithi152.stdout:440.out 2024-04-17T08:50:12.191 INFO:teuthology.orchestra.run.smithi152.stdout:441 2024-04-17T08:50:12.191 INFO:teuthology.orchestra.run.smithi152.stdout:441.out 2024-04-17T08:50:12.191 INFO:teuthology.orchestra.run.smithi152.stdout:442 2024-04-17T08:50:12.191 INFO:teuthology.orchestra.run.smithi152.stdout:442.out 2024-04-17T08:50:12.191 INFO:teuthology.orchestra.run.smithi152.stdout:443 2024-04-17T08:50:12.191 INFO:teuthology.orchestra.run.smithi152.stdout:443.out 2024-04-17T08:50:12.191 INFO:teuthology.orchestra.run.smithi152.stdout:444 2024-04-17T08:50:12.191 INFO:teuthology.orchestra.run.smithi152.stdout:444.out 2024-04-17T08:50:12.191 INFO:teuthology.orchestra.run.smithi152.stdout:445 2024-04-17T08:50:12.191 INFO:teuthology.orchestra.run.smithi152.stdout:445.out 2024-04-17T08:50:12.192 INFO:teuthology.orchestra.run.smithi152.stdout:446 2024-04-17T08:50:12.192 INFO:teuthology.orchestra.run.smithi152.stdout:446.out 2024-04-17T08:50:12.192 INFO:teuthology.orchestra.run.smithi152.stdout:447 2024-04-17T08:50:12.192 INFO:teuthology.orchestra.run.smithi152.stdout:447.out 2024-04-17T08:50:12.192 INFO:teuthology.orchestra.run.smithi152.stdout:448 2024-04-17T08:50:12.192 INFO:teuthology.orchestra.run.smithi152.stdout:448.out 2024-04-17T08:50:12.192 INFO:teuthology.orchestra.run.smithi152.stdout:449 2024-04-17T08:50:12.192 INFO:teuthology.orchestra.run.smithi152.stdout:449.out 2024-04-17T08:50:12.192 INFO:teuthology.orchestra.run.smithi152.stdout:450 2024-04-17T08:50:12.192 INFO:teuthology.orchestra.run.smithi152.stdout:450.out 2024-04-17T08:50:12.192 INFO:teuthology.orchestra.run.smithi152.stdout:451 2024-04-17T08:50:12.192 INFO:teuthology.orchestra.run.smithi152.stdout:451.out 2024-04-17T08:50:12.192 INFO:teuthology.orchestra.run.smithi152.stdout:452 2024-04-17T08:50:12.192 INFO:teuthology.orchestra.run.smithi152.stdout:452.out 2024-04-17T08:50:12.193 INFO:teuthology.orchestra.run.smithi152.stdout:453 2024-04-17T08:50:12.193 INFO:teuthology.orchestra.run.smithi152.stdout:453.out 2024-04-17T08:50:12.193 INFO:teuthology.orchestra.run.smithi152.stdout:454 2024-04-17T08:50:12.193 INFO:teuthology.orchestra.run.smithi152.stdout:454.out 2024-04-17T08:50:12.193 INFO:teuthology.orchestra.run.smithi152.stdout:455 2024-04-17T08:50:12.193 INFO:teuthology.orchestra.run.smithi152.stdout:455.out 2024-04-17T08:50:12.193 INFO:teuthology.orchestra.run.smithi152.stdout:456 2024-04-17T08:50:12.193 INFO:teuthology.orchestra.run.smithi152.stdout:456.out 2024-04-17T08:50:12.193 INFO:teuthology.orchestra.run.smithi152.stdout:457 2024-04-17T08:50:12.193 INFO:teuthology.orchestra.run.smithi152.stdout:457.out 2024-04-17T08:50:12.193 INFO:teuthology.orchestra.run.smithi152.stdout:458 2024-04-17T08:50:12.193 INFO:teuthology.orchestra.run.smithi152.stdout:458.out 2024-04-17T08:50:12.193 INFO:teuthology.orchestra.run.smithi152.stdout:459 2024-04-17T08:50:12.193 INFO:teuthology.orchestra.run.smithi152.stdout:459.out 2024-04-17T08:50:12.193 INFO:teuthology.orchestra.run.smithi152.stdout:460 2024-04-17T08:50:12.194 INFO:teuthology.orchestra.run.smithi152.stdout:460.out 2024-04-17T08:50:12.194 INFO:teuthology.orchestra.run.smithi152.stdout:461 2024-04-17T08:50:12.194 INFO:teuthology.orchestra.run.smithi152.stdout:461.out 2024-04-17T08:50:12.194 INFO:teuthology.orchestra.run.smithi152.stdout:462 2024-04-17T08:50:12.194 INFO:teuthology.orchestra.run.smithi152.stdout:462.out 2024-04-17T08:50:12.194 INFO:teuthology.orchestra.run.smithi152.stdout:463 2024-04-17T08:50:12.194 INFO:teuthology.orchestra.run.smithi152.stdout:463.out 2024-04-17T08:50:12.194 INFO:teuthology.orchestra.run.smithi152.stdout:464 2024-04-17T08:50:12.194 INFO:teuthology.orchestra.run.smithi152.stdout:464.out 2024-04-17T08:50:12.194 INFO:teuthology.orchestra.run.smithi152.stdout:465 2024-04-17T08:50:12.194 INFO:teuthology.orchestra.run.smithi152.stdout:465.out 2024-04-17T08:50:12.194 INFO:teuthology.orchestra.run.smithi152.stdout:466 2024-04-17T08:50:12.194 INFO:teuthology.orchestra.run.smithi152.stdout:466.out 2024-04-17T08:50:12.194 INFO:teuthology.orchestra.run.smithi152.stdout:467 2024-04-17T08:50:12.195 INFO:teuthology.orchestra.run.smithi152.stdout:467.out 2024-04-17T08:50:12.195 INFO:teuthology.orchestra.run.smithi152.stdout:468 2024-04-17T08:50:12.195 INFO:teuthology.orchestra.run.smithi152.stdout:468.out 2024-04-17T08:50:12.195 INFO:teuthology.orchestra.run.smithi152.stdout:469 2024-04-17T08:50:12.195 INFO:teuthology.orchestra.run.smithi152.stdout:469.out 2024-04-17T08:50:12.195 INFO:teuthology.orchestra.run.smithi152.stdout:470 2024-04-17T08:50:12.195 INFO:teuthology.orchestra.run.smithi152.stdout:470.out 2024-04-17T08:50:12.195 INFO:teuthology.orchestra.run.smithi152.stdout:471 2024-04-17T08:50:12.195 INFO:teuthology.orchestra.run.smithi152.stdout:471.out 2024-04-17T08:50:12.195 INFO:teuthology.orchestra.run.smithi152.stdout:472 2024-04-17T08:50:12.195 INFO:teuthology.orchestra.run.smithi152.stdout:472.out 2024-04-17T08:50:12.195 INFO:teuthology.orchestra.run.smithi152.stdout:473 2024-04-17T08:50:12.195 INFO:teuthology.orchestra.run.smithi152.stdout:473.out 2024-04-17T08:50:12.195 INFO:teuthology.orchestra.run.smithi152.stdout:474 2024-04-17T08:50:12.195 INFO:teuthology.orchestra.run.smithi152.stdout:474.out 2024-04-17T08:50:12.196 INFO:teuthology.orchestra.run.smithi152.stdout:475 2024-04-17T08:50:12.196 INFO:teuthology.orchestra.run.smithi152.stdout:475.out 2024-04-17T08:50:12.196 INFO:teuthology.orchestra.run.smithi152.stdout:476 2024-04-17T08:50:12.196 INFO:teuthology.orchestra.run.smithi152.stdout:476.out 2024-04-17T08:50:12.196 INFO:teuthology.orchestra.run.smithi152.stdout:477 2024-04-17T08:50:12.196 INFO:teuthology.orchestra.run.smithi152.stdout:477.out 2024-04-17T08:50:12.196 INFO:teuthology.orchestra.run.smithi152.stdout:478 2024-04-17T08:50:12.196 INFO:teuthology.orchestra.run.smithi152.stdout:478.out 2024-04-17T08:50:12.196 INFO:teuthology.orchestra.run.smithi152.stdout:479 2024-04-17T08:50:12.196 INFO:teuthology.orchestra.run.smithi152.stdout:479.out 2024-04-17T08:50:12.196 INFO:teuthology.orchestra.run.smithi152.stdout:480 2024-04-17T08:50:12.196 INFO:teuthology.orchestra.run.smithi152.stdout:480.out 2024-04-17T08:50:12.196 INFO:teuthology.orchestra.run.smithi152.stdout:481 2024-04-17T08:50:12.196 INFO:teuthology.orchestra.run.smithi152.stdout:481.out 2024-04-17T08:50:12.196 INFO:teuthology.orchestra.run.smithi152.stdout:482 2024-04-17T08:50:12.196 INFO:teuthology.orchestra.run.smithi152.stdout:482.out 2024-04-17T08:50:12.197 INFO:teuthology.orchestra.run.smithi152.stdout:483 2024-04-17T08:50:12.197 INFO:teuthology.orchestra.run.smithi152.stdout:483.out 2024-04-17T08:50:12.197 INFO:teuthology.orchestra.run.smithi152.stdout:484 2024-04-17T08:50:12.197 INFO:teuthology.orchestra.run.smithi152.stdout:484.out 2024-04-17T08:50:12.197 INFO:teuthology.orchestra.run.smithi152.stdout:485 2024-04-17T08:50:12.197 INFO:teuthology.orchestra.run.smithi152.stdout:485.out 2024-04-17T08:50:12.197 INFO:teuthology.orchestra.run.smithi152.stdout:486 2024-04-17T08:50:12.197 INFO:teuthology.orchestra.run.smithi152.stdout:486.out 2024-04-17T08:50:12.197 INFO:teuthology.orchestra.run.smithi152.stdout:487 2024-04-17T08:50:12.197 INFO:teuthology.orchestra.run.smithi152.stdout:487.out 2024-04-17T08:50:12.197 INFO:teuthology.orchestra.run.smithi152.stdout:488 2024-04-17T08:50:12.197 INFO:teuthology.orchestra.run.smithi152.stdout:488.out 2024-04-17T08:50:12.197 INFO:teuthology.orchestra.run.smithi152.stdout:489 2024-04-17T08:50:12.197 INFO:teuthology.orchestra.run.smithi152.stdout:489.out 2024-04-17T08:50:12.197 INFO:teuthology.orchestra.run.smithi152.stdout:490 2024-04-17T08:50:12.197 INFO:teuthology.orchestra.run.smithi152.stdout:490.out 2024-04-17T08:50:12.198 INFO:teuthology.orchestra.run.smithi152.stdout:491 2024-04-17T08:50:12.198 INFO:teuthology.orchestra.run.smithi152.stdout:491.out 2024-04-17T08:50:12.198 INFO:teuthology.orchestra.run.smithi152.stdout:492 2024-04-17T08:50:12.198 INFO:teuthology.orchestra.run.smithi152.stdout:492.out 2024-04-17T08:50:12.198 INFO:teuthology.orchestra.run.smithi152.stdout:493 2024-04-17T08:50:12.198 INFO:teuthology.orchestra.run.smithi152.stdout:493.out 2024-04-17T08:50:12.198 INFO:teuthology.orchestra.run.smithi152.stdout:494 2024-04-17T08:50:12.198 INFO:teuthology.orchestra.run.smithi152.stdout:494.out 2024-04-17T08:50:12.198 INFO:teuthology.orchestra.run.smithi152.stdout:495 2024-04-17T08:50:12.198 INFO:teuthology.orchestra.run.smithi152.stdout:495.out 2024-04-17T08:50:12.198 INFO:teuthology.orchestra.run.smithi152.stdout:496 2024-04-17T08:50:12.198 INFO:teuthology.orchestra.run.smithi152.stdout:496.out 2024-04-17T08:50:12.198 INFO:teuthology.orchestra.run.smithi152.stdout:497 2024-04-17T08:50:12.198 INFO:teuthology.orchestra.run.smithi152.stdout:497.out 2024-04-17T08:50:12.199 INFO:teuthology.orchestra.run.smithi152.stdout:498 2024-04-17T08:50:12.199 INFO:teuthology.orchestra.run.smithi152.stdout:498.out 2024-04-17T08:50:12.199 INFO:teuthology.orchestra.run.smithi152.stdout:499 2024-04-17T08:50:12.199 INFO:teuthology.orchestra.run.smithi152.stdout:499.out 2024-04-17T08:50:12.199 INFO:teuthology.orchestra.run.smithi152.stdout:500 2024-04-17T08:50:12.199 INFO:teuthology.orchestra.run.smithi152.stdout:500.out 2024-04-17T08:50:12.199 INFO:teuthology.orchestra.run.smithi152.stdout:501 2024-04-17T08:50:12.199 INFO:teuthology.orchestra.run.smithi152.stdout:501.out 2024-04-17T08:50:12.199 INFO:teuthology.orchestra.run.smithi152.stdout:502 2024-04-17T08:50:12.199 INFO:teuthology.orchestra.run.smithi152.stdout:502.out 2024-04-17T08:50:12.199 INFO:teuthology.orchestra.run.smithi152.stdout:503 2024-04-17T08:50:12.199 INFO:teuthology.orchestra.run.smithi152.stdout:503.out 2024-04-17T08:50:12.199 INFO:teuthology.orchestra.run.smithi152.stdout:504 2024-04-17T08:50:12.199 INFO:teuthology.orchestra.run.smithi152.stdout:504.out 2024-04-17T08:50:12.199 INFO:teuthology.orchestra.run.smithi152.stdout:505 2024-04-17T08:50:12.199 INFO:teuthology.orchestra.run.smithi152.stdout:505.out 2024-04-17T08:50:12.200 INFO:teuthology.orchestra.run.smithi152.stdout:506 2024-04-17T08:50:12.200 INFO:teuthology.orchestra.run.smithi152.stdout:506.out 2024-04-17T08:50:12.200 INFO:teuthology.orchestra.run.smithi152.stdout:507 2024-04-17T08:50:12.200 INFO:teuthology.orchestra.run.smithi152.stdout:507.out 2024-04-17T08:50:12.200 INFO:teuthology.orchestra.run.smithi152.stdout:508 2024-04-17T08:50:12.200 INFO:teuthology.orchestra.run.smithi152.stdout:508.out 2024-04-17T08:50:12.200 INFO:teuthology.orchestra.run.smithi152.stdout:509 2024-04-17T08:50:12.200 INFO:teuthology.orchestra.run.smithi152.stdout:509.out 2024-04-17T08:50:12.200 INFO:teuthology.orchestra.run.smithi152.stdout:510 2024-04-17T08:50:12.200 INFO:teuthology.orchestra.run.smithi152.stdout:510.out 2024-04-17T08:50:12.200 INFO:teuthology.orchestra.run.smithi152.stdout:511 2024-04-17T08:50:12.200 INFO:teuthology.orchestra.run.smithi152.stdout:511.out 2024-04-17T08:50:12.200 INFO:teuthology.orchestra.run.smithi152.stdout:512 2024-04-17T08:50:12.200 INFO:teuthology.orchestra.run.smithi152.stdout:512.out 2024-04-17T08:50:12.200 INFO:teuthology.orchestra.run.smithi152.stdout:513 2024-04-17T08:50:12.201 INFO:teuthology.orchestra.run.smithi152.stdout:513.out 2024-04-17T08:50:12.201 INFO:teuthology.orchestra.run.smithi152.stdout:514 2024-04-17T08:50:12.201 INFO:teuthology.orchestra.run.smithi152.stdout:514.out 2024-04-17T08:50:12.201 INFO:teuthology.orchestra.run.smithi152.stdout:515 2024-04-17T08:50:12.201 INFO:teuthology.orchestra.run.smithi152.stdout:515.out 2024-04-17T08:50:12.201 INFO:teuthology.orchestra.run.smithi152.stdout:516 2024-04-17T08:50:12.201 INFO:teuthology.orchestra.run.smithi152.stdout:516.out 2024-04-17T08:50:12.201 INFO:teuthology.orchestra.run.smithi152.stdout:517 2024-04-17T08:50:12.201 INFO:teuthology.orchestra.run.smithi152.stdout:517.out 2024-04-17T08:50:12.201 INFO:teuthology.orchestra.run.smithi152.stdout:518 2024-04-17T08:50:12.201 INFO:teuthology.orchestra.run.smithi152.stdout:518.out 2024-04-17T08:50:12.201 INFO:teuthology.orchestra.run.smithi152.stdout:519 2024-04-17T08:50:12.201 INFO:teuthology.orchestra.run.smithi152.stdout:519.out 2024-04-17T08:50:12.201 INFO:teuthology.orchestra.run.smithi152.stdout:520 2024-04-17T08:50:12.201 INFO:teuthology.orchestra.run.smithi152.stdout:520.out 2024-04-17T08:50:12.202 INFO:teuthology.orchestra.run.smithi152.stdout:521 2024-04-17T08:50:12.202 INFO:teuthology.orchestra.run.smithi152.stdout:521.out 2024-04-17T08:50:12.202 INFO:teuthology.orchestra.run.smithi152.stdout:522 2024-04-17T08:50:12.202 INFO:teuthology.orchestra.run.smithi152.stdout:522.out 2024-04-17T08:50:12.202 INFO:teuthology.orchestra.run.smithi152.stdout:523 2024-04-17T08:50:12.202 INFO:teuthology.orchestra.run.smithi152.stdout:523.out 2024-04-17T08:50:12.202 INFO:teuthology.orchestra.run.smithi152.stdout:524 2024-04-17T08:50:12.202 INFO:teuthology.orchestra.run.smithi152.stdout:524.out 2024-04-17T08:50:12.202 INFO:teuthology.orchestra.run.smithi152.stdout:525 2024-04-17T08:50:12.202 INFO:teuthology.orchestra.run.smithi152.stdout:525.out 2024-04-17T08:50:12.202 INFO:teuthology.orchestra.run.smithi152.stdout:526 2024-04-17T08:50:12.202 INFO:teuthology.orchestra.run.smithi152.stdout:526.out 2024-04-17T08:50:12.202 INFO:teuthology.orchestra.run.smithi152.stdout:527 2024-04-17T08:50:12.202 INFO:teuthology.orchestra.run.smithi152.stdout:527.out 2024-04-17T08:50:12.202 INFO:teuthology.orchestra.run.smithi152.stdout:528 2024-04-17T08:50:12.203 INFO:teuthology.orchestra.run.smithi152.stdout:528.out 2024-04-17T08:50:12.203 INFO:teuthology.orchestra.run.smithi152.stdout:529 2024-04-17T08:50:12.203 INFO:teuthology.orchestra.run.smithi152.stdout:529.out 2024-04-17T08:50:12.203 INFO:teuthology.orchestra.run.smithi152.stdout:530 2024-04-17T08:50:12.203 INFO:teuthology.orchestra.run.smithi152.stdout:530.out 2024-04-17T08:50:12.203 INFO:teuthology.orchestra.run.smithi152.stdout:531 2024-04-17T08:50:12.203 INFO:teuthology.orchestra.run.smithi152.stdout:531.out 2024-04-17T08:50:12.203 INFO:teuthology.orchestra.run.smithi152.stdout:532 2024-04-17T08:50:12.203 INFO:teuthology.orchestra.run.smithi152.stdout:532.out 2024-04-17T08:50:12.203 INFO:teuthology.orchestra.run.smithi152.stdout:533 2024-04-17T08:50:12.203 INFO:teuthology.orchestra.run.smithi152.stdout:533.out 2024-04-17T08:50:12.203 INFO:teuthology.orchestra.run.smithi152.stdout:534 2024-04-17T08:50:12.203 INFO:teuthology.orchestra.run.smithi152.stdout:534.out 2024-04-17T08:50:12.203 INFO:teuthology.orchestra.run.smithi152.stdout:535 2024-04-17T08:50:12.203 INFO:teuthology.orchestra.run.smithi152.stdout:535.out 2024-04-17T08:50:12.204 INFO:teuthology.orchestra.run.smithi152.stdout:536 2024-04-17T08:50:12.204 INFO:teuthology.orchestra.run.smithi152.stdout:536.out 2024-04-17T08:50:12.204 INFO:teuthology.orchestra.run.smithi152.stdout:537 2024-04-17T08:50:12.204 INFO:teuthology.orchestra.run.smithi152.stdout:537.out 2024-04-17T08:50:12.204 INFO:teuthology.orchestra.run.smithi152.stdout:538 2024-04-17T08:50:12.204 INFO:teuthology.orchestra.run.smithi152.stdout:538.out 2024-04-17T08:50:12.204 INFO:teuthology.orchestra.run.smithi152.stdout:539 2024-04-17T08:50:12.204 INFO:teuthology.orchestra.run.smithi152.stdout:539.out 2024-04-17T08:50:12.204 INFO:teuthology.orchestra.run.smithi152.stdout:540 2024-04-17T08:50:12.204 INFO:teuthology.orchestra.run.smithi152.stdout:540.out 2024-04-17T08:50:12.204 INFO:teuthology.orchestra.run.smithi152.stdout:541 2024-04-17T08:50:12.204 INFO:teuthology.orchestra.run.smithi152.stdout:541.out 2024-04-17T08:50:12.204 INFO:teuthology.orchestra.run.smithi152.stdout:542 2024-04-17T08:50:12.204 INFO:teuthology.orchestra.run.smithi152.stdout:542.out 2024-04-17T08:50:12.204 INFO:teuthology.orchestra.run.smithi152.stdout:543 2024-04-17T08:50:12.205 INFO:teuthology.orchestra.run.smithi152.stdout:543.out 2024-04-17T08:50:12.205 INFO:teuthology.orchestra.run.smithi152.stdout:544 2024-04-17T08:50:12.205 INFO:teuthology.orchestra.run.smithi152.stdout:544.out 2024-04-17T08:50:12.205 INFO:teuthology.orchestra.run.smithi152.stdout:545 2024-04-17T08:50:12.205 INFO:teuthology.orchestra.run.smithi152.stdout:545.out 2024-04-17T08:50:12.205 INFO:teuthology.orchestra.run.smithi152.stdout:546 2024-04-17T08:50:12.205 INFO:teuthology.orchestra.run.smithi152.stdout:546.out 2024-04-17T08:50:12.205 INFO:teuthology.orchestra.run.smithi152.stdout:547 2024-04-17T08:50:12.205 INFO:teuthology.orchestra.run.smithi152.stdout:547.out 2024-04-17T08:50:12.205 INFO:teuthology.orchestra.run.smithi152.stdout:548 2024-04-17T08:50:12.205 INFO:teuthology.orchestra.run.smithi152.stdout:548.out 2024-04-17T08:50:12.205 INFO:teuthology.orchestra.run.smithi152.stdout:549 2024-04-17T08:50:12.205 INFO:teuthology.orchestra.run.smithi152.stdout:549.out 2024-04-17T08:50:12.205 INFO:teuthology.orchestra.run.smithi152.stdout:550 2024-04-17T08:50:12.205 INFO:teuthology.orchestra.run.smithi152.stdout:550.out 2024-04-17T08:50:12.206 INFO:teuthology.orchestra.run.smithi152.stdout:551 2024-04-17T08:50:12.206 INFO:teuthology.orchestra.run.smithi152.stdout:551.out 2024-04-17T08:50:12.206 INFO:teuthology.orchestra.run.smithi152.stdout:552 2024-04-17T08:50:12.206 INFO:teuthology.orchestra.run.smithi152.stdout:552.out 2024-04-17T08:50:12.206 INFO:teuthology.orchestra.run.smithi152.stdout:553 2024-04-17T08:50:12.206 INFO:teuthology.orchestra.run.smithi152.stdout:553.out 2024-04-17T08:50:12.206 INFO:teuthology.orchestra.run.smithi152.stdout:554 2024-04-17T08:50:12.206 INFO:teuthology.orchestra.run.smithi152.stdout:554.out 2024-04-17T08:50:12.206 INFO:teuthology.orchestra.run.smithi152.stdout:555 2024-04-17T08:50:12.206 INFO:teuthology.orchestra.run.smithi152.stdout:555.out 2024-04-17T08:50:12.206 INFO:teuthology.orchestra.run.smithi152.stdout:556 2024-04-17T08:50:12.206 INFO:teuthology.orchestra.run.smithi152.stdout:556.out 2024-04-17T08:50:12.206 INFO:teuthology.orchestra.run.smithi152.stdout:557 2024-04-17T08:50:12.206 INFO:teuthology.orchestra.run.smithi152.stdout:557.out 2024-04-17T08:50:12.206 INFO:teuthology.orchestra.run.smithi152.stdout:558 2024-04-17T08:50:12.207 INFO:teuthology.orchestra.run.smithi152.stdout:558.out 2024-04-17T08:50:12.207 INFO:teuthology.orchestra.run.smithi152.stdout:559 2024-04-17T08:50:12.207 INFO:teuthology.orchestra.run.smithi152.stdout:559.out 2024-04-17T08:50:12.207 INFO:teuthology.orchestra.run.smithi152.stdout:560 2024-04-17T08:50:12.207 INFO:teuthology.orchestra.run.smithi152.stdout:560.out 2024-04-17T08:50:12.207 INFO:teuthology.orchestra.run.smithi152.stdout:561 2024-04-17T08:50:12.207 INFO:teuthology.orchestra.run.smithi152.stdout:561.out 2024-04-17T08:50:12.207 INFO:teuthology.orchestra.run.smithi152.stdout:562 2024-04-17T08:50:12.207 INFO:teuthology.orchestra.run.smithi152.stdout:562.out 2024-04-17T08:50:12.207 INFO:teuthology.orchestra.run.smithi152.stdout:563 2024-04-17T08:50:12.207 INFO:teuthology.orchestra.run.smithi152.stdout:563.out 2024-04-17T08:50:12.207 INFO:teuthology.orchestra.run.smithi152.stdout:564 2024-04-17T08:50:12.207 INFO:teuthology.orchestra.run.smithi152.stdout:564.out 2024-04-17T08:50:12.207 INFO:teuthology.orchestra.run.smithi152.stdout:565 2024-04-17T08:50:12.208 INFO:teuthology.orchestra.run.smithi152.stdout:565.out 2024-04-17T08:50:12.208 INFO:teuthology.orchestra.run.smithi152.stdout:566 2024-04-17T08:50:12.208 INFO:teuthology.orchestra.run.smithi152.stdout:566.out 2024-04-17T08:50:12.208 INFO:teuthology.orchestra.run.smithi152.stdout:567 2024-04-17T08:50:12.208 INFO:teuthology.orchestra.run.smithi152.stdout:567.out 2024-04-17T08:50:12.208 INFO:teuthology.orchestra.run.smithi152.stdout:568 2024-04-17T08:50:12.208 INFO:teuthology.orchestra.run.smithi152.stdout:568.out 2024-04-17T08:50:12.208 INFO:teuthology.orchestra.run.smithi152.stdout:569 2024-04-17T08:50:12.208 INFO:teuthology.orchestra.run.smithi152.stdout:569.out 2024-04-17T08:50:12.208 INFO:teuthology.orchestra.run.smithi152.stdout:570 2024-04-17T08:50:12.208 INFO:teuthology.orchestra.run.smithi152.stdout:570.out 2024-04-17T08:50:12.208 INFO:teuthology.orchestra.run.smithi152.stdout:571 2024-04-17T08:50:12.208 INFO:teuthology.orchestra.run.smithi152.stdout:571.out 2024-04-17T08:50:12.208 INFO:teuthology.orchestra.run.smithi152.stdout:572 2024-04-17T08:50:12.209 INFO:teuthology.orchestra.run.smithi152.stdout:572.out 2024-04-17T08:50:12.209 INFO:teuthology.orchestra.run.smithi152.stdout:573 2024-04-17T08:50:12.209 INFO:teuthology.orchestra.run.smithi152.stdout:573.out 2024-04-17T08:50:12.209 INFO:teuthology.orchestra.run.smithi152.stdout:574 2024-04-17T08:50:12.209 INFO:teuthology.orchestra.run.smithi152.stdout:574.out 2024-04-17T08:50:12.209 INFO:teuthology.orchestra.run.smithi152.stdout:575 2024-04-17T08:50:12.209 INFO:teuthology.orchestra.run.smithi152.stdout:575.out 2024-04-17T08:50:12.209 INFO:teuthology.orchestra.run.smithi152.stdout:576 2024-04-17T08:50:12.209 INFO:teuthology.orchestra.run.smithi152.stdout:576.out 2024-04-17T08:50:12.209 INFO:teuthology.orchestra.run.smithi152.stdout:577 2024-04-17T08:50:12.209 INFO:teuthology.orchestra.run.smithi152.stdout:577.out 2024-04-17T08:50:12.209 INFO:teuthology.orchestra.run.smithi152.stdout:578 2024-04-17T08:50:12.209 INFO:teuthology.orchestra.run.smithi152.stdout:578.out 2024-04-17T08:50:12.209 INFO:teuthology.orchestra.run.smithi152.stdout:579 2024-04-17T08:50:12.210 INFO:teuthology.orchestra.run.smithi152.stdout:579.out 2024-04-17T08:50:12.210 INFO:teuthology.orchestra.run.smithi152.stdout:580 2024-04-17T08:50:12.210 INFO:teuthology.orchestra.run.smithi152.stdout:580.out 2024-04-17T08:50:12.210 INFO:teuthology.orchestra.run.smithi152.stdout:581 2024-04-17T08:50:12.210 INFO:teuthology.orchestra.run.smithi152.stdout:581.out 2024-04-17T08:50:12.210 INFO:teuthology.orchestra.run.smithi152.stdout:582 2024-04-17T08:50:12.210 INFO:teuthology.orchestra.run.smithi152.stdout:582.out 2024-04-17T08:50:12.210 INFO:teuthology.orchestra.run.smithi152.stdout:583 2024-04-17T08:50:12.210 INFO:teuthology.orchestra.run.smithi152.stdout:583.out 2024-04-17T08:50:12.210 INFO:teuthology.orchestra.run.smithi152.stdout:584 2024-04-17T08:50:12.210 INFO:teuthology.orchestra.run.smithi152.stdout:584.out 2024-04-17T08:50:12.210 INFO:teuthology.orchestra.run.smithi152.stdout:585 2024-04-17T08:50:12.210 INFO:teuthology.orchestra.run.smithi152.stdout:585.out 2024-04-17T08:50:12.211 INFO:teuthology.orchestra.run.smithi152.stdout:586 2024-04-17T08:50:12.211 INFO:teuthology.orchestra.run.smithi152.stdout:586.out 2024-04-17T08:50:12.211 INFO:teuthology.orchestra.run.smithi152.stdout:587 2024-04-17T08:50:12.211 INFO:teuthology.orchestra.run.smithi152.stdout:587.out 2024-04-17T08:50:12.211 INFO:teuthology.orchestra.run.smithi152.stdout:588 2024-04-17T08:50:12.211 INFO:teuthology.orchestra.run.smithi152.stdout:588.out 2024-04-17T08:50:12.211 INFO:teuthology.orchestra.run.smithi152.stdout:589 2024-04-17T08:50:12.211 INFO:teuthology.orchestra.run.smithi152.stdout:589.out 2024-04-17T08:50:12.211 INFO:teuthology.orchestra.run.smithi152.stdout:590 2024-04-17T08:50:12.211 INFO:teuthology.orchestra.run.smithi152.stdout:590.out 2024-04-17T08:50:12.211 INFO:teuthology.orchestra.run.smithi152.stdout:591 2024-04-17T08:50:12.211 INFO:teuthology.orchestra.run.smithi152.stdout:591.out 2024-04-17T08:50:12.211 INFO:teuthology.orchestra.run.smithi152.stdout:592 2024-04-17T08:50:12.211 INFO:teuthology.orchestra.run.smithi152.stdout:592.out 2024-04-17T08:50:12.211 INFO:teuthology.orchestra.run.smithi152.stdout:593 2024-04-17T08:50:12.212 INFO:teuthology.orchestra.run.smithi152.stdout:593.out 2024-04-17T08:50:12.212 INFO:teuthology.orchestra.run.smithi152.stdout:594 2024-04-17T08:50:12.212 INFO:teuthology.orchestra.run.smithi152.stdout:594.out 2024-04-17T08:50:12.212 INFO:teuthology.orchestra.run.smithi152.stdout:595 2024-04-17T08:50:12.212 INFO:teuthology.orchestra.run.smithi152.stdout:595.out 2024-04-17T08:50:12.212 INFO:teuthology.orchestra.run.smithi152.stdout:596 2024-04-17T08:50:12.212 INFO:teuthology.orchestra.run.smithi152.stdout:596.out 2024-04-17T08:50:12.212 INFO:teuthology.orchestra.run.smithi152.stdout:597 2024-04-17T08:50:12.212 INFO:teuthology.orchestra.run.smithi152.stdout:597.out 2024-04-17T08:50:12.212 INFO:teuthology.orchestra.run.smithi152.stdout:598 2024-04-17T08:50:12.212 INFO:teuthology.orchestra.run.smithi152.stdout:598.out 2024-04-17T08:50:12.212 INFO:teuthology.orchestra.run.smithi152.stdout:599 2024-04-17T08:50:12.212 INFO:teuthology.orchestra.run.smithi152.stdout:599.out 2024-04-17T08:50:12.212 INFO:teuthology.orchestra.run.smithi152.stdout:600 2024-04-17T08:50:12.212 INFO:teuthology.orchestra.run.smithi152.stdout:600.out 2024-04-17T08:50:12.213 INFO:teuthology.orchestra.run.smithi152.stdout:601 2024-04-17T08:50:12.213 INFO:teuthology.orchestra.run.smithi152.stdout:601.out 2024-04-17T08:50:12.213 INFO:teuthology.orchestra.run.smithi152.stdout:602 2024-04-17T08:50:12.213 INFO:teuthology.orchestra.run.smithi152.stdout:602.out 2024-04-17T08:50:12.213 INFO:teuthology.orchestra.run.smithi152.stdout:603 2024-04-17T08:50:12.213 INFO:teuthology.orchestra.run.smithi152.stdout:603.out 2024-04-17T08:50:12.213 INFO:teuthology.orchestra.run.smithi152.stdout:604 2024-04-17T08:50:12.213 INFO:teuthology.orchestra.run.smithi152.stdout:604.out 2024-04-17T08:50:12.213 INFO:teuthology.orchestra.run.smithi152.stdout:605 2024-04-17T08:50:12.213 INFO:teuthology.orchestra.run.smithi152.stdout:605.out 2024-04-17T08:50:12.213 INFO:teuthology.orchestra.run.smithi152.stdout:606 2024-04-17T08:50:12.213 INFO:teuthology.orchestra.run.smithi152.stdout:606.out 2024-04-17T08:50:12.213 INFO:teuthology.orchestra.run.smithi152.stdout:607 2024-04-17T08:50:12.213 INFO:teuthology.orchestra.run.smithi152.stdout:607.out 2024-04-17T08:50:12.213 INFO:teuthology.orchestra.run.smithi152.stdout:608 2024-04-17T08:50:12.214 INFO:teuthology.orchestra.run.smithi152.stdout:608.out 2024-04-17T08:50:12.214 INFO:teuthology.orchestra.run.smithi152.stdout:609 2024-04-17T08:50:12.214 INFO:teuthology.orchestra.run.smithi152.stdout:609.out 2024-04-17T08:50:12.214 INFO:teuthology.orchestra.run.smithi152.stdout:610 2024-04-17T08:50:12.214 INFO:teuthology.orchestra.run.smithi152.stdout:610.out 2024-04-17T08:50:12.214 INFO:teuthology.orchestra.run.smithi152.stdout:611 2024-04-17T08:50:12.214 INFO:teuthology.orchestra.run.smithi152.stdout:611.out 2024-04-17T08:50:12.214 INFO:teuthology.orchestra.run.smithi152.stdout:612 2024-04-17T08:50:12.214 INFO:teuthology.orchestra.run.smithi152.stdout:612.out 2024-04-17T08:50:12.214 INFO:teuthology.orchestra.run.smithi152.stdout:613 2024-04-17T08:50:12.214 INFO:teuthology.orchestra.run.smithi152.stdout:613.out 2024-04-17T08:50:12.214 INFO:teuthology.orchestra.run.smithi152.stdout:614 2024-04-17T08:50:12.214 INFO:teuthology.orchestra.run.smithi152.stdout:614.out 2024-04-17T08:50:12.214 INFO:teuthology.orchestra.run.smithi152.stdout:615 2024-04-17T08:50:12.215 INFO:teuthology.orchestra.run.smithi152.stdout:615.out 2024-04-17T08:50:12.215 INFO:teuthology.orchestra.run.smithi152.stdout:616 2024-04-17T08:50:12.215 INFO:teuthology.orchestra.run.smithi152.stdout:616.out 2024-04-17T08:50:12.215 INFO:teuthology.orchestra.run.smithi152.stdout:617 2024-04-17T08:50:12.215 INFO:teuthology.orchestra.run.smithi152.stdout:617.out 2024-04-17T08:50:12.215 INFO:teuthology.orchestra.run.smithi152.stdout:618 2024-04-17T08:50:12.215 INFO:teuthology.orchestra.run.smithi152.stdout:618.out 2024-04-17T08:50:12.215 INFO:teuthology.orchestra.run.smithi152.stdout:619 2024-04-17T08:50:12.215 INFO:teuthology.orchestra.run.smithi152.stdout:619.out 2024-04-17T08:50:12.215 INFO:teuthology.orchestra.run.smithi152.stdout:620 2024-04-17T08:50:12.215 INFO:teuthology.orchestra.run.smithi152.stdout:620.out 2024-04-17T08:50:12.215 INFO:teuthology.orchestra.run.smithi152.stdout:621 2024-04-17T08:50:12.215 INFO:teuthology.orchestra.run.smithi152.stdout:621.out 2024-04-17T08:50:12.215 INFO:teuthology.orchestra.run.smithi152.stdout:622 2024-04-17T08:50:12.215 INFO:teuthology.orchestra.run.smithi152.stdout:622.out 2024-04-17T08:50:12.215 INFO:teuthology.orchestra.run.smithi152.stdout:623 2024-04-17T08:50:12.215 INFO:teuthology.orchestra.run.smithi152.stdout:623.out 2024-04-17T08:50:12.216 INFO:teuthology.orchestra.run.smithi152.stdout:624 2024-04-17T08:50:12.216 INFO:teuthology.orchestra.run.smithi152.stdout:624.out 2024-04-17T08:50:12.216 INFO:teuthology.orchestra.run.smithi152.stdout:625 2024-04-17T08:50:12.216 INFO:teuthology.orchestra.run.smithi152.stdout:625.out 2024-04-17T08:50:12.216 INFO:teuthology.orchestra.run.smithi152.stdout:626 2024-04-17T08:50:12.216 INFO:teuthology.orchestra.run.smithi152.stdout:626.out 2024-04-17T08:50:12.216 INFO:teuthology.orchestra.run.smithi152.stdout:627 2024-04-17T08:50:12.216 INFO:teuthology.orchestra.run.smithi152.stdout:627.out 2024-04-17T08:50:12.216 INFO:teuthology.orchestra.run.smithi152.stdout:628 2024-04-17T08:50:12.216 INFO:teuthology.orchestra.run.smithi152.stdout:628.out 2024-04-17T08:50:12.216 INFO:teuthology.orchestra.run.smithi152.stdout:629 2024-04-17T08:50:12.216 INFO:teuthology.orchestra.run.smithi152.stdout:629.out 2024-04-17T08:50:12.216 INFO:teuthology.orchestra.run.smithi152.stdout:630 2024-04-17T08:50:12.216 INFO:teuthology.orchestra.run.smithi152.stdout:630.out 2024-04-17T08:50:12.216 INFO:teuthology.orchestra.run.smithi152.stdout:631 2024-04-17T08:50:12.216 INFO:teuthology.orchestra.run.smithi152.stdout:631.out 2024-04-17T08:50:12.216 INFO:teuthology.orchestra.run.smithi152.stdout:632 2024-04-17T08:50:12.217 INFO:teuthology.orchestra.run.smithi152.stdout:632.out 2024-04-17T08:50:12.217 INFO:teuthology.orchestra.run.smithi152.stdout:633 2024-04-17T08:50:12.217 INFO:teuthology.orchestra.run.smithi152.stdout:633.out 2024-04-17T08:50:12.217 INFO:teuthology.orchestra.run.smithi152.stdout:634 2024-04-17T08:50:12.217 INFO:teuthology.orchestra.run.smithi152.stdout:634.out 2024-04-17T08:50:12.217 INFO:teuthology.orchestra.run.smithi152.stdout:635 2024-04-17T08:50:12.217 INFO:teuthology.orchestra.run.smithi152.stdout:635.out 2024-04-17T08:50:12.217 INFO:teuthology.orchestra.run.smithi152.stdout:636 2024-04-17T08:50:12.217 INFO:teuthology.orchestra.run.smithi152.stdout:636.out 2024-04-17T08:50:12.217 INFO:teuthology.orchestra.run.smithi152.stdout:637 2024-04-17T08:50:12.217 INFO:teuthology.orchestra.run.smithi152.stdout:637.out 2024-04-17T08:50:12.217 INFO:teuthology.orchestra.run.smithi152.stdout:638 2024-04-17T08:50:12.217 INFO:teuthology.orchestra.run.smithi152.stdout:638.out 2024-04-17T08:50:12.217 INFO:teuthology.orchestra.run.smithi152.stdout:639 2024-04-17T08:50:12.217 INFO:teuthology.orchestra.run.smithi152.stdout:639.out 2024-04-17T08:50:12.218 INFO:teuthology.orchestra.run.smithi152.stdout:640 2024-04-17T08:50:12.218 INFO:teuthology.orchestra.run.smithi152.stdout:640.out 2024-04-17T08:50:12.218 INFO:teuthology.orchestra.run.smithi152.stdout:641 2024-04-17T08:50:12.218 INFO:teuthology.orchestra.run.smithi152.stdout:641.out 2024-04-17T08:50:12.218 INFO:teuthology.orchestra.run.smithi152.stdout:642 2024-04-17T08:50:12.218 INFO:teuthology.orchestra.run.smithi152.stdout:642.out 2024-04-17T08:50:12.218 INFO:teuthology.orchestra.run.smithi152.stdout:643 2024-04-17T08:50:12.218 INFO:teuthology.orchestra.run.smithi152.stdout:643.out 2024-04-17T08:50:12.218 INFO:teuthology.orchestra.run.smithi152.stdout:644 2024-04-17T08:50:12.218 INFO:teuthology.orchestra.run.smithi152.stdout:644.out 2024-04-17T08:50:12.218 INFO:teuthology.orchestra.run.smithi152.stdout:645 2024-04-17T08:50:12.218 INFO:teuthology.orchestra.run.smithi152.stdout:645.out 2024-04-17T08:50:12.218 INFO:teuthology.orchestra.run.smithi152.stdout:646 2024-04-17T08:50:12.218 INFO:teuthology.orchestra.run.smithi152.stdout:646.out 2024-04-17T08:50:12.219 INFO:teuthology.orchestra.run.smithi152.stdout:647 2024-04-17T08:50:12.219 INFO:teuthology.orchestra.run.smithi152.stdout:647.out 2024-04-17T08:50:12.219 INFO:teuthology.orchestra.run.smithi152.stdout:648 2024-04-17T08:50:12.219 INFO:teuthology.orchestra.run.smithi152.stdout:648.out 2024-04-17T08:50:12.219 INFO:teuthology.orchestra.run.smithi152.stdout:649 2024-04-17T08:50:12.219 INFO:teuthology.orchestra.run.smithi152.stdout:649.out 2024-04-17T08:50:12.219 INFO:teuthology.orchestra.run.smithi152.stdout:650 2024-04-17T08:50:12.219 INFO:teuthology.orchestra.run.smithi152.stdout:650.out 2024-04-17T08:50:12.219 INFO:teuthology.orchestra.run.smithi152.stdout:651 2024-04-17T08:50:12.219 INFO:teuthology.orchestra.run.smithi152.stdout:651.out 2024-04-17T08:50:12.219 INFO:teuthology.orchestra.run.smithi152.stdout:652 2024-04-17T08:50:12.219 INFO:teuthology.orchestra.run.smithi152.stdout:652.out 2024-04-17T08:50:12.219 INFO:teuthology.orchestra.run.smithi152.stdout:653 2024-04-17T08:50:12.219 INFO:teuthology.orchestra.run.smithi152.stdout:653.out 2024-04-17T08:50:12.220 INFO:teuthology.orchestra.run.smithi152.stdout:654 2024-04-17T08:50:12.220 INFO:teuthology.orchestra.run.smithi152.stdout:654.out 2024-04-17T08:50:12.220 INFO:teuthology.orchestra.run.smithi152.stdout:655 2024-04-17T08:50:12.220 INFO:teuthology.orchestra.run.smithi152.stdout:655.out 2024-04-17T08:50:12.220 INFO:teuthology.orchestra.run.smithi152.stdout:656 2024-04-17T08:50:12.220 INFO:teuthology.orchestra.run.smithi152.stdout:656.out 2024-04-17T08:50:12.220 INFO:teuthology.orchestra.run.smithi152.stdout:657 2024-04-17T08:50:12.220 INFO:teuthology.orchestra.run.smithi152.stdout:657.out 2024-04-17T08:50:12.220 INFO:teuthology.orchestra.run.smithi152.stdout:658 2024-04-17T08:50:12.220 INFO:teuthology.orchestra.run.smithi152.stdout:658.out 2024-04-17T08:50:12.220 INFO:teuthology.orchestra.run.smithi152.stdout:659 2024-04-17T08:50:12.220 INFO:teuthology.orchestra.run.smithi152.stdout:659.out 2024-04-17T08:50:12.220 INFO:teuthology.orchestra.run.smithi152.stdout:660 2024-04-17T08:50:12.220 INFO:teuthology.orchestra.run.smithi152.stdout:660.out 2024-04-17T08:50:12.221 INFO:teuthology.orchestra.run.smithi152.stdout:661 2024-04-17T08:50:12.221 INFO:teuthology.orchestra.run.smithi152.stdout:661.out 2024-04-17T08:50:12.221 INFO:teuthology.orchestra.run.smithi152.stdout:662 2024-04-17T08:50:12.221 INFO:teuthology.orchestra.run.smithi152.stdout:662.out 2024-04-17T08:50:12.221 INFO:teuthology.orchestra.run.smithi152.stdout:663 2024-04-17T08:50:12.221 INFO:teuthology.orchestra.run.smithi152.stdout:663.out 2024-04-17T08:50:12.221 INFO:teuthology.orchestra.run.smithi152.stdout:664 2024-04-17T08:50:12.221 INFO:teuthology.orchestra.run.smithi152.stdout:664.out 2024-04-17T08:50:12.221 INFO:teuthology.orchestra.run.smithi152.stdout:665 2024-04-17T08:50:12.221 INFO:teuthology.orchestra.run.smithi152.stdout:665.out 2024-04-17T08:50:12.221 INFO:teuthology.orchestra.run.smithi152.stdout:666 2024-04-17T08:50:12.221 INFO:teuthology.orchestra.run.smithi152.stdout:666.out 2024-04-17T08:50:12.221 INFO:teuthology.orchestra.run.smithi152.stdout:667 2024-04-17T08:50:12.221 INFO:teuthology.orchestra.run.smithi152.stdout:667.out 2024-04-17T08:50:12.221 INFO:teuthology.orchestra.run.smithi152.stdout:668 2024-04-17T08:50:12.222 INFO:teuthology.orchestra.run.smithi152.stdout:668.out 2024-04-17T08:50:12.222 INFO:teuthology.orchestra.run.smithi152.stdout:669 2024-04-17T08:50:12.222 INFO:teuthology.orchestra.run.smithi152.stdout:669.out 2024-04-17T08:50:12.222 INFO:teuthology.orchestra.run.smithi152.stdout:670 2024-04-17T08:50:12.222 INFO:teuthology.orchestra.run.smithi152.stdout:670.out 2024-04-17T08:50:12.222 INFO:teuthology.orchestra.run.smithi152.stdout:671 2024-04-17T08:50:12.222 INFO:teuthology.orchestra.run.smithi152.stdout:671.out 2024-04-17T08:50:12.222 INFO:teuthology.orchestra.run.smithi152.stdout:672 2024-04-17T08:50:12.222 INFO:teuthology.orchestra.run.smithi152.stdout:672.out 2024-04-17T08:50:12.222 INFO:teuthology.orchestra.run.smithi152.stdout:673 2024-04-17T08:50:12.222 INFO:teuthology.orchestra.run.smithi152.stdout:673.out 2024-04-17T08:50:12.222 INFO:teuthology.orchestra.run.smithi152.stdout:674 2024-04-17T08:50:12.222 INFO:teuthology.orchestra.run.smithi152.stdout:674.out 2024-04-17T08:50:12.222 INFO:teuthology.orchestra.run.smithi152.stdout:675 2024-04-17T08:50:12.223 INFO:teuthology.orchestra.run.smithi152.stdout:675.out 2024-04-17T08:50:12.223 INFO:teuthology.orchestra.run.smithi152.stdout:676 2024-04-17T08:50:12.223 INFO:teuthology.orchestra.run.smithi152.stdout:676.out 2024-04-17T08:50:12.223 INFO:teuthology.orchestra.run.smithi152.stdout:677 2024-04-17T08:50:12.223 INFO:teuthology.orchestra.run.smithi152.stdout:677.out 2024-04-17T08:50:12.223 INFO:teuthology.orchestra.run.smithi152.stdout:678 2024-04-17T08:50:12.223 INFO:teuthology.orchestra.run.smithi152.stdout:678.out 2024-04-17T08:50:12.223 INFO:teuthology.orchestra.run.smithi152.stdout:679 2024-04-17T08:50:12.223 INFO:teuthology.orchestra.run.smithi152.stdout:679.out 2024-04-17T08:50:12.223 INFO:teuthology.orchestra.run.smithi152.stdout:680 2024-04-17T08:50:12.223 INFO:teuthology.orchestra.run.smithi152.stdout:680.out 2024-04-17T08:50:12.223 INFO:teuthology.orchestra.run.smithi152.stdout:681 2024-04-17T08:50:12.223 INFO:teuthology.orchestra.run.smithi152.stdout:681.out 2024-04-17T08:50:12.223 INFO:teuthology.orchestra.run.smithi152.stdout:682 2024-04-17T08:50:12.223 INFO:teuthology.orchestra.run.smithi152.stdout:682.out 2024-04-17T08:50:12.223 INFO:teuthology.orchestra.run.smithi152.stdout:683 2024-04-17T08:50:12.224 INFO:teuthology.orchestra.run.smithi152.stdout:683.out 2024-04-17T08:50:12.224 INFO:teuthology.orchestra.run.smithi152.stdout:684 2024-04-17T08:50:12.224 INFO:teuthology.orchestra.run.smithi152.stdout:684.out 2024-04-17T08:50:12.224 INFO:teuthology.orchestra.run.smithi152.stdout:685 2024-04-17T08:50:12.224 INFO:teuthology.orchestra.run.smithi152.stdout:685.out 2024-04-17T08:50:12.224 INFO:teuthology.orchestra.run.smithi152.stdout:686 2024-04-17T08:50:12.224 INFO:teuthology.orchestra.run.smithi152.stdout:686.out 2024-04-17T08:50:12.224 INFO:teuthology.orchestra.run.smithi152.stdout:687 2024-04-17T08:50:12.224 INFO:teuthology.orchestra.run.smithi152.stdout:687.out 2024-04-17T08:50:12.224 INFO:teuthology.orchestra.run.smithi152.stdout:688 2024-04-17T08:50:12.224 INFO:teuthology.orchestra.run.smithi152.stdout:688.out 2024-04-17T08:50:12.224 INFO:teuthology.orchestra.run.smithi152.stdout:689 2024-04-17T08:50:12.224 INFO:teuthology.orchestra.run.smithi152.stdout:689.out 2024-04-17T08:50:12.224 INFO:teuthology.orchestra.run.smithi152.stdout:690 2024-04-17T08:50:12.224 INFO:teuthology.orchestra.run.smithi152.stdout:690.out 2024-04-17T08:50:12.224 INFO:teuthology.orchestra.run.smithi152.stdout:691 2024-04-17T08:50:12.225 INFO:teuthology.orchestra.run.smithi152.stdout:691.out 2024-04-17T08:50:12.225 INFO:teuthology.orchestra.run.smithi152.stdout:692 2024-04-17T08:50:12.225 INFO:teuthology.orchestra.run.smithi152.stdout:692.out 2024-04-17T08:50:12.225 INFO:teuthology.orchestra.run.smithi152.stdout:693 2024-04-17T08:50:12.225 INFO:teuthology.orchestra.run.smithi152.stdout:693.out 2024-04-17T08:50:12.225 INFO:teuthology.orchestra.run.smithi152.stdout:694 2024-04-17T08:50:12.225 INFO:teuthology.orchestra.run.smithi152.stdout:694.out 2024-04-17T08:50:12.225 INFO:teuthology.orchestra.run.smithi152.stdout:695 2024-04-17T08:50:12.225 INFO:teuthology.orchestra.run.smithi152.stdout:695.out 2024-04-17T08:50:12.225 INFO:teuthology.orchestra.run.smithi152.stdout:696 2024-04-17T08:50:12.225 INFO:teuthology.orchestra.run.smithi152.stdout:696.out 2024-04-17T08:50:12.225 INFO:teuthology.orchestra.run.smithi152.stdout:697 2024-04-17T08:50:12.225 INFO:teuthology.orchestra.run.smithi152.stdout:697.out 2024-04-17T08:50:12.225 INFO:teuthology.orchestra.run.smithi152.stdout:698 2024-04-17T08:50:12.225 INFO:teuthology.orchestra.run.smithi152.stdout:698.out 2024-04-17T08:50:12.225 INFO:teuthology.orchestra.run.smithi152.stdout:699 2024-04-17T08:50:12.226 INFO:teuthology.orchestra.run.smithi152.stdout:699.out 2024-04-17T08:50:12.226 INFO:teuthology.orchestra.run.smithi152.stdout:700 2024-04-17T08:50:12.226 INFO:teuthology.orchestra.run.smithi152.stdout:700.out 2024-04-17T08:50:12.226 INFO:teuthology.orchestra.run.smithi152.stdout:701 2024-04-17T08:50:12.226 INFO:teuthology.orchestra.run.smithi152.stdout:701.out 2024-04-17T08:50:12.226 INFO:teuthology.orchestra.run.smithi152.stdout:702 2024-04-17T08:50:12.226 INFO:teuthology.orchestra.run.smithi152.stdout:702.out 2024-04-17T08:50:12.226 INFO:teuthology.orchestra.run.smithi152.stdout:703 2024-04-17T08:50:12.226 INFO:teuthology.orchestra.run.smithi152.stdout:703.out 2024-04-17T08:50:12.226 INFO:teuthology.orchestra.run.smithi152.stdout:704 2024-04-17T08:50:12.226 INFO:teuthology.orchestra.run.smithi152.stdout:704.out 2024-04-17T08:50:12.226 INFO:teuthology.orchestra.run.smithi152.stdout:705 2024-04-17T08:50:12.226 INFO:teuthology.orchestra.run.smithi152.stdout:705.out 2024-04-17T08:50:12.226 INFO:teuthology.orchestra.run.smithi152.stdout:706 2024-04-17T08:50:12.226 INFO:teuthology.orchestra.run.smithi152.stdout:706.out 2024-04-17T08:50:12.226 INFO:teuthology.orchestra.run.smithi152.stdout:707 2024-04-17T08:50:12.227 INFO:teuthology.orchestra.run.smithi152.stdout:707.out 2024-04-17T08:50:12.227 INFO:teuthology.orchestra.run.smithi152.stdout:708 2024-04-17T08:50:12.227 INFO:teuthology.orchestra.run.smithi152.stdout:708.out 2024-04-17T08:50:12.227 INFO:teuthology.orchestra.run.smithi152.stdout:709 2024-04-17T08:50:12.227 INFO:teuthology.orchestra.run.smithi152.stdout:709.out 2024-04-17T08:50:12.227 INFO:teuthology.orchestra.run.smithi152.stdout:710 2024-04-17T08:50:12.227 INFO:teuthology.orchestra.run.smithi152.stdout:710.out 2024-04-17T08:50:12.227 INFO:teuthology.orchestra.run.smithi152.stdout:711 2024-04-17T08:50:12.227 INFO:teuthology.orchestra.run.smithi152.stdout:711.out 2024-04-17T08:50:12.227 INFO:teuthology.orchestra.run.smithi152.stdout:712 2024-04-17T08:50:12.227 INFO:teuthology.orchestra.run.smithi152.stdout:712.out 2024-04-17T08:50:12.227 INFO:teuthology.orchestra.run.smithi152.stdout:713 2024-04-17T08:50:12.227 INFO:teuthology.orchestra.run.smithi152.stdout:713.out 2024-04-17T08:50:12.227 INFO:teuthology.orchestra.run.smithi152.stdout:714 2024-04-17T08:50:12.227 INFO:teuthology.orchestra.run.smithi152.stdout:714.out 2024-04-17T08:50:12.228 INFO:teuthology.orchestra.run.smithi152.stdout:715 2024-04-17T08:50:12.228 INFO:teuthology.orchestra.run.smithi152.stdout:715.out 2024-04-17T08:50:12.228 INFO:teuthology.orchestra.run.smithi152.stdout:716 2024-04-17T08:50:12.228 INFO:teuthology.orchestra.run.smithi152.stdout:716.out 2024-04-17T08:50:12.228 INFO:teuthology.orchestra.run.smithi152.stdout:717 2024-04-17T08:50:12.228 INFO:teuthology.orchestra.run.smithi152.stdout:717.out 2024-04-17T08:50:12.228 INFO:teuthology.orchestra.run.smithi152.stdout:718 2024-04-17T08:50:12.228 INFO:teuthology.orchestra.run.smithi152.stdout:718.out 2024-04-17T08:50:12.228 INFO:teuthology.orchestra.run.smithi152.stdout:719 2024-04-17T08:50:12.228 INFO:teuthology.orchestra.run.smithi152.stdout:719.out 2024-04-17T08:50:12.228 INFO:teuthology.orchestra.run.smithi152.stdout:720 2024-04-17T08:50:12.228 INFO:teuthology.orchestra.run.smithi152.stdout:720.out 2024-04-17T08:50:12.228 INFO:teuthology.orchestra.run.smithi152.stdout:721 2024-04-17T08:50:12.228 INFO:teuthology.orchestra.run.smithi152.stdout:721.out 2024-04-17T08:50:12.229 INFO:teuthology.orchestra.run.smithi152.stdout:722 2024-04-17T08:50:12.229 INFO:teuthology.orchestra.run.smithi152.stdout:722.out 2024-04-17T08:50:12.229 INFO:teuthology.orchestra.run.smithi152.stdout:723 2024-04-17T08:50:12.229 INFO:teuthology.orchestra.run.smithi152.stdout:723.out 2024-04-17T08:50:12.229 INFO:teuthology.orchestra.run.smithi152.stdout:724 2024-04-17T08:50:12.229 INFO:teuthology.orchestra.run.smithi152.stdout:724.out 2024-04-17T08:50:12.229 INFO:teuthology.orchestra.run.smithi152.stdout:725 2024-04-17T08:50:12.229 INFO:teuthology.orchestra.run.smithi152.stdout:725.out 2024-04-17T08:50:12.229 INFO:teuthology.orchestra.run.smithi152.stdout:726 2024-04-17T08:50:12.229 INFO:teuthology.orchestra.run.smithi152.stdout:726.out 2024-04-17T08:50:12.229 INFO:teuthology.orchestra.run.smithi152.stdout:727 2024-04-17T08:50:12.229 INFO:teuthology.orchestra.run.smithi152.stdout:727.out 2024-04-17T08:50:12.229 INFO:teuthology.orchestra.run.smithi152.stdout:728 2024-04-17T08:50:12.229 INFO:teuthology.orchestra.run.smithi152.stdout:728.out 2024-04-17T08:50:12.229 INFO:teuthology.orchestra.run.smithi152.stdout:729 2024-04-17T08:50:12.230 INFO:teuthology.orchestra.run.smithi152.stdout:729.out 2024-04-17T08:50:12.230 INFO:teuthology.orchestra.run.smithi152.stdout:730 2024-04-17T08:50:12.230 INFO:teuthology.orchestra.run.smithi152.stdout:730.out 2024-04-17T08:50:12.230 INFO:teuthology.orchestra.run.smithi152.stdout:731 2024-04-17T08:50:12.230 INFO:teuthology.orchestra.run.smithi152.stdout:731.out 2024-04-17T08:50:12.230 INFO:teuthology.orchestra.run.smithi152.stdout:732 2024-04-17T08:50:12.230 INFO:teuthology.orchestra.run.smithi152.stdout:732.out 2024-04-17T08:50:12.230 INFO:teuthology.orchestra.run.smithi152.stdout:733 2024-04-17T08:50:12.230 INFO:teuthology.orchestra.run.smithi152.stdout:733.out 2024-04-17T08:50:12.230 INFO:teuthology.orchestra.run.smithi152.stdout:734 2024-04-17T08:50:12.230 INFO:teuthology.orchestra.run.smithi152.stdout:734.out 2024-04-17T08:50:12.230 INFO:teuthology.orchestra.run.smithi152.stdout:735 2024-04-17T08:50:12.230 INFO:teuthology.orchestra.run.smithi152.stdout:735.out 2024-04-17T08:50:12.231 INFO:teuthology.orchestra.run.smithi152.stdout:736 2024-04-17T08:50:12.231 INFO:teuthology.orchestra.run.smithi152.stdout:736.out 2024-04-17T08:50:12.231 INFO:teuthology.orchestra.run.smithi152.stdout:737 2024-04-17T08:50:12.231 INFO:teuthology.orchestra.run.smithi152.stdout:737.out 2024-04-17T08:50:12.231 INFO:teuthology.orchestra.run.smithi152.stdout:738 2024-04-17T08:50:12.231 INFO:teuthology.orchestra.run.smithi152.stdout:738.out 2024-04-17T08:50:12.231 INFO:teuthology.orchestra.run.smithi152.stdout:739 2024-04-17T08:50:12.231 INFO:teuthology.orchestra.run.smithi152.stdout:739.out 2024-04-17T08:50:12.231 INFO:teuthology.orchestra.run.smithi152.stdout:741 2024-04-17T08:50:12.231 INFO:teuthology.orchestra.run.smithi152.stdout:741.out 2024-04-17T08:50:12.231 INFO:teuthology.orchestra.run.smithi152.stdout:742 2024-04-17T08:50:12.231 INFO:teuthology.orchestra.run.smithi152.stdout:742.out 2024-04-17T08:50:12.231 INFO:teuthology.orchestra.run.smithi152.stdout:743 2024-04-17T08:50:12.231 INFO:teuthology.orchestra.run.smithi152.stdout:743.out 2024-04-17T08:50:12.232 INFO:teuthology.orchestra.run.smithi152.stdout:group.list 2024-04-17T08:50:12.232 INFO:teuthology.orchestra.run.smithi152.stdout:Makefile 2024-04-17T08:50:12.233 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2024-04-17T08:50:12.675 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:50:12.686 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:50:12.686 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:50:16.815 INFO:teuthology.orchestra.run.smithi152.stdout:generic/001 4s 2024-04-17T08:50:16.827 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/001 2024-04-17T08:50:16.828 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:50:16.833 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:50:16.836 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:ceph-fuse[39245]: fuse finished with error 0 and tester_r 0 2024-04-17T08:50:16.854 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:50:16.855 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2024-04-17T08:50:17.221 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:50:17.231 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:50:17.231 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:50:17.963 INFO:teuthology.orchestra.run.smithi152.stdout:generic/002 0s 2024-04-17T08:50:17.974 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/002 2024-04-17T08:50:17.975 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:50:17.981 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:50:18.003 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:50:18.003 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2024-04-17T08:50:18.390 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:50:18.401 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:50:18.401 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:50:18.677 INFO:teuthology.orchestra.run.smithi152.stdout:generic/003 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T08:50:18.685 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/003 2024-04-17T08:50:18.685 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/003 2024-04-17T08:50:18.686 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:50:18.691 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:50:18.711 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:50:18.711 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2024-04-17T08:50:19.070 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:50:19.080 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:50:19.081 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:50:19.368 INFO:teuthology.orchestra.run.smithi152.stdout:generic/004 [not run] O_TMPFILE is not supported 2024-04-17T08:50:19.376 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/004 2024-04-17T08:50:19.376 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/004 2024-04-17T08:50:19.376 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:50:19.382 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:50:19.401 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:50:19.402 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2024-04-17T08:50:19.761 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:50:19.768 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:50:19.768 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:50:20.704 INFO:teuthology.orchestra.run.smithi152.stdout:generic/005 1s 2024-04-17T08:50:20.716 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/005 2024-04-17T08:50:20.716 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:50:20.722 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:50:20.744 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:50:20.744 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2024-04-17T08:50:21.149 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:50:21.160 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:50:21.160 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:50:22.435 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T08:50:22.438 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T08:50:52.567 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T08:50:52.571 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T08:50:59.616 INFO:teuthology.orchestra.run.smithi152.stdout:generic/006 38s 2024-04-17T08:51:03.843 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/006 2024-04-17T08:51:03.843 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:51:03.849 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:51:03.893 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:51:03.894 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2024-04-17T08:51:04.285 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:51:04.293 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:51:04.293 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:51:24.545 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T08:51:24.549 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T08:51:54.602 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T08:51:54.606 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T08:52:26.418 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T08:52:26.421 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T08:52:32.144 INFO:teuthology.orchestra.run.smithi152.stdout:generic/007 88s 2024-04-17T08:52:32.155 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/007 2024-04-17T08:52:32.155 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:52:32.162 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:52:32.187 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:52:32.188 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2024-04-17T08:52:32.601 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:52:32.611 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:52:32.611 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:52:34.152 INFO:teuthology.orchestra.run.smithi152.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-04-17T08:52:34.160 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/008 2024-04-17T08:52:34.160 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/008 2024-04-17T08:52:34.160 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:52:34.166 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:52:34.186 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:52:34.186 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2024-04-17T08:52:34.541 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:52:34.551 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:52:34.551 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:52:35.936 INFO:teuthology.orchestra.run.smithi152.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-04-17T08:52:35.943 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/009 2024-04-17T08:52:35.944 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/009 2024-04-17T08:52:35.944 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:52:35.950 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:52:35.970 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:52:35.970 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2024-04-17T08:52:36.326 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:52:36.336 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:52:36.336 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:52:36.799 INFO:teuthology.orchestra.run.smithi152.stdout:generic/010 [not run] /tmp/tmp.pJW3k3pP3vxfstests-dev/src/dbtest not built 2024-04-17T08:52:36.808 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/010 2024-04-17T08:52:36.808 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/010 2024-04-17T08:52:36.808 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:52:36.814 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:52:36.834 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:52:36.834 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2024-04-17T08:52:37.189 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:52:37.199 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:52:37.199 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:52:56.474 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T08:52:56.478 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T08:53:21.376 INFO:teuthology.orchestra.run.smithi152.stdout:generic/011 44s 2024-04-17T08:53:21.388 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/011 2024-04-17T08:53:21.388 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:53:21.394 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:53:21.489 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:53:21.489 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2024-04-17T08:53:21.921 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:53:21.931 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:53:21.931 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:53:23.336 INFO:teuthology.orchestra.run.smithi152.stdout:generic/012 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-04-17T08:53:23.344 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/012 2024-04-17T08:53:23.344 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/012 2024-04-17T08:53:23.344 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:53:23.350 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:53:23.399 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:53:23.399 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2024-04-17T08:53:23.773 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:53:23.783 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:53:23.783 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:53:28.381 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T08:53:28.385 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T08:53:59.545 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T08:53:59.550 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T08:54:30.499 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T08:54:30.504 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T08:55:01.401 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T08:55:01.405 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T08:55:01.448 INFO:tasks.ceph.mds.c.smithi152.stderr:2024-04-17T08:55:01.445+0000 7f1eb3200640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 84062) UID: 0 2024-04-17T08:55:01.448 INFO:tasks.ceph.mds.a.smithi152.stderr:2024-04-17T08:55:01.445+0000 7f65f1400640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 84062) UID: 0 2024-04-17T08:55:22.857 INFO:teuthology.orchestra.run.smithi152.stdout:generic/013 119s 2024-04-17T08:55:26.966 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/013 2024-04-17T08:55:26.966 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:55:26.977 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:55:27.012 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:55:27.012 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2024-04-17T08:55:27.731 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:55:27.751 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:55:27.751 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:55:29.027 INFO:teuthology.orchestra.run.smithi152.stdout:generic/014 [not run] Sparse files are not supported or do not work as expected 2024-04-17T08:55:29.044 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/014 2024-04-17T08:55:29.044 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/014 2024-04-17T08:55:29.044 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:55:29.054 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:55:29.085 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:55:29.085 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2024-04-17T08:55:29.705 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:55:29.722 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:55:29.722 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:55:30.174 INFO:teuthology.orchestra.run.smithi152.stdout:generic/015 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T08:55:30.187 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/015 2024-04-17T08:55:30.187 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/015 2024-04-17T08:55:30.187 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:55:30.196 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:55:30.242 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:55:30.243 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2024-04-17T08:55:30.833 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:55:30.854 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:55:30.854 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:55:34.162 INFO:teuthology.orchestra.run.smithi152.stdout:generic/016 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-04-17T08:55:34.174 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/016 2024-04-17T08:55:34.174 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/016 2024-04-17T08:55:34.174 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:55:34.187 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:55:34.302 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:55:34.302 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2024-04-17T08:55:34.977 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:55:34.999 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:55:34.999 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:55:35.429 INFO:teuthology.orchestra.run.smithi152.stdout:generic/017 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T08:55:35.442 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/017 2024-04-17T08:55:35.442 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/017 2024-04-17T08:55:35.442 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:55:35.455 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:55:35.489 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:55:35.489 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2024-04-17T08:55:36.114 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:55:36.130 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:55:36.130 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:55:36.555 INFO:teuthology.orchestra.run.smithi152.stdout:generic/018 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T08:55:36.576 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/018 2024-04-17T08:55:36.576 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/018 2024-04-17T08:55:36.576 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:55:36.584 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:55:36.651 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:55:36.651 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2024-04-17T08:55:37.273 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:55:37.292 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:55:37.293 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:55:37.735 INFO:teuthology.orchestra.run.smithi152.stdout:generic/019 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T08:55:37.750 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/019 2024-04-17T08:55:37.751 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/019 2024-04-17T08:55:37.751 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:55:37.764 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:55:37.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:55:37.800 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2024-04-17T08:55:38.443 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:55:38.464 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:55:38.465 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:56:04.324 INFO:teuthology.orchestra.run.smithi152.stdout:generic/020 - output mismatch (see /tmp/tmp.pJW3k3pP3vxfstests-dev/results//generic/020.out.bad) 2024-04-17T08:56:04.333 INFO:teuthology.orchestra.run.smithi152.stdout: --- tests/generic/020.out 2024-04-17 08:48:08.525452417 +0000 2024-04-17T08:56:04.333 INFO:teuthology.orchestra.run.smithi152.stdout: +++ /tmp/tmp.pJW3k3pP3vxfstests-dev/results//generic/020.out.bad 2024-04-17 08:56:04.316643411 +0000 2024-04-17T08:56:04.333 INFO:teuthology.orchestra.run.smithi152.stdout: @@ -47,9 +47,13 @@ 2024-04-17T08:56:04.333 INFO:teuthology.orchestra.run.smithi152.stdout: user.snrub="fish2\012" 2024-04-17T08:56:04.333 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:56:04.333 INFO:teuthology.orchestra.run.smithi152.stdout: *** really long value 2024-04-17T08:56:04.333 INFO:teuthology.orchestra.run.smithi152.stdout: -0000000 00 2024-04-17T08:56:04.333 INFO:teuthology.orchestra.run.smithi152.stdout: -* 2024-04-17T08:56:04.333 INFO:teuthology.orchestra.run.smithi152.stdout: -ATTRSIZE 2024-04-17T08:56:04.334 INFO:teuthology.orchestra.run.smithi152.stdout: +attr_set: No space left on device 2024-04-17T08:56:04.334 INFO:teuthology.orchestra.run.smithi152.stdout: +Could not set "long_attr" for 2024-04-17T08:56:04.334 INFO:teuthology.orchestra.run.smithi152.stdout: +attr_get: No data available 2024-04-17T08:56:04.334 INFO:teuthology.orchestra.run.smithi152.stdout: +Could not get "long_attr" for 2024-04-17T08:56:04.334 INFO:teuthology.orchestra.run.smithi152.stdout: +0000000 2024-04-17T08:56:04.334 INFO:teuthology.orchestra.run.smithi152.stdout: +attr_remove: No data available 2024-04-17T08:56:04.334 INFO:teuthology.orchestra.run.smithi152.stdout: +Could not remove "long_attr" for 2024-04-17T08:56:04.334 INFO:teuthology.orchestra.run.smithi152.stdout: *** set/get/remove really long names (expect failure) 2024-04-17T08:56:04.334 INFO:teuthology.orchestra.run.smithi152.stdout: attr_set: Invalid argument 2024-04-17T08:56:04.334 INFO:teuthology.orchestra.run.smithi152.stdout: Could not set "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2024-04-17T08:56:04.346 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/020 2024-04-17T08:56:04.346 INFO:teuthology.orchestra.run.smithi152.stdout:Failures: generic/020 2024-04-17T08:56:04.346 INFO:teuthology.orchestra.run.smithi152.stdout:Failed 1 of 1 tests 2024-04-17T08:56:04.356 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:56:04.391 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T08:56:04.392 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-04-17T08:56:04.392 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-04-17T08:56:04.392 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2024-04-17T08:56:05.156 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:56:05.175 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:56:05.175 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:56:08.505 INFO:teuthology.orchestra.run.smithi152.stdout:generic/021 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-04-17T08:56:08.518 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/021 2024-04-17T08:56:08.519 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/021 2024-04-17T08:56:08.519 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:56:08.527 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:56:08.555 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:56:08.555 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2024-04-17T08:56:09.305 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:56:09.325 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:56:09.325 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:56:12.509 INFO:teuthology.orchestra.run.smithi152.stdout:generic/022 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-04-17T08:56:12.526 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/022 2024-04-17T08:56:12.526 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/022 2024-04-17T08:56:12.526 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:56:12.537 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:56:12.742 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:56:12.742 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2024-04-17T08:56:13.373 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:56:13.392 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:56:13.392 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:56:17.079 INFO:teuthology.orchestra.run.smithi152.stdout:generic/023 4s 2024-04-17T08:56:17.101 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/023 2024-04-17T08:56:17.101 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:56:17.110 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:56:17.210 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:56:17.210 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2024-04-17T08:56:17.919 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:56:17.942 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:56:17.942 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:56:18.430 INFO:teuthology.orchestra.run.smithi152.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2024-04-17T08:56:18.448 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/024 2024-04-17T08:56:18.448 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/024 2024-04-17T08:56:18.448 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:56:18.457 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:56:18.509 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:56:18.510 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2024-04-17T08:56:19.215 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:56:19.233 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:56:19.233 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:56:19.750 INFO:teuthology.orchestra.run.smithi152.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2024-04-17T08:56:19.766 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/025 2024-04-17T08:56:19.766 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/025 2024-04-17T08:56:19.766 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:56:19.775 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:56:19.832 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:56:19.832 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2024-04-17T08:56:20.552 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:56:20.571 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:56:20.571 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:56:21.103 INFO:teuthology.orchestra.run.smithi152.stdout:generic/026 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-04-17T08:56:21.116 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/026 2024-04-17T08:56:21.116 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/026 2024-04-17T08:56:21.116 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:56:21.124 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:56:21.160 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:56:21.160 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2024-04-17T08:56:21.788 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:56:21.805 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:56:21.805 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:56:22.241 INFO:teuthology.orchestra.run.smithi152.stdout:generic/027 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T08:56:22.261 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/027 2024-04-17T08:56:22.262 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/027 2024-04-17T08:56:22.262 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:56:22.274 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:56:22.309 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:56:22.310 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2024-04-17T08:56:22.932 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:56:22.950 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:56:22.950 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:56:28.445 INFO:teuthology.orchestra.run.smithi152.stdout:generic/028 6s 2024-04-17T08:56:28.466 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/028 2024-04-17T08:56:28.466 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:56:28.475 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:56:28.507 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:56:28.507 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2024-04-17T08:56:29.121 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:56:29.142 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:56:29.142 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:56:29.511 INFO:teuthology.orchestra.run.smithi152.stdout:generic/029 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T08:56:29.519 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/029 2024-04-17T08:56:29.519 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/029 2024-04-17T08:56:29.519 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:56:29.525 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:56:29.544 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:56:29.544 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2024-04-17T08:56:30.093 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:56:30.111 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:56:30.111 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:56:30.552 INFO:teuthology.orchestra.run.smithi152.stdout:generic/030 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T08:56:30.566 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/030 2024-04-17T08:56:30.566 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/030 2024-04-17T08:56:30.566 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:56:30.576 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:56:30.611 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:56:30.611 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2024-04-17T08:56:31.248 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:56:31.266 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:56:31.267 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:56:31.710 INFO:teuthology.orchestra.run.smithi152.stdout:generic/031 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T08:56:31.726 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/031 2024-04-17T08:56:31.726 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/031 2024-04-17T08:56:31.727 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:56:31.737 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:56:31.770 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:56:31.770 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2024-04-17T08:56:32.208 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:56:32.223 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:56:32.224 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:56:32.835 INFO:teuthology.orchestra.run.smithi152.stdout:generic/032 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T08:56:32.848 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/032 2024-04-17T08:56:32.849 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/032 2024-04-17T08:56:32.849 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:56:32.859 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:56:32.895 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:56:32.895 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2024-04-17T08:56:33.479 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:56:33.498 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:56:33.498 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:56:33.927 INFO:teuthology.orchestra.run.smithi152.stdout:generic/033 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T08:56:33.941 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/033 2024-04-17T08:56:33.941 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/033 2024-04-17T08:56:33.941 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:56:33.950 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:56:33.988 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:56:33.989 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2024-04-17T08:56:34.593 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:56:34.611 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:56:34.611 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:56:35.071 INFO:teuthology.orchestra.run.smithi152.stdout:generic/034 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T08:56:35.085 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/034 2024-04-17T08:56:35.085 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/034 2024-04-17T08:56:35.085 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:56:35.093 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:56:35.127 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:56:35.128 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2024-04-17T08:56:35.759 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:56:35.773 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:56:35.773 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:56:36.464 INFO:teuthology.orchestra.run.smithi152.stdout:generic/035 1s 2024-04-17T08:56:36.929 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/035 2024-04-17T08:56:36.929 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:56:36.939 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:56:36.975 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:56:36.975 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2024-04-17T08:56:37.854 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:56:37.874 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:56:37.874 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:56:48.586 INFO:teuthology.orchestra.run.smithi152.stdout:generic/036 11s 2024-04-17T08:56:48.604 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/036 2024-04-17T08:56:48.605 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:56:48.619 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:56:48.652 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:56:48.652 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2024-04-17T08:56:49.402 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:56:49.420 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:56:49.420 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:56:49.870 INFO:teuthology.orchestra.run.smithi152.stdout:generic/037 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T08:56:49.886 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/037 2024-04-17T08:56:49.886 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/037 2024-04-17T08:56:49.886 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:56:49.898 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:56:49.929 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:56:49.929 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2024-04-17T08:56:50.571 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:56:50.588 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:56:50.588 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:56:51.035 INFO:teuthology.orchestra.run.smithi152.stdout:generic/038 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T08:56:51.046 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/038 2024-04-17T08:56:51.047 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/038 2024-04-17T08:56:51.047 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:56:51.057 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:56:51.093 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:56:51.093 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2024-04-17T08:56:51.712 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:56:51.730 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:56:51.730 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:56:52.191 INFO:teuthology.orchestra.run.smithi152.stdout:generic/039 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T08:56:52.204 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/039 2024-04-17T08:56:52.204 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/039 2024-04-17T08:56:52.204 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:56:52.215 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:56:52.253 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:56:52.253 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2024-04-17T08:56:52.858 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:56:52.883 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:56:52.883 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:56:53.345 INFO:teuthology.orchestra.run.smithi152.stdout:generic/040 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T08:56:53.358 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/040 2024-04-17T08:56:53.358 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/040 2024-04-17T08:56:53.358 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:56:53.377 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:56:53.409 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:56:53.410 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2024-04-17T08:56:54.026 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:56:54.040 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:56:54.041 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:56:54.482 INFO:teuthology.orchestra.run.smithi152.stdout:generic/041 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T08:56:54.497 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/041 2024-04-17T08:56:54.497 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/041 2024-04-17T08:56:54.497 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:56:54.507 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:56:54.537 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:56:54.537 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2024-04-17T08:56:55.147 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:56:55.164 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:56:55.164 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:56:55.613 INFO:teuthology.orchestra.run.smithi152.stdout:generic/042 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T08:56:55.627 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/042 2024-04-17T08:56:55.627 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/042 2024-04-17T08:56:55.627 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:56:55.638 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:56:55.672 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:56:55.672 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2024-04-17T08:56:56.294 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:56:56.313 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:56:56.314 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:56:56.765 INFO:teuthology.orchestra.run.smithi152.stdout:generic/043 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T08:56:56.778 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/043 2024-04-17T08:56:56.778 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/043 2024-04-17T08:56:56.778 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:56:56.789 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:56:56.830 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:56:56.830 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2024-04-17T08:56:57.466 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:56:57.493 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:56:57.493 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:56:57.944 INFO:teuthology.orchestra.run.smithi152.stdout:generic/044 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T08:56:57.956 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/044 2024-04-17T08:56:57.956 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/044 2024-04-17T08:56:57.957 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:56:57.965 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:56:57.999 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:56:57.999 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2024-04-17T08:56:58.583 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:56:58.596 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:56:58.597 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:56:59.039 INFO:teuthology.orchestra.run.smithi152.stdout:generic/045 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T08:56:59.056 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/045 2024-04-17T08:56:59.056 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/045 2024-04-17T08:56:59.056 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:56:59.066 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:56:59.099 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:56:59.099 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2024-04-17T08:56:59.694 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:56:59.709 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:56:59.711 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:57:00.153 INFO:teuthology.orchestra.run.smithi152.stdout:generic/046 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T08:57:00.167 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/046 2024-04-17T08:57:00.167 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/046 2024-04-17T08:57:00.167 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:57:00.177 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:57:00.212 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:57:00.212 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2024-04-17T08:57:00.837 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:57:00.857 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:57:00.857 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:57:01.279 INFO:teuthology.orchestra.run.smithi152.stdout:generic/047 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T08:57:01.291 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/047 2024-04-17T08:57:01.291 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/047 2024-04-17T08:57:01.291 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:57:01.302 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:57:01.342 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:57:01.342 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2024-04-17T08:57:01.951 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:57:01.967 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:57:01.967 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:57:02.395 INFO:teuthology.orchestra.run.smithi152.stdout:generic/048 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T08:57:02.406 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/048 2024-04-17T08:57:02.407 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/048 2024-04-17T08:57:02.407 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:57:02.415 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:57:02.449 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:57:02.449 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2024-04-17T08:57:03.053 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:57:03.070 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:57:03.070 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:57:03.511 INFO:teuthology.orchestra.run.smithi152.stdout:generic/049 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T08:57:03.530 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/049 2024-04-17T08:57:03.531 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/049 2024-04-17T08:57:03.531 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:57:03.541 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:57:03.582 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:57:03.582 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2024-04-17T08:57:04.182 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:57:04.197 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:57:04.198 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:57:04.669 INFO:teuthology.orchestra.run.smithi152.stdout:generic/050 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T08:57:04.681 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/050 2024-04-17T08:57:04.682 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/050 2024-04-17T08:57:04.682 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:57:04.691 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:57:04.729 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:57:04.729 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2024-04-17T08:57:05.370 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:57:05.385 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:57:05.385 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:57:05.801 INFO:teuthology.orchestra.run.smithi152.stdout:generic/051 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T08:57:05.814 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/051 2024-04-17T08:57:05.815 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/051 2024-04-17T08:57:05.815 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:57:05.825 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:57:05.853 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:57:05.853 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2024-04-17T08:57:06.485 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:57:06.501 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:57:06.502 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:57:06.936 INFO:teuthology.orchestra.run.smithi152.stdout:generic/052 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T08:57:06.945 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/052 2024-04-17T08:57:06.945 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/052 2024-04-17T08:57:06.945 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:57:06.951 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:57:06.970 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:57:06.970 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2024-04-17T08:57:07.432 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:57:07.445 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:57:07.445 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:57:08.031 INFO:teuthology.orchestra.run.smithi152.stdout:generic/053 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T08:57:08.043 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/053 2024-04-17T08:57:08.043 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/053 2024-04-17T08:57:08.044 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:57:08.055 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:57:08.084 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:57:08.084 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2024-04-17T08:57:08.732 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:57:08.751 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:57:08.751 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:57:09.204 INFO:teuthology.orchestra.run.smithi152.stdout:generic/054 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T08:57:09.221 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/054 2024-04-17T08:57:09.222 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/054 2024-04-17T08:57:09.222 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:57:09.231 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:57:09.267 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:57:09.267 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2024-04-17T08:57:09.861 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:57:09.875 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:57:09.875 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:57:10.318 INFO:teuthology.orchestra.run.smithi152.stdout:generic/055 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T08:57:10.330 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/055 2024-04-17T08:57:10.330 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/055 2024-04-17T08:57:10.330 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:57:10.341 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:57:10.371 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:57:10.371 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2024-04-17T08:57:10.989 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:57:11.012 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:57:11.012 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:57:11.462 INFO:teuthology.orchestra.run.smithi152.stdout:generic/056 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T08:57:11.475 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/056 2024-04-17T08:57:11.475 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/056 2024-04-17T08:57:11.475 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:57:11.487 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:57:11.534 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:57:11.535 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2024-04-17T08:57:12.156 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:57:12.179 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:57:12.179 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:57:12.656 INFO:teuthology.orchestra.run.smithi152.stdout:generic/057 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T08:57:12.670 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/057 2024-04-17T08:57:12.671 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/057 2024-04-17T08:57:12.671 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:57:12.680 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:57:12.712 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:57:12.712 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2024-04-17T08:57:13.297 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:57:13.312 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:57:13.312 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:57:16.365 INFO:teuthology.orchestra.run.smithi152.stdout:generic/058 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-04-17T08:57:16.382 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/058 2024-04-17T08:57:16.382 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/058 2024-04-17T08:57:16.382 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:57:16.398 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:57:16.599 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:57:16.599 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2024-04-17T08:57:17.254 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:57:17.271 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:57:17.272 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:57:17.726 INFO:teuthology.orchestra.run.smithi152.stdout:generic/059 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T08:57:17.738 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/059 2024-04-17T08:57:17.738 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/059 2024-04-17T08:57:17.738 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:57:17.748 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:57:17.810 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:57:17.811 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2024-04-17T08:57:18.445 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:57:18.459 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:57:18.460 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:57:21.763 INFO:teuthology.orchestra.run.smithi152.stdout:generic/060 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-04-17T08:57:21.777 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/060 2024-04-17T08:57:21.777 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/060 2024-04-17T08:57:21.777 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:57:21.787 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:57:21.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:57:21.869 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2024-04-17T08:57:22.594 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:57:22.611 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:57:22.611 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:57:25.689 INFO:teuthology.orchestra.run.smithi152.stdout:generic/061 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-04-17T08:57:25.701 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/061 2024-04-17T08:57:25.701 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/061 2024-04-17T08:57:25.701 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:57:25.715 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:57:25.863 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:57:25.864 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2024-04-17T08:57:26.568 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:57:26.590 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:57:26.591 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:57:27.032 INFO:teuthology.orchestra.run.smithi152.stdout:generic/062 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T08:57:27.046 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/062 2024-04-17T08:57:27.046 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/062 2024-04-17T08:57:27.046 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:57:27.054 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:57:27.083 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:57:27.084 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2024-04-17T08:57:27.620 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:57:27.635 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:57:27.635 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:57:32.188 INFO:teuthology.orchestra.run.smithi152.stdout:generic/063 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-04-17T08:57:32.200 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/063 2024-04-17T08:57:32.200 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/063 2024-04-17T08:57:32.200 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:57:32.343 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:57:32.398 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:57:32.398 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2024-04-17T08:57:33.369 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:57:33.387 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:57:33.387 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:57:33.831 INFO:teuthology.orchestra.run.smithi152.stdout:generic/064 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T08:57:33.843 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/064 2024-04-17T08:57:33.843 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/064 2024-04-17T08:57:33.843 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:57:33.853 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:57:33.886 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:57:33.887 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2024-04-17T08:57:34.465 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:57:34.483 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:57:34.484 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:57:34.953 INFO:teuthology.orchestra.run.smithi152.stdout:generic/065 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T08:57:34.966 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/065 2024-04-17T08:57:34.966 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/065 2024-04-17T08:57:34.966 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:57:34.976 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:57:35.035 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:57:35.036 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2024-04-17T08:57:40.027 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:57:40.049 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:57:40.049 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:57:40.519 INFO:teuthology.orchestra.run.smithi152.stdout:generic/066 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T08:57:40.536 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/066 2024-04-17T08:57:40.536 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/066 2024-04-17T08:57:40.536 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:57:40.562 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:57:40.601 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:57:40.602 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2024-04-17T08:57:41.519 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:57:41.536 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:57:41.536 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:57:42.064 INFO:teuthology.orchestra.run.smithi152.stdout:generic/067 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T08:57:42.078 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/067 2024-04-17T08:57:42.078 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/067 2024-04-17T08:57:42.078 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:57:42.090 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:57:42.122 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:57:42.122 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2024-04-17T08:57:42.616 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:57:42.627 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:57:42.627 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:57:43.320 INFO:teuthology.orchestra.run.smithi152.stdout:generic/068 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T08:57:43.333 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/068 2024-04-17T08:57:43.333 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/068 2024-04-17T08:57:43.333 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:57:43.347 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:57:43.399 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:57:43.399 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2024-04-17T08:57:44.167 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:57:44.182 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:57:44.182 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:57:44.609 INFO:teuthology.orchestra.run.smithi152.stdout:generic/069 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T08:57:44.623 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/069 2024-04-17T08:57:44.623 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/069 2024-04-17T08:57:44.623 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:57:44.648 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:57:44.682 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:57:44.682 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2024-04-17T08:57:45.479 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:57:45.499 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:57:45.499 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:58:28.386 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T08:58:28.390 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T08:58:59.951 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T08:58:59.962 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T08:59:30.219 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T08:59:30.223 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T08:59:48.501 INFO:teuthology.orchestra.run.smithi152.stdout:generic/070 123s 2024-04-17T08:59:48.533 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/070 2024-04-17T08:59:48.533 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:59:48.548 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:59:48.583 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:59:48.583 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2024-04-17T08:59:49.360 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:59:49.373 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:59:49.373 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:59:49.750 INFO:teuthology.orchestra.run.smithi152.stdout:generic/071 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T08:59:49.761 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/071 2024-04-17T08:59:49.761 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/071 2024-04-17T08:59:49.761 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:59:49.770 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:59:49.798 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:59:49.798 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2024-04-17T08:59:50.363 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:59:50.377 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:59:50.378 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:59:52.866 INFO:teuthology.orchestra.run.smithi152.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2024-04-17T08:59:52.879 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/072 2024-04-17T08:59:52.879 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/072 2024-04-17T08:59:52.879 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:59:52.889 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:59:52.920 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:59:52.920 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2024-04-17T08:59:53.466 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:59:53.478 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:59:53.479 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:59:53.912 INFO:teuthology.orchestra.run.smithi152.stdout:generic/073 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T08:59:53.926 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/073 2024-04-17T08:59:53.926 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/073 2024-04-17T08:59:53.926 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T08:59:53.936 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T08:59:53.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T08:59:53.968 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2024-04-17T08:59:54.473 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T08:59:54.487 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T08:59:54.487 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:00:00.277 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T09:00:00.281 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T09:00:30.350 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T09:00:30.355 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T09:01:00.414 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T09:01:00.417 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T09:01:30.470 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T09:01:30.474 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T09:02:00.652 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T09:02:00.660 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T09:02:32.225 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T09:02:32.235 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T09:03:05.388 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T09:03:05.392 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T09:03:38.961 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T09:03:38.965 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T09:04:13.419 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T09:04:13.424 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T09:04:44.222 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T09:04:44.226 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T09:05:15.304 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T09:05:15.313 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T09:05:45.434 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T09:05:45.439 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T09:06:16.579 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T09:06:16.584 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T09:06:46.648 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T09:06:46.652 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T09:07:16.710 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T09:07:16.717 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T09:07:16.788 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-04-17T09:07:16.788+0000 7f2b4a200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 33532) UID: 0 2024-04-17T09:07:16.788 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-04-17T09:07:16.788+0000 7fc7d2600640 -1 received signal: Hangup from (PID: 33532) UID: 0 2024-04-17T09:07:16.790 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-04-17T09:07:16.788+0000 7fc89d000640 -1 Fail to open '/proc/33532/cmdline' error = (2) No such file or directory 2024-04-17T09:07:16.790 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-04-17T09:07:16.788+0000 7fc89d000640 -1 received signal: Hangup from (PID: 33532) UID: 0 2024-04-17T09:07:16.790 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-04-17T09:07:16.788+0000 7f5475c00640 -1 Fail to open '/proc/33532/cmdline' error = (2) No such file or directory 2024-04-17T09:07:16.790 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-04-17T09:07:16.788+0000 7f5475c00640 -1 received signal: Hangup from (PID: 33532) UID: 0 2024-04-17T09:11:55.651 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T09:11:55.657 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T09:11:55.706 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-04-17T09:11:55.705+0000 7fc89d000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 33609) UID: 0 2024-04-17T09:11:55.707 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-04-17T09:11:55.709+0000 7f2b4a200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 33609) UID: 0 2024-04-17T09:11:55.708 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-04-17T09:11:55.705+0000 7f5475c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 33609) UID: 0 2024-04-17T09:11:55.714 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-04-17T09:11:55.713+0000 7fc7d2600640 -1 Fail to open '/proc/33609/cmdline' error = (2) No such file or directory 2024-04-17T09:11:55.714 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-04-17T09:11:55.713+0000 7fc7d2600640 -1 received signal: Hangup from (PID: 33609) UID: 0 2024-04-17T09:17:50.575 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T09:17:50.595 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T09:17:50.789 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-04-17T09:17:50.789+0000 7fc7d2600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 33678) UID: 0 2024-04-17T09:17:50.790 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-04-17T09:17:50.789+0000 7fc89d000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 33678) UID: 0 2024-04-17T09:17:50.790 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-04-17T09:17:50.789+0000 7f2b4a200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 33678) UID: 0 2024-04-17T09:17:50.790 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-04-17T09:17:50.789+0000 7f5475c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 33678) UID: 0 2024-04-17T09:17:50.879 INFO:tasks.ceph.osd.2.smithi152.stderr:2024-04-17T09:17:50.877+0000 7f9821400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120342) UID: 0 2024-04-17T09:17:50.880 INFO:tasks.ceph.osd.0.smithi152.stderr:2024-04-17T09:17:50.877+0000 7f2076000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120342) UID: 0 2024-04-17T09:17:50.880 INFO:tasks.ceph.osd.1.smithi152.stderr:2024-04-17T09:17:50.877+0000 7fb553c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120342) UID: 0 2024-04-17T09:17:50.882 INFO:tasks.ceph.osd.3.smithi152.stderr:2024-04-17T09:17:50.877+0000 7f2cca800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120342) UID: 0 2024-04-17T09:31:15.295 INFO:teuthology.orchestra.run.smithi152.stdout:generic/074 1881s 2024-04-17T09:31:15.420 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/074 2024-04-17T09:31:15.420 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T09:31:15.426 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:31:15.516 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T09:31:15.517 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2024-04-17T09:31:17.008 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T09:31:17.019 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T09:31:17.019 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:32:01.213 INFO:teuthology.orchestra.run.smithi152.stdout:generic/075 44s 2024-04-17T09:32:01.225 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/075 2024-04-17T09:32:01.225 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T09:32:01.231 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:32:01.266 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T09:32:01.267 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2024-04-17T09:32:01.963 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T09:32:01.974 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T09:32:01.975 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:32:02.268 INFO:teuthology.orchestra.run.smithi152.stdout:generic/076 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T09:32:02.276 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/076 2024-04-17T09:32:02.276 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/076 2024-04-17T09:32:02.276 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T09:32:02.282 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:32:02.302 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T09:32:02.302 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2024-04-17T09:32:02.665 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T09:32:02.675 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T09:32:02.675 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:32:06.583 INFO:teuthology.orchestra.run.smithi152.stdout:generic/077 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T09:32:06.591 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/077 2024-04-17T09:32:06.591 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/077 2024-04-17T09:32:06.591 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T09:32:06.598 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:32:06.617 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T09:32:06.617 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2024-04-17T09:32:06.982 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T09:32:06.993 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T09:32:06.993 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:32:07.334 INFO:teuthology.orchestra.run.smithi152.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2024-04-17T09:32:07.342 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/078 2024-04-17T09:32:07.342 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/078 2024-04-17T09:32:07.342 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T09:32:07.348 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:32:07.420 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T09:32:07.421 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2024-04-17T09:32:08.011 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T09:32:08.022 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T09:32:08.022 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:32:08.366 INFO:teuthology.orchestra.run.smithi152.stdout:generic/079 [not run] file system doesn't support chattr +ia 2024-04-17T09:32:08.375 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/079 2024-04-17T09:32:08.375 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/079 2024-04-17T09:32:08.375 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T09:32:08.381 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:32:08.401 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T09:32:08.401 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2024-04-17T09:32:08.838 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T09:32:08.848 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T09:32:08.849 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:32:11.302 INFO:teuthology.orchestra.run.smithi152.stdout:generic/080 3s 2024-04-17T09:32:11.315 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/080 2024-04-17T09:32:11.315 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T09:32:11.321 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:32:11.341 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T09:32:11.342 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2024-04-17T09:32:11.710 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T09:32:11.721 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T09:32:11.721 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:32:12.013 INFO:teuthology.orchestra.run.smithi152.stdout:generic/081 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T09:32:12.021 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/081 2024-04-17T09:32:12.021 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/081 2024-04-17T09:32:12.021 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T09:32:12.028 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:32:12.048 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T09:32:12.048 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2024-04-17T09:32:12.459 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T09:32:12.469 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T09:32:12.469 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:32:12.756 INFO:teuthology.orchestra.run.smithi152.stdout:generic/082 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T09:32:12.763 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/082 2024-04-17T09:32:12.764 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/082 2024-04-17T09:32:12.764 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T09:32:12.770 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:32:12.789 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T09:32:12.789 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2024-04-17T09:32:13.164 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T09:32:13.174 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T09:32:13.175 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:32:13.445 INFO:teuthology.orchestra.run.smithi152.stdout:generic/083 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T09:32:13.453 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/083 2024-04-17T09:32:13.453 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/083 2024-04-17T09:32:13.453 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T09:32:13.459 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:32:13.478 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T09:32:13.479 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2024-04-17T09:32:13.852 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T09:32:13.862 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T09:32:13.862 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:32:14.137 INFO:teuthology.orchestra.run.smithi152.stdout:generic/084 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T09:32:14.146 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/084 2024-04-17T09:32:14.146 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/084 2024-04-17T09:32:14.146 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T09:32:14.152 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:32:14.173 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T09:32:14.173 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2024-04-17T09:32:14.540 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T09:32:14.550 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T09:32:14.550 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:32:14.916 INFO:teuthology.orchestra.run.smithi152.stdout:generic/085 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T09:32:14.924 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/085 2024-04-17T09:32:14.924 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/085 2024-04-17T09:32:14.924 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T09:32:14.930 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:32:14.950 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T09:32:14.950 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2024-04-17T09:32:15.315 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T09:32:15.325 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T09:32:15.325 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:32:36.189 INFO:teuthology.orchestra.run.smithi152.stdout:generic/086 20s 2024-04-17T09:32:36.566 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/086 2024-04-17T09:32:36.566 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T09:32:36.572 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:32:36.654 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T09:32:36.654 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2024-04-17T09:32:39.581 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T09:32:39.591 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T09:32:39.591 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:32:40.294 INFO:teuthology.orchestra.run.smithi152.stdout:generic/087 1s 2024-04-17T09:32:40.306 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/087 2024-04-17T09:32:40.306 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T09:32:40.312 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:32:40.349 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T09:32:40.349 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2024-04-17T09:32:41.024 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T09:32:41.035 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T09:32:41.035 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:32:41.434 INFO:teuthology.orchestra.run.smithi152.stdout:generic/088 0s 2024-04-17T09:32:41.446 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/088 2024-04-17T09:32:41.446 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T09:32:41.452 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:32:41.489 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T09:32:41.489 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2024-04-17T09:32:42.171 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T09:32:42.181 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T09:32:42.181 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:33:17.951 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T09:33:17.955 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T09:33:18.066 INFO:tasks.ceph.osd.1.smithi152.stderr:2024-04-17T09:33:18.063+0000 7fb553c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133455) UID: 0 2024-04-17T09:33:18.066 INFO:tasks.ceph.osd.2.smithi152.stderr:2024-04-17T09:33:18.063+0000 7f9821400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133455) UID: 0 2024-04-17T09:33:18.066 INFO:tasks.ceph.osd.0.smithi152.stderr:2024-04-17T09:33:18.063+0000 7f2076000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133455) UID: 0 2024-04-17T09:33:18.067 INFO:tasks.ceph.osd.3.smithi152.stderr:2024-04-17T09:33:18.063+0000 7f2cca800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133455) UID: 0 2024-04-17T09:33:18.198 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-04-17T09:33:18.196+0000 7fc7d2600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34080) UID: 0 2024-04-17T09:33:18.198 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-04-17T09:33:18.196+0000 7f5475c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34080) UID: 0 2024-04-17T09:33:18.198 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-04-17T09:33:18.196+0000 7fc89d000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34080) UID: 0 2024-04-17T09:33:18.198 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-04-17T09:33:18.196+0000 7f2b4a200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34080) UID: 0 2024-04-17T09:46:08.114 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T09:46:08.118 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T09:46:08.263 INFO:tasks.ceph.mds.c.smithi152.stderr:2024-04-17T09:46:08.263+0000 7f1eb3200640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 135716) UID: 0 2024-04-17T09:46:08.263 INFO:tasks.ceph.mds.a.smithi152.stderr:2024-04-17T09:46:08.263+0000 7f65f1400640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 135716) UID: 0 2024-04-17T09:49:27.143 INFO:teuthology.orchestra.run.smithi152.stdout:generic/089 1005s 2024-04-17T09:49:27.285 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/089 2024-04-17T09:49:27.285 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T09:49:27.291 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:49:27.316 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T09:49:27.317 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2024-04-17T09:49:38.812 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T09:49:38.823 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T09:49:38.823 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:49:39.515 INFO:teuthology.orchestra.run.smithi152.stdout:generic/090 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T09:49:39.523 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/090 2024-04-17T09:49:39.523 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/090 2024-04-17T09:49:39.523 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T09:49:39.529 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:49:39.550 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T09:49:39.550 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2024-04-17T09:49:39.918 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T09:49:39.929 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T09:49:39.929 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:51:59.038 INFO:teuthology.orchestra.run.smithi152.stdout:generic/091 140s 2024-04-17T09:51:59.050 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/091 2024-04-17T09:51:59.050 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T09:51:59.056 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:51:59.132 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T09:51:59.132 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2024-04-17T09:52:00.303 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T09:52:00.313 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T09:52:00.313 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:52:00.935 INFO:teuthology.orchestra.run.smithi152.stdout:generic/092 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-04-17T09:52:00.943 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/092 2024-04-17T09:52:00.943 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/092 2024-04-17T09:52:00.944 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T09:52:00.950 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:52:01.015 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T09:52:01.015 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2024-04-17T09:52:01.736 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T09:52:01.746 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T09:52:01.746 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:52:03.921 INFO:teuthology.orchestra.run.smithi152.stdout:generic/093 2s 2024-04-17T09:52:03.933 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/093 2024-04-17T09:52:03.933 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T09:52:03.939 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:52:03.967 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T09:52:03.967 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2024-04-17T09:52:04.968 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T09:52:04.979 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T09:52:04.979 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:52:05.340 INFO:teuthology.orchestra.run.smithi152.stdout:generic/094 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T09:52:05.348 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/094 2024-04-17T09:52:05.348 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/094 2024-04-17T09:52:05.349 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T09:52:05.355 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:52:05.376 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T09:52:05.376 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2024-04-17T09:52:05.730 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T09:52:05.741 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T09:52:05.741 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:52:06.081 INFO:teuthology.orchestra.run.smithi152.stdout:generic/095 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T09:52:06.089 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/095 2024-04-17T09:52:06.090 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/095 2024-04-17T09:52:06.090 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T09:52:06.095 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:52:06.116 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T09:52:06.116 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2024-04-17T09:52:06.482 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T09:52:06.492 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T09:52:06.492 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:52:06.802 INFO:teuthology.orchestra.run.smithi152.stdout:generic/096 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T09:52:06.811 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/096 2024-04-17T09:52:06.811 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/096 2024-04-17T09:52:06.811 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T09:52:06.817 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:52:06.837 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T09:52:06.837 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2024-04-17T09:52:07.214 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T09:52:07.225 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T09:52:07.225 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:52:08.275 INFO:teuthology.orchestra.run.smithi152.stdout:generic/097 1s 2024-04-17T09:52:08.287 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/097 2024-04-17T09:52:08.287 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T09:52:08.293 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:52:08.311 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T09:52:08.311 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2024-04-17T09:52:08.670 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T09:52:08.681 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T09:52:08.681 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:52:09.071 INFO:teuthology.orchestra.run.smithi152.stdout:generic/098 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T09:52:09.080 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/098 2024-04-17T09:52:09.080 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/098 2024-04-17T09:52:09.080 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T09:52:09.086 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:52:09.108 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T09:52:09.108 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2024-04-17T09:52:09.488 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T09:52:09.499 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T09:52:09.499 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:52:09.895 INFO:teuthology.orchestra.run.smithi152.stdout:generic/099 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-04-17T09:52:09.904 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/099 2024-04-17T09:52:09.904 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/099 2024-04-17T09:52:09.904 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T09:52:09.910 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:52:09.930 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T09:52:09.930 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2024-04-17T09:52:10.318 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T09:52:10.329 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T09:52:10.329 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:53:03.961 INFO:teuthology.orchestra.run.smithi152.stdout:generic/100 53s 2024-04-17T09:53:03.973 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/100 2024-04-17T09:53:03.973 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T09:53:03.979 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:53:04.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T09:53:04.025 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2024-04-17T09:53:04.771 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T09:53:04.781 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T09:53:04.781 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:53:05.975 INFO:teuthology.orchestra.run.smithi152.stdout:generic/101 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T09:53:05.984 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/101 2024-04-17T09:53:05.984 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/101 2024-04-17T09:53:05.984 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T09:53:05.991 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:53:06.013 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T09:53:06.013 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2024-04-17T09:53:06.377 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T09:53:06.388 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T09:53:06.388 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:53:06.741 INFO:teuthology.orchestra.run.smithi152.stdout:generic/102 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T09:53:06.749 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/102 2024-04-17T09:53:06.749 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/102 2024-04-17T09:53:06.749 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T09:53:06.755 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:53:06.775 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T09:53:06.775 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2024-04-17T09:53:07.142 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T09:53:07.152 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T09:53:07.153 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:53:07.486 INFO:teuthology.orchestra.run.smithi152.stdout:generic/103 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T09:53:07.495 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/103 2024-04-17T09:53:07.495 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/103 2024-04-17T09:53:07.495 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T09:53:07.501 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:53:07.522 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T09:53:07.522 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2024-04-17T09:53:07.931 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T09:53:07.941 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T09:53:07.941 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:53:08.281 INFO:teuthology.orchestra.run.smithi152.stdout:generic/104 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T09:53:08.289 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/104 2024-04-17T09:53:08.289 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/104 2024-04-17T09:53:08.289 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T09:53:08.295 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:53:08.315 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T09:53:08.315 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2024-04-17T09:53:08.695 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T09:53:08.706 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T09:53:08.706 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:53:09.224 INFO:teuthology.orchestra.run.smithi152.stdout:generic/105 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T09:53:09.232 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/105 2024-04-17T09:53:09.232 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/105 2024-04-17T09:53:09.232 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T09:53:09.238 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:53:09.261 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T09:53:09.261 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2024-04-17T09:53:09.627 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T09:53:09.637 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T09:53:09.637 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:53:09.939 INFO:teuthology.orchestra.run.smithi152.stdout:generic/106 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T09:53:09.948 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/106 2024-04-17T09:53:09.948 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/106 2024-04-17T09:53:09.948 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T09:53:09.954 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:53:09.973 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T09:53:09.974 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2024-04-17T09:53:10.342 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T09:53:10.353 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T09:53:10.353 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:53:10.681 INFO:teuthology.orchestra.run.smithi152.stdout:generic/107 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T09:53:10.689 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/107 2024-04-17T09:53:10.689 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/107 2024-04-17T09:53:10.689 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T09:53:10.695 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:53:10.715 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T09:53:10.715 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2024-04-17T09:53:11.096 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T09:53:11.106 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T09:53:11.106 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:53:11.863 INFO:teuthology.orchestra.run.smithi152.stdout:generic/108 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T09:53:11.871 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/108 2024-04-17T09:53:11.871 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/108 2024-04-17T09:53:11.871 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T09:53:11.877 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:53:11.897 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T09:53:11.897 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2024-04-17T09:53:12.272 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T09:53:12.282 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T09:53:12.282 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:53:12.558 INFO:teuthology.orchestra.run.smithi152.stdout:generic/109 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T09:53:12.566 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/109 2024-04-17T09:53:12.566 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/109 2024-04-17T09:53:12.567 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T09:53:12.573 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:53:12.593 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T09:53:12.593 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2024-04-17T09:53:12.962 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T09:53:12.973 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T09:53:12.973 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:53:13.362 INFO:teuthology.orchestra.run.smithi152.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-17T09:53:13.370 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/110 2024-04-17T09:53:13.370 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/110 2024-04-17T09:53:13.370 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T09:53:13.376 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:53:13.423 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T09:53:13.423 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2024-04-17T09:53:14.106 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T09:53:14.116 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T09:53:14.116 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:53:14.548 INFO:teuthology.orchestra.run.smithi152.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-17T09:53:14.557 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/111 2024-04-17T09:53:14.557 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/111 2024-04-17T09:53:14.557 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T09:53:14.563 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:53:14.610 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T09:53:14.610 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2024-04-17T09:53:15.280 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T09:53:15.291 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T09:53:15.291 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:54:04.360 INFO:teuthology.orchestra.run.smithi152.stdout:generic/112 49s 2024-04-17T09:54:04.372 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/112 2024-04-17T09:54:04.372 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T09:54:04.378 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:54:04.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T09:54:04.403 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2024-04-17T09:54:05.135 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T09:54:05.145 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T09:54:05.146 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:54:52.536 INFO:teuthology.orchestra.run.smithi152.stdout:generic/113 47s 2024-04-17T09:54:52.548 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/113 2024-04-17T09:54:52.548 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T09:54:52.555 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:54:52.599 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T09:54:52.599 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2024-04-17T09:54:53.339 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T09:54:53.349 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T09:54:53.349 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:54:53.793 INFO:teuthology.orchestra.run.smithi152.stdout:generic/114 [not run] Sparse files are not supported or do not work as expected 2024-04-17T09:54:53.801 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/114 2024-04-17T09:54:53.801 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/114 2024-04-17T09:54:53.801 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T09:54:53.807 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:54:53.827 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T09:54:53.827 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2024-04-17T09:54:54.199 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T09:54:54.209 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T09:54:54.209 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:54:54.614 INFO:teuthology.orchestra.run.smithi152.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-17T09:54:54.622 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/115 2024-04-17T09:54:54.623 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/115 2024-04-17T09:54:54.623 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T09:54:54.629 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:54:54.687 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T09:54:54.687 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2024-04-17T09:54:55.331 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T09:54:55.341 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T09:54:55.342 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:54:55.733 INFO:teuthology.orchestra.run.smithi152.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-17T09:54:55.742 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/116 2024-04-17T09:54:55.742 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/116 2024-04-17T09:54:55.742 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T09:54:55.748 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:54:55.838 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T09:54:55.838 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2024-04-17T09:54:56.471 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T09:54:56.481 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T09:54:56.481 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:54:56.760 INFO:teuthology.orchestra.run.smithi152.stdout:generic/117 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T09:54:56.770 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/117 2024-04-17T09:54:56.770 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/117 2024-04-17T09:54:56.771 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T09:54:56.775 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:54:56.795 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T09:54:56.796 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2024-04-17T09:54:57.177 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T09:54:57.188 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T09:54:57.188 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:54:57.540 INFO:teuthology.orchestra.run.smithi152.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-17T09:54:57.549 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/118 2024-04-17T09:54:57.549 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/118 2024-04-17T09:54:57.549 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T09:54:57.555 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:54:57.600 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T09:54:57.601 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2024-04-17T09:54:58.302 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T09:54:58.313 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T09:54:58.313 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:54:58.681 INFO:teuthology.orchestra.run.smithi152.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-17T09:54:58.689 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/119 2024-04-17T09:54:58.689 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/119 2024-04-17T09:54:58.689 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T09:54:58.916 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:54:58.959 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T09:54:58.959 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2024-04-17T09:54:59.591 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T09:54:59.602 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T09:54:59.602 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:54:59.877 INFO:teuthology.orchestra.run.smithi152.stdout:generic/120 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T09:54:59.885 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/120 2024-04-17T09:54:59.885 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/120 2024-04-17T09:54:59.885 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T09:54:59.891 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:54:59.912 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T09:54:59.913 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2024-04-17T09:55:00.291 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T09:55:00.302 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T09:55:00.302 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:55:01.352 INFO:teuthology.orchestra.run.smithi152.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-04-17T09:55:01.360 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/121 2024-04-17T09:55:01.360 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/121 2024-04-17T09:55:01.360 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T09:55:01.366 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:55:01.430 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T09:55:01.430 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2024-04-17T09:55:02.038 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T09:55:02.048 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T09:55:02.049 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:55:02.672 INFO:teuthology.orchestra.run.smithi152.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-04-17T09:55:02.680 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/122 2024-04-17T09:55:02.680 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/122 2024-04-17T09:55:02.680 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T09:55:02.686 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:55:02.731 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T09:55:02.731 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2024-04-17T09:55:03.407 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T09:55:03.417 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T09:55:03.417 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:55:05.617 INFO:teuthology.orchestra.run.smithi152.stdout:generic/123 2s 2024-04-17T09:55:05.629 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/123 2024-04-17T09:55:05.629 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T09:55:05.636 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:55:05.715 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T09:55:05.715 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2024-04-17T09:55:06.375 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T09:55:06.385 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T09:55:06.386 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:55:06.685 INFO:teuthology.orchestra.run.smithi152.stdout:generic/124 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T09:55:06.693 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/124 2024-04-17T09:55:06.693 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/124 2024-04-17T09:55:06.693 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T09:55:06.700 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:55:06.721 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T09:55:06.721 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2024-04-17T09:55:07.092 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T09:55:07.103 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T09:55:07.103 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:56:08.487 INFO:teuthology.orchestra.run.smithi152.stdout:generic/125 61s 2024-04-17T09:56:08.629 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/125 2024-04-17T09:56:08.630 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T09:56:08.635 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:56:08.715 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T09:56:08.716 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2024-04-17T09:56:10.475 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T09:56:10.485 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T09:56:10.486 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:56:11.510 INFO:teuthology.orchestra.run.smithi152.stdout:generic/126 - output mismatch (see /tmp/tmp.pJW3k3pP3vxfstests-dev/results//generic/126.out.bad) 2024-04-17T09:56:11.515 INFO:teuthology.orchestra.run.smithi152.stdout: --- tests/generic/126.out 2024-04-17 08:48:08.537452281 +0000 2024-04-17T09:56:11.515 INFO:teuthology.orchestra.run.smithi152.stdout: +++ /tmp/tmp.pJW3k3pP3vxfstests-dev/results//generic/126.out.bad 2024-04-17 09:56:11.496838689 +0000 2024-04-17T09:56:11.515 INFO:teuthology.orchestra.run.smithi152.stdout: @@ -1,7 +1,7 @@ 2024-04-17T09:56:11.515 INFO:teuthology.orchestra.run.smithi152.stdout: QA output created by 126 2024-04-17T09:56:11.515 INFO:teuthology.orchestra.run.smithi152.stdout: -x a 001 file owned by (99/99) as user/group(12/100) PASS 2024-04-17T09:56:11.516 INFO:teuthology.orchestra.run.smithi152.stdout: -x a 010 file owned by (99/99) as user/group(200/99) PASS 2024-04-17T09:56:11.516 INFO:teuthology.orchestra.run.smithi152.stdout: -x a 100 file owned by (99/99) as user/group(99/500) PASS 2024-04-17T09:56:11.516 INFO:teuthology.orchestra.run.smithi152.stdout: +x a 001 file owned by (99/99) as user/group(12/100) FAIL 2024-04-17T09:56:11.516 INFO:teuthology.orchestra.run.smithi152.stdout: +x a 010 file owned by (99/99) as user/group(200/99) FAIL 2024-04-17T09:56:11.516 INFO:teuthology.orchestra.run.smithi152.stdout: +x a 100 file owned by (99/99) as user/group(99/500) FAIL 2024-04-17T09:56:11.516 INFO:teuthology.orchestra.run.smithi152.stdout: w a 002 file owned by (99/99) as user/group(12/100) PASS 2024-04-17T09:56:11.516 INFO:teuthology.orchestra.run.smithi152.stdout: w a 020 file owned by (99/99) as user/group(200/99) PASS 2024-04-17T09:56:11.516 INFO:teuthology.orchestra.run.smithi152.stdout: w a 200 file owned by (99/99) as user/group(99/500) PASS 2024-04-17T09:56:11.521 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/126 2024-04-17T09:56:11.521 INFO:teuthology.orchestra.run.smithi152.stdout:Failures: generic/126 2024-04-17T09:56:11.521 INFO:teuthology.orchestra.run.smithi152.stdout:Failed 1 of 1 tests 2024-04-17T09:56:11.528 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:56:11.559 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T09:56:11.560 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-04-17T09:56:11.560 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-04-17T09:56:11.560 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2024-04-17T09:56:12.282 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T09:56:12.293 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T09:56:12.293 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T09:57:29.448 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T09:57:29.453 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T09:57:59.554 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T09:57:59.559 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T09:58:29.609 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T09:58:29.614 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T09:58:59.670 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T09:58:59.674 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T09:59:29.736 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T09:59:29.741 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T09:59:59.798 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T09:59:59.803 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T09:59:59.894 INFO:tasks.ceph.osd.1.smithi152.stderr:2024-04-17T09:59:59.890+0000 7fb553c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 166556) UID: 0 2024-04-17T09:59:59.894 INFO:tasks.ceph.osd.2.smithi152.stderr:2024-04-17T09:59:59.890+0000 7f9821400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 166556) UID: 0 2024-04-17T09:59:59.894 INFO:tasks.ceph.osd.0.smithi152.stderr:2024-04-17T09:59:59.890+0000 7f2076000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 166556) UID: 0 2024-04-17T09:59:59.895 INFO:tasks.ceph.osd.3.smithi152.stderr:2024-04-17T09:59:59.890+0000 7f2cca800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 166556) UID: 0 2024-04-17T10:03:21.561 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:03:21.566 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:03:51.666 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:03:51.669 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:04:22.263 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:04:22.267 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:04:52.334 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:04:52.338 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:05:22.409 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:05:22.413 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:05:52.477 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:05:52.481 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:05:52.507 INFO:tasks.ceph.mds.c.smithi152.stderr:2024-04-17T10:05:52.506+0000 7f1eb3200640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 166591) UID: 0 2024-04-17T10:05:52.507 INFO:tasks.ceph.mds.a.smithi152.stderr:2024-04-17T10:05:52.506+0000 7f65f1400640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 166591) UID: 0 2024-04-17T10:08:55.472 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:08:55.476 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:09:25.765 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:09:25.769 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:09:55.965 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:09:55.970 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:10:26.141 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:10:26.145 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:10:56.462 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:10:56.465 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:11:26.550 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:11:26.554 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:11:35.473 INFO:teuthology.orchestra.run.smithi152.stdout:generic/127 923s 2024-04-17T10:11:35.485 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/127 2024-04-17T10:11:35.485 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:11:35.491 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:11:35.518 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:11:35.518 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2024-04-17T10:11:36.161 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:11:36.171 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:11:36.171 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:11:36.465 INFO:teuthology.orchestra.run.smithi152.stdout:generic/128 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:11:36.473 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/128 2024-04-17T10:11:36.473 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/128 2024-04-17T10:11:36.473 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:11:36.479 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:11:36.499 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:11:36.500 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2024-04-17T10:11:36.869 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:11:36.879 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:11:36.880 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:11:37.149 INFO:teuthology.orchestra.run.smithi152.stdout:generic/129 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:11:37.157 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/129 2024-04-17T10:11:37.157 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/129 2024-04-17T10:11:37.157 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:11:37.164 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:11:37.184 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:11:37.184 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2024-04-17T10:11:37.549 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:11:37.559 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:11:37.559 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:11:37.819 INFO:teuthology.orchestra.run.smithi152.stdout:generic/130 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:11:37.828 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/130 2024-04-17T10:11:37.828 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/130 2024-04-17T10:11:37.828 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:11:37.834 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:11:37.854 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:11:37.854 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2024-04-17T10:11:38.193 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:11:38.203 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:11:38.204 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:11:39.728 INFO:teuthology.orchestra.run.smithi152.stdout:generic/131 1s 2024-04-17T10:11:39.740 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/131 2024-04-17T10:11:39.741 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:11:39.747 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:11:39.767 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:11:39.768 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2024-04-17T10:11:40.438 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:11:40.448 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:11:40.448 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:11:40.714 INFO:teuthology.orchestra.run.smithi152.stdout:generic/132 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:11:40.722 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/132 2024-04-17T10:11:40.722 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/132 2024-04-17T10:11:40.722 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:11:40.727 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:11:40.748 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:11:40.748 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2024-04-17T10:11:41.109 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:11:41.119 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:11:41.119 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:11:56.613 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:11:56.616 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:12:26.847 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:12:26.851 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:12:56.903 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:12:56.907 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:13:27.193 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:13:27.197 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:13:57.273 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:13:57.277 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:14:27.577 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:14:27.581 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:14:57.634 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:14:57.638 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:15:27.711 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:15:27.715 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:15:57.791 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:15:57.795 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:16:06.430 INFO:teuthology.orchestra.run.smithi152.stdout:generic/133 265s 2024-04-17T10:16:06.444 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/133 2024-04-17T10:16:06.444 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:06.450 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:06.477 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:06.477 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2024-04-17T10:16:07.264 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:07.274 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:07.274 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:07.639 INFO:teuthology.orchestra.run.smithi152.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-17T10:16:07.648 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/134 2024-04-17T10:16:07.648 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/134 2024-04-17T10:16:07.648 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:07.654 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:07.680 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:07.681 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2024-04-17T10:16:08.364 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:08.374 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:08.375 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:08.710 INFO:teuthology.orchestra.run.smithi152.stdout:generic/135 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:16:08.718 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/135 2024-04-17T10:16:08.718 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/135 2024-04-17T10:16:08.718 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:08.724 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:08.744 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:08.744 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2024-04-17T10:16:09.109 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:09.119 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:09.119 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:09.474 INFO:teuthology.orchestra.run.smithi152.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-04-17T10:16:09.482 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/136 2024-04-17T10:16:09.482 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/136 2024-04-17T10:16:09.482 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:09.488 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:09.519 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:09.519 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2024-04-17T10:16:10.191 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:10.201 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:10.202 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:10.573 INFO:teuthology.orchestra.run.smithi152.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-17T10:16:10.581 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/137 2024-04-17T10:16:10.581 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/137 2024-04-17T10:16:10.581 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:10.587 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:10.609 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:10.609 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2024-04-17T10:16:11.312 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:11.323 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:11.323 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:11.676 INFO:teuthology.orchestra.run.smithi152.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-17T10:16:11.684 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/138 2024-04-17T10:16:11.684 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/138 2024-04-17T10:16:11.684 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:11.690 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:11.723 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:11.723 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2024-04-17T10:16:12.431 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:12.442 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:12.442 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:12.771 INFO:teuthology.orchestra.run.smithi152.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-17T10:16:12.779 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/139 2024-04-17T10:16:12.779 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/139 2024-04-17T10:16:12.779 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:12.785 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:12.834 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:12.834 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2024-04-17T10:16:13.477 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:13.487 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:13.487 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:13.835 INFO:teuthology.orchestra.run.smithi152.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-17T10:16:13.843 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/140 2024-04-17T10:16:13.843 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/140 2024-04-17T10:16:13.843 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:13.849 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:13.910 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:13.910 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2024-04-17T10:16:14.573 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:14.583 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:14.583 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:14.872 INFO:teuthology.orchestra.run.smithi152.stdout:generic/141 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:16:14.881 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/141 2024-04-17T10:16:14.881 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/141 2024-04-17T10:16:14.881 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:14.887 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:14.906 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:14.907 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2024-04-17T10:16:15.269 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:15.279 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:15.279 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:15.620 INFO:teuthology.orchestra.run.smithi152.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-17T10:16:15.628 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/142 2024-04-17T10:16:15.628 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/142 2024-04-17T10:16:15.628 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:15.634 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:15.696 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:15.696 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2024-04-17T10:16:16.345 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:16.355 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:16.355 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:16.704 INFO:teuthology.orchestra.run.smithi152.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-17T10:16:16.712 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/143 2024-04-17T10:16:16.712 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/143 2024-04-17T10:16:16.712 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:16.718 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:16.774 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:16.775 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2024-04-17T10:16:17.436 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:17.446 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:17.446 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:17.802 INFO:teuthology.orchestra.run.smithi152.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-17T10:16:17.811 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/144 2024-04-17T10:16:17.811 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/144 2024-04-17T10:16:17.811 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:17.817 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:17.847 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:17.847 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2024-04-17T10:16:18.517 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:18.527 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:18.527 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:18.868 INFO:teuthology.orchestra.run.smithi152.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-17T10:16:18.875 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/145 2024-04-17T10:16:18.875 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/145 2024-04-17T10:16:18.876 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:18.881 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:18.930 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:18.930 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2024-04-17T10:16:19.564 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:19.574 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:19.575 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:19.902 INFO:teuthology.orchestra.run.smithi152.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-17T10:16:19.910 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/146 2024-04-17T10:16:19.910 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/146 2024-04-17T10:16:19.910 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:19.916 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:19.955 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:19.955 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2024-04-17T10:16:20.633 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:20.643 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:20.643 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:20.978 INFO:teuthology.orchestra.run.smithi152.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-17T10:16:20.987 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/147 2024-04-17T10:16:20.987 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/147 2024-04-17T10:16:20.987 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:20.993 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:21.028 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:21.029 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2024-04-17T10:16:21.696 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:21.706 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:21.706 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:22.056 INFO:teuthology.orchestra.run.smithi152.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-17T10:16:22.065 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/148 2024-04-17T10:16:22.065 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/148 2024-04-17T10:16:22.065 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:22.071 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:22.105 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:22.105 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2024-04-17T10:16:22.752 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:22.762 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:22.762 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:23.100 INFO:teuthology.orchestra.run.smithi152.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-17T10:16:23.108 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/149 2024-04-17T10:16:23.108 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/149 2024-04-17T10:16:23.108 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:23.114 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:23.145 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:23.145 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2024-04-17T10:16:23.817 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:23.827 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:23.827 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:24.170 INFO:teuthology.orchestra.run.smithi152.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-17T10:16:24.178 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/150 2024-04-17T10:16:24.178 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/150 2024-04-17T10:16:24.178 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:24.184 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:24.241 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:24.241 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2024-04-17T10:16:24.908 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:24.919 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:24.919 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:25.290 INFO:teuthology.orchestra.run.smithi152.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-17T10:16:25.297 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/151 2024-04-17T10:16:25.298 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/151 2024-04-17T10:16:25.298 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:25.304 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:25.326 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:25.326 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2024-04-17T10:16:26.028 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:26.039 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:26.039 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:26.384 INFO:teuthology.orchestra.run.smithi152.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-17T10:16:26.392 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/152 2024-04-17T10:16:26.392 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/152 2024-04-17T10:16:26.392 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:26.398 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:26.429 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:26.430 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2024-04-17T10:16:27.129 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:27.139 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:27.139 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:27.467 INFO:teuthology.orchestra.run.smithi152.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-17T10:16:27.475 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/153 2024-04-17T10:16:27.475 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/153 2024-04-17T10:16:27.475 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:27.481 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:27.517 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:27.517 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2024-04-17T10:16:27.894 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:16:27.899 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:16:27.937 INFO:tasks.ceph.osd.1.smithi152.stderr:2024-04-17T10:16:27.939+0000 7fb553c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 178036) UID: 0 2024-04-17T10:16:27.938 INFO:tasks.ceph.osd.2.smithi152.stderr:2024-04-17T10:16:27.939+0000 7f9821400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 178036) UID: 0 2024-04-17T10:16:27.938 INFO:tasks.ceph.osd.3.smithi152.stderr:2024-04-17T10:16:27.939+0000 7f2cca800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 178036) UID: 0 2024-04-17T10:16:27.938 INFO:tasks.ceph.osd.0.smithi152.stderr:2024-04-17T10:16:27.939+0000 7f2076000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 178036) UID: 0 2024-04-17T10:16:28.180 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:28.191 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:28.191 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:28.549 INFO:teuthology.orchestra.run.smithi152.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-17T10:16:28.557 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/154 2024-04-17T10:16:28.558 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/154 2024-04-17T10:16:28.558 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:28.564 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:28.601 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:28.601 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2024-04-17T10:16:29.312 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:29.323 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:29.323 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:29.679 INFO:teuthology.orchestra.run.smithi152.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-17T10:16:29.687 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/155 2024-04-17T10:16:29.687 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/155 2024-04-17T10:16:29.687 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:29.693 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:29.718 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:29.718 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2024-04-17T10:16:30.434 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:30.445 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:30.445 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:30.856 INFO:teuthology.orchestra.run.smithi152.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-17T10:16:30.864 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/156 2024-04-17T10:16:30.864 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/156 2024-04-17T10:16:30.864 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:30.870 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:30.923 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:30.923 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2024-04-17T10:16:31.625 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:31.636 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:31.636 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:31.990 INFO:teuthology.orchestra.run.smithi152.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-17T10:16:32.001 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/157 2024-04-17T10:16:32.001 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/157 2024-04-17T10:16:32.001 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:32.005 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:32.029 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:32.029 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2024-04-17T10:16:32.737 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:32.747 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:32.747 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:33.134 INFO:teuthology.orchestra.run.smithi152.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-04-17T10:16:33.142 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/158 2024-04-17T10:16:33.142 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/158 2024-04-17T10:16:33.142 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:33.149 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:33.181 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:33.181 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2024-04-17T10:16:33.918 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:33.928 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:33.928 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:34.336 INFO:teuthology.orchestra.run.smithi152.stdout:generic/159 [not run] file system doesn't support chattr +i 2024-04-17T10:16:34.344 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/159 2024-04-17T10:16:34.345 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/159 2024-04-17T10:16:34.345 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:34.351 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:34.372 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:34.372 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2024-04-17T10:16:34.744 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:34.754 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:34.755 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:35.085 INFO:teuthology.orchestra.run.smithi152.stdout:generic/160 [not run] file system doesn't support chattr +i 2024-04-17T10:16:35.093 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/160 2024-04-17T10:16:35.094 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/160 2024-04-17T10:16:35.094 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:35.100 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:35.121 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:35.122 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2024-04-17T10:16:35.492 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:35.503 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:35.503 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:35.775 INFO:teuthology.orchestra.run.smithi152.stdout:generic/161 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:16:35.783 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/161 2024-04-17T10:16:35.783 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/161 2024-04-17T10:16:35.783 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:35.789 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:35.810 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:35.811 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2024-04-17T10:16:36.168 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:36.178 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:36.178 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:36.463 INFO:teuthology.orchestra.run.smithi152.stdout:generic/162 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:16:36.471 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/162 2024-04-17T10:16:36.471 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/162 2024-04-17T10:16:36.471 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:36.477 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:36.498 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:36.498 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2024-04-17T10:16:36.868 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:36.878 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:36.878 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:37.162 INFO:teuthology.orchestra.run.smithi152.stdout:generic/163 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:16:37.170 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/163 2024-04-17T10:16:37.171 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/163 2024-04-17T10:16:37.171 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:37.177 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:37.198 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:37.199 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2024-04-17T10:16:37.557 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:37.566 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:37.566 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:38.187 INFO:teuthology.orchestra.run.smithi152.stdout:generic/164 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:16:38.195 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/164 2024-04-17T10:16:38.195 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/164 2024-04-17T10:16:38.195 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:38.201 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:38.220 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:38.220 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2024-04-17T10:16:38.581 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:38.592 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:38.592 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:38.882 INFO:teuthology.orchestra.run.smithi152.stdout:generic/165 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:16:38.890 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/165 2024-04-17T10:16:38.890 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/165 2024-04-17T10:16:38.890 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:38.897 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:38.917 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:38.917 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2024-04-17T10:16:39.297 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:39.307 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:39.307 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:39.573 INFO:teuthology.orchestra.run.smithi152.stdout:generic/166 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:16:39.582 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/166 2024-04-17T10:16:39.582 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/166 2024-04-17T10:16:39.582 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:39.588 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:39.609 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:39.609 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2024-04-17T10:16:39.994 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:40.006 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:40.006 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:40.290 INFO:teuthology.orchestra.run.smithi152.stdout:generic/167 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:16:40.298 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/167 2024-04-17T10:16:40.298 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/167 2024-04-17T10:16:40.298 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:40.304 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:40.325 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:40.325 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2024-04-17T10:16:40.693 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:40.704 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:40.704 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:40.970 INFO:teuthology.orchestra.run.smithi152.stdout:generic/168 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:16:40.978 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/168 2024-04-17T10:16:40.979 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/168 2024-04-17T10:16:40.979 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:40.986 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:41.008 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:41.008 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2024-04-17T10:16:41.384 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:41.394 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:41.395 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:41.698 INFO:teuthology.orchestra.run.smithi152.stdout:generic/169 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:16:41.706 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/169 2024-04-17T10:16:41.707 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/169 2024-04-17T10:16:41.707 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:41.713 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:41.733 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:41.734 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2024-04-17T10:16:42.129 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:42.139 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:42.139 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:42.422 INFO:teuthology.orchestra.run.smithi152.stdout:generic/170 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:16:42.431 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/170 2024-04-17T10:16:42.431 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/170 2024-04-17T10:16:42.431 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:42.437 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:42.457 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:42.457 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2024-04-17T10:16:42.821 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:42.831 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:42.831 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:43.134 INFO:teuthology.orchestra.run.smithi152.stdout:generic/171 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:16:43.142 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/171 2024-04-17T10:16:43.143 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/171 2024-04-17T10:16:43.143 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:43.149 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:43.168 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:43.168 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2024-04-17T10:16:43.542 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:43.552 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:43.552 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:43.828 INFO:teuthology.orchestra.run.smithi152.stdout:generic/172 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:16:43.836 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/172 2024-04-17T10:16:43.836 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/172 2024-04-17T10:16:43.836 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:43.842 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:43.862 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:43.863 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2024-04-17T10:16:44.242 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:44.252 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:44.252 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:44.535 INFO:teuthology.orchestra.run.smithi152.stdout:generic/173 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:16:44.543 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/173 2024-04-17T10:16:44.543 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/173 2024-04-17T10:16:44.544 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:44.550 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:44.604 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:44.605 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2024-04-17T10:16:44.973 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:44.984 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:44.984 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:45.289 INFO:teuthology.orchestra.run.smithi152.stdout:generic/174 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:16:45.298 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/174 2024-04-17T10:16:45.298 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/174 2024-04-17T10:16:45.298 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:45.304 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:45.325 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:45.326 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2024-04-17T10:16:45.699 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:45.709 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:45.709 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:45.979 INFO:teuthology.orchestra.run.smithi152.stdout:generic/175 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:16:45.987 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/175 2024-04-17T10:16:45.988 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/175 2024-04-17T10:16:45.988 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:45.994 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:46.015 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:46.016 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2024-04-17T10:16:46.386 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:46.396 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:46.396 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:46.667 INFO:teuthology.orchestra.run.smithi152.stdout:generic/176 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:16:46.675 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/176 2024-04-17T10:16:46.675 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/176 2024-04-17T10:16:46.675 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:46.681 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:46.702 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:46.702 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2024-04-17T10:16:47.072 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:47.082 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:47.082 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:47.506 INFO:teuthology.orchestra.run.smithi152.stdout:generic/177 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:16:47.514 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/177 2024-04-17T10:16:47.515 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/177 2024-04-17T10:16:47.515 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:47.521 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:47.542 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:47.542 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2024-04-17T10:16:47.901 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:47.911 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:47.911 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:48.285 INFO:teuthology.orchestra.run.smithi152.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-17T10:16:48.293 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/178 2024-04-17T10:16:48.293 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/178 2024-04-17T10:16:48.294 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:48.300 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:48.506 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:48.506 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2024-04-17T10:16:49.072 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:49.083 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:49.083 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:49.439 INFO:teuthology.orchestra.run.smithi152.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-17T10:16:49.447 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/179 2024-04-17T10:16:49.447 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/179 2024-04-17T10:16:49.447 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:49.453 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:49.480 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:49.480 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2024-04-17T10:16:50.202 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:50.212 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:50.212 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:50.570 INFO:teuthology.orchestra.run.smithi152.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-17T10:16:50.578 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/180 2024-04-17T10:16:50.578 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/180 2024-04-17T10:16:50.578 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:50.584 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:50.625 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:50.625 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2024-04-17T10:16:51.307 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:51.317 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:51.317 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:51.673 INFO:teuthology.orchestra.run.smithi152.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-17T10:16:51.679 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/181 2024-04-17T10:16:51.679 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/181 2024-04-17T10:16:51.679 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:51.686 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:51.722 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:51.722 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2024-04-17T10:16:52.405 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:52.415 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:52.415 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:52.795 INFO:teuthology.orchestra.run.smithi152.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-04-17T10:16:52.804 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/182 2024-04-17T10:16:52.804 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/182 2024-04-17T10:16:52.804 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:52.810 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:52.851 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:52.851 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2024-04-17T10:16:53.508 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:53.518 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:53.519 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:53.817 INFO:teuthology.orchestra.run.smithi152.stdout:generic/183 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:16:53.825 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/183 2024-04-17T10:16:53.825 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/183 2024-04-17T10:16:53.825 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:53.831 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:53.851 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:53.852 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2024-04-17T10:16:54.227 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:54.237 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:54.237 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:54.655 INFO:teuthology.orchestra.run.smithi152.stdout:generic/184 [failed, exit status 1]- output mismatch (see /tmp/tmp.pJW3k3pP3vxfstests-dev/results//generic/184.out.bad) 2024-04-17T10:16:54.661 INFO:teuthology.orchestra.run.smithi152.stdout: --- tests/generic/184.out 2024-04-17 08:48:08.545452190 +0000 2024-04-17T10:16:54.661 INFO:teuthology.orchestra.run.smithi152.stdout: +++ /tmp/tmp.pJW3k3pP3vxfstests-dev/results//generic/184.out.bad 2024-04-17 10:16:54.655086834 +0000 2024-04-17T10:16:54.661 INFO:teuthology.orchestra.run.smithi152.stdout: @@ -1 +1,2 @@ 2024-04-17T10:16:54.661 INFO:teuthology.orchestra.run.smithi152.stdout: QA output created by 184 2024-04-17T10:16:54.661 INFO:teuthology.orchestra.run.smithi152.stdout: +/tmp/tmp.pJW3k3pP3vxfstests-dev/tests/generic/184: line 23: /tmp/tmp.N9QxrNRIp4test/null: Permission denied 2024-04-17T10:16:54.666 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/184 2024-04-17T10:16:54.666 INFO:teuthology.orchestra.run.smithi152.stdout:Failures: generic/184 2024-04-17T10:16:54.666 INFO:teuthology.orchestra.run.smithi152.stdout:Failed 1 of 1 tests 2024-04-17T10:16:54.672 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:54.690 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T10:16:54.690 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-04-17T10:16:54.690 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-04-17T10:16:54.690 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2024-04-17T10:16:55.068 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:55.078 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:55.079 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:55.355 INFO:teuthology.orchestra.run.smithi152.stdout:generic/185 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:16:55.363 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/185 2024-04-17T10:16:55.364 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/185 2024-04-17T10:16:55.364 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:55.370 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:55.390 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:55.390 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2024-04-17T10:16:55.768 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:55.778 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:55.779 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:56.055 INFO:teuthology.orchestra.run.smithi152.stdout:generic/186 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:16:56.063 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/186 2024-04-17T10:16:56.063 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/186 2024-04-17T10:16:56.064 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:56.070 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:56.090 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:56.090 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2024-04-17T10:16:56.476 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:56.487 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:56.487 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:56.811 INFO:teuthology.orchestra.run.smithi152.stdout:generic/187 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:16:56.819 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/187 2024-04-17T10:16:56.819 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/187 2024-04-17T10:16:56.820 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:56.826 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:56.846 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:56.847 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2024-04-17T10:16:57.234 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:57.244 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:57.244 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:57.529 INFO:teuthology.orchestra.run.smithi152.stdout:generic/188 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:16:57.537 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/188 2024-04-17T10:16:57.537 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/188 2024-04-17T10:16:57.537 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:57.543 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:57.563 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:57.564 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2024-04-17T10:16:57.932 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:57.943 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:57.943 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:58.243 INFO:teuthology.orchestra.run.smithi152.stdout:generic/189 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:16:58.251 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/189 2024-04-17T10:16:58.252 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/189 2024-04-17T10:16:58.252 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:58.258 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:58.278 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:58.278 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2024-04-17T10:16:58.649 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:58.659 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:58.659 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:58.948 INFO:teuthology.orchestra.run.smithi152.stdout:generic/190 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:16:58.956 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/190 2024-04-17T10:16:58.957 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/190 2024-04-17T10:16:58.957 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:16:58.962 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:58.981 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:16:58.982 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2024-04-17T10:16:59.353 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:16:59.363 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:16:59.363 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:16:59.988 INFO:teuthology.orchestra.run.smithi152.stdout:generic/191 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:16:59.996 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/191 2024-04-17T10:16:59.996 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/191 2024-04-17T10:16:59.996 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:17:00.003 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:17:00.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:17:00.025 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2024-04-17T10:17:00.393 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:17:00.403 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:17:00.403 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:17:00.707 INFO:teuthology.orchestra.run.smithi152.stdout:generic/192 [not run] atime not maintained by ceph-fuse 2024-04-17T10:17:00.715 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/192 2024-04-17T10:17:00.715 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/192 2024-04-17T10:17:00.715 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:17:00.722 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:17:00.742 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:17:00.742 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2024-04-17T10:17:01.121 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:17:01.132 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:17:01.132 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:17:03.299 INFO:teuthology.orchestra.run.smithi152.stdout:generic/193 - output mismatch (see /tmp/tmp.pJW3k3pP3vxfstests-dev/results//generic/193.out.bad) 2024-04-17T10:17:03.304 INFO:teuthology.orchestra.run.smithi152.stdout: --- tests/generic/193.out 2024-04-17 08:48:08.545452190 +0000 2024-04-17T10:17:03.304 INFO:teuthology.orchestra.run.smithi152.stdout: +++ /tmp/tmp.pJW3k3pP3vxfstests-dev/results//generic/193.out.bad 2024-04-17 10:17:03.294987294 +0000 2024-04-17T10:17:03.304 INFO:teuthology.orchestra.run.smithi152.stdout: @@ -24,7 +24,6 @@ 2024-04-17T10:17:03.304 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:17:03.305 INFO:teuthology.orchestra.run.smithi152.stdout: user: chmod a+r on qa_user owned file (should succeed) 2024-04-17T10:17:03.305 INFO:teuthology.orchestra.run.smithi152.stdout: user: chmod a+r on root owned file (should fail) 2024-04-17T10:17:03.305 INFO:teuthology.orchestra.run.smithi152.stdout: -chmod: changing permissions of 'test.root': Operation not permitted 2024-04-17T10:17:03.305 INFO:teuthology.orchestra.run.smithi152.stdout: check that the sgid bit is cleared 2024-04-17T10:17:03.305 INFO:teuthology.orchestra.run.smithi152.stdout: -rw-rw-rw- 2024-04-17T10:17:03.305 INFO:teuthology.orchestra.run.smithi152.stdout: check that suid bit is not cleared 2024-04-17T10:17:03.310 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/193 2024-04-17T10:17:03.310 INFO:teuthology.orchestra.run.smithi152.stdout:Failures: generic/193 2024-04-17T10:17:03.310 INFO:teuthology.orchestra.run.smithi152.stdout:Failed 1 of 1 tests 2024-04-17T10:17:03.316 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:17:03.352 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T10:17:03.353 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-04-17T10:17:03.353 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-04-17T10:17:03.353 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2024-04-17T10:17:04.055 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:17:04.065 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:17:04.065 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:17:04.357 INFO:teuthology.orchestra.run.smithi152.stdout:generic/194 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:17:04.365 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/194 2024-04-17T10:17:04.366 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/194 2024-04-17T10:17:04.366 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:17:04.372 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:17:04.394 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:17:04.394 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2024-04-17T10:17:04.754 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:17:04.764 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:17:04.764 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:17:05.055 INFO:teuthology.orchestra.run.smithi152.stdout:generic/195 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:17:05.064 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/195 2024-04-17T10:17:05.064 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/195 2024-04-17T10:17:05.064 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:17:05.070 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:17:05.093 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:17:05.093 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2024-04-17T10:17:05.465 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:17:05.476 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:17:05.476 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:17:05.757 INFO:teuthology.orchestra.run.smithi152.stdout:generic/196 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:17:05.766 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/196 2024-04-17T10:17:05.766 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/196 2024-04-17T10:17:05.766 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:17:05.772 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:17:05.792 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:17:05.792 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2024-04-17T10:17:06.177 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:17:06.187 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:17:06.187 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:17:06.448 INFO:teuthology.orchestra.run.smithi152.stdout:generic/197 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:17:06.456 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/197 2024-04-17T10:17:06.457 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/197 2024-04-17T10:17:06.457 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:17:06.463 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:17:06.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:17:06.483 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2024-04-17T10:17:06.848 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:17:06.858 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:17:06.859 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:17:08.218 INFO:teuthology.orchestra.run.smithi152.stdout:generic/198 2s 2024-04-17T10:17:08.230 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/198 2024-04-17T10:17:08.231 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:17:08.236 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:17:08.258 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:17:08.258 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2024-04-17T10:17:08.979 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:17:08.990 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:17:08.991 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:17:09.301 INFO:teuthology.orchestra.run.smithi152.stdout:generic/199 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:17:09.309 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/199 2024-04-17T10:17:09.310 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/199 2024-04-17T10:17:09.310 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:17:09.316 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:17:09.336 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:17:09.336 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2024-04-17T10:17:09.728 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:17:09.739 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:17:09.739 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:17:10.036 INFO:teuthology.orchestra.run.smithi152.stdout:generic/200 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:17:10.044 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/200 2024-04-17T10:17:10.044 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/200 2024-04-17T10:17:10.044 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:17:10.050 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:17:10.071 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:17:10.071 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2024-04-17T10:17:10.426 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:17:10.437 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:17:10.437 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:17:10.776 INFO:teuthology.orchestra.run.smithi152.stdout:generic/201 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:17:10.784 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/201 2024-04-17T10:17:10.784 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/201 2024-04-17T10:17:10.784 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:17:10.790 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:17:10.849 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:17:10.849 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2024-04-17T10:17:11.221 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:17:11.231 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:17:11.231 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:17:11.517 INFO:teuthology.orchestra.run.smithi152.stdout:generic/202 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:17:11.525 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/202 2024-04-17T10:17:11.525 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/202 2024-04-17T10:17:11.525 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:17:11.531 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:17:11.552 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:17:11.552 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2024-04-17T10:17:11.924 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:17:11.934 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:17:11.934 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:17:12.210 INFO:teuthology.orchestra.run.smithi152.stdout:generic/203 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:17:12.217 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/203 2024-04-17T10:17:12.217 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/203 2024-04-17T10:17:12.218 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:17:12.224 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:17:12.244 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:17:12.244 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2024-04-17T10:17:12.627 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:17:12.638 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:17:12.638 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:17:14.359 INFO:teuthology.orchestra.run.smithi152.stdout:generic/204 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:17:14.369 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/204 2024-04-17T10:17:14.369 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/204 2024-04-17T10:17:14.370 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:17:14.375 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:17:14.397 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:17:14.397 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2024-04-17T10:17:14.780 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:17:14.790 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:17:14.790 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:17:15.066 INFO:teuthology.orchestra.run.smithi152.stdout:generic/205 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:17:15.075 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/205 2024-04-17T10:17:15.075 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/205 2024-04-17T10:17:15.075 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:17:15.081 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:17:15.101 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:17:15.102 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2024-04-17T10:17:15.479 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:17:15.489 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:17:15.489 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:17:15.771 INFO:teuthology.orchestra.run.smithi152.stdout:generic/206 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:17:15.779 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/206 2024-04-17T10:17:15.779 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/206 2024-04-17T10:17:15.779 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:17:15.785 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:17:15.806 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:17:15.806 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2024-04-17T10:17:16.184 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:17:16.194 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:17:16.194 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:17:37.327 INFO:teuthology.orchestra.run.smithi152.stdout:generic/207 21s 2024-04-17T10:17:37.340 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/207 2024-04-17T10:17:37.340 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:17:37.347 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:17:37.378 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:17:37.378 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2024-04-17T10:17:38.092 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:17:38.103 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:17:38.103 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:19:38.100 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:19:38.104 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:20:08.219 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:20:08.222 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:20:38.550 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:20:38.553 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:20:58.685 INFO:teuthology.orchestra.run.smithi152.stdout:generic/208 200s 2024-04-17T10:20:58.696 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/208 2024-04-17T10:20:58.697 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:20:58.702 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:20:58.720 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:20:58.721 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2024-04-17T10:20:59.402 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:20:59.413 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:20:59.413 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:08.618 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:21:08.621 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:21:09.689 INFO:teuthology.orchestra.run.smithi152.stdout:generic/209 [failed, exit status 1]- output mismatch (see /tmp/tmp.pJW3k3pP3vxfstests-dev/results//generic/209.out.bad) 2024-04-17T10:21:09.714 INFO:teuthology.orchestra.run.smithi152.stdout: --- tests/generic/209.out 2024-04-17 08:48:08.549452146 +0000 2024-04-17T10:21:09.714 INFO:teuthology.orchestra.run.smithi152.stdout: +++ /tmp/tmp.pJW3k3pP3vxfstests-dev/results//generic/209.out.bad 2024-04-17 10:21:09.668202437 +0000 2024-04-17T10:21:09.714 INFO:teuthology.orchestra.run.smithi152.stdout: @@ -1,2 +1,2 @@ 2024-04-17T10:21:09.714 INFO:teuthology.orchestra.run.smithi152.stdout: QA output created by 209 2024-04-17T10:21:09.714 INFO:teuthology.orchestra.run.smithi152.stdout: -test ran for 30 seconds without error 2024-04-17T10:21:09.715 INFO:teuthology.orchestra.run.smithi152.stdout: +reader found old byte at pos 4096 2024-04-17T10:21:09.715 INFO:teuthology.orchestra.run.smithi152.stdout: \ No newline at end of file 2024-04-17T10:21:09.726 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/209 2024-04-17T10:21:09.726 INFO:teuthology.orchestra.run.smithi152.stdout:Failures: generic/209 2024-04-17T10:21:09.726 INFO:teuthology.orchestra.run.smithi152.stdout:Failed 1 of 1 tests 2024-04-17T10:21:09.751 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:09.820 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T10:21:09.821 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-04-17T10:21:09.821 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-04-17T10:21:09.821 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2024-04-17T10:21:10.226 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:21:10.237 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:21:10.237 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:10.747 INFO:teuthology.orchestra.run.smithi152.stdout:generic/210 0s 2024-04-17T10:21:10.759 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/210 2024-04-17T10:21:10.759 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:21:10.765 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:10.802 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:21:10.802 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2024-04-17T10:21:11.435 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:21:11.446 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:21:11.446 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:12.245 INFO:teuthology.orchestra.run.smithi152.stdout:generic/211 1s 2024-04-17T10:21:12.258 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/211 2024-04-17T10:21:12.258 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:21:12.264 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:12.284 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:21:12.285 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2024-04-17T10:21:12.664 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:21:12.674 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:21:12.674 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:13.129 INFO:teuthology.orchestra.run.smithi152.stdout:generic/212 1s 2024-04-17T10:21:13.142 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/212 2024-04-17T10:21:13.142 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:21:13.148 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:13.168 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:21:13.169 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2024-04-17T10:21:13.536 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:21:13.546 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:21:13.546 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:14.158 INFO:teuthology.orchestra.run.smithi152.stdout:generic/213 - output mismatch (see /tmp/tmp.pJW3k3pP3vxfstests-dev/results//generic/213.out.bad) 2024-04-17T10:21:14.163 INFO:teuthology.orchestra.run.smithi152.stdout: --- tests/generic/213.out 2024-04-17 08:48:08.549452146 +0000 2024-04-17T10:21:14.163 INFO:teuthology.orchestra.run.smithi152.stdout: +++ /tmp/tmp.pJW3k3pP3vxfstests-dev/results//generic/213.out.bad 2024-04-17 10:21:14.156152431 +0000 2024-04-17T10:21:14.163 INFO:teuthology.orchestra.run.smithi152.stdout: @@ -1,4 +1,3 @@ 2024-04-17T10:21:14.163 INFO:teuthology.orchestra.run.smithi152.stdout: QA output created by 213 2024-04-17T10:21:14.163 INFO:teuthology.orchestra.run.smithi152.stdout: We should get: fallocate: No space left on device 2024-04-17T10:21:14.163 INFO:teuthology.orchestra.run.smithi152.stdout: Strangely, xfs_io sometimes says "Success" when something went wrong, FYI 2024-04-17T10:21:14.163 INFO:teuthology.orchestra.run.smithi152.stdout: -fallocate: No space left on device 2024-04-17T10:21:14.169 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/213 2024-04-17T10:21:14.169 INFO:teuthology.orchestra.run.smithi152.stdout:Failures: generic/213 2024-04-17T10:21:14.169 INFO:teuthology.orchestra.run.smithi152.stdout:Failed 1 of 1 tests 2024-04-17T10:21:14.175 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:14.219 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T10:21:14.220 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-04-17T10:21:14.220 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-04-17T10:21:14.220 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2024-04-17T10:21:14.895 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:21:14.905 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:21:14.905 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:15.740 INFO:teuthology.orchestra.run.smithi152.stdout:generic/214 1s 2024-04-17T10:21:15.758 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/214 2024-04-17T10:21:15.758 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:21:15.766 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:15.797 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:21:15.798 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2024-04-17T10:21:16.590 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:21:16.607 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:21:16.608 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:20.846 INFO:teuthology.orchestra.run.smithi152.stdout:generic/215 4s 2024-04-17T10:21:20.863 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/215 2024-04-17T10:21:20.863 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:21:20.872 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:20.905 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:21:20.905 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2024-04-17T10:21:21.416 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:21:21.432 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:21:21.433 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:21.863 INFO:teuthology.orchestra.run.smithi152.stdout:generic/216 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:21:21.875 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/216 2024-04-17T10:21:21.875 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/216 2024-04-17T10:21:21.875 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:21:21.885 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:21.913 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:21:21.913 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2024-04-17T10:21:22.446 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:21:22.461 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:21:22.461 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:22.852 INFO:teuthology.orchestra.run.smithi152.stdout:generic/217 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:21:22.866 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/217 2024-04-17T10:21:22.866 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/217 2024-04-17T10:21:22.866 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:21:22.875 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:22.906 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:21:22.906 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2024-04-17T10:21:23.423 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:21:23.443 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:21:23.443 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:23.843 INFO:teuthology.orchestra.run.smithi152.stdout:generic/218 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:21:23.857 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/218 2024-04-17T10:21:23.857 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/218 2024-04-17T10:21:23.857 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:21:23.869 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:23.907 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:21:23.907 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2024-04-17T10:21:24.420 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:21:24.434 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:21:24.434 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:24.831 INFO:teuthology.orchestra.run.smithi152.stdout:generic/219 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:21:24.841 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/219 2024-04-17T10:21:24.842 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/219 2024-04-17T10:21:24.842 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:21:24.851 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:24.880 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:21:24.880 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2024-04-17T10:21:25.386 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:21:25.403 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:21:25.403 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:25.789 INFO:teuthology.orchestra.run.smithi152.stdout:generic/220 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:21:25.799 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/220 2024-04-17T10:21:25.800 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/220 2024-04-17T10:21:25.800 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:21:25.808 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:25.840 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:21:25.841 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2024-04-17T10:21:26.338 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:21:26.350 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:21:26.350 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:27.848 INFO:teuthology.orchestra.run.smithi152.stdout:generic/221 1s 2024-04-17T10:21:27.870 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/221 2024-04-17T10:21:27.870 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:21:27.878 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:27.906 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:21:27.906 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2024-04-17T10:21:28.393 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:21:28.408 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:21:28.408 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:28.786 INFO:teuthology.orchestra.run.smithi152.stdout:generic/222 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:21:28.800 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/222 2024-04-17T10:21:28.800 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/222 2024-04-17T10:21:28.801 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:21:28.812 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:28.885 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:21:28.885 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2024-04-17T10:21:29.401 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:21:29.416 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:21:29.416 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:30.011 INFO:teuthology.orchestra.run.smithi152.stdout:generic/223 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:21:30.023 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/223 2024-04-17T10:21:30.024 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/223 2024-04-17T10:21:30.024 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:21:30.031 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:30.068 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:21:30.069 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2024-04-17T10:21:30.551 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:21:30.564 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:21:30.564 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:31.306 INFO:teuthology.orchestra.run.smithi152.stdout:generic/224 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:21:31.318 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/224 2024-04-17T10:21:31.318 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/224 2024-04-17T10:21:31.319 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:21:31.327 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:31.356 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:21:31.356 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2024-04-17T10:21:31.886 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:21:31.903 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:21:31.903 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:32.308 INFO:teuthology.orchestra.run.smithi152.stdout:generic/225 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:21:32.318 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/225 2024-04-17T10:21:32.318 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/225 2024-04-17T10:21:32.318 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:21:32.326 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:32.350 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:21:32.350 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2024-04-17T10:21:32.897 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:21:32.912 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:21:32.912 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:33.309 INFO:teuthology.orchestra.run.smithi152.stdout:generic/226 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:21:33.321 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/226 2024-04-17T10:21:33.321 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/226 2024-04-17T10:21:33.321 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:21:33.329 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:33.361 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:21:33.361 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2024-04-17T10:21:33.868 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:21:33.884 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:21:33.884 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:34.275 INFO:teuthology.orchestra.run.smithi152.stdout:generic/227 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:21:34.287 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/227 2024-04-17T10:21:34.287 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/227 2024-04-17T10:21:34.287 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:21:34.295 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:34.322 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:21:34.322 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2024-04-17T10:21:34.846 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:21:34.861 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:21:34.861 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:35.547 INFO:teuthology.orchestra.run.smithi152.stdout:generic/228 1s 2024-04-17T10:21:35.567 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/228 2024-04-17T10:21:35.567 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:21:35.576 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:35.628 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:21:35.628 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2024-04-17T10:21:36.410 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:21:36.426 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:21:36.426 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:36.811 INFO:teuthology.orchestra.run.smithi152.stdout:generic/229 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:21:36.820 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/229 2024-04-17T10:21:36.821 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/229 2024-04-17T10:21:36.821 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:21:36.828 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:36.859 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:21:36.860 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2024-04-17T10:21:37.375 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:21:37.388 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:21:37.388 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:37.785 INFO:teuthology.orchestra.run.smithi152.stdout:generic/230 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:21:37.795 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/230 2024-04-17T10:21:37.795 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/230 2024-04-17T10:21:37.795 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:21:37.805 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:37.837 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:21:37.837 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2024-04-17T10:21:38.360 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:21:38.375 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:21:38.375 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:38.671 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:21:38.675 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:21:38.788 INFO:teuthology.orchestra.run.smithi152.stdout:generic/231 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:21:38.799 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/231 2024-04-17T10:21:38.799 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/231 2024-04-17T10:21:38.799 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:21:38.809 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:38.839 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:21:38.839 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2024-04-17T10:21:39.371 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:21:39.388 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:21:39.388 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:39.790 INFO:teuthology.orchestra.run.smithi152.stdout:generic/232 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:21:39.804 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/232 2024-04-17T10:21:39.804 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/232 2024-04-17T10:21:39.804 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:21:39.814 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:39.843 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:21:39.843 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2024-04-17T10:21:40.379 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:21:40.395 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:21:40.395 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:40.752 INFO:teuthology.orchestra.run.smithi152.stdout:generic/233 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:21:40.766 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/233 2024-04-17T10:21:40.766 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/233 2024-04-17T10:21:40.767 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:21:40.775 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:40.806 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:21:40.806 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2024-04-17T10:21:41.328 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:21:41.342 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:21:41.342 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:41.731 INFO:teuthology.orchestra.run.smithi152.stdout:generic/234 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:21:41.743 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/234 2024-04-17T10:21:41.743 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/234 2024-04-17T10:21:41.743 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:21:41.754 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:41.827 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:21:41.827 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2024-04-17T10:21:42.383 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:21:42.400 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:21:42.401 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:42.775 INFO:teuthology.orchestra.run.smithi152.stdout:generic/235 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:21:42.789 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/235 2024-04-17T10:21:42.789 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/235 2024-04-17T10:21:42.789 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:21:42.798 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:42.855 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:21:42.855 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2024-04-17T10:21:43.365 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:21:43.376 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:21:43.376 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:44.979 INFO:teuthology.orchestra.run.smithi152.stdout:generic/236 1s 2024-04-17T10:21:44.997 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/236 2024-04-17T10:21:44.997 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:21:45.007 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:45.108 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:21:45.108 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2024-04-17T10:21:45.849 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:21:45.863 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:21:45.863 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:46.384 INFO:teuthology.orchestra.run.smithi152.stdout:generic/237 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-04-17T10:21:46.396 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/237 2024-04-17T10:21:46.396 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/237 2024-04-17T10:21:46.396 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:21:46.406 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:46.434 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:21:46.434 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2024-04-17T10:21:46.965 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:21:46.982 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:21:46.982 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:47.379 INFO:teuthology.orchestra.run.smithi152.stdout:generic/238 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:21:47.392 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/238 2024-04-17T10:21:47.392 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/238 2024-04-17T10:21:47.392 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:21:47.402 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:47.435 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:21:47.435 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2024-04-17T10:21:47.969 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:21:47.982 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:21:47.982 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:48.466 INFO:teuthology.orchestra.run.smithi152.stdout:generic/239 [not run] Sparse files are not supported or do not work as expected 2024-04-17T10:21:48.480 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/239 2024-04-17T10:21:48.480 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/239 2024-04-17T10:21:48.480 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:21:48.487 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:48.517 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:21:48.517 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2024-04-17T10:21:48.997 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:21:49.014 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:21:49.014 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:49.470 INFO:teuthology.orchestra.run.smithi152.stdout:generic/240 [not run] Sparse files are not supported or do not work as expected 2024-04-17T10:21:49.484 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/240 2024-04-17T10:21:49.484 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/240 2024-04-17T10:21:49.484 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:21:49.495 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:21:49.527 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:21:49.527 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2024-04-17T10:21:50.068 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:21:50.081 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:21:50.081 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:22:08.733 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:22:08.738 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:22:08.782 INFO:tasks.ceph.osd.1.smithi152.stderr:2024-04-17T10:22:08.783+0000 7fb553c00640 -1 Fail to open '/proc/214902/cmdline' error = (2) No such file or directory 2024-04-17T10:22:08.782 INFO:tasks.ceph.osd.1.smithi152.stderr:2024-04-17T10:22:08.783+0000 7fb553c00640 -1 received signal: Hangup from (PID: 214902) UID: 0 2024-04-17T10:22:08.782 INFO:tasks.ceph.osd.0.smithi152.stderr:2024-04-17T10:22:08.783+0000 7f2076000640 -1 Fail to open '/proc/214902/cmdline' error = (2) No such file or directory 2024-04-17T10:22:08.782 INFO:tasks.ceph.osd.0.smithi152.stderr:2024-04-17T10:22:08.783+0000 7f2076000640 -1 received signal: Hangup from (PID: 214902) UID: 0 2024-04-17T10:22:08.783 INFO:tasks.ceph.osd.2.smithi152.stderr:2024-04-17T10:22:08.783+0000 7f9821400640 -1 Fail to open '/proc/214902/cmdline' error = (2) No such file or directory 2024-04-17T10:22:08.783 INFO:tasks.ceph.osd.2.smithi152.stderr:2024-04-17T10:22:08.783+0000 7f9821400640 -1 received signal: Hangup from (PID: 214902) UID: 0 2024-04-17T10:22:08.783 INFO:tasks.ceph.osd.3.smithi152.stderr:2024-04-17T10:22:08.783+0000 7f2cca800640 -1 Fail to open '/proc/214902/cmdline' error = (2) No such file or directory 2024-04-17T10:22:08.783 INFO:tasks.ceph.osd.3.smithi152.stderr:2024-04-17T10:22:08.783+0000 7f2cca800640 -1 received signal: Hangup from (PID: 214902) UID: 0 2024-04-17T10:23:04.447 INFO:teuthology.orchestra.run.smithi152.stdout:generic/241 74s 2024-04-17T10:23:06.122 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/241 2024-04-17T10:23:06.122 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:23:06.132 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:23:06.168 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:23:06.169 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2024-04-17T10:23:06.928 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:23:06.942 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:23:06.942 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:23:07.908 INFO:teuthology.orchestra.run.smithi152.stdout:generic/242 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:23:07.919 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/242 2024-04-17T10:23:07.919 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/242 2024-04-17T10:23:07.919 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:23:07.927 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:23:07.961 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:23:07.961 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2024-04-17T10:23:08.472 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:23:08.487 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:23:08.488 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:23:09.296 INFO:teuthology.orchestra.run.smithi152.stdout:generic/243 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:23:09.308 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/243 2024-04-17T10:23:09.308 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/243 2024-04-17T10:23:09.308 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:23:09.317 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:23:09.350 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:23:09.350 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2024-04-17T10:23:09.878 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:23:09.892 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:23:09.893 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:23:10.243 INFO:teuthology.orchestra.run.smithi152.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-04-17T10:23:10.252 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/244 2024-04-17T10:23:10.252 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/244 2024-04-17T10:23:10.252 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:23:10.258 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:23:10.277 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:23:10.277 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2024-04-17T10:23:10.763 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:23:10.784 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:23:10.784 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:23:11.465 INFO:teuthology.orchestra.run.smithi152.stdout:generic/245 1s 2024-04-17T10:23:11.484 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/245 2024-04-17T10:23:11.484 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:23:11.494 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:23:11.573 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:23:11.573 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2024-04-17T10:23:12.414 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:23:12.430 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:23:12.431 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:23:12.970 INFO:teuthology.orchestra.run.smithi152.stdout:generic/246 0s 2024-04-17T10:23:12.988 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/246 2024-04-17T10:23:12.988 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:23:13.002 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:23:13.040 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:23:13.040 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2024-04-17T10:23:13.931 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:23:13.948 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:23:13.949 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:24:08.009 INFO:teuthology.orchestra.run.smithi152.stdout:generic/247 54s 2024-04-17T10:24:08.116 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/247 2024-04-17T10:24:08.116 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:24:08.128 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:24:08.159 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:24:08.159 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2024-04-17T10:24:09.599 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:24:09.619 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:24:09.619 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:24:10.224 INFO:teuthology.orchestra.run.smithi152.stdout:generic/248 1s 2024-04-17T10:24:10.245 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/248 2024-04-17T10:24:10.245 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:24:10.258 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:24:10.293 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:24:10.293 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2024-04-17T10:24:10.896 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:24:10.914 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:24:10.914 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:24:15.745 INFO:teuthology.orchestra.run.smithi152.stdout:generic/249 5s 2024-04-17T10:24:15.765 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/249 2024-04-17T10:24:15.765 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:24:15.782 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:24:15.818 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:24:15.819 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2024-04-17T10:24:16.878 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:24:16.895 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:24:16.895 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:24:17.426 INFO:teuthology.orchestra.run.smithi152.stdout:generic/250 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:24:17.436 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/250 2024-04-17T10:24:17.436 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/250 2024-04-17T10:24:17.436 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:24:17.445 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:24:17.476 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:24:17.477 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2024-04-17T10:24:18.100 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:24:18.114 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:24:18.114 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:24:20.364 INFO:teuthology.orchestra.run.smithi152.stdout:generic/251 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:24:20.374 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/251 2024-04-17T10:24:20.374 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/251 2024-04-17T10:24:20.374 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:24:20.381 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:24:20.400 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:24:20.400 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2024-04-17T10:24:20.874 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:24:20.888 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:24:20.889 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:24:21.483 INFO:teuthology.orchestra.run.smithi152.stdout:generic/252 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:24:21.498 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/252 2024-04-17T10:24:21.498 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/252 2024-04-17T10:24:21.498 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:24:21.508 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:24:21.588 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:24:21.588 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2024-04-17T10:24:22.154 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:24:22.171 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:24:22.171 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:24:22.672 INFO:teuthology.orchestra.run.smithi152.stdout:generic/253 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:24:22.690 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/253 2024-04-17T10:24:22.690 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/253 2024-04-17T10:24:22.690 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:24:22.701 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:24:22.736 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:24:22.736 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2024-04-17T10:24:23.309 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:24:23.324 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:24:23.324 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:24:23.771 INFO:teuthology.orchestra.run.smithi152.stdout:generic/254 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:24:23.785 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/254 2024-04-17T10:24:23.785 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/254 2024-04-17T10:24:23.785 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:24:23.797 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:24:23.832 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:24:23.832 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2024-04-17T10:24:24.519 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:24:24.535 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:24:24.535 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:24:27.705 INFO:teuthology.orchestra.run.smithi152.stdout:generic/255 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-04-17T10:24:27.716 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/255 2024-04-17T10:24:27.716 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/255 2024-04-17T10:24:27.717 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:24:27.725 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:24:27.759 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:24:27.759 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2024-04-17T10:24:28.937 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:24:28.953 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:24:28.954 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:24:32.405 INFO:teuthology.orchestra.run.smithi152.stdout:generic/256 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:24:32.419 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/256 2024-04-17T10:24:32.419 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/256 2024-04-17T10:24:32.419 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:24:32.462 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:24:32.518 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:24:32.518 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2024-04-17T10:24:33.570 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:24:33.585 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:24:33.586 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:24:36.483 INFO:teuthology.orchestra.run.smithi152.stdout:generic/257 3s 2024-04-17T10:24:36.545 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/257 2024-04-17T10:24:36.545 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:24:36.556 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:24:36.629 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:24:36.629 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2024-04-17T10:24:37.976 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:24:37.995 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:24:37.995 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:24:38.639 INFO:teuthology.orchestra.run.smithi152.stdout:generic/258 [failed, exit status 1]- output mismatch (see /tmp/tmp.pJW3k3pP3vxfstests-dev/results//generic/258.out.bad) 2024-04-17T10:24:38.651 INFO:teuthology.orchestra.run.smithi152.stdout: --- tests/generic/258.out 2024-04-17 08:48:08.553452099 +0000 2024-04-17T10:24:38.651 INFO:teuthology.orchestra.run.smithi152.stdout: +++ /tmp/tmp.pJW3k3pP3vxfstests-dev/results//generic/258.out.bad 2024-04-17 10:24:38.633891543 +0000 2024-04-17T10:24:38.651 INFO:teuthology.orchestra.run.smithi152.stdout: @@ -1,5 +1,6 @@ 2024-04-17T10:24:38.651 INFO:teuthology.orchestra.run.smithi152.stdout: QA output created by 258 2024-04-17T10:24:38.651 INFO:teuthology.orchestra.run.smithi152.stdout: Creating file with timestamp of Jan 1, 1960 2024-04-17T10:24:38.651 INFO:teuthology.orchestra.run.smithi152.stdout: Testing for negative seconds since epoch 2024-04-17T10:24:38.651 INFO:teuthology.orchestra.run.smithi152.stdout: -Remounting to flush cache 2024-04-17T10:24:38.651 INFO:teuthology.orchestra.run.smithi152.stdout: -Testing for negative seconds since epoch 2024-04-17T10:24:38.652 INFO:teuthology.orchestra.run.smithi152.stdout: +Timestamp wrapped: 3979351756 2024-04-17T10:24:38.652 INFO:teuthology.orchestra.run.smithi152.stdout: +Timestamp wrapped 2024-04-17T10:24:38.652 INFO:teuthology.orchestra.run.smithi152.stdout: +(see /tmp/tmp.pJW3k3pP3vxfstests-dev/results//generic/258.full for details) 2024-04-17T10:24:38.661 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/258 2024-04-17T10:24:38.661 INFO:teuthology.orchestra.run.smithi152.stdout:Failures: generic/258 2024-04-17T10:24:38.661 INFO:teuthology.orchestra.run.smithi152.stdout:Failed 1 of 1 tests 2024-04-17T10:24:38.670 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:24:38.695 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T10:24:38.732 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-04-17T10:24:38.732 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-04-17T10:24:38.732 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2024-04-17T10:24:39.339 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:24:39.357 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:24:39.357 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:24:39.838 INFO:teuthology.orchestra.run.smithi152.stdout:generic/259 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:24:39.851 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/259 2024-04-17T10:24:39.852 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/259 2024-04-17T10:24:39.852 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:24:39.862 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:24:39.925 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:24:39.926 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2024-04-17T10:24:40.485 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:24:40.501 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:24:40.502 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:24:41.017 INFO:teuthology.orchestra.run.smithi152.stdout:generic/260 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:24:41.031 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/260 2024-04-17T10:24:41.033 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/260 2024-04-17T10:24:41.033 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:24:41.044 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:24:41.083 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:24:41.084 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2024-04-17T10:24:41.669 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:24:41.681 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:24:41.682 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:24:42.159 INFO:teuthology.orchestra.run.smithi152.stdout:generic/261 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:24:42.171 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/261 2024-04-17T10:24:42.171 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/261 2024-04-17T10:24:42.172 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:24:42.182 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:24:42.223 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:24:42.223 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2024-04-17T10:24:42.799 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:24:42.813 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:24:42.813 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:24:43.276 INFO:teuthology.orchestra.run.smithi152.stdout:generic/262 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:24:43.293 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/262 2024-04-17T10:24:43.293 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/262 2024-04-17T10:24:43.293 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:24:43.300 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:24:43.334 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:24:43.334 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2024-04-17T10:24:43.955 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:24:43.969 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:24:43.970 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:26:10.378 INFO:teuthology.orchestra.run.smithi152.stdout:generic/263 86s 2024-04-17T10:26:10.393 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/263 2024-04-17T10:26:10.393 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:26:10.396 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:26:10.438 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:26:10.439 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2024-04-17T10:26:11.113 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:26:11.123 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:26:11.124 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:26:11.432 INFO:teuthology.orchestra.run.smithi152.stdout:generic/264 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:26:11.439 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/264 2024-04-17T10:26:11.440 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/264 2024-04-17T10:26:11.440 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:26:11.446 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:26:11.466 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:26:11.466 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2024-04-17T10:26:11.839 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:26:11.849 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:26:11.849 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:26:12.188 INFO:teuthology.orchestra.run.smithi152.stdout:generic/265 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:26:12.196 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/265 2024-04-17T10:26:12.196 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/265 2024-04-17T10:26:12.196 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:26:12.202 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:26:12.222 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:26:12.222 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2024-04-17T10:26:12.571 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:26:12.581 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:26:12.581 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:26:12.879 INFO:teuthology.orchestra.run.smithi152.stdout:generic/266 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:26:12.887 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/266 2024-04-17T10:26:12.887 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/266 2024-04-17T10:26:12.887 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:26:12.893 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:26:12.913 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:26:12.913 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2024-04-17T10:26:13.287 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:26:13.298 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:26:13.298 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:26:13.579 INFO:teuthology.orchestra.run.smithi152.stdout:generic/267 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:26:13.587 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/267 2024-04-17T10:26:13.587 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/267 2024-04-17T10:26:13.588 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:26:13.593 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:26:13.614 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:26:13.614 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2024-04-17T10:26:13.979 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:26:13.989 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:26:13.990 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:26:14.282 INFO:teuthology.orchestra.run.smithi152.stdout:generic/268 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:26:14.287 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/268 2024-04-17T10:26:14.287 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/268 2024-04-17T10:26:14.287 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:26:14.293 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:26:14.313 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:26:14.314 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2024-04-17T10:26:14.673 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:26:14.682 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:26:14.682 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:26:14.953 INFO:teuthology.orchestra.run.smithi152.stdout:generic/269 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:26:14.962 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/269 2024-04-17T10:26:14.962 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/269 2024-04-17T10:26:14.962 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:26:14.968 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:26:14.987 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:26:14.987 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2024-04-17T10:26:15.332 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:26:15.342 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:26:15.342 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:26:15.645 INFO:teuthology.orchestra.run.smithi152.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-04-17T10:26:15.653 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/270 2024-04-17T10:26:15.653 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/270 2024-04-17T10:26:15.653 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:26:15.659 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:26:15.678 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:26:15.678 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2024-04-17T10:26:16.031 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:26:16.041 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:26:16.041 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:26:16.347 INFO:teuthology.orchestra.run.smithi152.stdout:generic/271 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:26:16.355 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/271 2024-04-17T10:26:16.355 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/271 2024-04-17T10:26:16.355 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:26:16.361 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:26:16.381 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:26:16.381 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2024-04-17T10:26:16.753 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:26:16.764 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:26:16.764 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:26:17.077 INFO:teuthology.orchestra.run.smithi152.stdout:generic/272 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:26:17.085 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/272 2024-04-17T10:26:17.085 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/272 2024-04-17T10:26:17.086 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:26:17.091 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:26:17.111 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:26:17.111 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2024-04-17T10:26:17.468 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:26:17.478 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:26:17.478 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:26:17.745 INFO:teuthology.orchestra.run.smithi152.stdout:generic/273 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:26:17.753 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/273 2024-04-17T10:26:17.753 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/273 2024-04-17T10:26:17.753 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:26:17.759 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:26:17.779 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:26:17.780 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2024-04-17T10:26:18.132 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:26:18.142 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:26:18.142 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:26:18.420 INFO:teuthology.orchestra.run.smithi152.stdout:generic/274 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:26:18.428 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/274 2024-04-17T10:26:18.428 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/274 2024-04-17T10:26:18.428 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:26:18.434 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:26:18.453 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:26:18.453 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2024-04-17T10:26:18.817 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:26:18.827 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:26:18.828 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:26:19.087 INFO:teuthology.orchestra.run.smithi152.stdout:generic/275 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:26:19.095 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/275 2024-04-17T10:26:19.095 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/275 2024-04-17T10:26:19.095 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:26:19.101 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:26:19.120 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:26:19.121 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2024-04-17T10:26:19.475 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:26:19.485 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:26:19.485 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:26:19.787 INFO:teuthology.orchestra.run.smithi152.stdout:generic/276 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:26:19.795 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/276 2024-04-17T10:26:19.795 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/276 2024-04-17T10:26:19.795 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:26:19.801 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:26:19.821 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:26:19.821 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2024-04-17T10:26:20.163 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:26:20.173 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:26:20.174 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:26:20.458 INFO:teuthology.orchestra.run.smithi152.stdout:generic/277 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:26:20.466 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/277 2024-04-17T10:26:20.466 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/277 2024-04-17T10:26:20.467 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:26:20.472 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:26:20.491 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:26:20.492 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2024-04-17T10:26:20.845 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:26:20.854 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:26:20.854 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:26:21.151 INFO:teuthology.orchestra.run.smithi152.stdout:generic/278 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:26:21.159 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/278 2024-04-17T10:26:21.159 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/278 2024-04-17T10:26:21.159 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:26:21.165 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:26:21.184 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:26:21.185 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2024-04-17T10:26:21.528 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:26:21.538 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:26:21.538 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:26:21.831 INFO:teuthology.orchestra.run.smithi152.stdout:generic/279 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:26:21.839 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/279 2024-04-17T10:26:21.839 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/279 2024-04-17T10:26:21.839 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:26:21.845 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:26:21.864 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:26:21.864 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2024-04-17T10:26:22.214 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:26:22.225 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:26:22.225 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:26:22.531 INFO:teuthology.orchestra.run.smithi152.stdout:generic/280 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:26:22.539 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/280 2024-04-17T10:26:22.539 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/280 2024-04-17T10:26:22.539 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:26:22.545 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:26:22.564 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:26:22.564 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2024-04-17T10:26:22.937 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:26:22.948 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:26:22.948 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:26:23.237 INFO:teuthology.orchestra.run.smithi152.stdout:generic/281 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:26:23.245 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/281 2024-04-17T10:26:23.245 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/281 2024-04-17T10:26:23.245 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:26:23.251 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:26:23.270 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:26:23.270 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2024-04-17T10:26:23.607 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:26:23.617 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:26:23.617 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:26:23.913 INFO:teuthology.orchestra.run.smithi152.stdout:generic/282 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:26:23.921 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/282 2024-04-17T10:26:23.921 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/282 2024-04-17T10:26:23.921 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:26:23.927 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:26:23.947 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:26:23.947 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2024-04-17T10:26:24.323 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:26:24.334 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:26:24.334 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:26:24.622 INFO:teuthology.orchestra.run.smithi152.stdout:generic/283 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:26:24.630 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/283 2024-04-17T10:26:24.630 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/283 2024-04-17T10:26:24.630 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:26:24.636 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:26:24.655 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:26:24.655 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2024-04-17T10:26:25.009 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:26:25.019 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:26:25.019 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:26:25.304 INFO:teuthology.orchestra.run.smithi152.stdout:generic/284 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:26:25.312 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/284 2024-04-17T10:26:25.312 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/284 2024-04-17T10:26:25.312 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:26:25.318 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:26:25.337 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:26:25.338 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2024-04-17T10:26:25.690 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:26:25.701 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:26:25.701 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:26:27.928 INFO:teuthology.orchestra.run.smithi152.stdout:generic/285 2s 2024-04-17T10:26:27.940 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/285 2024-04-17T10:26:27.940 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:26:27.946 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:26:28.116 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:26:28.116 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2024-04-17T10:26:28.658 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:26:28.668 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:26:28.668 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:26:38.501 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:26:38.506 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:27:08.586 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:27:08.590 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:27:20.110 INFO:teuthology.orchestra.run.smithi152.stdout:generic/286 52s 2024-04-17T10:27:20.122 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/286 2024-04-17T10:27:20.122 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:27:20.128 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:27:20.149 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:27:20.149 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2024-04-17T10:27:20.823 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:27:20.834 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:27:20.834 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:27:21.205 INFO:teuthology.orchestra.run.smithi152.stdout:generic/287 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:27:21.213 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/287 2024-04-17T10:27:21.213 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/287 2024-04-17T10:27:21.214 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:27:21.220 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:27:21.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:27:21.239 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2024-04-17T10:27:21.596 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:27:21.606 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:27:21.606 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:27:21.883 INFO:teuthology.orchestra.run.smithi152.stdout:generic/288 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:27:21.891 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/288 2024-04-17T10:27:21.891 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/288 2024-04-17T10:27:21.891 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:27:21.897 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:27:21.916 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:27:21.917 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2024-04-17T10:27:22.293 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:27:22.304 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:27:22.304 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:27:22.579 INFO:teuthology.orchestra.run.smithi152.stdout:generic/289 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:27:22.587 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/289 2024-04-17T10:27:22.587 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/289 2024-04-17T10:27:22.587 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:27:22.593 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:27:22.612 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:27:22.613 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2024-04-17T10:27:22.983 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:27:22.993 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:27:22.994 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:27:23.258 INFO:teuthology.orchestra.run.smithi152.stdout:generic/290 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:27:23.266 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/290 2024-04-17T10:27:23.267 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/290 2024-04-17T10:27:23.267 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:27:23.273 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:27:23.292 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:27:23.293 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2024-04-17T10:27:23.640 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:27:23.651 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:27:23.651 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:27:23.922 INFO:teuthology.orchestra.run.smithi152.stdout:generic/291 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:27:23.930 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/291 2024-04-17T10:27:23.930 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/291 2024-04-17T10:27:23.930 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:27:23.936 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:27:23.956 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:27:23.956 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2024-04-17T10:27:24.329 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:27:24.339 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:27:24.339 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:27:24.620 INFO:teuthology.orchestra.run.smithi152.stdout:generic/292 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:27:24.628 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/292 2024-04-17T10:27:24.629 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/292 2024-04-17T10:27:24.629 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:27:24.634 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:27:24.654 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:27:24.654 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2024-04-17T10:27:25.016 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:27:25.026 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:27:25.026 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:27:25.311 INFO:teuthology.orchestra.run.smithi152.stdout:generic/293 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:27:25.319 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/293 2024-04-17T10:27:25.319 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/293 2024-04-17T10:27:25.319 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:27:25.325 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:27:25.344 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:27:25.345 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2024-04-17T10:27:25.696 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:27:25.706 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:27:25.706 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:27:25.973 INFO:teuthology.orchestra.run.smithi152.stdout:generic/294 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:27:25.981 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/294 2024-04-17T10:27:25.981 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/294 2024-04-17T10:27:25.981 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:27:25.987 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:27:26.006 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:27:26.006 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2024-04-17T10:27:26.360 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:27:26.370 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:27:26.371 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:27:26.645 INFO:teuthology.orchestra.run.smithi152.stdout:generic/295 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:27:26.654 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/295 2024-04-17T10:27:26.654 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/295 2024-04-17T10:27:26.654 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:27:26.660 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:27:26.679 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:27:26.679 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2024-04-17T10:27:27.031 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:27:27.041 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:27:27.041 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:27:27.315 INFO:teuthology.orchestra.run.smithi152.stdout:generic/296 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:27:27.322 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/296 2024-04-17T10:27:27.323 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/296 2024-04-17T10:27:27.323 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:27:27.329 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:27:27.349 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:27:27.349 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2024-04-17T10:27:27.735 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:27:27.746 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:27:27.746 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:27:28.016 INFO:teuthology.orchestra.run.smithi152.stdout:generic/297 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:27:28.024 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/297 2024-04-17T10:27:28.024 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/297 2024-04-17T10:27:28.024 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:27:28.030 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:27:28.049 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:27:28.049 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2024-04-17T10:27:28.421 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:27:28.431 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:27:28.432 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:27:28.744 INFO:teuthology.orchestra.run.smithi152.stdout:generic/298 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:27:28.752 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/298 2024-04-17T10:27:28.752 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/298 2024-04-17T10:27:28.752 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:27:28.758 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:27:28.777 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:27:28.777 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2024-04-17T10:27:29.132 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:27:29.142 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:27:29.142 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:27:29.425 INFO:teuthology.orchestra.run.smithi152.stdout:generic/299 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:27:29.434 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/299 2024-04-17T10:27:29.434 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/299 2024-04-17T10:27:29.434 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:27:29.442 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:27:29.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:27:29.459 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2024-04-17T10:27:29.834 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:27:29.844 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:27:29.844 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:27:30.115 INFO:teuthology.orchestra.run.smithi152.stdout:generic/300 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:27:30.122 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/300 2024-04-17T10:27:30.123 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/300 2024-04-17T10:27:30.123 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:27:30.129 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:27:30.148 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:27:30.148 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2024-04-17T10:27:30.505 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:27:30.515 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:27:30.516 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:27:30.787 INFO:teuthology.orchestra.run.smithi152.stdout:generic/301 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:27:30.795 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/301 2024-04-17T10:27:30.795 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/301 2024-04-17T10:27:30.795 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:27:30.801 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:27:30.821 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:27:30.821 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2024-04-17T10:27:31.175 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:27:31.185 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:27:31.185 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:27:31.457 INFO:teuthology.orchestra.run.smithi152.stdout:generic/302 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:27:31.465 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/302 2024-04-17T10:27:31.465 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/302 2024-04-17T10:27:31.466 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:27:31.471 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:27:31.490 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:27:31.491 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2024-04-17T10:27:31.846 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:27:31.857 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:27:31.857 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:27:32.191 INFO:teuthology.orchestra.run.smithi152.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-17T10:27:32.198 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/303 2024-04-17T10:27:32.198 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/303 2024-04-17T10:27:32.199 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:27:32.204 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:27:32.240 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:27:32.240 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2024-04-17T10:27:32.867 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:27:32.878 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:27:32.878 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:27:33.215 INFO:teuthology.orchestra.run.smithi152.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-04-17T10:27:33.223 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/304 2024-04-17T10:27:33.223 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/304 2024-04-17T10:27:33.223 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:27:33.229 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:27:33.390 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:27:33.390 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2024-04-17T10:27:33.943 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:27:33.953 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:27:33.954 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:27:34.226 INFO:teuthology.orchestra.run.smithi152.stdout:generic/305 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:27:34.234 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/305 2024-04-17T10:27:34.234 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/305 2024-04-17T10:27:34.234 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:27:34.240 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:27:34.259 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:27:34.260 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2024-04-17T10:27:34.604 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:27:34.614 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:27:34.614 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:27:34.893 INFO:teuthology.orchestra.run.smithi152.stdout:generic/306 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:27:34.901 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/306 2024-04-17T10:27:34.901 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/306 2024-04-17T10:27:34.901 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:27:34.907 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:27:34.927 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:27:34.927 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2024-04-17T10:27:35.279 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:27:35.290 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:27:35.290 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:27:35.560 INFO:teuthology.orchestra.run.smithi152.stdout:generic/307 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:27:35.568 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/307 2024-04-17T10:27:35.568 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/307 2024-04-17T10:27:35.568 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:27:35.574 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:27:35.593 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:27:35.594 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2024-04-17T10:27:35.977 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:27:35.990 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:27:35.990 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:27:36.313 INFO:teuthology.orchestra.run.smithi152.stdout:generic/308 0s 2024-04-17T10:27:36.326 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/308 2024-04-17T10:27:36.326 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:27:36.332 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:27:36.351 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:27:36.351 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2024-04-17T10:27:36.716 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:27:36.726 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:27:36.726 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:27:38.113 INFO:teuthology.orchestra.run.smithi152.stdout:generic/309 2s 2024-04-17T10:27:38.125 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/309 2024-04-17T10:27:38.125 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:27:38.132 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:27:38.327 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:27:38.328 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2024-04-17T10:27:38.666 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:27:38.669 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:27:38.823 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:27:38.833 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:27:38.833 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:28:08.737 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:28:08.742 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:28:38.800 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:28:38.804 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:29:07.677 INFO:teuthology.orchestra.run.smithi152.stdout:generic/310 89s 2024-04-17T10:29:07.699 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/310 2024-04-17T10:29:07.699 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:29:07.705 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:29:07.752 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:29:07.752 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2024-04-17T10:29:08.469 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:29:08.489 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:29:08.490 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:29:08.847 INFO:teuthology.orchestra.run.smithi152.stdout:generic/311 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:29:08.855 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/311 2024-04-17T10:29:08.855 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/311 2024-04-17T10:29:08.855 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:29:08.861 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:29:08.882 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:29:08.882 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2024-04-17T10:29:09.234 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:29:09.244 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:29:09.245 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:29:09.497 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:29:09.500 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:29:09.572 INFO:teuthology.orchestra.run.smithi152.stdout:generic/312 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:29:09.580 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/312 2024-04-17T10:29:09.580 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/312 2024-04-17T10:29:09.580 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:29:09.586 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:29:09.605 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:29:09.606 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2024-04-17T10:29:10.003 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:29:10.013 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:29:10.014 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:29:14.375 INFO:teuthology.orchestra.run.smithi152.stdout:generic/313 4s 2024-04-17T10:29:14.389 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/313 2024-04-17T10:29:14.389 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:29:14.395 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:29:14.456 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:29:14.457 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2024-04-17T10:29:14.830 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:29:14.841 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:29:14.841 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:29:15.635 INFO:teuthology.orchestra.run.smithi152.stdout:generic/314 1s 2024-04-17T10:29:15.648 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/314 2024-04-17T10:29:15.648 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:29:15.653 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:29:15.673 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:29:15.674 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2024-04-17T10:29:16.039 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:29:16.050 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:29:16.050 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:29:17.849 INFO:teuthology.orchestra.run.smithi152.stdout:generic/315 1s 2024-04-17T10:29:17.861 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/315 2024-04-17T10:29:17.861 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:29:17.868 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:29:18.094 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:29:18.095 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2024-04-17T10:29:18.583 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:29:18.594 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:29:18.594 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:29:20.017 INFO:teuthology.orchestra.run.smithi152.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-04-17T10:29:20.026 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/316 2024-04-17T10:29:20.026 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/316 2024-04-17T10:29:20.026 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:29:20.032 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:29:20.066 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:29:20.066 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2024-04-17T10:29:20.727 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:29:20.737 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:29:20.737 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:29:21.002 INFO:teuthology.orchestra.run.smithi152.stdout:generic/317 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:29:21.010 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/317 2024-04-17T10:29:21.010 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/317 2024-04-17T10:29:21.010 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:29:21.016 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:29:21.034 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:29:21.035 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2024-04-17T10:29:21.387 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:29:21.397 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:29:21.398 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:29:21.677 INFO:teuthology.orchestra.run.smithi152.stdout:generic/318 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:29:21.685 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/318 2024-04-17T10:29:21.685 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/318 2024-04-17T10:29:21.685 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:29:21.690 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:29:21.710 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:29:21.710 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2024-04-17T10:29:22.072 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:29:22.082 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:29:22.082 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:29:22.427 INFO:teuthology.orchestra.run.smithi152.stdout:generic/319 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-04-17T10:29:22.436 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/319 2024-04-17T10:29:22.436 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/319 2024-04-17T10:29:22.436 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:29:22.442 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:29:22.461 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:29:22.461 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2024-04-17T10:29:22.839 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:29:22.849 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:29:22.849 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:29:23.122 INFO:teuthology.orchestra.run.smithi152.stdout:generic/320 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:29:23.129 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/320 2024-04-17T10:29:23.129 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/320 2024-04-17T10:29:23.129 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:29:23.135 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:29:23.156 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:29:23.156 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2024-04-17T10:29:23.524 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:29:23.535 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:29:23.535 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:29:23.817 INFO:teuthology.orchestra.run.smithi152.stdout:generic/321 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:29:23.825 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/321 2024-04-17T10:29:23.825 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/321 2024-04-17T10:29:23.825 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:29:23.831 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:29:23.891 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:29:23.891 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2024-04-17T10:29:24.235 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:29:24.245 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:29:24.245 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:29:24.542 INFO:teuthology.orchestra.run.smithi152.stdout:generic/322 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:29:24.550 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/322 2024-04-17T10:29:24.550 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/322 2024-04-17T10:29:24.550 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:29:24.556 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:29:24.576 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:29:24.576 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2024-04-17T10:29:24.939 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:29:24.949 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:29:24.949 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:29:39.592 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:29:39.596 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:30:10.774 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:30:10.778 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:30:10.863 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-04-17T10:30:10.863+0000 7fc7d2600640 -1 Fail to open '/proc/34363/cmdline' error = (2) No such file or directory 2024-04-17T10:30:10.863 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-04-17T10:30:10.863+0000 7fc7d2600640 -1 received signal: Hangup from (PID: 34363) UID: 0 2024-04-17T10:30:10.864 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-04-17T10:30:10.863+0000 7fc89d000640 -1 Fail to open '/proc/34363/cmdline' error = (2) No such file or directory 2024-04-17T10:30:10.864 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-04-17T10:30:10.863+0000 7fc89d000640 -1 received signal: Hangup from (PID: 34363) UID: 0 2024-04-17T10:30:10.864 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-04-17T10:30:10.863+0000 7f5475c00640 -1 Fail to open '/proc/34363/cmdline' error = (2) No such file or directory 2024-04-17T10:30:10.864 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-04-17T10:30:10.863+0000 7f5475c00640 -1 received signal: Hangup from (PID: 34363) UID: 0 2024-04-17T10:30:10.864 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-04-17T10:30:10.863+0000 7f2b4a200640 -1 Fail to open '/proc/34363/cmdline' error = (2) No such file or directory 2024-04-17T10:30:10.865 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-04-17T10:30:10.863+0000 7f2b4a200640 -1 received signal: Hangup from (PID: 34363) UID: 0 2024-04-17T10:31:26.539 INFO:teuthology.orchestra.run.smithi152.stdout:generic/323 122s 2024-04-17T10:31:26.550 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/323 2024-04-17T10:31:26.550 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:31:26.556 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:26.596 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:31:26.596 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2024-04-17T10:31:27.234 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:31:27.245 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:31:27.245 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:27.577 INFO:teuthology.orchestra.run.smithi152.stdout:generic/324 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:31:27.585 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/324 2024-04-17T10:31:27.585 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/324 2024-04-17T10:31:27.585 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:31:27.591 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:27.610 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:31:27.611 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2024-04-17T10:31:27.955 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:31:27.965 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:31:27.965 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:28.300 INFO:teuthology.orchestra.run.smithi152.stdout:generic/325 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:31:28.308 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/325 2024-04-17T10:31:28.308 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/325 2024-04-17T10:31:28.308 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:31:28.314 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:28.334 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:31:28.334 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2024-04-17T10:31:28.688 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:31:28.699 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:31:28.699 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:28.987 INFO:teuthology.orchestra.run.smithi152.stdout:generic/326 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:31:28.995 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/326 2024-04-17T10:31:28.995 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/326 2024-04-17T10:31:28.995 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:31:29.001 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:29.020 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:31:29.020 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2024-04-17T10:31:29.379 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:31:29.389 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:31:29.389 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:29.654 INFO:teuthology.orchestra.run.smithi152.stdout:generic/327 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:31:29.662 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/327 2024-04-17T10:31:29.662 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/327 2024-04-17T10:31:29.662 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:31:29.668 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:29.687 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:31:29.688 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2024-04-17T10:31:30.063 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:31:30.074 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:31:30.074 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:30.353 INFO:teuthology.orchestra.run.smithi152.stdout:generic/328 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:31:30.361 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/328 2024-04-17T10:31:30.361 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/328 2024-04-17T10:31:30.361 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:31:30.367 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:30.387 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:31:30.387 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2024-04-17T10:31:30.740 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:31:30.750 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:31:30.750 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:31.066 INFO:teuthology.orchestra.run.smithi152.stdout:generic/329 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:31:31.075 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/329 2024-04-17T10:31:31.075 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/329 2024-04-17T10:31:31.075 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:31:31.081 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:31.101 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:31:31.101 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2024-04-17T10:31:31.451 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:31:31.461 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:31:31.462 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:31.734 INFO:teuthology.orchestra.run.smithi152.stdout:generic/330 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:31:31.743 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/330 2024-04-17T10:31:31.743 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/330 2024-04-17T10:31:31.743 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:31:31.749 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:31.768 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:31:31.768 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2024-04-17T10:31:32.124 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:31:32.134 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:31:32.134 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:32.412 INFO:teuthology.orchestra.run.smithi152.stdout:generic/331 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:31:32.420 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/331 2024-04-17T10:31:32.420 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/331 2024-04-17T10:31:32.420 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:31:32.426 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:32.445 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:31:32.446 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2024-04-17T10:31:32.805 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:31:32.816 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:31:32.816 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:33.096 INFO:teuthology.orchestra.run.smithi152.stdout:generic/332 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:31:33.104 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/332 2024-04-17T10:31:33.104 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/332 2024-04-17T10:31:33.104 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:31:33.110 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:33.129 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:31:33.129 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2024-04-17T10:31:33.487 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:31:33.497 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:31:33.498 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:33.758 INFO:teuthology.orchestra.run.smithi152.stdout:generic/333 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:31:33.766 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/333 2024-04-17T10:31:33.766 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/333 2024-04-17T10:31:33.766 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:31:33.772 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:33.793 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:31:33.793 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2024-04-17T10:31:34.156 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:31:34.165 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:31:34.166 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:34.416 INFO:teuthology.orchestra.run.smithi152.stdout:generic/334 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:31:34.424 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/334 2024-04-17T10:31:34.424 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/334 2024-04-17T10:31:34.425 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:31:34.431 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:34.450 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:31:34.450 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2024-04-17T10:31:34.803 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:31:34.813 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:31:34.813 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:35.129 INFO:teuthology.orchestra.run.smithi152.stdout:generic/335 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:31:35.136 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/335 2024-04-17T10:31:35.136 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/335 2024-04-17T10:31:35.136 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:31:35.142 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:35.161 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:31:35.162 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2024-04-17T10:31:35.507 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:31:35.517 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:31:35.517 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:35.825 INFO:teuthology.orchestra.run.smithi152.stdout:generic/336 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:31:35.832 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/336 2024-04-17T10:31:35.833 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/336 2024-04-17T10:31:35.833 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:31:35.839 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:35.858 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:31:35.858 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2024-04-17T10:31:36.239 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:31:36.249 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:31:36.249 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:36.527 INFO:teuthology.orchestra.run.smithi152.stdout:generic/337 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:31:36.535 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/337 2024-04-17T10:31:36.535 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/337 2024-04-17T10:31:36.535 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:31:36.541 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:36.560 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:31:36.561 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2024-04-17T10:31:36.921 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:31:36.931 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:31:36.931 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:37.207 INFO:teuthology.orchestra.run.smithi152.stdout:generic/338 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:31:37.215 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/338 2024-04-17T10:31:37.215 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/338 2024-04-17T10:31:37.215 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:31:37.221 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:37.241 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:31:37.241 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2024-04-17T10:31:37.607 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:31:37.617 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:31:37.617 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:37.887 INFO:teuthology.orchestra.run.smithi152.stdout:generic/339 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:31:37.894 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/339 2024-04-17T10:31:37.895 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/339 2024-04-17T10:31:37.895 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:31:37.901 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:37.921 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:31:37.921 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2024-04-17T10:31:38.295 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:31:38.306 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:31:38.306 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:38.560 INFO:teuthology.orchestra.run.smithi152.stdout:generic/340 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:31:38.568 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/340 2024-04-17T10:31:38.568 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/340 2024-04-17T10:31:38.568 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:31:38.574 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:38.593 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:31:38.593 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2024-04-17T10:31:38.957 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:31:38.967 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:31:38.968 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:39.262 INFO:teuthology.orchestra.run.smithi152.stdout:generic/341 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:31:39.270 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/341 2024-04-17T10:31:39.271 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/341 2024-04-17T10:31:39.271 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:31:39.277 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:39.297 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:31:39.297 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2024-04-17T10:31:39.643 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:31:39.653 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:31:39.653 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:39.956 INFO:teuthology.orchestra.run.smithi152.stdout:generic/342 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:31:39.964 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/342 2024-04-17T10:31:39.964 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/342 2024-04-17T10:31:39.964 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:31:39.970 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:39.990 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:31:39.990 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2024-04-17T10:31:40.359 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:31:40.369 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:31:40.369 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:40.668 INFO:teuthology.orchestra.run.smithi152.stdout:generic/343 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:31:40.676 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/343 2024-04-17T10:31:40.676 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/343 2024-04-17T10:31:40.676 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:31:40.682 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:40.701 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:31:40.701 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2024-04-17T10:31:41.050 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:31:41.061 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:31:41.061 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:41.339 INFO:teuthology.orchestra.run.smithi152.stdout:generic/344 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:31:41.347 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/344 2024-04-17T10:31:41.347 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/344 2024-04-17T10:31:41.347 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:31:41.354 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:41.373 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:31:41.373 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2024-04-17T10:31:41.727 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:31:41.737 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:31:41.737 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:42.012 INFO:teuthology.orchestra.run.smithi152.stdout:generic/345 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:31:42.020 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/345 2024-04-17T10:31:42.020 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/345 2024-04-17T10:31:42.020 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:31:42.026 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:42.047 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:31:42.047 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2024-04-17T10:31:42.387 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:31:42.397 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:31:42.398 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:42.681 INFO:teuthology.orchestra.run.smithi152.stdout:generic/346 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:31:42.689 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/346 2024-04-17T10:31:42.690 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/346 2024-04-17T10:31:42.690 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:31:42.696 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:42.715 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:31:42.715 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2024-04-17T10:31:43.063 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:31:43.073 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:31:43.073 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:43.400 INFO:teuthology.orchestra.run.smithi152.stdout:generic/347 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:31:43.408 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/347 2024-04-17T10:31:43.408 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/347 2024-04-17T10:31:43.408 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:31:43.414 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:43.433 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:31:43.433 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2024-04-17T10:31:43.799 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:31:43.809 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:31:43.809 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:44.099 INFO:teuthology.orchestra.run.smithi152.stdout:generic/348 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:31:44.107 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/348 2024-04-17T10:31:44.107 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/348 2024-04-17T10:31:44.107 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:31:44.113 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:44.134 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:31:44.135 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2024-04-17T10:31:44.478 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:31:44.488 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:31:44.489 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:45.990 INFO:teuthology.orchestra.run.smithi152.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-04-17T10:31:45.995 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/349 2024-04-17T10:31:45.995 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/349 2024-04-17T10:31:45.995 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:31:46.001 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:46.063 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:31:46.063 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2024-04-17T10:31:46.403 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:31:46.413 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:31:46.414 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:48.983 INFO:teuthology.orchestra.run.smithi152.stdout:generic/350 2s 2024-04-17T10:31:48.996 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/350 2024-04-17T10:31:48.996 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:31:49.002 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:49.020 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:31:49.020 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2024-04-17T10:31:49.362 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:31:49.373 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:31:49.373 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:50.960 INFO:teuthology.orchestra.run.smithi152.stdout:generic/351 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2024-04-17T10:31:50.968 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/351 2024-04-17T10:31:50.968 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/351 2024-04-17T10:31:50.968 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:31:50.974 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:51.008 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:31:51.008 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2024-04-17T10:31:51.656 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:31:51.666 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:31:51.666 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:51.979 INFO:teuthology.orchestra.run.smithi152.stdout:generic/352 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:31:51.987 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/352 2024-04-17T10:31:51.987 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/352 2024-04-17T10:31:51.987 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:31:51.993 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:52.013 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:31:52.013 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2024-04-17T10:31:52.387 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:31:52.398 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:31:52.398 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:52.690 INFO:teuthology.orchestra.run.smithi152.stdout:generic/353 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:31:52.698 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/353 2024-04-17T10:31:52.698 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/353 2024-04-17T10:31:52.698 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:31:52.704 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:52.723 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:31:52.723 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2024-04-17T10:31:53.075 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:31:53.085 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:31:53.085 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:53.363 INFO:teuthology.orchestra.run.smithi152.stdout:generic/354 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:31:53.371 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/354 2024-04-17T10:31:53.371 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/354 2024-04-17T10:31:53.371 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:31:53.377 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:53.397 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:31:53.397 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2024-04-17T10:31:53.758 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:31:53.769 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:31:53.769 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:54.852 INFO:teuthology.orchestra.run.smithi152.stdout:generic/355 1s 2024-04-17T10:31:54.863 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/355 2024-04-17T10:31:54.863 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:31:54.870 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:54.891 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:31:54.892 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2024-04-17T10:31:55.563 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:31:55.573 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:31:55.573 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:55.847 INFO:teuthology.orchestra.run.smithi152.stdout:generic/356 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:31:55.855 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/356 2024-04-17T10:31:55.856 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/356 2024-04-17T10:31:55.856 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:31:55.861 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:55.881 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:31:55.882 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2024-04-17T10:31:56.243 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:31:56.253 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:31:56.253 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:56.529 INFO:teuthology.orchestra.run.smithi152.stdout:generic/357 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:31:56.536 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/357 2024-04-17T10:31:56.537 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/357 2024-04-17T10:31:56.537 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:31:56.542 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:56.563 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:31:56.563 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2024-04-17T10:31:56.922 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:31:56.933 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:31:56.933 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:57.199 INFO:teuthology.orchestra.run.smithi152.stdout:generic/358 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:31:57.207 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/358 2024-04-17T10:31:57.207 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/358 2024-04-17T10:31:57.207 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:31:57.213 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:57.232 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:31:57.233 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2024-04-17T10:31:57.587 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:31:57.597 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:31:57.597 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:57.886 INFO:teuthology.orchestra.run.smithi152.stdout:generic/359 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:31:57.893 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/359 2024-04-17T10:31:57.893 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/359 2024-04-17T10:31:57.894 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:31:57.899 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:57.919 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:31:57.919 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2024-04-17T10:31:58.279 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:31:58.289 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:31:58.289 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:58.688 INFO:teuthology.orchestra.run.smithi152.stdout:generic/360 0s 2024-04-17T10:31:58.700 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/360 2024-04-17T10:31:58.700 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:31:58.707 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:58.726 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:31:58.727 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2024-04-17T10:31:59.092 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:31:59.102 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:31:59.102 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:59.420 INFO:teuthology.orchestra.run.smithi152.stdout:generic/361 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:31:59.428 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/361 2024-04-17T10:31:59.428 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/361 2024-04-17T10:31:59.428 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:31:59.434 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:31:59.454 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:31:59.454 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2024-04-17T10:31:59.818 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:31:59.829 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:31:59.829 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:00.095 INFO:teuthology.orchestra.run.smithi152.stdout:generic/362 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:32:00.103 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/362 2024-04-17T10:32:00.103 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/362 2024-04-17T10:32:00.103 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:32:00.109 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:00.129 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:32:00.129 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2024-04-17T10:32:00.490 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:32:00.500 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:32:00.501 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:00.783 INFO:teuthology.orchestra.run.smithi152.stdout:generic/363 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:32:00.791 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/363 2024-04-17T10:32:00.791 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/363 2024-04-17T10:32:00.791 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:32:00.797 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:00.817 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:32:00.817 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2024-04-17T10:32:01.179 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:32:01.189 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:32:01.190 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:01.467 INFO:teuthology.orchestra.run.smithi152.stdout:generic/364 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:32:01.475 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/364 2024-04-17T10:32:01.475 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/364 2024-04-17T10:32:01.475 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:32:01.481 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:01.501 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:32:01.501 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2024-04-17T10:32:01.860 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:32:01.870 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:32:01.870 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:02.149 INFO:teuthology.orchestra.run.smithi152.stdout:generic/365 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:32:02.157 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/365 2024-04-17T10:32:02.157 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/365 2024-04-17T10:32:02.158 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:32:02.163 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:02.183 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:32:02.183 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2024-04-17T10:32:02.535 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:32:02.546 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:32:02.546 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:02.816 INFO:teuthology.orchestra.run.smithi152.stdout:generic/366 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:32:02.824 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/366 2024-04-17T10:32:02.824 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/366 2024-04-17T10:32:02.824 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:32:02.830 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:02.850 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:32:02.851 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2024-04-17T10:32:03.190 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:32:03.200 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:32:03.200 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:03.490 INFO:teuthology.orchestra.run.smithi152.stdout:generic/367 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:32:03.498 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/367 2024-04-17T10:32:03.498 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/367 2024-04-17T10:32:03.498 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:32:03.504 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:03.523 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:32:03.523 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2024-04-17T10:32:03.889 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:32:03.899 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:32:03.899 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:04.185 INFO:teuthology.orchestra.run.smithi152.stdout:generic/368 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:32:04.193 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/368 2024-04-17T10:32:04.193 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/368 2024-04-17T10:32:04.193 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:32:04.199 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:04.219 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:32:04.219 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2024-04-17T10:32:04.571 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:32:04.581 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:32:04.581 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:04.839 INFO:teuthology.orchestra.run.smithi152.stdout:generic/369 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:32:04.848 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/369 2024-04-17T10:32:04.848 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/369 2024-04-17T10:32:04.848 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:32:04.854 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:04.873 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:32:04.873 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2024-04-17T10:32:05.235 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:32:05.245 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:32:05.245 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:05.519 INFO:teuthology.orchestra.run.smithi152.stdout:generic/370 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:32:05.528 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/370 2024-04-17T10:32:05.528 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/370 2024-04-17T10:32:05.528 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:32:05.534 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:05.553 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:32:05.553 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2024-04-17T10:32:05.901 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:32:05.911 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:32:05.912 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:06.190 INFO:teuthology.orchestra.run.smithi152.stdout:generic/371 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:32:06.198 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/371 2024-04-17T10:32:06.198 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/371 2024-04-17T10:32:06.198 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:32:06.204 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:06.224 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:32:06.224 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2024-04-17T10:32:06.590 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:32:06.601 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:32:06.601 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:06.886 INFO:teuthology.orchestra.run.smithi152.stdout:generic/372 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:32:06.893 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/372 2024-04-17T10:32:06.893 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/372 2024-04-17T10:32:06.893 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:32:06.900 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:06.919 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:32:06.919 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2024-04-17T10:32:07.267 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:32:07.277 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:32:07.277 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:07.563 INFO:teuthology.orchestra.run.smithi152.stdout:generic/373 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:32:07.571 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/373 2024-04-17T10:32:07.571 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/373 2024-04-17T10:32:07.571 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:32:07.577 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:07.596 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:32:07.596 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2024-04-17T10:32:07.956 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:32:07.966 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:32:07.966 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:08.234 INFO:teuthology.orchestra.run.smithi152.stdout:generic/374 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:32:08.242 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/374 2024-04-17T10:32:08.242 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/374 2024-04-17T10:32:08.242 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:32:08.248 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:08.268 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:32:08.268 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2024-04-17T10:32:08.619 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:32:08.629 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:32:08.629 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:08.962 INFO:teuthology.orchestra.run.smithi152.stdout:generic/375 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-04-17T10:32:08.970 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/375 2024-04-17T10:32:08.970 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/375 2024-04-17T10:32:08.970 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:32:08.976 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:08.994 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:32:08.995 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2024-04-17T10:32:09.359 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:32:09.369 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:32:09.369 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:09.675 INFO:teuthology.orchestra.run.smithi152.stdout:generic/376 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:32:09.683 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/376 2024-04-17T10:32:09.683 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/376 2024-04-17T10:32:09.684 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:32:09.690 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:09.709 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:32:09.709 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2024-04-17T10:32:10.075 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:32:10.086 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:32:10.086 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:10.368 INFO:teuthology.orchestra.run.smithi152.stdout:generic/377 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:32:10.376 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/377 2024-04-17T10:32:10.376 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/377 2024-04-17T10:32:10.376 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:32:10.382 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:10.401 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:32:10.402 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2024-04-17T10:32:10.771 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:32:10.781 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:32:10.781 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:11.481 INFO:teuthology.orchestra.run.smithi152.stdout:generic/378 1s 2024-04-17T10:32:11.494 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/378 2024-04-17T10:32:11.494 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:32:11.500 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:11.570 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:32:11.570 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2024-04-17T10:32:12.187 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:32:12.197 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:32:12.197 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:12.487 INFO:teuthology.orchestra.run.smithi152.stdout:generic/379 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:32:12.494 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/379 2024-04-17T10:32:12.495 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/379 2024-04-17T10:32:12.495 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:32:12.500 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:12.519 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:32:12.519 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2024-04-17T10:32:12.868 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:32:12.878 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:32:12.878 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:13.150 INFO:teuthology.orchestra.run.smithi152.stdout:generic/380 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:32:13.158 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/380 2024-04-17T10:32:13.158 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/380 2024-04-17T10:32:13.158 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:32:13.164 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:13.183 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:32:13.183 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2024-04-17T10:32:13.540 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:32:13.550 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:32:13.550 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:13.825 INFO:teuthology.orchestra.run.smithi152.stdout:generic/381 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:32:13.833 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/381 2024-04-17T10:32:13.833 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/381 2024-04-17T10:32:13.833 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:32:13.839 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:13.859 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:32:13.859 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2024-04-17T10:32:14.216 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:32:14.226 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:32:14.226 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:14.506 INFO:teuthology.orchestra.run.smithi152.stdout:generic/382 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:32:14.514 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/382 2024-04-17T10:32:14.514 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/382 2024-04-17T10:32:14.514 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:32:14.520 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:14.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:32:14.540 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2024-04-17T10:32:14.903 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:32:14.913 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:32:14.913 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:15.201 INFO:teuthology.orchestra.run.smithi152.stdout:generic/383 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:32:15.211 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/383 2024-04-17T10:32:15.211 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/383 2024-04-17T10:32:15.211 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:32:15.215 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:15.235 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:32:15.235 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2024-04-17T10:32:15.592 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:32:15.602 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:32:15.602 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:15.898 INFO:teuthology.orchestra.run.smithi152.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-04-17T10:32:15.906 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/384 2024-04-17T10:32:15.906 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/384 2024-04-17T10:32:15.907 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:32:15.913 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:15.932 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:32:15.932 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2024-04-17T10:32:16.295 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:32:16.305 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:32:16.305 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:16.559 INFO:teuthology.orchestra.run.smithi152.stdout:generic/385 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:32:16.566 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/385 2024-04-17T10:32:16.567 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/385 2024-04-17T10:32:16.567 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:32:16.572 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:16.591 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:32:16.591 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2024-04-17T10:32:16.959 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:32:16.969 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:32:16.970 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:17.249 INFO:teuthology.orchestra.run.smithi152.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-04-17T10:32:17.257 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/386 2024-04-17T10:32:17.257 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/386 2024-04-17T10:32:17.257 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:32:17.263 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:17.283 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:32:17.283 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2024-04-17T10:32:17.640 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:32:17.650 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:32:17.650 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:17.953 INFO:teuthology.orchestra.run.smithi152.stdout:generic/387 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:32:17.961 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/387 2024-04-17T10:32:17.961 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/387 2024-04-17T10:32:17.961 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:32:17.967 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:17.987 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:32:17.988 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2024-04-17T10:32:18.359 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:32:18.369 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:32:18.369 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:18.665 INFO:teuthology.orchestra.run.smithi152.stdout:generic/388 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:32:18.672 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/388 2024-04-17T10:32:18.673 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/388 2024-04-17T10:32:18.673 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:32:18.679 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:18.755 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:32:18.755 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2024-04-17T10:32:19.120 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:32:19.130 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:32:19.130 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:19.425 INFO:teuthology.orchestra.run.smithi152.stdout:generic/389 [not run] O_TMPFILE is not supported 2024-04-17T10:32:19.433 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/389 2024-04-17T10:32:19.433 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/389 2024-04-17T10:32:19.434 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:32:19.440 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:19.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:32:19.459 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2024-04-17T10:32:19.818 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:32:19.828 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:32:19.829 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:20.122 INFO:teuthology.orchestra.run.smithi152.stdout:generic/390 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:32:20.130 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/390 2024-04-17T10:32:20.130 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/390 2024-04-17T10:32:20.130 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:32:20.136 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:20.155 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:32:20.156 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2024-04-17T10:32:20.514 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:32:20.524 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:32:20.524 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:57.967 INFO:teuthology.orchestra.run.smithi152.stdout:generic/391 37s 2024-04-17T10:32:58.188 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/391 2024-04-17T10:32:58.188 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:32:58.194 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:32:58.405 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:32:58.405 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2024-04-17T10:33:02.655 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:33:02.666 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:33:02.666 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:03.294 INFO:teuthology.orchestra.run.smithi152.stdout:generic/392 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:33:03.302 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/392 2024-04-17T10:33:03.302 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/392 2024-04-17T10:33:03.303 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:33:03.309 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:03.329 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:33:03.329 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2024-04-17T10:33:03.707 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:33:03.717 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:33:03.717 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:03.976 INFO:teuthology.orchestra.run.smithi152.stdout:generic/393 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:33:03.984 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/393 2024-04-17T10:33:03.984 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/393 2024-04-17T10:33:03.984 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:33:03.990 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:04.010 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:33:04.011 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2024-04-17T10:33:04.351 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:33:04.361 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:33:04.362 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:04.730 INFO:teuthology.orchestra.run.smithi152.stdout:generic/394 0s 2024-04-17T10:33:04.742 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/394 2024-04-17T10:33:04.742 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:33:04.748 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:04.782 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:33:04.782 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2024-04-17T10:33:05.468 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:33:05.478 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:33:05.478 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:05.893 INFO:teuthology.orchestra.run.smithi152.stdout:generic/395 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:33:05.902 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/395 2024-04-17T10:33:05.903 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/395 2024-04-17T10:33:05.903 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:33:05.911 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:05.938 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:33:05.938 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2024-04-17T10:33:06.437 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:33:06.447 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:33:06.448 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:06.791 INFO:teuthology.orchestra.run.smithi152.stdout:generic/396 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:33:06.799 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/396 2024-04-17T10:33:06.799 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/396 2024-04-17T10:33:06.800 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:33:06.805 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:06.825 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:33:06.825 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2024-04-17T10:33:07.172 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:33:07.182 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:33:07.182 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:07.548 INFO:teuthology.orchestra.run.smithi152.stdout:generic/397 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:33:07.556 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/397 2024-04-17T10:33:07.556 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/397 2024-04-17T10:33:07.556 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:33:07.562 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:07.583 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:33:07.583 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2024-04-17T10:33:07.944 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:33:07.954 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:33:07.955 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:08.290 INFO:teuthology.orchestra.run.smithi152.stdout:generic/398 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:33:08.298 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/398 2024-04-17T10:33:08.298 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/398 2024-04-17T10:33:08.298 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:33:08.304 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:08.324 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:33:08.324 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2024-04-17T10:33:08.683 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:33:08.693 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:33:08.694 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:09.020 INFO:teuthology.orchestra.run.smithi152.stdout:generic/399 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:33:09.028 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/399 2024-04-17T10:33:09.028 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/399 2024-04-17T10:33:09.028 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:33:09.034 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:09.099 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:33:09.099 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2024-04-17T10:33:09.475 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:33:09.485 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:33:09.485 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:09.757 INFO:teuthology.orchestra.run.smithi152.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-04-17T10:33:09.764 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/400 2024-04-17T10:33:09.765 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/400 2024-04-17T10:33:09.765 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:33:09.771 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:09.791 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:33:09.792 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2024-04-17T10:33:10.143 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:33:10.153 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:33:10.154 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:10.438 INFO:teuthology.orchestra.run.smithi152.stdout:generic/401 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:33:10.446 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/401 2024-04-17T10:33:10.446 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/401 2024-04-17T10:33:10.446 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:33:10.452 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:10.472 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:33:10.472 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2024-04-17T10:33:10.827 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:33:10.837 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:33:10.837 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:11.120 INFO:teuthology.orchestra.run.smithi152.stdout:generic/402 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:33:11.128 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/402 2024-04-17T10:33:11.128 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/402 2024-04-17T10:33:11.128 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:33:11.134 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:11.154 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:33:11.154 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2024-04-17T10:33:11.511 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:33:11.521 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:33:11.522 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:11.792 INFO:teuthology.orchestra.run.smithi152.stdout:generic/403 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:33:11.800 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/403 2024-04-17T10:33:11.800 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/403 2024-04-17T10:33:11.800 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:33:11.806 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:11.827 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:33:11.827 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2024-04-17T10:33:12.182 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:33:12.193 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:33:12.193 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:13.649 INFO:teuthology.orchestra.run.smithi152.stdout:generic/404 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2024-04-17T10:33:13.657 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/404 2024-04-17T10:33:13.657 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/404 2024-04-17T10:33:13.658 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:33:13.664 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:13.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:33:13.725 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2024-04-17T10:33:14.336 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:33:14.346 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:33:14.346 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:14.748 INFO:teuthology.orchestra.run.smithi152.stdout:generic/405 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:33:14.756 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/405 2024-04-17T10:33:14.756 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/405 2024-04-17T10:33:14.756 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:33:14.762 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:14.831 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:33:14.831 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2024-04-17T10:33:15.180 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:33:15.190 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:33:15.190 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:15.454 INFO:teuthology.orchestra.run.smithi152.stdout:generic/406 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:33:15.462 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/406 2024-04-17T10:33:15.463 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/406 2024-04-17T10:33:15.463 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:33:15.469 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:15.489 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:33:15.489 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2024-04-17T10:33:15.868 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:33:15.879 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:33:15.879 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:16.232 INFO:teuthology.orchestra.run.smithi152.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-17T10:33:16.240 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/407 2024-04-17T10:33:16.240 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/407 2024-04-17T10:33:16.240 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:33:16.246 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:16.316 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:33:16.317 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2024-04-17T10:33:16.955 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:33:16.965 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:33:16.965 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:17.341 INFO:teuthology.orchestra.run.smithi152.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-04-17T10:33:17.349 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/408 2024-04-17T10:33:17.349 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/408 2024-04-17T10:33:17.349 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:33:17.355 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:17.407 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:33:17.407 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2024-04-17T10:33:18.027 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:33:18.037 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:33:18.037 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:18.357 INFO:teuthology.orchestra.run.smithi152.stdout:generic/409 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:33:18.365 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/409 2024-04-17T10:33:18.365 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/409 2024-04-17T10:33:18.365 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:33:18.371 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:18.392 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:33:18.392 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2024-04-17T10:33:18.743 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:33:18.753 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:33:18.753 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:19.024 INFO:teuthology.orchestra.run.smithi152.stdout:generic/410 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:33:19.032 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/410 2024-04-17T10:33:19.032 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/410 2024-04-17T10:33:19.032 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:33:19.038 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:19.058 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:33:19.058 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2024-04-17T10:33:19.423 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:33:19.433 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:33:19.433 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:19.713 INFO:teuthology.orchestra.run.smithi152.stdout:generic/411 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:33:19.721 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/411 2024-04-17T10:33:19.721 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/411 2024-04-17T10:33:19.721 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:33:19.727 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:19.747 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:33:19.747 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2024-04-17T10:33:19.869 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:33:19.873 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:33:20.099 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:33:20.109 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:33:20.109 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:20.383 INFO:teuthology.orchestra.run.smithi152.stdout:generic/412 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:33:20.391 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/412 2024-04-17T10:33:20.391 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/412 2024-04-17T10:33:20.391 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:33:20.397 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:20.443 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:33:20.443 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2024-04-17T10:33:20.803 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:33:20.813 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:33:20.813 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:21.093 INFO:teuthology.orchestra.run.smithi152.stdout:generic/413 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:33:21.101 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/413 2024-04-17T10:33:21.101 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/413 2024-04-17T10:33:21.101 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:33:21.107 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:21.128 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:33:21.128 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2024-04-17T10:33:21.487 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:33:21.497 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:33:21.497 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:21.748 INFO:teuthology.orchestra.run.smithi152.stdout:generic/414 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:33:21.756 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/414 2024-04-17T10:33:21.756 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/414 2024-04-17T10:33:21.756 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:33:21.762 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:21.781 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:33:21.782 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2024-04-17T10:33:22.123 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:33:22.134 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:33:22.134 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:22.397 INFO:teuthology.orchestra.run.smithi152.stdout:generic/415 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:33:22.405 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/415 2024-04-17T10:33:22.405 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/415 2024-04-17T10:33:22.406 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:33:22.412 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:22.432 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:33:22.432 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2024-04-17T10:33:22.786 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:33:22.796 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:33:22.796 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:23.070 INFO:teuthology.orchestra.run.smithi152.stdout:generic/416 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:33:23.078 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/416 2024-04-17T10:33:23.078 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/416 2024-04-17T10:33:23.078 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:33:23.084 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:23.105 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:33:23.105 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2024-04-17T10:33:23.463 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:33:23.473 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:33:23.473 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:23.750 INFO:teuthology.orchestra.run.smithi152.stdout:generic/417 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:33:23.758 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/417 2024-04-17T10:33:23.758 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/417 2024-04-17T10:33:23.758 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:33:23.764 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:23.783 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:33:23.784 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2024-04-17T10:33:24.147 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:33:24.157 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:33:24.157 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:24.514 INFO:teuthology.orchestra.run.smithi152.stdout:generic/418 [not run] require ceph-fuse to be valid block disk 2024-04-17T10:33:24.521 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/418 2024-04-17T10:33:24.522 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/418 2024-04-17T10:33:24.522 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:33:24.528 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:24.548 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:33:24.548 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2024-04-17T10:33:24.899 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:33:24.909 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:33:24.910 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:25.256 INFO:teuthology.orchestra.run.smithi152.stdout:generic/419 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:33:25.264 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/419 2024-04-17T10:33:25.264 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/419 2024-04-17T10:33:25.264 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:33:25.270 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:25.335 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:33:25.335 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2024-04-17T10:33:25.678 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:33:25.688 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:33:25.688 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:27.131 INFO:teuthology.orchestra.run.smithi152.stdout:generic/420 2s 2024-04-17T10:33:27.142 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/420 2024-04-17T10:33:27.143 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:33:27.149 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:27.275 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:33:27.276 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2024-04-17T10:33:27.839 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:33:27.850 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:33:27.850 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:28.181 INFO:teuthology.orchestra.run.smithi152.stdout:generic/421 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:33:28.189 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/421 2024-04-17T10:33:28.189 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/421 2024-04-17T10:33:28.189 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:33:28.195 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:28.214 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:33:28.214 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2024-04-17T10:33:28.583 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:33:28.593 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:33:28.593 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:28.880 INFO:teuthology.orchestra.run.smithi152.stdout:generic/422 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:33:28.888 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/422 2024-04-17T10:33:28.888 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/422 2024-04-17T10:33:28.888 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:33:28.894 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:28.913 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:33:28.914 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2024-04-17T10:33:29.273 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:33:29.283 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:33:29.283 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:29.763 INFO:teuthology.orchestra.run.smithi152.stdout:generic/423 0s 2024-04-17T10:33:29.775 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/423 2024-04-17T10:33:29.775 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:33:29.781 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:29.911 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:33:29.912 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2024-04-17T10:33:30.476 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:33:30.486 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:33:30.486 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:30.817 INFO:teuthology.orchestra.run.smithi152.stdout:generic/424 [not run] file system doesn't support any of /usr/bin/chattr +a/+c/+d/+i 2024-04-17T10:33:30.825 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/424 2024-04-17T10:33:30.825 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/424 2024-04-17T10:33:30.825 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:33:30.830 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:30.851 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:33:30.851 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2024-04-17T10:33:31.227 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:33:31.237 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:33:31.237 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:31.503 INFO:teuthology.orchestra.run.smithi152.stdout:generic/425 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:33:31.512 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/425 2024-04-17T10:33:31.512 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/425 2024-04-17T10:33:31.512 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:33:31.518 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:31.537 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:33:31.537 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2024-04-17T10:33:31.895 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:33:31.905 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:33:31.905 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:33:50.123 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:33:50.126 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:34:12.576 INFO:teuthology.orchestra.run.smithi152.stdout:generic/426 - output mismatch (see /tmp/tmp.pJW3k3pP3vxfstests-dev/results//generic/426.out.bad) 2024-04-17T10:34:12.606 INFO:teuthology.orchestra.run.smithi152.stdout: --- tests/generic/426.out 2024-04-17 08:48:08.577451826 +0000 2024-04-17T10:34:12.607 INFO:teuthology.orchestra.run.smithi152.stdout: +++ /tmp/tmp.pJW3k3pP3vxfstests-dev/results//generic/426.out.bad 2024-04-17 10:34:12.555660011 +0000 2024-04-17T10:34:12.607 INFO:teuthology.orchestra.run.smithi152.stdout: @@ -1,5 +1,505 @@ 2024-04-17T10:34:12.607 INFO:teuthology.orchestra.run.smithi152.stdout: QA output created by 426 2024-04-17T10:34:12.607 INFO:teuthology.orchestra.run.smithi152.stdout: test_file_handles TEST_DIR/426-dir -d 2024-04-17T10:34:12.607 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000106) opened an unlinked file! 2024-04-17T10:34:12.607 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000107) opened an unlinked file! 2024-04-17T10:34:12.607 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000108) opened an unlinked file! 2024-04-17T10:34:12.607 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000109) opened an unlinked file! 2024-04-17T10:34:12.607 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000110) opened an unlinked file! 2024-04-17T10:34:12.607 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000111) opened an unlinked file! 2024-04-17T10:34:12.607 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000112) opened an unlinked file! 2024-04-17T10:34:12.607 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000113) opened an unlinked file! 2024-04-17T10:34:12.607 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000114) opened an unlinked file! 2024-04-17T10:34:12.608 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000115) opened an unlinked file! 2024-04-17T10:34:12.608 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000116) opened an unlinked file! 2024-04-17T10:34:12.608 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000117) opened an unlinked file! 2024-04-17T10:34:12.608 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000118) opened an unlinked file! 2024-04-17T10:34:12.608 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000119) opened an unlinked file! 2024-04-17T10:34:12.608 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000120) opened an unlinked file! 2024-04-17T10:34:12.608 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000121) opened an unlinked file! 2024-04-17T10:34:12.608 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000122) opened an unlinked file! 2024-04-17T10:34:12.608 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000123) opened an unlinked file! 2024-04-17T10:34:12.608 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000124) opened an unlinked file! 2024-04-17T10:34:12.608 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000125) opened an unlinked file! 2024-04-17T10:34:12.608 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000126) opened an unlinked file! 2024-04-17T10:34:12.608 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000127) opened an unlinked file! 2024-04-17T10:34:12.608 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000128) opened an unlinked file! 2024-04-17T10:34:12.609 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000129) opened an unlinked file! 2024-04-17T10:34:12.609 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000130) opened an unlinked file! 2024-04-17T10:34:12.609 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000131) opened an unlinked file! 2024-04-17T10:34:12.609 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000132) opened an unlinked file! 2024-04-17T10:34:12.609 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000133) opened an unlinked file! 2024-04-17T10:34:12.609 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000134) opened an unlinked file! 2024-04-17T10:34:12.609 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000135) opened an unlinked file! 2024-04-17T10:34:12.609 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000136) opened an unlinked file! 2024-04-17T10:34:12.609 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000137) opened an unlinked file! 2024-04-17T10:34:12.609 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000138) opened an unlinked file! 2024-04-17T10:34:12.609 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000139) opened an unlinked file! 2024-04-17T10:34:12.609 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000140) opened an unlinked file! 2024-04-17T10:34:12.609 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000141) opened an unlinked file! 2024-04-17T10:34:12.609 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000142) opened an unlinked file! 2024-04-17T10:34:12.610 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000143) opened an unlinked file! 2024-04-17T10:34:12.610 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000144) opened an unlinked file! 2024-04-17T10:34:12.610 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000145) opened an unlinked file! 2024-04-17T10:34:12.610 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000146) opened an unlinked file! 2024-04-17T10:34:12.610 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000147) opened an unlinked file! 2024-04-17T10:34:12.610 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000148) opened an unlinked file! 2024-04-17T10:34:12.610 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000149) opened an unlinked file! 2024-04-17T10:34:12.610 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000150) opened an unlinked file! 2024-04-17T10:34:12.610 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000151) opened an unlinked file! 2024-04-17T10:34:12.610 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000152) opened an unlinked file! 2024-04-17T10:34:12.610 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000153) opened an unlinked file! 2024-04-17T10:34:12.610 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000154) opened an unlinked file! 2024-04-17T10:34:12.610 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000155) opened an unlinked file! 2024-04-17T10:34:12.610 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000156) opened an unlinked file! 2024-04-17T10:34:12.610 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000157) opened an unlinked file! 2024-04-17T10:34:12.611 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000158) opened an unlinked file! 2024-04-17T10:34:12.611 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000159) opened an unlinked file! 2024-04-17T10:34:12.611 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000160) opened an unlinked file! 2024-04-17T10:34:12.611 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000161) opened an unlinked file! 2024-04-17T10:34:12.611 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000580) opened an unlinked file! 2024-04-17T10:34:12.611 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000581) opened an unlinked file! 2024-04-17T10:34:12.611 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000582) opened an unlinked file! 2024-04-17T10:34:12.611 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000583) opened an unlinked file! 2024-04-17T10:34:12.611 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000584) opened an unlinked file! 2024-04-17T10:34:12.611 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000585) opened an unlinked file! 2024-04-17T10:34:12.611 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000586) opened an unlinked file! 2024-04-17T10:34:12.611 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000587) opened an unlinked file! 2024-04-17T10:34:12.611 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000588) opened an unlinked file! 2024-04-17T10:34:12.611 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000589) opened an unlinked file! 2024-04-17T10:34:12.612 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000590) opened an unlinked file! 2024-04-17T10:34:12.612 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000591) opened an unlinked file! 2024-04-17T10:34:12.612 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000592) opened an unlinked file! 2024-04-17T10:34:12.612 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000593) opened an unlinked file! 2024-04-17T10:34:12.612 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000594) opened an unlinked file! 2024-04-17T10:34:12.612 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000595) opened an unlinked file! 2024-04-17T10:34:12.612 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000596) opened an unlinked file! 2024-04-17T10:34:12.612 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000597) opened an unlinked file! 2024-04-17T10:34:12.612 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000598) opened an unlinked file! 2024-04-17T10:34:12.612 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000599) opened an unlinked file! 2024-04-17T10:34:12.612 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000600) opened an unlinked file! 2024-04-17T10:34:12.612 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000601) opened an unlinked file! 2024-04-17T10:34:12.612 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000602) opened an unlinked file! 2024-04-17T10:34:12.613 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000603) opened an unlinked file! 2024-04-17T10:34:12.613 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000604) opened an unlinked file! 2024-04-17T10:34:12.613 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000605) opened an unlinked file! 2024-04-17T10:34:12.613 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000606) opened an unlinked file! 2024-04-17T10:34:12.613 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000607) opened an unlinked file! 2024-04-17T10:34:12.613 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000608) opened an unlinked file! 2024-04-17T10:34:12.613 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000609) opened an unlinked file! 2024-04-17T10:34:12.613 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000610) opened an unlinked file! 2024-04-17T10:34:12.613 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000611) opened an unlinked file! 2024-04-17T10:34:12.613 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000612) opened an unlinked file! 2024-04-17T10:34:12.613 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000613) opened an unlinked file! 2024-04-17T10:34:12.613 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000614) opened an unlinked file! 2024-04-17T10:34:12.613 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000615) opened an unlinked file! 2024-04-17T10:34:12.613 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000616) opened an unlinked file! 2024-04-17T10:34:12.614 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000617) opened an unlinked file! 2024-04-17T10:34:12.614 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000618) opened an unlinked file! 2024-04-17T10:34:12.614 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000619) opened an unlinked file! 2024-04-17T10:34:12.614 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000620) opened an unlinked file! 2024-04-17T10:34:12.614 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000621) opened an unlinked file! 2024-04-17T10:34:12.614 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000622) opened an unlinked file! 2024-04-17T10:34:12.614 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000623) opened an unlinked file! 2024-04-17T10:34:12.614 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000624) opened an unlinked file! 2024-04-17T10:34:12.614 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000625) opened an unlinked file! 2024-04-17T10:34:12.614 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000626) opened an unlinked file! 2024-04-17T10:34:12.614 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000627) opened an unlinked file! 2024-04-17T10:34:12.614 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000628) opened an unlinked file! 2024-04-17T10:34:12.614 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000629) opened an unlinked file! 2024-04-17T10:34:12.615 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000630) opened an unlinked file! 2024-04-17T10:34:12.615 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000631) opened an unlinked file! 2024-04-17T10:34:12.615 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000632) opened an unlinked file! 2024-04-17T10:34:12.615 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000633) opened an unlinked file! 2024-04-17T10:34:12.615 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000634) opened an unlinked file! 2024-04-17T10:34:12.615 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000635) opened an unlinked file! 2024-04-17T10:34:12.615 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000636) opened an unlinked file! 2024-04-17T10:34:12.615 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000637) opened an unlinked file! 2024-04-17T10:34:12.615 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000638) opened an unlinked file! 2024-04-17T10:34:12.615 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000639) opened an unlinked file! 2024-04-17T10:34:12.615 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000640) opened an unlinked file! 2024-04-17T10:34:12.615 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000641) opened an unlinked file! 2024-04-17T10:34:12.615 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000642) opened an unlinked file! 2024-04-17T10:34:12.615 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000643) opened an unlinked file! 2024-04-17T10:34:12.615 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000644) opened an unlinked file! 2024-04-17T10:34:12.616 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000645) opened an unlinked file! 2024-04-17T10:34:12.616 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000646) opened an unlinked file! 2024-04-17T10:34:12.616 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000647) opened an unlinked file! 2024-04-17T10:34:12.616 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000648) opened an unlinked file! 2024-04-17T10:34:12.616 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000649) opened an unlinked file! 2024-04-17T10:34:12.616 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000650) opened an unlinked file! 2024-04-17T10:34:12.616 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000651) opened an unlinked file! 2024-04-17T10:34:12.616 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000652) opened an unlinked file! 2024-04-17T10:34:12.616 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000653) opened an unlinked file! 2024-04-17T10:34:12.616 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000654) opened an unlinked file! 2024-04-17T10:34:12.616 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000655) opened an unlinked file! 2024-04-17T10:34:12.616 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000656) opened an unlinked file! 2024-04-17T10:34:12.616 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000657) opened an unlinked file! 2024-04-17T10:34:12.616 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000658) opened an unlinked file! 2024-04-17T10:34:12.616 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000659) opened an unlinked file! 2024-04-17T10:34:12.617 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000660) opened an unlinked file! 2024-04-17T10:34:12.617 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000661) opened an unlinked file! 2024-04-17T10:34:12.617 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000662) opened an unlinked file! 2024-04-17T10:34:12.617 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000663) opened an unlinked file! 2024-04-17T10:34:12.617 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000664) opened an unlinked file! 2024-04-17T10:34:12.617 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000665) opened an unlinked file! 2024-04-17T10:34:12.617 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000666) opened an unlinked file! 2024-04-17T10:34:12.617 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000667) opened an unlinked file! 2024-04-17T10:34:12.617 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000668) opened an unlinked file! 2024-04-17T10:34:12.617 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000669) opened an unlinked file! 2024-04-17T10:34:12.617 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000670) opened an unlinked file! 2024-04-17T10:34:12.617 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000671) opened an unlinked file! 2024-04-17T10:34:12.617 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000672) opened an unlinked file! 2024-04-17T10:34:12.617 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000673) opened an unlinked file! 2024-04-17T10:34:12.617 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000674) opened an unlinked file! 2024-04-17T10:34:12.618 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000675) opened an unlinked file! 2024-04-17T10:34:12.618 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000676) opened an unlinked file! 2024-04-17T10:34:12.618 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000677) opened an unlinked file! 2024-04-17T10:34:12.618 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000678) opened an unlinked file! 2024-04-17T10:34:12.618 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000679) opened an unlinked file! 2024-04-17T10:34:12.618 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000680) opened an unlinked file! 2024-04-17T10:34:12.618 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000681) opened an unlinked file! 2024-04-17T10:34:12.618 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000682) opened an unlinked file! 2024-04-17T10:34:12.618 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000683) opened an unlinked file! 2024-04-17T10:34:12.618 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000684) opened an unlinked file! 2024-04-17T10:34:12.618 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000685) opened an unlinked file! 2024-04-17T10:34:12.618 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000686) opened an unlinked file! 2024-04-17T10:34:12.618 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000687) opened an unlinked file! 2024-04-17T10:34:12.618 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000688) opened an unlinked file! 2024-04-17T10:34:12.618 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000689) opened an unlinked file! 2024-04-17T10:34:12.619 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000690) opened an unlinked file! 2024-04-17T10:34:12.619 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000691) opened an unlinked file! 2024-04-17T10:34:12.619 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000692) opened an unlinked file! 2024-04-17T10:34:12.619 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000693) opened an unlinked file! 2024-04-17T10:34:12.619 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000694) opened an unlinked file! 2024-04-17T10:34:12.619 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000695) opened an unlinked file! 2024-04-17T10:34:12.619 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000696) opened an unlinked file! 2024-04-17T10:34:12.619 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000697) opened an unlinked file! 2024-04-17T10:34:12.619 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000698) opened an unlinked file! 2024-04-17T10:34:12.619 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000699) opened an unlinked file! 2024-04-17T10:34:12.619 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000700) opened an unlinked file! 2024-04-17T10:34:12.619 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000701) opened an unlinked file! 2024-04-17T10:34:12.619 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000702) opened an unlinked file! 2024-04-17T10:34:12.619 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000703) opened an unlinked file! 2024-04-17T10:34:12.619 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000704) opened an unlinked file! 2024-04-17T10:34:12.620 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000705) opened an unlinked file! 2024-04-17T10:34:12.620 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000706) opened an unlinked file! 2024-04-17T10:34:12.620 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000707) opened an unlinked file! 2024-04-17T10:34:12.620 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000708) opened an unlinked file! 2024-04-17T10:34:12.620 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000709) opened an unlinked file! 2024-04-17T10:34:12.620 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000710) opened an unlinked file! 2024-04-17T10:34:12.620 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000711) opened an unlinked file! 2024-04-17T10:34:12.620 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000712) opened an unlinked file! 2024-04-17T10:34:12.620 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000713) opened an unlinked file! 2024-04-17T10:34:12.620 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000714) opened an unlinked file! 2024-04-17T10:34:12.621 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000715) opened an unlinked file! 2024-04-17T10:34:12.621 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000716) opened an unlinked file! 2024-04-17T10:34:12.621 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000717) opened an unlinked file! 2024-04-17T10:34:12.621 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000718) opened an unlinked file! 2024-04-17T10:34:12.621 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000719) opened an unlinked file! 2024-04-17T10:34:12.621 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000720) opened an unlinked file! 2024-04-17T10:34:12.621 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000721) opened an unlinked file! 2024-04-17T10:34:12.621 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000722) opened an unlinked file! 2024-04-17T10:34:12.621 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000723) opened an unlinked file! 2024-04-17T10:34:12.621 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000724) opened an unlinked file! 2024-04-17T10:34:12.621 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000725) opened an unlinked file! 2024-04-17T10:34:12.621 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000726) opened an unlinked file! 2024-04-17T10:34:12.622 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000727) opened an unlinked file! 2024-04-17T10:34:12.622 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000728) opened an unlinked file! 2024-04-17T10:34:12.622 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000729) opened an unlinked file! 2024-04-17T10:34:12.622 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000730) opened an unlinked file! 2024-04-17T10:34:12.622 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000731) opened an unlinked file! 2024-04-17T10:34:12.622 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000732) opened an unlinked file! 2024-04-17T10:34:12.623 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000733) opened an unlinked file! 2024-04-17T10:34:12.623 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000734) opened an unlinked file! 2024-04-17T10:34:12.623 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000735) opened an unlinked file! 2024-04-17T10:34:12.623 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000736) opened an unlinked file! 2024-04-17T10:34:12.623 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000737) opened an unlinked file! 2024-04-17T10:34:12.623 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000738) opened an unlinked file! 2024-04-17T10:34:12.623 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000739) opened an unlinked file! 2024-04-17T10:34:12.624 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000740) opened an unlinked file! 2024-04-17T10:34:12.624 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000741) opened an unlinked file! 2024-04-17T10:34:12.624 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000742) opened an unlinked file! 2024-04-17T10:34:12.624 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000743) opened an unlinked file! 2024-04-17T10:34:12.624 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000744) opened an unlinked file! 2024-04-17T10:34:12.624 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000745) opened an unlinked file! 2024-04-17T10:34:12.625 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000746) opened an unlinked file! 2024-04-17T10:34:12.625 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000747) opened an unlinked file! 2024-04-17T10:34:12.625 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000748) opened an unlinked file! 2024-04-17T10:34:12.625 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000749) opened an unlinked file! 2024-04-17T10:34:12.625 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000750) opened an unlinked file! 2024-04-17T10:34:12.625 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000751) opened an unlinked file! 2024-04-17T10:34:12.625 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000752) opened an unlinked file! 2024-04-17T10:34:12.626 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000753) opened an unlinked file! 2024-04-17T10:34:12.626 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000754) opened an unlinked file! 2024-04-17T10:34:12.626 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000755) opened an unlinked file! 2024-04-17T10:34:12.626 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000756) opened an unlinked file! 2024-04-17T10:34:12.626 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000757) opened an unlinked file! 2024-04-17T10:34:12.626 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000758) opened an unlinked file! 2024-04-17T10:34:12.627 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000759) opened an unlinked file! 2024-04-17T10:34:12.627 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000760) opened an unlinked file! 2024-04-17T10:34:12.627 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000761) opened an unlinked file! 2024-04-17T10:34:12.627 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000762) opened an unlinked file! 2024-04-17T10:34:12.627 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000763) opened an unlinked file! 2024-04-17T10:34:12.627 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000764) opened an unlinked file! 2024-04-17T10:34:12.628 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000765) opened an unlinked file! 2024-04-17T10:34:12.628 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000766) opened an unlinked file! 2024-04-17T10:34:12.628 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000767) opened an unlinked file! 2024-04-17T10:34:12.628 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000768) opened an unlinked file! 2024-04-17T10:34:12.628 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000769) opened an unlinked file! 2024-04-17T10:34:12.628 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000770) opened an unlinked file! 2024-04-17T10:34:12.629 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000771) opened an unlinked file! 2024-04-17T10:34:12.629 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000772) opened an unlinked file! 2024-04-17T10:34:12.629 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000773) opened an unlinked file! 2024-04-17T10:34:12.629 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000774) opened an unlinked file! 2024-04-17T10:34:12.629 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000775) opened an unlinked file! 2024-04-17T10:34:12.629 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000776) opened an unlinked file! 2024-04-17T10:34:12.629 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000777) opened an unlinked file! 2024-04-17T10:34:12.630 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000778) opened an unlinked file! 2024-04-17T10:34:12.630 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000779) opened an unlinked file! 2024-04-17T10:34:12.630 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000780) opened an unlinked file! 2024-04-17T10:34:12.630 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000781) opened an unlinked file! 2024-04-17T10:34:12.630 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000782) opened an unlinked file! 2024-04-17T10:34:12.630 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000783) opened an unlinked file! 2024-04-17T10:34:12.631 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000784) opened an unlinked file! 2024-04-17T10:34:12.631 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000785) opened an unlinked file! 2024-04-17T10:34:12.631 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000786) opened an unlinked file! 2024-04-17T10:34:12.631 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000787) opened an unlinked file! 2024-04-17T10:34:12.631 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000788) opened an unlinked file! 2024-04-17T10:34:12.631 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000789) opened an unlinked file! 2024-04-17T10:34:12.632 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000790) opened an unlinked file! 2024-04-17T10:34:12.632 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000791) opened an unlinked file! 2024-04-17T10:34:12.632 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000792) opened an unlinked file! 2024-04-17T10:34:12.632 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000793) opened an unlinked file! 2024-04-17T10:34:12.632 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000794) opened an unlinked file! 2024-04-17T10:34:12.632 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000795) opened an unlinked file! 2024-04-17T10:34:12.633 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000796) opened an unlinked file! 2024-04-17T10:34:12.633 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000797) opened an unlinked file! 2024-04-17T10:34:12.633 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000798) opened an unlinked file! 2024-04-17T10:34:12.633 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000799) opened an unlinked file! 2024-04-17T10:34:12.633 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000800) opened an unlinked file! 2024-04-17T10:34:12.633 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000801) opened an unlinked file! 2024-04-17T10:34:12.634 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000802) opened an unlinked file! 2024-04-17T10:34:12.634 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000803) opened an unlinked file! 2024-04-17T10:34:12.634 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000804) opened an unlinked file! 2024-04-17T10:34:12.634 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000805) opened an unlinked file! 2024-04-17T10:34:12.634 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000806) opened an unlinked file! 2024-04-17T10:34:12.635 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000807) opened an unlinked file! 2024-04-17T10:34:12.635 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000808) opened an unlinked file! 2024-04-17T10:34:12.635 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000809) opened an unlinked file! 2024-04-17T10:34:12.635 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000810) opened an unlinked file! 2024-04-17T10:34:12.635 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000811) opened an unlinked file! 2024-04-17T10:34:12.635 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000812) opened an unlinked file! 2024-04-17T10:34:12.636 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000813) opened an unlinked file! 2024-04-17T10:34:12.636 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000814) opened an unlinked file! 2024-04-17T10:34:12.636 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000815) opened an unlinked file! 2024-04-17T10:34:12.636 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000816) opened an unlinked file! 2024-04-17T10:34:12.636 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000817) opened an unlinked file! 2024-04-17T10:34:12.636 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000818) opened an unlinked file! 2024-04-17T10:34:12.637 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000819) opened an unlinked file! 2024-04-17T10:34:12.637 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000820) opened an unlinked file! 2024-04-17T10:34:12.637 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000821) opened an unlinked file! 2024-04-17T10:34:12.637 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000822) opened an unlinked file! 2024-04-17T10:34:12.637 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000823) opened an unlinked file! 2024-04-17T10:34:12.637 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000824) opened an unlinked file! 2024-04-17T10:34:12.637 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000825) opened an unlinked file! 2024-04-17T10:34:12.638 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000826) opened an unlinked file! 2024-04-17T10:34:12.638 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000827) opened an unlinked file! 2024-04-17T10:34:12.638 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000828) opened an unlinked file! 2024-04-17T10:34:12.638 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000829) opened an unlinked file! 2024-04-17T10:34:12.638 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000830) opened an unlinked file! 2024-04-17T10:34:12.638 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000831) opened an unlinked file! 2024-04-17T10:34:12.639 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000832) opened an unlinked file! 2024-04-17T10:34:12.639 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000833) opened an unlinked file! 2024-04-17T10:34:12.639 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000834) opened an unlinked file! 2024-04-17T10:34:12.639 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000835) opened an unlinked file! 2024-04-17T10:34:12.639 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000836) opened an unlinked file! 2024-04-17T10:34:12.639 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000837) opened an unlinked file! 2024-04-17T10:34:12.639 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000838) opened an unlinked file! 2024-04-17T10:34:12.639 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000839) opened an unlinked file! 2024-04-17T10:34:12.640 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000840) opened an unlinked file! 2024-04-17T10:34:12.640 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000841) opened an unlinked file! 2024-04-17T10:34:12.640 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000842) opened an unlinked file! 2024-04-17T10:34:12.640 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000843) opened an unlinked file! 2024-04-17T10:34:12.640 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000844) opened an unlinked file! 2024-04-17T10:34:12.640 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000845) opened an unlinked file! 2024-04-17T10:34:12.640 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000846) opened an unlinked file! 2024-04-17T10:34:12.641 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000847) opened an unlinked file! 2024-04-17T10:34:12.641 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000848) opened an unlinked file! 2024-04-17T10:34:12.641 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000849) opened an unlinked file! 2024-04-17T10:34:12.641 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000850) opened an unlinked file! 2024-04-17T10:34:12.641 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000851) opened an unlinked file! 2024-04-17T10:34:12.641 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000852) opened an unlinked file! 2024-04-17T10:34:12.642 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000853) opened an unlinked file! 2024-04-17T10:34:12.642 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000854) opened an unlinked file! 2024-04-17T10:34:12.642 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000855) opened an unlinked file! 2024-04-17T10:34:12.642 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000856) opened an unlinked file! 2024-04-17T10:34:12.642 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000857) opened an unlinked file! 2024-04-17T10:34:12.642 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000858) opened an unlinked file! 2024-04-17T10:34:12.643 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000859) opened an unlinked file! 2024-04-17T10:34:12.643 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000860) opened an unlinked file! 2024-04-17T10:34:12.643 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000861) opened an unlinked file! 2024-04-17T10:34:12.643 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000862) opened an unlinked file! 2024-04-17T10:34:12.643 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000863) opened an unlinked file! 2024-04-17T10:34:12.643 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000864) opened an unlinked file! 2024-04-17T10:34:12.644 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000865) opened an unlinked file! 2024-04-17T10:34:12.644 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000866) opened an unlinked file! 2024-04-17T10:34:12.644 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000867) opened an unlinked file! 2024-04-17T10:34:12.644 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000868) opened an unlinked file! 2024-04-17T10:34:12.644 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000869) opened an unlinked file! 2024-04-17T10:34:12.644 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000870) opened an unlinked file! 2024-04-17T10:34:12.644 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000871) opened an unlinked file! 2024-04-17T10:34:12.645 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000872) opened an unlinked file! 2024-04-17T10:34:12.645 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000873) opened an unlinked file! 2024-04-17T10:34:12.645 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000874) opened an unlinked file! 2024-04-17T10:34:12.645 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000875) opened an unlinked file! 2024-04-17T10:34:12.645 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000876) opened an unlinked file! 2024-04-17T10:34:12.645 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000877) opened an unlinked file! 2024-04-17T10:34:12.646 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000878) opened an unlinked file! 2024-04-17T10:34:12.646 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000879) opened an unlinked file! 2024-04-17T10:34:12.646 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000880) opened an unlinked file! 2024-04-17T10:34:12.646 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000881) opened an unlinked file! 2024-04-17T10:34:12.646 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000882) opened an unlinked file! 2024-04-17T10:34:12.646 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000883) opened an unlinked file! 2024-04-17T10:34:12.647 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000884) opened an unlinked file! 2024-04-17T10:34:12.647 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000885) opened an unlinked file! 2024-04-17T10:34:12.647 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000886) opened an unlinked file! 2024-04-17T10:34:12.647 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000887) opened an unlinked file! 2024-04-17T10:34:12.647 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000888) opened an unlinked file! 2024-04-17T10:34:12.647 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000889) opened an unlinked file! 2024-04-17T10:34:12.647 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000890) opened an unlinked file! 2024-04-17T10:34:12.648 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000891) opened an unlinked file! 2024-04-17T10:34:12.648 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000892) opened an unlinked file! 2024-04-17T10:34:12.648 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000893) opened an unlinked file! 2024-04-17T10:34:12.648 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000894) opened an unlinked file! 2024-04-17T10:34:12.648 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000895) opened an unlinked file! 2024-04-17T10:34:12.648 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000896) opened an unlinked file! 2024-04-17T10:34:12.649 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000897) opened an unlinked file! 2024-04-17T10:34:12.649 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000898) opened an unlinked file! 2024-04-17T10:34:12.649 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000899) opened an unlinked file! 2024-04-17T10:34:12.649 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000900) opened an unlinked file! 2024-04-17T10:34:12.649 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000901) opened an unlinked file! 2024-04-17T10:34:12.649 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000902) opened an unlinked file! 2024-04-17T10:34:12.650 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000903) opened an unlinked file! 2024-04-17T10:34:12.650 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000904) opened an unlinked file! 2024-04-17T10:34:12.650 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000905) opened an unlinked file! 2024-04-17T10:34:12.650 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000906) opened an unlinked file! 2024-04-17T10:34:12.650 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000907) opened an unlinked file! 2024-04-17T10:34:12.650 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000908) opened an unlinked file! 2024-04-17T10:34:12.651 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000909) opened an unlinked file! 2024-04-17T10:34:12.651 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000910) opened an unlinked file! 2024-04-17T10:34:12.651 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000911) opened an unlinked file! 2024-04-17T10:34:12.651 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000912) opened an unlinked file! 2024-04-17T10:34:12.651 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000913) opened an unlinked file! 2024-04-17T10:34:12.651 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000914) opened an unlinked file! 2024-04-17T10:34:12.651 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000915) opened an unlinked file! 2024-04-17T10:34:12.651 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000916) opened an unlinked file! 2024-04-17T10:34:12.651 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000917) opened an unlinked file! 2024-04-17T10:34:12.651 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000918) opened an unlinked file! 2024-04-17T10:34:12.652 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000919) opened an unlinked file! 2024-04-17T10:34:12.652 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000920) opened an unlinked file! 2024-04-17T10:34:12.653 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000921) opened an unlinked file! 2024-04-17T10:34:12.653 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000922) opened an unlinked file! 2024-04-17T10:34:12.654 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000923) opened an unlinked file! 2024-04-17T10:34:12.654 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000924) opened an unlinked file! 2024-04-17T10:34:12.654 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000925) opened an unlinked file! 2024-04-17T10:34:12.654 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000926) opened an unlinked file! 2024-04-17T10:34:12.654 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000927) opened an unlinked file! 2024-04-17T10:34:12.654 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000928) opened an unlinked file! 2024-04-17T10:34:12.655 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000929) opened an unlinked file! 2024-04-17T10:34:12.655 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000930) opened an unlinked file! 2024-04-17T10:34:12.655 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000931) opened an unlinked file! 2024-04-17T10:34:12.655 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000932) opened an unlinked file! 2024-04-17T10:34:12.655 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000933) opened an unlinked file! 2024-04-17T10:34:12.655 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000934) opened an unlinked file! 2024-04-17T10:34:12.656 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000935) opened an unlinked file! 2024-04-17T10:34:12.656 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000936) opened an unlinked file! 2024-04-17T10:34:12.656 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000937) opened an unlinked file! 2024-04-17T10:34:12.656 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000938) opened an unlinked file! 2024-04-17T10:34:12.656 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000939) opened an unlinked file! 2024-04-17T10:34:12.657 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000940) opened an unlinked file! 2024-04-17T10:34:12.657 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000941) opened an unlinked file! 2024-04-17T10:34:12.657 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000942) opened an unlinked file! 2024-04-17T10:34:12.657 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000943) opened an unlinked file! 2024-04-17T10:34:12.657 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000944) opened an unlinked file! 2024-04-17T10:34:12.657 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000945) opened an unlinked file! 2024-04-17T10:34:12.658 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000946) opened an unlinked file! 2024-04-17T10:34:12.658 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000947) opened an unlinked file! 2024-04-17T10:34:12.658 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000948) opened an unlinked file! 2024-04-17T10:34:12.658 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000949) opened an unlinked file! 2024-04-17T10:34:12.658 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000950) opened an unlinked file! 2024-04-17T10:34:12.659 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000951) opened an unlinked file! 2024-04-17T10:34:12.659 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000952) opened an unlinked file! 2024-04-17T10:34:12.659 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000953) opened an unlinked file! 2024-04-17T10:34:12.659 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000954) opened an unlinked file! 2024-04-17T10:34:12.659 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000955) opened an unlinked file! 2024-04-17T10:34:12.659 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000956) opened an unlinked file! 2024-04-17T10:34:12.660 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000957) opened an unlinked file! 2024-04-17T10:34:12.660 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000958) opened an unlinked file! 2024-04-17T10:34:12.660 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000959) opened an unlinked file! 2024-04-17T10:34:12.660 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000960) opened an unlinked file! 2024-04-17T10:34:12.660 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000961) opened an unlinked file! 2024-04-17T10:34:12.660 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000962) opened an unlinked file! 2024-04-17T10:34:12.661 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000963) opened an unlinked file! 2024-04-17T10:34:12.661 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000964) opened an unlinked file! 2024-04-17T10:34:12.661 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000965) opened an unlinked file! 2024-04-17T10:34:12.661 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000966) opened an unlinked file! 2024-04-17T10:34:12.661 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000967) opened an unlinked file! 2024-04-17T10:34:12.661 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000968) opened an unlinked file! 2024-04-17T10:34:12.662 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000969) opened an unlinked file! 2024-04-17T10:34:12.662 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000970) opened an unlinked file! 2024-04-17T10:34:12.662 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000971) opened an unlinked file! 2024-04-17T10:34:12.662 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000972) opened an unlinked file! 2024-04-17T10:34:12.662 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000973) opened an unlinked file! 2024-04-17T10:34:12.662 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000974) opened an unlinked file! 2024-04-17T10:34:12.663 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000975) opened an unlinked file! 2024-04-17T10:34:12.663 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000976) opened an unlinked file! 2024-04-17T10:34:12.663 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000977) opened an unlinked file! 2024-04-17T10:34:12.663 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000978) opened an unlinked file! 2024-04-17T10:34:12.663 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000979) opened an unlinked file! 2024-04-17T10:34:12.663 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000980) opened an unlinked file! 2024-04-17T10:34:12.664 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000981) opened an unlinked file! 2024-04-17T10:34:12.664 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000982) opened an unlinked file! 2024-04-17T10:34:12.664 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000983) opened an unlinked file! 2024-04-17T10:34:12.664 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000984) opened an unlinked file! 2024-04-17T10:34:12.664 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000985) opened an unlinked file! 2024-04-17T10:34:12.664 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000986) opened an unlinked file! 2024-04-17T10:34:12.665 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000987) opened an unlinked file! 2024-04-17T10:34:12.665 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000988) opened an unlinked file! 2024-04-17T10:34:12.665 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000989) opened an unlinked file! 2024-04-17T10:34:12.665 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000990) opened an unlinked file! 2024-04-17T10:34:12.665 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000991) opened an unlinked file! 2024-04-17T10:34:12.665 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000992) opened an unlinked file! 2024-04-17T10:34:12.665 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000993) opened an unlinked file! 2024-04-17T10:34:12.666 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000994) opened an unlinked file! 2024-04-17T10:34:12.666 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000995) opened an unlinked file! 2024-04-17T10:34:12.666 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000996) opened an unlinked file! 2024-04-17T10:34:12.666 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000997) opened an unlinked file! 2024-04-17T10:34:12.666 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000998) opened an unlinked file! 2024-04-17T10:34:12.667 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file000999) opened an unlinked file! 2024-04-17T10:34:12.667 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file001000) opened an unlinked file! 2024-04-17T10:34:12.667 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file001001) opened an unlinked file! 2024-04-17T10:34:12.667 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file001002) opened an unlinked file! 2024-04-17T10:34:12.667 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file001003) opened an unlinked file! 2024-04-17T10:34:12.667 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file001004) opened an unlinked file! 2024-04-17T10:34:12.667 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file001005) opened an unlinked file! 2024-04-17T10:34:12.667 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file001006) opened an unlinked file! 2024-04-17T10:34:12.667 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file001007) opened an unlinked file! 2024-04-17T10:34:12.668 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file001008) opened an unlinked file! 2024-04-17T10:34:12.668 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file001009) opened an unlinked file! 2024-04-17T10:34:12.668 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file001010) opened an unlinked file! 2024-04-17T10:34:12.668 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file001011) opened an unlinked file! 2024-04-17T10:34:12.668 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file001012) opened an unlinked file! 2024-04-17T10:34:12.668 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file001013) opened an unlinked file! 2024-04-17T10:34:12.668 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file001014) opened an unlinked file! 2024-04-17T10:34:12.668 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file001015) opened an unlinked file! 2024-04-17T10:34:12.669 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file001016) opened an unlinked file! 2024-04-17T10:34:12.669 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file001017) opened an unlinked file! 2024-04-17T10:34:12.669 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file001018) opened an unlinked file! 2024-04-17T10:34:12.669 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file001019) opened an unlinked file! 2024-04-17T10:34:12.669 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file001020) opened an unlinked file! 2024-04-17T10:34:12.669 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file001021) opened an unlinked file! 2024-04-17T10:34:12.669 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file001022) opened an unlinked file! 2024-04-17T10:34:12.669 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/426-dir/file001023) opened an unlinked file! 2024-04-17T10:34:12.669 INFO:teuthology.orchestra.run.smithi152.stdout: test_file_handles TEST_DIR/426-dir 2024-04-17T10:34:12.670 INFO:teuthology.orchestra.run.smithi152.stdout: test_file_handles TEST_DIR/426-dir -l 2024-04-17T10:34:12.670 INFO:teuthology.orchestra.run.smithi152.stdout: test_file_handles TEST_DIR/426-dir -u 2024-04-17T10:34:12.671 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/426 2024-04-17T10:34:12.671 INFO:teuthology.orchestra.run.smithi152.stdout:Failures: generic/426 2024-04-17T10:34:12.671 INFO:teuthology.orchestra.run.smithi152.stdout:Failed 1 of 1 tests 2024-04-17T10:34:12.671 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:34:12.795 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T10:34:12.796 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-04-17T10:34:12.796 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-04-17T10:34:12.796 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2024-04-17T10:34:14.618 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:34:14.628 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:34:14.629 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:34:14.978 INFO:teuthology.orchestra.run.smithi152.stdout:generic/427 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:34:14.986 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/427 2024-04-17T10:34:14.986 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/427 2024-04-17T10:34:14.986 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:34:14.992 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:34:15.011 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:34:15.011 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2024-04-17T10:34:15.391 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:34:15.401 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:34:15.401 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:34:15.746 INFO:teuthology.orchestra.run.smithi152.stdout:generic/428 0s 2024-04-17T10:34:15.758 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/428 2024-04-17T10:34:15.758 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:34:15.764 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:34:15.783 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:34:15.784 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2024-04-17T10:34:16.168 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:34:16.177 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:34:16.178 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:34:16.511 INFO:teuthology.orchestra.run.smithi152.stdout:generic/429 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:34:16.519 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/429 2024-04-17T10:34:16.520 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/429 2024-04-17T10:34:16.520 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:34:16.525 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:34:16.544 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:34:16.545 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2024-04-17T10:34:16.887 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:34:16.897 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:34:16.897 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:34:17.418 INFO:teuthology.orchestra.run.smithi152.stdout:generic/430 1s 2024-04-17T10:34:17.430 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/430 2024-04-17T10:34:17.430 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:34:17.436 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:34:17.456 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:34:17.457 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2024-04-17T10:34:18.119 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:34:18.129 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:34:18.129 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:34:18.622 INFO:teuthology.orchestra.run.smithi152.stdout:generic/431 0s 2024-04-17T10:34:18.634 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/431 2024-04-17T10:34:18.634 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:34:18.640 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:34:18.661 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:34:18.661 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2024-04-17T10:34:19.311 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:34:19.321 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:34:19.321 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:34:19.860 INFO:teuthology.orchestra.run.smithi152.stdout:generic/432 0s 2024-04-17T10:34:19.872 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/432 2024-04-17T10:34:19.872 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:34:19.878 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:34:19.899 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:34:19.899 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2024-04-17T10:34:20.591 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:34:20.601 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:34:20.601 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:34:20.805 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:34:20.808 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:34:21.053 INFO:teuthology.orchestra.run.smithi152.stdout:generic/433 1s 2024-04-17T10:34:21.065 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/433 2024-04-17T10:34:21.066 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:34:21.075 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:34:21.091 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:34:21.091 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2024-04-17T10:34:21.738 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:34:21.748 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:34:21.749 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:34:22.211 INFO:teuthology.orchestra.run.smithi152.stdout:generic/434 - output mismatch (see /tmp/tmp.pJW3k3pP3vxfstests-dev/results//generic/434.out.bad) 2024-04-17T10:34:22.216 INFO:teuthology.orchestra.run.smithi152.stdout: --- tests/generic/434.out 2024-04-17 08:48:08.577451826 +0000 2024-04-17T10:34:22.216 INFO:teuthology.orchestra.run.smithi152.stdout: +++ /tmp/tmp.pJW3k3pP3vxfstests-dev/results//generic/434.out.bad 2024-04-17 10:34:22.211556020 +0000 2024-04-17T10:34:22.216 INFO:teuthology.orchestra.run.smithi152.stdout: @@ -9,6 +9,6 @@ 2024-04-17T10:34:22.216 INFO:teuthology.orchestra.run.smithi152.stdout: copy_range: Bad file descriptor 2024-04-17T10:34:22.216 INFO:teuthology.orchestra.run.smithi152.stdout: d41d8cd98f00b204e9800998ecf8427e TEST_DIR/test-434/copy 2024-04-17T10:34:22.216 INFO:teuthology.orchestra.run.smithi152.stdout: Try to copy to a device 2024-04-17T10:34:22.217 INFO:teuthology.orchestra.run.smithi152.stdout: -copy_range: Invalid argument 2024-04-17T10:34:22.217 INFO:teuthology.orchestra.run.smithi152.stdout: +/tmp/tmp.N9QxrNRIp4test/test-434/dev1: Permission denied 2024-04-17T10:34:22.217 INFO:teuthology.orchestra.run.smithi152.stdout: Try to copy to a fifo 2024-04-17T10:34:22.217 INFO:teuthology.orchestra.run.smithi152.stdout: copy_range: Invalid argument 2024-04-17T10:34:22.222 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/434 2024-04-17T10:34:22.222 INFO:teuthology.orchestra.run.smithi152.stdout:Failures: generic/434 2024-04-17T10:34:22.222 INFO:teuthology.orchestra.run.smithi152.stdout:Failed 1 of 1 tests 2024-04-17T10:34:22.228 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:34:22.248 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T10:34:22.248 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-04-17T10:34:22.249 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-04-17T10:34:22.249 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2024-04-17T10:34:22.967 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:34:22.977 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:34:22.977 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:34:23.310 INFO:teuthology.orchestra.run.smithi152.stdout:generic/435 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:34:23.317 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/435 2024-04-17T10:34:23.317 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/435 2024-04-17T10:34:23.318 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:34:23.324 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:34:23.343 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:34:23.343 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2024-04-17T10:34:23.732 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:34:23.742 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:34:23.742 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:34:25.014 INFO:teuthology.orchestra.run.smithi152.stdout:generic/436 2s 2024-04-17T10:34:25.026 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/436 2024-04-17T10:34:25.027 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:34:25.033 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:34:25.275 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:34:25.276 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2024-04-17T10:34:25.751 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:34:25.761 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:34:25.761 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:34:26.890 INFO:teuthology.orchestra.run.smithi152.stdout:generic/437 1s 2024-04-17T10:34:26.902 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/437 2024-04-17T10:34:26.902 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:34:26.908 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:34:26.928 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:34:26.928 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2024-04-17T10:34:27.299 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:34:27.309 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:34:27.309 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:34:50.982 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:34:50.986 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:35:21.044 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:35:21.048 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:35:51.108 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:35:51.112 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:36:03.491 INFO:teuthology.orchestra.run.smithi152.stdout:generic/438 96s 2024-04-17T10:36:03.503 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/438 2024-04-17T10:36:03.503 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:36:03.509 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:03.531 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:36:03.531 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2024-04-17T10:36:03.892 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:36:03.902 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:36:03.902 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:04.192 INFO:teuthology.orchestra.run.smithi152.stdout:generic/439 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:36:04.201 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/439 2024-04-17T10:36:04.201 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/439 2024-04-17T10:36:04.201 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:36:04.207 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:04.226 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:36:04.227 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2024-04-17T10:36:04.581 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:36:04.591 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:36:04.591 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:04.923 INFO:teuthology.orchestra.run.smithi152.stdout:generic/440 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:36:04.931 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/440 2024-04-17T10:36:04.931 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/440 2024-04-17T10:36:04.931 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:36:04.937 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:04.957 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:36:04.957 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2024-04-17T10:36:05.323 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:36:05.333 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:36:05.333 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:05.690 INFO:teuthology.orchestra.run.smithi152.stdout:generic/441 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:36:05.698 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/441 2024-04-17T10:36:05.698 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/441 2024-04-17T10:36:05.698 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:36:05.704 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:05.724 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:36:05.724 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2024-04-17T10:36:06.086 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:36:06.096 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:36:06.096 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:06.378 INFO:teuthology.orchestra.run.smithi152.stdout:generic/442 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:36:06.386 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/442 2024-04-17T10:36:06.386 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/442 2024-04-17T10:36:06.386 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:36:06.392 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:06.413 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:36:06.413 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2024-04-17T10:36:06.769 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:36:06.779 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:36:06.779 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:07.099 INFO:teuthology.orchestra.run.smithi152.stdout:generic/443 1s 2024-04-17T10:36:07.111 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/443 2024-04-17T10:36:07.111 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:36:07.117 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:07.137 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:36:07.138 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2024-04-17T10:36:07.511 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:36:07.521 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:36:07.521 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:07.850 INFO:teuthology.orchestra.run.smithi152.stdout:generic/444 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-04-17T10:36:07.858 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/444 2024-04-17T10:36:07.858 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/444 2024-04-17T10:36:07.858 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:36:07.864 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:07.882 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:36:07.883 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2024-04-17T10:36:08.255 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:36:08.266 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:36:08.266 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:10.095 INFO:teuthology.orchestra.run.smithi152.stdout:generic/445 1s 2024-04-17T10:36:10.108 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/445 2024-04-17T10:36:10.108 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:36:10.114 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:10.144 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:36:10.145 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2024-04-17T10:36:10.803 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:36:10.813 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:36:10.813 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:11.093 INFO:teuthology.orchestra.run.smithi152.stdout:generic/446 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:36:11.101 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/446 2024-04-17T10:36:11.101 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/446 2024-04-17T10:36:11.101 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:36:11.107 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:11.126 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:36:11.126 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2024-04-17T10:36:11.491 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:36:11.501 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:36:11.501 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:11.771 INFO:teuthology.orchestra.run.smithi152.stdout:generic/447 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:36:11.779 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/447 2024-04-17T10:36:11.779 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/447 2024-04-17T10:36:11.780 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:36:11.785 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:11.805 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:36:11.805 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2024-04-17T10:36:12.158 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:36:12.168 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:36:12.169 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:13.173 INFO:teuthology.orchestra.run.smithi152.stdout:generic/448 1s 2024-04-17T10:36:13.186 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/448 2024-04-17T10:36:13.186 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:36:13.192 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:13.408 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:36:13.408 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2024-04-17T10:36:13.887 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:36:13.899 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:36:13.899 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:14.191 INFO:teuthology.orchestra.run.smithi152.stdout:generic/449 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:36:14.199 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/449 2024-04-17T10:36:14.199 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/449 2024-04-17T10:36:14.199 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:36:14.205 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:14.224 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:36:14.225 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2024-04-17T10:36:14.572 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:36:14.582 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:36:14.582 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:16.098 INFO:teuthology.orchestra.run.smithi152.stdout:generic/450 2s 2024-04-17T10:36:16.110 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/450 2024-04-17T10:36:16.110 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:36:16.116 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:16.336 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:36:16.336 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2024-04-17T10:36:16.799 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:36:16.809 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:36:16.809 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:17.447 INFO:teuthology.orchestra.run.smithi152.stdout:generic/451 - output mismatch (see /tmp/tmp.pJW3k3pP3vxfstests-dev/results//generic/451.out.bad) 2024-04-17T10:36:17.452 INFO:teuthology.orchestra.run.smithi152.stdout: --- tests/generic/451.out 2024-04-17 08:48:08.581451781 +0000 2024-04-17T10:36:17.452 INFO:teuthology.orchestra.run.smithi152.stdout: +++ /tmp/tmp.pJW3k3pP3vxfstests-dev/results//generic/451.out.bad 2024-04-17 10:36:17.446316312 +0000 2024-04-17T10:36:17.452 INFO:teuthology.orchestra.run.smithi152.stdout: @@ -1,2 +1,5 @@ 2024-04-17T10:36:17.452 INFO:teuthology.orchestra.run.smithi152.stdout: QA output created by 451 2024-04-17T10:36:17.453 INFO:teuthology.orchestra.run.smithi152.stdout: +get stale data from buffer read 2024-04-17T10:36:17.453 INFO:teuthology.orchestra.run.smithi152.stdout: +00000000 55 55 55 55 55 55 55 55 55 55 55 55 55 55 55 55 UUUUUUUUUUUUUUUU 2024-04-17T10:36:17.453 INFO:teuthology.orchestra.run.smithi152.stdout: +000a0000 2024-04-17T10:36:17.453 INFO:teuthology.orchestra.run.smithi152.stdout: Silence is golden 2024-04-17T10:36:17.458 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/451 2024-04-17T10:36:17.458 INFO:teuthology.orchestra.run.smithi152.stdout:Failures: generic/451 2024-04-17T10:36:17.458 INFO:teuthology.orchestra.run.smithi152.stdout:Failed 1 of 1 tests 2024-04-17T10:36:17.464 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:17.482 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T10:36:17.483 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-04-17T10:36:17.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-04-17T10:36:17.483 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2024-04-17T10:36:18.151 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:36:18.161 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:36:18.162 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:18.440 INFO:teuthology.orchestra.run.smithi152.stdout:generic/452 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:36:18.447 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/452 2024-04-17T10:36:18.448 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/452 2024-04-17T10:36:18.448 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:36:18.454 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:18.472 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:36:18.473 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2024-04-17T10:36:18.827 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:36:18.837 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:36:18.837 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:19.092 INFO:teuthology.orchestra.run.smithi152.stdout:generic/453 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:36:19.100 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/453 2024-04-17T10:36:19.100 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/453 2024-04-17T10:36:19.100 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:36:19.106 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:19.167 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:36:19.167 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2024-04-17T10:36:19.523 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:36:19.533 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:36:19.533 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:19.814 INFO:teuthology.orchestra.run.smithi152.stdout:generic/454 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:36:19.822 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/454 2024-04-17T10:36:19.822 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/454 2024-04-17T10:36:19.822 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:36:19.828 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:19.903 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:36:19.903 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2024-04-17T10:36:20.244 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:36:20.254 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:36:20.254 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:20.642 INFO:teuthology.orchestra.run.smithi152.stdout:generic/455 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:36:20.650 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/455 2024-04-17T10:36:20.650 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/455 2024-04-17T10:36:20.650 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:36:20.656 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:20.675 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:36:20.675 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2024-04-17T10:36:21.027 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:36:21.037 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:36:21.037 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:21.337 INFO:teuthology.orchestra.run.smithi152.stdout:generic/456 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:36:21.340 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/456 2024-04-17T10:36:21.340 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/456 2024-04-17T10:36:21.340 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:36:21.351 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:21.366 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:36:21.366 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2024-04-17T10:36:21.755 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:36:21.765 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:36:21.765 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:22.051 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:36:22.057 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:36:22.142 INFO:teuthology.orchestra.run.smithi152.stdout:generic/457 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:36:22.150 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/457 2024-04-17T10:36:22.150 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/457 2024-04-17T10:36:22.150 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:36:22.156 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:22.175 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:36:22.175 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2024-04-17T10:36:22.523 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:36:22.534 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:36:22.534 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:22.805 INFO:teuthology.orchestra.run.smithi152.stdout:generic/458 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:36:22.813 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/458 2024-04-17T10:36:22.813 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/458 2024-04-17T10:36:22.813 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:36:22.819 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:22.839 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:36:22.839 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2024-04-17T10:36:23.200 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:36:23.210 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:36:23.210 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:23.625 INFO:teuthology.orchestra.run.smithi152.stdout:generic/459 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:36:23.633 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/459 2024-04-17T10:36:23.633 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/459 2024-04-17T10:36:23.633 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:36:23.639 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:23.659 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:36:23.659 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2024-04-17T10:36:24.040 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:36:24.050 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:36:24.050 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:24.330 INFO:teuthology.orchestra.run.smithi152.stdout:generic/460 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:36:24.338 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/460 2024-04-17T10:36:24.338 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/460 2024-04-17T10:36:24.338 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:36:24.344 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:24.362 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:36:24.363 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2024-04-17T10:36:24.731 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:36:24.741 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:36:24.741 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:25.042 INFO:teuthology.orchestra.run.smithi152.stdout:generic/461 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:36:25.050 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/461 2024-04-17T10:36:25.050 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/461 2024-04-17T10:36:25.050 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:36:25.056 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:25.075 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:36:25.075 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2024-04-17T10:36:25.456 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:36:25.466 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:36:25.467 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:25.823 INFO:teuthology.orchestra.run.smithi152.stdout:generic/462 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:36:25.831 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/462 2024-04-17T10:36:25.831 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/462 2024-04-17T10:36:25.831 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:36:25.837 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:25.856 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:36:25.856 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2024-04-17T10:36:26.225 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:36:26.235 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:36:26.235 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:26.871 INFO:teuthology.orchestra.run.smithi152.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-17T10:36:26.879 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/463 2024-04-17T10:36:26.880 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/463 2024-04-17T10:36:26.880 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:36:26.885 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:26.922 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:36:26.922 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2024-04-17T10:36:27.548 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:36:27.559 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:36:27.559 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:27.823 INFO:teuthology.orchestra.run.smithi152.stdout:generic/464 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:36:27.831 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/464 2024-04-17T10:36:27.831 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/464 2024-04-17T10:36:27.831 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:36:27.837 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:27.856 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:36:27.856 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2024-04-17T10:36:28.206 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:36:28.216 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:36:28.217 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:43.617 INFO:teuthology.orchestra.run.smithi152.stdout:generic/465 15s 2024-04-17T10:36:43.647 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/465 2024-04-17T10:36:43.647 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:36:43.658 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:43.716 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:36:43.716 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2024-04-17T10:36:44.235 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:36:44.245 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:36:44.245 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:44.508 INFO:teuthology.orchestra.run.smithi152.stdout:generic/466 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:36:44.516 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/466 2024-04-17T10:36:44.516 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/466 2024-04-17T10:36:44.516 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:36:44.522 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:44.541 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:36:44.541 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2024-04-17T10:36:44.891 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:36:44.901 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:36:44.901 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:52.109 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:36:52.112 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:36:54.225 INFO:teuthology.orchestra.run.smithi152.stdout:generic/467 - output mismatch (see /tmp/tmp.pJW3k3pP3vxfstests-dev/results//generic/467.out.bad) 2024-04-17T10:36:54.255 INFO:teuthology.orchestra.run.smithi152.stdout: --- tests/generic/467.out 2024-04-17 08:48:08.581451781 +0000 2024-04-17T10:36:54.255 INFO:teuthology.orchestra.run.smithi152.stdout: +++ /tmp/tmp.pJW3k3pP3vxfstests-dev/results//generic/467.out.bad 2024-04-17 10:36:54.193921444 +0000 2024-04-17T10:36:54.255 INFO:teuthology.orchestra.run.smithi152.stdout: @@ -1,5 +1,15 @@ 2024-04-17T10:36:54.255 INFO:teuthology.orchestra.run.smithi152.stdout: QA output created by 467 2024-04-17T10:36:54.255 INFO:teuthology.orchestra.run.smithi152.stdout: test_file_handles TEST_DIR/467-dir -dp 2024-04-17T10:36:54.255 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/467-dir/file000000) opened an unlinked file! 2024-04-17T10:36:54.255 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/467-dir/file000001) opened an unlinked file! 2024-04-17T10:36:54.256 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/467-dir/file000002) opened an unlinked file! 2024-04-17T10:36:54.256 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/467-dir/file000003) opened an unlinked file! 2024-04-17T10:36:54.256 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/467-dir/file000004) opened an unlinked file! 2024-04-17T10:36:54.256 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/467-dir/file000005) opened an unlinked file! 2024-04-17T10:36:54.256 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/467-dir/file000006) opened an unlinked file! 2024-04-17T10:36:54.256 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/467-dir/file000007) opened an unlinked file! 2024-04-17T10:36:54.256 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/467-dir/file000008) opened an unlinked file! 2024-04-17T10:36:54.256 INFO:teuthology.orchestra.run.smithi152.stdout: +open_by_handle(/tmp/tmp.N9QxrNRIp4test/467-dir/file000009) opened an unlinked file! 2024-04-17T10:36:54.256 INFO:teuthology.orchestra.run.smithi152.stdout: test_file_handles TEST_DIR/467-dir -rp 2024-04-17T10:36:54.256 INFO:teuthology.orchestra.run.smithi152.stdout: test_file_handles TEST_DIR/467-dir -dkr 2024-04-17T10:36:54.256 INFO:teuthology.orchestra.run.smithi152.stdout: test_file_handles TEST_DIR/467-dir -lr 2024-04-17T10:36:54.279 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/467 2024-04-17T10:36:54.279 INFO:teuthology.orchestra.run.smithi152.stdout:Failures: generic/467 2024-04-17T10:36:54.280 INFO:teuthology.orchestra.run.smithi152.stdout:Failed 1 of 1 tests 2024-04-17T10:36:54.304 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:54.403 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T10:36:54.403 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-04-17T10:36:54.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-04-17T10:36:54.403 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2024-04-17T10:36:55.967 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:36:55.977 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:36:55.978 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:56.311 INFO:teuthology.orchestra.run.smithi152.stdout:generic/468 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:36:56.319 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/468 2024-04-17T10:36:56.319 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/468 2024-04-17T10:36:56.319 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:36:56.325 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:56.344 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:36:56.344 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2024-04-17T10:36:56.707 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:36:56.717 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:36:56.718 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:59.252 INFO:teuthology.orchestra.run.smithi152.stdout:generic/469 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-04-17T10:36:59.260 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/469 2024-04-17T10:36:59.260 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/469 2024-04-17T10:36:59.260 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:36:59.266 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:36:59.324 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:36:59.324 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2024-04-17T10:36:59.970 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:36:59.980 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:36:59.980 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:37:00.305 INFO:teuthology.orchestra.run.smithi152.stdout:generic/470 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:37:00.313 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/470 2024-04-17T10:37:00.313 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/470 2024-04-17T10:37:00.313 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:37:00.319 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:37:00.338 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:37:00.338 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/471) 2024-04-17T10:37:00.699 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:37:00.709 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:37:00.709 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:37:24.252 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:37:24.257 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:37:54.314 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:37:54.323 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:38:07.888 INFO:teuthology.orchestra.run.smithi152.stdout:generic/471 67s 2024-04-17T10:38:07.900 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/471 2024-04-17T10:38:07.901 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:38:07.907 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:38:07.928 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:38:07.928 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2024-04-17T10:38:09.043 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:38:09.063 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:38:09.063 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:38:09.608 INFO:teuthology.orchestra.run.smithi152.stdout:generic/472 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:38:09.616 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/472 2024-04-17T10:38:09.616 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/472 2024-04-17T10:38:09.616 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:38:09.622 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:38:09.641 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:38:09.642 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2024-04-17T10:38:10.018 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:38:10.029 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:38:10.029 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:38:10.378 INFO:teuthology.orchestra.run.smithi152.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-04-17T10:38:10.386 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/473 2024-04-17T10:38:10.386 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/473 2024-04-17T10:38:10.386 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:38:10.392 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:38:10.412 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:38:10.413 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2024-04-17T10:38:10.758 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:38:10.769 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:38:10.769 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:38:11.042 INFO:teuthology.orchestra.run.smithi152.stdout:generic/474 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:38:11.050 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/474 2024-04-17T10:38:11.050 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/474 2024-04-17T10:38:11.050 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:38:11.056 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:38:11.077 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:38:11.077 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2024-04-17T10:38:11.423 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:38:11.433 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:38:11.434 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:38:11.762 INFO:teuthology.orchestra.run.smithi152.stdout:generic/475 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:38:11.770 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/475 2024-04-17T10:38:11.770 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/475 2024-04-17T10:38:11.771 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:38:11.777 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:38:11.796 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:38:11.797 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2024-04-17T10:38:12.140 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:38:12.150 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:38:12.150 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:38:12.448 INFO:teuthology.orchestra.run.smithi152.stdout:generic/476 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:38:12.456 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/476 2024-04-17T10:38:12.456 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/476 2024-04-17T10:38:12.456 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:38:12.462 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:38:12.481 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:38:12.481 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2024-04-17T10:38:12.848 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:38:12.858 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:38:12.858 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:38:24.399 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:38:24.404 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:38:24.433 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-04-17T10:38:24.437+0000 7fc7d2600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34406) UID: 0 2024-04-17T10:38:24.433 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-04-17T10:38:24.437+0000 7fc89d000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34406) UID: 0 2024-04-17T10:38:24.433 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-04-17T10:38:24.437+0000 7f2b4a200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34406) UID: 0 2024-04-17T10:38:24.434 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-04-17T10:38:24.437+0000 7f5475c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34406) UID: 0 2024-04-17T10:38:31.578 INFO:teuthology.orchestra.run.smithi152.stdout:generic/477 19s 2024-04-17T10:38:31.764 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/477 2024-04-17T10:38:31.764 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:38:31.770 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:38:31.819 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:38:31.819 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/478) 2024-04-17T10:38:33.511 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:38:33.521 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:38:33.521 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:38:44.253 INFO:teuthology.orchestra.run.smithi152.stdout:generic/478 - output mismatch (see /tmp/tmp.pJW3k3pP3vxfstests-dev/results//generic/478.out.bad) 2024-04-17T10:38:44.258 INFO:teuthology.orchestra.run.smithi152.stdout: --- tests/generic/478.out 2024-04-17 08:48:08.585451737 +0000 2024-04-17T10:38:44.258 INFO:teuthology.orchestra.run.smithi152.stdout: +++ /tmp/tmp.pJW3k3pP3vxfstests-dev/results//generic/478.out.bad 2024-04-17 10:38:44.244740018 +0000 2024-04-17T10:38:44.258 INFO:teuthology.orchestra.run.smithi152.stdout: @@ -10,7 +10,7 @@ 2024-04-17T10:38:44.259 INFO:teuthology.orchestra.run.smithi152.stdout: lock could be placed 2024-04-17T10:38:44.259 INFO:teuthology.orchestra.run.smithi152.stdout: get wrlck 2024-04-17T10:38:44.259 INFO:teuthology.orchestra.run.smithi152.stdout: lock could be placed 2024-04-17T10:38:44.259 INFO:teuthology.orchestra.run.smithi152.stdout: -lock could be placed 2024-04-17T10:38:44.259 INFO:teuthology.orchestra.run.smithi152.stdout: +get wrlck 2024-04-17T10:38:44.259 INFO:teuthology.orchestra.run.smithi152.stdout: lock could be placed 2024-04-17T10:38:44.259 INFO:teuthology.orchestra.run.smithi152.stdout: lock could be placed 2024-04-17T10:38:44.259 INFO:teuthology.orchestra.run.smithi152.stdout: lock could be placed 2024-04-17T10:38:44.259 INFO:teuthology.orchestra.run.smithi152.stdout: @@ -25,7 +25,7 @@ 2024-04-17T10:38:44.260 INFO:teuthology.orchestra.run.smithi152.stdout: lock could be placed 2024-04-17T10:38:44.260 INFO:teuthology.orchestra.run.smithi152.stdout: get wrlck 2024-04-17T10:38:44.260 INFO:teuthology.orchestra.run.smithi152.stdout: lock could be placed 2024-04-17T10:38:44.260 INFO:teuthology.orchestra.run.smithi152.stdout: -lock could be placed 2024-04-17T10:38:44.260 INFO:teuthology.orchestra.run.smithi152.stdout: +get wrlck 2024-04-17T10:38:44.260 INFO:teuthology.orchestra.run.smithi152.stdout: lock could be placed 2024-04-17T10:38:44.260 INFO:teuthology.orchestra.run.smithi152.stdout: lock could be placed 2024-04-17T10:38:44.260 INFO:teuthology.orchestra.run.smithi152.stdout: lock could be placed 2024-04-17T10:38:44.260 INFO:teuthology.orchestra.run.smithi152.stdout: @@ -37,7 +37,7 @@ 2024-04-17T10:38:44.260 INFO:teuthology.orchestra.run.smithi152.stdout: get rdlck 2024-04-17T10:38:44.260 INFO:teuthology.orchestra.run.smithi152.stdout: get rdlck 2024-04-17T10:38:44.260 INFO:teuthology.orchestra.run.smithi152.stdout: lock could be placed 2024-04-17T10:38:44.260 INFO:teuthology.orchestra.run.smithi152.stdout: -lock could be placed 2024-04-17T10:38:44.260 INFO:teuthology.orchestra.run.smithi152.stdout: +get rdlck 2024-04-17T10:38:44.260 INFO:teuthology.orchestra.run.smithi152.stdout: get rdlck 2024-04-17T10:38:44.261 INFO:teuthology.orchestra.run.smithi152.stdout: lock could be placed 2024-04-17T10:38:44.261 INFO:teuthology.orchestra.run.smithi152.stdout: get rdlck 2024-04-17T10:38:44.261 INFO:teuthology.orchestra.run.smithi152.stdout: @@ -46,7 +46,7 @@ 2024-04-17T10:38:44.261 INFO:teuthology.orchestra.run.smithi152.stdout: get rdlck 2024-04-17T10:38:44.261 INFO:teuthology.orchestra.run.smithi152.stdout: get rdlck 2024-04-17T10:38:44.261 INFO:teuthology.orchestra.run.smithi152.stdout: lock could be placed 2024-04-17T10:38:44.261 INFO:teuthology.orchestra.run.smithi152.stdout: -lock could be placed 2024-04-17T10:38:44.261 INFO:teuthology.orchestra.run.smithi152.stdout: +get rdlck 2024-04-17T10:38:44.261 INFO:teuthology.orchestra.run.smithi152.stdout: lock could be placed 2024-04-17T10:38:44.261 INFO:teuthology.orchestra.run.smithi152.stdout: lock could be placed 2024-04-17T10:38:44.261 INFO:teuthology.orchestra.run.smithi152.stdout: lock could be placed 2024-04-17T10:38:44.264 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/478 2024-04-17T10:38:44.264 INFO:teuthology.orchestra.run.smithi152.stdout:Failures: generic/478 2024-04-17T10:38:44.264 INFO:teuthology.orchestra.run.smithi152.stdout:Failed 1 of 1 tests 2024-04-17T10:38:44.270 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:38:44.291 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T10:38:44.291 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-04-17T10:38:44.291 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-04-17T10:38:44.291 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/479) 2024-04-17T10:38:44.651 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:38:44.661 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:38:44.661 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:38:44.992 INFO:teuthology.orchestra.run.smithi152.stdout:generic/479 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:38:45.001 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/479 2024-04-17T10:38:45.001 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/479 2024-04-17T10:38:45.001 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:38:45.007 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:38:45.026 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:38:45.026 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/480) 2024-04-17T10:38:45.379 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:38:45.389 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:38:45.389 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:38:45.712 INFO:teuthology.orchestra.run.smithi152.stdout:generic/480 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:38:45.720 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/480 2024-04-17T10:38:45.720 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/480 2024-04-17T10:38:45.720 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:38:45.726 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:38:45.745 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:38:45.745 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/481) 2024-04-17T10:38:46.086 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:38:46.097 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:38:46.097 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:38:46.416 INFO:teuthology.orchestra.run.smithi152.stdout:generic/481 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:38:46.424 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/481 2024-04-17T10:38:46.424 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/481 2024-04-17T10:38:46.424 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:38:46.430 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:38:46.449 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:38:46.449 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/482) 2024-04-17T10:38:46.824 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:38:46.834 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:38:46.834 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:38:47.240 INFO:teuthology.orchestra.run.smithi152.stdout:generic/482 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:38:47.248 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/482 2024-04-17T10:38:47.248 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/482 2024-04-17T10:38:47.248 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:38:47.254 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:38:47.274 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:38:47.274 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/483) 2024-04-17T10:38:47.642 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:38:47.652 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:38:47.652 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:38:47.945 INFO:teuthology.orchestra.run.smithi152.stdout:generic/483 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:38:47.953 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/483 2024-04-17T10:38:47.953 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/483 2024-04-17T10:38:47.953 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:38:47.959 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:38:47.978 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:38:47.979 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/484) 2024-04-17T10:38:48.320 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:38:48.331 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:38:48.331 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:38:48.642 INFO:teuthology.orchestra.run.smithi152.stdout:generic/484 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:38:48.650 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/484 2024-04-17T10:38:48.650 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/484 2024-04-17T10:38:48.650 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:38:48.656 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:38:48.676 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:38:48.676 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/485) 2024-04-17T10:38:49.036 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:38:49.046 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:38:49.047 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:38:50.481 INFO:teuthology.orchestra.run.smithi152.stdout:generic/485 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2024-04-17T10:38:50.489 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/485 2024-04-17T10:38:50.490 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/485 2024-04-17T10:38:50.490 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:38:50.496 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:38:50.539 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:38:50.540 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/486) 2024-04-17T10:38:51.183 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:38:51.193 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:38:51.194 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:38:51.516 INFO:teuthology.orchestra.run.smithi152.stdout:generic/486 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:38:51.522 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/486 2024-04-17T10:38:51.525 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/486 2024-04-17T10:38:51.525 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:38:51.529 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:38:51.548 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:38:51.549 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/487) 2024-04-17T10:38:51.902 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:38:51.913 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:38:51.913 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:38:52.222 INFO:teuthology.orchestra.run.smithi152.stdout:generic/487 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:38:52.230 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/487 2024-04-17T10:38:52.230 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/487 2024-04-17T10:38:52.231 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:38:52.236 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:38:52.256 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:38:52.256 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/488) 2024-04-17T10:38:52.615 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:38:52.625 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:38:52.625 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:38:52.901 INFO:teuthology.orchestra.run.smithi152.stdout:generic/488 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:38:52.909 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/488 2024-04-17T10:38:52.909 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/488 2024-04-17T10:38:52.909 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:38:52.915 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:38:52.934 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:38:52.934 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/489) 2024-04-17T10:38:53.290 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:38:53.300 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:38:53.300 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:38:53.587 INFO:teuthology.orchestra.run.smithi152.stdout:generic/489 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:38:53.595 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/489 2024-04-17T10:38:53.595 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/489 2024-04-17T10:38:53.595 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:38:53.601 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:38:53.621 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:38:53.621 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/490) 2024-04-17T10:38:53.966 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:38:53.976 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:38:53.976 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:38:54.973 INFO:teuthology.orchestra.run.smithi152.stdout:generic/490 1s 2024-04-17T10:38:54.985 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/490 2024-04-17T10:38:54.985 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:38:54.992 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:38:55.171 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:38:55.171 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/491) 2024-04-17T10:38:55.710 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:38:55.721 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:38:55.721 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:38:56.016 INFO:teuthology.orchestra.run.smithi152.stdout:generic/491 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:38:56.024 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/491 2024-04-17T10:38:56.024 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/491 2024-04-17T10:38:56.024 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:38:56.030 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:38:56.049 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:38:56.050 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/492) 2024-04-17T10:38:56.394 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:38:56.405 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:38:56.405 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:38:56.662 INFO:teuthology.orchestra.run.smithi152.stdout:generic/492 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:38:56.670 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/492 2024-04-17T10:38:56.670 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/492 2024-04-17T10:38:56.670 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:38:56.677 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:38:56.695 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:38:56.696 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/493) 2024-04-17T10:38:57.059 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:38:57.069 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:38:57.069 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:38:57.337 INFO:teuthology.orchestra.run.smithi152.stdout:generic/493 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:38:57.345 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/493 2024-04-17T10:38:57.345 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/493 2024-04-17T10:38:57.345 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:38:57.351 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:38:57.371 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:38:57.371 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/494) 2024-04-17T10:38:57.746 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:38:57.756 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:38:57.757 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:38:58.040 INFO:teuthology.orchestra.run.smithi152.stdout:generic/494 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:38:58.048 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/494 2024-04-17T10:38:58.048 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/494 2024-04-17T10:38:58.048 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:38:58.054 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:38:58.073 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:38:58.073 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/495) 2024-04-17T10:38:58.415 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:38:58.426 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:38:58.426 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:38:58.726 INFO:teuthology.orchestra.run.smithi152.stdout:generic/495 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:38:58.734 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/495 2024-04-17T10:38:58.734 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/495 2024-04-17T10:38:58.734 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:38:58.741 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:38:58.761 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:38:58.761 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/496) 2024-04-17T10:38:59.103 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:38:59.113 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:38:59.113 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:38:59.408 INFO:teuthology.orchestra.run.smithi152.stdout:generic/496 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:38:59.416 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/496 2024-04-17T10:38:59.416 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/496 2024-04-17T10:38:59.417 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:38:59.423 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:38:59.442 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:38:59.443 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/497) 2024-04-17T10:38:59.816 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:38:59.826 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:38:59.826 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:39:00.122 INFO:teuthology.orchestra.run.smithi152.stdout:generic/497 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:39:00.130 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/497 2024-04-17T10:39:00.130 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/497 2024-04-17T10:39:00.130 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:39:00.136 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:39:00.156 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:39:00.157 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/498) 2024-04-17T10:39:00.514 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:39:00.524 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:39:00.524 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:39:00.816 INFO:teuthology.orchestra.run.smithi152.stdout:generic/498 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:39:00.823 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/498 2024-04-17T10:39:00.824 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/498 2024-04-17T10:39:00.824 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:39:00.830 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:39:00.849 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:39:00.849 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/499) 2024-04-17T10:39:01.212 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:39:01.222 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:39:01.222 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:39:01.502 INFO:teuthology.orchestra.run.smithi152.stdout:generic/499 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:39:01.510 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/499 2024-04-17T10:39:01.510 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/499 2024-04-17T10:39:01.510 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:39:01.516 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:39:01.536 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:39:01.536 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/500) 2024-04-17T10:39:01.894 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:39:01.904 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:39:01.904 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:39:02.260 INFO:teuthology.orchestra.run.smithi152.stdout:generic/500 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:39:02.267 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/500 2024-04-17T10:39:02.267 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/500 2024-04-17T10:39:02.267 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:39:02.273 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:39:02.292 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:39:02.293 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/501) 2024-04-17T10:39:02.654 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:39:02.664 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:39:02.664 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:39:02.970 INFO:teuthology.orchestra.run.smithi152.stdout:generic/501 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:39:02.978 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/501 2024-04-17T10:39:02.978 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/501 2024-04-17T10:39:02.978 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:39:02.984 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:39:03.003 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:39:03.004 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/502) 2024-04-17T10:39:03.351 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:39:03.361 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:39:03.361 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:39:03.649 INFO:teuthology.orchestra.run.smithi152.stdout:generic/502 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:39:03.657 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/502 2024-04-17T10:39:03.657 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/502 2024-04-17T10:39:03.657 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:39:03.663 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:39:03.726 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:39:03.726 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/503) 2024-04-17T10:39:04.087 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:39:04.097 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:39:04.097 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:39:04.389 INFO:teuthology.orchestra.run.smithi152.stdout:generic/503 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:39:04.396 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/503 2024-04-17T10:39:04.397 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/503 2024-04-17T10:39:04.397 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:39:04.402 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:39:04.422 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:39:04.422 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/504) 2024-04-17T10:39:04.782 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:39:04.793 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:39:04.793 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:39:05.170 INFO:teuthology.orchestra.run.smithi152.stdout:generic/504 - output mismatch (see /tmp/tmp.pJW3k3pP3vxfstests-dev/results//generic/504.out.bad) 2024-04-17T10:39:05.175 INFO:teuthology.orchestra.run.smithi152.stdout: --- tests/generic/504.out 2024-04-17 08:48:08.589451690 +0000 2024-04-17T10:39:05.175 INFO:teuthology.orchestra.run.smithi152.stdout: +++ /tmp/tmp.pJW3k3pP3vxfstests-dev/results//generic/504.out.bad 2024-04-17 10:39:05.172515524 +0000 2024-04-17T10:39:05.176 INFO:teuthology.orchestra.run.smithi152.stdout: @@ -1,2 +1,3 @@ 2024-04-17T10:39:05.176 INFO:teuthology.orchestra.run.smithi152.stdout: QA output created by 504 2024-04-17T10:39:05.176 INFO:teuthology.orchestra.run.smithi152.stdout: +lock info not found 2024-04-17T10:39:05.176 INFO:teuthology.orchestra.run.smithi152.stdout: Silence is golden 2024-04-17T10:39:05.181 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/504 2024-04-17T10:39:05.181 INFO:teuthology.orchestra.run.smithi152.stdout:Failures: generic/504 2024-04-17T10:39:05.181 INFO:teuthology.orchestra.run.smithi152.stdout:Failed 1 of 1 tests 2024-04-17T10:39:05.187 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:39:05.246 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T10:39:05.246 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-04-17T10:39:05.246 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-04-17T10:39:05.247 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/505) 2024-04-17T10:39:05.623 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:39:05.633 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:39:05.633 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:39:05.898 INFO:teuthology.orchestra.run.smithi152.stdout:generic/505 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:39:05.906 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/505 2024-04-17T10:39:05.906 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/505 2024-04-17T10:39:05.906 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:39:05.912 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:39:05.931 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:39:05.931 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/506) 2024-04-17T10:39:06.290 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:39:06.301 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:39:06.301 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:39:06.591 INFO:teuthology.orchestra.run.smithi152.stdout:generic/506 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:39:06.598 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/506 2024-04-17T10:39:06.599 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/506 2024-04-17T10:39:06.599 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:39:06.605 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:39:06.624 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:39:06.624 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/507) 2024-04-17T10:39:06.994 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:39:07.004 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:39:07.004 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:39:07.342 INFO:teuthology.orchestra.run.smithi152.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2024-04-17T10:39:07.354 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/507 2024-04-17T10:39:07.355 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/507 2024-04-17T10:39:07.355 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:39:07.357 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:39:07.377 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:39:07.378 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/508) 2024-04-17T10:39:07.739 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:39:07.749 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:39:07.749 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:39:08.035 INFO:teuthology.orchestra.run.smithi152.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph-fuse 2024-04-17T10:39:08.043 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/508 2024-04-17T10:39:08.043 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/508 2024-04-17T10:39:08.043 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:39:08.049 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:39:08.068 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:39:08.068 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/509) 2024-04-17T10:39:08.427 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:39:08.437 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:39:08.437 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:39:08.752 INFO:teuthology.orchestra.run.smithi152.stdout:generic/509 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:39:08.760 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/509 2024-04-17T10:39:08.760 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/509 2024-04-17T10:39:08.761 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:39:08.766 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:39:08.786 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:39:08.787 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/510) 2024-04-17T10:39:09.147 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:39:09.157 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:39:09.157 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:39:09.452 INFO:teuthology.orchestra.run.smithi152.stdout:generic/510 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:39:09.460 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/510 2024-04-17T10:39:09.460 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/510 2024-04-17T10:39:09.460 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:39:09.466 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:39:09.486 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:39:09.486 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/511) 2024-04-17T10:39:09.856 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:39:09.866 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:39:09.866 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:39:10.136 INFO:teuthology.orchestra.run.smithi152.stdout:generic/511 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:39:10.144 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/511 2024-04-17T10:39:10.145 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/511 2024-04-17T10:39:10.145 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:39:10.151 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:39:10.211 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:39:10.211 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/512) 2024-04-17T10:39:10.575 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:39:10.585 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:39:10.585 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:39:10.892 INFO:teuthology.orchestra.run.smithi152.stdout:generic/512 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:39:10.900 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/512 2024-04-17T10:39:10.900 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/512 2024-04-17T10:39:10.900 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:39:10.906 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:39:10.926 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:39:10.926 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/513) 2024-04-17T10:39:11.294 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:39:11.304 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:39:11.304 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:39:11.566 INFO:teuthology.orchestra.run.smithi152.stdout:generic/513 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:39:11.574 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/513 2024-04-17T10:39:11.574 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/513 2024-04-17T10:39:11.574 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:39:11.580 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:39:11.599 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:39:11.600 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/514) 2024-04-17T10:39:11.947 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:39:11.958 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:39:11.958 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:39:12.344 INFO:teuthology.orchestra.run.smithi152.stdout:generic/514 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:39:12.351 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/514 2024-04-17T10:39:12.352 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/514 2024-04-17T10:39:12.352 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:39:12.358 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:39:12.431 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:39:12.431 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/515) 2024-04-17T10:39:12.788 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:39:12.797 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:39:12.797 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:39:13.060 INFO:teuthology.orchestra.run.smithi152.stdout:generic/515 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:39:13.068 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/515 2024-04-17T10:39:13.068 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/515 2024-04-17T10:39:13.068 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:39:13.074 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:39:13.094 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:39:13.094 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/516) 2024-04-17T10:39:13.455 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:39:13.465 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:39:13.465 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:39:13.825 INFO:teuthology.orchestra.run.smithi152.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-04-17T10:39:13.832 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/516 2024-04-17T10:39:13.833 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/516 2024-04-17T10:39:13.833 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:39:13.839 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:39:13.890 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:39:13.890 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/517) 2024-04-17T10:39:14.542 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:39:14.553 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:39:14.553 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:39:14.824 INFO:teuthology.orchestra.run.smithi152.stdout:generic/517 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:39:14.833 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/517 2024-04-17T10:39:14.833 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/517 2024-04-17T10:39:14.833 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:39:14.838 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:39:14.858 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:39:14.858 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/518) 2024-04-17T10:39:15.220 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:39:15.230 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:39:15.230 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:39:15.504 INFO:teuthology.orchestra.run.smithi152.stdout:generic/518 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:39:15.512 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/518 2024-04-17T10:39:15.512 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/518 2024-04-17T10:39:15.512 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:39:15.518 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:39:15.538 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:39:15.539 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/519) 2024-04-17T10:39:15.902 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:39:15.912 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:39:15.912 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:39:16.186 INFO:teuthology.orchestra.run.smithi152.stdout:generic/519 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:39:16.194 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/519 2024-04-17T10:39:16.194 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/519 2024-04-17T10:39:16.194 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:39:16.200 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:39:16.219 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:39:16.220 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/520) 2024-04-17T10:39:16.576 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:39:16.586 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:39:16.586 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:39:16.874 INFO:teuthology.orchestra.run.smithi152.stdout:generic/520 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T10:39:16.882 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/520 2024-04-17T10:39:16.882 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/520 2024-04-17T10:39:16.883 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T10:39:16.888 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:39:16.908 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T10:39:16.908 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/521) 2024-04-17T10:39:17.262 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T10:39:17.273 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T10:39:17.273 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T10:41:27.574 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:41:27.578 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:41:57.793 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:41:57.858 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:42:27.931 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:42:27.935 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:42:58.853 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:42:58.857 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:43:28.908 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:43:28.912 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:43:59.104 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:43:59.108 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:44:29.158 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:44:29.162 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:44:59.237 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:44:59.240 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:45:29.285 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:45:29.312 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:45:59.733 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:45:59.737 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:46:29.804 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:46:29.808 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:47:00.150 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:47:00.154 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:47:30.264 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:47:30.267 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:48:00.318 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:48:00.322 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:48:30.382 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:48:30.386 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:49:00.587 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:49:00.591 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:49:30.667 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:49:30.670 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:50:01.716 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:50:01.722 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:50:31.775 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:50:31.779 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:51:01.826 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:51:01.830 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:51:32.553 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:51:32.556 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:51:32.585 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-04-17T10:51:32.584+0000 7fc7d2600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34489) UID: 0 2024-04-17T10:51:32.585 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-04-17T10:51:32.584+0000 7f2b4a200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34489) UID: 0 2024-04-17T10:51:32.585 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-04-17T10:51:32.584+0000 7fc89d000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34489) UID: 0 2024-04-17T10:51:32.586 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-04-17T10:51:32.584+0000 7f5475c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34489) UID: 0 2024-04-17T10:51:32.589 INFO:tasks.ceph.mds.c.smithi152.stderr:2024-04-17T10:51:32.588+0000 7f1eb3200640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 395727) UID: 0 2024-04-17T10:51:32.589 INFO:tasks.ceph.mds.a.smithi152.stderr:2024-04-17T10:51:32.588+0000 7f65f1400640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 395727) UID: 0 2024-04-17T10:54:36.235 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:54:36.239 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:55:06.321 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:55:06.325 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:55:36.385 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:55:36.389 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:56:06.486 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:56:06.490 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:56:36.619 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:56:36.624 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:57:06.723 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:57:06.727 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:57:36.830 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:57:36.834 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:58:08.033 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:58:08.037 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:58:38.095 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:58:38.099 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:59:08.192 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:59:08.198 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:59:38.247 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T10:59:38.251 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:00:08.399 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:00:08.403 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:00:38.563 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:00:38.566 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:01:08.628 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:01:08.632 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:01:38.791 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:01:38.794 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:01:38.824 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-04-17T11:01:38.824+0000 7fc7d2600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34550) UID: 0 2024-04-17T11:01:38.824 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-04-17T11:01:38.824+0000 7fc89d000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34550) UID: 0 2024-04-17T11:01:38.825 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-04-17T11:01:38.824+0000 7f2b4a200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34550) UID: 0 2024-04-17T11:01:38.825 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-04-17T11:01:38.824+0000 7f5475c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34550) UID: 0 2024-04-17T11:04:55.378 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:04:55.382 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:05:25.451 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:05:25.455 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:05:55.682 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:05:55.686 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:06:25.738 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:06:25.748 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:06:55.886 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:06:55.890 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:07:25.965 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:07:25.969 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:07:56.064 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:07:56.067 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:08:26.326 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:08:26.330 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:08:56.380 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:08:56.383 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:09:27.226 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:09:27.230 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:09:57.287 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:09:57.291 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:10:27.458 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:10:27.462 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:10:57.648 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:10:57.652 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:11:27.744 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:11:27.748 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:11:57.901 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:11:57.904 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:12:28.053 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:12:28.057 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:12:58.166 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:12:58.169 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:13:28.229 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:13:28.234 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:13:58.341 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:13:58.345 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:14:28.446 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:14:28.450 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:14:58.501 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:14:58.505 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:15:28.614 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:15:28.618 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:15:58.726 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:15:58.729 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:16:28.803 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:16:28.807 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:16:58.878 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:16:58.882 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:17:29.774 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:17:29.778 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:17:59.827 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:17:59.831 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:17:59.873 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-04-17T11:17:59.875+0000 7fc7d2600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34661) UID: 0 2024-04-17T11:17:59.874 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-04-17T11:17:59.875+0000 7fc89d000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34661) UID: 0 2024-04-17T11:17:59.874 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-04-17T11:17:59.875+0000 7f2b4a200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34661) UID: 0 2024-04-17T11:17:59.874 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-04-17T11:17:59.875+0000 7f5475c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34661) UID: 0 2024-04-17T11:20:57.493 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:20:57.496 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:21:27.838 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:21:27.841 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:21:57.892 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:21:57.896 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:22:28.366 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:22:28.370 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:22:58.426 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:22:58.430 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:23:28.497 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:23:28.501 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:23:58.734 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:23:58.739 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:24:28.847 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:24:28.851 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:24:58.943 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:24:58.947 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:25:29.064 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:25:29.068 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:25:59.186 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:25:59.190 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:26:29.314 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:26:29.318 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:26:59.475 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:26:59.478 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:27:29.625 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:27:29.629 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:27:59.679 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:27:59.682 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:28:29.784 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:28:29.788 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:28:59.880 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:28:59.884 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:29:30.009 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:29:30.013 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:30:00.106 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:30:00.110 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:30:30.627 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:30:30.631 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:31:00.773 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:31:00.777 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:31:31.076 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:31:31.079 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:32:01.123 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:32:01.126 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:32:31.262 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:32:31.266 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:32:54.423 INFO:teuthology.orchestra.run.smithi152.stdout:generic/521 3216s 2024-04-17T11:32:54.437 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/521 2024-04-17T11:32:54.437 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T11:32:54.444 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T11:32:54.477 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T11:32:54.477 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/522) 2024-04-17T11:32:55.146 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T11:32:55.155 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T11:32:55.156 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T11:33:01.358 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:33:01.362 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:33:31.601 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:33:31.605 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:34:01.658 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:34:01.662 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:34:32.547 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:34:32.551 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:35:02.634 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:35:02.638 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:35:32.881 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:35:32.885 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:36:02.935 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:36:02.939 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:36:33.048 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:36:33.052 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:37:03.135 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:37:03.139 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:37:33.291 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:37:33.294 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:38:03.528 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:38:03.532 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:38:33.702 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:38:33.705 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:39:03.764 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:39:03.767 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:39:33.817 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:39:33.822 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:40:03.981 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:40:03.985 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:40:34.076 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:40:34.080 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:41:04.223 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:41:04.227 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:41:34.344 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:41:34.348 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:42:04.399 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:42:04.403 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:42:35.361 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:42:35.365 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:43:05.600 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:43:05.604 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:43:35.709 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:43:35.712 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:44:06.034 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:44:06.038 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:44:36.103 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:44:36.107 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:44:36.152 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-04-17T11:44:36.153+0000 7fc89d000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34836) UID: 0 2024-04-17T11:44:36.153 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-04-17T11:44:36.153+0000 7fc7d2600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34836) UID: 0 2024-04-17T11:44:36.153 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-04-17T11:44:36.153+0000 7f2b4a200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34836) UID: 0 2024-04-17T11:44:36.153 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-04-17T11:44:36.153+0000 7f5475c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34836) UID: 0 2024-04-17T11:47:13.208 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:47:13.213 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:47:43.469 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:47:43.472 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:48:13.549 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:48:13.553 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:48:43.624 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:48:43.627 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:49:13.727 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:49:13.730 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:49:43.861 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:49:43.865 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:50:13.981 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:50:13.985 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:50:44.087 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:50:44.091 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:51:14.251 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:51:14.254 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:51:44.371 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:51:44.376 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:52:15.035 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:52:15.039 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:52:45.179 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:52:45.183 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:53:15.444 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:53:15.449 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:53:46.156 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:53:46.160 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:54:16.275 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:54:16.278 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:54:46.333 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:54:46.337 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:55:16.419 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:55:16.423 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:55:46.541 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:55:46.545 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:56:16.596 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:56:16.600 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:56:46.709 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:56:46.712 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:57:16.788 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:57:16.793 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:57:16.864 INFO:tasks.ceph.mds.c.smithi152.stderr:2024-04-17T11:57:16.861+0000 7f1eb3200640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 396538) UID: 0 2024-04-17T11:57:16.865 INFO:tasks.ceph.mds.a.smithi152.stderr:2024-04-17T11:57:16.861+0000 7f65f1400640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 396538) UID: 0 2024-04-17T11:59:51.488 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:59:51.491 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T11:59:51.605 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-04-17T11:59:51.605+0000 7fc89d000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34929) UID: 0 2024-04-17T11:59:51.605 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-04-17T11:59:51.605+0000 7f2b4a200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34929) UID: 0 2024-04-17T11:59:51.606 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-04-17T11:59:51.605+0000 7fc7d2600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34929) UID: 0 2024-04-17T11:59:51.606 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-04-17T11:59:51.605+0000 7f5475c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34929) UID: 0 2024-04-17T12:05:12.929 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:05:12.933 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:05:43.008 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:05:43.012 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:06:13.081 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:06:13.084 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:06:43.205 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:06:43.208 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:07:13.317 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:07:13.321 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:07:43.456 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:07:43.460 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:08:14.448 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:08:14.452 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:08:44.509 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:08:44.512 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:09:14.815 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:09:14.819 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:09:45.005 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:09:45.008 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:10:15.163 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:10:15.167 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:10:45.450 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:10:45.454 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:11:07.528 INFO:teuthology.orchestra.run.smithi152.stdout:generic/522 2292s 2024-04-17T12:11:07.585 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/522 2024-04-17T12:11:07.585 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:11:07.596 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:11:07.616 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:11:07.616 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/523) 2024-04-17T12:11:08.332 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:11:08.343 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:11:08.343 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:11:08.719 INFO:teuthology.orchestra.run.smithi152.stdout:generic/523 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:11:08.727 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/523 2024-04-17T12:11:08.727 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/523 2024-04-17T12:11:08.727 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:11:08.733 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:11:08.752 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:11:08.752 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/524) 2024-04-17T12:11:09.109 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:11:09.120 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:11:09.120 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:11:09.377 INFO:teuthology.orchestra.run.smithi152.stdout:generic/524 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:11:09.385 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/524 2024-04-17T12:11:09.385 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/524 2024-04-17T12:11:09.385 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:11:09.391 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:11:09.410 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:11:09.410 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/525) 2024-04-17T12:11:09.771 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:11:09.781 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:11:09.781 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:11:10.065 INFO:teuthology.orchestra.run.smithi152.stdout:generic/525 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:11:10.073 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/525 2024-04-17T12:11:10.073 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/525 2024-04-17T12:11:10.073 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:11:10.079 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:11:10.098 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:11:10.099 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/526) 2024-04-17T12:11:10.470 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:11:10.480 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:11:10.480 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:11:10.834 INFO:teuthology.orchestra.run.smithi152.stdout:generic/526 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:11:10.842 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/526 2024-04-17T12:11:10.842 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/526 2024-04-17T12:11:10.842 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:11:10.848 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:11:10.867 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:11:10.867 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/527) 2024-04-17T12:11:11.230 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:11:11.240 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:11:11.241 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:11:11.533 INFO:teuthology.orchestra.run.smithi152.stdout:generic/527 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:11:11.541 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/527 2024-04-17T12:11:11.541 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/527 2024-04-17T12:11:11.541 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:11:11.547 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:11:11.566 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:11:11.567 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/528) 2024-04-17T12:11:11.932 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:11:11.942 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:11:11.942 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:11:12.282 INFO:teuthology.orchestra.run.smithi152.stdout:generic/528 [not run] inode creation time not supported by this filesystem 2024-04-17T12:11:12.290 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/528 2024-04-17T12:11:12.290 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/528 2024-04-17T12:11:12.291 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:11:12.296 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:11:12.315 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:11:12.316 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/529) 2024-04-17T12:11:12.670 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:11:12.680 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:11:12.680 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:11:13.015 INFO:teuthology.orchestra.run.smithi152.stdout:generic/529 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-04-17T12:11:13.023 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/529 2024-04-17T12:11:13.023 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/529 2024-04-17T12:11:13.023 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:11:13.029 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:11:13.047 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:11:13.047 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/530) 2024-04-17T12:11:13.418 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:11:13.429 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:11:13.429 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:11:13.692 INFO:teuthology.orchestra.run.smithi152.stdout:generic/530 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:11:13.700 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/530 2024-04-17T12:11:13.700 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/530 2024-04-17T12:11:13.700 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:11:13.706 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:11:13.726 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:11:13.726 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/531) 2024-04-17T12:11:14.107 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:11:14.117 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:11:14.117 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:11:14.381 INFO:teuthology.orchestra.run.smithi152.stdout:generic/531 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:11:14.389 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/531 2024-04-17T12:11:14.389 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/531 2024-04-17T12:11:14.389 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:11:14.395 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:11:14.414 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:11:14.415 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/532) 2024-04-17T12:11:14.770 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:11:14.780 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:11:14.780 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:11:15.134 INFO:teuthology.orchestra.run.smithi152.stdout:generic/532 1s 2024-04-17T12:11:15.146 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/532 2024-04-17T12:11:15.146 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:11:15.152 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:11:15.202 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:11:15.202 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/533) 2024-04-17T12:11:15.566 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:11:15.576 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:11:15.576 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:11:15.922 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:11:15.926 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:11:16.251 INFO:teuthology.orchestra.run.smithi152.stdout:generic/533 1s 2024-04-17T12:11:16.263 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/533 2024-04-17T12:11:16.263 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:11:16.269 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:11:16.287 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:11:16.287 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/534) 2024-04-17T12:11:16.642 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:11:16.652 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:11:16.652 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:11:16.934 INFO:teuthology.orchestra.run.smithi152.stdout:generic/534 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:11:16.941 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/534 2024-04-17T12:11:16.942 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/534 2024-04-17T12:11:16.942 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:11:16.948 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:11:16.967 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:11:16.967 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/535) 2024-04-17T12:11:17.318 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:11:17.328 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:11:17.328 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:11:17.647 INFO:teuthology.orchestra.run.smithi152.stdout:generic/535 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:11:17.655 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/535 2024-04-17T12:11:17.655 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/535 2024-04-17T12:11:17.655 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:11:17.661 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:11:17.680 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:11:17.680 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/536) 2024-04-17T12:11:18.029 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:11:18.040 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:11:18.040 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:11:18.343 INFO:teuthology.orchestra.run.smithi152.stdout:generic/536 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:11:18.351 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/536 2024-04-17T12:11:18.351 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/536 2024-04-17T12:11:18.351 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:11:18.357 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:11:18.375 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:11:18.376 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/537) 2024-04-17T12:11:18.726 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:11:18.736 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:11:18.736 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:11:18.999 INFO:teuthology.orchestra.run.smithi152.stdout:generic/537 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:11:19.007 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/537 2024-04-17T12:11:19.007 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/537 2024-04-17T12:11:19.007 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:11:19.013 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:11:19.032 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:11:19.032 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/538) 2024-04-17T12:11:19.402 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:11:19.412 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:11:19.413 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:11:45.988 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:11:45.992 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:12:16.269 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:12:16.273 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:12:46.336 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:12:46.340 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:13:16.440 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:13:16.443 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:13:16.471 INFO:tasks.ceph.osd.1.smithi152.stderr:2024-04-17T12:13:16.470+0000 7fb553c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 403714) UID: 0 2024-04-17T12:13:16.471 INFO:tasks.ceph.osd.2.smithi152.stderr:2024-04-17T12:13:16.470+0000 7f9821400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 403714) UID: 0 2024-04-17T12:13:16.472 INFO:tasks.ceph.osd.3.smithi152.stderr:2024-04-17T12:13:16.470+0000 7f2cca800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 403714) UID: 0 2024-04-17T12:13:16.472 INFO:tasks.ceph.osd.0.smithi152.stderr:2024-04-17T12:13:16.470+0000 7f2076000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 403714) UID: 0 2024-04-17T12:16:29.641 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:16:29.648 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:16:59.819 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:16:59.823 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:17:29.940 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:17:29.944 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:18:00.045 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:18:00.050 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:18:30.366 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:18:30.370 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:19:00.425 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:19:00.428 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:19:30.543 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:19:30.546 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:20:00.647 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:20:00.652 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:20:30.751 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:20:30.755 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:21:00.865 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:21:00.868 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:21:31.164 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:21:31.167 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:22:01.294 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:22:01.298 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:22:31.433 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:22:31.436 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:23:01.483 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:23:01.486 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:23:31.803 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:23:31.807 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:24:02.101 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:24:02.104 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:24:32.205 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:24:32.209 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:25:02.319 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:25:02.323 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:25:32.376 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:25:32.379 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:26:02.720 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:26:02.724 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:26:32.854 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:26:32.857 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:27:03.184 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:27:03.187 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:27:33.257 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:27:33.261 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:28:03.571 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:28:03.576 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:28:33.702 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:28:33.706 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:29:03.824 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:29:03.828 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:29:33.878 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:29:33.881 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:30:04.018 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:30:04.022 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:30:34.070 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:30:34.074 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:31:04.197 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:31:04.201 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:31:34.813 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:31:34.817 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:32:04.868 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:32:04.872 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:32:35.014 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:32:35.017 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:33:05.327 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:33:05.331 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:33:35.382 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:33:35.386 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:34:05.486 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:34:05.490 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:34:35.540 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:34:35.543 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:35:05.901 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:35:05.905 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:35:35.965 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:35:35.969 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:36:06.122 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:36:06.125 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:36:36.196 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:36:36.200 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:37:06.728 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:37:06.731 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:37:36.774 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:37:36.778 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:38:06.891 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:38:06.894 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:38:36.945 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:38:36.949 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:39:07.084 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:39:07.087 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:39:07.116 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-04-17T12:39:07.114+0000 7fc89d000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 35178) UID: 0 2024-04-17T12:39:07.116 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-04-17T12:39:07.114+0000 7fc7d2600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 35178) UID: 0 2024-04-17T12:39:07.117 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-04-17T12:39:07.114+0000 7f2b4a200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 35178) UID: 0 2024-04-17T12:39:07.117 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-04-17T12:39:07.114+0000 7f5475c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 35178) UID: 0 2024-04-17T12:42:10.981 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:42:10.985 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:42:41.131 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:42:41.135 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:43:11.246 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:43:11.249 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:43:41.528 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:43:41.531 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:44:12.208 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:44:12.212 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:44:42.313 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:44:42.317 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:45:12.449 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:45:12.453 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:45:42.521 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:45:42.524 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:46:12.674 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:46:12.677 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:46:42.771 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:46:42.774 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:47:12.901 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:47:12.905 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:47:43.783 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:47:43.787 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:48:13.889 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:48:13.893 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:48:43.996 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:48:44.000 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:49:14.234 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:49:14.238 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:49:14.266 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-04-17T12:49:14.261+0000 7fc89d000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 35245) UID: 0 2024-04-17T12:49:14.266 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-04-17T12:49:14.261+0000 7fc7d2600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 35245) UID: 0 2024-04-17T12:49:14.266 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-04-17T12:49:14.261+0000 7f2b4a200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 35245) UID: 0 2024-04-17T12:49:14.267 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-04-17T12:49:14.261+0000 7f5475c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 35245) UID: 0 2024-04-17T12:52:06.520 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:52:06.524 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:52:06.686 INFO:tasks.ceph.osd.0.smithi152.stderr:2024-04-17T12:52:06.680+0000 7f2076000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 409258) UID: 0 2024-04-17T12:52:06.686 INFO:tasks.ceph.osd.1.smithi152.stderr:2024-04-17T12:52:06.680+0000 7fb553c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 409258) UID: 0 2024-04-17T12:52:06.686 INFO:tasks.ceph.osd.2.smithi152.stderr:2024-04-17T12:52:06.680+0000 7f9821400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 409258) UID: 0 2024-04-17T12:52:06.687 INFO:tasks.ceph.osd.3.smithi152.stderr:2024-04-17T12:52:06.680+0000 7f2cca800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 409258) UID: 0 2024-04-17T12:55:19.129 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:55:19.133 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:55:49.271 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:55:49.275 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:56:19.325 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:56:19.329 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:56:27.572 INFO:teuthology.orchestra.run.smithi152.stdout:generic/538 2708s 2024-04-17T12:56:27.689 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/538 2024-04-17T12:56:27.689 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:56:27.695 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:27.713 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:56:27.713 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/539) 2024-04-17T12:56:28.870 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:56:28.880 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:56:28.880 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:31.414 INFO:teuthology.orchestra.run.smithi152.stdout:generic/539 3s 2024-04-17T12:56:31.426 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/539 2024-04-17T12:56:31.426 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:56:31.432 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:31.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:56:31.452 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/540) 2024-04-17T12:56:32.151 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:56:32.161 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:56:32.161 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:32.447 INFO:teuthology.orchestra.run.smithi152.stdout:generic/540 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:56:32.454 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/540 2024-04-17T12:56:32.455 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/540 2024-04-17T12:56:32.455 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:56:32.460 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:32.480 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:56:32.480 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/541) 2024-04-17T12:56:32.827 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:56:32.837 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:56:32.837 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:33.108 INFO:teuthology.orchestra.run.smithi152.stdout:generic/541 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:56:33.116 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/541 2024-04-17T12:56:33.116 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/541 2024-04-17T12:56:33.116 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:56:33.122 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:33.141 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:56:33.141 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/542) 2024-04-17T12:56:33.508 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:56:33.518 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:56:33.519 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:33.792 INFO:teuthology.orchestra.run.smithi152.stdout:generic/542 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:56:33.800 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/542 2024-04-17T12:56:33.800 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/542 2024-04-17T12:56:33.800 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:56:33.806 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:33.825 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:56:33.825 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/543) 2024-04-17T12:56:34.187 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:56:34.197 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:56:34.197 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:34.460 INFO:teuthology.orchestra.run.smithi152.stdout:generic/543 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:56:34.468 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/543 2024-04-17T12:56:34.468 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/543 2024-04-17T12:56:34.468 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:56:34.475 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:34.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:56:34.494 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/544) 2024-04-17T12:56:34.843 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:56:34.853 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:56:34.853 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:35.116 INFO:teuthology.orchestra.run.smithi152.stdout:generic/544 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:56:35.124 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/544 2024-04-17T12:56:35.124 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/544 2024-04-17T12:56:35.124 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:56:35.130 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:35.148 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:56:35.148 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/545) 2024-04-17T12:56:35.507 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:56:35.518 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:56:35.518 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:35.887 INFO:teuthology.orchestra.run.smithi152.stdout:generic/545 [not run] file system doesn't support chattr +i 2024-04-17T12:56:35.895 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/545 2024-04-17T12:56:35.895 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/545 2024-04-17T12:56:35.895 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:56:35.901 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:35.920 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:56:35.920 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/546) 2024-04-17T12:56:36.288 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:56:36.298 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:56:36.298 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:36.689 INFO:teuthology.orchestra.run.smithi152.stdout:generic/546 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:56:36.697 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/546 2024-04-17T12:56:36.697 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/546 2024-04-17T12:56:36.697 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:56:36.703 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:36.722 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:56:36.722 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/547) 2024-04-17T12:56:37.088 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:56:37.098 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:56:37.098 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:37.537 INFO:teuthology.orchestra.run.smithi152.stdout:generic/547 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:56:37.544 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/547 2024-04-17T12:56:37.544 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/547 2024-04-17T12:56:37.545 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:56:37.550 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:37.569 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:56:37.569 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/548) 2024-04-17T12:56:37.920 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:56:37.930 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:56:37.931 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:38.274 INFO:teuthology.orchestra.run.smithi152.stdout:generic/548 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:56:38.282 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/548 2024-04-17T12:56:38.282 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/548 2024-04-17T12:56:38.282 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:56:38.288 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:38.339 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:56:38.339 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/549) 2024-04-17T12:56:38.695 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:56:38.705 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:56:38.705 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:39.033 INFO:teuthology.orchestra.run.smithi152.stdout:generic/549 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:56:39.041 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/549 2024-04-17T12:56:39.041 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/549 2024-04-17T12:56:39.041 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:56:39.047 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:39.066 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:56:39.066 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/550) 2024-04-17T12:56:39.423 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:56:39.433 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:56:39.433 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:39.762 INFO:teuthology.orchestra.run.smithi152.stdout:generic/550 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:56:39.770 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/550 2024-04-17T12:56:39.770 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/550 2024-04-17T12:56:39.770 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:56:39.775 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:39.794 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:56:39.794 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/551) 2024-04-17T12:56:40.156 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:56:40.166 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:56:40.167 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:40.440 INFO:teuthology.orchestra.run.smithi152.stdout:generic/551 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:56:40.448 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/551 2024-04-17T12:56:40.448 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/551 2024-04-17T12:56:40.448 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:56:40.454 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:40.523 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:56:40.524 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/552) 2024-04-17T12:56:40.883 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:56:40.894 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:56:40.894 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:41.208 INFO:teuthology.orchestra.run.smithi152.stdout:generic/552 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:56:41.216 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/552 2024-04-17T12:56:41.217 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/552 2024-04-17T12:56:41.217 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:56:41.222 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:41.241 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:56:41.242 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/553) 2024-04-17T12:56:41.596 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:56:41.606 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:56:41.606 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:42.001 INFO:teuthology.orchestra.run.smithi152.stdout:generic/553 [not run] xfs_io chattr +i failed (old kernel/wrong fs/bad args?) 2024-04-17T12:56:42.009 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/553 2024-04-17T12:56:42.009 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/553 2024-04-17T12:56:42.009 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:56:42.015 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:42.034 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:56:42.034 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/554) 2024-04-17T12:56:42.699 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:56:42.709 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:56:42.709 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:42.982 INFO:teuthology.orchestra.run.smithi152.stdout:generic/554 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:56:42.990 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/554 2024-04-17T12:56:42.990 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/554 2024-04-17T12:56:42.990 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:56:42.996 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:43.017 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:56:43.018 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/555) 2024-04-17T12:56:43.371 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:56:43.382 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:56:43.382 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:43.754 INFO:teuthology.orchestra.run.smithi152.stdout:generic/555 [not run] xfs_io chattr +ia failed (old kernel/wrong fs/bad args?) 2024-04-17T12:56:43.762 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/555 2024-04-17T12:56:43.762 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/555 2024-04-17T12:56:43.762 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:56:43.768 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:43.804 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:56:43.804 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/556) 2024-04-17T12:56:44.488 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:56:44.499 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:56:44.499 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:44.782 INFO:teuthology.orchestra.run.smithi152.stdout:generic/556 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:56:44.790 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/556 2024-04-17T12:56:44.790 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/556 2024-04-17T12:56:44.790 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:56:44.796 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:44.814 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:56:44.815 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/557) 2024-04-17T12:56:45.184 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:56:45.194 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:56:45.194 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:45.505 INFO:teuthology.orchestra.run.smithi152.stdout:generic/557 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:56:45.513 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/557 2024-04-17T12:56:45.513 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/557 2024-04-17T12:56:45.513 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:56:45.519 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:45.538 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:56:45.538 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/558) 2024-04-17T12:56:45.900 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:56:45.910 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:56:45.910 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:46.220 INFO:teuthology.orchestra.run.smithi152.stdout:generic/558 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:56:46.228 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/558 2024-04-17T12:56:46.228 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/558 2024-04-17T12:56:46.228 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:56:46.234 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:46.253 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:56:46.254 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/559) 2024-04-17T12:56:46.627 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:56:46.638 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:56:46.638 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:46.914 INFO:teuthology.orchestra.run.smithi152.stdout:generic/559 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:56:46.922 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/559 2024-04-17T12:56:46.923 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/559 2024-04-17T12:56:46.923 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:56:46.929 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:46.947 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:56:46.948 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/560) 2024-04-17T12:56:47.320 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:56:47.330 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:56:47.330 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:47.641 INFO:teuthology.orchestra.run.smithi152.stdout:generic/560 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:56:47.649 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/560 2024-04-17T12:56:47.649 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/560 2024-04-17T12:56:47.649 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:56:47.655 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:47.674 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:56:47.674 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/561) 2024-04-17T12:56:48.035 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:56:48.046 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:56:48.046 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:48.309 INFO:teuthology.orchestra.run.smithi152.stdout:generic/561 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:56:48.317 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/561 2024-04-17T12:56:48.317 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/561 2024-04-17T12:56:48.317 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:56:48.323 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:48.343 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:56:48.343 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/562) 2024-04-17T12:56:48.716 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:56:48.726 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:56:48.726 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:49.018 INFO:teuthology.orchestra.run.smithi152.stdout:generic/562 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:56:49.026 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/562 2024-04-17T12:56:49.026 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/562 2024-04-17T12:56:49.026 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:56:49.033 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:49.051 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:56:49.051 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/563) 2024-04-17T12:56:49.415 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:56:49.426 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:56:49.426 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:49.463 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:56:49.466 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:56:49.763 INFO:teuthology.orchestra.run.smithi152.stdout:generic/563 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:56:49.771 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/563 2024-04-17T12:56:49.771 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/563 2024-04-17T12:56:49.771 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:56:49.777 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:49.796 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:56:49.796 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/564) 2024-04-17T12:56:50.171 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:56:50.181 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:56:50.182 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:51.030 INFO:teuthology.orchestra.run.smithi152.stdout:generic/564 1s 2024-04-17T12:56:51.043 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/564 2024-04-17T12:56:51.043 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:56:51.049 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:51.272 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:56:51.272 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/565) 2024-04-17T12:56:51.772 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:56:51.782 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:56:51.782 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:52.057 INFO:teuthology.orchestra.run.smithi152.stdout:generic/565 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:56:52.064 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/565 2024-04-17T12:56:52.064 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/565 2024-04-17T12:56:52.065 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:56:52.070 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:52.089 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:56:52.089 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/566) 2024-04-17T12:56:52.439 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:56:52.449 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:56:52.449 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:52.709 INFO:teuthology.orchestra.run.smithi152.stdout:generic/566 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:56:52.716 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/566 2024-04-17T12:56:52.717 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/566 2024-04-17T12:56:52.717 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:56:52.722 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:52.741 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:56:52.741 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/567) 2024-04-17T12:56:53.104 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:56:53.114 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:56:53.114 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:53.376 INFO:teuthology.orchestra.run.smithi152.stdout:generic/567 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:56:53.384 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/567 2024-04-17T12:56:53.384 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/567 2024-04-17T12:56:53.384 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:56:53.390 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:53.409 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:56:53.409 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/568) 2024-04-17T12:56:53.773 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:56:53.784 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:56:53.784 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:54.238 INFO:teuthology.orchestra.run.smithi152.stdout:generic/568 1s 2024-04-17T12:56:54.332 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/568 2024-04-17T12:56:54.332 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:56:54.352 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:54.463 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:56:54.463 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/569) 2024-04-17T12:56:54.867 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:56:54.877 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:56:54.877 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:55.227 INFO:teuthology.orchestra.run.smithi152.stdout:generic/569 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:56:55.235 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/569 2024-04-17T12:56:55.235 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/569 2024-04-17T12:56:55.235 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:56:55.241 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:55.260 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:56:55.260 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/570) 2024-04-17T12:56:55.616 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:56:55.626 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:56:55.626 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:55.894 INFO:teuthology.orchestra.run.smithi152.stdout:generic/570 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:56:55.902 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/570 2024-04-17T12:56:55.902 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/570 2024-04-17T12:56:55.902 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:56:55.908 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:56:55.928 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:56:55.929 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/571) 2024-04-17T12:56:56.302 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:56:56.312 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:56:56.312 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:02.860 INFO:teuthology.orchestra.run.smithi152.stdout:generic/571 6s 2024-04-17T12:57:02.876 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/571 2024-04-17T12:57:02.876 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:57:02.883 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:02.903 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:57:02.904 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/572) 2024-04-17T12:57:03.608 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:57:03.618 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:57:03.618 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:03.887 INFO:teuthology.orchestra.run.smithi152.stdout:generic/572 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:57:03.895 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/572 2024-04-17T12:57:03.895 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/572 2024-04-17T12:57:03.896 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:57:03.901 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:03.920 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:57:03.920 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/573) 2024-04-17T12:57:04.279 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:57:04.289 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:57:04.289 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:04.566 INFO:teuthology.orchestra.run.smithi152.stdout:generic/573 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:57:04.574 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/573 2024-04-17T12:57:04.574 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/573 2024-04-17T12:57:04.574 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:57:04.580 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:04.599 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:57:04.600 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/574) 2024-04-17T12:57:04.957 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:57:04.967 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:57:04.967 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:05.235 INFO:teuthology.orchestra.run.smithi152.stdout:generic/574 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:57:05.243 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/574 2024-04-17T12:57:05.243 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/574 2024-04-17T12:57:05.243 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:57:05.249 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:05.268 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:57:05.268 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/575) 2024-04-17T12:57:05.644 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:57:05.654 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:57:05.654 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:05.934 INFO:teuthology.orchestra.run.smithi152.stdout:generic/575 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:57:05.942 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/575 2024-04-17T12:57:05.943 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/575 2024-04-17T12:57:05.943 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:57:05.949 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:05.967 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:57:05.968 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/576) 2024-04-17T12:57:06.319 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:57:06.330 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:57:06.330 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:06.661 INFO:teuthology.orchestra.run.smithi152.stdout:generic/576 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:57:06.669 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/576 2024-04-17T12:57:06.669 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/576 2024-04-17T12:57:06.669 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:57:06.676 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:06.695 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:57:06.695 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/577) 2024-04-17T12:57:07.047 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:57:07.058 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:57:07.058 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:07.333 INFO:teuthology.orchestra.run.smithi152.stdout:generic/577 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:57:07.342 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/577 2024-04-17T12:57:07.342 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/577 2024-04-17T12:57:07.342 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:57:07.349 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:07.368 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:57:07.369 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/578) 2024-04-17T12:57:07.719 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:57:07.730 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:57:07.730 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:08.048 INFO:teuthology.orchestra.run.smithi152.stdout:generic/578 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-04-17T12:57:08.056 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/578 2024-04-17T12:57:08.056 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/578 2024-04-17T12:57:08.057 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:57:08.063 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:08.081 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:57:08.082 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/579) 2024-04-17T12:57:08.447 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:57:08.458 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:57:08.458 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:08.745 INFO:teuthology.orchestra.run.smithi152.stdout:generic/579 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:57:08.753 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/579 2024-04-17T12:57:08.753 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/579 2024-04-17T12:57:08.753 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:57:08.759 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:08.778 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:57:08.778 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/580) 2024-04-17T12:57:09.150 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:57:09.160 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:57:09.160 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:09.509 INFO:teuthology.orchestra.run.smithi152.stdout:generic/580 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:57:09.517 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/580 2024-04-17T12:57:09.517 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/580 2024-04-17T12:57:09.517 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:57:09.524 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:09.543 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:57:09.543 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/581) 2024-04-17T12:57:09.915 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:57:09.925 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:57:09.925 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:10.821 INFO:teuthology.orchestra.run.smithi152.stdout:generic/581 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:57:10.829 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/581 2024-04-17T12:57:10.829 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/581 2024-04-17T12:57:10.829 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:57:10.835 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:10.854 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:57:10.854 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/582) 2024-04-17T12:57:11.219 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:57:11.230 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:57:11.230 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:11.563 INFO:teuthology.orchestra.run.smithi152.stdout:generic/582 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:57:11.571 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/582 2024-04-17T12:57:11.571 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/582 2024-04-17T12:57:11.571 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:57:11.577 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:11.596 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:57:11.596 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/583) 2024-04-17T12:57:11.959 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:57:11.969 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:57:11.969 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:12.307 INFO:teuthology.orchestra.run.smithi152.stdout:generic/583 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:57:12.315 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/583 2024-04-17T12:57:12.315 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/583 2024-04-17T12:57:12.315 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:57:12.321 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:12.341 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:57:12.341 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/584) 2024-04-17T12:57:12.695 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:57:12.706 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:57:12.706 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:13.040 INFO:teuthology.orchestra.run.smithi152.stdout:generic/584 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:57:13.048 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/584 2024-04-17T12:57:13.048 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/584 2024-04-17T12:57:13.048 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:57:13.054 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:13.073 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:57:13.073 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/585) 2024-04-17T12:57:13.428 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:57:13.438 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:57:13.438 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:13.701 INFO:teuthology.orchestra.run.smithi152.stdout:generic/585 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:57:13.709 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/585 2024-04-17T12:57:13.710 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/585 2024-04-17T12:57:13.710 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:57:13.716 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:13.735 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:57:13.735 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/586) 2024-04-17T12:57:14.079 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:57:14.089 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:57:14.089 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:19.534 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:57:19.538 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:57:34.704 INFO:teuthology.orchestra.run.smithi152.stdout:generic/586 20s 2024-04-17T12:57:34.716 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/586 2024-04-17T12:57:34.716 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:57:34.722 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:34.770 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:57:34.770 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/587) 2024-04-17T12:57:35.412 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:57:35.422 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:57:35.422 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:35.935 INFO:teuthology.orchestra.run.smithi152.stdout:generic/587 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-04-17T12:57:35.943 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/587 2024-04-17T12:57:35.943 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/587 2024-04-17T12:57:35.943 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:57:35.949 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:35.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:57:35.968 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/588) 2024-04-17T12:57:36.323 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:57:36.333 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:57:36.333 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:36.649 INFO:teuthology.orchestra.run.smithi152.stdout:generic/588 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:57:36.657 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/588 2024-04-17T12:57:36.657 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/588 2024-04-17T12:57:36.657 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:57:36.663 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:36.682 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:57:36.683 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/589) 2024-04-17T12:57:37.039 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:57:37.049 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:57:37.050 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:37.327 INFO:teuthology.orchestra.run.smithi152.stdout:generic/589 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:57:37.335 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/589 2024-04-17T12:57:37.335 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/589 2024-04-17T12:57:37.335 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:57:37.342 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:37.361 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:57:37.361 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/590) 2024-04-17T12:57:37.724 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:57:37.734 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:57:37.734 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:38.000 INFO:teuthology.orchestra.run.smithi152.stdout:generic/590 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:57:38.008 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/590 2024-04-17T12:57:38.008 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/590 2024-04-17T12:57:38.008 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:57:38.014 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:38.033 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:57:38.034 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/591) 2024-04-17T12:57:38.380 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:57:38.390 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:57:38.390 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:39.645 INFO:teuthology.orchestra.run.smithi152.stdout:generic/591 1s 2024-04-17T12:57:39.657 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/591 2024-04-17T12:57:39.657 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:57:39.663 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:39.683 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:57:39.684 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/592) 2024-04-17T12:57:40.375 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:57:40.385 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:57:40.386 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:40.721 INFO:teuthology.orchestra.run.smithi152.stdout:generic/592 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:57:40.728 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/592 2024-04-17T12:57:40.729 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/592 2024-04-17T12:57:40.729 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:57:40.735 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:40.754 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:57:40.754 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/593) 2024-04-17T12:57:41.111 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:57:41.122 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:57:41.122 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:41.458 INFO:teuthology.orchestra.run.smithi152.stdout:generic/593 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:57:41.466 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/593 2024-04-17T12:57:41.466 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/593 2024-04-17T12:57:41.466 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:57:41.472 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:41.491 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:57:41.492 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/594) 2024-04-17T12:57:41.840 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:57:41.850 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:57:41.850 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:42.142 INFO:teuthology.orchestra.run.smithi152.stdout:generic/594 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:57:42.150 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/594 2024-04-17T12:57:42.150 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/594 2024-04-17T12:57:42.150 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:57:42.156 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:42.175 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:57:42.175 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/595) 2024-04-17T12:57:42.535 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:57:42.546 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:57:42.546 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:42.882 INFO:teuthology.orchestra.run.smithi152.stdout:generic/595 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:57:42.890 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/595 2024-04-17T12:57:42.890 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/595 2024-04-17T12:57:42.890 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:57:42.896 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:42.916 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:57:42.917 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/596) 2024-04-17T12:57:43.280 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:57:43.290 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:57:43.290 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:43.589 INFO:teuthology.orchestra.run.smithi152.stdout:generic/596 [not run] accton utility required, skipped this test 2024-04-17T12:57:43.597 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/596 2024-04-17T12:57:43.597 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/596 2024-04-17T12:57:43.597 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:57:43.603 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:43.622 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:57:43.623 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/597) 2024-04-17T12:57:43.974 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:57:43.985 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:57:43.985 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:45.253 INFO:teuthology.orchestra.run.smithi152.stdout:generic/597 - output mismatch (see /tmp/tmp.pJW3k3pP3vxfstests-dev/results//generic/597.out.bad) 2024-04-17T12:57:45.258 INFO:teuthology.orchestra.run.smithi152.stdout: --- tests/generic/597.out 2024-04-17 08:48:08.601451555 +0000 2024-04-17T12:57:45.258 INFO:teuthology.orchestra.run.smithi152.stdout: +++ /tmp/tmp.pJW3k3pP3vxfstests-dev/results//generic/597.out.bad 2024-04-17 12:57:45.244979923 +0000 2024-04-17T12:57:45.259 INFO:teuthology.orchestra.run.smithi152.stdout: @@ -4,11 +4,11 @@ 2024-04-17T12:57:45.259 INFO:teuthology.orchestra.run.smithi152.stdout: fs.protected_symlinks = 0 2024-04-17T12:57:45.259 INFO:teuthology.orchestra.run.smithi152.stdout: successfully followed symlink 2024-04-17T12:57:45.259 INFO:teuthology.orchestra.run.smithi152.stdout: fs.protected_symlinks = 1 2024-04-17T12:57:45.259 INFO:teuthology.orchestra.run.smithi152.stdout: -Permission denied 2024-04-17T12:57:45.259 INFO:teuthology.orchestra.run.smithi152.stdout: +successfully followed symlink 2024-04-17T12:57:45.259 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:45.259 INFO:teuthology.orchestra.run.smithi152.stdout: == Test hardlink create protection when 2024-04-17T12:57:45.259 INFO:teuthology.orchestra.run.smithi152.stdout: == process != target owner and process cannot read target 2024-04-17T12:57:45.259 INFO:teuthology.orchestra.run.smithi152.stdout: fs.protected_hardlinks = 0 2024-04-17T12:57:45.259 INFO:teuthology.orchestra.run.smithi152.stdout: -successfully created hardlink 2024-04-17T12:57:45.259 INFO:teuthology.orchestra.run.smithi152.stdout: +Permission denied 2024-04-17T12:57:45.259 INFO:teuthology.orchestra.run.smithi152.stdout: fs.protected_hardlinks = 1 2024-04-17T12:57:45.259 INFO:teuthology.orchestra.run.smithi152.stdout: -ln: failed to create hard link 'TEST_DIR/597/sticky_dir/hardlink' => 'TEST_DIR/597/target': Operation not permitted 2024-04-17T12:57:45.260 INFO:teuthology.orchestra.run.smithi152.stdout: +Permission denied 2024-04-17T12:57:45.264 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/597 2024-04-17T12:57:45.264 INFO:teuthology.orchestra.run.smithi152.stdout:Failures: generic/597 2024-04-17T12:57:45.264 INFO:teuthology.orchestra.run.smithi152.stdout:Failed 1 of 1 tests 2024-04-17T12:57:45.270 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:45.291 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T12:57:45.291 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-04-17T12:57:45.291 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-04-17T12:57:45.291 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/598) 2024-04-17T12:57:45.988 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:57:45.998 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:57:45.998 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:47.133 INFO:teuthology.orchestra.run.smithi152.stdout:generic/598 - output mismatch (see /tmp/tmp.pJW3k3pP3vxfstests-dev/results//generic/598.out.bad) 2024-04-17T12:57:47.138 INFO:teuthology.orchestra.run.smithi152.stdout: --- tests/generic/598.out 2024-04-17 08:48:08.601451555 +0000 2024-04-17T12:57:47.139 INFO:teuthology.orchestra.run.smithi152.stdout: +++ /tmp/tmp.pJW3k3pP3vxfstests-dev/results//generic/598.out.bad 2024-04-17 12:57:47.124958585 +0000 2024-04-17T12:57:47.139 INFO:teuthology.orchestra.run.smithi152.stdout: @@ -5,13 +5,10 @@ 2024-04-17T12:57:47.139 INFO:teuthology.orchestra.run.smithi152.stdout: = only group writable dir 2024-04-17T12:57:47.139 INFO:teuthology.orchestra.run.smithi152.stdout: fs.protected_regular = 1 2024-04-17T12:57:47.139 INFO:teuthology.orchestra.run.smithi152.stdout: = group & world writable dir 2024-04-17T12:57:47.139 INFO:teuthology.orchestra.run.smithi152.stdout: -Permission denied 2024-04-17T12:57:47.139 INFO:teuthology.orchestra.run.smithi152.stdout: = only group writable dir 2024-04-17T12:57:47.139 INFO:teuthology.orchestra.run.smithi152.stdout: fs.protected_regular = 2 2024-04-17T12:57:47.139 INFO:teuthology.orchestra.run.smithi152.stdout: = group & world writable dir 2024-04-17T12:57:47.139 INFO:teuthology.orchestra.run.smithi152.stdout: -Permission denied 2024-04-17T12:57:47.139 INFO:teuthology.orchestra.run.smithi152.stdout: = only group writable dir 2024-04-17T12:57:47.139 INFO:teuthology.orchestra.run.smithi152.stdout: -Permission denied 2024-04-17T12:57:47.139 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:47.139 INFO:teuthology.orchestra.run.smithi152.stdout: == Test fifo open when owned by another and fifo owner != dir owner 2024-04-17T12:57:47.139 INFO:teuthology.orchestra.run.smithi152.stdout: fs.protected_fifos = 0 2024-04-17T12:57:47.140 INFO:teuthology.orchestra.run.smithi152.stdout: @@ -19,10 +16,7 @@ 2024-04-17T12:57:47.140 INFO:teuthology.orchestra.run.smithi152.stdout: = only group writable dir 2024-04-17T12:57:47.140 INFO:teuthology.orchestra.run.smithi152.stdout: fs.protected_fifos = 1 2024-04-17T12:57:47.140 INFO:teuthology.orchestra.run.smithi152.stdout: = group & world writable dir 2024-04-17T12:57:47.140 INFO:teuthology.orchestra.run.smithi152.stdout: -Permission denied 2024-04-17T12:57:47.140 INFO:teuthology.orchestra.run.smithi152.stdout: = only group writable dir 2024-04-17T12:57:47.140 INFO:teuthology.orchestra.run.smithi152.stdout: fs.protected_fifos = 2 2024-04-17T12:57:47.140 INFO:teuthology.orchestra.run.smithi152.stdout: = group & world writable dir 2024-04-17T12:57:47.140 INFO:teuthology.orchestra.run.smithi152.stdout: -Permission denied 2024-04-17T12:57:47.140 INFO:teuthology.orchestra.run.smithi152.stdout: = only group writable dir 2024-04-17T12:57:47.140 INFO:teuthology.orchestra.run.smithi152.stdout: -Permission denied 2024-04-17T12:57:47.144 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/598 2024-04-17T12:57:47.144 INFO:teuthology.orchestra.run.smithi152.stdout:Failures: generic/598 2024-04-17T12:57:47.144 INFO:teuthology.orchestra.run.smithi152.stdout:Failed 1 of 1 tests 2024-04-17T12:57:47.150 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:47.170 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T12:57:47.171 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-04-17T12:57:47.171 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-04-17T12:57:47.171 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/599) 2024-04-17T12:57:47.871 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:57:47.882 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:57:47.882 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:48.174 INFO:teuthology.orchestra.run.smithi152.stdout:generic/599 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:57:48.181 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/599 2024-04-17T12:57:48.182 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/599 2024-04-17T12:57:48.182 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:57:48.188 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:48.209 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:57:48.209 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/600) 2024-04-17T12:57:48.584 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:57:48.594 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:57:48.594 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:48.870 INFO:teuthology.orchestra.run.smithi152.stdout:generic/600 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:57:48.878 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/600 2024-04-17T12:57:48.878 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/600 2024-04-17T12:57:48.878 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:57:48.884 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:48.904 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:57:48.904 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/601) 2024-04-17T12:57:49.265 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:57:49.275 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:57:49.275 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:49.562 INFO:teuthology.orchestra.run.smithi152.stdout:generic/601 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:57:49.571 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/601 2024-04-17T12:57:49.571 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/601 2024-04-17T12:57:49.571 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:57:49.577 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:49.597 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:57:49.598 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/602) 2024-04-17T12:57:49.614 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:57:49.646 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:57:49.959 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:57:49.970 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:57:49.970 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:50.303 INFO:teuthology.orchestra.run.smithi152.stdout:generic/602 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:57:50.311 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/602 2024-04-17T12:57:50.311 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/602 2024-04-17T12:57:50.311 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:57:50.317 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:50.337 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:57:50.337 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/603) 2024-04-17T12:57:50.719 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:57:50.730 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:57:50.730 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:50.999 INFO:teuthology.orchestra.run.smithi152.stdout:generic/603 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:57:51.007 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/603 2024-04-17T12:57:51.007 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/603 2024-04-17T12:57:51.007 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:57:51.013 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:51.034 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:57:51.034 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/604) 2024-04-17T12:57:51.402 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:57:51.413 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:57:51.413 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:51.681 INFO:teuthology.orchestra.run.smithi152.stdout:generic/604 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:57:51.689 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/604 2024-04-17T12:57:51.689 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/604 2024-04-17T12:57:51.690 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:57:51.696 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:51.715 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:57:51.715 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/605) 2024-04-17T12:57:52.083 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:57:52.094 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:57:52.094 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:52.355 INFO:teuthology.orchestra.run.smithi152.stdout:generic/605 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:57:52.363 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/605 2024-04-17T12:57:52.363 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/605 2024-04-17T12:57:52.363 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:57:52.369 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:52.389 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:57:52.389 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/606) 2024-04-17T12:57:52.759 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:57:52.770 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:57:52.770 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:53.043 INFO:teuthology.orchestra.run.smithi152.stdout:generic/606 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:57:53.051 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/606 2024-04-17T12:57:53.051 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/606 2024-04-17T12:57:53.051 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:57:53.057 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:53.077 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:57:53.077 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/607) 2024-04-17T12:57:53.441 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:57:53.451 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:57:53.451 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:53.736 INFO:teuthology.orchestra.run.smithi152.stdout:generic/607 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:57:53.744 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/607 2024-04-17T12:57:53.744 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/607 2024-04-17T12:57:53.744 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:57:53.750 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:53.770 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:57:53.770 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/608) 2024-04-17T12:57:54.136 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:57:54.145 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:57:54.145 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:54.440 INFO:teuthology.orchestra.run.smithi152.stdout:generic/608 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:57:54.449 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/608 2024-04-17T12:57:54.449 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/608 2024-04-17T12:57:54.449 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:57:54.455 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:54.475 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:57:54.475 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/609) 2024-04-17T12:57:54.828 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:57:54.838 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:57:54.838 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:55.408 INFO:teuthology.orchestra.run.smithi152.stdout:generic/609 1s 2024-04-17T12:57:55.420 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/609 2024-04-17T12:57:55.420 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:57:55.426 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:55.666 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:57:55.666 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/610) 2024-04-17T12:57:56.164 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:57:56.174 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:57:56.174 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:56.487 INFO:teuthology.orchestra.run.smithi152.stdout:generic/610 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:57:56.495 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/610 2024-04-17T12:57:56.495 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/610 2024-04-17T12:57:56.495 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:57:56.501 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:56.520 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:57:56.520 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/611) 2024-04-17T12:57:56.875 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:57:56.885 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:57:56.885 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:57.159 INFO:teuthology.orchestra.run.smithi152.stdout:generic/611 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:57:57.167 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/611 2024-04-17T12:57:57.167 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/611 2024-04-17T12:57:57.168 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:57:57.173 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:57.193 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:57:57.194 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/612) 2024-04-17T12:57:57.555 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:57:57.566 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:57:57.566 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:57.930 INFO:teuthology.orchestra.run.smithi152.stdout:generic/612 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-17T12:57:57.938 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/612 2024-04-17T12:57:57.938 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/612 2024-04-17T12:57:57.938 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:57:57.944 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:57.975 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:57:57.975 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/613) 2024-04-17T12:57:58.671 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:57:58.682 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:57:58.682 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:59.024 INFO:teuthology.orchestra.run.smithi152.stdout:generic/613 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:57:59.032 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/613 2024-04-17T12:57:59.032 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/613 2024-04-17T12:57:59.032 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:57:59.038 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:59.057 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:57:59.057 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/614) 2024-04-17T12:57:59.415 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:57:59.425 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:57:59.425 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:59.695 INFO:teuthology.orchestra.run.smithi152.stdout:generic/614 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:57:59.703 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/614 2024-04-17T12:57:59.703 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/614 2024-04-17T12:57:59.703 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:57:59.709 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:57:59.729 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:57:59.729 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/615) 2024-04-17T12:58:00.098 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:58:00.108 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:58:00.108 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:58:00.386 INFO:teuthology.orchestra.run.smithi152.stdout:generic/615 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T12:58:00.394 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/615 2024-04-17T12:58:00.394 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/615 2024-04-17T12:58:00.394 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T12:58:00.400 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:58:00.420 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T12:58:00.420 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/616) 2024-04-17T12:58:00.771 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T12:58:00.782 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T12:58:00.782 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T12:58:19.775 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:58:19.778 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:58:49.890 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:58:49.894 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:59:20.020 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:59:20.025 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:59:50.141 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T12:59:50.144 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:00:20.262 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:00:20.266 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:00:50.375 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:00:50.379 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:00:50.406 INFO:tasks.ceph.osd.1.smithi152.stderr:2024-04-17T13:00:50.402+0000 7fb553c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 443619) UID: 0 2024-04-17T13:00:50.406 INFO:tasks.ceph.osd.0.smithi152.stderr:2024-04-17T13:00:50.402+0000 7f2076000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 443619) UID: 0 2024-04-17T13:00:50.407 INFO:tasks.ceph.osd.2.smithi152.stderr:2024-04-17T13:00:50.402+0000 7f9821400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 443619) UID: 0 2024-04-17T13:00:50.407 INFO:tasks.ceph.osd.3.smithi152.stderr:2024-04-17T13:00:50.402+0000 7f2cca800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 443619) UID: 0 2024-04-17T13:01:52.215 INFO:teuthology.orchestra.run.smithi152.stdout:generic/616 232s 2024-04-17T13:01:52.227 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/616 2024-04-17T13:01:52.227 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T13:01:52.233 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:01:52.253 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T13:01:52.254 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/617) 2024-04-17T13:01:52.664 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T13:01:52.675 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T13:01:52.675 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:01.163 INFO:teuthology.orchestra.run.smithi152.stdout:generic/617 69s 2024-04-17T13:03:01.175 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/617 2024-04-17T13:03:01.175 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T13:03:01.181 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:01.359 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T13:03:01.359 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/618) 2024-04-17T13:03:01.948 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T13:03:01.958 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T13:03:01.958 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:02.298 INFO:teuthology.orchestra.run.smithi152.stdout:generic/618 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T13:03:02.306 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/618 2024-04-17T13:03:02.306 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/618 2024-04-17T13:03:02.306 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T13:03:02.312 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:02.332 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T13:03:02.332 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/619) 2024-04-17T13:03:02.698 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T13:03:02.708 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T13:03:02.708 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:02.984 INFO:teuthology.orchestra.run.smithi152.stdout:generic/619 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T13:03:02.992 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/619 2024-04-17T13:03:02.992 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/619 2024-04-17T13:03:02.992 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T13:03:02.998 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:03.018 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T13:03:03.018 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/620) 2024-04-17T13:03:03.726 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T13:03:03.736 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T13:03:03.737 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:04.408 INFO:teuthology.orchestra.run.smithi152.stdout:generic/620 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T13:03:04.416 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/620 2024-04-17T13:03:04.417 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/620 2024-04-17T13:03:04.417 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T13:03:04.423 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:04.444 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T13:03:04.444 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/621) 2024-04-17T13:03:04.820 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T13:03:04.830 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T13:03:04.830 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:05.201 INFO:teuthology.orchestra.run.smithi152.stdout:generic/621 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T13:03:05.209 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/621 2024-04-17T13:03:05.209 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/621 2024-04-17T13:03:05.209 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T13:03:05.218 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:05.236 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T13:03:05.236 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/622) 2024-04-17T13:03:05.616 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T13:03:05.626 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T13:03:05.626 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:05.904 INFO:teuthology.orchestra.run.smithi152.stdout:generic/622 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T13:03:05.912 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/622 2024-04-17T13:03:05.912 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/622 2024-04-17T13:03:05.912 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T13:03:05.918 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:05.937 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T13:03:05.938 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/623) 2024-04-17T13:03:06.306 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T13:03:06.317 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T13:03:06.317 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:06.594 INFO:teuthology.orchestra.run.smithi152.stdout:generic/623 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T13:03:06.602 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/623 2024-04-17T13:03:06.602 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/623 2024-04-17T13:03:06.602 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T13:03:06.608 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:06.628 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T13:03:06.628 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/624) 2024-04-17T13:03:07.017 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T13:03:07.028 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T13:03:07.028 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:07.384 INFO:teuthology.orchestra.run.smithi152.stdout:generic/624 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T13:03:07.392 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/624 2024-04-17T13:03:07.392 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/624 2024-04-17T13:03:07.392 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T13:03:07.398 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:07.418 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T13:03:07.418 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/625) 2024-04-17T13:03:07.782 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T13:03:07.792 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T13:03:07.793 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:08.835 INFO:teuthology.orchestra.run.smithi152.stdout:generic/625 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T13:03:08.843 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/625 2024-04-17T13:03:08.843 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/625 2024-04-17T13:03:08.843 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T13:03:08.849 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:08.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T13:03:08.869 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/626) 2024-04-17T13:03:09.259 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T13:03:09.269 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T13:03:09.269 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:09.551 INFO:teuthology.orchestra.run.smithi152.stdout:generic/626 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T13:03:09.559 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/626 2024-04-17T13:03:09.559 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/626 2024-04-17T13:03:09.559 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T13:03:09.566 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:09.585 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T13:03:09.585 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/627) 2024-04-17T13:03:09.955 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T13:03:09.966 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T13:03:09.966 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:10.264 INFO:teuthology.orchestra.run.smithi152.stdout:generic/627 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T13:03:10.272 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/627 2024-04-17T13:03:10.272 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/627 2024-04-17T13:03:10.273 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T13:03:10.278 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:10.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T13:03:10.298 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/628) 2024-04-17T13:03:10.667 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T13:03:10.678 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T13:03:10.678 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:11.000 INFO:teuthology.orchestra.run.smithi152.stdout:generic/628 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T13:03:11.008 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/628 2024-04-17T13:03:11.008 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/628 2024-04-17T13:03:11.008 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T13:03:11.014 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:11.071 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T13:03:11.072 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/629) 2024-04-17T13:03:11.443 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T13:03:11.453 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T13:03:11.453 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:11.760 INFO:teuthology.orchestra.run.smithi152.stdout:generic/629 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T13:03:11.768 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/629 2024-04-17T13:03:11.768 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/629 2024-04-17T13:03:11.768 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T13:03:11.774 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:11.793 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T13:03:11.794 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/630) 2024-04-17T13:03:12.159 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T13:03:12.170 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T13:03:12.170 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:12.448 INFO:teuthology.orchestra.run.smithi152.stdout:generic/630 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T13:03:12.456 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/630 2024-04-17T13:03:12.456 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/630 2024-04-17T13:03:12.457 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T13:03:12.462 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:12.482 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T13:03:12.482 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/631) 2024-04-17T13:03:12.856 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T13:03:12.866 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T13:03:12.866 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:13.174 INFO:teuthology.orchestra.run.smithi152.stdout:generic/631 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T13:03:13.182 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/631 2024-04-17T13:03:13.182 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/631 2024-04-17T13:03:13.182 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T13:03:13.188 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:13.209 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T13:03:13.209 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/632) 2024-04-17T13:03:13.572 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T13:03:13.582 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T13:03:13.583 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:19.807 INFO:teuthology.orchestra.run.smithi152.stdout:generic/632 6s 2024-04-17T13:03:19.819 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/632 2024-04-17T13:03:19.820 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T13:03:19.825 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:19.847 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T13:03:19.847 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/633) 2024-04-17T13:03:20.228 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T13:03:20.238 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T13:03:20.238 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:20.938 INFO:teuthology.orchestra.run.smithi152.stdout:generic/633 [failed, exit status 1]- output mismatch (see /tmp/tmp.pJW3k3pP3vxfstests-dev/results//generic/633.out.bad) 2024-04-17T13:03:20.983 INFO:teuthology.orchestra.run.smithi152.stdout: --- tests/generic/633.out 2024-04-17 08:48:08.605451508 +0000 2024-04-17T13:03:20.984 INFO:teuthology.orchestra.run.smithi152.stdout: +++ /tmp/tmp.pJW3k3pP3vxfstests-dev/results//generic/633.out.bad 2024-04-17 13:03:20.877182147 +0000 2024-04-17T13:03:20.984 INFO:teuthology.orchestra.run.smithi152.stdout: @@ -1,2 +1,5 @@ 2024-04-17T13:03:20.984 INFO:teuthology.orchestra.run.smithi152.stdout: QA output created by 633 2024-04-17T13:03:20.984 INFO:teuthology.orchestra.run.smithi152.stdout: Silence is golden 2024-04-17T13:03:20.984 INFO:teuthology.orchestra.run.smithi152.stdout: +vfstest.c: 1164: protected_symlinks - Success - failure: openat 2024-04-17T13:03:20.984 INFO:teuthology.orchestra.run.smithi152.stdout: +vfstest.c: 1171: protected_symlinks - Success - failure: wait_for_pid 2024-04-17T13:03:20.984 INFO:teuthology.orchestra.run.smithi152.stdout: +vfstest.c: 2418: run_test - Success - failure: following protected symlinks on regular mounts 2024-04-17T13:03:20.993 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/633 2024-04-17T13:03:20.994 INFO:teuthology.orchestra.run.smithi152.stdout:Failures: generic/633 2024-04-17T13:03:20.994 INFO:teuthology.orchestra.run.smithi152.stdout:Failed 1 of 1 tests 2024-04-17T13:03:21.042 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:21.106 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T13:03:21.107 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-04-17T13:03:21.107 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-04-17T13:03:21.107 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/634) 2024-04-17T13:03:21.578 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T13:03:21.589 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T13:03:21.589 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:21.866 INFO:teuthology.orchestra.run.smithi152.stdout:generic/634 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T13:03:21.874 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/634 2024-04-17T13:03:21.874 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/634 2024-04-17T13:03:21.874 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T13:03:21.880 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:21.900 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T13:03:21.901 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/635) 2024-04-17T13:03:22.275 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T13:03:22.285 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T13:03:22.286 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:23.070 INFO:teuthology.orchestra.run.smithi152.stdout:generic/635 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T13:03:23.078 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/635 2024-04-17T13:03:23.078 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/635 2024-04-17T13:03:23.079 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T13:03:23.085 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:23.104 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T13:03:23.105 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/636) 2024-04-17T13:03:23.487 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T13:03:23.498 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T13:03:23.498 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:23.763 INFO:teuthology.orchestra.run.smithi152.stdout:generic/636 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T13:03:23.772 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/636 2024-04-17T13:03:23.772 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/636 2024-04-17T13:03:23.772 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T13:03:23.778 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:23.843 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T13:03:23.843 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/637) 2024-04-17T13:03:24.214 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T13:03:24.224 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T13:03:24.225 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:25.758 INFO:teuthology.orchestra.run.smithi152.stdout:generic/637 1s 2024-04-17T13:03:25.771 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/637 2024-04-17T13:03:25.771 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T13:03:25.777 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:25.834 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T13:03:25.834 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/638) 2024-04-17T13:03:26.563 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T13:03:26.573 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T13:03:26.573 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:26.966 INFO:teuthology.orchestra.run.smithi152.stdout:generic/638 0s 2024-04-17T13:03:26.978 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/638 2024-04-17T13:03:26.978 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T13:03:26.984 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:27.004 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T13:03:27.004 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/639) 2024-04-17T13:03:27.359 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T13:03:27.369 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T13:03:27.369 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:29.506 INFO:teuthology.orchestra.run.smithi152.stdout:generic/639 2s 2024-04-17T13:03:29.518 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/639 2024-04-17T13:03:29.519 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T13:03:29.525 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:29.543 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T13:03:29.543 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/640) 2024-04-17T13:03:29.905 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T13:03:29.916 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T13:03:29.916 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:30.570 INFO:teuthology.orchestra.run.smithi152.stdout:generic/640 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T13:03:30.578 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/640 2024-04-17T13:03:30.578 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/640 2024-04-17T13:03:30.579 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T13:03:30.585 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:30.627 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T13:03:30.627 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/641) 2024-04-17T13:03:30.986 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T13:03:30.997 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T13:03:30.997 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:31.463 INFO:teuthology.orchestra.run.smithi152.stdout:generic/641 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T13:03:31.471 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/641 2024-04-17T13:03:31.471 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/641 2024-04-17T13:03:31.471 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T13:03:31.477 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:31.497 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T13:03:31.497 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/642) 2024-04-17T13:03:31.879 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T13:03:31.890 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T13:03:31.890 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:32.183 INFO:teuthology.orchestra.run.smithi152.stdout:generic/642 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T13:03:32.192 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/642 2024-04-17T13:03:32.192 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/642 2024-04-17T13:03:32.192 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T13:03:32.198 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:32.217 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T13:03:32.217 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/643) 2024-04-17T13:03:32.581 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T13:03:32.592 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T13:03:32.592 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:32.882 INFO:teuthology.orchestra.run.smithi152.stdout:generic/643 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T13:03:32.890 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/643 2024-04-17T13:03:32.890 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/643 2024-04-17T13:03:32.891 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T13:03:32.896 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:32.963 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T13:03:32.963 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/644) 2024-04-17T13:03:33.347 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T13:03:33.357 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T13:03:33.357 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:33.677 INFO:teuthology.orchestra.run.smithi152.stdout:generic/644 [not run] vfstest not support by ceph-fuse 2024-04-17T13:03:33.685 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/644 2024-04-17T13:03:33.685 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/644 2024-04-17T13:03:33.685 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T13:03:33.691 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:33.711 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T13:03:33.711 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/645) 2024-04-17T13:03:34.084 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T13:03:34.094 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T13:03:34.094 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:34.368 INFO:teuthology.orchestra.run.smithi152.stdout:generic/645 [not run] vfstest not support by ceph-fuse 2024-04-17T13:03:34.376 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/645 2024-04-17T13:03:34.376 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/645 2024-04-17T13:03:34.376 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T13:03:34.382 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:34.402 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T13:03:34.402 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/646) 2024-04-17T13:03:34.779 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T13:03:34.789 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T13:03:34.789 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:35.075 INFO:teuthology.orchestra.run.smithi152.stdout:generic/646 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T13:03:35.084 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/646 2024-04-17T13:03:35.084 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/646 2024-04-17T13:03:35.084 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T13:03:35.398 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:35.417 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T13:03:35.417 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/647) 2024-04-17T13:03:35.779 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T13:03:35.790 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T13:03:35.790 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:36.313 INFO:teuthology.orchestra.run.smithi152.stdout:generic/647 1s 2024-04-17T13:03:36.325 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/647 2024-04-17T13:03:36.326 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T13:03:36.332 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:36.532 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T13:03:36.532 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/648) 2024-04-17T13:03:37.154 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T13:03:37.165 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T13:03:37.165 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:37.556 INFO:teuthology.orchestra.run.smithi152.stdout:generic/648 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T13:03:37.563 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/648 2024-04-17T13:03:37.564 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/648 2024-04-17T13:03:37.564 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T13:03:37.570 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:37.589 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T13:03:37.590 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/649) 2024-04-17T13:03:37.960 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T13:03:37.971 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T13:03:37.971 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:38.375 INFO:teuthology.orchestra.run.smithi152.stdout:generic/649 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-17T13:03:38.383 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/649 2024-04-17T13:03:38.384 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/649 2024-04-17T13:03:38.384 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T13:03:38.390 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:03:38.413 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T13:03:38.413 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/650) 2024-04-17T13:03:39.131 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T13:03:39.141 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T13:03:39.142 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T13:04:11.220 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:04:11.228 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:04:11.323 INFO:tasks.ceph.osd.0.smithi152.stderr:2024-04-17T13:04:11.316+0000 7f2076000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 458083) UID: 0 2024-04-17T13:04:11.323 INFO:tasks.ceph.osd.3.smithi152.stderr:2024-04-17T13:04:11.316+0000 7f2cca800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 458083) UID: 0 2024-04-17T13:04:11.328 INFO:tasks.ceph.osd.1.smithi152.stderr:2024-04-17T13:04:11.316+0000 7fb553c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 458083) UID: 0 2024-04-17T13:04:11.332 INFO:tasks.ceph.osd.2.smithi152.stderr:2024-04-17T13:04:11.328+0000 7f9821400640 -1 Fail to open '/proc/458083/cmdline' error = (2) No such file or directory 2024-04-17T13:04:11.332 INFO:tasks.ceph.osd.2.smithi152.stderr:2024-04-17T13:04:11.328+0000 7f9821400640 -1 received signal: Hangup from (PID: 458083) UID: 0 2024-04-17T13:14:46.636 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:14:46.650 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:15:17.093 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:15:17.097 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:15:47.191 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:15:47.208 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:16:17.334 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:16:17.343 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:16:47.897 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:16:47.905 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:17:18.490 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:17:18.495 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:17:18.521 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-04-17T13:17:18.521+0000 7fc89d000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 35377) UID: 0 2024-04-17T13:17:18.521 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-04-17T13:17:18.521+0000 7fc7d2600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 35377) UID: 0 2024-04-17T13:17:18.522 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-04-17T13:17:18.521+0000 7f2b4a200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 35377) UID: 0 2024-04-17T13:17:18.522 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-04-17T13:17:18.521+0000 7f5475c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 35377) UID: 0 2024-04-17T13:20:35.210 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:20:35.243 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:21:07.338 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:21:07.346 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:21:37.504 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:21:37.511 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:21:37.579 INFO:tasks.ceph.mds.c.smithi152.stderr:2024-04-17T13:21:37.572+0000 7f1eb3200640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 461507) UID: 0 2024-04-17T13:21:37.579 INFO:tasks.ceph.mds.a.smithi152.stderr:2024-04-17T13:21:37.572+0000 7f65f1400640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 461507) UID: 0 2024-04-17T13:31:44.360 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:31:44.380 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:32:14.689 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:32:14.695 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:32:44.844 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:32:44.859 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:33:15.153 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:33:15.177 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:33:45.532 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:33:45.538 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:34:15.689 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:34:15.694 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:34:45.798 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:34:45.805 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:35:15.968 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:35:15.973 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:35:46.179 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:35:46.198 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:36:16.751 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:36:16.756 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:36:47.415 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:36:47.439 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:37:17.963 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:37:17.985 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:37:48.475 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:37:48.487 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:38:18.681 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:38:18.698 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:38:48.916 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:38:48.934 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:39:19.025 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:39:19.052 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:39:49.612 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:39:49.618 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:40:19.828 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:40:19.861 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:40:50.277 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:40:50.347 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:41:20.776 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:41:20.780 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:41:50.875 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:41:50.891 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:42:21.069 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:42:21.080 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:42:51.173 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:42:51.178 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:43:21.447 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:43:21.472 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:43:52.068 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:43:52.084 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:44:22.333 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:44:22.336 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:44:52.605 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:44:52.612 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:45:22.795 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:45:22.800 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:45:53.219 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:45:53.224 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:46:23.826 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:46:23.833 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:46:53.979 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:46:54.007 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:47:24.306 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:47:24.353 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:47:24.412 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-04-17T13:47:24.407+0000 7fc7d2600640 -1 received signal: Hangup from (PID: 35616) UID: 0 2024-04-17T13:47:24.413 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-04-17T13:47:24.403+0000 7fc89d000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 35616) UID: 0 2024-04-17T13:47:24.413 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-04-17T13:47:24.407+0000 7f5475c00640 -1 received signal: Hangup from (PID: 35616) UID: 0 2024-04-17T13:47:24.414 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-04-17T13:47:24.407+0000 7f2b4a200640 -1 received signal: Hangup from (PID: 35616) UID: 0 2024-04-17T13:50:09.970 INFO:teuthology.orchestra.run.smithi196.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-osd.6.log.1: 2024-04-17T13:50:09.970 INFO:teuthology.orchestra.run.smithi196.stderr:gzip: stdin: file size changed while zipping 2024-04-17T13:50:43.588 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:50:43.615 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:51:14.057 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:51:14.061 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:51:44.441 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:51:44.444 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:52:14.758 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:52:14.780 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T13:52:15.123 INFO:tasks.ceph.osd.0.smithi152.stderr:2024-04-17T13:52:15.120+0000 7f2076000640 -1 Fail to open '/proc/465621/cmdline' error = (2) No such file or directory 2024-04-17T13:52:15.123 INFO:tasks.ceph.osd.0.smithi152.stderr:2024-04-17T13:52:15.120+0000 7f2076000640 -1 received signal: Hangup from (PID: 465621) UID: 0 2024-04-17T13:52:15.123 INFO:tasks.ceph.osd.1.smithi152.stderr:2024-04-17T13:52:15.120+0000 7fb553c00640 -1 Fail to open '/proc/465621/cmdline' error = (2) No such file or directory 2024-04-17T13:52:15.123 INFO:tasks.ceph.osd.1.smithi152.stderr:2024-04-17T13:52:15.120+0000 7fb553c00640 -1 received signal: Hangup from (PID: 465621) UID: 0 2024-04-17T13:52:15.123 INFO:tasks.ceph.osd.3.smithi152.stderr:2024-04-17T13:52:15.120+0000 7f2cca800640 -1 Fail to open '/proc/465621/cmdline' error = (2) No such file or directory 2024-04-17T13:52:15.123 INFO:tasks.ceph.osd.3.smithi152.stderr:2024-04-17T13:52:15.120+0000 7f2cca800640 -1 received signal: Hangup from (PID: 465621) UID: 0 2024-04-17T13:52:15.129 INFO:tasks.ceph.osd.2.smithi152.stderr:2024-04-17T13:52:15.120+0000 7f9821400640 -1 Fail to open '/proc/465621/cmdline' error = (2) No such file or directory 2024-04-17T13:52:15.129 INFO:tasks.ceph.osd.2.smithi152.stderr:2024-04-17T13:52:15.124+0000 7f9821400640 -1 received signal: Hangup from (PID: 465621) UID: 0 2024-04-17T14:03:33.377 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:03:33.409 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:03:33.483 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-04-17T14:03:33.482+0000 7fc89d000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 35680) UID: 0 2024-04-17T14:03:33.483 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-04-17T14:03:33.482+0000 7fc7d2600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 35680) UID: 0 2024-04-17T14:03:33.484 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-04-17T14:03:33.482+0000 7f2b4a200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 35680) UID: 0 2024-04-17T14:03:33.484 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-04-17T14:03:33.482+0000 7f5475c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 35680) UID: 0 2024-04-17T14:03:33.652 INFO:tasks.ceph.mds.a.smithi152.stderr:2024-04-17T14:03:33.648+0000 7f65f1400640 -1 Fail to open '/proc/467186/cmdline' error = (2) No such file or directory 2024-04-17T14:03:33.652 INFO:tasks.ceph.mds.a.smithi152.stderr:2024-04-17T14:03:33.648+0000 7f65f1400640 -1 received signal: Hangup from (PID: 467186) UID: 0 2024-04-17T14:03:33.665 INFO:tasks.ceph.mds.c.smithi152.stderr:2024-04-17T14:03:33.648+0000 7f1eb3200640 -1 Fail to open '/proc/467186/cmdline' error = (2) No such file or directory 2024-04-17T14:03:33.665 INFO:tasks.ceph.mds.c.smithi152.stderr:2024-04-17T14:03:33.648+0000 7f1eb3200640 -1 received signal: Hangup from (PID: 467186) UID: 0 2024-04-17T14:17:50.262 INFO:tasks.ceph.osd.1.smithi152.stderr:2024-04-17T14:17:50.259+0000 7fb553c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 469110) UID: 0 2024-04-17T14:17:50.268 INFO:tasks.ceph.osd.0.smithi152.stderr:2024-04-17T14:17:50.267+0000 7f2076000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 469110) UID: 0 2024-04-17T14:17:50.270 INFO:tasks.ceph.osd.3.smithi152.stderr:2024-04-17T14:17:50.267+0000 7f2cca800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 469110) UID: 0 2024-04-17T14:17:50.272 INFO:tasks.ceph.osd.2.smithi152.stderr:2024-04-17T14:17:50.267+0000 7f9821400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 469110) UID: 0 2024-04-17T14:41:40.894 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:41:40.900 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T14:41:41.126 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-04-17T14:41:41.126+0000 7fc7d2600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 35830) UID: 0 2024-04-17T14:41:41.126 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-04-17T14:41:41.126+0000 7fc89d000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 35830) UID: 0 2024-04-17T14:41:41.127 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-04-17T14:41:41.126+0000 7f5475c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 35830) UID: 0 2024-04-17T14:41:41.127 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-04-17T14:41:41.126+0000 7f2b4a200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 35830) UID: 0 2024-04-17T14:41:41.526 INFO:tasks.ceph.mds.c.smithi152.stderr:2024-04-17T14:41:41.523+0000 7f1eb3200640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 471941) UID: 0 2024-04-17T14:41:41.526 INFO:tasks.ceph.mds.a.smithi152.stderr:2024-04-17T14:41:41.523+0000 7f65f1400640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 471941) UID: 0 2024-04-17T14:46:05.613 INFO:teuthology.orchestra.run.smithi152.stdout:generic/650 6146s 2024-04-17T14:46:06.000 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/650 2024-04-17T14:46:06.000 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T14:46:06.030 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T14:46:06.128 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T14:46:06.128 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/651) 2024-04-17T14:46:08.673 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T14:46:08.725 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T14:46:08.726 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T14:46:09.749 INFO:teuthology.orchestra.run.smithi152.stdout:generic/651 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T14:46:09.773 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/651 2024-04-17T14:46:09.774 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/651 2024-04-17T14:46:09.774 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T14:46:09.799 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T14:46:09.866 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T14:46:09.867 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/652) 2024-04-17T14:46:11.046 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T14:46:11.096 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T14:46:11.096 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T14:46:12.238 INFO:teuthology.orchestra.run.smithi152.stdout:generic/652 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T14:46:12.271 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/652 2024-04-17T14:46:12.272 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/652 2024-04-17T14:46:12.272 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T14:46:12.286 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T14:46:12.350 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T14:46:12.350 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/653) 2024-04-17T14:46:13.548 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T14:46:13.597 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T14:46:13.598 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T14:46:16.071 INFO:teuthology.orchestra.run.smithi152.stdout:generic/653 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T14:46:16.112 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/653 2024-04-17T14:46:16.113 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/653 2024-04-17T14:46:16.113 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T14:46:16.130 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T14:46:16.178 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T14:46:16.178 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/654) 2024-04-17T14:46:17.249 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T14:46:17.290 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T14:46:17.290 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T14:46:18.333 INFO:teuthology.orchestra.run.smithi152.stdout:generic/654 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T14:46:18.348 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/654 2024-04-17T14:46:18.348 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/654 2024-04-17T14:46:18.348 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T14:46:18.377 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T14:46:18.465 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T14:46:18.465 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/655) 2024-04-17T14:46:19.893 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T14:46:19.926 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T14:46:19.926 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T14:46:21.022 INFO:teuthology.orchestra.run.smithi152.stdout:generic/655 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T14:46:21.053 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/655 2024-04-17T14:46:21.053 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/655 2024-04-17T14:46:21.053 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T14:46:21.086 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T14:46:21.141 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T14:46:21.141 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/656) 2024-04-17T14:46:22.338 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T14:46:22.392 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T14:46:22.392 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T14:46:23.416 INFO:teuthology.orchestra.run.smithi152.stdout:generic/656 [not run] vfstest not support by ceph-fuse 2024-04-17T14:46:23.447 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/656 2024-04-17T14:46:23.447 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/656 2024-04-17T14:46:23.447 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T14:46:23.457 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T14:46:23.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T14:46:23.540 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/657) 2024-04-17T14:46:24.869 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T14:46:24.916 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T14:46:24.917 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T14:46:26.096 INFO:teuthology.orchestra.run.smithi152.stdout:generic/657 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T14:46:26.118 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/657 2024-04-17T14:46:26.119 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/657 2024-04-17T14:46:26.119 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T14:46:26.140 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T14:46:26.198 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T14:46:26.198 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/658) 2024-04-17T14:46:27.445 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T14:46:27.460 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T14:46:27.460 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T14:46:28.505 INFO:teuthology.orchestra.run.smithi152.stdout:generic/658 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T14:46:28.539 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/658 2024-04-17T14:46:28.539 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/658 2024-04-17T14:46:28.539 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T14:46:28.569 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T14:46:28.657 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T14:46:28.658 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/659) 2024-04-17T14:46:29.938 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T14:46:29.969 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T14:46:29.969 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T14:46:31.039 INFO:teuthology.orchestra.run.smithi152.stdout:generic/659 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T14:46:31.075 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/659 2024-04-17T14:46:31.075 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/659 2024-04-17T14:46:31.075 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T14:46:31.103 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T14:46:31.186 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T14:46:31.187 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/660) 2024-04-17T14:46:32.367 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T14:46:32.412 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T14:46:32.412 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T14:46:33.387 INFO:teuthology.orchestra.run.smithi152.stdout:generic/660 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T14:46:33.425 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/660 2024-04-17T14:46:33.426 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/660 2024-04-17T14:46:33.426 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T14:46:33.453 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T14:46:33.490 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T14:46:33.491 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/661) 2024-04-17T14:46:34.882 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T14:46:34.936 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T14:46:34.936 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T14:46:36.049 INFO:teuthology.orchestra.run.smithi152.stdout:generic/661 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T14:46:36.077 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/661 2024-04-17T14:46:36.077 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/661 2024-04-17T14:46:36.077 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T14:46:36.083 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T14:46:36.128 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T14:46:36.128 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/662) 2024-04-17T14:46:37.381 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T14:46:37.434 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T14:46:37.434 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T14:46:38.467 INFO:teuthology.orchestra.run.smithi152.stdout:generic/662 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T14:46:38.495 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/662 2024-04-17T14:46:38.495 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/662 2024-04-17T14:46:38.495 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T14:46:38.509 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T14:46:38.542 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T14:46:38.542 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/663) 2024-04-17T14:46:39.878 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T14:46:39.929 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T14:46:39.929 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T14:46:41.006 INFO:teuthology.orchestra.run.smithi152.stdout:generic/663 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T14:46:41.044 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/663 2024-04-17T14:46:41.044 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/663 2024-04-17T14:46:41.044 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T14:46:41.068 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T14:46:41.110 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T14:46:41.111 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/664) 2024-04-17T14:46:42.242 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T14:46:42.287 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T14:46:42.287 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T14:46:43.251 INFO:teuthology.orchestra.run.smithi152.stdout:generic/664 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T14:46:43.261 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/664 2024-04-17T14:46:43.261 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/664 2024-04-17T14:46:43.261 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T14:46:43.279 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T14:46:43.327 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T14:46:43.328 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/665) 2024-04-17T14:46:44.419 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T14:46:44.435 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T14:46:44.435 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T14:46:45.160 INFO:teuthology.orchestra.run.smithi152.stdout:generic/665 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T14:46:45.182 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/665 2024-04-17T14:46:45.182 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/665 2024-04-17T14:46:45.184 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T14:46:45.202 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T14:46:45.241 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T14:46:45.241 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/666) 2024-04-17T14:46:46.325 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T14:46:46.341 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T14:46:46.341 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T14:46:47.168 INFO:teuthology.orchestra.run.smithi152.stdout:generic/666 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T14:46:47.194 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/666 2024-04-17T14:46:47.194 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/666 2024-04-17T14:46:47.194 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T14:46:47.228 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T14:46:47.309 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T14:46:47.310 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/667) 2024-04-17T14:46:48.273 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T14:46:48.295 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T14:46:48.295 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T14:46:49.330 INFO:teuthology.orchestra.run.smithi152.stdout:generic/667 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T14:46:49.371 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/667 2024-04-17T14:46:49.371 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/667 2024-04-17T14:46:49.372 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T14:46:49.401 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T14:46:49.484 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T14:46:49.484 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/668) 2024-04-17T14:46:50.482 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T14:46:50.532 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T14:46:50.532 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T14:46:51.547 INFO:teuthology.orchestra.run.smithi152.stdout:generic/668 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T14:46:51.586 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/668 2024-04-17T14:46:51.589 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/668 2024-04-17T14:46:51.589 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T14:46:51.624 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T14:46:51.710 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T14:46:51.710 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/669) 2024-04-17T14:46:52.606 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T14:46:52.645 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T14:46:52.645 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T14:46:53.880 INFO:teuthology.orchestra.run.smithi152.stdout:generic/669 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T14:46:53.891 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/669 2024-04-17T14:46:53.892 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/669 2024-04-17T14:46:53.892 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T14:46:53.902 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T14:46:53.969 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T14:46:53.969 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/670) 2024-04-17T14:46:55.225 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T14:46:55.266 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T14:46:55.266 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T14:46:56.020 INFO:teuthology.orchestra.run.smithi152.stdout:generic/670 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T14:46:56.037 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/670 2024-04-17T14:46:56.037 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/670 2024-04-17T14:46:56.037 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T14:46:56.058 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T14:46:56.161 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T14:46:56.161 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/671) 2024-04-17T14:46:57.373 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T14:46:57.388 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T14:46:57.388 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T14:46:58.246 INFO:teuthology.orchestra.run.smithi152.stdout:generic/671 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T14:46:58.269 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/671 2024-04-17T14:46:58.269 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/671 2024-04-17T14:46:58.270 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T14:46:58.288 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T14:46:58.335 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T14:46:58.335 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/672) 2024-04-17T14:46:59.682 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T14:46:59.729 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T14:46:59.730 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T14:47:00.546 INFO:teuthology.orchestra.run.smithi152.stdout:generic/672 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T14:47:00.578 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/672 2024-04-17T14:47:00.578 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/672 2024-04-17T14:47:00.579 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T14:47:00.611 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T14:47:00.672 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T14:47:00.672 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/673) 2024-04-17T14:47:01.792 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T14:47:01.811 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T14:47:01.812 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T14:47:03.651 INFO:teuthology.orchestra.run.smithi152.stdout:generic/673 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T14:47:03.677 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/673 2024-04-17T14:47:03.677 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/673 2024-04-17T14:47:03.677 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T14:47:03.685 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T14:47:03.746 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T14:47:03.747 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/674) 2024-04-17T14:47:05.073 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T14:47:05.114 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T14:47:05.115 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T14:47:06.147 INFO:teuthology.orchestra.run.smithi152.stdout:generic/674 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T14:47:06.173 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/674 2024-04-17T14:47:06.174 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/674 2024-04-17T14:47:06.174 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T14:47:06.197 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T14:47:06.250 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T14:47:06.250 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/675) 2024-04-17T14:47:07.488 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T14:47:07.523 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T14:47:07.523 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T14:47:08.579 INFO:teuthology.orchestra.run.smithi152.stdout:generic/675 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T14:47:08.625 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/675 2024-04-17T14:47:08.625 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/675 2024-04-17T14:47:08.625 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T14:47:08.631 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T14:47:08.707 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T14:47:08.707 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/676) 2024-04-17T14:47:09.733 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T14:47:09.775 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T14:47:09.776 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T14:51:08.689 INFO:tasks.ceph.osd.2.smithi152.stderr:2024-04-17T14:51:08.685+0000 7f9821400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 482628) UID: 0 2024-04-17T14:51:08.690 INFO:tasks.ceph.osd.3.smithi152.stderr:2024-04-17T14:51:08.685+0000 7f2cca800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 482628) UID: 0 2024-04-17T14:51:08.690 INFO:tasks.ceph.osd.0.smithi152.stderr:2024-04-17T14:51:08.685+0000 7f2076000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 482628) UID: 0 2024-04-17T14:51:08.696 INFO:tasks.ceph.osd.1.smithi152.stderr:2024-04-17T14:51:08.685+0000 7fb553c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 482628) UID: 0 2024-04-17T15:01:46.193 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:01:46.207 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:01:46.346 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-04-17T15:01:46.344+0000 7fc7d2600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 35881) UID: 0 2024-04-17T15:01:46.346 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-04-17T15:01:46.344+0000 7f2b4a200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 35881) UID: 0 2024-04-17T15:01:46.347 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-04-17T15:01:46.344+0000 7f5475c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 35881) UID: 0 2024-04-17T15:01:46.347 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-04-17T15:01:46.344+0000 7fc89d000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 35881) UID: 0 2024-04-17T15:01:46.498 INFO:tasks.ceph.mds.c.smithi152.stderr:2024-04-17T15:01:46.494+0000 7f1eb3200640 -1 Fail to open '/proc/482654/cmdline' error = (2) No such file or directory 2024-04-17T15:01:46.498 INFO:tasks.ceph.mds.c.smithi152.stderr:2024-04-17T15:01:46.494+0000 7f1eb3200640 -1 received signal: Hangup from (PID: 482654) UID: 0 2024-04-17T15:01:46.499 INFO:tasks.ceph.mds.a.smithi152.stderr:2024-04-17T15:01:46.494+0000 7f65f1400640 -1 Fail to open '/proc/482654/cmdline' error = (2) No such file or directory 2024-04-17T15:01:46.499 INFO:tasks.ceph.mds.a.smithi152.stderr:2024-04-17T15:01:46.494+0000 7f65f1400640 -1 received signal: Hangup from (PID: 482654) UID: 0 2024-04-17T15:09:35.976 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:09:35.982 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:09:36.011 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-04-17T15:09:36.010+0000 7fc89d000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 35904) UID: 0 2024-04-17T15:09:36.012 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-04-17T15:09:36.010+0000 7fc7d2600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 35904) UID: 0 2024-04-17T15:09:36.012 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-04-17T15:09:36.010+0000 7f2b4a200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 35904) UID: 0 2024-04-17T15:09:36.012 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-04-17T15:09:36.010+0000 7f5475c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 35904) UID: 0 2024-04-17T15:15:53.759 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:15:53.764 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:16:23.891 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:16:23.898 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:16:54.000 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:16:54.015 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:17:24.137 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:17:24.147 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:17:24.291 INFO:tasks.ceph.mds.c.smithi152.stderr:2024-04-17T15:17:24.288+0000 7f1eb3200640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 482702) UID: 0 2024-04-17T15:17:24.292 INFO:tasks.ceph.mds.a.smithi152.stderr:2024-04-17T15:17:24.288+0000 7f65f1400640 -1 Fail to open '/proc/482702/cmdline' error = (2) No such file or directory 2024-04-17T15:17:24.292 INFO:tasks.ceph.mds.a.smithi152.stderr:2024-04-17T15:17:24.288+0000 7f65f1400640 -1 received signal: Hangup from (PID: 482702) UID: 0 2024-04-17T15:23:39.124 INFO:tasks.ceph.osd.0.smithi152.stderr:2024-04-17T15:23:39.120+0000 7f2076000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 482724) UID: 0 2024-04-17T15:23:39.125 INFO:tasks.ceph.osd.1.smithi152.stderr:2024-04-17T15:23:39.120+0000 7fb553c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 482724) UID: 0 2024-04-17T15:23:39.125 INFO:tasks.ceph.osd.2.smithi152.stderr:2024-04-17T15:23:39.120+0000 7f9821400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 482724) UID: 0 2024-04-17T15:23:39.125 INFO:tasks.ceph.osd.3.smithi152.stderr:2024-04-17T15:23:39.120+0000 7f2cca800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 482724) UID: 0 2024-04-17T15:39:20.348 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:39:20.357 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:39:21.101 INFO:tasks.ceph.mds.a.smithi152.stderr:2024-04-17T15:39:21.097+0000 7f65f1400640 -1 Fail to open '/proc/482759/cmdline' error = (2) No such file or directory 2024-04-17T15:39:21.101 INFO:tasks.ceph.mds.a.smithi152.stderr:2024-04-17T15:39:21.097+0000 7f65f1400640 -1 received signal: Hangup from (PID: 482759) UID: 0 2024-04-17T15:39:21.101 INFO:tasks.ceph.mds.c.smithi152.stderr:2024-04-17T15:39:21.097+0000 7f1eb3200640 -1 Fail to open '/proc/482759/cmdline' error = (2) No such file or directory 2024-04-17T15:39:21.101 INFO:tasks.ceph.mds.c.smithi152.stderr:2024-04-17T15:39:21.097+0000 7f1eb3200640 -1 received signal: Hangup from (PID: 482759) UID: 0 2024-04-17T15:47:42.468 INFO:teuthology.orchestra.run.smithi152.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-mds.c.log.1: 2024-04-17T15:47:42.469 INFO:teuthology.orchestra.run.smithi152.stderr:gzip: stdin: file size changed while zipping 2024-04-17T15:47:48.299 INFO:tasks.ceph.osd.1.smithi152.stderr:2024-04-17T15:47:48.296+0000 7fb553c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 482785) UID: 0 2024-04-17T15:47:48.300 INFO:tasks.ceph.osd.2.smithi152.stderr:2024-04-17T15:47:48.296+0000 7f9821400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 482785) UID: 0 2024-04-17T15:47:48.300 INFO:tasks.ceph.osd.0.smithi152.stderr:2024-04-17T15:47:48.300+0000 7f2076000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 482785) UID: 0 2024-04-17T15:47:48.300 INFO:tasks.ceph.osd.3.smithi152.stderr:2024-04-17T15:47:48.300+0000 7f2cca800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 482785) UID: 0 2024-04-17T15:56:27.915 INFO:teuthology.orchestra.run.smithi152.stdout:generic/676 4158s 2024-04-17T15:56:28.129 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/676 2024-04-17T15:56:28.129 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:56:28.140 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:56:28.301 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:56:28.302 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/677) 2024-04-17T15:56:31.081 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:56:31.131 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:56:31.131 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:56:32.391 INFO:teuthology.orchestra.run.smithi152.stdout:generic/677 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T15:56:32.405 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/677 2024-04-17T15:56:32.406 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/677 2024-04-17T15:56:32.406 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:56:32.417 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:56:32.487 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:56:32.487 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/678) 2024-04-17T15:56:33.688 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:56:33.727 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:56:33.727 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:56:35.007 INFO:teuthology.orchestra.run.smithi152.stdout:generic/678 1s 2024-04-17T15:56:35.051 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/678 2024-04-17T15:56:35.053 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:56:35.071 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:56:35.275 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:56:35.275 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/679) 2024-04-17T15:56:36.881 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:56:36.914 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:56:36.914 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:56:37.945 INFO:teuthology.orchestra.run.smithi152.stdout:generic/679 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T15:56:37.967 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/679 2024-04-17T15:56:37.968 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/679 2024-04-17T15:56:37.968 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:56:37.976 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:56:38.018 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:56:38.018 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/680) 2024-04-17T15:56:39.474 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:56:39.514 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:56:39.515 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:56:42.108 INFO:teuthology.orchestra.run.smithi152.stdout:generic/680 3s 2024-04-17T15:56:42.145 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/680 2024-04-17T15:56:42.146 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:56:42.166 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:56:42.342 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:56:42.342 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/681) 2024-04-17T15:56:43.906 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:56:43.920 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:56:43.920 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:56:45.305 INFO:teuthology.orchestra.run.smithi152.stdout:generic/681 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-04-17T15:56:45.318 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/681 2024-04-17T15:56:45.319 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/681 2024-04-17T15:56:45.319 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:56:45.329 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:56:45.412 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:56:45.412 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/682) 2024-04-17T15:56:46.600 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:56:46.627 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:56:46.628 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:56:47.515 INFO:teuthology.orchestra.run.smithi152.stdout:generic/682 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-04-17T15:56:47.537 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/682 2024-04-17T15:56:47.538 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/682 2024-04-17T15:56:47.538 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:56:47.548 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:56:47.629 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:56:47.629 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/683) 2024-04-17T15:56:48.714 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:56:48.749 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:56:48.749 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:56:49.979 INFO:teuthology.orchestra.run.smithi152.stdout:generic/683 [not run] /tmp/tmp.N9QxrNRIp4test: file alloc unit 4194304 larger than op length 65536 2024-04-17T15:56:50.017 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/683 2024-04-17T15:56:50.018 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/683 2024-04-17T15:56:50.018 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:56:50.037 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:56:50.106 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:56:50.106 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/684) 2024-04-17T15:56:51.322 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:56:51.357 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:56:51.358 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:56:56.873 INFO:teuthology.orchestra.run.smithi152.stdout:generic/684 [not run] /tmp/tmp.N9QxrNRIp4test: file alloc unit 4194304 larger than op length 65536 2024-04-17T15:56:56.909 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/684 2024-04-17T15:56:56.910 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/684 2024-04-17T15:56:56.910 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:56:56.942 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:56:56.997 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:56:56.997 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/685) 2024-04-17T15:56:58.232 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:56:58.279 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:56:58.279 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:57:02.844 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:57:02.849 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T15:57:03.025 INFO:tasks.ceph.mds.c.smithi152.stderr:2024-04-17T15:57:03.030+0000 7f1eb3200640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 486731) UID: 0 2024-04-17T15:57:03.026 INFO:tasks.ceph.mds.a.smithi152.stderr:2024-04-17T15:57:03.030+0000 7f65f1400640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 486731) UID: 0 2024-04-17T15:57:04.005 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-04-17T15:57:04.014+0000 7fc7d2600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 36017) UID: 0 2024-04-17T15:57:04.006 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-04-17T15:57:04.014+0000 7fc89d000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 36017) UID: 0 2024-04-17T15:57:04.006 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-04-17T15:57:04.014+0000 7f2b4a200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 36017) UID: 0 2024-04-17T15:57:04.006 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-04-17T15:57:04.014+0000 7f5475c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 36017) UID: 0 2024-04-17T15:57:04.296 INFO:teuthology.orchestra.run.smithi152.stdout:generic/685 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-04-17T15:57:04.310 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/685 2024-04-17T15:57:04.310 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/685 2024-04-17T15:57:04.310 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:57:04.331 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:57:04.456 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:57:04.457 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/686) 2024-04-17T15:57:05.799 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:57:05.839 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:57:05.839 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:57:11.537 INFO:teuthology.orchestra.run.smithi152.stdout:generic/686 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2024-04-17T15:57:11.571 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/686 2024-04-17T15:57:11.571 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/686 2024-04-17T15:57:11.571 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:57:11.590 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:57:11.666 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:57:11.667 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/687) 2024-04-17T15:57:12.986 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:57:13.028 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:57:13.028 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:57:18.487 INFO:teuthology.orchestra.run.smithi152.stdout:generic/687 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2024-04-17T15:57:18.519 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/687 2024-04-17T15:57:18.519 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/687 2024-04-17T15:57:18.519 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:57:18.633 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:57:18.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:57:18.726 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/688) 2024-04-17T15:57:20.058 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:57:20.087 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:57:20.087 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:57:21.568 INFO:teuthology.orchestra.run.smithi152.stdout:generic/688 [not run] /tmp/tmp.N9QxrNRIp4test: file alloc unit 4194304 larger than op length 65536 2024-04-17T15:57:21.603 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/688 2024-04-17T15:57:21.603 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/688 2024-04-17T15:57:21.603 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:57:21.625 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:57:21.715 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:57:21.715 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/689) 2024-04-17T15:57:23.009 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:57:23.059 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:57:23.059 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:57:24.239 INFO:teuthology.orchestra.run.smithi152.stdout:generic/689 [not run] vfstest not support by ceph-fuse 2024-04-17T15:57:24.277 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/689 2024-04-17T15:57:24.277 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/689 2024-04-17T15:57:24.280 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:57:24.298 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:57:24.335 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:57:24.335 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/690) 2024-04-17T15:57:25.460 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:57:25.500 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:57:25.501 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:57:26.444 INFO:teuthology.orchestra.run.smithi152.stdout:generic/690 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T15:57:26.473 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/690 2024-04-17T15:57:26.473 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/690 2024-04-17T15:57:26.474 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:57:26.498 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:57:26.581 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:57:26.581 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/691) 2024-04-17T15:57:27.803 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:57:27.848 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:57:27.849 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:57:28.889 INFO:teuthology.orchestra.run.smithi152.stdout:generic/691 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T15:57:28.916 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/691 2024-04-17T15:57:28.916 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/691 2024-04-17T15:57:28.916 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:57:28.927 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:57:29.017 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:57:29.017 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/692) 2024-04-17T15:57:30.239 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:57:30.286 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:57:30.286 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:57:31.238 INFO:teuthology.orchestra.run.smithi152.stdout:generic/692 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T15:57:31.254 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/692 2024-04-17T15:57:31.254 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/692 2024-04-17T15:57:31.254 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:57:31.267 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:57:31.398 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:57:31.399 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/693) 2024-04-17T15:57:32.642 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:57:32.673 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:57:32.673 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:57:33.830 INFO:teuthology.orchestra.run.smithi152.stdout:generic/693 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T15:57:33.848 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/693 2024-04-17T15:57:33.848 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/693 2024-04-17T15:57:33.848 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:57:33.869 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:57:33.939 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:57:33.939 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/694) 2024-04-17T15:57:35.048 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:57:35.099 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:57:35.100 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:57:37.243 INFO:teuthology.orchestra.run.smithi152.stdout:generic/694 2s 2024-04-17T15:57:37.285 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/694 2024-04-17T15:57:37.285 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:57:37.306 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:57:37.397 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:57:37.397 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/695) 2024-04-17T15:57:38.786 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:57:38.823 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:57:38.823 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:57:39.676 INFO:teuthology.orchestra.run.smithi152.stdout:generic/695 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T15:57:39.687 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/695 2024-04-17T15:57:39.687 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/695 2024-04-17T15:57:39.688 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:57:39.705 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:57:39.760 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:57:39.760 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/696) 2024-04-17T15:57:41.061 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:57:41.111 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:57:41.111 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:57:42.147 INFO:teuthology.orchestra.run.smithi152.stdout:generic/696 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T15:57:42.164 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/696 2024-04-17T15:57:42.164 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/696 2024-04-17T15:57:42.164 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:57:42.171 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:57:42.240 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:57:42.240 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/697) 2024-04-17T15:57:43.790 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:57:43.838 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:57:43.838 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:57:44.955 INFO:teuthology.orchestra.run.smithi152.stdout:generic/697 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-04-17T15:57:44.981 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/697 2024-04-17T15:57:44.982 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/697 2024-04-17T15:57:44.982 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:57:45.015 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:57:45.109 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:57:45.109 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/698) 2024-04-17T15:57:46.386 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:57:46.432 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:57:46.432 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:57:47.681 INFO:teuthology.orchestra.run.smithi152.stdout:generic/698 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T15:57:47.695 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/698 2024-04-17T15:57:47.695 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/698 2024-04-17T15:57:47.695 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:57:47.702 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:57:47.809 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:57:47.809 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/699) 2024-04-17T15:57:49.068 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:57:49.120 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:57:49.120 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:57:50.295 INFO:teuthology.orchestra.run.smithi152.stdout:generic/699 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T15:57:50.332 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/699 2024-04-17T15:57:50.332 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/699 2024-04-17T15:57:50.332 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:57:50.366 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:57:50.449 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:57:50.450 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/700) 2024-04-17T15:57:51.716 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:57:51.766 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:57:51.767 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:57:52.960 INFO:teuthology.orchestra.run.smithi152.stdout:generic/700 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T15:57:52.982 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/700 2024-04-17T15:57:52.983 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/700 2024-04-17T15:57:52.983 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:57:53.011 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:57:53.080 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:57:53.136 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/701) 2024-04-17T15:57:54.373 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:57:54.421 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:57:54.421 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:57:56.275 INFO:teuthology.orchestra.run.smithi152.stdout:generic/701 2s 2024-04-17T15:57:56.347 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/701 2024-04-17T15:57:56.347 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:57:56.379 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:57:56.578 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:57:56.578 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/702) 2024-04-17T15:57:58.464 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:57:58.513 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:57:58.513 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:57:59.413 INFO:teuthology.orchestra.run.smithi152.stdout:generic/702 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T15:57:59.432 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/702 2024-04-17T15:57:59.432 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/702 2024-04-17T15:57:59.439 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:57:59.462 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:57:59.535 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:57:59.535 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/703) 2024-04-17T15:58:00.828 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:58:00.863 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:58:00.863 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:58:01.890 INFO:teuthology.orchestra.run.smithi152.stdout:generic/703 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T15:58:01.935 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/703 2024-04-17T15:58:01.937 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/703 2024-04-17T15:58:01.938 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:58:01.962 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:58:02.017 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:58:02.017 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/704) 2024-04-17T15:58:03.280 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:58:03.315 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:58:03.315 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:58:04.592 INFO:teuthology.orchestra.run.smithi152.stdout:generic/704 [not run] require ceph-fuse to be valid block disk 2024-04-17T15:58:04.602 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/704 2024-04-17T15:58:04.603 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/704 2024-04-17T15:58:04.603 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:58:04.614 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:58:04.705 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:58:04.706 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/705) 2024-04-17T15:58:05.899 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:58:05.942 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:58:05.944 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:58:06.835 INFO:teuthology.orchestra.run.smithi152.stdout:generic/705 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T15:58:06.848 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/705 2024-04-17T15:58:06.848 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/705 2024-04-17T15:58:06.848 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:58:06.866 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:58:06.985 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:58:06.985 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/706) 2024-04-17T15:58:08.150 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:58:08.203 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:58:08.203 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:58:12.962 INFO:teuthology.orchestra.run.smithi152.stdout:generic/706 4s 2024-04-17T15:58:13.013 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/706 2024-04-17T15:58:13.013 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:58:13.023 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:58:13.102 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:58:13.102 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/707) 2024-04-17T15:58:14.884 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:58:14.899 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:58:14.899 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:58:15.692 INFO:teuthology.orchestra.run.smithi152.stdout:generic/707 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T15:58:15.723 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/707 2024-04-17T15:58:15.725 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/707 2024-04-17T15:58:15.725 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:58:15.754 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:58:15.846 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:58:15.847 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/708) 2024-04-17T15:58:17.366 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:58:17.409 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:58:17.409 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:58:19.549 INFO:teuthology.orchestra.run.smithi152.stdout:generic/708 2s 2024-04-17T15:58:19.596 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/708 2024-04-17T15:58:19.596 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:58:19.612 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:58:19.702 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:58:19.702 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/709) 2024-04-17T15:58:21.477 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:58:21.527 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:58:21.527 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:58:22.851 INFO:teuthology.orchestra.run.smithi152.stdout:generic/709 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-04-17T15:58:22.890 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/709 2024-04-17T15:58:22.891 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/709 2024-04-17T15:58:22.891 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:58:22.901 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:58:22.973 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:58:22.973 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/710) 2024-04-17T15:58:24.673 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:58:24.702 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:58:24.702 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:58:25.820 INFO:teuthology.orchestra.run.smithi152.stdout:generic/710 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-04-17T15:58:25.865 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/710 2024-04-17T15:58:25.865 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/710 2024-04-17T15:58:25.865 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:58:25.883 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:58:26.013 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:58:26.013 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/711) 2024-04-17T15:58:27.863 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:58:27.910 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:58:27.910 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:58:29.019 INFO:teuthology.orchestra.run.smithi152.stdout:generic/711 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-04-17T15:58:29.060 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/711 2024-04-17T15:58:29.061 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/711 2024-04-17T15:58:29.061 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:58:29.087 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:58:29.234 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:58:29.235 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/712) 2024-04-17T15:58:31.266 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:58:31.309 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:58:31.309 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:58:32.464 INFO:teuthology.orchestra.run.smithi152.stdout:generic/712 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-04-17T15:58:32.494 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/712 2024-04-17T15:58:32.497 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/712 2024-04-17T15:58:32.497 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:58:32.525 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:58:32.593 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:58:32.594 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/713) 2024-04-17T15:58:34.552 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:58:34.593 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:58:34.594 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:58:35.646 INFO:teuthology.orchestra.run.smithi152.stdout:generic/713 [not run] xfs_io swapext -v exchrange -s 64k -l 64k not supported on ceph-fuse 2024-04-17T15:58:35.675 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/713 2024-04-17T15:58:35.675 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/713 2024-04-17T15:58:35.675 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:58:35.686 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:58:35.721 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:58:35.722 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/714) 2024-04-17T15:58:37.566 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:58:37.608 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:58:37.608 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:58:38.734 INFO:teuthology.orchestra.run.smithi152.stdout:generic/714 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-04-17T15:58:38.777 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/714 2024-04-17T15:58:38.779 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/714 2024-04-17T15:58:38.780 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:58:38.810 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:58:38.866 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:58:38.866 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/715) 2024-04-17T15:58:40.952 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:58:40.989 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:58:40.990 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:58:42.248 INFO:teuthology.orchestra.run.smithi152.stdout:generic/715 [not run] xfs_io swapext -v exchrange -s 64k -l 64k not supported on ceph-fuse 2024-04-17T15:58:42.261 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/715 2024-04-17T15:58:42.261 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/715 2024-04-17T15:58:42.261 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:58:42.269 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:58:42.323 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:58:42.323 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/716) 2024-04-17T15:58:44.155 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:58:44.175 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:58:44.176 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:58:45.325 INFO:teuthology.orchestra.run.smithi152.stdout:generic/716 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-04-17T15:58:45.376 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/716 2024-04-17T15:58:45.376 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/716 2024-04-17T15:58:45.376 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:58:45.408 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:58:45.445 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:58:45.446 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/717) 2024-04-17T15:58:46.983 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:58:47.022 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:58:47.022 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:58:48.352 INFO:teuthology.orchestra.run.smithi152.stdout:generic/717 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-04-17T15:58:48.380 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/717 2024-04-17T15:58:48.380 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/717 2024-04-17T15:58:48.381 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:58:48.404 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:58:48.504 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:58:48.504 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/718) 2024-04-17T15:58:50.291 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:58:50.317 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:58:50.317 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:58:51.462 INFO:teuthology.orchestra.run.smithi152.stdout:generic/718 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-04-17T15:58:51.476 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/718 2024-04-17T15:58:51.477 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/718 2024-04-17T15:58:51.477 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:58:51.506 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:58:51.609 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:58:51.609 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/719) 2024-04-17T15:58:53.528 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:58:53.558 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:58:53.558 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:58:54.783 INFO:teuthology.orchestra.run.smithi152.stdout:generic/719 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-04-17T15:58:54.814 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/719 2024-04-17T15:58:54.817 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/719 2024-04-17T15:58:54.817 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:58:54.835 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:58:54.891 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:58:54.891 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/720) 2024-04-17T15:58:56.673 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:58:56.720 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:58:56.721 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:58:58.030 INFO:teuthology.orchestra.run.smithi152.stdout:generic/720 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-04-17T15:58:58.057 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/720 2024-04-17T15:58:58.057 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/720 2024-04-17T15:58:58.057 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:58:58.082 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:58:58.184 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:58:58.184 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/721) 2024-04-17T15:59:00.108 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:59:00.156 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:59:00.156 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:59:01.506 INFO:teuthology.orchestra.run.smithi152.stdout:generic/721 [not run] xfs_io startupdate support is missing 2024-04-17T15:59:01.547 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/721 2024-04-17T15:59:01.548 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/721 2024-04-17T15:59:01.548 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:59:01.575 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:59:01.648 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:59:01.649 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/722) 2024-04-17T15:59:03.039 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:59:03.079 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:59:03.079 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:59:04.225 INFO:teuthology.orchestra.run.smithi152.stdout:generic/722 [not run] xfs_io swapext -v exchrange -a not supported on ceph-fuse 2024-04-17T15:59:04.255 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/722 2024-04-17T15:59:04.255 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/722 2024-04-17T15:59:04.255 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:59:04.266 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:59:04.425 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:59:04.426 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/723) 2024-04-17T15:59:06.188 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:59:06.244 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:59:06.245 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:59:07.498 INFO:teuthology.orchestra.run.smithi152.stdout:generic/723 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-04-17T15:59:07.542 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/723 2024-04-17T15:59:07.542 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/723 2024-04-17T15:59:07.542 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:59:07.565 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:59:07.612 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:59:07.612 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/724) 2024-04-17T15:59:09.506 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:59:09.539 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:59:09.539 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:59:10.951 INFO:teuthology.orchestra.run.smithi152.stdout:generic/724 [not run] xfs_io swapext -v exchrange -a not supported on ceph-fuse 2024-04-17T15:59:10.978 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/724 2024-04-17T15:59:10.978 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/724 2024-04-17T15:59:10.980 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:59:11.013 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:59:11.152 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:59:11.152 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/725) 2024-04-17T15:59:13.096 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:59:13.130 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:59:13.130 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:59:14.331 INFO:teuthology.orchestra.run.smithi152.stdout:generic/725 [not run] xfs_io swapext -v exchrange -a not supported on ceph-fuse 2024-04-17T15:59:14.352 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/725 2024-04-17T15:59:14.352 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/725 2024-04-17T15:59:14.352 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:59:14.378 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:59:14.455 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:59:14.455 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/726) 2024-04-17T15:59:16.115 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:59:16.167 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:59:16.167 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:59:17.796 INFO:teuthology.orchestra.run.smithi152.stdout:generic/726 [not run] xfs_io swapext -v exchrange -a not supported on ceph-fuse 2024-04-17T15:59:17.821 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/726 2024-04-17T15:59:17.822 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/726 2024-04-17T15:59:17.822 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:59:17.854 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:59:17.963 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:59:17.964 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/727) 2024-04-17T15:59:19.667 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:59:19.704 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:59:19.704 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:59:21.193 INFO:teuthology.orchestra.run.smithi152.stdout:generic/727 [not run] xfs_io swapext -v exchrange -a not supported on ceph-fuse 2024-04-17T15:59:21.211 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/727 2024-04-17T15:59:21.211 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/727 2024-04-17T15:59:21.212 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:59:21.236 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:59:21.340 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:59:21.340 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/728) 2024-04-17T15:59:23.145 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:59:23.180 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:59:23.180 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:59:28.455 INFO:teuthology.orchestra.run.smithi152.stdout:generic/728 5s 2024-04-17T15:59:28.522 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/728 2024-04-17T15:59:28.522 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:59:28.534 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:59:28.601 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:59:28.602 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/729) 2024-04-17T15:59:29.859 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:59:29.915 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:59:29.915 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:59:32.310 INFO:teuthology.orchestra.run.smithi152.stdout:generic/729 1s 2024-04-17T15:59:32.356 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/729 2024-04-17T15:59:32.356 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:59:32.382 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:59:32.579 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:59:32.579 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/730) 2024-04-17T15:59:34.525 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:59:34.550 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:59:34.550 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:59:35.730 INFO:teuthology.orchestra.run.smithi152.stdout:generic/730 [not run] require ceph-fuse to be valid block disk 2024-04-17T15:59:35.760 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/730 2024-04-17T15:59:35.760 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/730 2024-04-17T15:59:35.760 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:59:35.789 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:59:35.842 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:59:35.842 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/731) 2024-04-17T15:59:36.944 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:59:36.983 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:59:36.983 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:59:37.929 INFO:teuthology.orchestra.run.smithi152.stdout:generic/731 [not run] require ceph-fuse to be valid block disk 2024-04-17T15:59:37.959 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/731 2024-04-17T15:59:37.960 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/731 2024-04-17T15:59:37.960 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:59:37.968 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:59:38.002 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:59:38.003 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/732) 2024-04-17T15:59:39.478 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:59:39.505 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:59:39.506 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:59:40.373 INFO:teuthology.orchestra.run.smithi152.stdout:generic/732 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T15:59:40.406 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/732 2024-04-17T15:59:40.407 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/732 2024-04-17T15:59:40.407 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:59:40.445 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:59:40.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:59:40.540 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/733) 2024-04-17T15:59:41.761 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:59:41.776 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:59:41.776 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:59:42.552 INFO:teuthology.orchestra.run.smithi152.stdout:generic/733 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T15:59:42.576 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/733 2024-04-17T15:59:42.576 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/733 2024-04-17T15:59:42.576 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:59:42.604 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:59:42.687 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:59:42.688 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/734) 2024-04-17T15:59:43.978 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:59:44.014 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:59:44.014 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:59:45.338 INFO:teuthology.orchestra.run.smithi152.stdout:generic/734 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-04-17T15:59:45.363 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/734 2024-04-17T15:59:45.363 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/734 2024-04-17T15:59:45.363 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:59:45.373 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:59:45.518 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:59:45.518 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/735) 2024-04-17T15:59:47.163 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:59:47.180 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:59:47.181 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:59:52.842 INFO:teuthology.orchestra.run.smithi152.stdout:generic/735 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2024-04-17T15:59:52.878 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/735 2024-04-17T15:59:52.878 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/735 2024-04-17T15:59:52.878 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T15:59:52.889 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T15:59:53.020 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T15:59:53.020 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/736) 2024-04-17T15:59:54.876 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T15:59:54.919 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T15:59:54.921 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T16:03:09.439 INFO:tasks.ceph.osd.1.smithi152.stderr:2024-04-17T16:03:09.450+0000 7fb553c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 508577) UID: 0 2024-04-17T16:03:09.440 INFO:tasks.ceph.osd.2.smithi152.stderr:2024-04-17T16:03:09.450+0000 7f9821400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 508577) UID: 0 2024-04-17T16:03:09.440 INFO:tasks.ceph.osd.3.smithi152.stderr:2024-04-17T16:03:09.450+0000 7f2cca800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 508577) UID: 0 2024-04-17T16:03:09.440 INFO:tasks.ceph.osd.0.smithi152.stderr:2024-04-17T16:03:09.450+0000 7f2076000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 508577) UID: 0 2024-04-17T16:06:39.746 INFO:teuthology.orchestra.run.smithi152.stdout:generic/736 405s 2024-04-17T16:06:39.780 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/736 2024-04-17T16:06:39.780 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T16:06:39.818 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T16:06:39.923 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T16:06:39.923 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/737) 2024-04-17T16:06:41.627 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T16:06:41.683 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T16:06:41.684 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T16:06:42.984 INFO:teuthology.orchestra.run.smithi152.stdout:generic/737 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T16:06:43.022 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/737 2024-04-17T16:06:43.024 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/737 2024-04-17T16:06:43.024 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T16:06:43.051 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T16:06:43.142 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T16:06:43.142 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/738) 2024-04-17T16:06:44.476 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T16:06:44.490 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T16:06:44.490 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T16:06:45.291 INFO:teuthology.orchestra.run.smithi152.stdout:generic/738 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T16:06:45.329 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/738 2024-04-17T16:06:45.329 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/738 2024-04-17T16:06:45.329 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T16:06:45.339 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T16:06:45.375 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T16:06:45.376 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/739) 2024-04-17T16:06:46.519 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T16:06:46.568 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T16:06:46.568 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T16:06:47.835 INFO:teuthology.orchestra.run.smithi152.stdout:generic/739 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T16:06:47.846 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/739 2024-04-17T16:06:47.847 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/739 2024-04-17T16:06:47.847 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T16:06:47.860 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T16:06:47.966 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T16:06:47.966 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/741) 2024-04-17T16:06:49.506 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T16:06:49.526 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T16:06:49.526 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T16:06:50.688 INFO:teuthology.orchestra.run.smithi152.stdout:generic/741 [not run] this test requires a valid $SCRATCH_DEV 2024-04-17T16:06:50.728 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/741 2024-04-17T16:06:50.728 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/741 2024-04-17T16:06:50.728 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T16:06:50.765 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T16:06:50.853 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T16:06:50.853 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/742) 2024-04-17T16:06:52.309 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T16:06:52.349 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T16:06:52.349 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T16:10:05.905 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:10:05.910 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:10:05.947 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-04-17T16:10:05.962+0000 7fc7d2600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 36122) UID: 0 2024-04-17T16:10:05.947 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-04-17T16:10:05.962+0000 7f2b4a200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 36122) UID: 0 2024-04-17T16:10:05.947 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-04-17T16:10:05.962+0000 7f5475c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 36122) UID: 0 2024-04-17T16:10:05.947 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-04-17T16:10:05.962+0000 7fc89d000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 36122) UID: 0 2024-04-17T16:13:30.895 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:13:30.907 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:14:00.982 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:14:00.988 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:14:31.069 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:14:31.080 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:15:01.525 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:15:01.535 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:15:32.145 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:15:32.149 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:16:02.265 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:16:02.271 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:16:32.404 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:16:32.410 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:17:02.592 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:17:02.604 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:17:32.774 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:17:32.784 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:18:02.894 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:18:02.899 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:18:33.048 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:18:33.057 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:18:33.149 INFO:tasks.ceph.osd.3.smithi152.stderr:2024-04-17T16:18:33.168+0000 7f2cca800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 511031) UID: 0 2024-04-17T16:18:33.150 INFO:tasks.ceph.osd.0.smithi152.stderr:2024-04-17T16:18:33.168+0000 7f2076000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 511031) UID: 0 2024-04-17T16:18:33.151 INFO:tasks.ceph.osd.1.smithi152.stderr:2024-04-17T16:18:33.172+0000 7fb553c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 511031) UID: 0 2024-04-17T16:18:33.152 INFO:tasks.ceph.osd.2.smithi152.stderr:2024-04-17T16:18:33.172+0000 7f9821400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 511031) UID: 0 2024-04-17T16:24:59.116 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:24:59.121 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:24:59.155 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-04-17T16:24:59.171+0000 7fc89d000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 36378) UID: 0 2024-04-17T16:24:59.155 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-04-17T16:24:59.171+0000 7f2b4a200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 36378) UID: 0 2024-04-17T16:24:59.155 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-04-17T16:24:59.171+0000 7fc7d2600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 36378) UID: 0 2024-04-17T16:24:59.159 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-04-17T16:24:59.171+0000 7f5475c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 36378) UID: 0 2024-04-17T16:28:27.509 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:28:27.523 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:28:57.669 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:28:57.681 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:29:27.800 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:29:27.805 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:29:57.898 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:29:57.904 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:30:29.640 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:30:29.646 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:30:59.958 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:30:59.970 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:31:30.072 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:31:30.077 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:32:00.227 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:32:00.237 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:32:30.557 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:32:30.572 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:33:00.679 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:33:00.691 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:33:30.798 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:33:30.809 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:34:01.877 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:34:01.887 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:34:32.006 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:34:32.015 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:35:03.251 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:35:03.261 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:35:33.495 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:35:33.504 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:36:03.640 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:36:03.651 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:36:33.799 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:36:33.809 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:37:03.940 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:37:03.953 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:37:34.077 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:37:34.087 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:38:04.346 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:38:04.359 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:38:34.494 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:38:34.511 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:39:05.985 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:39:05.993 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:39:36.078 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:39:36.084 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:40:06.166 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:40:06.173 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:40:36.322 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:40:36.329 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:41:06.444 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:41:06.448 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:41:36.687 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:41:36.691 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:42:06.815 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:42:06.820 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:42:37.030 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:42:37.039 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:43:07.163 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:43:07.169 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:43:37.276 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:43:37.284 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:44:07.397 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:44:07.401 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:44:37.511 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:44:37.515 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:45:08.455 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:45:08.459 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:45:38.598 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:45:38.602 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:46:08.701 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:46:08.705 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:46:38.822 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:46:38.826 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:47:08.931 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:47:08.938 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:47:39.092 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:47:39.098 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:48:09.237 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:48:09.245 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:48:39.348 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:48:39.351 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:49:09.502 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:49:09.509 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:49:39.602 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:49:39.605 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:50:09.731 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:50:09.738 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:50:39.849 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:50:39.855 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:51:09.953 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:51:09.960 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:51:40.041 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:51:40.048 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:52:10.166 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:52:10.174 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:52:40.235 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:52:40.241 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:53:10.360 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:53:10.363 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:53:40.457 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:53:40.461 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:54:10.612 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:54:10.620 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:54:40.726 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:54:40.730 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:55:10.869 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:55:10.873 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:55:40.988 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:55:40.992 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:56:11.112 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:56:11.116 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:56:41.251 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:56:41.257 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:57:11.373 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:57:11.376 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:57:41.518 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:57:41.522 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:58:11.633 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:58:11.637 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:58:41.753 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:58:41.762 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:59:11.902 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:59:11.905 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:59:42.582 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T16:59:42.590 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:00:12.652 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:00:12.656 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:00:42.820 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:00:42.827 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:01:12.903 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:01:12.907 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:01:43.037 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:01:43.041 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:02:13.167 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:02:13.170 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:02:43.279 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:02:43.283 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:03:13.548 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:03:13.552 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:03:43.681 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:03:43.685 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:04:13.770 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:04:13.774 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:04:43.899 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:04:43.903 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:05:14.021 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:05:14.026 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:05:44.315 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:05:44.320 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:06:14.436 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:06:14.440 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:06:44.565 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:06:44.569 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:07:15.328 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:07:15.332 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:07:45.429 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:07:45.436 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:08:15.596 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:08:15.603 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:08:45.702 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:08:45.706 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:09:15.813 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:09:15.819 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:09:45.943 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:09:45.946 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:10:16.063 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:10:16.068 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:10:46.211 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:10:46.214 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:11:16.348 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:11:16.351 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:11:46.447 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:11:46.453 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:12:16.574 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:12:16.580 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:12:46.677 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:12:46.684 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:13:17.441 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:13:17.444 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:13:47.537 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:13:47.545 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:14:17.651 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:14:17.658 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:14:47.779 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:14:47.786 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:15:17.916 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:15:17.923 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:15:18.086 INFO:tasks.ceph.osd.1.smithi152.stderr:2024-04-17T17:15:18.087+0000 7fb553c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 511595) UID: 0 2024-04-17T17:15:18.087 INFO:tasks.ceph.osd.2.smithi152.stderr:2024-04-17T17:15:18.087+0000 7f9821400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 511595) UID: 0 2024-04-17T17:15:18.087 INFO:tasks.ceph.osd.0.smithi152.stderr:2024-04-17T17:15:18.087+0000 7f2076000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 511595) UID: 0 2024-04-17T17:15:18.087 INFO:tasks.ceph.osd.3.smithi152.stderr:2024-04-17T17:15:18.087+0000 7f2cca800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 511595) UID: 0 2024-04-17T17:19:40.122 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:19:40.126 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:20:10.260 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:20:10.266 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:20:40.356 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:20:40.364 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:21:10.527 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:21:10.533 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:21:40.665 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:21:40.672 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:22:10.781 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:22:10.785 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:22:40.908 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:22:40.914 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:23:11.230 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:23:11.234 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:23:41.375 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:23:41.379 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:24:11.505 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:24:11.508 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:24:41.617 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:24:41.624 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:25:11.764 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:25:11.771 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:25:42.148 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:25:42.152 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:26:12.321 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:26:12.325 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:26:42.655 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:26:42.662 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:27:12.858 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:27:12.862 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:27:42.996 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:27:43.002 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:28:13.191 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:28:13.197 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:28:43.267 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:28:43.271 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:29:13.374 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:29:13.382 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:29:43.482 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:29:43.485 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:30:13.603 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:30:13.611 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:30:43.735 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:30:43.742 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:31:13.922 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:31:13.931 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:31:44.048 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:31:44.051 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:32:14.177 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:32:14.183 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:32:44.251 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:32:44.255 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:33:14.341 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:33:14.345 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:33:46.154 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:33:46.162 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:34:16.280 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:34:16.284 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:34:46.392 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:34:46.403 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:35:16.499 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:35:16.503 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:35:46.647 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:35:46.650 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:36:16.806 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:36:16.817 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:36:46.944 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:36:46.950 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:37:17.082 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:37:17.088 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:37:47.198 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:37:47.206 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:37:47.342 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-04-17T17:37:47.343+0000 7fc89d000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 37063) UID: 0 2024-04-17T17:37:47.342 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-04-17T17:37:47.343+0000 7fc7d2600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 37063) UID: 0 2024-04-17T17:37:47.343 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-04-17T17:37:47.343+0000 7f2b4a200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 37063) UID: 0 2024-04-17T17:37:47.343 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-04-17T17:37:47.343+0000 7f5475c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 37063) UID: 0 2024-04-17T17:40:25.390 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:40:25.394 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:40:55.554 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:40:55.561 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:41:25.752 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:41:25.760 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:41:55.918 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:41:55.925 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:42:26.843 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:42:26.847 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:42:56.947 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:42:56.954 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:43:27.042 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:43:27.051 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:43:57.143 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:43:57.149 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:44:27.274 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:44:27.281 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:44:57.436 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:44:57.443 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:45:27.574 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:45:27.581 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:45:57.706 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:45:57.714 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:46:27.914 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:46:27.921 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:46:58.010 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:46:58.017 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:47:28.151 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:47:28.158 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:47:58.297 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:47:58.301 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:48:28.399 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:48:28.406 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:48:58.535 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:48:58.539 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:49:28.678 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:49:28.682 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:49:59.017 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:49:59.021 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:50:29.131 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:50:29.135 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:50:59.238 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:50:59.242 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:51:10.230 INFO:teuthology.orchestra.run.smithi152.stdout:generic/742 [failed, exit status 1]- output mismatch (see /tmp/tmp.pJW3k3pP3vxfstests-dev/results//generic/742.out.bad) 2024-04-17T17:51:10.301 INFO:teuthology.orchestra.run.smithi152.stdout: --- tests/generic/742.out 2024-04-17 08:48:08.617451373 +0000 2024-04-17T17:51:10.301 INFO:teuthology.orchestra.run.smithi152.stdout: +++ /tmp/tmp.pJW3k3pP3vxfstests-dev/results//generic/742.out.bad 2024-04-17 17:51:10.183074033 +0000 2024-04-17T17:51:10.301 INFO:teuthology.orchestra.run.smithi152.stdout: @@ -1,2 +1,3 @@ 2024-04-17T17:51:10.301 INFO:teuthology.orchestra.run.smithi152.stdout: QA output created by 742 2024-04-17T17:51:10.301 INFO:teuthology.orchestra.run.smithi152.stdout: Silence is golden 2024-04-17T17:51:10.301 INFO:teuthology.orchestra.run.smithi152.stdout: +fiemap-fault: fiemap failed 95: Operation not supported 2024-04-17T17:51:10.395 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/742 2024-04-17T17:51:10.395 INFO:teuthology.orchestra.run.smithi152.stdout:Failures: generic/742 2024-04-17T17:51:10.395 INFO:teuthology.orchestra.run.smithi152.stdout:Failed 1 of 1 tests 2024-04-17T17:51:10.500 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T17:51:10.684 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T17:51:10.685 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-04-17T17:51:10.685 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-04-17T17:51:10.686 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.pJW3k3pP3vxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/743) 2024-04-17T17:51:12.725 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph-fuse 2024-04-17T17:51:12.760 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 6.9.0-rc3-g3f60ed14f7c1 #1 SMP PREEMPT_DYNAMIC Thu Apr 11 19:00:15 UTC 2024 2024-04-17T17:51:12.760 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T17:51:14.149 INFO:teuthology.orchestra.run.smithi152.stdout:generic/743 [not run] xfs_io madvise doesn't support -R 2024-04-17T17:51:14.170 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/743 2024-04-17T17:51:14.173 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/743 2024-04-17T17:51:14.173 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-04-17T17:51:14.200 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T17:51:14.255 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-17T17:51:14.256 INFO:tasks.cephfs.xfstests_dev:=========================================================Total number of tests failed = 17========================================================= 2024-04-17T17:51:14.256 DEBUG:teuthology.orchestra.run.smithi152:> sudo userdel --force --remove fsgqa 2024-04-17T17:51:14.578 INFO:teuthology.orchestra.run.smithi152.stderr:userdel: fsgqa mail spool (/var/mail/fsgqa) not found 2024-04-17T17:51:15.050 DEBUG:teuthology.orchestra.run.smithi152:> sudo userdel --force --remove 123456-fsgqa 2024-04-17T17:51:15.113 INFO:teuthology.orchestra.run.smithi152.stderr:userdel: 123456-fsgqa mail spool (/var/mail/123456-fsgqa) not found 2024-04-17T17:51:15.113 INFO:teuthology.orchestra.run.smithi152.stderr:userdel: 123456-fsgqa home directory (/home/123456-fsgqa) not found 2024-04-17T17:51:15.638 DEBUG:teuthology.orchestra.run.smithi152:> sudo groupdel fsgqa 2024-04-17T17:51:15.732 INFO:teuthology.orchestra.run.smithi152.stderr:groupdel: group 'fsgqa' does not exist 2024-04-17T17:51:15.736 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-17T17:51:15.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T17:51:15.737 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo stat /tmp/tmp.pJW3k3pP3vxfstests-dev/results) 2024-04-17T17:51:15.772 INFO:teuthology.orchestra.run.smithi152.stderr:bash: line 1: cd: /home/ubuntu/cephtest/mnt.0: Permission denied 2024-04-17T17:51:15.777 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T17:51:15.777 INFO:tasks.cephfs.xfstests_dev:xfstests-dev repo contains not directory named "results". repo location: /tmp/tmp.pJW3k3pP3vxfstests-dev 2024-04-17T17:51:15.777 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -rf /tmp/tmp.pJW3k3pP3vxfstests-dev 2024-04-17T17:51:17.014 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-17T17:51:17.014 DEBUG:teuthology.orchestra.run.smithi152:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-17T17:51:17.307 DEBUG:teuthology.orchestra.run.smithi196:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-17T17:51:17.552 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-17T17:51:17.553 INFO:tasks.cephfs.mount:Terminating background process 2024-04-17T17:51:17.553 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-17T17:51:17.553 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-17T17:51:17.624 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350312k,nr_inodes=4087578,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3038 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-17T17:51:17.625 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi152.front.sepia.ceph.com 2024-04-17T17:51:17.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T17:51:17.625 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-17T17:51:17.713 INFO:tasks.cephfs.mount:Terminating background process 2024-04-17T17:51:17.713 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-17T17:51:17.713 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-17T17:51:17.743 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350260k,nr_inodes=4087565,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7575 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-17T17:51:17.743 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi196.front.sepia.ceph.com 2024-04-17T17:51:17.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T17:51:17.743 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-17T17:51:17.805 INFO:teuthology.orchestra.run.smithi196.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-04-17T17:51:17.816 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T17:51:17.816 INFO:tasks.cephfs.mount:Terminating background process 2024-04-17T17:51:17.816 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-17T17:51:17.816 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-17T17:51:17.838 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350312k,nr_inodes=4087578,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3038 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-17T17:51:17.838 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi152.front.sepia.ceph.com 2024-04-17T17:51:17.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T17:51:17.838 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-04-17T17:51:17.919 INFO:teuthology.orchestra.run.smithi152.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-04-17T17:51:17.924 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T17:51:17.924 INFO:tasks.cephfs.mount:Terminating background process 2024-04-17T17:51:17.924 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-17T17:51:17.924 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-17T17:51:17.936 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350260k,nr_inodes=4087565,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7575 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-17T17:51:17.936 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi196.front.sepia.ceph.com 2024-04-17T17:51:17.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T17:51:17.936 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-04-17T17:51:17.996 INFO:teuthology.orchestra.run.smithi196.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-04-17T17:51:17.997 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T17:51:17.997 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T17:51:19.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.190+0000 7fc6f0a00640 1 Processor -- start 2024-04-17T17:51:19.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.190+0000 7fc6f0a00640 1 -- start start 2024-04-17T17:51:19.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.198+0000 7fc6f0a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc6ec0ad210 0x7fc6ec0adc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:19.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.198+0000 7fc6f0a00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc6ec0ae1b0 0x7fc6ec0b3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:19.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.202+0000 7fc6ebe00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fc6ec0ad5f0 0x7fc6ec15b2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.152:46996/0 (socket says 172.21.15.152:46996) 2024-04-17T17:51:19.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.202+0000 7fc6ebe00640 1 -- 172.21.15.152:0/1758618035 learned_addr learned my addr 172.21.15.152:0/1758618035 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T17:51:19.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.202+0000 7fc6eb400640 1 --2- 172.21.15.152:0/1758618035 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc6ec0ad210 0x7fc6ec0adc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:19.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.202+0000 7fc6f0a00640 1 -- 172.21.15.152:0/1758618035 --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6ec1628c0 con 0x7fc6ec0ad5f0 2024-04-17T17:51:19.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.202+0000 7fc6f0a00640 1 -- 172.21.15.152:0/1758618035 --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fc6ec06b9b0 con 0x7fc6ec0ae1b0 2024-04-17T17:51:19.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.202+0000 7fc6f0a00640 1 -- 172.21.15.152:0/1758618035 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fc6ec06bc70 con 0x7fc6ec0ad210 2024-04-17T17:51:19.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.202+0000 7fc6eaa00640 1 --2- 172.21.15.152:0/1758618035 >> v2:172.21.15.152:3300/0 conn(0x7fc6ec0ae1b0 0x7fc6ec0b3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:19.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.202+0000 7fc6ea000640 1 -- 172.21.15.152:0/1758618035 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 264224694 0 0) 0x7fc6ec1628c0 con 0x7fc6ec0ad5f0 2024-04-17T17:51:19.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.202+0000 7fc6ea000640 1 -- 172.21.15.152:0/1758618035 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6d0003530 con 0x7fc6ec0ad5f0 2024-04-17T17:51:19.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.202+0000 7fc6ea000640 1 -- 172.21.15.152:0/1758618035 <== mon.1 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3231954537 0 0) 0x7fc6d0003530 con 0x7fc6ec0ad5f0 2024-04-17T17:51:19.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.202+0000 7fc6ea000640 1 -- 172.21.15.152:0/1758618035 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc6ec0ad210 msgr2=0x7fc6ec0adc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T17:51:19.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.206+0000 7fc6ea000640 1 --2- 172.21.15.152:0/1758618035 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc6ec0ad210 0x7fc6ec0adc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:19.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.206+0000 7fc6ea000640 1 -- 172.21.15.152:0/1758618035 >> v2:172.21.15.152:3300/0 conn(0x7fc6ec0ae1b0 msgr2=0x7fc6ec0b3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T17:51:19.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.206+0000 7fc6ea000640 1 --2- 172.21.15.152:0/1758618035 >> v2:172.21.15.152:3300/0 conn(0x7fc6ec0ae1b0 0x7fc6ec0b3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:19.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.206+0000 7fc6ea000640 1 -- 172.21.15.152:0/1758618035 --> v1:172.21.15.196:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6ec06bf50 con 0x7fc6ec0ad5f0 2024-04-17T17:51:19.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.206+0000 7fc6ea000640 1 -- 172.21.15.152:0/1758618035 <== mon.1 v1:172.21.15.196:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2973887244 0 0) 0x7fc6e4001a20 con 0x7fc6ec0ad5f0 2024-04-17T17:51:19.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.206+0000 7fc6ea000640 1 -- 172.21.15.152:0/1758618035 >> v1:172.21.15.196:6789/0 conn(0x7fc6ec0ad5f0 legacy=0x7fc6ec15b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:19.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.206+0000 7fc6ea000640 1 --2- 172.21.15.152:0/1758618035 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6d00039c0 0x7fc6d0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:19.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.206+0000 7fc6ea000640 1 --2- 172.21.15.152:0/1758618035 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc6ec0ad210 0x7fc6d0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:19.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.206+0000 7fc6ea000640 1 --2- 172.21.15.152:0/1758618035 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6d0004d50 0x7fc6d00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:19.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.206+0000 7fc6eb400640 1 --2- 172.21.15.152:0/1758618035 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6d00039c0 0x7fc6d0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:19.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.206+0000 7fc6ea000640 1 -- 172.21.15.152:0/1758618035 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc6ec06b9b0 con 0x7fc6d0004d50 2024-04-17T17:51:19.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.206+0000 7fc6ea000640 1 -- 172.21.15.152:0/1758618035 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc6ec06bc70 con 0x7fc6d00039c0 2024-04-17T17:51:19.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.206+0000 7fc6ea000640 1 -- 172.21.15.152:0/1758618035 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fc6d000b9d0 con 0x7fc6ec0ad210 2024-04-17T17:51:19.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.206+0000 7fc6eaa00640 1 --2- 172.21.15.152:0/1758618035 >> v2:172.21.15.152:3300/0 conn(0x7fc6ec0ae1b0 0x7fc6ec0b3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T17:51:19.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.210+0000 7fc6ebe00640 1 --2- 172.21.15.152:0/1758618035 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6d0004d50 0x7fc6d00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:19.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.210+0000 7fc6eaa00640 1 --2- 172.21.15.152:0/1758618035 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc6ec0ad210 0x7fc6d0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:19.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.210+0000 7fc6eb400640 1 -- 172.21.15.152:0/1758618035 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc6ec0ad210 msgr2=0x7fc6d0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T17:51:19.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.210+0000 7fc6eb400640 1 --2- 172.21.15.152:0/1758618035 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc6ec0ad210 0x7fc6d0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:19.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.210+0000 7fc6eb400640 1 -- 172.21.15.152:0/1758618035 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6d0004d50 msgr2=0x7fc6d00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T17:51:19.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.210+0000 7fc6eb400640 1 --2- 172.21.15.152:0/1758618035 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6d0004d50 0x7fc6d00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:19.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.210+0000 7fc6eb400640 1 -- 172.21.15.152:0/1758618035 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6d0003530 con 0x7fc6d00039c0 2024-04-17T17:51:19.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.210+0000 7fc6ebe00640 1 --2- 172.21.15.152:0/1758618035 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6d0004d50 0x7fc6d00051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T17:51:19.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.226+0000 7fc6eb400640 1 --2- 172.21.15.152:0/1758618035 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6d00039c0 0x7fc6d0003da0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc009ae0 tx=0x7fc6dc01ca70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e01dc1cf02caaadc server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:19.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.226+0000 7fc6ea000640 1 -- 172.21.15.152:0/1758618035 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6dc0b2070 con 0x7fc6d00039c0 2024-04-17T17:51:19.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.226+0000 7fc6ea000640 1 -- 172.21.15.152:0/1758618035 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6dc0a5660 con 0x7fc6d00039c0 2024-04-17T17:51:19.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.226+0000 7fc6ea000640 1 -- 172.21.15.152:0/1758618035 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6dc0096b0 con 0x7fc6d00039c0 2024-04-17T17:51:19.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.226+0000 7fc6f0a00640 1 -- 172.21.15.152:0/1758618035 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6d00039c0 msgr2=0x7fc6d0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:19.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.226+0000 7fc6f0a00640 1 --2- 172.21.15.152:0/1758618035 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6d00039c0 0x7fc6d0003da0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc009ae0 tx=0x7fc6dc01ca70 comp rx=0 tx=0).stop 2024-04-17T17:51:19.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.226+0000 7fc6ebe00640 1 -- 172.21.15.152:0/1758618035 reap_dead start 2024-04-17T17:51:19.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.226+0000 7fc6f0a00640 1 -- 172.21.15.152:0/1758618035 shutdown_connections 2024-04-17T17:51:19.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.226+0000 7fc6f0a00640 1 -- 172.21.15.152:0/1758618035 >> 172.21.15.152:0/1758618035 conn(0x7fc6ec0b1c80 msgr2=0x7fc6ec0b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:19.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.226+0000 7fc6f0a00640 1 -- 172.21.15.152:0/1758618035 shutdown_connections 2024-04-17T17:51:19.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.226+0000 7fc6f0a00640 1 -- 172.21.15.152:0/1758618035 wait complete. 2024-04-17T17:51:19.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.230+0000 7fc6f0a00640 1 Processor -- start 2024-04-17T17:51:19.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.230+0000 7fc6f0a00640 1 -- start start 2024-04-17T17:51:19.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.230+0000 7fc6f0a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6d00039c0 0x7fc6ec14dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:19.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.230+0000 7fc6f0a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6ec0afbf0 0x7fc6ec0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:19.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.230+0000 7fc6f0a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc6ec06ec70 0x7fc6ec06f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:19.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.230+0000 7fc6f0a00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc6ec0adc70 con 0x7fc6ec0afbf0 2024-04-17T17:51:19.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.230+0000 7fc6f0a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc6ec06c510 con 0x7fc6d00039c0 2024-04-17T17:51:19.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.230+0000 7fc6f0a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fc6ec0addf0 con 0x7fc6ec06ec70 2024-04-17T17:51:19.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.230+0000 7fc6eaa00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6ec0afbf0 0x7fc6ec0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:19.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.230+0000 7fc6eaa00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6ec0afbf0 0x7fc6ec0b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47942/0 (socket says 172.21.15.152:47942) 2024-04-17T17:51:19.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.230+0000 7fc6eaa00640 1 -- 172.21.15.152:0/2372181414 learned_addr learned my addr 172.21.15.152:0/2372181414 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T17:51:19.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.234+0000 7fc6eaa00640 1 -- 172.21.15.152:0/2372181414 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc6ec06ec70 msgr2=0x7fc6ec06f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:19.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.234+0000 7fc6eaa00640 1 --2- 172.21.15.152:0/2372181414 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc6ec06ec70 0x7fc6ec06f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:19.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.234+0000 7fc6eaa00640 1 -- 172.21.15.152:0/2372181414 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6d00039c0 msgr2=0x7fc6ec14dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:19.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.234+0000 7fc6eaa00640 1 --2- 172.21.15.152:0/2372181414 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6d00039c0 0x7fc6ec14dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:19.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.234+0000 7fc6eaa00640 1 -- 172.21.15.152:0/2372181414 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6ec072160 con 0x7fc6ec0afbf0 2024-04-17T17:51:19.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.234+0000 7fc6eaa00640 1 --2- 172.21.15.152:0/2372181414 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6ec0afbf0 0x7fc6ec0b0070 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8011cd0 tx=0x7fc6d800f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:19.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.234+0000 7fc6e3400640 1 -- 172.21.15.152:0/2372181414 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d8011e80 con 0x7fc6ec0afbf0 2024-04-17T17:51:19.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.234+0000 7fc6e3400640 1 -- 172.21.15.152:0/2372181414 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6d8004020 con 0x7fc6ec0afbf0 2024-04-17T17:51:19.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.234+0000 7fc6e3400640 1 -- 172.21.15.152:0/2372181414 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d80043d0 con 0x7fc6ec0afbf0 2024-04-17T17:51:19.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.238+0000 7fc6f0a00640 1 -- 172.21.15.152:0/2372181414 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6ec0b0760 con 0x7fc6ec0afbf0 2024-04-17T17:51:19.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.238+0000 7fc6f0a00640 1 -- 172.21.15.152:0/2372181414 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6ec0b0d20 con 0x7fc6ec0afbf0 2024-04-17T17:51:19.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.262+0000 7fc6e3400640 1 -- 172.21.15.152:0/2372181414 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc6d8012040 con 0x7fc6ec0afbf0 2024-04-17T17:51:19.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.270+0000 7fc6e3400640 1 --2- 172.21.15.152:0/2372181414 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc6cc0683b0 0x7fc6cc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:19.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.270+0000 7fc6e3400640 1 -- 172.21.15.152:0/2372181414 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6130+0+0 (secure 0 0 0) 0x7fc6d80870b0 con 0x7fc6ec0afbf0 2024-04-17T17:51:19.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.270+0000 7fc6eb400640 1 --2- 172.21.15.152:0/2372181414 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc6cc0683b0 0x7fc6cc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:19.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.238+0000 7fc6e0c00640 1 -- 172.21.15.152:0/2372181414 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6c00052a0 con 0x7fc6ec0afbf0 2024-04-17T17:51:19.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.282+0000 7fc6eb400640 1 --2- 172.21.15.152:0/2372181414 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc6cc0683b0 0x7fc6cc06a870 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc0af000 tx=0x7fc6dc004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:19.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:19.402+0000 7fc6e3400640 1 -- 172.21.15.152:0/2372181414 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fc6d8019030 con 0x7fc6ec0afbf0 2024-04-17T17:51:20.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.210+0000 7fc6e0c00640 1 -- 172.21.15.152:0/2372181414 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc6c0005590 con 0x7fc6ec0afbf0 2024-04-17T17:51:20.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.246+0000 7fc6e3400640 1 -- 172.21.15.152:0/2372181414 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5211 (secure 0 0 0) 0x7fc6d80574b0 con 0x7fc6ec0afbf0 2024-04-17T17:51:20.249 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T17:51:20.250 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4973,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6835/1356093111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6833","nonce":1356093111},{"type":"v1","addr":"172.21.15.196:6835","nonce":1356093111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4982,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1048040532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1048040532},{"type":"v1","addr":"172.21.15.152:6837","nonce":1048040532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5275,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6834/2151645018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":2151645018},{"type":"v1","addr":"172.21.15.196:6834","nonce":2151645018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-17T08:47:59.653400+0000","modified":"2024-04-17T08:48:02.688952+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5508":{"gid":5508,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6835/4144515289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":4144515289},{"type":"v1","addr":"172.21.15.152:6835","nonce":4144515289}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5508,"qdb_cluster":[5508]},"id":2}]} 2024-04-17T17:51:20.250 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 18 2024-04-17T17:51:20.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.250+0000 7fc6e0c00640 1 -- 172.21.15.152:0/2372181414 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc6cc0683b0 msgr2=0x7fc6cc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:20.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.250+0000 7fc6e0c00640 1 --2- 172.21.15.152:0/2372181414 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc6cc0683b0 0x7fc6cc06a870 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc0af000 tx=0x7fc6dc004740 comp rx=0 tx=0).stop 2024-04-17T17:51:20.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.250+0000 7fc6e0c00640 1 -- 172.21.15.152:0/2372181414 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6ec0afbf0 msgr2=0x7fc6ec0b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:20.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.250+0000 7fc6e0c00640 1 --2- 172.21.15.152:0/2372181414 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6ec0afbf0 0x7fc6ec0b0070 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8011cd0 tx=0x7fc6d800f610 comp rx=0 tx=0).stop 2024-04-17T17:51:20.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.254+0000 7fc6e0c00640 1 -- 172.21.15.152:0/2372181414 shutdown_connections 2024-04-17T17:51:20.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.254+0000 7fc6e0c00640 1 --2- 172.21.15.152:0/2372181414 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc6cc0683b0 0x7fc6cc06a870 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:20.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.254+0000 7fc6e0c00640 1 --2- 172.21.15.152:0/2372181414 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc6ec06ec70 0x7fc6ec06f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:20.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.254+0000 7fc6e0c00640 1 --2- 172.21.15.152:0/2372181414 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6ec0afbf0 0x7fc6ec0b0070 unknown :-1 s=CLOSED pgs=2032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:20.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.254+0000 7fc6e0c00640 1 --2- 172.21.15.152:0/2372181414 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6d00039c0 0x7fc6ec14dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:20.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.254+0000 7fc6e0c00640 1 -- 172.21.15.152:0/2372181414 >> 172.21.15.152:0/2372181414 conn(0x7fc6ec0b1c80 msgr2=0x7fc6ec151c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:20.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.254+0000 7fc6e0c00640 1 -- 172.21.15.152:0/2372181414 shutdown_connections 2024-04-17T17:51:20.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.258+0000 7fc6e0c00640 1 -- 172.21.15.152:0/2372181414 wait complete. 2024-04-17T17:51:20.329 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T17:51:20.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.942+0000 7f719b000640 1 Processor -- start 2024-04-17T17:51:20.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.942+0000 7f719b000640 1 -- start start 2024-04-17T17:51:20.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.942+0000 7f719b000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f719415e4f0 0x7f71940d15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:20.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.942+0000 7f719b000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f71940d4940 0x7f71940b3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:20.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.942+0000 7f719b000640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71940cfba0 con 0x7f7194162fb0 2024-04-17T17:51:20.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.942+0000 7f719b000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f71940cf970 con 0x7f719415e4f0 2024-04-17T17:51:20.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.942+0000 7f719b000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f71940cfe80 con 0x7f71940d4940 2024-04-17T17:51:20.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.946+0000 7f7199c00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f719415e4f0 0x7f71940d15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:20.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.946+0000 7f7199c00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f719415e4f0 0x7f71940d15b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.152:53256/0 (socket says 172.21.15.152:53256) 2024-04-17T17:51:20.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.946+0000 7f7199c00640 1 -- 172.21.15.152:0/1061264518 learned_addr learned my addr 172.21.15.152:0/1061264518 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T17:51:20.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.946+0000 7f7199c00640 1 -- 172.21.15.152:0/1061264518 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f71940d4940 msgr2=0x7f71940b3000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-17T17:51:20.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.946+0000 7f7199c00640 1 --2- 172.21.15.152:0/1061264518 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f71940d4940 0x7f71940b3000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:20.950 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.946+0000 7f7199c00640 1 -- 172.21.15.152:0/1061264518 >> v1:172.21.15.152:6789/0 conn(0x7f7194162fb0 legacy=0x7f71940d4230 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-17T17:51:20.950 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.946+0000 7f7199c00640 1 -- 172.21.15.152:0/1061264518 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71940d0160 con 0x7f719415e4f0 2024-04-17T17:51:20.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.950+0000 7f7199c00640 1 --2- 172.21.15.152:0/1061264518 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f719415e4f0 0x7f71940d15b0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f718c009e50 tx=0x7f718c01f200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76cfaa3a9c24e686 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:20.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.950+0000 7f7193e00640 1 -- 172.21.15.152:0/1061264518 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f718c0b4070 con 0x7f719415e4f0 2024-04-17T17:51:20.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.950+0000 7f7193e00640 1 -- 172.21.15.152:0/1061264518 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f718c0af400 con 0x7f719415e4f0 2024-04-17T17:51:20.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.950+0000 7f7193e00640 1 -- 172.21.15.152:0/1061264518 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f718c0af7d0 con 0x7f719415e4f0 2024-04-17T17:51:20.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.950+0000 7f719b000640 1 -- 172.21.15.152:0/1061264518 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f719415e4f0 msgr2=0x7f71940d15b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:20.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.950+0000 7f719b000640 1 --2- 172.21.15.152:0/1061264518 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f719415e4f0 0x7f71940d15b0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f718c009e50 tx=0x7f718c01f200 comp rx=0 tx=0).stop 2024-04-17T17:51:20.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.950+0000 7f719b000640 1 -- 172.21.15.152:0/1061264518 shutdown_connections 2024-04-17T17:51:20.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.950+0000 7f719b000640 1 --2- 172.21.15.152:0/1061264518 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f71940d4940 0x7f71940b3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:20.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.950+0000 7f719b000640 1 --2- 172.21.15.152:0/1061264518 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f719415e4f0 0x7f71940d15b0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:20.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.954+0000 7f719b000640 1 -- 172.21.15.152:0/1061264518 >> 172.21.15.152:0/1061264518 conn(0x7f719408bf90 msgr2=0x7f719409d780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:20.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.954+0000 7f719b000640 1 -- 172.21.15.152:0/1061264518 shutdown_connections 2024-04-17T17:51:20.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.954+0000 7f719b000640 1 -- 172.21.15.152:0/1061264518 wait complete. 2024-04-17T17:51:20.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.962+0000 7f719b000640 1 Processor -- start 2024-04-17T17:51:20.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.970+0000 7f719b000640 1 -- start start 2024-04-17T17:51:20.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.970+0000 7f719b000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f71940d4940 0x7f71940ce520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:20.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.970+0000 7f719b000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f719415e4f0 0x7f7194151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:20.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.970+0000 7f719b000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7194162fb0 0x7f71940cd910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:20.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.970+0000 7f719b000640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f71940d0c40 con 0x7f719415e4f0 2024-04-17T17:51:20.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.970+0000 7f719b000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f71940d0720 con 0x7f71940d4940 2024-04-17T17:51:20.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.970+0000 7f719b000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f71940d1af0 con 0x7f7194162fb0 2024-04-17T17:51:20.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.970+0000 7f719a600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7194162fb0 0x7f71940cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:20.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.970+0000 7f719a600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7194162fb0 0x7f71940cd910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.152:33726/0 (socket says 172.21.15.152:33726) 2024-04-17T17:51:20.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.970+0000 7f719a600640 1 -- 172.21.15.152:0/1620450677 learned_addr learned my addr 172.21.15.152:0/1620450677 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T17:51:20.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.974+0000 7f719a600640 1 -- 172.21.15.152:0/1620450677 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f71940d4940 msgr2=0x7f71940ce520 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-17T17:51:20.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.974+0000 7f719a600640 1 --2- 172.21.15.152:0/1620450677 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f71940d4940 0x7f71940ce520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:20.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.974+0000 7f719a600640 1 -- 172.21.15.152:0/1620450677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f719415e4f0 msgr2=0x7f7194151d30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-17T17:51:20.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.974+0000 7f719a600640 1 --2- 172.21.15.152:0/1620450677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f719415e4f0 0x7f7194151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:20.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.974+0000 7f719a600640 1 -- 172.21.15.152:0/1620450677 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7194153620 con 0x7f7194162fb0 2024-04-17T17:51:20.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.978+0000 7f719a600640 1 --2- 172.21.15.152:0/1620450677 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7194162fb0 0x7f71940cd910 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f718800b410 tx=0x7f718800b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:20.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.978+0000 7f7191600640 1 -- 172.21.15.152:0/1620450677 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7188015020 con 0x7f7194162fb0 2024-04-17T17:51:20.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.978+0000 7f7191600640 1 -- 172.21.15.152:0/1620450677 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7188011830 con 0x7f7194162fb0 2024-04-17T17:51:20.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.978+0000 7f7191600640 1 -- 172.21.15.152:0/1620450677 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7188011ca0 con 0x7f7194162fb0 2024-04-17T17:51:20.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.982+0000 7f719b000640 1 -- 172.21.15.152:0/1620450677 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71941538c0 con 0x7f7194162fb0 2024-04-17T17:51:20.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.982+0000 7f719b000640 1 -- 172.21.15.152:0/1620450677 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7194153e80 con 0x7f7194162fb0 2024-04-17T17:51:20.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.986+0000 7f719b000640 1 -- 172.21.15.152:0/1620450677 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71700052a0 con 0x7f7194162fb0 2024-04-17T17:51:21.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.990+0000 7f7191600640 1 -- 172.21.15.152:0/1620450677 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7188018020 con 0x7f7194162fb0 2024-04-17T17:51:21.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.994+0000 7f7191600640 1 --2- 172.21.15.152:0/1620450677 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f7174068480 0x7f717406a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:21.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.994+0000 7f7191600640 1 -- 172.21.15.152:0/1620450677 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(40..40 src has 1..40) ==== 6130+0+0 (secure 0 0 0) 0x7f7188086a20 con 0x7f7194162fb0 2024-04-17T17:51:21.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:20.998+0000 7f7199c00640 1 --2- 172.21.15.152:0/1620450677 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f7174068480 0x7f717406a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:21.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:21.002+0000 7f7199c00640 1 --2- 172.21.15.152:0/1620450677 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f7174068480 0x7f717406a940 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f718c0b1000 tx=0x7f718c0aa000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:21.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:21.082+0000 7f7191600640 1 -- 172.21.15.152:0/1620450677 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f718801f020 con 0x7f7194162fb0 2024-04-17T17:51:21.773 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:21.770+0000 7f719b000640 1 -- 172.21.15.152:0/1620450677 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7170005590 con 0x7f7194162fb0 2024-04-17T17:51:21.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:21.886+0000 7f7191600640 1 -- 172.21.15.152:0/1620450677 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+16959 (secure 0 0 0) 0x7f71880172c0 con 0x7f7194162fb0 2024-04-17T17:51:21.891 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T17:51:21.891 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":40,"fsid":"ce68f82e-ec5f-4205-9fd5-bdfdf6ef31e2","created":"2024-04-17T08:46:08.353546+0000","modified":"2024-04-17T08:48:15.464983+0000","last_up_change":"2024-04-17T08:46:20.738799+0000","last_in_change":"2024-04-17T08:46:11.210050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T08:46:21.386856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-17T08:47:58.148039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-17T08:47:58.612261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"682f0192-187c-404e-bc7a-b6b4e23825e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6819","nonce":3603799291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6823","nonce":3603799291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6831","nonce":3603799291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6827","nonce":3603799291}]},"public_addr":"172.21.15.152:6819/3603799291","cluster_addr":"172.21.15.152:6823/3603799291","heartbeat_back_addr":"172.21.15.152:6831/3603799291","heartbeat_front_addr":"172.21.15.152:6827/3603799291","state":["exists","up"]},{"osd":1,"uuid":"f0fe8fef-60ec-4a39-83b6-2fa6a5adb0f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6801","nonce":4133383142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6803","nonce":4133383142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6807","nonce":4133383142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6805","nonce":4133383142}]},"public_addr":"172.21.15.152:6801/4133383142","cluster_addr":"172.21.15.152:6803/4133383142","heartbeat_back_addr":"172.21.15.152:6807/4133383142","heartbeat_front_addr":"172.21.15.152:6805/4133383142","state":["exists","up"]},{"osd":2,"uuid":"35f36d9c-5245-4431-a618-f4df0fa380ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6809","nonce":3826143898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6811","nonce":3826143898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6815","nonce":3826143898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6813","nonce":3826143898}]},"public_addr":"172.21.15.152:6809/3826143898","cluster_addr":"172.21.15.152:6811/3826143898","heartbeat_back_addr":"172.21.15.152:6815/3826143898","heartbeat_front_addr":"172.21.15.152:6813/3826143898","state":["exists","up"]},{"osd":3,"uuid":"96e56ca5-15b4-4895-9b79-da2c92043159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6818","nonce":165717826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6822","nonce":165717826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6830","nonce":165717826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6826","nonce":165717826}]},"public_addr":"172.21.15.152:6818/165717826","cluster_addr":"172.21.15.152:6822/165717826","heartbeat_back_addr":"172.21.15.152:6830/165717826","heartbeat_front_addr":"172.21.15.152:6826/165717826","state":["exists","up"]},{"osd":4,"uuid":"f5aa10a4-9ff9-41fe-a5c9-15326f982cc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6817","nonce":4080159297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6819","nonce":4080159297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6823","nonce":4080159297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6821","nonce":4080159297}]},"public_addr":"172.21.15.196:6817/4080159297","cluster_addr":"172.21.15.196:6819/4080159297","heartbeat_back_addr":"172.21.15.196:6823/4080159297","heartbeat_front_addr":"172.21.15.196:6821/4080159297","state":["exists","up"]},{"osd":5,"uuid":"42bab884-3476-47ae-ac65-935fa6e0f055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6801","nonce":3519444232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6803","nonce":3519444232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6807","nonce":3519444232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6805","nonce":3519444232}]},"public_addr":"172.21.15.196:6801/3519444232","cluster_addr":"172.21.15.196:6803/3519444232","heartbeat_back_addr":"172.21.15.196:6807/3519444232","heartbeat_front_addr":"172.21.15.196:6805/3519444232","state":["exists","up"]},{"osd":6,"uuid":"460b6167-f57b-4224-9c92-cfc9b80bbe99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6809","nonce":275739834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6811","nonce":275739834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6815","nonce":275739834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6813","nonce":275739834}]},"public_addr":"172.21.15.196:6809/275739834","cluster_addr":"172.21.15.196:6811/275739834","heartbeat_back_addr":"172.21.15.196:6815/275739834","heartbeat_front_addr":"172.21.15.196:6813/275739834","state":["exists","up"]},{"osd":7,"uuid":"d695643f-5e07-4e2a-a646-c06bd97b6650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6825","nonce":307626968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6827","nonce":307626968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6831","nonce":307626968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6829","nonce":307626968}]},"public_addr":"172.21.15.196:6825/307626968","cluster_addr":"172.21.15.196:6827/307626968","heartbeat_back_addr":"172.21.15.196:6831/307626968","heartbeat_front_addr":"172.21.15.196:6829/307626968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.293257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.964533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.248895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.010000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.832554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.743704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930171+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930962+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.31","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T17:51:21.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:21.894+0000 7f719b000640 1 -- 172.21.15.152:0/1620450677 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f7174068480 msgr2=0x7f717406a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:21.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:21.894+0000 7f719b000640 1 --2- 172.21.15.152:0/1620450677 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f7174068480 0x7f717406a940 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f718c0b1000 tx=0x7f718c0aa000 comp rx=0 tx=0).stop 2024-04-17T17:51:21.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:21.894+0000 7f719b000640 1 -- 172.21.15.152:0/1620450677 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7194162fb0 msgr2=0x7f71940cd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:21.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:21.894+0000 7f719b000640 1 --2- 172.21.15.152:0/1620450677 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7194162fb0 0x7f71940cd910 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f718800b410 tx=0x7f718800b8d0 comp rx=0 tx=0).stop 2024-04-17T17:51:21.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:21.902+0000 7f719b000640 1 -- 172.21.15.152:0/1620450677 shutdown_connections 2024-04-17T17:51:21.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:21.902+0000 7f719b000640 1 --2- 172.21.15.152:0/1620450677 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f7174068480 0x7f717406a940 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:21.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:21.902+0000 7f719b000640 1 --2- 172.21.15.152:0/1620450677 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7194162fb0 0x7f71940cd910 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:21.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:21.902+0000 7f719b000640 1 --2- 172.21.15.152:0/1620450677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f719415e4f0 0x7f7194151d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:21.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:21.902+0000 7f719b000640 1 --2- 172.21.15.152:0/1620450677 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f71940d4940 0x7f71940ce520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:21.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:21.902+0000 7f719b000640 1 -- 172.21.15.152:0/1620450677 >> 172.21.15.152:0/1620450677 conn(0x7f719408bf90 msgr2=0x7f7194160b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:21.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:21.906+0000 7f719b000640 1 -- 172.21.15.152:0/1620450677 shutdown_connections 2024-04-17T17:51:21.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:21.906+0000 7f719b000640 1 -- 172.21.15.152:0/1620450677 wait complete. 2024-04-17T17:51:21.974 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T08:46:21.386856+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-17T08:47:58.148039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-04-17T08:47:58.612261+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-17T17:51:21.974 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T17:51:22.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.562+0000 7f0e1cc00640 1 Processor -- start 2024-04-17T17:51:22.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.562+0000 7f0e1cc00640 1 -- start start 2024-04-17T17:51:22.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.566+0000 7f0e1cc00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0e180b4650 0x7f0e180b34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:22.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.566+0000 7f0e1cc00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e1815a8e0 con 0x7f0e1806cfa0 2024-04-17T17:51:22.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.566+0000 7f0e1cc00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e1806e270 con 0x7f0e1815b520 2024-04-17T17:51:22.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.566+0000 7f0e1cc00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f0e180b39e0 con 0x7f0e180b4650 2024-04-17T17:51:22.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.566+0000 7f0e17e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0e180b4650 0x7f0e180b34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:22.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.566+0000 7f0e17e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0e180b4650 0x7f0e180b34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.152:53268/0 (socket says 172.21.15.152:53268) 2024-04-17T17:51:22.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.566+0000 7f0e17e00640 1 -- 172.21.15.152:0/205405613 learned_addr learned my addr 172.21.15.152:0/205405613 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T17:51:22.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.566+0000 7f0e17e00640 1 -- 172.21.15.152:0/205405613 >> v1:172.21.15.196:6789/0 conn(0x7f0e1815b520 legacy=0x7f0e180b3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:22.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.566+0000 7f0e17e00640 1 -- 172.21.15.152:0/205405613 >> v1:172.21.15.152:6789/0 conn(0x7f0e1806cfa0 legacy=0x7f0e1806f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T17:51:22.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.566+0000 7f0e17e00640 1 -- 172.21.15.152:0/205405613 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e1806e550 con 0x7f0e180b4650 2024-04-17T17:51:22.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.578+0000 7f0e17e00640 1 --2- 172.21.15.152:0/205405613 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e180b4650 0x7f0e180b34a0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f0e1000d370 tx=0x7f0e1001ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dba22408755235bc server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:22.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.582+0000 7f0e16000640 1 -- 172.21.15.152:0/205405613 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e100ad070 con 0x7f0e180b4650 2024-04-17T17:51:22.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.582+0000 7f0e16000640 1 -- 172.21.15.152:0/205405613 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e100a7bd0 con 0x7f0e180b4650 2024-04-17T17:51:22.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.582+0000 7f0e16000640 1 -- 172.21.15.152:0/205405613 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1000be60 con 0x7f0e180b4650 2024-04-17T17:51:22.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.582+0000 7f0e1cc00640 1 -- 172.21.15.152:0/205405613 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e180b4650 msgr2=0x7f0e180b34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:22.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.582+0000 7f0e1cc00640 1 --2- 172.21.15.152:0/205405613 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e180b4650 0x7f0e180b34a0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f0e1000d370 tx=0x7f0e1001ed00 comp rx=0 tx=0).stop 2024-04-17T17:51:22.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.582+0000 7f0e1cc00640 1 -- 172.21.15.152:0/205405613 shutdown_connections 2024-04-17T17:51:22.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.582+0000 7f0e1cc00640 1 --2- 172.21.15.152:0/205405613 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e180b4650 0x7f0e180b34a0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:22.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.582+0000 7f0e1cc00640 1 -- 172.21.15.152:0/205405613 >> 172.21.15.152:0/205405613 conn(0x7f0e180d0470 msgr2=0x7f0e180d0880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:22.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.586+0000 7f0e1cc00640 1 -- 172.21.15.152:0/205405613 shutdown_connections 2024-04-17T17:51:22.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.586+0000 7f0e1cc00640 1 -- 172.21.15.152:0/205405613 wait complete. 2024-04-17T17:51:22.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.590+0000 7f0e1cc00640 1 Processor -- start 2024-04-17T17:51:22.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.594+0000 7f0e1cc00640 1 -- start start 2024-04-17T17:51:22.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.598+0000 7f0e1cc00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e1806cfa0 0x7f0e1814cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:22.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.598+0000 7f0e1cc00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e180b4650 0x7f0e180b00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:22.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.598+0000 7f0e1cc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e1815b520 0x7f0e180b0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:22.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.598+0000 7f0e1cc00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1806c550 con 0x7f0e1806cfa0 2024-04-17T17:51:22.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.598+0000 7f0e1cc00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1806c3d0 con 0x7f0e180b4650 2024-04-17T17:51:22.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.598+0000 7f0e1cc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f0e1806eba0 con 0x7f0e1815b520 2024-04-17T17:51:22.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.598+0000 7f0e17e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e1815b520 0x7f0e180b0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:22.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.598+0000 7f0e17e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e1815b520 0x7f0e180b0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.152:33738/0 (socket says 172.21.15.152:33738) 2024-04-17T17:51:22.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.598+0000 7f0e17e00640 1 -- 172.21.15.152:0/3464979257 learned_addr learned my addr 172.21.15.152:0/3464979257 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T17:51:22.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.598+0000 7f0e17400640 1 --2- 172.21.15.152:0/3464979257 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e1806cfa0 0x7f0e1814cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:22.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.598+0000 7f0e17e00640 1 -- 172.21.15.152:0/3464979257 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e180b4650 msgr2=0x7f0e180b00d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-17T17:51:22.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.598+0000 7f0e17e00640 1 --2- 172.21.15.152:0/3464979257 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e180b4650 0x7f0e180b00d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:22.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.598+0000 7f0e17e00640 1 -- 172.21.15.152:0/3464979257 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e1806cfa0 msgr2=0x7f0e1814cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:22.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.598+0000 7f0e17e00640 1 --2- 172.21.15.152:0/3464979257 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e1806cfa0 0x7f0e1814cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:22.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.598+0000 7f0e17e00640 1 -- 172.21.15.152:0/3464979257 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e180b3b60 con 0x7f0e1815b520 2024-04-17T17:51:22.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.602+0000 7f0e17e00640 1 --2- 172.21.15.152:0/3464979257 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e1815b520 0x7f0e180b0610 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0e100b3040 tx=0x7f0e1001bac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:22.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.602+0000 7f0e0f400640 1 -- 172.21.15.152:0/3464979257 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e100bf020 con 0x7f0e1815b520 2024-04-17T17:51:22.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.602+0000 7f0e0f400640 1 -- 172.21.15.152:0/3464979257 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e10008700 con 0x7f0e1815b520 2024-04-17T17:51:22.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.602+0000 7f0e0f400640 1 -- 172.21.15.152:0/3464979257 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e100bf020 con 0x7f0e1815b520 2024-04-17T17:51:22.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.606+0000 7f0e1cc00640 1 -- 172.21.15.152:0/3464979257 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e18069420 con 0x7f0e1815b520 2024-04-17T17:51:22.611 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.606+0000 7f0e1cc00640 1 -- 172.21.15.152:0/3464979257 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e18154d90 con 0x7f0e1815b520 2024-04-17T17:51:22.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.610+0000 7f0e0f400640 1 -- 172.21.15.152:0/3464979257 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0e100c2020 con 0x7f0e1815b520 2024-04-17T17:51:22.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.610+0000 7f0e0f400640 1 --2- 172.21.15.152:0/3464979257 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0df8068780 0x7f0df806ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:22.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.610+0000 7f0e1cc00640 1 -- 172.21.15.152:0/3464979257 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e18075be0 con 0x7f0e1815b520 2024-04-17T17:51:22.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.614+0000 7f0e0f400640 1 -- 172.21.15.152:0/3464979257 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(40..40 src has 1..40) ==== 6130+0+0 (secure 0 0 0) 0x7f0e10008500 con 0x7f0e1815b520 2024-04-17T17:51:22.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.614+0000 7f0e17400640 1 --2- 172.21.15.152:0/3464979257 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0df8068780 0x7f0df806ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:22.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.614+0000 7f0e17400640 1 --2- 172.21.15.152:0/3464979257 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0df8068780 0x7f0df806ac40 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f0e18072e40 tx=0x7f0e04009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:22.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.618+0000 7f0e0f400640 1 -- 172.21.15.152:0/3464979257 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f0e100189a0 con 0x7f0e1815b520 2024-04-17T17:51:22.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.882+0000 7f0e1cc00640 1 -- 172.21.15.152:0/3464979257 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0e18074490 con 0x7f0e1815b520 2024-04-17T17:51:22.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.902+0000 7f0e0f400640 1 -- 172.21.15.152:0/3464979257 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) ==== 93+0+10 (secure 0 0 0) 0x7f0e100f3360 con 0x7f0e1815b520 2024-04-17T17:51:22.908 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2024-04-17T17:51:22.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.910+0000 7f0e1cc00640 1 -- 172.21.15.152:0/3464979257 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0df8068780 msgr2=0x7f0df806ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:22.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.910+0000 7f0e1cc00640 1 --2- 172.21.15.152:0/3464979257 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0df8068780 0x7f0df806ac40 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f0e18072e40 tx=0x7f0e04009040 comp rx=0 tx=0).stop 2024-04-17T17:51:22.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.910+0000 7f0e1cc00640 1 -- 172.21.15.152:0/3464979257 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e1815b520 msgr2=0x7f0e180b0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:22.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.910+0000 7f0e1cc00640 1 --2- 172.21.15.152:0/3464979257 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e1815b520 0x7f0e180b0610 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0e100b3040 tx=0x7f0e1001bac0 comp rx=0 tx=0).stop 2024-04-17T17:51:22.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.910+0000 7f0e1cc00640 1 -- 172.21.15.152:0/3464979257 shutdown_connections 2024-04-17T17:51:22.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.910+0000 7f0e1cc00640 1 --2- 172.21.15.152:0/3464979257 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f0df8068780 0x7f0df806ac40 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:22.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.910+0000 7f0e1cc00640 1 --2- 172.21.15.152:0/3464979257 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e1815b520 0x7f0e180b0610 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:22.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.910+0000 7f0e1cc00640 1 --2- 172.21.15.152:0/3464979257 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e180b4650 0x7f0e180b00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:22.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.910+0000 7f0e1cc00640 1 --2- 172.21.15.152:0/3464979257 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e1806cfa0 0x7f0e1814cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:22.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.910+0000 7f0e1cc00640 1 -- 172.21.15.152:0/3464979257 >> 172.21.15.152:0/3464979257 conn(0x7f0e180d0470 msgr2=0x7f0e181568a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:22.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.914+0000 7f0e1cc00640 1 -- 172.21.15.152:0/3464979257 shutdown_connections 2024-04-17T17:51:22.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:22.914+0000 7f0e1cc00640 1 -- 172.21.15.152:0/3464979257 wait complete. 2024-04-17T17:51:22.952 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-17T17:51:23.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.162+0000 7f4a88e00640 1 Processor -- start 2024-04-17T17:51:23.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.162+0000 7f4a88e00640 1 -- start start 2024-04-17T17:51:23.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.162+0000 7f4a88e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f4a84161f70 0x7f4a840b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:23.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.166+0000 7f4a88e00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f4a8406ebf0 0x7f4a840d43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:23.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.166+0000 7f4a88e00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a84162350 con 0x7f4a840d4910 2024-04-17T17:51:23.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.166+0000 7f4a88e00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f4a8406f3e0 con 0x7f4a8406ebf0 2024-04-17T17:51:23.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.166+0000 7f4a88e00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f4a840d2260 con 0x7f4a84161f70 2024-04-17T17:51:23.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.166+0000 7f4a81e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f4a84161f70 0x7f4a840b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:23.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.166+0000 7f4a81e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f4a84161f70 0x7f4a840b3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.152:53278/0 (socket says 172.21.15.152:53278) 2024-04-17T17:51:23.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.166+0000 7f4a81e00640 1 -- 172.21.15.152:0/1858554457 learned_addr learned my addr 172.21.15.152:0/1858554457 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T17:51:23.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.166+0000 7f4a81e00640 1 -- 172.21.15.152:0/1858554457 >> v2:172.21.15.152:3300/0 conn(0x7f4a8406ebf0 msgr2=0x7f4a840d43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T17:51:23.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.166+0000 7f4a80a00640 1 -- 172.21.15.152:0/1858554457 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 801627342 0 0) 0x7f4a84162350 con 0x7f4a840d4910 2024-04-17T17:51:23.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.166+0000 7f4a81400640 1 --2- 172.21.15.152:0/1858554457 >> v2:172.21.15.152:3300/0 conn(0x7f4a8406ebf0 0x7f4a840d43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:23.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.170+0000 7f4a81e00640 1 --2- 172.21.15.152:0/1858554457 >> v2:172.21.15.152:3300/0 conn(0x7f4a8406ebf0 0x7f4a840d43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:23.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.170+0000 7f4a81e00640 1 -- 172.21.15.152:0/1858554457 >> v1:172.21.15.196:6789/0 conn(0x7f4a840d4910 legacy=0x7f4a840d1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:23.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.170+0000 7f4a81e00640 1 -- 172.21.15.152:0/1858554457 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a840d0790 con 0x7f4a84161f70 2024-04-17T17:51:23.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.170+0000 7f4a81400640 1 --2- 172.21.15.152:0/1858554457 >> v2:172.21.15.152:3300/0 conn(0x7f4a8406ebf0 0x7f4a840d43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T17:51:23.184 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.178+0000 7f4a81e00640 1 --2- 172.21.15.152:0/1858554457 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4a84161f70 0x7f4a840b3b10 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f4a8408d340 tx=0x7f4a7401c400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3fda785b40f7916 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:23.184 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.182+0000 7f4a80a00640 1 -- 172.21.15.152:0/1858554457 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a740b0070 con 0x7f4a84161f70 2024-04-17T17:51:23.185 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.182+0000 7f4a80a00640 1 -- 172.21.15.152:0/1858554457 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a740ab600 con 0x7f4a84161f70 2024-04-17T17:51:23.185 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.182+0000 7f4a80a00640 1 -- 172.21.15.152:0/1858554457 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a740ab9d0 con 0x7f4a84161f70 2024-04-17T17:51:23.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.182+0000 7f4a88e00640 1 -- 172.21.15.152:0/1858554457 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4a84161f70 msgr2=0x7f4a840b3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:23.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.182+0000 7f4a88e00640 1 --2- 172.21.15.152:0/1858554457 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4a84161f70 0x7f4a840b3b10 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f4a8408d340 tx=0x7f4a7401c400 comp rx=0 tx=0).stop 2024-04-17T17:51:23.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.182+0000 7f4a88e00640 1 -- 172.21.15.152:0/1858554457 shutdown_connections 2024-04-17T17:51:23.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.182+0000 7f4a88e00640 1 --2- 172.21.15.152:0/1858554457 >> v2:172.21.15.152:3300/0 conn(0x7f4a8406ebf0 0x7f4a840d43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:23.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.182+0000 7f4a88e00640 1 --2- 172.21.15.152:0/1858554457 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4a84161f70 0x7f4a840b3b10 secure :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f4a8408d340 tx=0x7f4a7401c400 comp rx=0 tx=0).stop 2024-04-17T17:51:23.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.182+0000 7f4a88e00640 1 -- 172.21.15.152:0/1858554457 >> 172.21.15.152:0/1858554457 conn(0x7f4a840b99b0 msgr2=0x7f4a840b7540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:23.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.190+0000 7f4a88e00640 1 -- 172.21.15.152:0/1858554457 shutdown_connections 2024-04-17T17:51:23.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.194+0000 7f4a88e00640 1 -- 172.21.15.152:0/1858554457 wait complete. 2024-04-17T17:51:23.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.202+0000 7f4a88e00640 1 Processor -- start 2024-04-17T17:51:23.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.202+0000 7f4a88e00640 1 -- start start 2024-04-17T17:51:23.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.214+0000 7f4a88e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a8406ebf0 0x7f4a841578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:23.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.214+0000 7f4a88e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4a840d4910 0x7f4a84157280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:23.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.214+0000 7f4a88e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4a840c9970 0x7f4a8415cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:23.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.214+0000 7f4a88e00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4a8416b600 con 0x7f4a8406ebf0 2024-04-17T17:51:23.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.214+0000 7f4a88e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4a840d4d20 con 0x7f4a840d4910 2024-04-17T17:51:23.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.214+0000 7f4a88e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f4a8416b780 con 0x7f4a840c9970 2024-04-17T17:51:23.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.214+0000 7f4a82800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4a840c9970 0x7f4a8415cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:23.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.214+0000 7f4a82800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4a840c9970 0x7f4a8415cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.152:33748/0 (socket says 172.21.15.152:33748) 2024-04-17T17:51:23.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.214+0000 7f4a82800640 1 -- 172.21.15.152:0/2071076612 learned_addr learned my addr 172.21.15.152:0/2071076612 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T17:51:23.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.214+0000 7f4a81400640 1 --2- 172.21.15.152:0/2071076612 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4a840d4910 0x7f4a84157280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:23.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.214+0000 7f4a81e00640 1 --2- 172.21.15.152:0/2071076612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a8406ebf0 0x7f4a841578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:23.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.214+0000 7f4a81e00640 1 -- 172.21.15.152:0/2071076612 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4a840c9970 msgr2=0x7f4a8415cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:23.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.214+0000 7f4a81e00640 1 --2- 172.21.15.152:0/2071076612 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4a840c9970 0x7f4a8415cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:23.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.214+0000 7f4a81e00640 1 -- 172.21.15.152:0/2071076612 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4a840d4910 msgr2=0x7f4a84157280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:23.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.214+0000 7f4a81e00640 1 --2- 172.21.15.152:0/2071076612 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4a840d4910 0x7f4a84157280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:23.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.214+0000 7f4a81e00640 1 -- 172.21.15.152:0/2071076612 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a8415d240 con 0x7f4a8406ebf0 2024-04-17T17:51:23.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.214+0000 7f4a82800640 1 --2- 172.21.15.152:0/2071076612 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4a840c9970 0x7f4a8415cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T17:51:23.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.214+0000 7f4a81e00640 1 --2- 172.21.15.152:0/2071076612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a8406ebf0 0x7f4a841578b0 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 crypto rx=0x7f4a740ab000 tx=0x7f4a740191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:23.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.214+0000 7f4a7a000640 1 -- 172.21.15.152:0/2071076612 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a740b8020 con 0x7f4a8406ebf0 2024-04-17T17:51:23.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.214+0000 7f4a7a000640 1 -- 172.21.15.152:0/2071076612 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a740b4440 con 0x7f4a8406ebf0 2024-04-17T17:51:23.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.214+0000 7f4a7a000640 1 -- 172.21.15.152:0/2071076612 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a740b0040 con 0x7f4a8406ebf0 2024-04-17T17:51:23.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.214+0000 7f4a88e00640 1 -- 172.21.15.152:0/2071076612 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a840ca430 con 0x7f4a8406ebf0 2024-04-17T17:51:23.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.218+0000 7f4a88e00640 1 -- 172.21.15.152:0/2071076612 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a840ca9f0 con 0x7f4a8406ebf0 2024-04-17T17:51:23.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.218+0000 7f4a88e00640 1 -- 172.21.15.152:0/2071076612 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a84068a30 con 0x7f4a8406ebf0 2024-04-17T17:51:23.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.222+0000 7f4a7a000640 1 -- 172.21.15.152:0/2071076612 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4a740bb070 con 0x7f4a8406ebf0 2024-04-17T17:51:23.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.222+0000 7f4a7a000640 1 --2- 172.21.15.152:0/2071076612 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f4a640683d0 0x7f4a6406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:23.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.226+0000 7f4a81400640 1 --2- 172.21.15.152:0/2071076612 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f4a640683d0 0x7f4a6406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:23.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.234+0000 7f4a7a000640 1 -- 172.21.15.152:0/2071076612 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6130+0+0 (secure 0 0 0) 0x7f4a7411fa70 con 0x7f4a8406ebf0 2024-04-17T17:51:23.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.234+0000 7f4a81400640 1 --2- 172.21.15.152:0/2071076612 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f4a640683d0 0x7f4a6406a890 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f4a840b70f0 tx=0x7f4a70008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:23.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:23.242+0000 7f4a7a000640 1 -- 172.21.15.152:0/2071076612 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f4a8415d240 con 0x7f4a8406ebf0 2024-04-17T17:51:24.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.118+0000 7f4a88e00640 1 -- 172.21.15.152:0/2071076612 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f4a840ca0e0 con 0x7f4a8406ebf0 2024-04-17T17:51:24.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.266+0000 7f4a7a000640 1 -- 172.21.15.152:0/2071076612 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) ==== 104+0+11 (secure 0 0 0) 0x7f4a74016110 con 0x7f4a8406ebf0 2024-04-17T17:51:24.272 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-04-17T17:51:24.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.274+0000 7f4a88e00640 1 -- 172.21.15.152:0/2071076612 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f4a640683d0 msgr2=0x7f4a6406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:24.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.274+0000 7f4a88e00640 1 --2- 172.21.15.152:0/2071076612 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f4a640683d0 0x7f4a6406a890 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f4a840b70f0 tx=0x7f4a70008040 comp rx=0 tx=0).stop 2024-04-17T17:51:24.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.274+0000 7f4a88e00640 1 -- 172.21.15.152:0/2071076612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a8406ebf0 msgr2=0x7f4a841578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:24.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.274+0000 7f4a88e00640 1 --2- 172.21.15.152:0/2071076612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a8406ebf0 0x7f4a841578b0 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 crypto rx=0x7f4a740ab000 tx=0x7f4a740191a0 comp rx=0 tx=0).stop 2024-04-17T17:51:24.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.278+0000 7f4a88e00640 1 -- 172.21.15.152:0/2071076612 shutdown_connections 2024-04-17T17:51:24.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.278+0000 7f4a88e00640 1 --2- 172.21.15.152:0/2071076612 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f4a640683d0 0x7f4a6406a890 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:24.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.278+0000 7f4a88e00640 1 --2- 172.21.15.152:0/2071076612 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4a840c9970 0x7f4a8415cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:24.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.278+0000 7f4a88e00640 1 --2- 172.21.15.152:0/2071076612 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4a840d4910 0x7f4a84157280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:24.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.278+0000 7f4a88e00640 1 --2- 172.21.15.152:0/2071076612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a8406ebf0 0x7f4a841578b0 unknown :-1 s=CLOSED pgs=2033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:24.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.278+0000 7f4a88e00640 1 -- 172.21.15.152:0/2071076612 >> 172.21.15.152:0/2071076612 conn(0x7f4a840b99b0 msgr2=0x7f4a840b2920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:24.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.278+0000 7f4a88e00640 1 -- 172.21.15.152:0/2071076612 shutdown_connections 2024-04-17T17:51:24.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.278+0000 7f4a88e00640 1 -- 172.21.15.152:0/2071076612 wait complete. 2024-04-17T17:51:24.307 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-17T17:51:24.860 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.854+0000 7fec21200640 1 Processor -- start 2024-04-17T17:51:24.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.858+0000 7fec21200640 1 -- start start 2024-04-17T17:51:24.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.862+0000 7fec21200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec1c06f310 0x7fec1c165ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:24.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.862+0000 7fec21200640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec1c0af2b0 con 0x7fec1c15eb60 2024-04-17T17:51:24.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.862+0000 7fec19e00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fec1c15eb60 0x7fec1c0ae980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:57400/0 (socket says 172.21.15.152:57400) 2024-04-17T17:51:24.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.862+0000 7fec19e00640 1 -- 172.21.15.152:0/1709166100 learned_addr learned my addr 172.21.15.152:0/1709166100 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T17:51:24.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.862+0000 7fec21200640 1 -- 172.21.15.152:0/1709166100 --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec1c0af590 con 0x7fec1c06e730 2024-04-17T17:51:24.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.862+0000 7fec21200640 1 -- 172.21.15.152:0/1709166100 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fec1c0af090 con 0x7fec1c06f310 2024-04-17T17:51:24.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.866+0000 7fec1a800640 1 --2- 172.21.15.152:0/1709166100 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec1c06f310 0x7fec1c165ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:24.869 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.866+0000 7fec18a00640 1 -- 172.21.15.152:0/1709166100 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2790525101 0 0) 0x7fec1c0af2b0 con 0x7fec1c15eb60 2024-04-17T17:51:24.869 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.866+0000 7fec18a00640 1 -- 172.21.15.152:0/1709166100 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec00003530 con 0x7fec1c15eb60 2024-04-17T17:51:24.869 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.866+0000 7fec18a00640 1 -- 172.21.15.152:0/1709166100 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2605234407 0 0) 0x7fec00003530 con 0x7fec1c15eb60 2024-04-17T17:51:24.869 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.866+0000 7fec18a00640 1 -- 172.21.15.152:0/1709166100 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec1c06f310 msgr2=0x7fec1c165ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T17:51:24.869 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.866+0000 7fec18a00640 1 --2- 172.21.15.152:0/1709166100 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec1c06f310 0x7fec1c165ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:24.869 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.866+0000 7fec18a00640 1 -- 172.21.15.152:0/1709166100 >> v1:172.21.15.196:6789/0 conn(0x7fec1c06e730 legacy=0x7fec1c06ec00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-17T17:51:24.869 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.866+0000 7fec18a00640 1 -- 172.21.15.152:0/1709166100 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec1c0af870 con 0x7fec1c15eb60 2024-04-17T17:51:24.869 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.866+0000 7fec18a00640 1 -- 172.21.15.152:0/1709166100 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2973887244 0 0) 0x7fec0c001680 con 0x7fec1c15eb60 2024-04-17T17:51:24.869 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.866+0000 7fec18a00640 1 -- 172.21.15.152:0/1709166100 >> v1:172.21.15.152:6789/0 conn(0x7fec1c15eb60 legacy=0x7fec1c0ae980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:24.869 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.866+0000 7fec18a00640 1 --2- 172.21.15.152:0/1709166100 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fec000039f0 0x7fec00003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:24.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.866+0000 7fec18a00640 1 --2- 172.21.15.152:0/1709166100 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec00004810 0x7fec00004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:24.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.866+0000 7fec18a00640 1 --2- 172.21.15.152:0/1709166100 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec1c06f310 0x7fec000051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:24.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.866+0000 7fec18a00640 1 -- 172.21.15.152:0/1709166100 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fec1c0af090 con 0x7fec00004810 2024-04-17T17:51:24.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.866+0000 7fec18a00640 1 -- 172.21.15.152:0/1709166100 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fec000099f0 con 0x7fec000039f0 2024-04-17T17:51:24.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.866+0000 7fec18a00640 1 -- 172.21.15.152:0/1709166100 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fec00009bf0 con 0x7fec1c06f310 2024-04-17T17:51:24.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.866+0000 7fec1a800640 1 --2- 172.21.15.152:0/1709166100 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec1c06f310 0x7fec000051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:24.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.866+0000 7fec19400640 1 --2- 172.21.15.152:0/1709166100 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec00004810 0x7fec00004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:24.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.866+0000 7fec1a800640 1 -- 172.21.15.152:0/1709166100 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fec000039f0 msgr2=0x7fec00003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T17:51:24.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.866+0000 7fec1a800640 1 --2- 172.21.15.152:0/1709166100 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fec000039f0 0x7fec00003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:24.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.866+0000 7fec1a800640 1 -- 172.21.15.152:0/1709166100 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec00004810 msgr2=0x7fec00004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T17:51:24.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.866+0000 7fec1a800640 1 --2- 172.21.15.152:0/1709166100 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec00004810 0x7fec00004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:24.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.866+0000 7fec1a800640 1 -- 172.21.15.152:0/1709166100 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec00003530 con 0x7fec1c06f310 2024-04-17T17:51:24.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.894+0000 7fec1a800640 1 --2- 172.21.15.152:0/1709166100 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec1c06f310 0x7fec000051d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fec14009f90 tx=0x7fec1401cc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42d2d937361b3a0a server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:24.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.894+0000 7fec18a00640 1 -- 172.21.15.152:0/1709166100 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec140b2070 con 0x7fec1c06f310 2024-04-17T17:51:24.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.894+0000 7fec18a00640 1 -- 172.21.15.152:0/1709166100 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec140a5c90 con 0x7fec1c06f310 2024-04-17T17:51:24.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.894+0000 7fec18a00640 1 -- 172.21.15.152:0/1709166100 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec14009c10 con 0x7fec1c06f310 2024-04-17T17:51:24.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.894+0000 7fec21200640 1 -- 172.21.15.152:0/1709166100 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec1c06f310 msgr2=0x7fec000051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:24.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.894+0000 7fec21200640 1 --2- 172.21.15.152:0/1709166100 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec1c06f310 0x7fec000051d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fec14009f90 tx=0x7fec1401cc80 comp rx=0 tx=0).stop 2024-04-17T17:51:24.904 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.902+0000 7fec1a800640 1 -- 172.21.15.152:0/1709166100 reap_dead start 2024-04-17T17:51:24.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.902+0000 7fec21200640 1 -- 172.21.15.152:0/1709166100 shutdown_connections 2024-04-17T17:51:24.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.902+0000 7fec21200640 1 -- 172.21.15.152:0/1709166100 >> 172.21.15.152:0/1709166100 conn(0x7fec1c072140 msgr2=0x7fec1c0b4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:24.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.902+0000 7fec21200640 1 -- 172.21.15.152:0/1709166100 shutdown_connections 2024-04-17T17:51:24.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.902+0000 7fec21200640 1 -- 172.21.15.152:0/1709166100 wait complete. 2024-04-17T17:51:24.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.902+0000 7fec21200640 1 Processor -- start 2024-04-17T17:51:24.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.906+0000 7fec21200640 1 -- start start 2024-04-17T17:51:24.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.906+0000 7fec21200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec1c06f310 0x7fec1c09dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:24.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.906+0000 7fec21200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fec1c14e240 0x7fec1c156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:24.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.906+0000 7fec21200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec1c14c9a0 0x7fec1c153960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:24.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.906+0000 7fec21200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fec1c0afb50 con 0x7fec1c06f310 2024-04-17T17:51:24.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.906+0000 7fec21200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fec1c06d310 con 0x7fec1c14e240 2024-04-17T17:51:24.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.906+0000 7fec21200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fec1c06bbe0 con 0x7fec1c14c9a0 2024-04-17T17:51:24.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.906+0000 7fec19e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec1c06f310 0x7fec1c09dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:24.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.906+0000 7fec19e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec1c06f310 0x7fec1c09dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:48010/0 (socket says 172.21.15.152:48010) 2024-04-17T17:51:24.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.906+0000 7fec19e00640 1 -- 172.21.15.152:0/1106151114 learned_addr learned my addr 172.21.15.152:0/1106151114 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T17:51:24.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.906+0000 7fec1a800640 1 --2- 172.21.15.152:0/1106151114 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec1c14c9a0 0x7fec1c153960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:24.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.906+0000 7fec19e00640 1 -- 172.21.15.152:0/1106151114 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec1c14c9a0 msgr2=0x7fec1c153960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:24.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.906+0000 7fec19e00640 1 --2- 172.21.15.152:0/1106151114 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec1c14c9a0 0x7fec1c153960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:24.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.906+0000 7fec19e00640 1 -- 172.21.15.152:0/1106151114 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fec1c14e240 msgr2=0x7fec1c156a70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-17T17:51:24.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.906+0000 7fec19e00640 1 --2- 172.21.15.152:0/1106151114 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fec1c14e240 0x7fec1c156a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:24.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.906+0000 7fec19e00640 1 -- 172.21.15.152:0/1106151114 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec1c14e980 con 0x7fec1c06f310 2024-04-17T17:51:24.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.906+0000 7fec1a800640 1 --2- 172.21.15.152:0/1106151114 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec1c14c9a0 0x7fec1c153960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T17:51:24.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.906+0000 7fec19e00640 1 --2- 172.21.15.152:0/1106151114 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec1c06f310 0x7fec1c09dca0 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7fec0c00f460 tx=0x7fec0c00f920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:24.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.906+0000 7fec12000640 1 -- 172.21.15.152:0/1106151114 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec0c01a070 con 0x7fec1c06f310 2024-04-17T17:51:24.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.906+0000 7fec12000640 1 -- 172.21.15.152:0/1106151114 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec0c008d30 con 0x7fec1c06f310 2024-04-17T17:51:24.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.906+0000 7fec21200640 1 -- 172.21.15.152:0/1106151114 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec1c14d1a0 con 0x7fec1c06f310 2024-04-17T17:51:24.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.906+0000 7fec21200640 1 -- 172.21.15.152:0/1106151114 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec1c14d760 con 0x7fec1c06f310 2024-04-17T17:51:24.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.906+0000 7fec12000640 1 -- 172.21.15.152:0/1106151114 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec0c00a2b0 con 0x7fec1c06f310 2024-04-17T17:51:24.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.910+0000 7fec21200640 1 -- 172.21.15.152:0/1106151114 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febf40052a0 con 0x7fec1c06f310 2024-04-17T17:51:24.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.926+0000 7fec12000640 1 -- 172.21.15.152:0/1106151114 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fec0c01d070 con 0x7fec1c06f310 2024-04-17T17:51:24.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.930+0000 7fec12000640 1 --2- 172.21.15.152:0/1106151114 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7febfc068450 0x7febfc06a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:24.937 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.934+0000 7fec12000640 1 -- 172.21.15.152:0/1106151114 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6130+0+0 (secure 0 0 0) 0x7fec0c089660 con 0x7fec1c06f310 2024-04-17T17:51:24.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.938+0000 7fec19400640 1 --2- 172.21.15.152:0/1106151114 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7febfc068450 0x7febfc06a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:24.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.938+0000 7fec19400640 1 --2- 172.21.15.152:0/1106151114 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7febfc068450 0x7febfc06a910 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fec1c152e50 tx=0x7fec08008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:24.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:24.946+0000 7fec12000640 1 -- 172.21.15.152:0/1106151114 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fec0c059400 con 0x7fec1c06f310 2024-04-17T17:51:25.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.206+0000 7fec21200640 1 -- 172.21.15.152:0/1106151114 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7febf4005860 con 0x7fec1c06f310 2024-04-17T17:51:25.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.206+0000 7fec12000640 1 -- 172.21.15.152:0/1106151114 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) ==== 100+0+11 (secure 0 0 0) 0x7fec0c05d700 con 0x7fec1c06f310 2024-04-17T17:51:25.212 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 64 2024-04-17T17:51:25.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.210+0000 7fec21200640 1 -- 172.21.15.152:0/1106151114 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7febfc068450 msgr2=0x7febfc06a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:25.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.210+0000 7fec21200640 1 --2- 172.21.15.152:0/1106151114 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7febfc068450 0x7febfc06a910 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fec1c152e50 tx=0x7fec08008040 comp rx=0 tx=0).stop 2024-04-17T17:51:25.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.210+0000 7fec21200640 1 -- 172.21.15.152:0/1106151114 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec1c06f310 msgr2=0x7fec1c09dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:25.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.210+0000 7fec21200640 1 --2- 172.21.15.152:0/1106151114 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec1c06f310 0x7fec1c09dca0 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7fec0c00f460 tx=0x7fec0c00f920 comp rx=0 tx=0).stop 2024-04-17T17:51:25.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.218+0000 7fec21200640 1 -- 172.21.15.152:0/1106151114 shutdown_connections 2024-04-17T17:51:25.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.218+0000 7fec21200640 1 --2- 172.21.15.152:0/1106151114 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7febfc068450 0x7febfc06a910 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:25.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.218+0000 7fec21200640 1 --2- 172.21.15.152:0/1106151114 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec1c14c9a0 0x7fec1c153960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:25.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.218+0000 7fec21200640 1 --2- 172.21.15.152:0/1106151114 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fec1c14e240 0x7fec1c156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:25.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.218+0000 7fec21200640 1 --2- 172.21.15.152:0/1106151114 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec1c06f310 0x7fec1c09dca0 unknown :-1 s=CLOSED pgs=2035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:25.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.218+0000 7fec21200640 1 -- 172.21.15.152:0/1106151114 >> 172.21.15.152:0/1106151114 conn(0x7fec1c072140 msgr2=0x7fec1c0b0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:25.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.218+0000 7fec21200640 1 -- 172.21.15.152:0/1106151114 shutdown_connections 2024-04-17T17:51:25.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.218+0000 7fec21200640 1 -- 172.21.15.152:0/1106151114 wait complete. 2024-04-17T17:51:25.258 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T17:51:25.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.846+0000 7f5e5d000640 1 Processor -- start 2024-04-17T17:51:25.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.858+0000 7f5e5d000640 1 -- start start 2024-04-17T17:51:25.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.870+0000 7f5e5d000640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f5e580d37e0 0x7f5e5806c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:25.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.870+0000 7f5e57400640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f5e58162b60 0x7f5e580d0150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.152:47028/0 (socket says 172.21.15.152:47028) 2024-04-17T17:51:25.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.870+0000 7f5e56a00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f5e580d37e0 0x7f5e5806c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:25.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.870+0000 7f5e56a00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f5e580d37e0 0x7f5e5806c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:48022/0 (socket says 172.21.15.152:48022) 2024-04-17T17:51:25.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.870+0000 7f5e57e00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f5e5806c900 0x7f5e580b72b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:57412/0 (socket says 172.21.15.152:57412) 2024-04-17T17:51:25.875 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.870+0000 7f5e57400640 1 -- 172.21.15.152:0/2536006557 learned_addr learned my addr 172.21.15.152:0/2536006557 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T17:51:25.875 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.870+0000 7f5e5d000640 1 -- 172.21.15.152:0/2536006557 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e580d2740 con 0x7f5e5806c900 2024-04-17T17:51:25.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.874+0000 7f5e5d000640 1 -- 172.21.15.152:0/2536006557 --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e580d2a20 con 0x7f5e58162b60 2024-04-17T17:51:25.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.874+0000 7f5e5d000640 1 -- 172.21.15.152:0/2536006557 --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f5e5806cd70 con 0x7f5e580d37e0 2024-04-17T17:51:25.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.874+0000 7f5e56000640 1 -- 172.21.15.152:0/2536006557 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4279485486 0 0) 0x7f5e580d2740 con 0x7f5e5806c900 2024-04-17T17:51:25.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.874+0000 7f5e56000640 1 -- 172.21.15.152:0/2536006557 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e3c003530 con 0x7f5e5806c900 2024-04-17T17:51:25.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.874+0000 7f5e56000640 1 -- 172.21.15.152:0/2536006557 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2515717542 0 0) 0x7f5e580d2a20 con 0x7f5e58162b60 2024-04-17T17:51:25.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.874+0000 7f5e56000640 1 -- 172.21.15.152:0/2536006557 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e580d2740 con 0x7f5e58162b60 2024-04-17T17:51:25.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.874+0000 7f5e56000640 1 -- 172.21.15.152:0/2536006557 <== mon.1 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3782688504 0 0) 0x7f5e580d2740 con 0x7f5e58162b60 2024-04-17T17:51:25.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.874+0000 7f5e56000640 1 -- 172.21.15.152:0/2536006557 >> v2:172.21.15.152:3300/0 conn(0x7f5e580d37e0 msgr2=0x7f5e5806c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T17:51:25.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.874+0000 7f5e56000640 1 --2- 172.21.15.152:0/2536006557 >> v2:172.21.15.152:3300/0 conn(0x7f5e580d37e0 0x7f5e5806c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:25.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.874+0000 7f5e56000640 1 -- 172.21.15.152:0/2536006557 >> v1:172.21.15.152:6789/0 conn(0x7f5e5806c900 legacy=0x7f5e580b72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:25.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.874+0000 7f5e56000640 1 -- 172.21.15.152:0/2536006557 --> v1:172.21.15.196:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e580d2d00 con 0x7f5e58162b60 2024-04-17T17:51:25.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.874+0000 7f5e56000640 1 -- 172.21.15.152:0/2536006557 <== mon.1 v1:172.21.15.196:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2973887244 0 0) 0x7f5e44001680 con 0x7f5e58162b60 2024-04-17T17:51:25.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.874+0000 7f5e56000640 1 -- 172.21.15.152:0/2536006557 >> v1:172.21.15.196:6789/0 conn(0x7f5e58162b60 legacy=0x7f5e580d0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:25.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.874+0000 7f5e56000640 1 --2- 172.21.15.152:0/2536006557 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5e3c004c00 0x7f5e3c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:25.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.874+0000 7f5e56000640 1 --2- 172.21.15.152:0/2536006557 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5e3c0037b0 0x7f5e3c003c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:25.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.874+0000 7f5e56000640 1 --2- 172.21.15.152:0/2536006557 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e3c004170 0x7f5e3c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:25.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.874+0000 7f5e56000640 1 -- 172.21.15.152:0/2536006557 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5e5806cd70 con 0x7f5e3c004170 2024-04-17T17:51:25.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.874+0000 7f5e56000640 1 -- 172.21.15.152:0/2536006557 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3c00c0a0 con 0x7f5e3c0037b0 2024-04-17T17:51:25.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.874+0000 7f5e56000640 1 -- 172.21.15.152:0/2536006557 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f5e3c00c2a0 con 0x7f5e3c004c00 2024-04-17T17:51:25.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.874+0000 7f5e57e00640 1 --2- 172.21.15.152:0/2536006557 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e3c004170 0x7f5e3c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:25.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.874+0000 7f5e56a00640 1 --2- 172.21.15.152:0/2536006557 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5e3c0037b0 0x7f5e3c003c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:25.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.874+0000 7f5e57e00640 1 -- 172.21.15.152:0/2536006557 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5e3c004c00 msgr2=0x7f5e3c005000 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-17T17:51:25.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.874+0000 7f5e57e00640 1 --2- 172.21.15.152:0/2536006557 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5e3c004c00 0x7f5e3c005000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:25.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.874+0000 7f5e57e00640 1 -- 172.21.15.152:0/2536006557 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5e3c0037b0 msgr2=0x7f5e3c003c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T17:51:25.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.874+0000 7f5e57e00640 1 --2- 172.21.15.152:0/2536006557 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5e3c0037b0 0x7f5e3c003c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:25.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.874+0000 7f5e57e00640 1 -- 172.21.15.152:0/2536006557 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e580d2740 con 0x7f5e3c004170 2024-04-17T17:51:25.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.878+0000 7f5e57e00640 1 --2- 172.21.15.152:0/2536006557 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e3c004170 0x7f5e3c00b9d0 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 crypto rx=0x7f5e50002030 tx=0x7f5e5001f0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa91eb50799af2ec server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:25.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.878+0000 7f5e57e00640 1 -- 172.21.15.152:0/2536006557 reap_dead start 2024-04-17T17:51:25.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.878+0000 7f5e56000640 1 -- 172.21.15.152:0/2536006557 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e50001c80 con 0x7f5e3c004170 2024-04-17T17:51:25.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.878+0000 7f5e56000640 1 -- 172.21.15.152:0/2536006557 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e50004d70 con 0x7f5e3c004170 2024-04-17T17:51:25.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.878+0000 7f5e56000640 1 -- 172.21.15.152:0/2536006557 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e500a8cb0 con 0x7f5e3c004170 2024-04-17T17:51:25.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.882+0000 7f5e5d000640 1 -- 172.21.15.152:0/2536006557 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e3c004170 msgr2=0x7f5e3c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:25.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.882+0000 7f5e5d000640 1 --2- 172.21.15.152:0/2536006557 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e3c004170 0x7f5e3c00b9d0 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 crypto rx=0x7f5e50002030 tx=0x7f5e5001f0d0 comp rx=0 tx=0).stop 2024-04-17T17:51:25.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.886+0000 7f5e5d000640 1 -- 172.21.15.152:0/2536006557 shutdown_connections 2024-04-17T17:51:25.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.886+0000 7f5e5d000640 1 --2- 172.21.15.152:0/2536006557 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e3c004170 0x7f5e3c00b9d0 unknown :-1 s=CLOSED pgs=2037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:25.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.886+0000 7f5e5d000640 1 -- 172.21.15.152:0/2536006557 >> 172.21.15.152:0/2536006557 conn(0x7f5e580d4460 msgr2=0x7f5e580d4870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:25.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.886+0000 7f5e5d000640 1 -- 172.21.15.152:0/2536006557 shutdown_connections 2024-04-17T17:51:25.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.890+0000 7f5e5d000640 1 -- 172.21.15.152:0/2536006557 wait complete. 2024-04-17T17:51:25.900 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.898+0000 7f5e5d000640 1 Processor -- start 2024-04-17T17:51:25.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.898+0000 7f5e5d000640 1 -- start start 2024-04-17T17:51:25.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.902+0000 7f5e5d000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5e3c004170 0x7f5e5815cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:25.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.902+0000 7f5e5d000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5e580cd9a0 0x7f5e580cde20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:25.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.902+0000 7f5e5d000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e581f84a0 0x7f5e581f8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:25.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.902+0000 7f5e5d000640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5e580d3c40 con 0x7f5e581f84a0 2024-04-17T17:51:25.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.902+0000 7f5e5d000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f5e580d32c0 con 0x7f5e580cd9a0 2024-04-17T17:51:25.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.902+0000 7f5e5d000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f5e58162f40 con 0x7f5e3c004170 2024-04-17T17:51:25.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.902+0000 7f5e56a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5e580cd9a0 0x7f5e580cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:25.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.902+0000 7f5e56a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5e580cd9a0 0x7f5e580cde20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.152:53340/0 (socket says 172.21.15.152:53340) 2024-04-17T17:51:25.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.902+0000 7f5e56a00640 1 -- 172.21.15.152:0/3367856963 learned_addr learned my addr 172.21.15.152:0/3367856963 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T17:51:25.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.906+0000 7f5e56a00640 1 -- 172.21.15.152:0/3367856963 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5e3c004170 msgr2=0x7f5e5815cb90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-17T17:51:25.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.906+0000 7f5e56a00640 1 --2- 172.21.15.152:0/3367856963 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5e3c004170 0x7f5e5815cb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:25.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.906+0000 7f5e56a00640 1 -- 172.21.15.152:0/3367856963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e581f84a0 msgr2=0x7f5e581f8920 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-17T17:51:25.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.906+0000 7f5e57e00640 1 --2- 172.21.15.152:0/3367856963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e581f84a0 0x7f5e581f8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:25.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.906+0000 7f5e56a00640 1 --2- 172.21.15.152:0/3367856963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e581f84a0 0x7f5e581f8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:25.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.906+0000 7f5e56a00640 1 -- 172.21.15.152:0/3367856963 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e580cc480 con 0x7f5e580cd9a0 2024-04-17T17:51:25.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.906+0000 7f5e57e00640 1 --2- 172.21.15.152:0/3367856963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e581f84a0 0x7f5e581f8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T17:51:25.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.906+0000 7f5e56a00640 1 --2- 172.21.15.152:0/3367856963 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5e580cd9a0 0x7f5e580cde20 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f5e48011990 tx=0x7f5e48011e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:25.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.906+0000 7f5e4f400640 1 -- 172.21.15.152:0/3367856963 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e4800fa70 con 0x7f5e580cd9a0 2024-04-17T17:51:25.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.906+0000 7f5e4f400640 1 -- 172.21.15.152:0/3367856963 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e4800fc10 con 0x7f5e580cd9a0 2024-04-17T17:51:25.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.906+0000 7f5e4f400640 1 -- 172.21.15.152:0/3367856963 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e48014440 con 0x7f5e580cd9a0 2024-04-17T17:51:25.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.906+0000 7f5e5d000640 1 -- 172.21.15.152:0/3367856963 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e580cc900 con 0x7f5e580cd9a0 2024-04-17T17:51:25.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.906+0000 7f5e5d000640 1 -- 172.21.15.152:0/3367856963 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e580ccec0 con 0x7f5e580cd9a0 2024-04-17T17:51:25.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.910+0000 7f5e4f400640 1 -- 172.21.15.152:0/3367856963 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5e48012040 con 0x7f5e580cd9a0 2024-04-17T17:51:25.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.910+0000 7f5e4f400640 1 --2- 172.21.15.152:0/3367856963 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5e38068450 0x7f5e3806a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:25.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.910+0000 7f5e4f400640 1 -- 172.21.15.152:0/3367856963 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6130+0+0 (secure 0 0 0) 0x7f5e48087110 con 0x7f5e580cd9a0 2024-04-17T17:51:25.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.914+0000 7f5e57400640 1 --2- 172.21.15.152:0/3367856963 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5e38068450 0x7f5e3806a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:25.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.914+0000 7f5e5d000640 1 -- 172.21.15.152:0/3367856963 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e58075c10 con 0x7f5e580cd9a0 2024-04-17T17:51:25.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.914+0000 7f5e57400640 1 --2- 172.21.15.152:0/3367856963 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5e38068450 0x7f5e3806a910 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f5e440018b0 tx=0x7f5e44001480 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:25.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:25.958+0000 7f5e4f400640 1 -- 172.21.15.152:0/3367856963 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f5e48019030 con 0x7f5e580cd9a0 2024-04-17T17:51:26.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:26.426+0000 7f5e5d000640 1 -- 172.21.15.152:0/3367856963 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5e580cee30 con 0x7f5e580cd9a0 2024-04-17T17:51:26.462 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:26.458+0000 7f5e4f400640 1 -- 172.21.15.152:0/3367856963 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5211 (secure 0 0 0) 0x7f5e48057590 con 0x7f5e580cd9a0 2024-04-17T17:51:26.463 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T17:51:26.463 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4973,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6835/1356093111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6833","nonce":1356093111},{"type":"v1","addr":"172.21.15.196:6835","nonce":1356093111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4982,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1048040532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1048040532},{"type":"v1","addr":"172.21.15.152:6837","nonce":1048040532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5275,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6834/2151645018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":2151645018},{"type":"v1","addr":"172.21.15.196:6834","nonce":2151645018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-17T08:47:59.653400+0000","modified":"2024-04-17T08:48:02.688952+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5508":{"gid":5508,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6835/4144515289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":4144515289},{"type":"v1","addr":"172.21.15.152:6835","nonce":4144515289}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5508,"qdb_cluster":[5508]},"id":2}]} 2024-04-17T17:51:26.463 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 18 2024-04-17T17:51:26.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:26.466+0000 7f5e5d000640 1 -- 172.21.15.152:0/3367856963 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5e38068450 msgr2=0x7f5e3806a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:26.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:26.466+0000 7f5e5d000640 1 --2- 172.21.15.152:0/3367856963 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5e38068450 0x7f5e3806a910 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f5e440018b0 tx=0x7f5e44001480 comp rx=0 tx=0).stop 2024-04-17T17:51:26.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:26.466+0000 7f5e5d000640 1 -- 172.21.15.152:0/3367856963 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5e580cd9a0 msgr2=0x7f5e580cde20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:26.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:26.466+0000 7f5e5d000640 1 --2- 172.21.15.152:0/3367856963 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5e580cd9a0 0x7f5e580cde20 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f5e48011990 tx=0x7f5e48011e50 comp rx=0 tx=0).stop 2024-04-17T17:51:26.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:26.466+0000 7f5e5d000640 1 -- 172.21.15.152:0/3367856963 shutdown_connections 2024-04-17T17:51:26.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:26.466+0000 7f5e5d000640 1 --2- 172.21.15.152:0/3367856963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e581f84a0 0x7f5e581f8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:26.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:26.466+0000 7f5e5d000640 1 --2- 172.21.15.152:0/3367856963 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5e580cd9a0 0x7f5e580cde20 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:26.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:26.466+0000 7f5e5d000640 1 --2- 172.21.15.152:0/3367856963 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5e38068450 0x7f5e3806a910 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:26.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:26.466+0000 7f5e5d000640 1 --2- 172.21.15.152:0/3367856963 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5e3c004170 0x7f5e5815cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:26.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:26.466+0000 7f5e5d000640 1 -- 172.21.15.152:0/3367856963 >> 172.21.15.152:0/3367856963 conn(0x7f5e580d4460 msgr2=0x7f5e581601f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:26.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:26.466+0000 7f5e5d000640 1 -- 172.21.15.152:0/3367856963 shutdown_connections 2024-04-17T17:51:26.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:26.466+0000 7f5e5d000640 1 -- 172.21.15.152:0/3367856963 wait complete. 2024-04-17T17:51:26.549 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T17:51:27.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.174+0000 7f75c6800640 1 Processor -- start 2024-04-17T17:51:27.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.174+0000 7f75c6800640 1 -- start start 2024-04-17T17:51:27.183 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.178+0000 7f75c6800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f75c015a100 0x7f75c006f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:27.184 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.178+0000 7f75c6800640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f75c00cc8c0 0x7f75c00ccd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:27.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.182+0000 7f75c6800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75c00cec80 0x7f75c00cf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:27.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.182+0000 7f75c6800640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f75c006faa0 con 0x7f75c00cc8c0 2024-04-17T17:51:27.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.182+0000 7f75c5400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f75c015a100 0x7f75c006f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:27.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.182+0000 7f75c6800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f75c01602d0 con 0x7f75c015a100 2024-04-17T17:51:27.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.182+0000 7f75c4a00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f75c00cc8c0 0x7f75c00ccd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:27.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.182+0000 7f75c6800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f75c01605b0 con 0x7f75c00cec80 2024-04-17T17:51:27.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.182+0000 7f75c4a00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f75c00cc8c0 0x7f75c00ccd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:48048/0 (socket says 172.21.15.152:48048) 2024-04-17T17:51:27.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.182+0000 7f75c4a00640 1 -- 172.21.15.152:0/3833558735 learned_addr learned my addr 172.21.15.152:0/3833558735 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T17:51:27.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.182+0000 7f75c5400640 1 -- 172.21.15.152:0/3833558735 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75c00cec80 msgr2=0x7f75c00cf110 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-17T17:51:27.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.182+0000 7f75c5400640 1 --2- 172.21.15.152:0/3833558735 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75c00cec80 0x7f75c00cf110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:27.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.182+0000 7f75c5400640 1 -- 172.21.15.152:0/3833558735 >> v2:172.21.15.152:3300/0 conn(0x7f75c00cc8c0 msgr2=0x7f75c00ccd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T17:51:27.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.182+0000 7f75c5400640 1 --2- 172.21.15.152:0/3833558735 >> v2:172.21.15.152:3300/0 conn(0x7f75c00cc8c0 0x7f75c00ccd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:27.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.182+0000 7f75c5400640 1 -- 172.21.15.152:0/3833558735 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75c0160890 con 0x7f75c015a100 2024-04-17T17:51:27.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.198+0000 7f75c5400640 1 --2- 172.21.15.152:0/3833558735 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f75c015a100 0x7f75c006f560 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f75c00cec50 tx=0x7f75b401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a41a4b286411e714 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:27.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.198+0000 7f75bfe00640 1 -- 172.21.15.152:0/3833558735 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b40b0070 con 0x7f75c015a100 2024-04-17T17:51:27.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.198+0000 7f75bfe00640 1 -- 172.21.15.152:0/3833558735 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75b40ab600 con 0x7f75c015a100 2024-04-17T17:51:27.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.198+0000 7f75bfe00640 1 -- 172.21.15.152:0/3833558735 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b40ab9d0 con 0x7f75c015a100 2024-04-17T17:51:27.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.202+0000 7f75c6800640 1 -- 172.21.15.152:0/3833558735 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f75c015a100 msgr2=0x7f75c006f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:27.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.202+0000 7f75c6800640 1 --2- 172.21.15.152:0/3833558735 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f75c015a100 0x7f75c006f560 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f75c00cec50 tx=0x7f75b401c4a0 comp rx=0 tx=0).stop 2024-04-17T17:51:27.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.202+0000 7f75c6800640 1 -- 172.21.15.152:0/3833558735 shutdown_connections 2024-04-17T17:51:27.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.202+0000 7f75c6800640 1 --2- 172.21.15.152:0/3833558735 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75c00cec80 0x7f75c00cf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:27.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.202+0000 7f75c6800640 1 --2- 172.21.15.152:0/3833558735 >> v2:172.21.15.152:3300/0 conn(0x7f75c00cc8c0 0x7f75c00ccd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:27.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.202+0000 7f75c6800640 1 --2- 172.21.15.152:0/3833558735 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f75c015a100 0x7f75c006f560 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:27.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.202+0000 7f75c6800640 1 -- 172.21.15.152:0/3833558735 >> 172.21.15.152:0/3833558735 conn(0x7f75c00b3e00 msgr2=0x7f75c00b4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:27.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.202+0000 7f75c6800640 1 -- 172.21.15.152:0/3833558735 shutdown_connections 2024-04-17T17:51:27.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.202+0000 7f75c6800640 1 -- 172.21.15.152:0/3833558735 wait complete. 2024-04-17T17:51:27.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.214+0000 7f75c6800640 1 Processor -- start 2024-04-17T17:51:27.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.214+0000 7f75c6800640 1 -- start start 2024-04-17T17:51:27.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.218+0000 7f75c6800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75c00cc8c0 0x7f75c00c5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:27.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.218+0000 7f75c6800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f75c00cec80 0x7f75c015b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:27.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.218+0000 7f75c6800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75c015a100 0x7f75c00c9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:27.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.218+0000 7f75c6800640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f75c015d910 con 0x7f75c015a100 2024-04-17T17:51:27.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.218+0000 7f75c6800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f75c015d790 con 0x7f75c00cec80 2024-04-17T17:51:27.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.218+0000 7f75c6800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f75c00cfe40 con 0x7f75c00cc8c0 2024-04-17T17:51:27.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.218+0000 7f75c5400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75c00cc8c0 0x7f75c00c5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:27.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.218+0000 7f75c5400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75c00cc8c0 0x7f75c00c5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.152:33800/0 (socket says 172.21.15.152:33800) 2024-04-17T17:51:27.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.218+0000 7f75c5400640 1 -- 172.21.15.152:0/2198108100 learned_addr learned my addr 172.21.15.152:0/2198108100 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T17:51:27.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.218+0000 7f75c5e00640 1 --2- 172.21.15.152:0/2198108100 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75c015a100 0x7f75c00c9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:27.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.222+0000 7f75c4a00640 1 --2- 172.21.15.152:0/2198108100 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f75c00cec80 0x7f75c015b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:27.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.222+0000 7f75c5e00640 1 -- 172.21.15.152:0/2198108100 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75c00cc8c0 msgr2=0x7f75c00c5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:27.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.222+0000 7f75c5e00640 1 --2- 172.21.15.152:0/2198108100 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75c00cc8c0 0x7f75c00c5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:27.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.222+0000 7f75c5e00640 1 -- 172.21.15.152:0/2198108100 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f75c00cec80 msgr2=0x7f75c015b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:27.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.222+0000 7f75c5e00640 1 --2- 172.21.15.152:0/2198108100 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f75c00cec80 0x7f75c015b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:27.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.222+0000 7f75c5e00640 1 -- 172.21.15.152:0/2198108100 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75c00ca020 con 0x7f75c015a100 2024-04-17T17:51:27.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.222+0000 7f75c5e00640 1 --2- 172.21.15.152:0/2198108100 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75c015a100 0x7f75c00c9480 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7f75b800be50 tx=0x7f75b800bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:27.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.222+0000 7f75bd600640 1 -- 172.21.15.152:0/2198108100 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b8019070 con 0x7f75c015a100 2024-04-17T17:51:27.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.222+0000 7f75bd600640 1 -- 172.21.15.152:0/2198108100 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75b8014440 con 0x7f75c015a100 2024-04-17T17:51:27.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.222+0000 7f75bd600640 1 -- 172.21.15.152:0/2198108100 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b8014830 con 0x7f75c015a100 2024-04-17T17:51:27.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.222+0000 7f75c6800640 1 -- 172.21.15.152:0/2198108100 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75c00ca300 con 0x7f75c015a100 2024-04-17T17:51:27.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.222+0000 7f75c6800640 1 -- 172.21.15.152:0/2198108100 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75c00ca8c0 con 0x7f75c015a100 2024-04-17T17:51:27.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.230+0000 7f75c6800640 1 -- 172.21.15.152:0/2198108100 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f759c0052a0 con 0x7f75c015a100 2024-04-17T17:51:27.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.230+0000 7f75bd600640 1 -- 172.21.15.152:0/2198108100 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f75b801c070 con 0x7f75c015a100 2024-04-17T17:51:27.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.238+0000 7f75bd600640 1 --2- 172.21.15.152:0/2198108100 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f75a006c860 0x7f75a006ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:27.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.238+0000 7f75bd600640 1 -- 172.21.15.152:0/2198108100 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6130+0+0 (secure 0 0 0) 0x7f75b8086b40 con 0x7f75c015a100 2024-04-17T17:51:27.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.238+0000 7f75c5400640 1 --2- 172.21.15.152:0/2198108100 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f75a006c860 0x7f75a006ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:27.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.246+0000 7f75c5400640 1 --2- 172.21.15.152:0/2198108100 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f75a006c860 0x7f75a006ed20 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f75b4000c10 tx=0x7f75b40a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:27.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:27.250+0000 7f75bd600640 1 -- 172.21.15.152:0/2198108100 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f75b8056fc0 con 0x7f75c015a100 2024-04-17T17:51:28.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.170+0000 7f75c6800640 1 -- 172.21.15.152:0/2198108100 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f759c005590 con 0x7f75c015a100 2024-04-17T17:51:28.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.238+0000 7f75bd600640 1 -- 172.21.15.152:0/2198108100 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+16959 (secure 0 0 0) 0x7f75b80568c0 con 0x7f75c015a100 2024-04-17T17:51:28.256 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T17:51:28.256 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":40,"fsid":"ce68f82e-ec5f-4205-9fd5-bdfdf6ef31e2","created":"2024-04-17T08:46:08.353546+0000","modified":"2024-04-17T08:48:15.464983+0000","last_up_change":"2024-04-17T08:46:20.738799+0000","last_in_change":"2024-04-17T08:46:11.210050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T08:46:21.386856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-17T08:47:58.148039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-17T08:47:58.612261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"682f0192-187c-404e-bc7a-b6b4e23825e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6819","nonce":3603799291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6823","nonce":3603799291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6831","nonce":3603799291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6827","nonce":3603799291}]},"public_addr":"172.21.15.152:6819/3603799291","cluster_addr":"172.21.15.152:6823/3603799291","heartbeat_back_addr":"172.21.15.152:6831/3603799291","heartbeat_front_addr":"172.21.15.152:6827/3603799291","state":["exists","up"]},{"osd":1,"uuid":"f0fe8fef-60ec-4a39-83b6-2fa6a5adb0f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6801","nonce":4133383142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6803","nonce":4133383142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6807","nonce":4133383142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6805","nonce":4133383142}]},"public_addr":"172.21.15.152:6801/4133383142","cluster_addr":"172.21.15.152:6803/4133383142","heartbeat_back_addr":"172.21.15.152:6807/4133383142","heartbeat_front_addr":"172.21.15.152:6805/4133383142","state":["exists","up"]},{"osd":2,"uuid":"35f36d9c-5245-4431-a618-f4df0fa380ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6809","nonce":3826143898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6811","nonce":3826143898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6815","nonce":3826143898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6813","nonce":3826143898}]},"public_addr":"172.21.15.152:6809/3826143898","cluster_addr":"172.21.15.152:6811/3826143898","heartbeat_back_addr":"172.21.15.152:6815/3826143898","heartbeat_front_addr":"172.21.15.152:6813/3826143898","state":["exists","up"]},{"osd":3,"uuid":"96e56ca5-15b4-4895-9b79-da2c92043159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6818","nonce":165717826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6822","nonce":165717826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6830","nonce":165717826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6826","nonce":165717826}]},"public_addr":"172.21.15.152:6818/165717826","cluster_addr":"172.21.15.152:6822/165717826","heartbeat_back_addr":"172.21.15.152:6830/165717826","heartbeat_front_addr":"172.21.15.152:6826/165717826","state":["exists","up"]},{"osd":4,"uuid":"f5aa10a4-9ff9-41fe-a5c9-15326f982cc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6817","nonce":4080159297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6819","nonce":4080159297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6823","nonce":4080159297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6821","nonce":4080159297}]},"public_addr":"172.21.15.196:6817/4080159297","cluster_addr":"172.21.15.196:6819/4080159297","heartbeat_back_addr":"172.21.15.196:6823/4080159297","heartbeat_front_addr":"172.21.15.196:6821/4080159297","state":["exists","up"]},{"osd":5,"uuid":"42bab884-3476-47ae-ac65-935fa6e0f055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6801","nonce":3519444232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6803","nonce":3519444232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6807","nonce":3519444232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6805","nonce":3519444232}]},"public_addr":"172.21.15.196:6801/3519444232","cluster_addr":"172.21.15.196:6803/3519444232","heartbeat_back_addr":"172.21.15.196:6807/3519444232","heartbeat_front_addr":"172.21.15.196:6805/3519444232","state":["exists","up"]},{"osd":6,"uuid":"460b6167-f57b-4224-9c92-cfc9b80bbe99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6809","nonce":275739834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6811","nonce":275739834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6815","nonce":275739834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6813","nonce":275739834}]},"public_addr":"172.21.15.196:6809/275739834","cluster_addr":"172.21.15.196:6811/275739834","heartbeat_back_addr":"172.21.15.196:6815/275739834","heartbeat_front_addr":"172.21.15.196:6813/275739834","state":["exists","up"]},{"osd":7,"uuid":"d695643f-5e07-4e2a-a646-c06bd97b6650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6825","nonce":307626968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6827","nonce":307626968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6831","nonce":307626968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6829","nonce":307626968}]},"public_addr":"172.21.15.196:6825/307626968","cluster_addr":"172.21.15.196:6827/307626968","heartbeat_back_addr":"172.21.15.196:6831/307626968","heartbeat_front_addr":"172.21.15.196:6829/307626968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.293257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.964533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.248895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.010000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.832554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.743704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930171+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930962+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.31","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T17:51:28.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.258+0000 7f75c6800640 1 -- 172.21.15.152:0/2198108100 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f75a006c860 msgr2=0x7f75a006ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:28.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.258+0000 7f75c6800640 1 --2- 172.21.15.152:0/2198108100 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f75a006c860 0x7f75a006ed20 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f75b4000c10 tx=0x7f75b40a6000 comp rx=0 tx=0).stop 2024-04-17T17:51:28.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.258+0000 7f75c6800640 1 -- 172.21.15.152:0/2198108100 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75c015a100 msgr2=0x7f75c00c9480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:28.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.258+0000 7f75c6800640 1 --2- 172.21.15.152:0/2198108100 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75c015a100 0x7f75c00c9480 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7f75b800be50 tx=0x7f75b800bf40 comp rx=0 tx=0).stop 2024-04-17T17:51:28.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.258+0000 7f75c6800640 1 -- 172.21.15.152:0/2198108100 shutdown_connections 2024-04-17T17:51:28.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.258+0000 7f75c6800640 1 --2- 172.21.15.152:0/2198108100 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75c015a100 0x7f75c00c9480 unknown :-1 s=CLOSED pgs=2038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:28.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.258+0000 7f75c6800640 1 --2- 172.21.15.152:0/2198108100 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f75c00cec80 0x7f75c015b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:28.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.258+0000 7f75c6800640 1 --2- 172.21.15.152:0/2198108100 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f75a006c860 0x7f75a006ed20 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:28.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.258+0000 7f75c6800640 1 --2- 172.21.15.152:0/2198108100 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75c00cc8c0 0x7f75c00c5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:28.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.258+0000 7f75c6800640 1 -- 172.21.15.152:0/2198108100 >> 172.21.15.152:0/2198108100 conn(0x7f75c00b3e00 msgr2=0x7f75c00b3600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:28.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.262+0000 7f75c6800640 1 -- 172.21.15.152:0/2198108100 shutdown_connections 2024-04-17T17:51:28.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.262+0000 7f75c6800640 1 -- 172.21.15.152:0/2198108100 wait complete. 2024-04-17T17:51:28.332 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-17T17:51:28.333 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T17:51:28.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.590+0000 7f7bddc00640 1 Processor -- start 2024-04-17T17:51:28.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.590+0000 7f7bddc00640 1 -- start start 2024-04-17T17:51:28.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.594+0000 7f7bddc00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7bd80b6140 0x7f7bd80cf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:28.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.594+0000 7f7bddc00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bd8163740 con 0x7f7bd80d0770 2024-04-17T17:51:28.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.598+0000 7f7bd7400640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f7bd80d0770 0x7f7bd8162dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:36272/0 (socket says 172.21.15.152:36272) 2024-04-17T17:51:28.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.598+0000 7f7bd7400640 1 -- 172.21.15.152:0/3400499593 learned_addr learned my addr 172.21.15.152:0/3400499593 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T17:51:28.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.598+0000 7f7bddc00640 1 -- 172.21.15.152:0/3400499593 --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bd8163a20 con 0x7f7bd8072bb0 2024-04-17T17:51:28.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.598+0000 7f7bddc00640 1 -- 172.21.15.152:0/3400499593 --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f7bd8163d00 con 0x7f7bd80b6140 2024-04-17T17:51:28.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.598+0000 7f7bd6a00640 1 -- 172.21.15.152:0/3400499593 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1408221577 0 0) 0x7f7bd8163740 con 0x7f7bd80d0770 2024-04-17T17:51:28.601 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.598+0000 7f7bd6a00640 1 -- 172.21.15.152:0/3400499593 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7bbc003530 con 0x7f7bd80d0770 2024-04-17T17:51:28.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.598+0000 7f7bd6a00640 1 -- 172.21.15.152:0/3400499593 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1361651731 0 0) 0x7f7bd8163a20 con 0x7f7bd8072bb0 2024-04-17T17:51:28.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.598+0000 7f7bd6a00640 1 -- 172.21.15.152:0/3400499593 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7bd8163740 con 0x7f7bd8072bb0 2024-04-17T17:51:28.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.598+0000 7f7bd7e00640 1 --2- 172.21.15.152:0/3400499593 >> v2:172.21.15.152:3300/0 conn(0x7f7bd80b6140 0x7f7bd80cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:28.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.598+0000 7f7bd6a00640 1 -- 172.21.15.152:0/3400499593 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3926610807 0 0) 0x7f7bbc003530 con 0x7f7bd80d0770 2024-04-17T17:51:28.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.598+0000 7f7bd6a00640 1 -- 172.21.15.152:0/3400499593 >> v2:172.21.15.152:3300/0 conn(0x7f7bd80b6140 msgr2=0x7f7bd80cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T17:51:28.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.598+0000 7f7bd6a00640 1 --2- 172.21.15.152:0/3400499593 >> v2:172.21.15.152:3300/0 conn(0x7f7bd80b6140 0x7f7bd80cf610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:28.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.598+0000 7f7bd6a00640 1 -- 172.21.15.152:0/3400499593 >> v1:172.21.15.196:6789/0 conn(0x7f7bd8072bb0 legacy=0x7f7bd80b4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:28.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.598+0000 7f7bd6a00640 1 -- 172.21.15.152:0/3400499593 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bd80cee10 con 0x7f7bd80d0770 2024-04-17T17:51:28.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.598+0000 7f7bd6a00640 1 -- 172.21.15.152:0/3400499593 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2973887244 0 0) 0x7f7bc4001680 con 0x7f7bd80d0770 2024-04-17T17:51:28.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.598+0000 7f7bd6a00640 1 -- 172.21.15.152:0/3400499593 >> v1:172.21.15.152:6789/0 conn(0x7f7bd80d0770 legacy=0x7f7bd8162dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:28.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.598+0000 7f7bd6a00640 1 --2- 172.21.15.152:0/3400499593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7bbc003ba0 0x7f7bbc003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:28.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.598+0000 7f7bd6a00640 1 --2- 172.21.15.152:0/3400499593 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7bbc004810 0x7f7bbc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:28.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.598+0000 7f7bd6a00640 1 --2- 172.21.15.152:0/3400499593 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7bbc0053d0 0x7f7bbc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:28.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.598+0000 7f7bd6a00640 1 -- 172.21.15.152:0/3400499593 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd8163d00 con 0x7f7bbc003ba0 2024-04-17T17:51:28.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.598+0000 7f7bd6a00640 1 -- 172.21.15.152:0/3400499593 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f7bbc00c2f0 con 0x7f7bbc004810 2024-04-17T17:51:28.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.598+0000 7f7bd6a00640 1 -- 172.21.15.152:0/3400499593 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f7bbc00c4f0 con 0x7f7bbc0053d0 2024-04-17T17:51:28.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.598+0000 7f7bd7e00640 1 --2- 172.21.15.152:0/3400499593 >> v2:172.21.15.152:3300/0 conn(0x7f7bd80b6140 0x7f7bd80cf610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T17:51:28.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.598+0000 7f7bd7400640 1 --2- 172.21.15.152:0/3400499593 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7bbc004810 0x7f7bbc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:28.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.602+0000 7f7bd7400640 1 -- 172.21.15.152:0/3400499593 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7bbc0053d0 msgr2=0x7f7bbc00ba10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-17T17:51:28.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.602+0000 7f7bd7400640 1 --2- 172.21.15.152:0/3400499593 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7bbc0053d0 0x7f7bbc00ba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:28.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.602+0000 7f7bd7400640 1 -- 172.21.15.152:0/3400499593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7bbc003ba0 msgr2=0x7f7bbc003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T17:51:28.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.602+0000 7f7bd7400640 1 --2- 172.21.15.152:0/3400499593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7bbc003ba0 0x7f7bbc003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:28.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.602+0000 7f7bd7400640 1 -- 172.21.15.152:0/3400499593 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bbc003530 con 0x7f7bbc004810 2024-04-17T17:51:28.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.602+0000 7f7bdd200640 1 -- 172.21.15.152:0/3400499593 reap_dead start 2024-04-17T17:51:28.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.606+0000 7f7bd7400640 1 --2- 172.21.15.152:0/3400499593 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7bbc004810 0x7f7bbc004c90 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f7bc4007fc0 tx=0x7f7bc401cb60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d5bf9970d511940 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:28.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.606+0000 7f7bd6a00640 1 -- 172.21.15.152:0/3400499593 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc4007c10 con 0x7f7bbc004810 2024-04-17T17:51:28.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.606+0000 7f7bd6a00640 1 -- 172.21.15.152:0/3400499593 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bc40a9070 con 0x7f7bbc004810 2024-04-17T17:51:28.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.606+0000 7f7bd6a00640 1 -- 172.21.15.152:0/3400499593 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc4005d60 con 0x7f7bbc004810 2024-04-17T17:51:28.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.606+0000 7f7bddc00640 1 -- 172.21.15.152:0/3400499593 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7bbc004810 msgr2=0x7f7bbc004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:28.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.606+0000 7f7bddc00640 1 --2- 172.21.15.152:0/3400499593 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7bbc004810 0x7f7bbc004c90 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f7bc4007fc0 tx=0x7f7bc401cb60 comp rx=0 tx=0).stop 2024-04-17T17:51:28.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.610+0000 7f7bddc00640 1 -- 172.21.15.152:0/3400499593 shutdown_connections 2024-04-17T17:51:28.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.610+0000 7f7bddc00640 1 --2- 172.21.15.152:0/3400499593 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7bbc004810 0x7f7bbc004c90 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:28.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.610+0000 7f7bddc00640 1 -- 172.21.15.152:0/3400499593 >> 172.21.15.152:0/3400499593 conn(0x7f7bd80d12e0 msgr2=0x7f7bd80d16f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:28.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.610+0000 7f7bddc00640 1 -- 172.21.15.152:0/3400499593 shutdown_connections 2024-04-17T17:51:28.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.610+0000 7f7bddc00640 1 -- 172.21.15.152:0/3400499593 wait complete. 2024-04-17T17:51:28.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.614+0000 7f7bddc00640 1 Processor -- start 2024-04-17T17:51:28.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.614+0000 7f7bddc00640 1 -- start start 2024-04-17T17:51:28.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.618+0000 7f7bddc00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7bd81fbbd0 0x7f7bd81f1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:28.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.618+0000 7f7bddc00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7bd80c64b0 0x7f7bd81f04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:28.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.618+0000 7f7bddc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7bd806ea90 0x7f7bd806ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:28.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.618+0000 7f7bddc00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd80cf180 con 0x7f7bd81fbbd0 2024-04-17T17:51:28.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.618+0000 7f7bddc00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd80cfc10 con 0x7f7bd80c64b0 2024-04-17T17:51:28.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.618+0000 7f7bddc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f7bd80b4180 con 0x7f7bd806ea90 2024-04-17T17:51:28.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.622+0000 7f7bd7e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7bd81fbbd0 0x7f7bd81f1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:28.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.622+0000 7f7bd7e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7bd81fbbd0 0x7f7bd81f1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33676/0 (socket says 172.21.15.152:33676) 2024-04-17T17:51:28.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.622+0000 7f7bd7e00640 1 -- 172.21.15.152:0/1128675511 learned_addr learned my addr 172.21.15.152:0/1128675511 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T17:51:28.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.622+0000 7f7bd7400640 1 --2- 172.21.15.152:0/1128675511 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7bd80c64b0 0x7f7bd81f04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:28.628 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.626+0000 7f7bdd200640 1 --2- 172.21.15.152:0/1128675511 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7bd806ea90 0x7f7bd806ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:28.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.626+0000 7f7bdd200640 1 -- 172.21.15.152:0/1128675511 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7bd80c64b0 msgr2=0x7f7bd81f04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:28.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.626+0000 7f7bdd200640 1 --2- 172.21.15.152:0/1128675511 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7bd80c64b0 0x7f7bd81f04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:28.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.626+0000 7f7bdd200640 1 -- 172.21.15.152:0/1128675511 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7bd81fbbd0 msgr2=0x7f7bd81f1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:28.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.626+0000 7f7bdd200640 1 --2- 172.21.15.152:0/1128675511 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7bd81fbbd0 0x7f7bd81f1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:28.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.626+0000 7f7bdd200640 1 -- 172.21.15.152:0/1128675511 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bd81f0cf0 con 0x7f7bd806ea90 2024-04-17T17:51:28.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.626+0000 7f7bdd200640 1 --2- 172.21.15.152:0/1128675511 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7bd806ea90 0x7f7bd806ef10 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8071150 tx=0x7f7bd000cb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:28.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.626+0000 7f7bcfe00640 1 -- 172.21.15.152:0/1128675511 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd0017070 con 0x7f7bd806ea90 2024-04-17T17:51:28.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.630+0000 7f7bcfe00640 1 -- 172.21.15.152:0/1128675511 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bd0005d90 con 0x7f7bd806ea90 2024-04-17T17:51:28.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.630+0000 7f7bcfe00640 1 -- 172.21.15.152:0/1128675511 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd000a7f0 con 0x7f7bd806ea90 2024-04-17T17:51:28.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.630+0000 7f7bddc00640 1 -- 172.21.15.152:0/1128675511 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bd81f0fd0 con 0x7f7bd806ea90 2024-04-17T17:51:28.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.630+0000 7f7bddc00640 1 -- 172.21.15.152:0/1128675511 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bd81f1590 con 0x7f7bd806ea90 2024-04-17T17:51:28.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.638+0000 7f7bcfe00640 1 -- 172.21.15.152:0/1128675511 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7bd000a990 con 0x7f7bd806ea90 2024-04-17T17:51:28.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.638+0000 7f7bddc00640 1 -- 172.21.15.152:0/1128675511 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bd8075be0 con 0x7f7bd806ea90 2024-04-17T17:51:28.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.642+0000 7f7bcfe00640 1 --2- 172.21.15.152:0/1128675511 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f7bb80683d0 0x7f7bb806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:28.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.642+0000 7f7bcfe00640 1 -- 172.21.15.152:0/1128675511 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(40..40 src has 1..40) ==== 6130+0+0 (secure 0 0 0) 0x7f7bd0085d80 con 0x7f7bd806ea90 2024-04-17T17:51:28.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.646+0000 7f7bd7e00640 1 --2- 172.21.15.152:0/1128675511 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f7bb80683d0 0x7f7bb806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:28.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.646+0000 7f7bd7e00640 1 --2- 172.21.15.152:0/1128675511 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f7bb80683d0 0x7f7bb806a890 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f7bc8006fd0 tx=0x7f7bc8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:28.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:28.650+0000 7f7bcfe00640 1 -- 172.21.15.152:0/1128675511 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f7bd0055b90 con 0x7f7bd806ea90 2024-04-17T17:51:29.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:29.678+0000 7f7bddc00640 1 -- 172.21.15.152:0/1128675511 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7bd80b15e0 con 0x7f7bd806ea90 2024-04-17T17:51:29.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:29.762+0000 7f7bcfe00640 1 -- 172.21.15.152:0/1128675511 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5211 (secure 0 0 0) 0x7f7bd0087020 con 0x7f7bd806ea90 2024-04-17T17:51:29.776 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T17:51:29.776 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4973,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6835/1356093111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6833","nonce":1356093111},{"type":"v1","addr":"172.21.15.196:6835","nonce":1356093111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4982,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1048040532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1048040532},{"type":"v1","addr":"172.21.15.152:6837","nonce":1048040532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5275,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6834/2151645018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":2151645018},{"type":"v1","addr":"172.21.15.196:6834","nonce":2151645018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-17T08:47:59.653400+0000","modified":"2024-04-17T08:48:02.688952+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5508":{"gid":5508,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6835/4144515289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":4144515289},{"type":"v1","addr":"172.21.15.152:6835","nonce":4144515289}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5508,"qdb_cluster":[5508]},"id":2}]} 2024-04-17T17:51:29.776 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 18 2024-04-17T17:51:29.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:29.774+0000 7f7bddc00640 1 -- 172.21.15.152:0/1128675511 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f7bb80683d0 msgr2=0x7f7bb806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:29.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:29.774+0000 7f7bddc00640 1 --2- 172.21.15.152:0/1128675511 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f7bb80683d0 0x7f7bb806a890 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f7bc8006fd0 tx=0x7f7bc8008040 comp rx=0 tx=0).stop 2024-04-17T17:51:29.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:29.774+0000 7f7bddc00640 1 -- 172.21.15.152:0/1128675511 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7bd806ea90 msgr2=0x7f7bd806ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:29.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:29.774+0000 7f7bddc00640 1 --2- 172.21.15.152:0/1128675511 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7bd806ea90 0x7f7bd806ef10 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8071150 tx=0x7f7bd000cb90 comp rx=0 tx=0).stop 2024-04-17T17:51:29.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:29.774+0000 7f7bddc00640 1 -- 172.21.15.152:0/1128675511 shutdown_connections 2024-04-17T17:51:29.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:29.774+0000 7f7bddc00640 1 --2- 172.21.15.152:0/1128675511 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f7bb80683d0 0x7f7bb806a890 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:29.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:29.774+0000 7f7bddc00640 1 --2- 172.21.15.152:0/1128675511 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7bd806ea90 0x7f7bd806ef10 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:29.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:29.774+0000 7f7bddc00640 1 --2- 172.21.15.152:0/1128675511 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7bd80c64b0 0x7f7bd81f04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:29.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:29.774+0000 7f7bddc00640 1 --2- 172.21.15.152:0/1128675511 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7bd81fbbd0 0x7f7bd81f1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:29.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:29.774+0000 7f7bddc00640 1 -- 172.21.15.152:0/1128675511 >> 172.21.15.152:0/1128675511 conn(0x7f7bd80d12e0 msgr2=0x7f7bd80b0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:29.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:29.786+0000 7f7bddc00640 1 -- 172.21.15.152:0/1128675511 shutdown_connections 2024-04-17T17:51:29.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:29.786+0000 7f7bddc00640 1 -- 172.21.15.152:0/1128675511 wait complete. 2024-04-17T17:51:29.826 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T17:51:29.855 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:51:29.874 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:51:30.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.354+0000 7f69cc200640 1 Processor -- start 2024-04-17T17:51:30.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.358+0000 7f69cc200640 1 -- start start 2024-04-17T17:51:30.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.358+0000 7f69cc200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f69c40d0b20 0x7f69c41651f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:30.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.358+0000 7f69cc200640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69c406de00 con 0x7f69c415b840 2024-04-17T17:51:30.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.358+0000 7f69cc200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69c406e0e0 con 0x7f69c4154ce0 2024-04-17T17:51:30.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.358+0000 7f69cc200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f69c41550c0 con 0x7f69c40d0b20 2024-04-17T17:51:30.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.358+0000 7f69c9800640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f69c4154ce0 0x7f69c4072610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.152:53758/0 (socket says 172.21.15.152:53758) 2024-04-17T17:51:30.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.358+0000 7f69c9800640 1 -- 172.21.15.152:0/2018688373 learned_addr learned my addr 172.21.15.152:0/2018688373 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T17:51:30.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.358+0000 7f69ca200640 1 --2- 172.21.15.152:0/2018688373 >> v2:172.21.15.196:3300/0 conn(0x7f69c40d0b20 0x7f69c41651f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:30.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.358+0000 7f69ca200640 1 -- 172.21.15.152:0/2018688373 >> v1:172.21.15.196:6789/0 conn(0x7f69c4154ce0 legacy=0x7f69c4072610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T17:51:30.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.358+0000 7f69ca200640 1 -- 172.21.15.152:0/2018688373 >> v1:172.21.15.152:6789/0 conn(0x7f69c415b840 legacy=0x7f69c40d0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T17:51:30.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.358+0000 7f69ca200640 1 -- 172.21.15.152:0/2018688373 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69c406e3c0 con 0x7f69c40d0b20 2024-04-17T17:51:30.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.362+0000 7f69ca200640 1 --2- 172.21.15.152:0/2018688373 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f69c40d0b20 0x7f69c41651f0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f69bc009d90 tx=0x7f69bc01c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d3bae357d6828ca server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:30.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.362+0000 7f69c3e00640 1 -- 172.21.15.152:0/2018688373 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69bc0b2070 con 0x7f69c40d0b20 2024-04-17T17:51:30.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.366+0000 7f69c3e00640 1 -- 172.21.15.152:0/2018688373 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69bc0a59d0 con 0x7f69c40d0b20 2024-04-17T17:51:30.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.366+0000 7f69c3e00640 1 -- 172.21.15.152:0/2018688373 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69bc0a5da0 con 0x7f69c40d0b20 2024-04-17T17:51:30.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.366+0000 7f69cc200640 1 -- 172.21.15.152:0/2018688373 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f69c40d0b20 msgr2=0x7f69c41651f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:30.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.366+0000 7f69cc200640 1 --2- 172.21.15.152:0/2018688373 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f69c40d0b20 0x7f69c41651f0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f69bc009d90 tx=0x7f69bc01c8f0 comp rx=0 tx=0).stop 2024-04-17T17:51:30.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.366+0000 7f69cc200640 1 -- 172.21.15.152:0/2018688373 shutdown_connections 2024-04-17T17:51:30.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.366+0000 7f69cc200640 1 --2- 172.21.15.152:0/2018688373 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f69c40d0b20 0x7f69c41651f0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:30.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.366+0000 7f69cc200640 1 -- 172.21.15.152:0/2018688373 >> 172.21.15.152:0/2018688373 conn(0x7f69c40b3350 msgr2=0x7f69c40b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:30.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.366+0000 7f69cc200640 1 -- 172.21.15.152:0/2018688373 shutdown_connections 2024-04-17T17:51:30.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.366+0000 7f69cc200640 1 -- 172.21.15.152:0/2018688373 wait complete. 2024-04-17T17:51:30.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.366+0000 7f69cc200640 1 Processor -- start 2024-04-17T17:51:30.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.370+0000 7f69cc200640 1 -- start start 2024-04-17T17:51:30.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.370+0000 7f69cc200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69c40d0b20 0x7f69c4149480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:30.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.370+0000 7f69cc200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f69c4154ce0 0x7f69c4147ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:30.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.370+0000 7f69cc200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f69c415b840 0x7f69c4164b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:30.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.370+0000 7f69cc200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f69c4167f50 con 0x7f69c40d0b20 2024-04-17T17:51:30.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.370+0000 7f69cc200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f69c406ff00 con 0x7f69c4154ce0 2024-04-17T17:51:30.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.370+0000 7f69cc200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f69c41680d0 con 0x7f69c415b840 2024-04-17T17:51:30.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.370+0000 7f69c8e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f69c4154ce0 0x7f69c4147ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:30.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.370+0000 7f69ca200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f69c415b840 0x7f69c4164b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:30.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.370+0000 7f69c8e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f69c4154ce0 0x7f69c4147ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.152:41928/0 (socket says 172.21.15.152:41928) 2024-04-17T17:51:30.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.370+0000 7f69c8e00640 1 -- 172.21.15.152:0/4046656941 learned_addr learned my addr 172.21.15.152:0/4046656941 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T17:51:30.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.370+0000 7f69c9800640 1 --2- 172.21.15.152:0/4046656941 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69c40d0b20 0x7f69c4149480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:30.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.370+0000 7f69c8e00640 1 -- 172.21.15.152:0/4046656941 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f69c415b840 msgr2=0x7f69c4164b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:30.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.370+0000 7f69c8e00640 1 --2- 172.21.15.152:0/4046656941 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f69c415b840 0x7f69c4164b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:30.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.370+0000 7f69c8e00640 1 -- 172.21.15.152:0/4046656941 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69c40d0b20 msgr2=0x7f69c4149480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:30.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.370+0000 7f69c8e00640 1 --2- 172.21.15.152:0/4046656941 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69c40d0b20 0x7f69c4149480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:30.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.370+0000 7f69c8e00640 1 -- 172.21.15.152:0/4046656941 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69c41499c0 con 0x7f69c4154ce0 2024-04-17T17:51:30.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.370+0000 7f69c9800640 1 --2- 172.21.15.152:0/4046656941 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69c40d0b20 0x7f69c4149480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T17:51:30.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.374+0000 7f69c8e00640 1 --2- 172.21.15.152:0/4046656941 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f69c4154ce0 0x7f69c4147ae0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f69b000b410 tx=0x7f69b000b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:30.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.374+0000 7f69c1600640 1 -- 172.21.15.152:0/4046656941 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b0015020 con 0x7f69c4154ce0 2024-04-17T17:51:30.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.374+0000 7f69cc200640 1 -- 172.21.15.152:0/4046656941 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69c41483e0 con 0x7f69c4154ce0 2024-04-17T17:51:30.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.374+0000 7f69c1600640 1 -- 172.21.15.152:0/4046656941 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69b0011830 con 0x7f69c4154ce0 2024-04-17T17:51:30.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.374+0000 7f69c1600640 1 -- 172.21.15.152:0/4046656941 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b0011c20 con 0x7f69c4154ce0 2024-04-17T17:51:30.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.374+0000 7f69cc200640 1 -- 172.21.15.152:0/4046656941 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69c41489a0 con 0x7f69c4154ce0 2024-04-17T17:51:30.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.378+0000 7f69c1600640 1 -- 172.21.15.152:0/4046656941 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f69b0018020 con 0x7f69c4154ce0 2024-04-17T17:51:30.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.378+0000 7f69c1600640 1 --2- 172.21.15.152:0/4046656941 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f69a4068450 0x7f69a406a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:30.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.378+0000 7f69c1600640 1 -- 172.21.15.152:0/4046656941 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6130+0+0 (secure 0 0 0) 0x7f69b0086a50 con 0x7f69c4154ce0 2024-04-17T17:51:30.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.382+0000 7f69c9800640 1 --2- 172.21.15.152:0/4046656941 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f69a4068450 0x7f69a406a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:30.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.382+0000 7f69c9800640 1 --2- 172.21.15.152:0/4046656941 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f69a4068450 0x7f69a406a910 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f69b8007fd0 tx=0x7f69b8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:30.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.382+0000 7f69cc200640 1 -- 172.21.15.152:0/4046656941 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69a00052a0 con 0x7f69c4154ce0 2024-04-17T17:51:30.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:30.390+0000 7f69c1600640 1 -- 172.21.15.152:0/4046656941 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f69b001f020 con 0x7f69c4154ce0 2024-04-17T17:51:31.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:31.578+0000 7f69cc200640 1 -- 172.21.15.152:0/4046656941 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f69a0005590 con 0x7f69c4154ce0 2024-04-17T17:51:31.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:31.582+0000 7f69c1600640 1 -- 172.21.15.152:0/4046656941 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5211 (secure 0 0 0) 0x7f69b0056db0 con 0x7f69c4154ce0 2024-04-17T17:51:31.588 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T17:51:31.588 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4973,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6835/1356093111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6833","nonce":1356093111},{"type":"v1","addr":"172.21.15.196:6835","nonce":1356093111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4982,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1048040532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1048040532},{"type":"v1","addr":"172.21.15.152:6837","nonce":1048040532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5275,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6834/2151645018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":2151645018},{"type":"v1","addr":"172.21.15.196:6834","nonce":2151645018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-17T08:47:59.653400+0000","modified":"2024-04-17T08:48:02.688952+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5508":{"gid":5508,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6835/4144515289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":4144515289},{"type":"v1","addr":"172.21.15.152:6835","nonce":4144515289}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5508,"qdb_cluster":[5508]},"id":2}]} 2024-04-17T17:51:31.589 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 18 2024-04-17T17:51:31.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:31.590+0000 7f69cc200640 1 -- 172.21.15.152:0/4046656941 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f69a4068450 msgr2=0x7f69a406a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:31.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:31.590+0000 7f69cc200640 1 --2- 172.21.15.152:0/4046656941 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f69a4068450 0x7f69a406a910 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f69b8007fd0 tx=0x7f69b8009040 comp rx=0 tx=0).stop 2024-04-17T17:51:31.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:31.594+0000 7f69cc200640 1 -- 172.21.15.152:0/4046656941 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f69c4154ce0 msgr2=0x7f69c4147ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:31.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:31.594+0000 7f69cc200640 1 --2- 172.21.15.152:0/4046656941 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f69c4154ce0 0x7f69c4147ae0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f69b000b410 tx=0x7f69b000b8d0 comp rx=0 tx=0).stop 2024-04-17T17:51:31.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:31.594+0000 7f69cc200640 1 -- 172.21.15.152:0/4046656941 shutdown_connections 2024-04-17T17:51:31.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:31.594+0000 7f69cc200640 1 --2- 172.21.15.152:0/4046656941 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f69a4068450 0x7f69a406a910 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:31.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:31.594+0000 7f69cc200640 1 --2- 172.21.15.152:0/4046656941 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f69c415b840 0x7f69c4164b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:31.597 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:31.594+0000 7f69cc200640 1 --2- 172.21.15.152:0/4046656941 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f69c4154ce0 0x7f69c4147ae0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:31.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:31.594+0000 7f69cc200640 1 --2- 172.21.15.152:0/4046656941 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69c40d0b20 0x7f69c4149480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:31.598 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:31.594+0000 7f69cc200640 1 -- 172.21.15.152:0/4046656941 >> 172.21.15.152:0/4046656941 conn(0x7f69c40b3350 msgr2=0x7f69c41533e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:31.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:31.614+0000 7f69cc200640 1 -- 172.21.15.152:0/4046656941 shutdown_connections 2024-04-17T17:51:31.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:31.618+0000 7f69cc200640 1 -- 172.21.15.152:0/4046656941 wait complete. 2024-04-17T17:51:31.661 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T17:51:32.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.270+0000 7f2716000640 1 Processor -- start 2024-04-17T17:51:32.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.270+0000 7f2716000640 1 -- start start 2024-04-17T17:51:32.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.274+0000 7f2716000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f271006e730 0x7f271006ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:32.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.274+0000 7f2716000640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f271006f140 0x7f271006c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:32.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.274+0000 7f2716000640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27100af2b0 con 0x7f271015eb60 2024-04-17T17:51:32.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.274+0000 7f2716000640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f27100af090 con 0x7f271006f140 2024-04-17T17:51:32.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.274+0000 7f2716000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f27100afb50 con 0x7f271006e730 2024-04-17T17:51:32.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.278+0000 7f270f400640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f271015eb60 0x7f27100ae980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:36286/0 (socket says 172.21.15.152:36286) 2024-04-17T17:51:32.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.278+0000 7f270f400640 1 -- 172.21.15.152:0/1201625333 learned_addr learned my addr 172.21.15.152:0/1201625333 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T17:51:32.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.278+0000 7f270fe00640 1 --2- 172.21.15.152:0/1201625333 >> v2:172.21.15.152:3300/0 conn(0x7f271006f140 0x7f271006c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:32.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.278+0000 7f2706a00640 1 --2- 172.21.15.152:0/1201625333 >> v2:172.21.15.196:3300/0 conn(0x7f271006e730 0x7f271006ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:32.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.278+0000 7f2706a00640 1 -- 172.21.15.152:0/1201625333 >> v2:172.21.15.152:3300/0 conn(0x7f271006f140 msgr2=0x7f271006c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T17:51:32.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.278+0000 7f2706a00640 1 --2- 172.21.15.152:0/1201625333 >> v2:172.21.15.152:3300/0 conn(0x7f271006f140 0x7f271006c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:32.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.278+0000 7f2706a00640 1 -- 172.21.15.152:0/1201625333 >> v1:172.21.15.152:6789/0 conn(0x7f271015eb60 legacy=0x7f27100ae980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:32.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.278+0000 7f2706a00640 1 -- 172.21.15.152:0/1201625333 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27100af590 con 0x7f271006e730 2024-04-17T17:51:32.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.282+0000 7f2706a00640 1 --2- 172.21.15.152:0/1201625333 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f271006e730 0x7f271006ec00 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f27100741f0 tx=0x7f26f801e690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d80a291ba5fca430 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:32.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.282+0000 7f270ea00640 1 -- 172.21.15.152:0/1201625333 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f80ac600 con 0x7f271006e730 2024-04-17T17:51:32.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.282+0000 7f270ea00640 1 -- 172.21.15.152:0/1201625333 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26f80b1070 con 0x7f271006e730 2024-04-17T17:51:32.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.282+0000 7f270ea00640 1 -- 172.21.15.152:0/1201625333 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f80ac9c0 con 0x7f271006e730 2024-04-17T17:51:32.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.286+0000 7f2716000640 1 -- 172.21.15.152:0/1201625333 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f271006e730 msgr2=0x7f271006ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:32.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.286+0000 7f2716000640 1 --2- 172.21.15.152:0/1201625333 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f271006e730 0x7f271006ec00 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f27100741f0 tx=0x7f26f801e690 comp rx=0 tx=0).stop 2024-04-17T17:51:32.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.286+0000 7f2716000640 1 -- 172.21.15.152:0/1201625333 shutdown_connections 2024-04-17T17:51:32.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.286+0000 7f2716000640 1 --2- 172.21.15.152:0/1201625333 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f271006e730 0x7f271006ec00 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:32.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.286+0000 7f2716000640 1 --2- 172.21.15.152:0/1201625333 >> v2:172.21.15.152:3300/0 conn(0x7f271006f140 0x7f271006c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:32.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.286+0000 7f2716000640 1 -- 172.21.15.152:0/1201625333 >> 172.21.15.152:0/1201625333 conn(0x7f2710072140 msgr2=0x7f27100b4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:32.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.290+0000 7f2716000640 1 -- 172.21.15.152:0/1201625333 shutdown_connections 2024-04-17T17:51:32.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.290+0000 7f2716000640 1 -- 172.21.15.152:0/1201625333 wait complete. 2024-04-17T17:51:32.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.298+0000 7f2716000640 1 Processor -- start 2024-04-17T17:51:32.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.298+0000 7f2716000640 1 -- start start 2024-04-17T17:51:32.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.306+0000 7f2716000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f271006e730 0x7f271009ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:32.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.306+0000 7f2716000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f271006f140 0x7f2710099520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:32.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.306+0000 7f2716000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f271015eb60 0x7f2710099a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:32.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.306+0000 7f2716000640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f271006d150 con 0x7f271015eb60 2024-04-17T17:51:32.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.310+0000 7f2716000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f271006cfd0 con 0x7f271006f140 2024-04-17T17:51:32.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.310+0000 7f2716000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f271006d2d0 con 0x7f271006e730 2024-04-17T17:51:32.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.310+0000 7f270f400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f271006e730 0x7f271009ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:32.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.310+0000 7f2706a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f271006f140 0x7f2710099520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:32.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.310+0000 7f2706a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f271006f140 0x7f2710099520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.152:41944/0 (socket says 172.21.15.152:41944) 2024-04-17T17:51:32.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.310+0000 7f2706a00640 1 -- 172.21.15.152:0/736857205 learned_addr learned my addr 172.21.15.152:0/736857205 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T17:51:32.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.310+0000 7f270fe00640 1 --2- 172.21.15.152:0/736857205 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f271015eb60 0x7f2710099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:32.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.310+0000 7f2706a00640 1 -- 172.21.15.152:0/736857205 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f271006e730 msgr2=0x7f271009ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:32.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.310+0000 7f2706a00640 1 --2- 172.21.15.152:0/736857205 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f271006e730 0x7f271009ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:32.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.310+0000 7f2706a00640 1 -- 172.21.15.152:0/736857205 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f271015eb60 msgr2=0x7f2710099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:32.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.310+0000 7f2706a00640 1 --2- 172.21.15.152:0/736857205 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f271015eb60 0x7f2710099a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:32.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.310+0000 7f2706a00640 1 -- 172.21.15.152:0/736857205 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2710151600 con 0x7f271006f140 2024-04-17T17:51:32.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.310+0000 7f270fe00640 1 --2- 172.21.15.152:0/736857205 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f271015eb60 0x7f2710099a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T17:51:32.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.310+0000 7f2706a00640 1 --2- 172.21.15.152:0/736857205 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f271006f140 0x7f2710099520 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f26f80ae040 tx=0x7f26f801ced0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:32.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.310+0000 7f2707e00640 1 -- 172.21.15.152:0/736857205 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f8006e20 con 0x7f271006f140 2024-04-17T17:51:32.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.310+0000 7f2707e00640 1 -- 172.21.15.152:0/736857205 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26f80be070 con 0x7f271006f140 2024-04-17T17:51:32.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.310+0000 7f2707e00640 1 -- 172.21.15.152:0/736857205 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f80b5a90 con 0x7f271006f140 2024-04-17T17:51:32.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.310+0000 7f2716000640 1 -- 172.21.15.152:0/736857205 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f271009d800 con 0x7f271006f140 2024-04-17T17:51:32.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.310+0000 7f2716000640 1 -- 172.21.15.152:0/736857205 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f271009ddc0 con 0x7f271006f140 2024-04-17T17:51:32.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.314+0000 7f2707e00640 1 -- 172.21.15.152:0/736857205 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f26f80ab070 con 0x7f271006f140 2024-04-17T17:51:32.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.314+0000 7f2707e00640 1 --2- 172.21.15.152:0/736857205 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f26ec068380 0x7f26ec06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:32.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.314+0000 7f2707e00640 1 -- 172.21.15.152:0/736857205 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6130+0+0 (secure 0 0 0) 0x7f26f8120c50 con 0x7f271006f140 2024-04-17T17:51:32.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.318+0000 7f270f400640 1 --2- 172.21.15.152:0/736857205 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f26ec068380 0x7f26ec06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:32.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.318+0000 7f2716000640 1 -- 172.21.15.152:0/736857205 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27101517d0 con 0x7f271006f140 2024-04-17T17:51:32.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.322+0000 7f270f400640 1 --2- 172.21.15.152:0/736857205 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f26ec068380 0x7f26ec06a840 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f2700000f70 tx=0x7f2700007e90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:32.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:32.326+0000 7f2707e00640 1 -- 172.21.15.152:0/736857205 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f26f8018280 con 0x7f271006f140 2024-04-17T17:51:33.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:33.194+0000 7f2716000640 1 -- 172.21.15.152:0/736857205 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2710157b30 con 0x7f271006f140 2024-04-17T17:51:34.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.174+0000 7f2707e00640 1 -- 172.21.15.152:0/736857205 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+16959 (secure 0 0 0) 0x7f26f80f0fc0 con 0x7f271006f140 2024-04-17T17:51:34.178 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T17:51:34.179 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":40,"fsid":"ce68f82e-ec5f-4205-9fd5-bdfdf6ef31e2","created":"2024-04-17T08:46:08.353546+0000","modified":"2024-04-17T08:48:15.464983+0000","last_up_change":"2024-04-17T08:46:20.738799+0000","last_in_change":"2024-04-17T08:46:11.210050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T08:46:21.386856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-17T08:47:58.148039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-17T08:47:58.612261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"682f0192-187c-404e-bc7a-b6b4e23825e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6819","nonce":3603799291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6823","nonce":3603799291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6831","nonce":3603799291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6827","nonce":3603799291}]},"public_addr":"172.21.15.152:6819/3603799291","cluster_addr":"172.21.15.152:6823/3603799291","heartbeat_back_addr":"172.21.15.152:6831/3603799291","heartbeat_front_addr":"172.21.15.152:6827/3603799291","state":["exists","up"]},{"osd":1,"uuid":"f0fe8fef-60ec-4a39-83b6-2fa6a5adb0f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6801","nonce":4133383142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6803","nonce":4133383142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6807","nonce":4133383142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6805","nonce":4133383142}]},"public_addr":"172.21.15.152:6801/4133383142","cluster_addr":"172.21.15.152:6803/4133383142","heartbeat_back_addr":"172.21.15.152:6807/4133383142","heartbeat_front_addr":"172.21.15.152:6805/4133383142","state":["exists","up"]},{"osd":2,"uuid":"35f36d9c-5245-4431-a618-f4df0fa380ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6809","nonce":3826143898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6811","nonce":3826143898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6815","nonce":3826143898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6813","nonce":3826143898}]},"public_addr":"172.21.15.152:6809/3826143898","cluster_addr":"172.21.15.152:6811/3826143898","heartbeat_back_addr":"172.21.15.152:6815/3826143898","heartbeat_front_addr":"172.21.15.152:6813/3826143898","state":["exists","up"]},{"osd":3,"uuid":"96e56ca5-15b4-4895-9b79-da2c92043159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6818","nonce":165717826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6822","nonce":165717826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6830","nonce":165717826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6826","nonce":165717826}]},"public_addr":"172.21.15.152:6818/165717826","cluster_addr":"172.21.15.152:6822/165717826","heartbeat_back_addr":"172.21.15.152:6830/165717826","heartbeat_front_addr":"172.21.15.152:6826/165717826","state":["exists","up"]},{"osd":4,"uuid":"f5aa10a4-9ff9-41fe-a5c9-15326f982cc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6817","nonce":4080159297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6819","nonce":4080159297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6823","nonce":4080159297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6821","nonce":4080159297}]},"public_addr":"172.21.15.196:6817/4080159297","cluster_addr":"172.21.15.196:6819/4080159297","heartbeat_back_addr":"172.21.15.196:6823/4080159297","heartbeat_front_addr":"172.21.15.196:6821/4080159297","state":["exists","up"]},{"osd":5,"uuid":"42bab884-3476-47ae-ac65-935fa6e0f055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6801","nonce":3519444232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6803","nonce":3519444232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6807","nonce":3519444232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6805","nonce":3519444232}]},"public_addr":"172.21.15.196:6801/3519444232","cluster_addr":"172.21.15.196:6803/3519444232","heartbeat_back_addr":"172.21.15.196:6807/3519444232","heartbeat_front_addr":"172.21.15.196:6805/3519444232","state":["exists","up"]},{"osd":6,"uuid":"460b6167-f57b-4224-9c92-cfc9b80bbe99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6809","nonce":275739834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6811","nonce":275739834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6815","nonce":275739834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6813","nonce":275739834}]},"public_addr":"172.21.15.196:6809/275739834","cluster_addr":"172.21.15.196:6811/275739834","heartbeat_back_addr":"172.21.15.196:6815/275739834","heartbeat_front_addr":"172.21.15.196:6813/275739834","state":["exists","up"]},{"osd":7,"uuid":"d695643f-5e07-4e2a-a646-c06bd97b6650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6825","nonce":307626968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6827","nonce":307626968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6831","nonce":307626968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6829","nonce":307626968}]},"public_addr":"172.21.15.196:6825/307626968","cluster_addr":"172.21.15.196:6827/307626968","heartbeat_back_addr":"172.21.15.196:6831/307626968","heartbeat_front_addr":"172.21.15.196:6829/307626968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.293257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.964533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.248895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.010000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.832554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.743704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930171+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930962+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.31","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T17:51:34.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.178+0000 7f2716000640 1 -- 172.21.15.152:0/736857205 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f26ec068380 msgr2=0x7f26ec06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:34.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.178+0000 7f2716000640 1 --2- 172.21.15.152:0/736857205 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f26ec068380 0x7f26ec06a840 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f2700000f70 tx=0x7f2700007e90 comp rx=0 tx=0).stop 2024-04-17T17:51:34.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.178+0000 7f2716000640 1 -- 172.21.15.152:0/736857205 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f271006f140 msgr2=0x7f2710099520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:34.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.178+0000 7f2716000640 1 --2- 172.21.15.152:0/736857205 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f271006f140 0x7f2710099520 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f26f80ae040 tx=0x7f26f801ced0 comp rx=0 tx=0).stop 2024-04-17T17:51:34.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.178+0000 7f2716000640 1 -- 172.21.15.152:0/736857205 shutdown_connections 2024-04-17T17:51:34.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.178+0000 7f2716000640 1 --2- 172.21.15.152:0/736857205 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f271015eb60 0x7f2710099a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:34.183 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.178+0000 7f2716000640 1 --2- 172.21.15.152:0/736857205 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f271006f140 0x7f2710099520 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:34.183 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.178+0000 7f2716000640 1 --2- 172.21.15.152:0/736857205 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f26ec068380 0x7f26ec06a840 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:34.183 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.178+0000 7f2716000640 1 --2- 172.21.15.152:0/736857205 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f271006e730 0x7f271009ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:34.183 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.178+0000 7f2716000640 1 -- 172.21.15.152:0/736857205 >> 172.21.15.152:0/736857205 conn(0x7f2710072140 msgr2=0x7f27100adf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:34.183 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.178+0000 7f2716000640 1 -- 172.21.15.152:0/736857205 shutdown_connections 2024-04-17T17:51:34.183 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.178+0000 7f2716000640 1 -- 172.21.15.152:0/736857205 wait complete. 2024-04-17T17:51:34.217 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-17T17:51:34.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.626+0000 7f012d800640 1 Processor -- start 2024-04-17T17:51:34.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.626+0000 7f012d800640 1 -- start start 2024-04-17T17:51:34.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.630+0000 7f012d800640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f0128162900 0x7f0128072610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:34.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.630+0000 7f012d800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f01280d0a70 0x7f01280ad060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:34.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.630+0000 7f012d800640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f012806e0f0 con 0x7f012806dc60 2024-04-17T17:51:34.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.630+0000 7f012d800640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f012806e3d0 con 0x7f0128162900 2024-04-17T17:51:34.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.630+0000 7f012d800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f012806e6b0 con 0x7f01280d0a70 2024-04-17T17:51:34.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.630+0000 7f0126000640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f012806dc60 0x7f01280d0360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:36298/0 (socket says 172.21.15.152:36298) 2024-04-17T17:51:34.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.630+0000 7f0126000640 1 -- 172.21.15.152:0/1217331617 learned_addr learned my addr 172.21.15.152:0/1217331617 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T17:51:34.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.630+0000 7f0126a00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f0128162900 0x7f0128072610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:34.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.630+0000 7f0127400640 1 --2- 172.21.15.152:0/1217331617 >> v2:172.21.15.196:3300/0 conn(0x7f01280d0a70 0x7f01280ad060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:34.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.630+0000 7f0126a00640 1 -- 172.21.15.152:0/1217331617 >> v2:172.21.15.196:3300/0 conn(0x7f01280d0a70 msgr2=0x7f01280ad060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T17:51:34.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.630+0000 7f0126a00640 1 --2- 172.21.15.152:0/1217331617 >> v2:172.21.15.196:3300/0 conn(0x7f01280d0a70 0x7f01280ad060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:34.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.634+0000 7f0126a00640 1 -- 172.21.15.152:0/1217331617 >> v1:172.21.15.152:6789/0 conn(0x7f012806dc60 legacy=0x7f01280d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:34.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.634+0000 7f0126a00640 1 -- 172.21.15.152:0/1217331617 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f012806e990 con 0x7f0128162900 2024-04-17T17:51:34.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.642+0000 7f0126a00640 1 --2- 172.21.15.152:0/1217331617 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0128162900 0x7f0128072610 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7f012806d9a0 tx=0x7f011801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6a7f32cbe27a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:34.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.642+0000 7f0125600640 1 -- 172.21.15.152:0/1217331617 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01180b1070 con 0x7f0128162900 2024-04-17T17:51:34.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.642+0000 7f0125600640 1 -- 172.21.15.152:0/1217331617 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01180ac5f0 con 0x7f0128162900 2024-04-17T17:51:34.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.642+0000 7f0125600640 1 -- 172.21.15.152:0/1217331617 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01180ac9c0 con 0x7f0128162900 2024-04-17T17:51:34.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.642+0000 7f012d800640 1 -- 172.21.15.152:0/1217331617 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0128162900 msgr2=0x7f0128072610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:34.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.642+0000 7f012d800640 1 --2- 172.21.15.152:0/1217331617 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0128162900 0x7f0128072610 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7f012806d9a0 tx=0x7f011801c480 comp rx=0 tx=0).stop 2024-04-17T17:51:34.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.642+0000 7f012d800640 1 -- 172.21.15.152:0/1217331617 shutdown_connections 2024-04-17T17:51:34.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.642+0000 7f012d800640 1 --2- 172.21.15.152:0/1217331617 >> v2:172.21.15.196:3300/0 conn(0x7f01280d0a70 0x7f01280ad060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:34.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.642+0000 7f012d800640 1 --2- 172.21.15.152:0/1217331617 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0128162900 0x7f0128072610 unknown :-1 s=CLOSED pgs=2042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:34.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.642+0000 7f012d800640 1 -- 172.21.15.152:0/1217331617 >> 172.21.15.152:0/1217331617 conn(0x7f01280b3350 msgr2=0x7f01280b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:34.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.642+0000 7f012d800640 1 -- 172.21.15.152:0/1217331617 shutdown_connections 2024-04-17T17:51:34.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.642+0000 7f012d800640 1 -- 172.21.15.152:0/1217331617 wait complete. 2024-04-17T17:51:34.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.646+0000 7f012d800640 1 Processor -- start 2024-04-17T17:51:34.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.646+0000 7f012d800640 1 -- start start 2024-04-17T17:51:34.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.650+0000 7f012d800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f01280d0a70 0x7f012809c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:34.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.650+0000 7f012d800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0128162900 0x7f012815c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:34.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.650+0000 7f012d800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f012815e760 0x7f012815c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:34.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.650+0000 7f012d800640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f01280adf30 con 0x7f01280d0a70 2024-04-17T17:51:34.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.650+0000 7f012d800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f01280addb0 con 0x7f0128162900 2024-04-17T17:51:34.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.650+0000 7f012d800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f012806f190 con 0x7f012815e760 2024-04-17T17:51:34.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.650+0000 7f0126a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f01280d0a70 0x7f012809c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:34.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.650+0000 7f0126a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f01280d0a70 0x7f012809c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33726/0 (socket says 172.21.15.152:33726) 2024-04-17T17:51:34.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.650+0000 7f0126a00640 1 -- 172.21.15.152:0/2989830972 learned_addr learned my addr 172.21.15.152:0/2989830972 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T17:51:34.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.650+0000 7f0126000640 1 --2- 172.21.15.152:0/2989830972 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0128162900 0x7f012815c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:34.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.650+0000 7f0127400640 1 --2- 172.21.15.152:0/2989830972 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f012815e760 0x7f012815c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:34.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.654+0000 7f0126a00640 1 -- 172.21.15.152:0/2989830972 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f012815e760 msgr2=0x7f012815c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:34.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.654+0000 7f0126a00640 1 --2- 172.21.15.152:0/2989830972 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f012815e760 0x7f012815c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:34.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.654+0000 7f0126a00640 1 -- 172.21.15.152:0/2989830972 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0128162900 msgr2=0x7f012815c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:34.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.654+0000 7f0126a00640 1 --2- 172.21.15.152:0/2989830972 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0128162900 0x7f012815c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:34.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.654+0000 7f0126a00640 1 -- 172.21.15.152:0/2989830972 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f012809d300 con 0x7f01280d0a70 2024-04-17T17:51:34.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.654+0000 7f0127400640 1 --2- 172.21.15.152:0/2989830972 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f012815e760 0x7f012815c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T17:51:34.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.654+0000 7f0126a00640 1 --2- 172.21.15.152:0/2989830972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f01280d0a70 0x7f012809c790 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7f011801ab30 tx=0x7f0118019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:34.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.654+0000 7f011ea00640 1 -- 172.21.15.152:0/2989830972 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01180b1040 con 0x7f01280d0a70 2024-04-17T17:51:34.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.654+0000 7f011ea00640 1 -- 172.21.15.152:0/2989830972 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01180bc070 con 0x7f01280d0a70 2024-04-17T17:51:34.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.654+0000 7f011ea00640 1 -- 172.21.15.152:0/2989830972 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0118006e20 con 0x7f01280d0a70 2024-04-17T17:51:34.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.654+0000 7f012d800640 1 -- 172.21.15.152:0/2989830972 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f012815ec40 con 0x7f01280d0a70 2024-04-17T17:51:34.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.654+0000 7f012d800640 1 -- 172.21.15.152:0/2989830972 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f012815f200 con 0x7f01280d0a70 2024-04-17T17:51:34.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.658+0000 7f012d800640 1 -- 172.21.15.152:0/2989830972 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0128068a30 con 0x7f01280d0a70 2024-04-17T17:51:34.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.658+0000 7f011ea00640 1 -- 172.21.15.152:0/2989830972 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f01180b5650 con 0x7f01280d0a70 2024-04-17T17:51:34.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.662+0000 7f011ea00640 1 --2- 172.21.15.152:0/2989830972 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f01080683b0 0x7f010806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:34.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.662+0000 7f011ea00640 1 -- 172.21.15.152:0/2989830972 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6130+0+0 (secure 0 0 0) 0x7f0118120610 con 0x7f01280d0a70 2024-04-17T17:51:34.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.662+0000 7f0126000640 1 --2- 172.21.15.152:0/2989830972 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f01080683b0 0x7f010806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:34.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.662+0000 7f0126000640 1 --2- 172.21.15.152:0/2989830972 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f01080683b0 0x7f010806a870 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f01281fea40 tx=0x7f0114009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:34.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:34.674+0000 7f011ea00640 1 -- 172.21.15.152:0/2989830972 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f01180a9070 con 0x7f01280d0a70 2024-04-17T17:51:35.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.262+0000 7f012d800640 1 -- 172.21.15.152:0/2989830972 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f01280cff10 con 0x7f01280d0a70 2024-04-17T17:51:35.389 INFO:tasks.ceph.mon.a.smithi152.stderr:2024-04-17T17:51:35.386+0000 7fa662400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-17T17:51:35.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.390+0000 7f011ea00640 1 -- 172.21.15.152:0/2989830972 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) ==== 161+0+0 (secure 0 0 0) 0x7f0118016070 con 0x7f01280d0a70 2024-04-17T17:51:35.393 INFO:teuthology.orchestra.run.smithi152.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-17T17:51:35.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.394+0000 7f012d800640 1 -- 172.21.15.152:0/2989830972 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f01080683b0 msgr2=0x7f010806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:35.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.394+0000 7f012d800640 1 --2- 172.21.15.152:0/2989830972 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f01080683b0 0x7f010806a870 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f01281fea40 tx=0x7f0114009040 comp rx=0 tx=0).stop 2024-04-17T17:51:35.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.394+0000 7f012d800640 1 -- 172.21.15.152:0/2989830972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f01280d0a70 msgr2=0x7f012809c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:35.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.394+0000 7f012d800640 1 --2- 172.21.15.152:0/2989830972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f01280d0a70 0x7f012809c790 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7f011801ab30 tx=0x7f0118019220 comp rx=0 tx=0).stop 2024-04-17T17:51:35.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.394+0000 7f012d800640 1 -- 172.21.15.152:0/2989830972 shutdown_connections 2024-04-17T17:51:35.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.394+0000 7f012d800640 1 --2- 172.21.15.152:0/2989830972 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f01080683b0 0x7f010806a870 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:35.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.394+0000 7f012d800640 1 --2- 172.21.15.152:0/2989830972 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f012815e760 0x7f012815c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:35.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.394+0000 7f012d800640 1 --2- 172.21.15.152:0/2989830972 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0128162900 0x7f012815c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:35.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.394+0000 7f012d800640 1 --2- 172.21.15.152:0/2989830972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f01280d0a70 0x7f012809c790 unknown :-1 s=CLOSED pgs=2043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:35.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.394+0000 7f012d800640 1 -- 172.21.15.152:0/2989830972 >> 172.21.15.152:0/2989830972 conn(0x7f01280b3350 msgr2=0x7f01280b05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:35.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.394+0000 7f012d800640 1 -- 172.21.15.152:0/2989830972 shutdown_connections 2024-04-17T17:51:35.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.394+0000 7f012d800640 1 -- 172.21.15.152:0/2989830972 wait complete. 2024-04-17T17:51:35.445 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-17T17:51:35.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.650+0000 7fd13a200640 1 Processor -- start 2024-04-17T17:51:35.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.654+0000 7fd13a200640 1 -- start start 2024-04-17T17:51:35.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.658+0000 7fd13a200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd134158650 0x7fd13406cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:35.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.658+0000 7fd13a200640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd1340b4330 0x7fd13415ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:35.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.658+0000 7fd13a200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd13415f430 con 0x7fd13415e5c0 2024-04-17T17:51:35.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.658+0000 7fd13a200640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fd13415ef40 con 0x7fd1340b4330 2024-04-17T17:51:35.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.658+0000 7fd13a200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fd13406c240 con 0x7fd134158650 2024-04-17T17:51:35.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.658+0000 7fd139800640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd1340b4330 0x7fd13415ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:35.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.658+0000 7fd139800640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd1340b4330 0x7fd13415ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33742/0 (socket says 172.21.15.152:33742) 2024-04-17T17:51:35.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.658+0000 7fd139800640 1 -- 172.21.15.152:0/2654498778 learned_addr learned my addr 172.21.15.152:0/2654498778 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T17:51:35.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.658+0000 7fd138e00640 1 --2- 172.21.15.152:0/2654498778 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd134158650 0x7fd13406cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:35.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.658+0000 7fd133400640 1 -- 172.21.15.152:0/2654498778 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 687725278 0 0) 0x7fd13415f430 con 0x7fd13415e5c0 2024-04-17T17:51:35.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.658+0000 7fd139800640 1 -- 172.21.15.152:0/2654498778 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd134158650 msgr2=0x7fd13406cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T17:51:35.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.658+0000 7fd139800640 1 --2- 172.21.15.152:0/2654498778 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd134158650 0x7fd13406cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:35.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.658+0000 7fd139800640 1 -- 172.21.15.152:0/2654498778 >> v1:172.21.15.196:6789/0 conn(0x7fd13415e5c0 legacy=0x7fd1340b3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:35.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.658+0000 7fd139800640 1 -- 172.21.15.152:0/2654498778 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1340b4870 con 0x7fd1340b4330 2024-04-17T17:51:35.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.658+0000 7fd138e00640 1 --2- 172.21.15.152:0/2654498778 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd134158650 0x7fd13406cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T17:51:35.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.670+0000 7fd139800640 1 --2- 172.21.15.152:0/2654498778 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd1340b4330 0x7fd13415ea00 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7fd12c009870 tx=0x7fd12c01d670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cca960205529cd51 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:35.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.670+0000 7fd133400640 1 -- 172.21.15.152:0/2654498778 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd12c0b1600 con 0x7fd1340b4330 2024-04-17T17:51:35.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.674+0000 7fd133400640 1 -- 172.21.15.152:0/2654498778 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd12c0b17a0 con 0x7fd1340b4330 2024-04-17T17:51:35.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.674+0000 7fd133400640 1 -- 172.21.15.152:0/2654498778 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd12c0b1b70 con 0x7fd1340b4330 2024-04-17T17:51:35.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.674+0000 7fd13a200640 1 -- 172.21.15.152:0/2654498778 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd1340b4330 msgr2=0x7fd13415ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:35.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.674+0000 7fd13a200640 1 --2- 172.21.15.152:0/2654498778 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd1340b4330 0x7fd13415ea00 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7fd12c009870 tx=0x7fd12c01d670 comp rx=0 tx=0).stop 2024-04-17T17:51:35.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.674+0000 7fd13a200640 1 -- 172.21.15.152:0/2654498778 shutdown_connections 2024-04-17T17:51:35.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.674+0000 7fd13a200640 1 --2- 172.21.15.152:0/2654498778 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd1340b4330 0x7fd13415ea00 unknown :-1 s=CLOSED pgs=2044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:35.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.674+0000 7fd13a200640 1 --2- 172.21.15.152:0/2654498778 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd134158650 0x7fd13406cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:35.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.674+0000 7fd13a200640 1 -- 172.21.15.152:0/2654498778 >> 172.21.15.152:0/2654498778 conn(0x7fd1340d0470 msgr2=0x7fd1340d0880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:35.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.674+0000 7fd13a200640 1 -- 172.21.15.152:0/2654498778 shutdown_connections 2024-04-17T17:51:35.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.674+0000 7fd13a200640 1 -- 172.21.15.152:0/2654498778 wait complete. 2024-04-17T17:51:35.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.678+0000 7fd13a200640 1 Processor -- start 2024-04-17T17:51:35.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.678+0000 7fd13a200640 1 -- start start 2024-04-17T17:51:35.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.678+0000 7fd13a200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd1340b4330 0x7fd13414e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:35.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.678+0000 7fd13a200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd134158650 0x7fd1340cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:35.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.678+0000 7fd13a200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd13415e5c0 0x7fd13414ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:35.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.678+0000 7fd13a200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd13406d3a0 con 0x7fd134158650 2024-04-17T17:51:35.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.678+0000 7fd13a200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd13406d220 con 0x7fd13415e5c0 2024-04-17T17:51:35.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.678+0000 7fd13a200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fd13406dea0 con 0x7fd1340b4330 2024-04-17T17:51:35.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.678+0000 7fd133e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd134158650 0x7fd1340cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:35.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.678+0000 7fd138e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd1340b4330 0x7fd13414e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:35.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.678+0000 7fd138e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd1340b4330 0x7fd13414e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.152:34804/0 (socket says 172.21.15.152:34804) 2024-04-17T17:51:35.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.678+0000 7fd138e00640 1 -- 172.21.15.152:0/1945193564 learned_addr learned my addr 172.21.15.152:0/1945193564 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T17:51:35.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.678+0000 7fd139800640 1 --2- 172.21.15.152:0/1945193564 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd13415e5c0 0x7fd13414ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:35.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.678+0000 7fd138e00640 1 -- 172.21.15.152:0/1945193564 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd13415e5c0 msgr2=0x7fd13414ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:35.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.678+0000 7fd138e00640 1 --2- 172.21.15.152:0/1945193564 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd13415e5c0 0x7fd13414ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:35.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.678+0000 7fd138e00640 1 -- 172.21.15.152:0/1945193564 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd134158650 msgr2=0x7fd1340cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:35.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.678+0000 7fd138e00640 1 --2- 172.21.15.152:0/1945193564 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd134158650 0x7fd1340cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:35.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.678+0000 7fd138e00640 1 -- 172.21.15.152:0/1945193564 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd134153950 con 0x7fd1340b4330 2024-04-17T17:51:35.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.678+0000 7fd138e00640 1 --2- 172.21.15.152:0/1945193564 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd1340b4330 0x7fd13414e070 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd128007fa0 tx=0x7fd12800d560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:35.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.678+0000 7fd130c00640 1 -- 172.21.15.152:0/1945193564 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd12801a070 con 0x7fd1340b4330 2024-04-17T17:51:35.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.678+0000 7fd130c00640 1 -- 172.21.15.152:0/1945193564 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd128003ba0 con 0x7fd1340b4330 2024-04-17T17:51:35.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.678+0000 7fd13a200640 1 -- 172.21.15.152:0/1945193564 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd134155d00 con 0x7fd1340b4330 2024-04-17T17:51:35.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.678+0000 7fd130c00640 1 -- 172.21.15.152:0/1945193564 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd128004030 con 0x7fd1340b4330 2024-04-17T17:51:35.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.682+0000 7fd13a200640 1 -- 172.21.15.152:0/1945193564 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd134153ed0 con 0x7fd1340b4330 2024-04-17T17:51:35.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.682+0000 7fd13a200640 1 -- 172.21.15.152:0/1945193564 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd134075be0 con 0x7fd1340b4330 2024-04-17T17:51:35.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.686+0000 7fd130c00640 1 -- 172.21.15.152:0/1945193564 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd12801d070 con 0x7fd1340b4330 2024-04-17T17:51:35.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.686+0000 7fd130c00640 1 --2- 172.21.15.152:0/1945193564 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fd1140683d0 0x7fd11406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:35.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.686+0000 7fd130c00640 1 -- 172.21.15.152:0/1945193564 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(41..41 src has 1..41) ==== 6216+0+0 (secure 0 0 0) 0x7fd128086ca0 con 0x7fd1340b4330 2024-04-17T17:51:35.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.686+0000 7fd133e00640 1 --2- 172.21.15.152:0/1945193564 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fd1140683d0 0x7fd11406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:35.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.686+0000 7fd133e00640 1 --2- 172.21.15.152:0/1945193564 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fd1140683d0 0x7fd11406a890 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fd1341fe9d0 tx=0x7fd120009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:35.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:35.690+0000 7fd130c00640 1 -- 172.21.15.152:0/1945193564 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fd12808b070 con 0x7fd1340b4330 2024-04-17T17:51:35.924 INFO:tasks.ceph.mds.c.smithi152.stdout:starting mds.c at 2024-04-17T17:51:36.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.338+0000 7fd13a200640 1 -- 172.21.15.152:0/1945193564 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fd1340d11b0 con 0x7fd1340b4330 2024-04-17T17:51:36.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.410+0000 7fd130c00640 1 -- 172.21.15.152:0/1945193564 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) ==== 104+0+0 (secure 0 0 0) 0x7fd128010070 con 0x7fd1340b4330 2024-04-17T17:51:36.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.414+0000 7fd13a200640 1 -- 172.21.15.152:0/1945193564 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fd1140683d0 msgr2=0x7fd11406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:36.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.414+0000 7fd13a200640 1 --2- 172.21.15.152:0/1945193564 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fd1140683d0 0x7fd11406a890 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fd1341fe9d0 tx=0x7fd120009040 comp rx=0 tx=0).stop 2024-04-17T17:51:36.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.414+0000 7fd13a200640 1 -- 172.21.15.152:0/1945193564 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd1340b4330 msgr2=0x7fd13414e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:36.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.414+0000 7fd13a200640 1 --2- 172.21.15.152:0/1945193564 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd1340b4330 0x7fd13414e070 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd128007fa0 tx=0x7fd12800d560 comp rx=0 tx=0).stop 2024-04-17T17:51:36.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.414+0000 7fd13a200640 1 -- 172.21.15.152:0/1945193564 shutdown_connections 2024-04-17T17:51:36.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.414+0000 7fd13a200640 1 --2- 172.21.15.152:0/1945193564 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd13415e5c0 0x7fd13414ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:36.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.414+0000 7fd13a200640 1 --2- 172.21.15.152:0/1945193564 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd134158650 0x7fd1340cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:36.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.414+0000 7fd13a200640 1 --2- 172.21.15.152:0/1945193564 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fd1140683d0 0x7fd11406a890 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:36.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.414+0000 7fd13a200640 1 --2- 172.21.15.152:0/1945193564 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd1340b4330 0x7fd13414e070 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:36.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.414+0000 7fd13a200640 1 -- 172.21.15.152:0/1945193564 >> 172.21.15.152:0/1945193564 conn(0x7fd1340d0470 msgr2=0x7fd1340b09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:36.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.414+0000 7fd13a200640 1 -- 172.21.15.152:0/1945193564 shutdown_connections 2024-04-17T17:51:36.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.414+0000 7fd13a200640 1 -- 172.21.15.152:0/1945193564 wait complete. 2024-04-17T17:51:36.469 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-17T17:51:36.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.878+0000 7eff93400640 1 Processor -- start 2024-04-17T17:51:36.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.878+0000 7eff93400640 1 -- start start 2024-04-17T17:51:36.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.882+0000 7eff93400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7eff8c145b30 0x7eff8c163200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:36.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.882+0000 7eff93400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff8c0cf9b0 0x7eff8c1483a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:36.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.882+0000 7eff93400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7eff8c1488e0 0x7eff8c1667f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:36.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.882+0000 7eff93400640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7eff8c0b1e70 con 0x7eff8c145b30 2024-04-17T17:51:36.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.882+0000 7eff93400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7eff8c0b2140 con 0x7eff8c1488e0 2024-04-17T17:51:36.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.882+0000 7eff93400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7eff8c163a50 con 0x7eff8c0cf9b0 2024-04-17T17:51:36.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.882+0000 7eff90a00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7eff8c145b30 0x7eff8c163200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:36.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.882+0000 7eff91400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7eff8c1488e0 0x7eff8c1667f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:36.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.882+0000 7eff8be00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff8c0cf9b0 0x7eff8c1483a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:36.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.882+0000 7eff90a00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7eff8c145b30 0x7eff8c163200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33782/0 (socket says 172.21.15.152:33782) 2024-04-17T17:51:36.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.882+0000 7eff90a00640 1 -- 172.21.15.152:0/3274735587 learned_addr learned my addr 172.21.15.152:0/3274735587 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T17:51:36.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.882+0000 7eff90a00640 1 -- 172.21.15.152:0/3274735587 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff8c0cf9b0 msgr2=0x7eff8c1483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T17:51:36.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.882+0000 7eff90a00640 1 --2- 172.21.15.152:0/3274735587 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff8c0cf9b0 0x7eff8c1483a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:36.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.882+0000 7eff90a00640 1 -- 172.21.15.152:0/3274735587 >> v2:172.21.15.196:3300/0 conn(0x7eff8c1488e0 msgr2=0x7eff8c1667f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T17:51:36.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.882+0000 7eff90a00640 1 --2- 172.21.15.152:0/3274735587 >> v2:172.21.15.196:3300/0 conn(0x7eff8c1488e0 0x7eff8c1667f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:36.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.882+0000 7eff90a00640 1 -- 172.21.15.152:0/3274735587 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff8c163d30 con 0x7eff8c145b30 2024-04-17T17:51:36.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.894+0000 7eff90a00640 1 --2- 172.21.15.152:0/3274735587 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7eff8c145b30 0x7eff8c163200 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 crypto rx=0x7eff8c149440 tx=0x7eff8001c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37be1e34e66a96cc server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:36.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.894+0000 7eff8b400640 1 -- 172.21.15.152:0/3274735587 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff800b0070 con 0x7eff8c145b30 2024-04-17T17:51:36.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.894+0000 7eff8b400640 1 -- 172.21.15.152:0/3274735587 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff800ab600 con 0x7eff8c145b30 2024-04-17T17:51:36.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.894+0000 7eff8b400640 1 -- 172.21.15.152:0/3274735587 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff800ab9d0 con 0x7eff8c145b30 2024-04-17T17:51:36.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.894+0000 7eff93400640 1 -- 172.21.15.152:0/3274735587 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7eff8c145b30 msgr2=0x7eff8c163200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:36.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.894+0000 7eff93400640 1 --2- 172.21.15.152:0/3274735587 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7eff8c145b30 0x7eff8c163200 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 crypto rx=0x7eff8c149440 tx=0x7eff8001c260 comp rx=0 tx=0).stop 2024-04-17T17:51:36.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.894+0000 7eff93400640 1 -- 172.21.15.152:0/3274735587 shutdown_connections 2024-04-17T17:51:36.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.894+0000 7eff93400640 1 --2- 172.21.15.152:0/3274735587 >> v2:172.21.15.196:3300/0 conn(0x7eff8c1488e0 0x7eff8c1667f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:36.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.894+0000 7eff93400640 1 --2- 172.21.15.152:0/3274735587 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff8c0cf9b0 0x7eff8c1483a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:36.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.894+0000 7eff93400640 1 --2- 172.21.15.152:0/3274735587 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7eff8c145b30 0x7eff8c163200 unknown :-1 s=CLOSED pgs=2047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:36.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.894+0000 7eff93400640 1 -- 172.21.15.152:0/3274735587 >> 172.21.15.152:0/3274735587 conn(0x7eff8c0cee20 msgr2=0x7eff8c0cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:36.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.894+0000 7eff93400640 1 -- 172.21.15.152:0/3274735587 shutdown_connections 2024-04-17T17:51:36.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.894+0000 7eff93400640 1 -- 172.21.15.152:0/3274735587 wait complete. 2024-04-17T17:51:36.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.898+0000 7eff93400640 1 Processor -- start 2024-04-17T17:51:36.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.898+0000 7eff93400640 1 -- start start 2024-04-17T17:51:36.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.902+0000 7eff93400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7eff8c0cf9b0 0x7eff8c148280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:36.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.902+0000 7eff93400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff8c145b30 0x7eff8c142300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:36.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.902+0000 7eff93400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7eff8c1488e0 0x7eff8c0b5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:36.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.902+0000 7eff93400640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7eff8c0b2750 con 0x7eff8c0cf9b0 2024-04-17T17:51:36.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.902+0000 7eff93400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7eff8c0b25d0 con 0x7eff8c1488e0 2024-04-17T17:51:36.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.902+0000 7eff93400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7eff8c0b28d0 con 0x7eff8c145b30 2024-04-17T17:51:36.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.902+0000 7eff90a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7eff8c0cf9b0 0x7eff8c148280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:36.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.902+0000 7eff90a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7eff8c0cf9b0 0x7eff8c148280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33786/0 (socket says 172.21.15.152:33786) 2024-04-17T17:51:36.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.902+0000 7eff8be00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff8c145b30 0x7eff8c142300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:36.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.902+0000 7eff90a00640 1 -- 172.21.15.152:0/4261888389 learned_addr learned my addr 172.21.15.152:0/4261888389 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T17:51:36.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.902+0000 7eff91400640 1 --2- 172.21.15.152:0/4261888389 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7eff8c1488e0 0x7eff8c0b5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:36.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.902+0000 7eff90a00640 1 -- 172.21.15.152:0/4261888389 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff8c145b30 msgr2=0x7eff8c142300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:36.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.902+0000 7eff90a00640 1 --2- 172.21.15.152:0/4261888389 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff8c145b30 0x7eff8c142300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:36.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.906+0000 7eff90a00640 1 -- 172.21.15.152:0/4261888389 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7eff8c1488e0 msgr2=0x7eff8c0b5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:36.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.906+0000 7eff90a00640 1 --2- 172.21.15.152:0/4261888389 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7eff8c1488e0 0x7eff8c0b5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:36.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.906+0000 7eff90a00640 1 -- 172.21.15.152:0/4261888389 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff8c0b7c90 con 0x7eff8c0cf9b0 2024-04-17T17:51:36.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.906+0000 7eff90a00640 1 --2- 172.21.15.152:0/4261888389 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7eff8c0cf9b0 0x7eff8c148280 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7eff800ae040 tx=0x7eff8001aaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:36.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.906+0000 7eff88c00640 1 -- 172.21.15.152:0/4261888389 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff800b0040 con 0x7eff8c0cf9b0 2024-04-17T17:51:36.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.906+0000 7eff88c00640 1 -- 172.21.15.152:0/4261888389 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff800bc070 con 0x7eff8c0cf9b0 2024-04-17T17:51:36.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.906+0000 7eff93400640 1 -- 172.21.15.152:0/4261888389 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff8c0b7f70 con 0x7eff8c0cf9b0 2024-04-17T17:51:36.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.906+0000 7eff88c00640 1 -- 172.21.15.152:0/4261888389 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff800b6640 con 0x7eff8c0cf9b0 2024-04-17T17:51:36.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.906+0000 7eff93400640 1 -- 172.21.15.152:0/4261888389 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff8c0c7740 con 0x7eff8c0cf9b0 2024-04-17T17:51:36.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.910+0000 7eff93400640 1 -- 172.21.15.152:0/4261888389 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff8c147b80 con 0x7eff8c0cf9b0 2024-04-17T17:51:36.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.910+0000 7eff88c00640 1 -- 172.21.15.152:0/4261888389 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7eff800b67e0 con 0x7eff8c0cf9b0 2024-04-17T17:51:36.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.914+0000 7eff88c00640 1 --2- 172.21.15.152:0/4261888389 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7eff6c068380 0x7eff6c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:36.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.914+0000 7eff8be00640 1 --2- 172.21.15.152:0/4261888389 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7eff6c068380 0x7eff6c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:36.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.914+0000 7eff88c00640 1 -- 172.21.15.152:0/4261888389 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6216+0+0 (secure 0 0 0) 0x7eff80120c60 con 0x7eff8c0cf9b0 2024-04-17T17:51:36.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.914+0000 7eff8be00640 1 --2- 172.21.15.152:0/4261888389 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7eff6c068380 0x7eff6c06a840 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7eff8c162e30 tx=0x7eff78009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:36.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:36.926+0000 7eff88c00640 1 -- 172.21.15.152:0/4261888389 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7eff8c147b80 con 0x7eff8c0cf9b0 2024-04-17T17:51:37.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:37.430+0000 7eff93400640 1 -- 172.21.15.152:0/4261888389 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7eff8c068a30 con 0x7eff8c0cf9b0 2024-04-17T17:51:38.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.218+0000 7eff88c00640 1 -- 172.21.15.152:0/4261888389 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v42) ==== 181+0+0 (secure 0 0 0) 0x7eff80016110 con 0x7eff8c0cf9b0 2024-04-17T17:51:38.223 INFO:teuthology.orchestra.run.smithi152.stderr:pool 'cephfs_metadata' removed 2024-04-17T17:51:38.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.222+0000 7eff93400640 1 -- 172.21.15.152:0/4261888389 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7eff6c068380 msgr2=0x7eff6c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:38.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.222+0000 7eff93400640 1 --2- 172.21.15.152:0/4261888389 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7eff6c068380 0x7eff6c06a840 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7eff8c162e30 tx=0x7eff78009190 comp rx=0 tx=0).stop 2024-04-17T17:51:38.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.222+0000 7eff93400640 1 -- 172.21.15.152:0/4261888389 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7eff8c0cf9b0 msgr2=0x7eff8c148280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:38.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.222+0000 7eff93400640 1 --2- 172.21.15.152:0/4261888389 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7eff8c0cf9b0 0x7eff8c148280 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7eff800ae040 tx=0x7eff8001aaa0 comp rx=0 tx=0).stop 2024-04-17T17:51:38.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.222+0000 7eff93400640 1 -- 172.21.15.152:0/4261888389 shutdown_connections 2024-04-17T17:51:38.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.222+0000 7eff93400640 1 --2- 172.21.15.152:0/4261888389 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7eff8c1488e0 0x7eff8c0b5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:38.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.222+0000 7eff93400640 1 --2- 172.21.15.152:0/4261888389 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7eff6c068380 0x7eff6c06a840 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:38.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.222+0000 7eff93400640 1 --2- 172.21.15.152:0/4261888389 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff8c145b30 0x7eff8c142300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:38.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.222+0000 7eff93400640 1 --2- 172.21.15.152:0/4261888389 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7eff8c0cf9b0 0x7eff8c148280 unknown :-1 s=CLOSED pgs=2048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:38.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.222+0000 7eff93400640 1 -- 172.21.15.152:0/4261888389 >> 172.21.15.152:0/4261888389 conn(0x7eff8c0cee20 msgr2=0x7eff8c0d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:38.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.222+0000 7eff93400640 1 -- 172.21.15.152:0/4261888389 shutdown_connections 2024-04-17T17:51:38.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.222+0000 7eff93400640 1 -- 172.21.15.152:0/4261888389 wait complete. 2024-04-17T17:51:38.257 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-17T17:51:38.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.618+0000 7f9ee1c00640 1 Processor -- start 2024-04-17T17:51:38.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.618+0000 7f9ee1c00640 1 -- start start 2024-04-17T17:51:38.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.618+0000 7f9ee1c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9edc071c00 0x7f9edc162d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:38.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.618+0000 7f9ee1c00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9edc0af790 con 0x7f9edc06f6b0 2024-04-17T17:51:38.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.618+0000 7f9ee1c00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9edc0afa70 con 0x7f9edc167000 2024-04-17T17:51:38.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.618+0000 7f9ee1c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f9edc1633a0 con 0x7f9edc071c00 2024-04-17T17:51:38.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.618+0000 7f9edaa00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9edc071c00 0x7f9edc162d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:38.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.622+0000 7f9eda000640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f9edc167000 0x7f9edc071fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.152:49148/0 (socket says 172.21.15.152:49148) 2024-04-17T17:51:38.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.622+0000 7f9eda000640 1 -- 172.21.15.152:0/776836922 learned_addr learned my addr 172.21.15.152:0/776836922 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T17:51:38.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.622+0000 7f9ed9600640 1 -- 172.21.15.152:0/776836922 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1182356300 0 0) 0x7f9edc0afa70 con 0x7f9edc167000 2024-04-17T17:51:38.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.622+0000 7f9ed9600640 1 -- 172.21.15.152:0/776836922 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ec0003530 con 0x7f9edc167000 2024-04-17T17:51:38.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.622+0000 7f9edaa00640 1 -- 172.21.15.152:0/776836922 >> v1:172.21.15.196:6789/0 conn(0x7f9edc167000 legacy=0x7f9edc071fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:38.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.622+0000 7f9ed9600640 1 -- 172.21.15.152:0/776836922 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1838227128 0 0) 0x7f9edc0af790 con 0x7f9edc06f6b0 2024-04-17T17:51:38.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.622+0000 7f9edaa00640 1 -- 172.21.15.152:0/776836922 >> v1:172.21.15.152:6789/0 conn(0x7f9edc06f6b0 legacy=0x7f9edc163830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:38.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.622+0000 7f9edaa00640 1 -- 172.21.15.152:0/776836922 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9edc163f40 con 0x7f9edc071c00 2024-04-17T17:51:38.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.630+0000 7f9edaa00640 1 --2- 172.21.15.152:0/776836922 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9edc071c00 0x7f9edc162d10 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc009dc0 tx=0x7f9ecc01c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=229f27b6f3548510 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:38.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.630+0000 7f9ed9600640 1 -- 172.21.15.152:0/776836922 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc0b2070 con 0x7f9edc071c00 2024-04-17T17:51:38.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.630+0000 7f9ed9600640 1 -- 172.21.15.152:0/776836922 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ecc0a5850 con 0x7f9edc071c00 2024-04-17T17:51:38.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.630+0000 7f9ed9600640 1 -- 172.21.15.152:0/776836922 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc0a5c20 con 0x7f9edc071c00 2024-04-17T17:51:38.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.630+0000 7f9ee1c00640 1 -- 172.21.15.152:0/776836922 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9edc071c00 msgr2=0x7f9edc162d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:38.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.630+0000 7f9ee1c00640 1 --2- 172.21.15.152:0/776836922 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9edc071c00 0x7f9edc162d10 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc009dc0 tx=0x7f9ecc01c990 comp rx=0 tx=0).stop 2024-04-17T17:51:38.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.630+0000 7f9ee1c00640 1 -- 172.21.15.152:0/776836922 shutdown_connections 2024-04-17T17:51:38.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.630+0000 7f9ee1c00640 1 --2- 172.21.15.152:0/776836922 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9edc071c00 0x7f9edc162d10 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:38.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.630+0000 7f9ee1c00640 1 -- 172.21.15.152:0/776836922 >> 172.21.15.152:0/776836922 conn(0x7f9edc0b3220 msgr2=0x7f9edc0b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:38.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.630+0000 7f9ee1c00640 1 -- 172.21.15.152:0/776836922 shutdown_connections 2024-04-17T17:51:38.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.630+0000 7f9ee1c00640 1 -- 172.21.15.152:0/776836922 wait complete. 2024-04-17T17:51:38.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.634+0000 7f9ee1c00640 1 Processor -- start 2024-04-17T17:51:38.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.638+0000 7f9ee1c00640 1 -- start start 2024-04-17T17:51:38.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.638+0000 7f9ee1c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9edc06f6b0 0x7f9edc1530d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:38.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.638+0000 7f9ee1c00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9edc071c00 0x7f9edc154320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:38.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.638+0000 7f9ee1c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9edc167000 0x7f9edc09b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:38.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.638+0000 7f9ee1c00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9edc171540 con 0x7f9edc071c00 2024-04-17T17:51:38.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.638+0000 7f9ee1c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f9edc1713c0 con 0x7f9edc06f6b0 2024-04-17T17:51:38.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.638+0000 7f9ee1c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f9edc1716c0 con 0x7f9edc167000 2024-04-17T17:51:38.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.638+0000 7f9eda000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9edc071c00 0x7f9edc154320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:38.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.638+0000 7f9eda000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9edc071c00 0x7f9edc154320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46048/0 (socket says 172.21.15.152:46048) 2024-04-17T17:51:38.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.638+0000 7f9eda000640 1 -- 172.21.15.152:0/2019407716 learned_addr learned my addr 172.21.15.152:0/2019407716 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T17:51:38.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.638+0000 7f9edb400640 1 --2- 172.21.15.152:0/2019407716 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9edc167000 0x7f9edc09b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:38.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.638+0000 7f9edaa00640 1 --2- 172.21.15.152:0/2019407716 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9edc06f6b0 0x7f9edc1530d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:38.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.642+0000 7f9eda000640 1 -- 172.21.15.152:0/2019407716 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9edc167000 msgr2=0x7f9edc09b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:38.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.642+0000 7f9eda000640 1 --2- 172.21.15.152:0/2019407716 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9edc167000 0x7f9edc09b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:38.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.642+0000 7f9eda000640 1 -- 172.21.15.152:0/2019407716 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9edc06f6b0 msgr2=0x7f9edc1530d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:38.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.642+0000 7f9eda000640 1 --2- 172.21.15.152:0/2019407716 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9edc06f6b0 0x7f9edc1530d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:38.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.642+0000 7f9eda000640 1 -- 172.21.15.152:0/2019407716 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9edc154dc0 con 0x7f9edc071c00 2024-04-17T17:51:38.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.642+0000 7f9eda000640 1 --2- 172.21.15.152:0/2019407716 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9edc071c00 0x7f9edc154320 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7f9ec800c3f0 tx=0x7f9ec800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:38.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.642+0000 7f9ed2a00640 1 -- 172.21.15.152:0/2019407716 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec8017070 con 0x7f9edc071c00 2024-04-17T17:51:38.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.642+0000 7f9ee1c00640 1 -- 172.21.15.152:0/2019407716 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9edc1550a0 con 0x7f9edc071c00 2024-04-17T17:51:38.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.642+0000 7f9ed2a00640 1 -- 172.21.15.152:0/2019407716 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ec8005cf0 con 0x7f9edc071c00 2024-04-17T17:51:38.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.642+0000 7f9ed2a00640 1 -- 172.21.15.152:0/2019407716 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec80072f0 con 0x7f9edc071c00 2024-04-17T17:51:38.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.642+0000 7f9ee1c00640 1 -- 172.21.15.152:0/2019407716 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9edc155660 con 0x7f9edc071c00 2024-04-17T17:51:38.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.646+0000 7f9ee1c00640 1 -- 172.21.15.152:0/2019407716 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9edc068a30 con 0x7f9edc071c00 2024-04-17T17:51:38.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.650+0000 7f9ed2a00640 1 -- 172.21.15.152:0/2019407716 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9ec801a070 con 0x7f9edc071c00 2024-04-17T17:51:38.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.650+0000 7f9ed2a00640 1 --2- 172.21.15.152:0/2019407716 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9ebc068380 0x7f9ebc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:38.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.654+0000 7f9ed2a00640 1 -- 172.21.15.152:0/2019407716 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5778+0+0 (secure 0 0 0) 0x7f9ec8085d40 con 0x7f9edc071c00 2024-04-17T17:51:38.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.654+0000 7f9edaa00640 1 --2- 172.21.15.152:0/2019407716 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9ebc068380 0x7f9ebc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:38.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:38.654+0000 7f9edaa00640 1 --2- 172.21.15.152:0/2019407716 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9ebc068380 0x7f9ebc06a840 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc0af000 tx=0x7f9ecc0a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:39.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:39.194+0000 7f9ed2a00640 1 -- 172.21.15.152:0/2019407716 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f9ec8055c60 con 0x7f9edc071c00 2024-04-17T17:51:39.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:39.422+0000 7f9ee1c00640 1 -- 172.21.15.152:0/2019407716 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9edc06d550 con 0x7f9edc071c00 2024-04-17T17:51:40.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.238+0000 7f9ed2a00640 1 -- 172.21.15.152:0/2019407716 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v43) ==== 169+0+0 (secure 0 0 0) 0x7f9ec8059f60 con 0x7f9edc071c00 2024-04-17T17:51:40.244 INFO:teuthology.orchestra.run.smithi152.stderr:pool 'cephfs_data' removed 2024-04-17T17:51:40.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.246+0000 7f9ee1c00640 1 -- 172.21.15.152:0/2019407716 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9ebc068380 msgr2=0x7f9ebc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:40.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.246+0000 7f9ee1c00640 1 --2- 172.21.15.152:0/2019407716 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9ebc068380 0x7f9ebc06a840 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc0af000 tx=0x7f9ecc0a7070 comp rx=0 tx=0).stop 2024-04-17T17:51:40.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.246+0000 7f9ee1c00640 1 -- 172.21.15.152:0/2019407716 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9edc071c00 msgr2=0x7f9edc154320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:40.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.246+0000 7f9ee1c00640 1 --2- 172.21.15.152:0/2019407716 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9edc071c00 0x7f9edc154320 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7f9ec800c3f0 tx=0x7f9ec800c8b0 comp rx=0 tx=0).stop 2024-04-17T17:51:40.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.246+0000 7f9ee1c00640 1 -- 172.21.15.152:0/2019407716 shutdown_connections 2024-04-17T17:51:40.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.246+0000 7f9ee1c00640 1 --2- 172.21.15.152:0/2019407716 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9ebc068380 0x7f9ebc06a840 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:40.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.246+0000 7f9ee1c00640 1 --2- 172.21.15.152:0/2019407716 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9edc167000 0x7f9edc09b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:40.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.246+0000 7f9ee1c00640 1 --2- 172.21.15.152:0/2019407716 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9edc071c00 0x7f9edc154320 unknown :-1 s=CLOSED pgs=2050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:40.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.246+0000 7f9ee1c00640 1 --2- 172.21.15.152:0/2019407716 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9edc06f6b0 0x7f9edc1530d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:40.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.246+0000 7f9ee1c00640 1 -- 172.21.15.152:0/2019407716 >> 172.21.15.152:0/2019407716 conn(0x7f9edc0b3220 msgr2=0x7f9edc0b3600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:40.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.246+0000 7f9ee1c00640 1 -- 172.21.15.152:0/2019407716 shutdown_connections 2024-04-17T17:51:40.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.246+0000 7f9ee1c00640 1 -- 172.21.15.152:0/2019407716 wait complete. 2024-04-17T17:51:40.300 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-17T17:51:40.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.706+0000 7fb3d0a00640 1 Processor -- start 2024-04-17T17:51:40.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.706+0000 7fb3d0a00640 1 -- start start 2024-04-17T17:51:40.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.710+0000 7fb3d0a00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb3cc0d0030 0x7fb3cc06c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:40.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.710+0000 7fb3d0a00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3cc0ccea0 con 0x7fb3cc0cf540 2024-04-17T17:51:40.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.710+0000 7fb3d0a00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3cc0cd180 con 0x7fb3cc0cca10 2024-04-17T17:51:40.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.710+0000 7fb3d0a00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fb3cc0cd460 con 0x7fb3cc0d0030 2024-04-17T17:51:40.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.710+0000 7fb3ca800640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fb3cc0cf540 0x7fb3cc0cf920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:53182/0 (socket says 172.21.15.152:53182) 2024-04-17T17:51:40.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.710+0000 7fb3ca800640 1 -- 172.21.15.152:0/1112947777 learned_addr learned my addr 172.21.15.152:0/1112947777 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T17:51:40.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.710+0000 7fb3cb200640 1 --2- 172.21.15.152:0/1112947777 >> v2:172.21.15.152:3300/0 conn(0x7fb3cc0d0030 0x7fb3cc06c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:40.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.710+0000 7fb3c9400640 1 -- 172.21.15.152:0/1112947777 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 589505149 0 0) 0x7fb3cc0ccea0 con 0x7fb3cc0cf540 2024-04-17T17:51:40.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.710+0000 7fb3c9400640 1 -- 172.21.15.152:0/1112947777 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3b0003530 con 0x7fb3cc0cf540 2024-04-17T17:51:40.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.710+0000 7fb3cb200640 1 -- 172.21.15.152:0/1112947777 >> v1:172.21.15.196:6789/0 conn(0x7fb3cc0cca10 legacy=0x7fb3cc163f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T17:51:40.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.710+0000 7fb3cb200640 1 -- 172.21.15.152:0/1112947777 >> v1:172.21.15.152:6789/0 conn(0x7fb3cc0cf540 legacy=0x7fb3cc0cf920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:40.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.710+0000 7fb3cb200640 1 -- 172.21.15.152:0/1112947777 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3cc0cd740 con 0x7fb3cc0d0030 2024-04-17T17:51:40.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.718+0000 7fb3cb200640 1 --2- 172.21.15.152:0/1112947777 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3cc0d0030 0x7fb3cc06c8d0 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4009d90 tx=0x7fb3c401d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e37a70dd69326c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:40.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.722+0000 7fb3c9400640 1 -- 172.21.15.152:0/1112947777 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c40b2070 con 0x7fb3cc0d0030 2024-04-17T17:51:40.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.722+0000 7fb3c9400640 1 -- 172.21.15.152:0/1112947777 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3c40a59e0 con 0x7fb3cc0d0030 2024-04-17T17:51:40.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.722+0000 7fb3c9400640 1 -- 172.21.15.152:0/1112947777 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c40a5d90 con 0x7fb3cc0d0030 2024-04-17T17:51:40.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.722+0000 7fb3d0a00640 1 -- 172.21.15.152:0/1112947777 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3cc0d0030 msgr2=0x7fb3cc06c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:40.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.722+0000 7fb3d0a00640 1 --2- 172.21.15.152:0/1112947777 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3cc0d0030 0x7fb3cc06c8d0 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4009d90 tx=0x7fb3c401d360 comp rx=0 tx=0).stop 2024-04-17T17:51:40.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.722+0000 7fb3d0a00640 1 -- 172.21.15.152:0/1112947777 shutdown_connections 2024-04-17T17:51:40.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.722+0000 7fb3d0a00640 1 --2- 172.21.15.152:0/1112947777 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3cc0d0030 0x7fb3cc06c8d0 unknown :-1 s=CLOSED pgs=2052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:40.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.722+0000 7fb3d0a00640 1 -- 172.21.15.152:0/1112947777 >> 172.21.15.152:0/1112947777 conn(0x7fb3cc0d0890 msgr2=0x7fb3cc0d0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:40.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.722+0000 7fb3d0a00640 1 -- 172.21.15.152:0/1112947777 shutdown_connections 2024-04-17T17:51:40.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.722+0000 7fb3d0a00640 1 -- 172.21.15.152:0/1112947777 wait complete. 2024-04-17T17:51:40.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.726+0000 7fb3d0a00640 1 Processor -- start 2024-04-17T17:51:40.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.726+0000 7fb3d0a00640 1 -- start start 2024-04-17T17:51:40.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.730+0000 7fb3d0a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb3cc0cf540 0x7fb3cc15f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:40.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.730+0000 7fb3d0a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3cc0d0030 0x7fb3cc147e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:40.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.730+0000 7fb3d0a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb3cc0ae9f0 0x7fb3cc0aee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:40.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.730+0000 7fb3d0a00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb3cc06f4b0 con 0x7fb3cc0d0030 2024-04-17T17:51:40.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.730+0000 7fb3d0a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb3cc06f330 con 0x7fb3cc0cf540 2024-04-17T17:51:40.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.730+0000 7fb3d0a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fb3cc169e60 con 0x7fb3cc0ae9f0 2024-04-17T17:51:40.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.730+0000 7fb3c9e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3cc0d0030 0x7fb3cc147e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:40.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.730+0000 7fb3c9e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3cc0d0030 0x7fb3cc147e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46068/0 (socket says 172.21.15.152:46068) 2024-04-17T17:51:40.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.730+0000 7fb3ca800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb3cc0cf540 0x7fb3cc15f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:40.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.730+0000 7fb3c9e00640 1 -- 172.21.15.152:0/247219074 learned_addr learned my addr 172.21.15.152:0/247219074 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T17:51:40.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.730+0000 7fb3cb200640 1 --2- 172.21.15.152:0/247219074 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb3cc0ae9f0 0x7fb3cc0aee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:40.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.730+0000 7fb3c9e00640 1 -- 172.21.15.152:0/247219074 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb3cc0ae9f0 msgr2=0x7fb3cc0aee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:40.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.730+0000 7fb3c9e00640 1 --2- 172.21.15.152:0/247219074 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb3cc0ae9f0 0x7fb3cc0aee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:40.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.730+0000 7fb3c9e00640 1 -- 172.21.15.152:0/247219074 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb3cc0cf540 msgr2=0x7fb3cc15f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:40.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.730+0000 7fb3c9e00640 1 --2- 172.21.15.152:0/247219074 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb3cc0cf540 0x7fb3cc15f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:40.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.730+0000 7fb3c9e00640 1 -- 172.21.15.152:0/247219074 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3cc148980 con 0x7fb3cc0d0030 2024-04-17T17:51:40.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.730+0000 7fb3c9e00640 1 --2- 172.21.15.152:0/247219074 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3cc0d0030 0x7fb3cc147e40 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 crypto rx=0x7fb3b800c430 tx=0x7fb3b800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:40.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.734+0000 7fb3c2a00640 1 -- 172.21.15.152:0/247219074 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b8017070 con 0x7fb3cc0d0030 2024-04-17T17:51:40.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.734+0000 7fb3c2a00640 1 -- 172.21.15.152:0/247219074 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3b8003650 con 0x7fb3cc0d0030 2024-04-17T17:51:40.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.734+0000 7fb3d0a00640 1 -- 172.21.15.152:0/247219074 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3cc0b4a60 con 0x7fb3cc0d0030 2024-04-17T17:51:40.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.734+0000 7fb3c2a00640 1 -- 172.21.15.152:0/247219074 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b8003a60 con 0x7fb3cc0d0030 2024-04-17T17:51:40.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.734+0000 7fb3d0a00640 1 -- 172.21.15.152:0/247219074 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3cc0ae4d0 con 0x7fb3cc0d0030 2024-04-17T17:51:40.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.734+0000 7fb3d0a00640 1 -- 172.21.15.152:0/247219074 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3cc075be0 con 0x7fb3cc0d0030 2024-04-17T17:51:40.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.734+0000 7fb3c2a00640 1 -- 172.21.15.152:0/247219074 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb3b801a070 con 0x7fb3cc0d0030 2024-04-17T17:51:40.742 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.738+0000 7fb3c2a00640 1 --2- 172.21.15.152:0/247219074 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb3ac0683b0 0x7fb3ac06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:40.742 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.738+0000 7fb3c2a00640 1 -- 172.21.15.152:0/247219074 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7fb3b8085a80 con 0x7fb3cc0d0030 2024-04-17T17:51:40.742 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.738+0000 7fb3ca800640 1 --2- 172.21.15.152:0/247219074 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb3ac0683b0 0x7fb3ac06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:40.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.738+0000 7fb3ca800640 1 --2- 172.21.15.152:0/247219074 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb3ac0683b0 0x7fb3ac06a870 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc0011f0 tx=0x7fb3bc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:40.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:40.754+0000 7fb3c2a00640 1 -- 172.21.15.152:0/247219074 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fb3b8055bd0 con 0x7fb3cc0d0030 2024-04-17T17:51:41.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:41.286+0000 7fb3d0a00640 1 -- 172.21.15.152:0/247219074 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fb3cc155e90 con 0x7fb3cc0d0030 2024-04-17T17:51:41.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:41.602+0000 7fb3c2a00640 1 -- 172.21.15.152:0/247219074 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7fb3b8059ed0 con 0x7fb3cc0d0030 2024-04-17T17:51:41.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:41.610+0000 7fb3d0a00640 1 -- 172.21.15.152:0/247219074 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb3ac0683b0 msgr2=0x7fb3ac06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:41.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:41.610+0000 7fb3d0a00640 1 --2- 172.21.15.152:0/247219074 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb3ac0683b0 0x7fb3ac06a870 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc0011f0 tx=0x7fb3bc009040 comp rx=0 tx=0).stop 2024-04-17T17:51:41.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:41.610+0000 7fb3d0a00640 1 -- 172.21.15.152:0/247219074 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3cc0d0030 msgr2=0x7fb3cc147e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:41.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:41.610+0000 7fb3d0a00640 1 --2- 172.21.15.152:0/247219074 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3cc0d0030 0x7fb3cc147e40 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 crypto rx=0x7fb3b800c430 tx=0x7fb3b800c8f0 comp rx=0 tx=0).stop 2024-04-17T17:51:41.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:41.610+0000 7fb3d0a00640 1 -- 172.21.15.152:0/247219074 shutdown_connections 2024-04-17T17:51:41.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:41.610+0000 7fb3d0a00640 1 --2- 172.21.15.152:0/247219074 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb3ac0683b0 0x7fb3ac06a870 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:41.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:41.610+0000 7fb3d0a00640 1 --2- 172.21.15.152:0/247219074 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb3cc0ae9f0 0x7fb3cc0aee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:41.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:41.610+0000 7fb3d0a00640 1 --2- 172.21.15.152:0/247219074 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3cc0d0030 0x7fb3cc147e40 unknown :-1 s=CLOSED pgs=2053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:41.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:41.610+0000 7fb3d0a00640 1 --2- 172.21.15.152:0/247219074 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb3cc0cf540 0x7fb3cc15f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:41.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:41.610+0000 7fb3d0a00640 1 -- 172.21.15.152:0/247219074 >> 172.21.15.152:0/247219074 conn(0x7fb3cc0d0890 msgr2=0x7fb3cc06d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:41.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:41.610+0000 7fb3d0a00640 1 -- 172.21.15.152:0/247219074 shutdown_connections 2024-04-17T17:51:41.615 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:41.610+0000 7fb3d0a00640 1 -- 172.21.15.152:0/247219074 wait complete. 2024-04-17T17:51:41.748 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2024-04-17T17:51:42.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.278+0000 7fe957000640 1 Processor -- start 2024-04-17T17:51:42.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.278+0000 7fe957000640 1 -- start start 2024-04-17T17:51:42.284 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.278+0000 7fe957000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe950154ce0 0x7fe950072610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:42.284 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.278+0000 7fe957000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fe95015b840 0x7fe9500d0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:42.284 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.282+0000 7fe957000640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe95006de00 con 0x7fe9500d0950 2024-04-17T17:51:42.284 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.282+0000 7fe957000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fe9500d0da0 con 0x7fe95015b840 2024-04-17T17:51:42.284 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.282+0000 7fe957000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fe9501550c0 con 0x7fe950154ce0 2024-04-17T17:51:42.284 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.282+0000 7fe94fe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe950154ce0 0x7fe950072610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:42.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.282+0000 7fe94fe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe950154ce0 0x7fe950072610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.152:51738/0 (socket says 172.21.15.152:51738) 2024-04-17T17:51:42.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.282+0000 7fe94fe00640 1 -- 172.21.15.152:0/1103903986 learned_addr learned my addr 172.21.15.152:0/1103903986 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T17:51:42.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.282+0000 7fe94f400640 1 --2- 172.21.15.152:0/1103903986 >> v2:172.21.15.196:3300/0 conn(0x7fe95015b840 0x7fe9500d0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:42.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.282+0000 7fe94fe00640 1 -- 172.21.15.152:0/1103903986 >> v2:172.21.15.196:3300/0 conn(0x7fe95015b840 msgr2=0x7fe9500d0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T17:51:42.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.282+0000 7fe94fe00640 1 --2- 172.21.15.152:0/1103903986 >> v2:172.21.15.196:3300/0 conn(0x7fe95015b840 0x7fe9500d0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:42.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.282+0000 7fe94fe00640 1 -- 172.21.15.152:0/1103903986 >> v1:172.21.15.152:6789/0 conn(0x7fe9500d0950 legacy=0x7fe95006b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:42.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.282+0000 7fe94fe00640 1 -- 172.21.15.152:0/1103903986 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe95006e0e0 con 0x7fe950154ce0 2024-04-17T17:51:42.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.282+0000 7fe94f400640 1 --2- 172.21.15.152:0/1103903986 >> v2:172.21.15.196:3300/0 conn(0x7fe95015b840 0x7fe9500d0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T17:51:42.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.290+0000 7fe94fe00640 1 --2- 172.21.15.152:0/1103903986 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe950154ce0 0x7fe950072610 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe940006fd0 tx=0x7fe940020c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e33bd6b14e562b server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:42.298 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.290+0000 7fe94ea00640 1 -- 172.21.15.152:0/1103903986 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9400af070 con 0x7fe950154ce0 2024-04-17T17:51:42.298 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.294+0000 7fe94ea00640 1 -- 172.21.15.152:0/1103903986 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9400a9c30 con 0x7fe950154ce0 2024-04-17T17:51:42.298 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.294+0000 7fe94ea00640 1 -- 172.21.15.152:0/1103903986 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9400a9e60 con 0x7fe950154ce0 2024-04-17T17:51:42.298 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.294+0000 7fe957000640 1 -- 172.21.15.152:0/1103903986 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe950154ce0 msgr2=0x7fe950072610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:42.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.294+0000 7fe957000640 1 --2- 172.21.15.152:0/1103903986 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe950154ce0 0x7fe950072610 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe940006fd0 tx=0x7fe940020c00 comp rx=0 tx=0).stop 2024-04-17T17:51:42.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.294+0000 7fe957000640 1 -- 172.21.15.152:0/1103903986 shutdown_connections 2024-04-17T17:51:42.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.294+0000 7fe957000640 1 --2- 172.21.15.152:0/1103903986 >> v2:172.21.15.196:3300/0 conn(0x7fe95015b840 0x7fe9500d0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:42.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.294+0000 7fe957000640 1 --2- 172.21.15.152:0/1103903986 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe950154ce0 0x7fe950072610 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:42.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.294+0000 7fe957000640 1 -- 172.21.15.152:0/1103903986 >> 172.21.15.152:0/1103903986 conn(0x7fe9500b3350 msgr2=0x7fe9500b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:42.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.294+0000 7fe957000640 1 -- 172.21.15.152:0/1103903986 shutdown_connections 2024-04-17T17:51:42.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.298+0000 7fe957000640 1 -- 172.21.15.152:0/1103903986 wait complete. 2024-04-17T17:51:42.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.310+0000 7fe957000640 1 Processor -- start 2024-04-17T17:51:42.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.310+0000 7fe957000640 1 -- start start 2024-04-17T17:51:42.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.310+0000 7fe957000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe9500d0950 0x7fe9501fb760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:42.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.310+0000 7fe957000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe950154ce0 0x7fe9500af7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:42.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.310+0000 7fe957000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe95015b840 0x7fe95009cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:42.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.310+0000 7fe957000640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe950072b50 con 0x7fe95015b840 2024-04-17T17:51:42.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.310+0000 7fe957000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe95006e6a0 con 0x7fe9500d0950 2024-04-17T17:51:42.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.310+0000 7fe957000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fe95015bd80 con 0x7fe950154ce0 2024-04-17T17:51:42.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.314+0000 7fe94fe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe9500d0950 0x7fe9501fb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:42.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.314+0000 7fe94f400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe950154ce0 0x7fe9500af7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:42.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.314+0000 7fe94fe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe9500d0950 0x7fe9501fb760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.152:36410/0 (socket says 172.21.15.152:36410) 2024-04-17T17:51:42.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.314+0000 7fe94fe00640 1 -- 172.21.15.152:0/2605893139 learned_addr learned my addr 172.21.15.152:0/2605893139 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T17:51:42.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.318+0000 7fe955000640 1 --2- 172.21.15.152:0/2605893139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe95015b840 0x7fe95009cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:42.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.318+0000 7fe94fe00640 1 -- 172.21.15.152:0/2605893139 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe950154ce0 msgr2=0x7fe9500af7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:42.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.318+0000 7fe94fe00640 1 --2- 172.21.15.152:0/2605893139 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe950154ce0 0x7fe9500af7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:42.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.318+0000 7fe94fe00640 1 -- 172.21.15.152:0/2605893139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe95015b840 msgr2=0x7fe95009cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:42.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.318+0000 7fe94fe00640 1 --2- 172.21.15.152:0/2605893139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe95015b840 0x7fe95009cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:42.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.318+0000 7fe94fe00640 1 -- 172.21.15.152:0/2605893139 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9500b00a0 con 0x7fe9500d0950 2024-04-17T17:51:42.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.318+0000 7fe94f400640 1 --2- 172.21.15.152:0/2605893139 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe950154ce0 0x7fe9500af7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T17:51:42.328 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.322+0000 7fe94fe00640 1 --2- 172.21.15.152:0/2605893139 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe9500d0950 0x7fe9501fb760 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fe9400214a0 tx=0x7fe94001d9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:42.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.326+0000 7fe947e00640 1 -- 172.21.15.152:0/2605893139 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9400af070 con 0x7fe9500d0950 2024-04-17T17:51:42.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.326+0000 7fe947e00640 1 -- 172.21.15.152:0/2605893139 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe940011070 con 0x7fe9500d0950 2024-04-17T17:51:42.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.326+0000 7fe947e00640 1 -- 172.21.15.152:0/2605893139 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9400af070 con 0x7fe9500d0950 2024-04-17T17:51:42.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.326+0000 7fe957000640 1 -- 172.21.15.152:0/2605893139 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9500b0380 con 0x7fe9500d0950 2024-04-17T17:51:42.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.326+0000 7fe957000640 1 -- 172.21.15.152:0/2605893139 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9500b0940 con 0x7fe9500d0950 2024-04-17T17:51:42.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.330+0000 7fe957000640 1 -- 172.21.15.152:0/2605893139 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe950068a30 con 0x7fe9500d0950 2024-04-17T17:51:42.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.334+0000 7fe947e00640 1 -- 172.21.15.152:0/2605893139 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe9400039d0 con 0x7fe9500d0950 2024-04-17T17:51:42.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.334+0000 7fe947e00640 1 --2- 172.21.15.152:0/2605893139 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fe930068580 0x7fe93006aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:42.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.334+0000 7fe947e00640 1 -- 172.21.15.152:0/2605893139 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7fe940120630 con 0x7fe9500d0950 2024-04-17T17:51:42.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.342+0000 7fe94f400640 1 --2- 172.21.15.152:0/2605893139 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fe930068580 0x7fe93006aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:42.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.346+0000 7fe947e00640 1 -- 172.21.15.152:0/2605893139 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fe9400c1070 con 0x7fe9500d0950 2024-04-17T17:51:42.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.350+0000 7fe94f400640 1 --2- 172.21.15.152:0/2605893139 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fe930068580 0x7fe93006aa40 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fe95009a040 tx=0x7fe93c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:42.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:42.878+0000 7fe957000640 1 -- 172.21.15.152:0/2605893139 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) -- 0x7fe9500b3730 con 0x7fe9500d0950 2024-04-17T17:51:43.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:43.298+0000 7fe947e00640 1 -- 172.21.15.152:0/2605893139 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v16447) ==== 144+0+0 (secure 0 0 0) 0x7fe94001a880 con 0x7fe9500d0950 2024-04-17T17:51:43.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:43.310+0000 7fe957000640 1 -- 172.21.15.152:0/2605893139 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fe930068580 msgr2=0x7fe93006aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:43.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:43.310+0000 7fe957000640 1 --2- 172.21.15.152:0/2605893139 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fe930068580 0x7fe93006aa40 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fe95009a040 tx=0x7fe93c008040 comp rx=0 tx=0).stop 2024-04-17T17:51:43.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:43.310+0000 7fe957000640 1 -- 172.21.15.152:0/2605893139 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe9500d0950 msgr2=0x7fe9501fb760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:43.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:43.310+0000 7fe957000640 1 --2- 172.21.15.152:0/2605893139 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe9500d0950 0x7fe9501fb760 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fe9400214a0 tx=0x7fe94001d9a0 comp rx=0 tx=0).stop 2024-04-17T17:51:43.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:43.314+0000 7fe957000640 1 -- 172.21.15.152:0/2605893139 shutdown_connections 2024-04-17T17:51:43.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:43.314+0000 7fe957000640 1 --2- 172.21.15.152:0/2605893139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe95015b840 0x7fe95009cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:43.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:43.314+0000 7fe957000640 1 --2- 172.21.15.152:0/2605893139 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fe930068580 0x7fe93006aa40 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:43.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:43.314+0000 7fe957000640 1 --2- 172.21.15.152:0/2605893139 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe950154ce0 0x7fe9500af7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:43.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:43.314+0000 7fe957000640 1 --2- 172.21.15.152:0/2605893139 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe9500d0950 0x7fe9501fb760 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:43.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:43.314+0000 7fe957000640 1 -- 172.21.15.152:0/2605893139 >> 172.21.15.152:0/2605893139 conn(0x7fe9500b3350 msgr2=0x7fe9500b1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:43.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:43.314+0000 7fe957000640 1 -- 172.21.15.152:0/2605893139 shutdown_connections 2024-04-17T17:51:43.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:43.314+0000 7fe957000640 1 -- 172.21.15.152:0/2605893139 wait complete. 2024-04-17T17:51:43.407 INFO:tasks.cephfs_test_runner:test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) ... FAIL 2024-04-17T17:51:43.407 INFO:tasks.cephfs_test_runner: 2024-04-17T17:51:43.407 INFO:tasks.cephfs_test_runner:====================================================================== 2024-04-17T17:51:43.407 INFO:tasks.cephfs_test_runner:FAIL: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-04-17T17:51:43.407 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-17T17:51:43.407 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-04-17T17:51:43.407 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2024-04-17T17:51:43.407 INFO:tasks.cephfs_test_runner: self.run_generic_tests() 2024-04-17T17:51:43.407 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa/tasks/cephfs/xfstests_dev.py", line 407, in run_generic_tests 2024-04-17T17:51:43.407 INFO:tasks.cephfs_test_runner: return self.run_testdir('generic') 2024-04-17T17:51:43.407 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa/tasks/cephfs/xfstests_dev.py", line 399, in run_testdir 2024-04-17T17:51:43.408 INFO:tasks.cephfs_test_runner: self.assertEqual(self.total_tests_failed, 0) 2024-04-17T17:51:43.408 INFO:tasks.cephfs_test_runner:AssertionError: 17 != 0 2024-04-17T17:51:43.408 INFO:tasks.cephfs_test_runner: 2024-04-17T17:51:43.408 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-17T17:51:43.408 INFO:tasks.cephfs_test_runner:Ran 1 test in 32658.260s 2024-04-17T17:51:43.408 INFO:tasks.cephfs_test_runner: 2024-04-17T17:51:43.408 INFO:tasks.cephfs_test_runner:FAILED (failures=1) 2024-04-17T17:51:43.408 INFO:tasks.cephfs_test_runner: 2024-04-17T17:51:43.408 INFO:tasks.cephfs_test_runner:====================================================================== 2024-04-17T17:51:43.408 INFO:tasks.cephfs_test_runner:FAIL: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-04-17T17:51:43.408 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-17T17:51:43.408 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-04-17T17:51:43.408 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2024-04-17T17:51:43.408 INFO:tasks.cephfs_test_runner: self.run_generic_tests() 2024-04-17T17:51:43.408 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa/tasks/cephfs/xfstests_dev.py", line 407, in run_generic_tests 2024-04-17T17:51:43.408 INFO:tasks.cephfs_test_runner: return self.run_testdir('generic') 2024-04-17T17:51:43.408 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa/tasks/cephfs/xfstests_dev.py", line 399, in run_testdir 2024-04-17T17:51:43.409 INFO:tasks.cephfs_test_runner: self.assertEqual(self.total_tests_failed, 0) 2024-04-17T17:51:43.409 INFO:tasks.cephfs_test_runner:AssertionError: 17 != 0 2024-04-17T17:51:43.409 INFO:tasks.cephfs_test_runner: 2024-04-17T17:51:43.409 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-04-17T17:51:43.632 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=164819eeb8ed43e38bfffab4084c4617 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-04-17T17:51:43.633 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-04-17T17:51:43.643 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-17T17:51:43.676 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-17T17:51:43.677 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-17T17:51:43.677 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-17T17:51:43.731 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350312k,nr_inodes=4087578,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3038 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-17T17:51:43.732 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-04-17T17:51:43.732 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-17T17:51:43.838 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350312k,nr_inodes=4087578,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3038 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-17T17:51:43.839 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-17T17:51:43.839 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-17T17:51:43.849 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350260k,nr_inodes=4087565,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7575 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-17T17:51:43.849 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-17T17:51:43.849 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-17T17:51:43.900 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350260k,nr_inodes=4087565,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7575 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-17T17:51:43.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T17:51:43.901 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list 2024-04-17T17:51:43.913 INFO:teuthology.orchestra.run.smithi152.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-17T17:51:43.913 INFO:teuthology.orchestra.run.smithi152.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-17T17:51:43.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T17:51:43.914 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-17T17:51:44.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T17:51:44.076 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-17T17:51:44.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T17:51:44.210 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link delete ceph-brx 2024-04-17T17:51:44.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T17:51:44.457 DEBUG:teuthology.orchestra.run.smithi196:> ip netns list 2024-04-17T17:51:44.467 INFO:teuthology.orchestra.run.smithi196.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-17T17:51:44.467 INFO:teuthology.orchestra.run.smithi196.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-17T17:51:44.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T17:51:44.468 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-17T17:51:44.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T17:51:44.535 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-17T17:51:44.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T17:51:44.598 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip link delete ceph-brx 2024-04-17T17:51:44.759 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-17T17:51:44.770 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-17T17:51:44.770 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T17:51:45.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.178+0000 7fdbf0e00640 1 Processor -- start 2024-04-17T17:51:45.183 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.178+0000 7fdbf0e00640 1 -- start start 2024-04-17T17:51:45.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.182+0000 7fdbf0e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fdbec158de0 0x7fdbec06ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:45.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.182+0000 7fdbf0e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdbec0b4f20 0x7fdbec072f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:45.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.182+0000 7fdbf0e00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fdbec06f3b0 0x7fdbec0734b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:45.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.182+0000 7fdbf0e00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fdbec0b41f0 con 0x7fdbec06f3b0 2024-04-17T17:51:45.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.182+0000 7fdbf0e00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fdbec06f910 con 0x7fdbec158de0 2024-04-17T17:51:45.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.182+0000 7fdbf0e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fdbec0b4440 con 0x7fdbec0b4f20 2024-04-17T17:51:45.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.182+0000 7fdbebe00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fdbec06f3b0 0x7fdbec0734b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:45.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.182+0000 7fdbebe00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fdbec06f3b0 0x7fdbec0734b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46104/0 (socket says 172.21.15.152:46104) 2024-04-17T17:51:45.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.182+0000 7fdbebe00640 1 -- 172.21.15.152:0/2252604046 learned_addr learned my addr 172.21.15.152:0/2252604046 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T17:51:45.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.182+0000 7fdbeb400640 1 --2- 172.21.15.152:0/2252604046 >> v2:172.21.15.196:3300/0 conn(0x7fdbec158de0 0x7fdbec06ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:45.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.182+0000 7fdbeaa00640 1 --2- 172.21.15.152:0/2252604046 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdbec0b4f20 0x7fdbec072f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:45.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.182+0000 7fdbebe00640 1 -- 172.21.15.152:0/2252604046 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdbec0b4f20 msgr2=0x7fdbec072f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T17:51:45.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.182+0000 7fdbebe00640 1 --2- 172.21.15.152:0/2252604046 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdbec0b4f20 0x7fdbec072f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:45.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.182+0000 7fdbebe00640 1 -- 172.21.15.152:0/2252604046 >> v2:172.21.15.196:3300/0 conn(0x7fdbec158de0 msgr2=0x7fdbec06ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T17:51:45.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.182+0000 7fdbebe00640 1 --2- 172.21.15.152:0/2252604046 >> v2:172.21.15.196:3300/0 conn(0x7fdbec158de0 0x7fdbec06ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:45.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.186+0000 7fdbebe00640 1 -- 172.21.15.152:0/2252604046 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbec0b4720 con 0x7fdbec06f3b0 2024-04-17T17:51:45.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.190+0000 7fdbebe00640 1 --2- 172.21.15.152:0/2252604046 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdbec06f3b0 0x7fdbec0734b0 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 crypto rx=0x7fdbec0725d0 tx=0x7fdbe401ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=282558aeb72ddc2 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:45.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.194+0000 7fdbea000640 1 -- 172.21.15.152:0/2252604046 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe40a7890 con 0x7fdbec06f3b0 2024-04-17T17:51:45.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.194+0000 7fdbea000640 1 -- 172.21.15.152:0/2252604046 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbe40a7a30 con 0x7fdbec06f3b0 2024-04-17T17:51:45.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.194+0000 7fdbea000640 1 -- 172.21.15.152:0/2252604046 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe40a7e00 con 0x7fdbec06f3b0 2024-04-17T17:51:45.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.194+0000 7fdbf0e00640 1 -- 172.21.15.152:0/2252604046 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdbec06f3b0 msgr2=0x7fdbec0734b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:45.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.194+0000 7fdbf0e00640 1 --2- 172.21.15.152:0/2252604046 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdbec06f3b0 0x7fdbec0734b0 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 crypto rx=0x7fdbec0725d0 tx=0x7fdbe401ec00 comp rx=0 tx=0).stop 2024-04-17T17:51:45.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.194+0000 7fdbf0e00640 1 -- 172.21.15.152:0/2252604046 shutdown_connections 2024-04-17T17:51:45.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.194+0000 7fdbf0e00640 1 --2- 172.21.15.152:0/2252604046 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdbec06f3b0 0x7fdbec0734b0 unknown :-1 s=CLOSED pgs=2055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:45.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.194+0000 7fdbf0e00640 1 --2- 172.21.15.152:0/2252604046 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdbec0b4f20 0x7fdbec072f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:45.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.194+0000 7fdbf0e00640 1 --2- 172.21.15.152:0/2252604046 >> v2:172.21.15.196:3300/0 conn(0x7fdbec158de0 0x7fdbec06ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:45.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.194+0000 7fdbf0e00640 1 -- 172.21.15.152:0/2252604046 >> 172.21.15.152:0/2252604046 conn(0x7fdbec0b32f0 msgr2=0x7fdbec0b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:45.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.194+0000 7fdbf0e00640 1 -- 172.21.15.152:0/2252604046 shutdown_connections 2024-04-17T17:51:45.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.194+0000 7fdbf0e00640 1 -- 172.21.15.152:0/2252604046 wait complete. 2024-04-17T17:51:45.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.198+0000 7fdbf0e00640 1 Processor -- start 2024-04-17T17:51:45.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.198+0000 7fdbf0e00640 1 -- start start 2024-04-17T17:51:45.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.198+0000 7fdbf0e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdbec06f3b0 0x7fdbec0b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:45.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.198+0000 7fdbf0e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdbec0b4f20 0x7fdbec14db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:45.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.198+0000 7fdbf0e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdbec158de0 0x7fdbec0cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:45.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.198+0000 7fdbf0e00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdbec15f770 con 0x7fdbec06f3b0 2024-04-17T17:51:45.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.198+0000 7fdbf0e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fdbec1593d0 con 0x7fdbec158de0 2024-04-17T17:51:45.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.198+0000 7fdbf0e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fdbec15f8f0 con 0x7fdbec0b4f20 2024-04-17T17:51:45.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.198+0000 7fdbeb400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdbec06f3b0 0x7fdbec0b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:45.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.198+0000 7fdbeb400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdbec06f3b0 0x7fdbec0b1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46108/0 (socket says 172.21.15.152:46108) 2024-04-17T17:51:45.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.198+0000 7fdbeb400640 1 -- 172.21.15.152:0/219151747 learned_addr learned my addr 172.21.15.152:0/219151747 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T17:51:45.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.198+0000 7fdbebe00640 1 --2- 172.21.15.152:0/219151747 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdbec158de0 0x7fdbec0cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:45.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.198+0000 7fdbeb400640 1 -- 172.21.15.152:0/219151747 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdbec0b4f20 msgr2=0x7fdbec14db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:45.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.198+0000 7fdbeaa00640 1 --2- 172.21.15.152:0/219151747 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdbec0b4f20 0x7fdbec14db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:45.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.198+0000 7fdbeb400640 1 --2- 172.21.15.152:0/219151747 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdbec0b4f20 0x7fdbec14db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:45.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.198+0000 7fdbeb400640 1 -- 172.21.15.152:0/219151747 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdbec158de0 msgr2=0x7fdbec0cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:45.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.198+0000 7fdbeb400640 1 --2- 172.21.15.152:0/219151747 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdbec158de0 0x7fdbec0cfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:45.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.198+0000 7fdbeb400640 1 -- 172.21.15.152:0/219151747 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbec1574d0 con 0x7fdbec06f3b0 2024-04-17T17:51:45.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.198+0000 7fdbebe00640 1 --2- 172.21.15.152:0/219151747 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdbec158de0 0x7fdbec0cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T17:51:45.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.198+0000 7fdbeaa00640 1 --2- 172.21.15.152:0/219151747 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdbec0b4f20 0x7fdbec14db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T17:51:45.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.198+0000 7fdbeb400640 1 --2- 172.21.15.152:0/219151747 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdbec06f3b0 0x7fdbec0b1cf0 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc00e7f0 tx=0x7fdbdc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:45.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.198+0000 7fdbe3400640 1 -- 172.21.15.152:0/219151747 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc020070 con 0x7fdbec06f3b0 2024-04-17T17:51:45.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.198+0000 7fdbf0e00640 1 -- 172.21.15.152:0/219151747 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbec0b27e0 con 0x7fdbec06f3b0 2024-04-17T17:51:45.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.198+0000 7fdbf0e00640 1 -- 172.21.15.152:0/219151747 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbec157a20 con 0x7fdbec06f3b0 2024-04-17T17:51:45.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.198+0000 7fdbe3400640 1 -- 172.21.15.152:0/219151747 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbdc00c940 con 0x7fdbec06f3b0 2024-04-17T17:51:45.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.198+0000 7fdbe3400640 1 -- 172.21.15.152:0/219151747 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc00ccf0 con 0x7fdbec06f3b0 2024-04-17T17:51:45.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.202+0000 7fdbf0e00640 1 -- 172.21.15.152:0/219151747 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbc40052a0 con 0x7fdbec06f3b0 2024-04-17T17:51:45.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.206+0000 7fdbe3400640 1 -- 172.21.15.152:0/219151747 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdbdc023070 con 0x7fdbec06f3b0 2024-04-17T17:51:45.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.210+0000 7fdbe3400640 1 --2- 172.21.15.152:0/219151747 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fdbcc068380 0x7fdbcc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:45.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.210+0000 7fdbe3400640 1 -- 172.21.15.152:0/219151747 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7fdbdc08aa30 con 0x7fdbec06f3b0 2024-04-17T17:51:45.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.210+0000 7fdbeaa00640 1 --2- 172.21.15.152:0/219151747 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fdbcc068380 0x7fdbcc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:45.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.214+0000 7fdbeaa00640 1 --2- 172.21.15.152:0/219151747 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fdbcc068380 0x7fdbcc06a840 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fdbec154fc0 tx=0x7fdbd8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:45.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.218+0000 7fdbe3400640 1 -- 172.21.15.152:0/219151747 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fdbdc02a020 con 0x7fdbec06f3b0 2024-04-17T17:51:45.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.386+0000 7fdbf0e00640 1 -- 172.21.15.152:0/219151747 --> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdbc4000bd0 con 0x7fdbcc068380 2024-04-17T17:51:45.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.434+0000 7fdbe3400640 1 -- 172.21.15.152:0/219151747 <== mgr.4104 v2:172.21.15.152:6832/3078522445 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13705 (secure 0 0 0) 0x7fdbc4000bd0 con 0x7fdbcc068380 2024-04-17T17:51:45.439 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T17:51:45.439 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2024-04-17T17:51:45.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.438+0000 7fdbf0e00640 1 -- 172.21.15.152:0/219151747 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fdbcc068380 msgr2=0x7fdbcc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:45.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.438+0000 7fdbf0e00640 1 --2- 172.21.15.152:0/219151747 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fdbcc068380 0x7fdbcc06a840 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fdbec154fc0 tx=0x7fdbd8008040 comp rx=0 tx=0).stop 2024-04-17T17:51:45.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.438+0000 7fdbf0e00640 1 -- 172.21.15.152:0/219151747 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdbec06f3b0 msgr2=0x7fdbec0b1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:45.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.438+0000 7fdbf0e00640 1 --2- 172.21.15.152:0/219151747 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdbec06f3b0 0x7fdbec0b1cf0 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc00e7f0 tx=0x7fdbdc00ecb0 comp rx=0 tx=0).stop 2024-04-17T17:51:45.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.438+0000 7fdbf0e00640 1 -- 172.21.15.152:0/219151747 shutdown_connections 2024-04-17T17:51:45.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.438+0000 7fdbf0e00640 1 --2- 172.21.15.152:0/219151747 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdbec158de0 0x7fdbec0cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:45.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.438+0000 7fdbf0e00640 1 --2- 172.21.15.152:0/219151747 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fdbcc068380 0x7fdbcc06a840 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:45.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.438+0000 7fdbf0e00640 1 --2- 172.21.15.152:0/219151747 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdbec0b4f20 0x7fdbec14db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:45.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.438+0000 7fdbf0e00640 1 --2- 172.21.15.152:0/219151747 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdbec06f3b0 0x7fdbec0b1cf0 unknown :-1 s=CLOSED pgs=2056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:45.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.438+0000 7fdbf0e00640 1 -- 172.21.15.152:0/219151747 >> 172.21.15.152:0/219151747 conn(0x7fdbec0b32f0 msgr2=0x7fdbec0b0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:45.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.438+0000 7fdbf0e00640 1 -- 172.21.15.152:0/219151747 shutdown_connections 2024-04-17T17:51:45.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.438+0000 7fdbf0e00640 1 -- 172.21.15.152:0/219151747 wait complete. 2024-04-17T17:51:45.468 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":16384,"stamp":"2024-04-17T17:51:44.908904+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":141,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":12901828,"kb_used_data":437448,"kb_used_omap":3922,"kb_used_meta":12433645,"kb_avail":742072892,"statfs":{"total":773094113280,"available":759882641408,"internally_reserved":0,"allocated":447946752,"data_stored":445290517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4016990,"internal_metadata":12732052642},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":563,"apply_latency_ms":563,"commit_latency_ns":563000000,"apply_latency_ns":563000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1129180853,"num_objects":-6808,"num_object_clones":0,"num_object_copies":-13616,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-6808,"num_whiteouts":0,"num_read":-2020543,"num_read_kb":-140884569,"num_write":-7612726,"num_write_kb":-206859659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-87,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.538302"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":483,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-17T17:51:41.078371+0000","last_change":"2024-04-17T08:46:22.807988+0000","last_active":"2024-04-17T17:51:41.078371+0000","last_peered":"2024-04-17T17:51:41.078371+0000","last_clean":"2024-04-17T17:51:41.078371+0000","last_became_active":"2024-04-17T08:46:22.806843+0000","last_became_peered":"2024-04-17T08:46:22.806843+0000","last_unstale":"2024-04-17T17:51:41.078371+0000","last_undegraded":"2024-04-17T17:51:41.078371+0000","last_fullsized":"2024-04-17T17:51:41.078371+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:21.741557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:21.741557+0000","last_clean_scrub_stamp":"2024-04-17T08:46:21.741557+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:28:38.254696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834581392,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1527172,"kb_used_data":1084,"kb_used_omap":548,"kb_used_meta":1521435,"kb_avail":92844668,"statfs":{"total":96636764160,"available":95072940032,"internally_reserved":0,"allocated":1110016,"data_stored":812444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":561386,"internal_metadata":1557950230},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834581394,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1741720,"kb_used_data":98952,"kb_used_omap":648,"kb_used_meta":1642103,"kb_avail":92630120,"statfs":{"total":96636764160,"available":94853242880,"internally_reserved":0,"allocated":101326848,"data_stored":100958631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":664377,"internal_metadata":1681513671},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834581392,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1300856,"kb_used_data":496,"kb_used_omap":755,"kb_used_meta":1299596,"kb_avail":93070984,"statfs":{"total":96636764160,"available":95304687616,"internally_reserved":0,"allocated":507904,"data_stored":221795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":773576,"internal_metadata":1330786872},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834581394,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1741692,"kb_used_data":496,"kb_used_omap":1137,"kb_used_meta":1740046,"kb_avail":92630148,"statfs":{"total":96636764160,"available":94853271552,"internally_reserved":0,"allocated":507904,"data_stored":221795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1164464,"internal_metadata":1781807952},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834581335,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1807656,"kb_used_data":152796,"kb_used_omap":255,"kb_used_meta":1654592,"kb_avail":92564184,"statfs":{"total":96636764160,"available":94785724416,"internally_reserved":0,"allocated":156463104,"data_stored":156079324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":261991,"internal_metadata":1694302361},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":87,"apply_latency_ms":87,"commit_latency_ns":87000000,"apply_latency_ns":87000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834581343,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1747400,"kb_used_data":50552,"kb_used_omap":276,"kb_used_meta":1680171,"kb_avail":92624440,"statfs":{"total":96636764160,"available":94847426560,"internally_reserved":0,"allocated":51765248,"data_stored":51441928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":283299,"internal_metadata":1720495453},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":133,"apply_latency_ms":133,"commit_latency_ns":133000000,"apply_latency_ns":133000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834581351,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1577932,"kb_used_data":90912,"kb_used_omap":27,"kb_used_meta":1480740,"kb_avail":92793908,"statfs":{"total":96636764160,"available":95020961792,"internally_reserved":0,"allocated":93093888,"data_stored":92724018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28320,"internal_metadata":1516278112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":85,"apply_latency_ms":85,"commit_latency_ns":85000000,"apply_latency_ns":85000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834581343,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1457400,"kb_used_data":42160,"kb_used_omap":273,"kb_used_meta":1414958,"kb_avail":92914440,"statfs":{"total":96636764160,"available":95144386560,"internally_reserved":0,"allocated":43171840,"data_stored":42830582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":279577,"internal_metadata":1448917991},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":133,"apply_latency_ms":133,"commit_latency_ns":133000000,"apply_latency_ns":133000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T17:51:45.468 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T17:51:45.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.858+0000 7f424c200640 1 Processor -- start 2024-04-17T17:51:45.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.858+0000 7f424c200640 1 -- start start 2024-04-17T17:51:45.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.862+0000 7f424c200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4244147690 0x7f42441622e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:45.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.862+0000 7f424c200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f4244147a90 0x7f4244071790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:45.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.862+0000 7f424c200640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4244162820 con 0x7f4244071cd0 2024-04-17T17:51:45.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.862+0000 7f424c200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f4244072130 con 0x7f4244147a90 2024-04-17T17:51:45.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.862+0000 7f424c200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f4244162aa0 con 0x7f4244147690 2024-04-17T17:51:45.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.862+0000 7f424a200640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f4244071cd0 0x7f424415ece0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:53188/0 (socket says 172.21.15.152:53188) 2024-04-17T17:51:45.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.862+0000 7f424a200640 1 -- 172.21.15.152:0/2079306369 learned_addr learned my addr 172.21.15.152:0/2079306369 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T17:51:45.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.862+0000 7f4248e00640 1 --2- 172.21.15.152:0/2079306369 >> v2:172.21.15.196:3300/0 conn(0x7f4244147a90 0x7f4244071790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:45.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.862+0000 7f4249800640 1 --2- 172.21.15.152:0/2079306369 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4244147690 0x7f42441622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:45.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.862+0000 7f4243e00640 1 -- 172.21.15.152:0/2079306369 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1949938652 0 0) 0x7f423c0014a0 con 0x7f4244071cd0 2024-04-17T17:51:45.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.862+0000 7f4243e00640 1 -- 172.21.15.152:0/2079306369 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f422c003530 con 0x7f4244071cd0 2024-04-17T17:51:45.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.862+0000 7f4249800640 1 -- 172.21.15.152:0/2079306369 >> v2:172.21.15.196:3300/0 conn(0x7f4244147a90 msgr2=0x7f4244071790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T17:51:45.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.862+0000 7f4249800640 1 --2- 172.21.15.152:0/2079306369 >> v2:172.21.15.196:3300/0 conn(0x7f4244147a90 0x7f4244071790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:45.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.862+0000 7f4249800640 1 -- 172.21.15.152:0/2079306369 >> v1:172.21.15.152:6789/0 conn(0x7f4244071cd0 legacy=0x7f424415ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:45.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.862+0000 7f4249800640 1 -- 172.21.15.152:0/2079306369 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4244162d80 con 0x7f4244147690 2024-04-17T17:51:45.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.870+0000 7f4249800640 1 --2- 172.21.15.152:0/2079306369 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4244147690 0x7f42441622e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f42380097c0 tx=0x7f423801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=998948122192b5e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:45.875 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.870+0000 7f4243e00640 1 -- 172.21.15.152:0/2079306369 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42380b0070 con 0x7f4244147690 2024-04-17T17:51:45.875 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.870+0000 7f4243e00640 1 -- 172.21.15.152:0/2079306369 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f424415fc00 con 0x7f4244147690 2024-04-17T17:51:45.875 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.870+0000 7f4243e00640 1 -- 172.21.15.152:0/2079306369 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42380ab820 con 0x7f4244147690 2024-04-17T17:51:45.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.874+0000 7f424c200640 1 -- 172.21.15.152:0/2079306369 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4244147690 msgr2=0x7f42441622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:45.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.874+0000 7f424c200640 1 --2- 172.21.15.152:0/2079306369 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4244147690 0x7f42441622e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f42380097c0 tx=0x7f423801c4a0 comp rx=0 tx=0).stop 2024-04-17T17:51:45.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.874+0000 7f424c200640 1 -- 172.21.15.152:0/2079306369 shutdown_connections 2024-04-17T17:51:45.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.874+0000 7f424c200640 1 --2- 172.21.15.152:0/2079306369 >> v2:172.21.15.196:3300/0 conn(0x7f4244147a90 0x7f4244071790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:45.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.874+0000 7f424c200640 1 --2- 172.21.15.152:0/2079306369 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4244147690 0x7f42441622e0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:45.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.874+0000 7f424c200640 1 -- 172.21.15.152:0/2079306369 >> 172.21.15.152:0/2079306369 conn(0x7f42440d2350 msgr2=0x7f42440d2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:45.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.874+0000 7f424c200640 1 -- 172.21.15.152:0/2079306369 shutdown_connections 2024-04-17T17:51:45.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.874+0000 7f424c200640 1 -- 172.21.15.152:0/2079306369 wait complete. 2024-04-17T17:51:45.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.878+0000 7f424c200640 1 Processor -- start 2024-04-17T17:51:45.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.878+0000 7f424c200640 1 -- start start 2024-04-17T17:51:45.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.882+0000 7f424c200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4244071cd0 0x7f424415da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:45.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.882+0000 7f424c200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4244147690 0x7f424413ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:45.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.882+0000 7f424c200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4244147a90 0x7f4244161090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:45.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.882+0000 7f424c200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f424416ba10 con 0x7f4244147a90 2024-04-17T17:51:45.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.882+0000 7f424c200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f424416b890 con 0x7f4244147690 2024-04-17T17:51:45.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.882+0000 7f424c200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f424416bb90 con 0x7f4244071cd0 2024-04-17T17:51:45.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.882+0000 7f4249800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4244071cd0 0x7f424415da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:45.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.882+0000 7f4248e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4244147690 0x7f424413ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:45.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.882+0000 7f4249800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4244071cd0 0x7f424415da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.152:51802/0 (socket says 172.21.15.152:51802) 2024-04-17T17:51:45.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.882+0000 7f4249800640 1 -- 172.21.15.152:0/3756067270 learned_addr learned my addr 172.21.15.152:0/3756067270 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T17:51:45.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.882+0000 7f4248e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4244147690 0x7f424413ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.152:36450/0 (socket says 172.21.15.152:36450) 2024-04-17T17:51:45.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.882+0000 7f424a200640 1 --2- 172.21.15.152:0/3756067270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4244147a90 0x7f4244161090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:45.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.882+0000 7f4249800640 1 -- 172.21.15.152:0/3756067270 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4244147690 msgr2=0x7f424413ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:45.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.882+0000 7f4249800640 1 --2- 172.21.15.152:0/3756067270 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4244147690 0x7f424413ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:45.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.882+0000 7f4249800640 1 -- 172.21.15.152:0/3756067270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4244147a90 msgr2=0x7f4244161090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:45.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.882+0000 7f4249800640 1 --2- 172.21.15.152:0/3756067270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4244147a90 0x7f4244161090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:45.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.882+0000 7f4249800640 1 -- 172.21.15.152:0/3756067270 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f424413f230 con 0x7f4244071cd0 2024-04-17T17:51:45.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.882+0000 7f424a200640 1 --2- 172.21.15.152:0/3756067270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4244147a90 0x7f4244161090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T17:51:45.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.882+0000 7f4249800640 1 --2- 172.21.15.152:0/3756067270 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4244071cd0 0x7f424415da00 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f42380ae040 tx=0x7f423801ace0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:45.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.882+0000 7f4241600640 1 -- 172.21.15.152:0/3756067270 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42380b0050 con 0x7f4244071cd0 2024-04-17T17:51:45.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.882+0000 7f4241600640 1 -- 172.21.15.152:0/3756067270 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42380bc070 con 0x7f4244071cd0 2024-04-17T17:51:45.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.882+0000 7f4241600640 1 -- 172.21.15.152:0/3756067270 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42380b7690 con 0x7f4244071cd0 2024-04-17T17:51:45.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.882+0000 7f424c200640 1 -- 172.21.15.152:0/3756067270 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f424415e100 con 0x7f4244071cd0 2024-04-17T17:51:45.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.882+0000 7f424c200640 1 -- 172.21.15.152:0/3756067270 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f42440c98a0 con 0x7f4244071cd0 2024-04-17T17:51:45.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.886+0000 7f424c200640 1 -- 172.21.15.152:0/3756067270 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4244068a30 con 0x7f4244071cd0 2024-04-17T17:51:45.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.890+0000 7f4241600640 1 -- 172.21.15.152:0/3756067270 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f42380b7830 con 0x7f4244071cd0 2024-04-17T17:51:45.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.890+0000 7f4241600640 1 --2- 172.21.15.152:0/3756067270 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f42240683d0 0x7f422406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:45.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.890+0000 7f4241600640 1 -- 172.21.15.152:0/3756067270 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f4238120e70 con 0x7f4244071cd0 2024-04-17T17:51:45.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.890+0000 7f4248e00640 1 --2- 172.21.15.152:0/3756067270 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f42240683d0 0x7f422406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:45.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.894+0000 7f4248e00640 1 --2- 172.21.15.152:0/3756067270 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f42240683d0 0x7f422406a890 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f42440b5300 tx=0x7f4230009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:45.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:45.894+0000 7f4241600640 1 -- 172.21.15.152:0/3756067270 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f4238016090 con 0x7f4244071cd0 2024-04-17T17:51:46.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.058+0000 7f424c200640 1 -- 172.21.15.152:0/3756067270 --> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f424415fc00 con 0x7f42240683d0 2024-04-17T17:51:46.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.058+0000 7f4241600640 1 -- 172.21.15.152:0/3756067270 <== mgr.4104 v2:172.21.15.152:6832/3078522445 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13705 (secure 0 0 0) 0x7f424415fc00 con 0x7f42240683d0 2024-04-17T17:51:46.062 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T17:51:46.062 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2024-04-17T17:51:46.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.062+0000 7f424c200640 1 -- 172.21.15.152:0/3756067270 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f42240683d0 msgr2=0x7f422406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:46.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.062+0000 7f424c200640 1 --2- 172.21.15.152:0/3756067270 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f42240683d0 0x7f422406a890 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f42440b5300 tx=0x7f4230009190 comp rx=0 tx=0).stop 2024-04-17T17:51:46.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.062+0000 7f424c200640 1 -- 172.21.15.152:0/3756067270 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4244071cd0 msgr2=0x7f424415da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:46.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.062+0000 7f424c200640 1 --2- 172.21.15.152:0/3756067270 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4244071cd0 0x7f424415da00 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f42380ae040 tx=0x7f423801ace0 comp rx=0 tx=0).stop 2024-04-17T17:51:46.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.062+0000 7f424c200640 1 -- 172.21.15.152:0/3756067270 shutdown_connections 2024-04-17T17:51:46.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.062+0000 7f424c200640 1 --2- 172.21.15.152:0/3756067270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4244147a90 0x7f4244161090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:46.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.062+0000 7f424c200640 1 --2- 172.21.15.152:0/3756067270 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4244147690 0x7f424413ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:46.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.062+0000 7f424c200640 1 --2- 172.21.15.152:0/3756067270 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f42240683d0 0x7f422406a890 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:46.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.062+0000 7f424c200640 1 --2- 172.21.15.152:0/3756067270 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4244071cd0 0x7f424415da00 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:46.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.062+0000 7f424c200640 1 -- 172.21.15.152:0/3756067270 >> 172.21.15.152:0/3756067270 conn(0x7f42440d2350 msgr2=0x7f42440cf610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:46.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.062+0000 7f424c200640 1 -- 172.21.15.152:0/3756067270 shutdown_connections 2024-04-17T17:51:46.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.062+0000 7f424c200640 1 -- 172.21.15.152:0/3756067270 wait complete. 2024-04-17T17:51:46.093 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":16384,"stamp":"2024-04-17T17:51:44.908904+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":141,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":12901828,"kb_used_data":437448,"kb_used_omap":3922,"kb_used_meta":12433645,"kb_avail":742072892,"statfs":{"total":773094113280,"available":759882641408,"internally_reserved":0,"allocated":447946752,"data_stored":445290517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4016990,"internal_metadata":12732052642},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":563,"apply_latency_ms":563,"commit_latency_ns":563000000,"apply_latency_ns":563000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1129180853,"num_objects":-6808,"num_object_clones":0,"num_object_copies":-13616,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-6808,"num_whiteouts":0,"num_read":-2020543,"num_read_kb":-140884569,"num_write":-7612726,"num_write_kb":-206859659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-87,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.538302"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":483,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-17T17:51:41.078371+0000","last_change":"2024-04-17T08:46:22.807988+0000","last_active":"2024-04-17T17:51:41.078371+0000","last_peered":"2024-04-17T17:51:41.078371+0000","last_clean":"2024-04-17T17:51:41.078371+0000","last_became_active":"2024-04-17T08:46:22.806843+0000","last_became_peered":"2024-04-17T08:46:22.806843+0000","last_unstale":"2024-04-17T17:51:41.078371+0000","last_undegraded":"2024-04-17T17:51:41.078371+0000","last_fullsized":"2024-04-17T17:51:41.078371+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:21.741557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:21.741557+0000","last_clean_scrub_stamp":"2024-04-17T08:46:21.741557+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:28:38.254696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834581392,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1527172,"kb_used_data":1084,"kb_used_omap":548,"kb_used_meta":1521435,"kb_avail":92844668,"statfs":{"total":96636764160,"available":95072940032,"internally_reserved":0,"allocated":1110016,"data_stored":812444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":561386,"internal_metadata":1557950230},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834581394,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1741720,"kb_used_data":98952,"kb_used_omap":648,"kb_used_meta":1642103,"kb_avail":92630120,"statfs":{"total":96636764160,"available":94853242880,"internally_reserved":0,"allocated":101326848,"data_stored":100958631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":664377,"internal_metadata":1681513671},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834581392,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1300856,"kb_used_data":496,"kb_used_omap":755,"kb_used_meta":1299596,"kb_avail":93070984,"statfs":{"total":96636764160,"available":95304687616,"internally_reserved":0,"allocated":507904,"data_stored":221795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":773576,"internal_metadata":1330786872},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834581394,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1741692,"kb_used_data":496,"kb_used_omap":1137,"kb_used_meta":1740046,"kb_avail":92630148,"statfs":{"total":96636764160,"available":94853271552,"internally_reserved":0,"allocated":507904,"data_stored":221795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1164464,"internal_metadata":1781807952},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834581335,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1807656,"kb_used_data":152796,"kb_used_omap":255,"kb_used_meta":1654592,"kb_avail":92564184,"statfs":{"total":96636764160,"available":94785724416,"internally_reserved":0,"allocated":156463104,"data_stored":156079324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":261991,"internal_metadata":1694302361},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":87,"apply_latency_ms":87,"commit_latency_ns":87000000,"apply_latency_ns":87000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834581343,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1747400,"kb_used_data":50552,"kb_used_omap":276,"kb_used_meta":1680171,"kb_avail":92624440,"statfs":{"total":96636764160,"available":94847426560,"internally_reserved":0,"allocated":51765248,"data_stored":51441928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":283299,"internal_metadata":1720495453},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":133,"apply_latency_ms":133,"commit_latency_ns":133000000,"apply_latency_ns":133000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834581351,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1577932,"kb_used_data":90912,"kb_used_omap":27,"kb_used_meta":1480740,"kb_avail":92793908,"statfs":{"total":96636764160,"available":95020961792,"internally_reserved":0,"allocated":93093888,"data_stored":92724018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28320,"internal_metadata":1516278112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":85,"apply_latency_ms":85,"commit_latency_ns":85000000,"apply_latency_ns":85000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834581343,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1457400,"kb_used_data":42160,"kb_used_omap":273,"kb_used_meta":1414958,"kb_avail":92914440,"statfs":{"total":96636764160,"available":95144386560,"internally_reserved":0,"allocated":43171840,"data_stored":42830582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":279577,"internal_metadata":1448917991},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":133,"apply_latency_ms":133,"commit_latency_ns":133000000,"apply_latency_ns":133000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T17:51:46.093 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-17T17:51:46.094 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T17:51:46.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.282+0000 7fb4e3200640 1 Processor -- start 2024-04-17T17:51:46.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.282+0000 7fb4e3200640 1 -- start start 2024-04-17T17:51:46.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.286+0000 7fb4e3200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb4e40cd030 0x7fb4e4160270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:46.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.286+0000 7fb4e3200640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb4e41607b0 0x7fb4e4159640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:46.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.286+0000 7fb4e3200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4e40cea90 con 0x7fb4e4070eb0 2024-04-17T17:51:46.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.286+0000 7fb4e3200640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fb4e40cf830 con 0x7fb4e41607b0 2024-04-17T17:51:46.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.286+0000 7fb4e3200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fb4e40cf3a0 con 0x7fb4e40cd030 2024-04-17T17:51:46.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.286+0000 7fb4e2800640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb4e41607b0 0x7fb4e4159640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:46.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.286+0000 7fb4e1400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb4e40cd030 0x7fb4e4160270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:46.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.286+0000 7fb4e1400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb4e40cd030 0x7fb4e4160270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.152:51804/0 (socket says 172.21.15.152:51804) 2024-04-17T17:51:46.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.286+0000 7fb4e1400640 1 -- 172.21.15.152:0/1362212534 learned_addr learned my addr 172.21.15.152:0/1362212534 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T17:51:46.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.286+0000 7fb4e1400640 1 -- 172.21.15.152:0/1362212534 >> v2:172.21.15.152:3300/0 conn(0x7fb4e41607b0 msgr2=0x7fb4e4159640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T17:51:46.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.286+0000 7fb4e1400640 1 --2- 172.21.15.152:0/1362212534 >> v2:172.21.15.152:3300/0 conn(0x7fb4e41607b0 0x7fb4e4159640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:46.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.286+0000 7fb4e1400640 1 -- 172.21.15.152:0/1362212534 >> v1:172.21.15.196:6789/0 conn(0x7fb4e4070eb0 legacy=0x7fb4e40cc920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:46.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.286+0000 7fb4e1400640 1 -- 172.21.15.152:0/1362212534 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4e40ced50 con 0x7fb4e40cd030 2024-04-17T17:51:46.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.290+0000 7fb4e1400640 1 --2- 172.21.15.152:0/1362212534 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb4e40cd030 0x7fb4e4160270 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb4d0009870 tx=0x7fb4d001c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75dc2895ba6a3e80 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:46.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.290+0000 7fb4e0a00640 1 -- 172.21.15.152:0/1362212534 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d00a7070 con 0x7fb4e40cd030 2024-04-17T17:51:46.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.290+0000 7fb4e0a00640 1 -- 172.21.15.152:0/1362212534 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4d00b0070 con 0x7fb4e40cd030 2024-04-17T17:51:46.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.290+0000 7fb4e0a00640 1 -- 172.21.15.152:0/1362212534 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d00ab890 con 0x7fb4e40cd030 2024-04-17T17:51:46.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.290+0000 7fb4e3200640 1 -- 172.21.15.152:0/1362212534 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb4e40cd030 msgr2=0x7fb4e4160270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:46.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.290+0000 7fb4e3200640 1 --2- 172.21.15.152:0/1362212534 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb4e40cd030 0x7fb4e4160270 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb4d0009870 tx=0x7fb4d001c560 comp rx=0 tx=0).stop 2024-04-17T17:51:46.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.290+0000 7fb4e3200640 1 -- 172.21.15.152:0/1362212534 shutdown_connections 2024-04-17T17:51:46.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.290+0000 7fb4e3200640 1 --2- 172.21.15.152:0/1362212534 >> v2:172.21.15.152:3300/0 conn(0x7fb4e41607b0 0x7fb4e4159640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:46.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.290+0000 7fb4e3200640 1 --2- 172.21.15.152:0/1362212534 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb4e40cd030 0x7fb4e4160270 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:46.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.290+0000 7fb4e3200640 1 -- 172.21.15.152:0/1362212534 >> 172.21.15.152:0/1362212534 conn(0x7fb4e40b3e40 msgr2=0x7fb4e40b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:46.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.290+0000 7fb4e3200640 1 -- 172.21.15.152:0/1362212534 shutdown_connections 2024-04-17T17:51:46.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.290+0000 7fb4e3200640 1 -- 172.21.15.152:0/1362212534 wait complete. 2024-04-17T17:51:46.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.290+0000 7fb4e3200640 1 Processor -- start 2024-04-17T17:51:46.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.294+0000 7fb4e3200640 1 -- start start 2024-04-17T17:51:46.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.294+0000 7fb4e3200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb4e4070eb0 0x7fb4e40c7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:46.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.294+0000 7fb4e3200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb4e40cd030 0x7fb4e4158d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:46.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.294+0000 7fb4e3200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4e41607b0 0x7fb4e40c5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:46.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.294+0000 7fb4e3200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e406f6e0 con 0x7fb4e41607b0 2024-04-17T17:51:46.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.294+0000 7fb4e3200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e406f560 con 0x7fb4e4070eb0 2024-04-17T17:51:46.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.294+0000 7fb4e3200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fb4e406f860 con 0x7fb4e40cd030 2024-04-17T17:51:46.298 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.294+0000 7fb4e2800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4e41607b0 0x7fb4e40c5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:46.298 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.294+0000 7fb4e1400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb4e40cd030 0x7fb4e4158d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:46.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.294+0000 7fb4e1400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb4e40cd030 0x7fb4e4158d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.152:51816/0 (socket says 172.21.15.152:51816) 2024-04-17T17:51:46.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.294+0000 7fb4e1400640 1 -- 172.21.15.152:0/2303623203 learned_addr learned my addr 172.21.15.152:0/2303623203 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T17:51:46.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.294+0000 7fb4e2800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4e41607b0 0x7fb4e40c5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46184/0 (socket says 172.21.15.152:46184) 2024-04-17T17:51:46.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.294+0000 7fb4e1e00640 1 --2- 172.21.15.152:0/2303623203 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb4e4070eb0 0x7fb4e40c7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:46.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.294+0000 7fb4e1400640 1 -- 172.21.15.152:0/2303623203 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb4e4070eb0 msgr2=0x7fb4e40c7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:46.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.294+0000 7fb4e1400640 1 --2- 172.21.15.152:0/2303623203 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb4e4070eb0 0x7fb4e40c7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:46.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.294+0000 7fb4e1400640 1 -- 172.21.15.152:0/2303623203 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4e41607b0 msgr2=0x7fb4e40c5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:46.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.294+0000 7fb4e1400640 1 --2- 172.21.15.152:0/2303623203 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4e41607b0 0x7fb4e40c5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:46.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.294+0000 7fb4e1400640 1 -- 172.21.15.152:0/2303623203 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4e40c68c0 con 0x7fb4e40cd030 2024-04-17T17:51:46.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.294+0000 7fb4e1400640 1 --2- 172.21.15.152:0/2303623203 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb4e40cd030 0x7fb4e4158d00 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb4d00ad040 tx=0x7fb4d001ada0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:46.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.294+0000 7fb4da000640 1 -- 172.21.15.152:0/2303623203 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d00be5f0 con 0x7fb4e40cd030 2024-04-17T17:51:46.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.294+0000 7fb4da000640 1 -- 172.21.15.152:0/2303623203 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4d00be790 con 0x7fb4e40cd030 2024-04-17T17:51:46.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.294+0000 7fb4da000640 1 -- 172.21.15.152:0/2303623203 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d00beb80 con 0x7fb4e40cd030 2024-04-17T17:51:46.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.294+0000 7fb4e3200640 1 -- 172.21.15.152:0/2303623203 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4e40c6ba0 con 0x7fb4e40cd030 2024-04-17T17:51:46.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.294+0000 7fb4e3200640 1 -- 172.21.15.152:0/2303623203 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4e40c7160 con 0x7fb4e40cd030 2024-04-17T17:51:46.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.298+0000 7fb4e3200640 1 -- 172.21.15.152:0/2303623203 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4e4075c10 con 0x7fb4e40cd030 2024-04-17T17:51:46.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.298+0000 7fb4da000640 1 -- 172.21.15.152:0/2303623203 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb4d00b43f0 con 0x7fb4e40cd030 2024-04-17T17:51:46.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.302+0000 7fb4da000640 1 --2- 172.21.15.152:0/2303623203 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb4c4068380 0x7fb4c406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:46.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.302+0000 7fb4da000640 1 -- 172.21.15.152:0/2303623203 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7fb4d0120e20 con 0x7fb4e40cd030 2024-04-17T17:51:46.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.302+0000 7fb4e1e00640 1 --2- 172.21.15.152:0/2303623203 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb4c4068380 0x7fb4c406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:46.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.302+0000 7fb4e1e00640 1 --2- 172.21.15.152:0/2303623203 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb4c4068380 0x7fb4c406a840 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fb4e40cd740 tx=0x7fb4d4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:46.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.306+0000 7fb4da000640 1 -- 172.21.15.152:0/2303623203 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fb4d0016150 con 0x7fb4e40cd030 2024-04-17T17:51:46.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.462+0000 7fb4e3200640 1 -- 172.21.15.152:0/2303623203 --> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb4e4167570 con 0x7fb4c4068380 2024-04-17T17:51:46.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.466+0000 7fb4da000640 1 -- 172.21.15.152:0/2303623203 <== mgr.4104 v2:172.21.15.152:6832/3078522445 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13705 (secure 0 0 0) 0x7fb4e4167570 con 0x7fb4c4068380 2024-04-17T17:51:46.469 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T17:51:46.469 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2024-04-17T17:51:46.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.466+0000 7fb4e3200640 1 -- 172.21.15.152:0/2303623203 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb4c4068380 msgr2=0x7fb4c406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:46.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.466+0000 7fb4e3200640 1 --2- 172.21.15.152:0/2303623203 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb4c4068380 0x7fb4c406a840 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fb4e40cd740 tx=0x7fb4d4009040 comp rx=0 tx=0).stop 2024-04-17T17:51:46.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.466+0000 7fb4e3200640 1 -- 172.21.15.152:0/2303623203 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb4e40cd030 msgr2=0x7fb4e4158d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:46.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.466+0000 7fb4e3200640 1 --2- 172.21.15.152:0/2303623203 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb4e40cd030 0x7fb4e4158d00 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb4d00ad040 tx=0x7fb4d001ada0 comp rx=0 tx=0).stop 2024-04-17T17:51:46.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.466+0000 7fb4e3200640 1 -- 172.21.15.152:0/2303623203 shutdown_connections 2024-04-17T17:51:46.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.466+0000 7fb4e3200640 1 --2- 172.21.15.152:0/2303623203 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4e41607b0 0x7fb4e40c5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:46.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.466+0000 7fb4e3200640 1 --2- 172.21.15.152:0/2303623203 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fb4c4068380 0x7fb4c406a840 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:46.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.466+0000 7fb4e3200640 1 --2- 172.21.15.152:0/2303623203 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb4e40cd030 0x7fb4e4158d00 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:46.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.466+0000 7fb4e3200640 1 --2- 172.21.15.152:0/2303623203 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb4e4070eb0 0x7fb4e40c7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:46.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.466+0000 7fb4e3200640 1 -- 172.21.15.152:0/2303623203 >> 172.21.15.152:0/2303623203 conn(0x7fb4e40b3e40 msgr2=0x7fb4e406edb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:46.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.466+0000 7fb4e3200640 1 -- 172.21.15.152:0/2303623203 shutdown_connections 2024-04-17T17:51:46.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.466+0000 7fb4e3200640 1 -- 172.21.15.152:0/2303623203 wait complete. 2024-04-17T17:51:46.494 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":16384,"stamp":"2024-04-17T17:51:44.908904+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":141,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":12901828,"kb_used_data":437448,"kb_used_omap":3922,"kb_used_meta":12433645,"kb_avail":742072892,"statfs":{"total":773094113280,"available":759882641408,"internally_reserved":0,"allocated":447946752,"data_stored":445290517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4016990,"internal_metadata":12732052642},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":563,"apply_latency_ms":563,"commit_latency_ns":563000000,"apply_latency_ns":563000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1129180853,"num_objects":-6808,"num_object_clones":0,"num_object_copies":-13616,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-6808,"num_whiteouts":0,"num_read":-2020543,"num_read_kb":-140884569,"num_write":-7612726,"num_write_kb":-206859659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-87,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.538302"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":483,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-17T17:51:41.078371+0000","last_change":"2024-04-17T08:46:22.807988+0000","last_active":"2024-04-17T17:51:41.078371+0000","last_peered":"2024-04-17T17:51:41.078371+0000","last_clean":"2024-04-17T17:51:41.078371+0000","last_became_active":"2024-04-17T08:46:22.806843+0000","last_became_peered":"2024-04-17T08:46:22.806843+0000","last_unstale":"2024-04-17T17:51:41.078371+0000","last_undegraded":"2024-04-17T17:51:41.078371+0000","last_fullsized":"2024-04-17T17:51:41.078371+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:21.741557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:21.741557+0000","last_clean_scrub_stamp":"2024-04-17T08:46:21.741557+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:28:38.254696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834581392,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1527172,"kb_used_data":1084,"kb_used_omap":548,"kb_used_meta":1521435,"kb_avail":92844668,"statfs":{"total":96636764160,"available":95072940032,"internally_reserved":0,"allocated":1110016,"data_stored":812444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":561386,"internal_metadata":1557950230},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834581394,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1741720,"kb_used_data":98952,"kb_used_omap":648,"kb_used_meta":1642103,"kb_avail":92630120,"statfs":{"total":96636764160,"available":94853242880,"internally_reserved":0,"allocated":101326848,"data_stored":100958631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":664377,"internal_metadata":1681513671},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834581392,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1300856,"kb_used_data":496,"kb_used_omap":755,"kb_used_meta":1299596,"kb_avail":93070984,"statfs":{"total":96636764160,"available":95304687616,"internally_reserved":0,"allocated":507904,"data_stored":221795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":773576,"internal_metadata":1330786872},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834581394,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1741692,"kb_used_data":496,"kb_used_omap":1137,"kb_used_meta":1740046,"kb_avail":92630148,"statfs":{"total":96636764160,"available":94853271552,"internally_reserved":0,"allocated":507904,"data_stored":221795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1164464,"internal_metadata":1781807952},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834581335,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1807656,"kb_used_data":152796,"kb_used_omap":255,"kb_used_meta":1654592,"kb_avail":92564184,"statfs":{"total":96636764160,"available":94785724416,"internally_reserved":0,"allocated":156463104,"data_stored":156079324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":261991,"internal_metadata":1694302361},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":87,"apply_latency_ms":87,"commit_latency_ns":87000000,"apply_latency_ns":87000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834581343,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1747400,"kb_used_data":50552,"kb_used_omap":276,"kb_used_meta":1680171,"kb_avail":92624440,"statfs":{"total":96636764160,"available":94847426560,"internally_reserved":0,"allocated":51765248,"data_stored":51441928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":283299,"internal_metadata":1720495453},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":133,"apply_latency_ms":133,"commit_latency_ns":133000000,"apply_latency_ns":133000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834581351,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1577932,"kb_used_data":90912,"kb_used_omap":27,"kb_used_meta":1480740,"kb_avail":92793908,"statfs":{"total":96636764160,"available":95020961792,"internally_reserved":0,"allocated":93093888,"data_stored":92724018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28320,"internal_metadata":1516278112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":85,"apply_latency_ms":85,"commit_latency_ns":85000000,"apply_latency_ns":85000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834581343,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1457400,"kb_used_data":42160,"kb_used_omap":273,"kb_used_meta":1414958,"kb_avail":92914440,"statfs":{"total":96636764160,"available":95144386560,"internally_reserved":0,"allocated":43171840,"data_stored":42830582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":279577,"internal_metadata":1448917991},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":133,"apply_latency_ms":133,"commit_latency_ns":133000000,"apply_latency_ns":133000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T17:51:46.495 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T17:51:46.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.878+0000 7fa8f3e00640 1 Processor -- start 2024-04-17T17:51:46.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.878+0000 7fa8f3e00640 1 -- start start 2024-04-17T17:51:46.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.882+0000 7fa8f3e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa8ec0c7230 0x7fa8ec0c76c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:46.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.882+0000 7fa8f3e00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa8ec071790 0x7fa8ec071c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:46.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.882+0000 7fa8f3e00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8ec0ccbb0 con 0x7fa8ec145ea0 2024-04-17T17:51:46.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.882+0000 7fa8f3e00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fa8ec072140 con 0x7fa8ec071790 2024-04-17T17:51:46.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.882+0000 7fa8f3e00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fa8ec0cce90 con 0x7fa8ec0c7230 2024-04-17T17:51:46.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.882+0000 7fa8f1400640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fa8ec145ea0 0x7fa8ec0d0250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:53204/0 (socket says 172.21.15.152:53204) 2024-04-17T17:51:46.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.882+0000 7fa8f1400640 1 -- 172.21.15.152:0/832257908 learned_addr learned my addr 172.21.15.152:0/832257908 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T17:51:46.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.886+0000 7fa8f0a00640 1 --2- 172.21.15.152:0/832257908 >> v2:172.21.15.196:3300/0 conn(0x7fa8ec0c7230 0x7fa8ec0c76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:46.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.886+0000 7fa8f1e00640 1 --2- 172.21.15.152:0/832257908 >> v2:172.21.15.152:3300/0 conn(0x7fa8ec071790 0x7fa8ec071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:46.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.886+0000 7fa8ebe00640 1 -- 172.21.15.152:0/832257908 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3169935625 0 0) 0x7fa8ec0ccbb0 con 0x7fa8ec145ea0 2024-04-17T17:51:46.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.886+0000 7fa8ebe00640 1 -- 172.21.15.152:0/832257908 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8d4003530 con 0x7fa8ec145ea0 2024-04-17T17:51:46.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.886+0000 7fa8f0a00640 1 -- 172.21.15.152:0/832257908 >> v2:172.21.15.152:3300/0 conn(0x7fa8ec071790 msgr2=0x7fa8ec071c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T17:51:46.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.886+0000 7fa8f0a00640 1 --2- 172.21.15.152:0/832257908 >> v2:172.21.15.152:3300/0 conn(0x7fa8ec071790 0x7fa8ec071c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:46.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.886+0000 7fa8ebe00640 1 -- 172.21.15.152:0/832257908 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3097274756 0 0) 0x7fa8d4003530 con 0x7fa8ec145ea0 2024-04-17T17:51:46.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.886+0000 7fa8f0a00640 1 -- 172.21.15.152:0/832257908 >> v1:172.21.15.152:6789/0 conn(0x7fa8ec145ea0 legacy=0x7fa8ec0d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:46.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.886+0000 7fa8f0a00640 1 -- 172.21.15.152:0/832257908 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8ec0cd170 con 0x7fa8ec0c7230 2024-04-17T17:51:46.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.894+0000 7fa8f0a00640 1 --2- 172.21.15.152:0/832257908 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa8ec0c7230 0x7fa8ec0c76c0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec0c8c20 tx=0x7fa8d801c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d219591db40bacd server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:46.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.894+0000 7fa8ebe00640 1 -- 172.21.15.152:0/832257908 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d80b0070 con 0x7fa8ec0c7230 2024-04-17T17:51:46.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.894+0000 7fa8ebe00640 1 -- 172.21.15.152:0/832257908 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8d80ab400 con 0x7fa8ec0c7230 2024-04-17T17:51:46.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.894+0000 7fa8ebe00640 1 -- 172.21.15.152:0/832257908 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e0001680 con 0x7fa8ec0c7230 2024-04-17T17:51:46.900 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.898+0000 7fa8f3e00640 1 -- 172.21.15.152:0/832257908 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa8ec0c7230 msgr2=0x7fa8ec0c76c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:46.900 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.898+0000 7fa8f3e00640 1 --2- 172.21.15.152:0/832257908 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa8ec0c7230 0x7fa8ec0c76c0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec0c8c20 tx=0x7fa8d801c310 comp rx=0 tx=0).stop 2024-04-17T17:51:46.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.898+0000 7fa8f3e00640 1 -- 172.21.15.152:0/832257908 shutdown_connections 2024-04-17T17:51:46.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.898+0000 7fa8f3e00640 1 --2- 172.21.15.152:0/832257908 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa8ec0c7230 0x7fa8ec0c76c0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:46.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.898+0000 7fa8f3e00640 1 --2- 172.21.15.152:0/832257908 >> v2:172.21.15.152:3300/0 conn(0x7fa8ec071790 0x7fa8ec071c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:46.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.898+0000 7fa8f3e00640 1 -- 172.21.15.152:0/832257908 >> 172.21.15.152:0/832257908 conn(0x7fa8ec0d2350 msgr2=0x7fa8ec0d2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:46.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.898+0000 7fa8f3e00640 1 -- 172.21.15.152:0/832257908 shutdown_connections 2024-04-17T17:51:46.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.898+0000 7fa8f3e00640 1 -- 172.21.15.152:0/832257908 wait complete. 2024-04-17T17:51:46.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.902+0000 7fa8f3e00640 1 Processor -- start 2024-04-17T17:51:46.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.902+0000 7fa8f3e00640 1 -- start start 2024-04-17T17:51:46.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.906+0000 7fa8f3e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa8ec071790 0x7fa8ec0b5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:46.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.906+0000 7fa8f3e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa8ec0c7230 0x7fa8ec0b7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:46.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.906+0000 7fa8f3e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8ec145ea0 0x7fa8ec15be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:46.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.906+0000 7fa8f3e00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa8ec169490 con 0x7fa8ec145ea0 2024-04-17T17:51:46.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.906+0000 7fa8f3e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa8ec0d0960 con 0x7fa8ec0c7230 2024-04-17T17:51:46.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.906+0000 7fa8f3e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fa8ec169610 con 0x7fa8ec071790 2024-04-17T17:51:46.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.906+0000 7fa8f1400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa8ec071790 0x7fa8ec0b5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:46.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.906+0000 7fa8f1400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa8ec071790 0x7fa8ec0b5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.152:51832/0 (socket says 172.21.15.152:51832) 2024-04-17T17:51:46.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.906+0000 7fa8f1400640 1 -- 172.21.15.152:0/2555660999 learned_addr learned my addr 172.21.15.152:0/2555660999 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T17:51:46.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.906+0000 7fa8f0a00640 1 --2- 172.21.15.152:0/2555660999 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa8ec0c7230 0x7fa8ec0b7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:46.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.906+0000 7fa8f1e00640 1 --2- 172.21.15.152:0/2555660999 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8ec145ea0 0x7fa8ec15be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:46.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.906+0000 7fa8f1400640 1 -- 172.21.15.152:0/2555660999 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa8ec0c7230 msgr2=0x7fa8ec0b7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:46.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.906+0000 7fa8f1400640 1 --2- 172.21.15.152:0/2555660999 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa8ec0c7230 0x7fa8ec0b7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:46.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.906+0000 7fa8f1400640 1 -- 172.21.15.152:0/2555660999 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8ec145ea0 msgr2=0x7fa8ec15be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:46.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.906+0000 7fa8f1400640 1 --2- 172.21.15.152:0/2555660999 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8ec145ea0 0x7fa8ec15be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:46.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.906+0000 7fa8f1400640 1 -- 172.21.15.152:0/2555660999 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8ec165ee0 con 0x7fa8ec071790 2024-04-17T17:51:46.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.906+0000 7fa8f1400640 1 --2- 172.21.15.152:0/2555660999 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa8ec071790 0x7fa8ec0b5090 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa8e000c750 tx=0x7fa8e000cc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:46.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.906+0000 7fa8e9600640 1 -- 172.21.15.152:0/2555660999 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e0005ae0 con 0x7fa8ec071790 2024-04-17T17:51:46.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.906+0000 7fa8e9600640 1 -- 172.21.15.152:0/2555660999 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8e0005ca0 con 0x7fa8ec071790 2024-04-17T17:51:46.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.906+0000 7fa8f3e00640 1 -- 172.21.15.152:0/2555660999 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8ec0c9fa0 con 0x7fa8ec071790 2024-04-17T17:51:46.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.906+0000 7fa8e9600640 1 -- 172.21.15.152:0/2555660999 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e00072b0 con 0x7fa8ec071790 2024-04-17T17:51:46.912 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.906+0000 7fa8f3e00640 1 -- 172.21.15.152:0/2555660999 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8ec0b5a00 con 0x7fa8ec071790 2024-04-17T17:51:46.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.910+0000 7fa8e9600640 1 -- 172.21.15.152:0/2555660999 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa8e0007450 con 0x7fa8ec071790 2024-04-17T17:51:46.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.910+0000 7fa8f3e00640 1 -- 172.21.15.152:0/2555660999 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8ec068a30 con 0x7fa8ec071790 2024-04-17T17:51:46.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.910+0000 7fa8e9600640 1 --2- 172.21.15.152:0/2555660999 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fa8cc068380 0x7fa8cc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:46.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.914+0000 7fa8e9600640 1 -- 172.21.15.152:0/2555660999 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7fa8e00864e0 con 0x7fa8ec071790 2024-04-17T17:51:46.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.914+0000 7fa8f0a00640 1 --2- 172.21.15.152:0/2555660999 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fa8cc068380 0x7fa8cc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:46.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.914+0000 7fa8f0a00640 1 --2- 172.21.15.152:0/2555660999 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fa8cc068380 0x7fa8cc06a840 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fa8d80ad000 tx=0x7fa8d80a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:46.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:46.914+0000 7fa8e9600640 1 -- 172.21.15.152:0/2555660999 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fa8ec165ee0 con 0x7fa8ec071790 2024-04-17T17:51:47.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:47.402+0000 7fa8f3e00640 1 -- 172.21.15.152:0/2555660999 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa8ec0d1db0 con 0x7fa8ec071790 2024-04-17T17:51:47.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:47.402+0000 7fa8e9600640 1 -- 172.21.15.152:0/2555660999 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) ==== 74+0+13319 (secure 0 0 0) 0x7fa8e0056c00 con 0x7fa8ec071790 2024-04-17T17:51:47.407 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T17:51:47.407 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":43,"fsid":"ce68f82e-ec5f-4205-9fd5-bdfdf6ef31e2","created":"2024-04-17T08:46:08.353546+0000","modified":"2024-04-17T17:51:40.234083+0000","last_up_change":"2024-04-17T08:46:20.738799+0000","last_in_change":"2024-04-17T08:46:11.210050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T08:46:21.386856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"682f0192-187c-404e-bc7a-b6b4e23825e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6819","nonce":3603799291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6823","nonce":3603799291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6831","nonce":3603799291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":3603799291},{"type":"v1","addr":"172.21.15.152:6827","nonce":3603799291}]},"public_addr":"172.21.15.152:6819/3603799291","cluster_addr":"172.21.15.152:6823/3603799291","heartbeat_back_addr":"172.21.15.152:6831/3603799291","heartbeat_front_addr":"172.21.15.152:6827/3603799291","state":["exists","up"]},{"osd":1,"uuid":"f0fe8fef-60ec-4a39-83b6-2fa6a5adb0f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6801","nonce":4133383142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6803","nonce":4133383142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6807","nonce":4133383142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4133383142},{"type":"v1","addr":"172.21.15.152:6805","nonce":4133383142}]},"public_addr":"172.21.15.152:6801/4133383142","cluster_addr":"172.21.15.152:6803/4133383142","heartbeat_back_addr":"172.21.15.152:6807/4133383142","heartbeat_front_addr":"172.21.15.152:6805/4133383142","state":["exists","up"]},{"osd":2,"uuid":"35f36d9c-5245-4431-a618-f4df0fa380ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6809","nonce":3826143898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6811","nonce":3826143898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6815","nonce":3826143898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3826143898},{"type":"v1","addr":"172.21.15.152:6813","nonce":3826143898}]},"public_addr":"172.21.15.152:6809/3826143898","cluster_addr":"172.21.15.152:6811/3826143898","heartbeat_back_addr":"172.21.15.152:6815/3826143898","heartbeat_front_addr":"172.21.15.152:6813/3826143898","state":["exists","up"]},{"osd":3,"uuid":"96e56ca5-15b4-4895-9b79-da2c92043159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6818","nonce":165717826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6822","nonce":165717826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6830","nonce":165717826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":165717826},{"type":"v1","addr":"172.21.15.152:6826","nonce":165717826}]},"public_addr":"172.21.15.152:6818/165717826","cluster_addr":"172.21.15.152:6822/165717826","heartbeat_back_addr":"172.21.15.152:6830/165717826","heartbeat_front_addr":"172.21.15.152:6826/165717826","state":["exists","up"]},{"osd":4,"uuid":"f5aa10a4-9ff9-41fe-a5c9-15326f982cc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6817","nonce":4080159297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6819","nonce":4080159297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6823","nonce":4080159297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":4080159297},{"type":"v1","addr":"172.21.15.196:6821","nonce":4080159297}]},"public_addr":"172.21.15.196:6817/4080159297","cluster_addr":"172.21.15.196:6819/4080159297","heartbeat_back_addr":"172.21.15.196:6823/4080159297","heartbeat_front_addr":"172.21.15.196:6821/4080159297","state":["exists","up"]},{"osd":5,"uuid":"42bab884-3476-47ae-ac65-935fa6e0f055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6801","nonce":3519444232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6803","nonce":3519444232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6807","nonce":3519444232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3519444232},{"type":"v1","addr":"172.21.15.196:6805","nonce":3519444232}]},"public_addr":"172.21.15.196:6801/3519444232","cluster_addr":"172.21.15.196:6803/3519444232","heartbeat_back_addr":"172.21.15.196:6807/3519444232","heartbeat_front_addr":"172.21.15.196:6805/3519444232","state":["exists","up"]},{"osd":6,"uuid":"460b6167-f57b-4224-9c92-cfc9b80bbe99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6809","nonce":275739834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6811","nonce":275739834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6815","nonce":275739834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":275739834},{"type":"v1","addr":"172.21.15.196:6813","nonce":275739834}]},"public_addr":"172.21.15.196:6809/275739834","cluster_addr":"172.21.15.196:6811/275739834","heartbeat_back_addr":"172.21.15.196:6815/275739834","heartbeat_front_addr":"172.21.15.196:6813/275739834","state":["exists","up"]},{"osd":7,"uuid":"d695643f-5e07-4e2a-a646-c06bd97b6650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6825","nonce":307626968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6827","nonce":307626968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6831","nonce":307626968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":307626968},{"type":"v1","addr":"172.21.15.196:6829","nonce":307626968}]},"public_addr":"172.21.15.196:6825/307626968","cluster_addr":"172.21.15.196:6827/307626968","heartbeat_back_addr":"172.21.15.196:6831/307626968","heartbeat_front_addr":"172.21.15.196:6829/307626968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.293257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.964533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.248895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:17.010000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.832554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.743704+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930171+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T08:46:16.930962+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.152:6835/4144515289":"2024-04-18T17:51:35.282509+0000","172.21.15.152:6834/4144515289":"2024-04-18T17:51:35.282509+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T17:51:47.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:47.406+0000 7fa8f3e00640 1 -- 172.21.15.152:0/2555660999 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fa8cc068380 msgr2=0x7fa8cc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:47.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:47.406+0000 7fa8f3e00640 1 --2- 172.21.15.152:0/2555660999 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fa8cc068380 0x7fa8cc06a840 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fa8d80ad000 tx=0x7fa8d80a6000 comp rx=0 tx=0).stop 2024-04-17T17:51:47.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:47.406+0000 7fa8f3e00640 1 -- 172.21.15.152:0/2555660999 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa8ec071790 msgr2=0x7fa8ec0b5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:47.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:47.406+0000 7fa8f3e00640 1 --2- 172.21.15.152:0/2555660999 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa8ec071790 0x7fa8ec0b5090 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa8e000c750 tx=0x7fa8e000cc10 comp rx=0 tx=0).stop 2024-04-17T17:51:47.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:47.406+0000 7fa8f3e00640 1 -- 172.21.15.152:0/2555660999 shutdown_connections 2024-04-17T17:51:47.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:47.406+0000 7fa8f3e00640 1 --2- 172.21.15.152:0/2555660999 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8ec145ea0 0x7fa8ec15be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:47.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:47.406+0000 7fa8f3e00640 1 --2- 172.21.15.152:0/2555660999 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa8ec0c7230 0x7fa8ec0b7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:47.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:47.406+0000 7fa8f3e00640 1 --2- 172.21.15.152:0/2555660999 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fa8cc068380 0x7fa8cc06a840 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:47.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:47.406+0000 7fa8f3e00640 1 --2- 172.21.15.152:0/2555660999 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa8ec071790 0x7fa8ec0b5090 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:47.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:47.406+0000 7fa8f3e00640 1 -- 172.21.15.152:0/2555660999 >> 172.21.15.152:0/2555660999 conn(0x7fa8ec0d2350 msgr2=0x7fa8ec166980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:47.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:47.406+0000 7fa8f3e00640 1 -- 172.21.15.152:0/2555660999 shutdown_connections 2024-04-17T17:51:47.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:47.406+0000 7fa8f3e00640 1 -- 172.21.15.152:0/2555660999 wait complete. 2024-04-17T17:51:48.463 INFO:tasks.ceph:Scrubbing osd.0 2024-04-17T17:51:48.463 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-17T17:51:48.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.866+0000 7f9750200640 1 Processor -- start 2024-04-17T17:51:48.869 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.866+0000 7f9750200640 1 -- start start 2024-04-17T17:51:48.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.870+0000 7f9750200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f974806c0c0 0x7f97480ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:48.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.870+0000 7f9750200640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f97480b3a70 0x7f97480b4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:48.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.870+0000 7f9750200640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97480cd240 con 0x7f974815e810 2024-04-17T17:51:48.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.870+0000 7f9750200640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f97480d0200 con 0x7f97480b3a70 2024-04-17T17:51:48.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.870+0000 7f9750200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f974815ebf0 con 0x7f974806c0c0 2024-04-17T17:51:48.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.870+0000 7f974d800640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f974815e810 0x7f974806b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:54708/0 (socket says 172.21.15.152:54708) 2024-04-17T17:51:48.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.870+0000 7f974d800640 1 -- 172.21.15.152:0/3504767135 learned_addr learned my addr 172.21.15.152:0/3504767135 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T17:51:48.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.870+0000 7f974e200640 1 --2- 172.21.15.152:0/3504767135 >> v2:172.21.15.152:3300/0 conn(0x7f97480b3a70 0x7f97480b4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:48.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.870+0000 7f974ce00640 1 --2- 172.21.15.152:0/3504767135 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f974806c0c0 0x7f97480ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:48.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.870+0000 7f9747e00640 1 -- 172.21.15.152:0/3504767135 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3508088534 0 0) 0x7f97480cd240 con 0x7f974815e810 2024-04-17T17:51:48.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.870+0000 7f9747e00640 1 -- 172.21.15.152:0/3504767135 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9730003530 con 0x7f974815e810 2024-04-17T17:51:48.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.870+0000 7f974e200640 1 -- 172.21.15.152:0/3504767135 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f974806c0c0 msgr2=0x7f97480ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T17:51:48.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.870+0000 7f974e200640 1 --2- 172.21.15.152:0/3504767135 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f974806c0c0 0x7f97480ccc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:48.874 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.870+0000 7f974e200640 1 -- 172.21.15.152:0/3504767135 >> v1:172.21.15.152:6789/0 conn(0x7f974815e810 legacy=0x7f974806b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:48.875 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.870+0000 7f974e200640 1 -- 172.21.15.152:0/3504767135 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97480cf440 con 0x7f97480b3a70 2024-04-17T17:51:48.875 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.870+0000 7f974ce00640 1 --2- 172.21.15.152:0/3504767135 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f974806c0c0 0x7f97480ccc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T17:51:48.876 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.874+0000 7f974e200640 1 --2- 172.21.15.152:0/3504767135 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97480b3a70 0x7f97480b4080 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7f9740009d90 tx=0x7f974001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed9ea8075fdc2e8b server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:48.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.874+0000 7f9747e00640 1 -- 172.21.15.152:0/3504767135 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97400b2070 con 0x7f97480b3a70 2024-04-17T17:51:48.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.874+0000 7f9747e00640 1 -- 172.21.15.152:0/3504767135 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97400a5890 con 0x7f97480b3a70 2024-04-17T17:51:48.877 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.874+0000 7f9747e00640 1 -- 172.21.15.152:0/3504767135 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97400a5c60 con 0x7f97480b3a70 2024-04-17T17:51:48.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.874+0000 7f9750200640 1 -- 172.21.15.152:0/3504767135 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97480b3a70 msgr2=0x7f97480b4080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:48.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.874+0000 7f9750200640 1 --2- 172.21.15.152:0/3504767135 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97480b3a70 0x7f97480b4080 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7f9740009d90 tx=0x7f974001c8e0 comp rx=0 tx=0).stop 2024-04-17T17:51:48.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.874+0000 7f9750200640 1 -- 172.21.15.152:0/3504767135 shutdown_connections 2024-04-17T17:51:48.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.874+0000 7f9750200640 1 --2- 172.21.15.152:0/3504767135 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f974806c0c0 0x7f97480ccc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:48.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.874+0000 7f9750200640 1 --2- 172.21.15.152:0/3504767135 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97480b3a70 0x7f97480b4080 unknown :-1 s=CLOSED pgs=2060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:48.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.874+0000 7f9750200640 1 -- 172.21.15.152:0/3504767135 >> 172.21.15.152:0/3504767135 conn(0x7f97480cd4c0 msgr2=0x7f97480cd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:48.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.874+0000 7f9750200640 1 -- 172.21.15.152:0/3504767135 shutdown_connections 2024-04-17T17:51:48.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.874+0000 7f9750200640 1 -- 172.21.15.152:0/3504767135 wait complete. 2024-04-17T17:51:48.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.878+0000 7f9750200640 1 Processor -- start 2024-04-17T17:51:48.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.882+0000 7f9750200640 1 -- start start 2024-04-17T17:51:48.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.882+0000 7f9750200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f974806c0c0 0x7f974815afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:48.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.882+0000 7f9750200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f97480b3a70 0x7f974815c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:48.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.882+0000 7f9750200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f974815e810 0x7f97481403d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:48.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.882+0000 7f9750200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f97480b4f50 con 0x7f974806c0c0 2024-04-17T17:51:48.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.882+0000 7f9750200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f97480b4dd0 con 0x7f97480b3a70 2024-04-17T17:51:48.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.882+0000 7f9750200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f97480b50d0 con 0x7f974815e810 2024-04-17T17:51:48.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.882+0000 7f974d800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f974806c0c0 0x7f974815afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:48.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.882+0000 7f974e200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f974815e810 0x7f97481403d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:48.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.882+0000 7f974e200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f974815e810 0x7f97481403d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.152:58008/0 (socket says 172.21.15.152:58008) 2024-04-17T17:51:48.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.882+0000 7f974e200640 1 -- 172.21.15.152:0/510708618 learned_addr learned my addr 172.21.15.152:0/510708618 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T17:51:48.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.882+0000 7f974ce00640 1 --2- 172.21.15.152:0/510708618 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f97480b3a70 0x7f974815c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:48.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.886+0000 7f974e200640 1 -- 172.21.15.152:0/510708618 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f97480b3a70 msgr2=0x7f974815c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:48.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.886+0000 7f974e200640 1 --2- 172.21.15.152:0/510708618 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f97480b3a70 0x7f974815c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:48.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.886+0000 7f974e200640 1 -- 172.21.15.152:0/510708618 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f974806c0c0 msgr2=0x7f974815afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:48.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.886+0000 7f974e200640 1 --2- 172.21.15.152:0/510708618 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f974806c0c0 0x7f974815afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:48.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.886+0000 7f974e200640 1 -- 172.21.15.152:0/510708618 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f974815b520 con 0x7f974815e810 2024-04-17T17:51:48.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.886+0000 7f974d800640 1 --2- 172.21.15.152:0/510708618 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f974806c0c0 0x7f974815afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T17:51:48.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.886+0000 7f974ce00640 1 --2- 172.21.15.152:0/510708618 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f97480b3a70 0x7f974815c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T17:51:48.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.886+0000 7f974e200640 1 --2- 172.21.15.152:0/510708618 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f974815e810 0x7f97481403d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f97400b0040 tx=0x7f9740019680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:48.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.886+0000 7f9745600640 1 -- 172.21.15.152:0/510708618 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97400b2050 con 0x7f974815e810 2024-04-17T17:51:48.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.886+0000 7f9745600640 1 -- 172.21.15.152:0/510708618 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97400be070 con 0x7f974815e810 2024-04-17T17:51:48.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.886+0000 7f9750200640 1 -- 172.21.15.152:0/510708618 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9748143540 con 0x7f974815e810 2024-04-17T17:51:48.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.886+0000 7f9745600640 1 -- 172.21.15.152:0/510708618 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97400ad850 con 0x7f974815e810 2024-04-17T17:51:48.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.886+0000 7f9750200640 1 -- 172.21.15.152:0/510708618 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9748143b00 con 0x7f974815e810 2024-04-17T17:51:48.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.890+0000 7f9745600640 1 -- 172.21.15.152:0/510708618 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f97400ad9f0 con 0x7f974815e810 2024-04-17T17:51:48.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.890+0000 7f9750200640 1 -- 172.21.15.152:0/510708618 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9748069140 con 0x7f974815e810 2024-04-17T17:51:48.893 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.890+0000 7f9745600640 1 --2- 172.21.15.152:0/510708618 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f97280683d0 0x7f972806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:48.893 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.890+0000 7f9745600640 1 -- 172.21.15.152:0/510708618 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f97401218b0 con 0x7f974815e810 2024-04-17T17:51:48.893 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.890+0000 7f9745600640 1 --2- 172.21.15.152:0/510708618 >> [v2:172.21.15.152:6817/3603799291,v1:172.21.15.152:6819/3603799291] conn(0x7f972806e870 0x7f9728070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:48.893 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.890+0000 7f9745600640 1 -- 172.21.15.152:0/510708618 --> [v2:172.21.15.152:6817/3603799291,v1:172.21.15.152:6819/3603799291] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f97400c4e50 con 0x7f972806e870 2024-04-17T17:51:48.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.890+0000 7f9745600640 1 -- 172.21.15.152:0/510708618 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f97401262a0 con 0x7f974815e810 2024-04-17T17:51:48.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.890+0000 7f974d800640 1 --2- 172.21.15.152:0/510708618 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f97280683d0 0x7f972806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:48.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.890+0000 7f974ce00640 1 --2- 172.21.15.152:0/510708618 >> [v2:172.21.15.152:6817/3603799291,v1:172.21.15.152:6819/3603799291] conn(0x7f972806e870 0x7f9728070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:48.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.890+0000 7f974d800640 1 --2- 172.21.15.152:0/510708618 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f97280683d0 0x7f972806a890 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f973c0011f0 tx=0x7f973c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:48.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:48.890+0000 7f974ce00640 1 --2- 172.21.15.152:0/510708618 >> [v2:172.21.15.152:6817/3603799291,v1:172.21.15.152:6819/3603799291] conn(0x7f972806e870 0x7f9728070cb0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:49.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.218+0000 7f9745600640 1 -- 172.21.15.152:0/510708618 <== osd.0 v2:172.21.15.152:6817/3603799291 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f97400c4e50 con 0x7f972806e870 2024-04-17T17:51:49.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.258+0000 7f9750200640 1 -- 172.21.15.152:0/510708618 --> [v2:172.21.15.152:6817/3603799291,v1:172.21.15.152:6819/3603799291] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f97480ce410 con 0x7f972806e870 2024-04-17T17:51:49.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.266+0000 7f9745600640 1 -- 172.21.15.152:0/510708618 <== osd.0 v2:172.21.15.152:6817/3603799291 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f97480ce410 con 0x7f972806e870 2024-04-17T17:51:49.271 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-17T17:51:49.272 INFO:teuthology.orchestra.run.smithi152.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-17T17:51:49.272 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-17T17:51:49.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.270+0000 7f9750200640 1 -- 172.21.15.152:0/510708618 >> [v2:172.21.15.152:6817/3603799291,v1:172.21.15.152:6819/3603799291] conn(0x7f972806e870 msgr2=0x7f9728070cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:49.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.270+0000 7f9750200640 1 --2- 172.21.15.152:0/510708618 >> [v2:172.21.15.152:6817/3603799291,v1:172.21.15.152:6819/3603799291] conn(0x7f972806e870 0x7f9728070cb0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:49.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.270+0000 7f9750200640 1 -- 172.21.15.152:0/510708618 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f97280683d0 msgr2=0x7f972806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:49.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.270+0000 7f9750200640 1 --2- 172.21.15.152:0/510708618 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f97280683d0 0x7f972806a890 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f973c0011f0 tx=0x7f973c009040 comp rx=0 tx=0).stop 2024-04-17T17:51:49.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.270+0000 7f9750200640 1 -- 172.21.15.152:0/510708618 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f974815e810 msgr2=0x7f97481403d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:49.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.270+0000 7f9750200640 1 --2- 172.21.15.152:0/510708618 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f974815e810 0x7f97481403d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f97400b0040 tx=0x7f9740019680 comp rx=0 tx=0).stop 2024-04-17T17:51:49.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.270+0000 7f974e200640 1 -- 172.21.15.152:0/510708618 reap_dead start 2024-04-17T17:51:49.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.270+0000 7f9750200640 1 -- 172.21.15.152:0/510708618 shutdown_connections 2024-04-17T17:51:49.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.270+0000 7f9750200640 1 -- 172.21.15.152:0/510708618 >> 172.21.15.152:0/510708618 conn(0x7f97480cd4c0 msgr2=0x7f97481620d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:49.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.270+0000 7f9750200640 1 -- 172.21.15.152:0/510708618 shutdown_connections 2024-04-17T17:51:49.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.270+0000 7f9750200640 1 -- 172.21.15.152:0/510708618 wait complete. 2024-04-17T17:51:49.318 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-17T17:51:49.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.722+0000 7fd83fe00640 1 Processor -- start 2024-04-17T17:51:49.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.722+0000 7fd83fe00640 1 -- start start 2024-04-17T17:51:49.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.726+0000 7fd83fe00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fd83815a010 0x7fd8380d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:49.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.726+0000 7fd83fe00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd838160d20 con 0x7fd83815d710 2024-04-17T17:51:49.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.726+0000 7fd83fe00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd83815cc30 con 0x7fd838160720 2024-04-17T17:51:49.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.726+0000 7fd83fe00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fd83815d280 con 0x7fd83815a010 2024-04-17T17:51:49.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.726+0000 7fd83ca00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fd83815d710 0x7fd838160010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:54718/0 (socket says 172.21.15.152:54718) 2024-04-17T17:51:49.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.726+0000 7fd83ca00640 1 -- 172.21.15.152:0/3495502139 learned_addr learned my addr 172.21.15.152:0/3495502139 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T17:51:49.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.726+0000 7fd83d400640 1 --2- 172.21.15.152:0/3495502139 >> v2:172.21.15.196:3300/0 conn(0x7fd83815a010 0x7fd8380d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:49.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.726+0000 7fd837e00640 1 -- 172.21.15.152:0/3495502139 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3361580251 0 0) 0x7fd838160d20 con 0x7fd83815d710 2024-04-17T17:51:49.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.726+0000 7fd837e00640 1 -- 172.21.15.152:0/3495502139 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd820003530 con 0x7fd83815d710 2024-04-17T17:51:49.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.726+0000 7fd83d400640 1 -- 172.21.15.152:0/3495502139 >> v1:172.21.15.196:6789/0 conn(0x7fd838160720 legacy=0x7fd83815dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:49.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.726+0000 7fd837e00640 1 -- 172.21.15.152:0/3495502139 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1451334234 0 0) 0x7fd820003530 con 0x7fd83815d710 2024-04-17T17:51:49.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.726+0000 7fd83d400640 1 -- 172.21.15.152:0/3495502139 >> v1:172.21.15.152:6789/0 conn(0x7fd83815d710 legacy=0x7fd838160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:49.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.726+0000 7fd83d400640 1 -- 172.21.15.152:0/3495502139 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd83815cf10 con 0x7fd83815a010 2024-04-17T17:51:49.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.734+0000 7fd83d400640 1 --2- 172.21.15.152:0/3495502139 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd83815a010 0x7fd8380d0360 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fd83815d400 tx=0x7fd82c01c1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf5935d57658a1ae server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:49.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.738+0000 7fd837e00640 1 -- 172.21.15.152:0/3495502139 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd82c0b0070 con 0x7fd83815a010 2024-04-17T17:51:49.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.738+0000 7fd837e00640 1 -- 172.21.15.152:0/3495502139 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd82c0ab400 con 0x7fd83815a010 2024-04-17T17:51:49.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.738+0000 7fd837e00640 1 -- 172.21.15.152:0/3495502139 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd824001680 con 0x7fd83815a010 2024-04-17T17:51:49.742 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.738+0000 7fd83fe00640 1 -- 172.21.15.152:0/3495502139 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd83815a010 msgr2=0x7fd8380d0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:49.742 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.738+0000 7fd83fe00640 1 --2- 172.21.15.152:0/3495502139 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd83815a010 0x7fd8380d0360 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fd83815d400 tx=0x7fd82c01c1e0 comp rx=0 tx=0).stop 2024-04-17T17:51:49.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.738+0000 7fd83fe00640 1 -- 172.21.15.152:0/3495502139 shutdown_connections 2024-04-17T17:51:49.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.738+0000 7fd83fe00640 1 --2- 172.21.15.152:0/3495502139 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd83815a010 0x7fd8380d0360 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:49.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.738+0000 7fd83fe00640 1 -- 172.21.15.152:0/3495502139 >> 172.21.15.152:0/3495502139 conn(0x7fd8380b3350 msgr2=0x7fd8380b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:49.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.738+0000 7fd83fe00640 1 -- 172.21.15.152:0/3495502139 shutdown_connections 2024-04-17T17:51:49.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.738+0000 7fd83fe00640 1 -- 172.21.15.152:0/3495502139 wait complete. 2024-04-17T17:51:49.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.742+0000 7fd83fe00640 1 Processor -- start 2024-04-17T17:51:49.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.742+0000 7fd83fe00640 1 -- start start 2024-04-17T17:51:49.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.746+0000 7fd83fe00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd83815a010 0x7fd83815be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:49.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.746+0000 7fd83fe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd83815d710 0x7fd838159380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:49.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.746+0000 7fd83fe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd838160720 0x7fd83806e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:49.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.746+0000 7fd83fe00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd8380d0cb0 con 0x7fd83815a010 2024-04-17T17:51:49.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.746+0000 7fd83fe00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd83815c9d0 con 0x7fd83815d710 2024-04-17T17:51:49.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.746+0000 7fd83fe00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fd83816a5d0 con 0x7fd838160720 2024-04-17T17:51:49.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.746+0000 7fd83ca00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd83815d710 0x7fd838159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:49.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.746+0000 7fd83ca00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd83815d710 0x7fd838159380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.152:46740/0 (socket says 172.21.15.152:46740) 2024-04-17T17:51:49.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.746+0000 7fd83ca00640 1 -- 172.21.15.152:0/2438949103 learned_addr learned my addr 172.21.15.152:0/2438949103 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T17:51:49.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.746+0000 7fd83d400640 1 --2- 172.21.15.152:0/2438949103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd83815a010 0x7fd83815be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:49.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.746+0000 7fd83de00640 1 --2- 172.21.15.152:0/2438949103 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd838160720 0x7fd83806e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:49.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.746+0000 7fd83ca00640 1 -- 172.21.15.152:0/2438949103 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd838160720 msgr2=0x7fd83806e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:49.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.746+0000 7fd83ca00640 1 --2- 172.21.15.152:0/2438949103 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd838160720 0x7fd83806e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:49.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.746+0000 7fd83ca00640 1 -- 172.21.15.152:0/2438949103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd83815a010 msgr2=0x7fd83815be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:49.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.746+0000 7fd83ca00640 1 --2- 172.21.15.152:0/2438949103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd83815a010 0x7fd83815be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:49.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.746+0000 7fd83ca00640 1 -- 172.21.15.152:0/2438949103 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd83806ebb0 con 0x7fd83815d710 2024-04-17T17:51:49.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.746+0000 7fd83d400640 1 --2- 172.21.15.152:0/2438949103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd83815a010 0x7fd83815be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T17:51:49.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.746+0000 7fd83ca00640 1 --2- 172.21.15.152:0/2438949103 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd83815d710 0x7fd838159380 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fd824007fd0 tx=0x7fd82400cbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:49.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.750+0000 7fd835600640 1 -- 172.21.15.152:0/2438949103 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd824018070 con 0x7fd83815d710 2024-04-17T17:51:49.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.750+0000 7fd835600640 1 -- 172.21.15.152:0/2438949103 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8240072d0 con 0x7fd83815d710 2024-04-17T17:51:49.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.750+0000 7fd835600640 1 -- 172.21.15.152:0/2438949103 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8240047f0 con 0x7fd83815d710 2024-04-17T17:51:49.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.750+0000 7fd83fe00640 1 -- 172.21.15.152:0/2438949103 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd83806ee50 con 0x7fd83815d710 2024-04-17T17:51:49.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.750+0000 7fd83fe00640 1 -- 172.21.15.152:0/2438949103 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd83806f410 con 0x7fd83815d710 2024-04-17T17:51:49.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.750+0000 7fd83fe00640 1 -- 172.21.15.152:0/2438949103 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd838068a30 con 0x7fd83815d710 2024-04-17T17:51:49.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.754+0000 7fd835600640 1 -- 172.21.15.152:0/2438949103 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd824004990 con 0x7fd83815d710 2024-04-17T17:51:49.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.754+0000 7fd835600640 1 --2- 172.21.15.152:0/2438949103 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fd8180683b0 0x7fd81806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:49.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.758+0000 7fd835600640 1 -- 172.21.15.152:0/2438949103 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7fd824085c90 con 0x7fd83815d710 2024-04-17T17:51:49.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.758+0000 7fd83d400640 1 --2- 172.21.15.152:0/2438949103 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fd8180683b0 0x7fd81806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:49.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.758+0000 7fd83d400640 1 --2- 172.21.15.152:0/2438949103 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fd8180683b0 0x7fd81806a870 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fd82c0ad000 tx=0x7fd82c0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:49.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:49.762+0000 7fd835600640 1 -- 172.21.15.152:0/2438949103 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fd8240563b0 con 0x7fd83815d710 2024-04-17T17:51:50.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.250+0000 7fd83fe00640 1 -- 172.21.15.152:0/2438949103 --> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fd838069360 con 0x7fd8180683b0 2024-04-17T17:51:50.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.294+0000 7fd835600640 1 -- 172.21.15.152:0/2438949103 <== mgr.4104 v2:172.21.15.152:6832/3078522445 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd838069360 con 0x7fd8180683b0 2024-04-17T17:51:50.296 INFO:teuthology.orchestra.run.smithi152.stderr:instructed osd(s) 0 to deep-scrub 2024-04-17T17:51:50.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.298+0000 7fd83fe00640 1 -- 172.21.15.152:0/2438949103 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fd8180683b0 msgr2=0x7fd81806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:50.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.298+0000 7fd83fe00640 1 --2- 172.21.15.152:0/2438949103 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fd8180683b0 0x7fd81806a870 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fd82c0ad000 tx=0x7fd82c0a6000 comp rx=0 tx=0).stop 2024-04-17T17:51:50.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.298+0000 7fd83fe00640 1 -- 172.21.15.152:0/2438949103 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd83815d710 msgr2=0x7fd838159380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:50.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.298+0000 7fd83fe00640 1 --2- 172.21.15.152:0/2438949103 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd83815d710 0x7fd838159380 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fd824007fd0 tx=0x7fd82400cbe0 comp rx=0 tx=0).stop 2024-04-17T17:51:50.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.298+0000 7fd83fe00640 1 -- 172.21.15.152:0/2438949103 shutdown_connections 2024-04-17T17:51:50.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.298+0000 7fd83fe00640 1 --2- 172.21.15.152:0/2438949103 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fd8180683b0 0x7fd81806a870 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:50.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.298+0000 7fd83fe00640 1 --2- 172.21.15.152:0/2438949103 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd838160720 0x7fd83806e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:50.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.298+0000 7fd83fe00640 1 --2- 172.21.15.152:0/2438949103 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd83815d710 0x7fd838159380 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:50.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.298+0000 7fd83fe00640 1 --2- 172.21.15.152:0/2438949103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd83815a010 0x7fd83815be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:50.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.298+0000 7fd83fe00640 1 -- 172.21.15.152:0/2438949103 >> 172.21.15.152:0/2438949103 conn(0x7fd8380b3350 msgr2=0x7fd8380b29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:50.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.298+0000 7fd83fe00640 1 -- 172.21.15.152:0/2438949103 shutdown_connections 2024-04-17T17:51:50.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.298+0000 7fd83fe00640 1 -- 172.21.15.152:0/2438949103 wait complete. 2024-04-17T17:51:50.352 INFO:tasks.ceph:Scrubbing osd.1 2024-04-17T17:51:50.352 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-17T17:51:50.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.758+0000 7f539ec00640 1 Processor -- start 2024-04-17T17:51:50.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.758+0000 7f539ec00640 1 -- start start 2024-04-17T17:51:50.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.762+0000 7f539ec00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f539816b4f0 0x7f5398095080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:50.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.762+0000 7f539ec00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f53980d00c0 0x7f53980d0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:50.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.762+0000 7f539ec00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53980737d0 con 0x7f539816b110 2024-04-17T17:51:50.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.762+0000 7f539ec00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f539806b9b0 con 0x7f539816b4f0 2024-04-17T17:51:50.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.762+0000 7f539ec00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f5398073ab0 con 0x7f53980d00c0 2024-04-17T17:51:50.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.762+0000 7f5397e00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f539816b110 0x7f5398072ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:54726/0 (socket says 172.21.15.152:54726) 2024-04-17T17:51:50.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.762+0000 7f5397e00640 1 -- 172.21.15.152:0/2971260151 learned_addr learned my addr 172.21.15.152:0/2971260151 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T17:51:50.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.762+0000 7f538f400640 1 --2- 172.21.15.152:0/2971260151 >> v2:172.21.15.152:3300/0 conn(0x7f539816b4f0 0x7f5398095080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:50.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.762+0000 7f539cc00640 1 --2- 172.21.15.152:0/2971260151 >> v2:172.21.15.196:3300/0 conn(0x7f53980d00c0 0x7f53980d0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:50.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.766+0000 7f5397400640 1 -- 172.21.15.152:0/2971260151 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1627840176 0 0) 0x7f53980737d0 con 0x7f539816b110 2024-04-17T17:51:50.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.774+0000 7f5397400640 1 -- 172.21.15.152:0/2971260151 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f537c003510 con 0x7f539816b110 2024-04-17T17:51:50.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.774+0000 7f539cc00640 1 -- 172.21.15.152:0/2971260151 >> v2:172.21.15.152:3300/0 conn(0x7f539816b4f0 msgr2=0x7f5398095080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T17:51:50.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.774+0000 7f5397400640 1 -- 172.21.15.152:0/2971260151 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2598196158 0 0) 0x7f537c003510 con 0x7f539816b110 2024-04-17T17:51:50.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.774+0000 7f539cc00640 1 --2- 172.21.15.152:0/2971260151 >> v2:172.21.15.152:3300/0 conn(0x7f539816b4f0 0x7f5398095080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:50.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.774+0000 7f539cc00640 1 -- 172.21.15.152:0/2971260151 >> v1:172.21.15.152:6789/0 conn(0x7f539816b110 legacy=0x7f5398072ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:50.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.774+0000 7f539cc00640 1 -- 172.21.15.152:0/2971260151 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5398073d90 con 0x7f53980d00c0 2024-04-17T17:51:50.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.778+0000 7f539cc00640 1 --2- 172.21.15.152:0/2971260151 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53980d00c0 0x7f53980d0550 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f53980b4130 tx=0x7f539001c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6f2aacf2f90a965 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:50.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.778+0000 7f5397400640 1 -- 172.21.15.152:0/2971260151 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53900b1070 con 0x7f53980d00c0 2024-04-17T17:51:50.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.778+0000 7f5397400640 1 -- 172.21.15.152:0/2971260151 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f539000ae50 con 0x7f53980d00c0 2024-04-17T17:51:50.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.778+0000 7f5397400640 1 -- 172.21.15.152:0/2971260151 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5388001a00 con 0x7f53980d00c0 2024-04-17T17:51:50.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.778+0000 7f539ec00640 1 -- 172.21.15.152:0/2971260151 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53980d00c0 msgr2=0x7f53980d0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:50.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.778+0000 7f539ec00640 1 --2- 172.21.15.152:0/2971260151 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53980d00c0 0x7f53980d0550 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f53980b4130 tx=0x7f539001c410 comp rx=0 tx=0).stop 2024-04-17T17:51:50.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.778+0000 7f539ec00640 1 -- 172.21.15.152:0/2971260151 shutdown_connections 2024-04-17T17:51:50.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.778+0000 7f539ec00640 1 --2- 172.21.15.152:0/2971260151 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53980d00c0 0x7f53980d0550 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:50.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.778+0000 7f539ec00640 1 --2- 172.21.15.152:0/2971260151 >> v2:172.21.15.152:3300/0 conn(0x7f539816b4f0 0x7f5398095080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:50.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.778+0000 7f539ec00640 1 -- 172.21.15.152:0/2971260151 >> 172.21.15.152:0/2971260151 conn(0x7f5398072140 msgr2=0x7f53980b4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:50.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.778+0000 7f539ec00640 1 -- 172.21.15.152:0/2971260151 shutdown_connections 2024-04-17T17:51:50.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.778+0000 7f539ec00640 1 -- 172.21.15.152:0/2971260151 wait complete. 2024-04-17T17:51:50.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.782+0000 7f539ec00640 1 Processor -- start 2024-04-17T17:51:50.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.782+0000 7f539ec00640 1 -- start start 2024-04-17T17:51:50.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.786+0000 7f539ec00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53980d00c0 0x7f539808fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:50.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.786+0000 7f539ec00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f539816b110 0x7f539809d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:50.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.786+0000 7f539ec00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f539816b4f0 0x7f53980ae1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:50.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.786+0000 7f539ec00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f539806e840 con 0x7f539816b4f0 2024-04-17T17:51:50.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.786+0000 7f539ec00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f539806e6c0 con 0x7f539816b110 2024-04-17T17:51:50.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.786+0000 7f539ec00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f539806c120 con 0x7f53980d00c0 2024-04-17T17:51:50.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.786+0000 7f539cc00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f539816b4f0 0x7f53980ae1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:50.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.786+0000 7f539cc00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f539816b4f0 0x7f53980ae1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39802/0 (socket says 172.21.15.152:39802) 2024-04-17T17:51:50.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.786+0000 7f539cc00640 1 -- 172.21.15.152:0/880381406 learned_addr learned my addr 172.21.15.152:0/880381406 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T17:51:50.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.786+0000 7f5397e00640 1 --2- 172.21.15.152:0/880381406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53980d00c0 0x7f539808fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:50.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.786+0000 7f538f400640 1 --2- 172.21.15.152:0/880381406 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f539816b110 0x7f539809d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:50.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.786+0000 7f5397e00640 1 -- 172.21.15.152:0/880381406 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f539816b110 msgr2=0x7f539809d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:50.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.786+0000 7f5397e00640 1 --2- 172.21.15.152:0/880381406 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f539816b110 0x7f539809d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:50.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.786+0000 7f5397e00640 1 -- 172.21.15.152:0/880381406 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f539816b4f0 msgr2=0x7f53980ae1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:50.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.786+0000 7f5397e00640 1 --2- 172.21.15.152:0/880381406 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f539816b4f0 0x7f53980ae1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:50.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.786+0000 7f5397e00640 1 -- 172.21.15.152:0/880381406 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f539808ffc0 con 0x7f53980d00c0 2024-04-17T17:51:50.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.786+0000 7f539cc00640 1 --2- 172.21.15.152:0/880381406 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f539816b4f0 0x7f53980ae1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T17:51:50.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.790+0000 7f5397e00640 1 --2- 172.21.15.152:0/880381406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53980d00c0 0x7f539808fa80 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5388001710 tx=0x7f538800a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:50.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.790+0000 7f5394c00640 1 -- 172.21.15.152:0/880381406 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5388017070 con 0x7f53980d00c0 2024-04-17T17:51:50.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.790+0000 7f5394c00640 1 -- 172.21.15.152:0/880381406 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f538800ce20 con 0x7f53980d00c0 2024-04-17T17:51:50.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.790+0000 7f5394c00640 1 -- 172.21.15.152:0/880381406 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5388012640 con 0x7f53980d00c0 2024-04-17T17:51:50.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.790+0000 7f539ec00640 1 -- 172.21.15.152:0/880381406 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f539809c4c0 con 0x7f53980d00c0 2024-04-17T17:51:50.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.790+0000 7f539ec00640 1 -- 172.21.15.152:0/880381406 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f539809ca80 con 0x7f53980d00c0 2024-04-17T17:51:50.795 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.790+0000 7f539ec00640 1 -- 172.21.15.152:0/880381406 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5398068a30 con 0x7f53980d00c0 2024-04-17T17:51:50.795 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.790+0000 7f5394c00640 1 -- 172.21.15.152:0/880381406 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f538801a070 con 0x7f53980d00c0 2024-04-17T17:51:50.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.794+0000 7f5394c00640 1 --2- 172.21.15.152:0/880381406 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5374068380 0x7f537406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:50.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.794+0000 7f5394c00640 1 -- 172.21.15.152:0/880381406 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f5388086770 con 0x7f53980d00c0 2024-04-17T17:51:50.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.794+0000 7f538f400640 1 --2- 172.21.15.152:0/880381406 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5374068380 0x7f537406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:50.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.794+0000 7f5394c00640 1 --2- 172.21.15.152:0/880381406 >> [v2:172.21.15.152:6800/4133383142,v1:172.21.15.152:6801/4133383142] conn(0x7f537406e820 0x7f5374070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:50.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.794+0000 7f5394c00640 1 -- 172.21.15.152:0/880381406 --> [v2:172.21.15.152:6800/4133383142,v1:172.21.15.152:6801/4133383142] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5374071330 con 0x7f537406e820 2024-04-17T17:51:50.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.794+0000 7f5394c00640 1 -- 172.21.15.152:0/880381406 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f538808d050 con 0x7f53980d00c0 2024-04-17T17:51:50.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.794+0000 7f539cc00640 1 --2- 172.21.15.152:0/880381406 >> [v2:172.21.15.152:6800/4133383142,v1:172.21.15.152:6801/4133383142] conn(0x7f537406e820 0x7f5374070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:50.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.794+0000 7f539cc00640 1 --2- 172.21.15.152:0/880381406 >> [v2:172.21.15.152:6800/4133383142,v1:172.21.15.152:6801/4133383142] conn(0x7f537406e820 0x7f5374070c60 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:50.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.798+0000 7f538f400640 1 --2- 172.21.15.152:0/880381406 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5374068380 0x7f537406a840 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f53980943a0 tx=0x7f538000f040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:50.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.930+0000 7f5394c00640 1 -- 172.21.15.152:0/880381406 <== osd.1 v2:172.21.15.152:6800/4133383142 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5374071330 con 0x7f537406e820 2024-04-17T17:51:50.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.970+0000 7f539ec00640 1 -- 172.21.15.152:0/880381406 --> [v2:172.21.15.152:6800/4133383142,v1:172.21.15.152:6801/4133383142] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f53980cfea0 con 0x7f537406e820 2024-04-17T17:51:50.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.974+0000 7f5394c00640 1 -- 172.21.15.152:0/880381406 <== osd.1 v2:172.21.15.152:6800/4133383142 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f53980cfea0 con 0x7f537406e820 2024-04-17T17:51:50.979 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-17T17:51:50.979 INFO:teuthology.orchestra.run.smithi152.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-17T17:51:50.980 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-17T17:51:50.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.978+0000 7f539ec00640 1 -- 172.21.15.152:0/880381406 >> [v2:172.21.15.152:6800/4133383142,v1:172.21.15.152:6801/4133383142] conn(0x7f537406e820 msgr2=0x7f5374070c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:50.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.978+0000 7f539ec00640 1 --2- 172.21.15.152:0/880381406 >> [v2:172.21.15.152:6800/4133383142,v1:172.21.15.152:6801/4133383142] conn(0x7f537406e820 0x7f5374070c60 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:50.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.978+0000 7f539ec00640 1 -- 172.21.15.152:0/880381406 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5374068380 msgr2=0x7f537406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:50.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.978+0000 7f539ec00640 1 --2- 172.21.15.152:0/880381406 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5374068380 0x7f537406a840 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f53980943a0 tx=0x7f538000f040 comp rx=0 tx=0).stop 2024-04-17T17:51:50.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.978+0000 7f539ec00640 1 -- 172.21.15.152:0/880381406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53980d00c0 msgr2=0x7f539808fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:50.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.978+0000 7f539ec00640 1 --2- 172.21.15.152:0/880381406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53980d00c0 0x7f539808fa80 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5388001710 tx=0x7f538800a430 comp rx=0 tx=0).stop 2024-04-17T17:51:50.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.978+0000 7f539cc00640 1 -- 172.21.15.152:0/880381406 reap_dead start 2024-04-17T17:51:50.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.978+0000 7f539ec00640 1 -- 172.21.15.152:0/880381406 shutdown_connections 2024-04-17T17:51:50.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.978+0000 7f539ec00640 1 -- 172.21.15.152:0/880381406 >> 172.21.15.152:0/880381406 conn(0x7f5398072140 msgr2=0x7f5398072ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:50.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.978+0000 7f539ec00640 1 -- 172.21.15.152:0/880381406 shutdown_connections 2024-04-17T17:51:50.982 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:50.978+0000 7f539ec00640 1 -- 172.21.15.152:0/880381406 wait complete. 2024-04-17T17:51:51.028 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-17T17:51:51.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.426+0000 7f9f4a800640 1 Processor -- start 2024-04-17T17:51:51.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.426+0000 7f9f4a800640 1 -- start start 2024-04-17T17:51:51.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.430+0000 7f9f4a800640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f9f4406fa70 0x7f9f4406cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:51.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.430+0000 7f9f4a800640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f4406e340 con 0x7f9f440729f0 2024-04-17T17:51:51.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.430+0000 7f9f4a800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f44070030 con 0x7f9f440b5290 2024-04-17T17:51:51.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.430+0000 7f9f4a800640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f9f4406c240 con 0x7f9f4406fa70 2024-04-17T17:51:51.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.430+0000 7f9f48a00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f9f440729f0 0x7f9f440b3900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:54738/0 (socket says 172.21.15.152:54738) 2024-04-17T17:51:51.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.430+0000 7f9f48a00640 1 -- 172.21.15.152:0/306380447 learned_addr learned my addr 172.21.15.152:0/306380447 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T17:51:51.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.430+0000 7f9f49e00640 1 --2- 172.21.15.152:0/306380447 >> v2:172.21.15.152:3300/0 conn(0x7f9f4406fa70 0x7f9f4406cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:51.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.430+0000 7f9f43e00640 1 -- 172.21.15.152:0/306380447 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 546138543 0 0) 0x7f9f4406e340 con 0x7f9f440729f0 2024-04-17T17:51:51.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.430+0000 7f9f43e00640 1 -- 172.21.15.152:0/306380447 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f2c003530 con 0x7f9f440729f0 2024-04-17T17:51:51.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.430+0000 7f9f49e00640 1 -- 172.21.15.152:0/306380447 >> v1:172.21.15.196:6789/0 conn(0x7f9f440b5290 legacy=0x7f9f440722e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:51.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.430+0000 7f9f49e00640 1 -- 172.21.15.152:0/306380447 >> v1:172.21.15.152:6789/0 conn(0x7f9f440729f0 legacy=0x7f9f440b3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:51.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.430+0000 7f9f49e00640 1 -- 172.21.15.152:0/306380447 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f4406c490 con 0x7f9f4406fa70 2024-04-17T17:51:51.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.438+0000 7f9f49e00640 1 --2- 172.21.15.152:0/306380447 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f4406fa70 0x7f9f4406cf70 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c009d90 tx=0x7f9f3c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53df76891841bb3b server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:51.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.442+0000 7f9f43e00640 1 -- 172.21.15.152:0/306380447 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c0b2070 con 0x7f9f4406fa70 2024-04-17T17:51:51.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.442+0000 7f9f43e00640 1 -- 172.21.15.152:0/306380447 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f3c0a5820 con 0x7f9f4406fa70 2024-04-17T17:51:51.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.442+0000 7f9f43e00640 1 -- 172.21.15.152:0/306380447 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c0a5bf0 con 0x7f9f4406fa70 2024-04-17T17:51:51.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.442+0000 7f9f4a800640 1 -- 172.21.15.152:0/306380447 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f4406fa70 msgr2=0x7f9f4406cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:51.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.442+0000 7f9f4a800640 1 --2- 172.21.15.152:0/306380447 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f4406fa70 0x7f9f4406cf70 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c009d90 tx=0x7f9f3c01c8e0 comp rx=0 tx=0).stop 2024-04-17T17:51:51.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.442+0000 7f9f4a800640 1 -- 172.21.15.152:0/306380447 shutdown_connections 2024-04-17T17:51:51.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.442+0000 7f9f4a800640 1 --2- 172.21.15.152:0/306380447 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f4406fa70 0x7f9f4406cf70 unknown :-1 s=CLOSED pgs=2064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:51.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.442+0000 7f9f4a800640 1 -- 172.21.15.152:0/306380447 >> 172.21.15.152:0/306380447 conn(0x7f9f440cd350 msgr2=0x7f9f440cd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:51.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.442+0000 7f9f4a800640 1 -- 172.21.15.152:0/306380447 shutdown_connections 2024-04-17T17:51:51.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.442+0000 7f9f4a800640 1 -- 172.21.15.152:0/306380447 wait complete. 2024-04-17T17:51:51.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.446+0000 7f9f4a800640 1 Processor -- start 2024-04-17T17:51:51.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.446+0000 7f9f4a800640 1 -- start start 2024-04-17T17:51:51.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.450+0000 7f9f4a800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f4406fa70 0x7f9f4414d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:51.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.450+0000 7f9f4a800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9f440729f0 0x7f9f4414efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:51.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.450+0000 7f9f4a800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9f440b5290 0x7f9f440d0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:51.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.450+0000 7f9f4a800640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9f440cf940 con 0x7f9f4406fa70 2024-04-17T17:51:51.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.450+0000 7f9f4a800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f9f440cf7c0 con 0x7f9f440729f0 2024-04-17T17:51:51.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.450+0000 7f9f4a800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f9f440cfac0 con 0x7f9f440b5290 2024-04-17T17:51:51.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.450+0000 7f9f49400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f4406fa70 0x7f9f4414d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:51.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.450+0000 7f9f48a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9f440729f0 0x7f9f4414efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:51.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.450+0000 7f9f48a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9f440729f0 0x7f9f4414efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.152:46762/0 (socket says 172.21.15.152:46762) 2024-04-17T17:51:51.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.450+0000 7f9f48a00640 1 -- 172.21.15.152:0/3321779501 learned_addr learned my addr 172.21.15.152:0/3321779501 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T17:51:51.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.450+0000 7f9f49e00640 1 --2- 172.21.15.152:0/3321779501 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9f440b5290 0x7f9f440d0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:51.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.450+0000 7f9f48a00640 1 -- 172.21.15.152:0/3321779501 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9f440b5290 msgr2=0x7f9f440d0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:51.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.450+0000 7f9f48a00640 1 --2- 172.21.15.152:0/3321779501 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9f440b5290 0x7f9f440d0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:51.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.450+0000 7f9f48a00640 1 -- 172.21.15.152:0/3321779501 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f4406fa70 msgr2=0x7f9f4414d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:51.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.450+0000 7f9f48a00640 1 --2- 172.21.15.152:0/3321779501 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f4406fa70 0x7f9f4414d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:51.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.450+0000 7f9f48a00640 1 -- 172.21.15.152:0/3321779501 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f4414df40 con 0x7f9f440729f0 2024-04-17T17:51:51.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.450+0000 7f9f48a00640 1 --2- 172.21.15.152:0/3321779501 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9f440729f0 0x7f9f4414efe0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f9f3000c4d0 tx=0x7f9f3000c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:51.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.450+0000 7f9f41600640 1 -- 172.21.15.152:0/3321779501 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f30017070 con 0x7f9f440729f0 2024-04-17T17:51:51.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.450+0000 7f9f41600640 1 -- 172.21.15.152:0/3321779501 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f30005cf0 con 0x7f9f440729f0 2024-04-17T17:51:51.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.450+0000 7f9f41600640 1 -- 172.21.15.152:0/3321779501 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f30007270 con 0x7f9f440729f0 2024-04-17T17:51:51.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.450+0000 7f9f4a800640 1 -- 172.21.15.152:0/3321779501 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f4414e220 con 0x7f9f440729f0 2024-04-17T17:51:51.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.454+0000 7f9f4a800640 1 -- 172.21.15.152:0/3321779501 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f4414e7e0 con 0x7f9f440729f0 2024-04-17T17:51:51.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.454+0000 7f9f41600640 1 -- 172.21.15.152:0/3321779501 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9f3001a070 con 0x7f9f440729f0 2024-04-17T17:51:51.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.454+0000 7f9f4a800640 1 -- 172.21.15.152:0/3321779501 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f44144c30 con 0x7f9f440729f0 2024-04-17T17:51:51.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.458+0000 7f9f41600640 1 --2- 172.21.15.152:0/3321779501 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9f24068380 0x7f9f2406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:51.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.458+0000 7f9f41600640 1 -- 172.21.15.152:0/3321779501 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f9f30085b30 con 0x7f9f440729f0 2024-04-17T17:51:51.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.458+0000 7f9f49400640 1 --2- 172.21.15.152:0/3321779501 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9f24068380 0x7f9f2406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:51.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.458+0000 7f9f49400640 1 --2- 172.21.15.152:0/3321779501 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9f24068380 0x7f9f2406a840 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f9f440b3fc0 tx=0x7f9f38009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:51.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.462+0000 7f9f41600640 1 -- 172.21.15.152:0/3321779501 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f9f44144c30 con 0x7f9f440729f0 2024-04-17T17:51:51.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.942+0000 7f9f4a800640 1 -- 172.21.15.152:0/3321779501 --> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f9f44075be0 con 0x7f9f24068380 2024-04-17T17:51:51.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.958+0000 7f9f41600640 1 -- 172.21.15.152:0/3321779501 <== mgr.4104 v2:172.21.15.152:6832/3078522445 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f9f44075be0 con 0x7f9f24068380 2024-04-17T17:51:51.962 INFO:teuthology.orchestra.run.smithi152.stderr:instructed osd(s) 1 to deep-scrub 2024-04-17T17:51:51.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.962+0000 7f9f4a800640 1 -- 172.21.15.152:0/3321779501 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9f24068380 msgr2=0x7f9f2406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:51.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.962+0000 7f9f4a800640 1 --2- 172.21.15.152:0/3321779501 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9f24068380 0x7f9f2406a840 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f9f440b3fc0 tx=0x7f9f38009040 comp rx=0 tx=0).stop 2024-04-17T17:51:51.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.962+0000 7f9f4a800640 1 -- 172.21.15.152:0/3321779501 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9f440729f0 msgr2=0x7f9f4414efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:51.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.962+0000 7f9f4a800640 1 --2- 172.21.15.152:0/3321779501 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9f440729f0 0x7f9f4414efe0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f9f3000c4d0 tx=0x7f9f3000c990 comp rx=0 tx=0).stop 2024-04-17T17:51:51.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.962+0000 7f9f4a800640 1 -- 172.21.15.152:0/3321779501 shutdown_connections 2024-04-17T17:51:51.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.962+0000 7f9f4a800640 1 --2- 172.21.15.152:0/3321779501 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f9f24068380 0x7f9f2406a840 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:51.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.962+0000 7f9f4a800640 1 --2- 172.21.15.152:0/3321779501 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9f440b5290 0x7f9f440d0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:51.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.962+0000 7f9f4a800640 1 --2- 172.21.15.152:0/3321779501 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9f440729f0 0x7f9f4414efe0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:51.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.962+0000 7f9f4a800640 1 --2- 172.21.15.152:0/3321779501 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f4406fa70 0x7f9f4414d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:51.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.962+0000 7f9f4a800640 1 -- 172.21.15.152:0/3321779501 >> 172.21.15.152:0/3321779501 conn(0x7f9f440cd350 msgr2=0x7f9f44166ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:51.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.962+0000 7f9f4a800640 1 -- 172.21.15.152:0/3321779501 shutdown_connections 2024-04-17T17:51:51.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:51.962+0000 7f9f4a800640 1 -- 172.21.15.152:0/3321779501 wait complete. 2024-04-17T17:51:52.019 INFO:tasks.ceph:Scrubbing osd.2 2024-04-17T17:51:52.019 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-17T17:51:52.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.430+0000 7f345b400640 1 Processor -- start 2024-04-17T17:51:52.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.430+0000 7f345b400640 1 -- start start 2024-04-17T17:51:52.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.434+0000 7f345b400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f345415a010 0x7f34540d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:52.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.434+0000 7f345b400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f345415d710 0x7f34540d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:52.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.434+0000 7f345b400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3454160010 0x7f34541604a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:52.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.434+0000 7f345b400640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f345415d280 con 0x7f345415a010 2024-04-17T17:51:52.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.434+0000 7f345b400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f345415c9d0 con 0x7f345415d710 2024-04-17T17:51:52.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.434+0000 7f345b400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f3454160d20 con 0x7f3454160010 2024-04-17T17:51:52.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.434+0000 7f3458a00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f345415a010 0x7f34540d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:52.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.434+0000 7f3458a00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f345415a010 0x7f34540d0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39828/0 (socket says 172.21.15.152:39828) 2024-04-17T17:51:52.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.434+0000 7f3458a00640 1 -- 172.21.15.152:0/3948077580 learned_addr learned my addr 172.21.15.152:0/3948077580 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T17:51:52.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.434+0000 7f3459400640 1 --2- 172.21.15.152:0/3948077580 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3454160010 0x7f34541604a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:52.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.434+0000 7f3453e00640 1 --2- 172.21.15.152:0/3948077580 >> v2:172.21.15.196:3300/0 conn(0x7f345415d710 0x7f34540d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:52.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.434+0000 7f3458a00640 1 -- 172.21.15.152:0/3948077580 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3454160010 msgr2=0x7f34541604a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T17:51:52.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.434+0000 7f3458a00640 1 --2- 172.21.15.152:0/3948077580 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3454160010 0x7f34541604a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:52.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.434+0000 7f3458a00640 1 -- 172.21.15.152:0/3948077580 >> v2:172.21.15.196:3300/0 conn(0x7f345415d710 msgr2=0x7f34540d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T17:51:52.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.434+0000 7f3458a00640 1 --2- 172.21.15.152:0/3948077580 >> v2:172.21.15.196:3300/0 conn(0x7f345415d710 0x7f34540d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:52.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.434+0000 7f3458a00640 1 -- 172.21.15.152:0/3948077580 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f345415cc30 con 0x7f345415a010 2024-04-17T17:51:52.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.434+0000 7f3453e00640 1 --2- 172.21.15.152:0/3948077580 >> v2:172.21.15.196:3300/0 conn(0x7f345415d710 0x7f34540d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T17:51:52.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.442+0000 7f3458a00640 1 --2- 172.21.15.152:0/3948077580 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f345415a010 0x7f34540d0360 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 crypto rx=0x7f34540b1d10 tx=0x7f344801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9da715421261dd2 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:52.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.446+0000 7f3453400640 1 -- 172.21.15.152:0/3948077580 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34480b0070 con 0x7f345415a010 2024-04-17T17:51:52.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.446+0000 7f3453400640 1 -- 172.21.15.152:0/3948077580 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34480ab600 con 0x7f345415a010 2024-04-17T17:51:52.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.446+0000 7f3453400640 1 -- 172.21.15.152:0/3948077580 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34480ab9d0 con 0x7f345415a010 2024-04-17T17:51:52.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.446+0000 7f345b400640 1 -- 172.21.15.152:0/3948077580 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f345415a010 msgr2=0x7f34540d0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:52.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.446+0000 7f345b400640 1 --2- 172.21.15.152:0/3948077580 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f345415a010 0x7f34540d0360 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 crypto rx=0x7f34540b1d10 tx=0x7f344801c490 comp rx=0 tx=0).stop 2024-04-17T17:51:52.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.446+0000 7f345b400640 1 -- 172.21.15.152:0/3948077580 shutdown_connections 2024-04-17T17:51:52.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.446+0000 7f345b400640 1 --2- 172.21.15.152:0/3948077580 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3454160010 0x7f34541604a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:52.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.446+0000 7f345b400640 1 --2- 172.21.15.152:0/3948077580 >> v2:172.21.15.196:3300/0 conn(0x7f345415d710 0x7f34540d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:52.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.446+0000 7f345b400640 1 --2- 172.21.15.152:0/3948077580 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f345415a010 0x7f34540d0360 unknown :-1 s=CLOSED pgs=2065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:52.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.446+0000 7f345b400640 1 -- 172.21.15.152:0/3948077580 >> 172.21.15.152:0/3948077580 conn(0x7f34540b3350 msgr2=0x7f34540b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:52.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.446+0000 7f345b400640 1 -- 172.21.15.152:0/3948077580 shutdown_connections 2024-04-17T17:51:52.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.446+0000 7f345b400640 1 -- 172.21.15.152:0/3948077580 wait complete. 2024-04-17T17:51:52.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.450+0000 7f345b400640 1 Processor -- start 2024-04-17T17:51:52.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.450+0000 7f345b400640 1 -- start start 2024-04-17T17:51:52.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.450+0000 7f345b400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f345415a010 0x7f345415aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:52.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.450+0000 7f345b400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f345415d710 0x7f345414f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:52.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.450+0000 7f345b400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3454160010 0x7f3454099290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:52.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.450+0000 7f345b400640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f345406c340 con 0x7f345415a010 2024-04-17T17:51:52.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.450+0000 7f345b400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f345406c1c0 con 0x7f345415d710 2024-04-17T17:51:52.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.450+0000 7f345b400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f345406c4c0 con 0x7f3454160010 2024-04-17T17:51:52.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.450+0000 7f3453e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f345415d710 0x7f345414f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:52.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.450+0000 7f3458a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f345415a010 0x7f345415aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:52.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.450+0000 7f3453e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f345415d710 0x7f345414f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.152:46770/0 (socket says 172.21.15.152:46770) 2024-04-17T17:51:52.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.450+0000 7f3453e00640 1 -- 172.21.15.152:0/1856426138 learned_addr learned my addr 172.21.15.152:0/1856426138 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T17:51:52.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.450+0000 7f3459400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3454160010 0x7f3454099290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:52.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.454+0000 7f3458a00640 1 -- 172.21.15.152:0/1856426138 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3454160010 msgr2=0x7f3454099290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:52.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.454+0000 7f3458a00640 1 --2- 172.21.15.152:0/1856426138 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3454160010 0x7f3454099290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:52.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.454+0000 7f3458a00640 1 -- 172.21.15.152:0/1856426138 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f345415d710 msgr2=0x7f345414f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:52.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.454+0000 7f3458a00640 1 --2- 172.21.15.152:0/1856426138 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f345415d710 0x7f345414f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:52.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.454+0000 7f3458a00640 1 -- 172.21.15.152:0/1856426138 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f345415b750 con 0x7f345415a010 2024-04-17T17:51:52.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.454+0000 7f3453e00640 1 --2- 172.21.15.152:0/1856426138 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f345415d710 0x7f345414f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T17:51:52.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.454+0000 7f3458a00640 1 --2- 172.21.15.152:0/1856426138 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f345415a010 0x7f345415aeb0 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7f34540d0f80 tx=0x7f3448019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:52.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.454+0000 7f3450c00640 1 -- 172.21.15.152:0/1856426138 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34480b0040 con 0x7f345415a010 2024-04-17T17:51:52.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.454+0000 7f3450c00640 1 -- 172.21.15.152:0/1856426138 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34480ab400 con 0x7f345415a010 2024-04-17T17:51:52.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.454+0000 7f3450c00640 1 -- 172.21.15.152:0/1856426138 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34480b4640 con 0x7f345415a010 2024-04-17T17:51:52.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.454+0000 7f345b400640 1 -- 172.21.15.152:0/1856426138 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f345415ba30 con 0x7f345415a010 2024-04-17T17:51:52.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.454+0000 7f345b400640 1 -- 172.21.15.152:0/1856426138 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f345415bd10 con 0x7f345415a010 2024-04-17T17:51:52.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.454+0000 7f345b400640 1 -- 172.21.15.152:0/1856426138 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3454068a30 con 0x7f345415a010 2024-04-17T17:51:52.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.458+0000 7f3450c00640 1 -- 172.21.15.152:0/1856426138 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f34480bb020 con 0x7f345415a010 2024-04-17T17:51:52.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.458+0000 7f3450c00640 1 --2- 172.21.15.152:0/1856426138 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3434068380 0x7f343406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:52.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.458+0000 7f3450c00640 1 -- 172.21.15.152:0/1856426138 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f3448120730 con 0x7f345415a010 2024-04-17T17:51:52.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.458+0000 7f3453e00640 1 --2- 172.21.15.152:0/1856426138 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3434068380 0x7f343406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:52.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.462+0000 7f3450c00640 1 --2- 172.21.15.152:0/1856426138 >> [v2:172.21.15.152:6808/3826143898,v1:172.21.15.152:6809/3826143898] conn(0x7f343406e820 0x7f3434070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:52.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.462+0000 7f3450c00640 1 -- 172.21.15.152:0/1856426138 --> [v2:172.21.15.152:6808/3826143898,v1:172.21.15.152:6809/3826143898] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f34480adec0 con 0x7f343406e820 2024-04-17T17:51:52.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.462+0000 7f3450c00640 1 -- 172.21.15.152:0/1856426138 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f3448120ae0 con 0x7f345415a010 2024-04-17T17:51:52.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.462+0000 7f3459400640 1 --2- 172.21.15.152:0/1856426138 >> [v2:172.21.15.152:6808/3826143898,v1:172.21.15.152:6809/3826143898] conn(0x7f343406e820 0x7f3434070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:52.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.462+0000 7f3453e00640 1 --2- 172.21.15.152:0/1856426138 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3434068380 0x7f343406a840 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f34540aebf0 tx=0x7f3440008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:52.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.462+0000 7f3459400640 1 --2- 172.21.15.152:0/1856426138 >> [v2:172.21.15.152:6808/3826143898,v1:172.21.15.152:6809/3826143898] conn(0x7f343406e820 0x7f3434070c60 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:52.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.570+0000 7f3450c00640 1 -- 172.21.15.152:0/1856426138 <== osd.2 v2:172.21.15.152:6808/3826143898 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f34480adec0 con 0x7f343406e820 2024-04-17T17:51:52.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.582+0000 7f345b400640 1 -- 172.21.15.152:0/1856426138 --> [v2:172.21.15.152:6808/3826143898,v1:172.21.15.152:6809/3826143898] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f34540723f0 con 0x7f343406e820 2024-04-17T17:51:52.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.586+0000 7f3450c00640 1 -- 172.21.15.152:0/1856426138 <== osd.2 v2:172.21.15.152:6808/3826143898 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f34540723f0 con 0x7f343406e820 2024-04-17T17:51:52.589 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-17T17:51:52.589 INFO:teuthology.orchestra.run.smithi152.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-17T17:51:52.589 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-17T17:51:52.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.586+0000 7f345b400640 1 -- 172.21.15.152:0/1856426138 >> [v2:172.21.15.152:6808/3826143898,v1:172.21.15.152:6809/3826143898] conn(0x7f343406e820 msgr2=0x7f3434070c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:52.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.586+0000 7f345b400640 1 --2- 172.21.15.152:0/1856426138 >> [v2:172.21.15.152:6808/3826143898,v1:172.21.15.152:6809/3826143898] conn(0x7f343406e820 0x7f3434070c60 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:52.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.586+0000 7f345b400640 1 -- 172.21.15.152:0/1856426138 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3434068380 msgr2=0x7f343406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:52.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.586+0000 7f345b400640 1 --2- 172.21.15.152:0/1856426138 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3434068380 0x7f343406a840 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f34540aebf0 tx=0x7f3440008040 comp rx=0 tx=0).stop 2024-04-17T17:51:52.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.586+0000 7f345b400640 1 -- 172.21.15.152:0/1856426138 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f345415a010 msgr2=0x7f345415aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:52.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.586+0000 7f345b400640 1 --2- 172.21.15.152:0/1856426138 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f345415a010 0x7f345415aeb0 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7f34540d0f80 tx=0x7f3448019230 comp rx=0 tx=0).stop 2024-04-17T17:51:52.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.586+0000 7f3459400640 1 -- 172.21.15.152:0/1856426138 reap_dead start 2024-04-17T17:51:52.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.586+0000 7f345b400640 1 -- 172.21.15.152:0/1856426138 shutdown_connections 2024-04-17T17:51:52.592 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.586+0000 7f345b400640 1 -- 172.21.15.152:0/1856426138 >> 172.21.15.152:0/1856426138 conn(0x7f34540b3350 msgr2=0x7f3454154880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:52.592 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.586+0000 7f345b400640 1 -- 172.21.15.152:0/1856426138 shutdown_connections 2024-04-17T17:51:52.592 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:52.586+0000 7f345b400640 1 -- 172.21.15.152:0/1856426138 wait complete. 2024-04-17T17:51:52.635 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-17T17:51:53.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.030+0000 7f5321400640 1 Processor -- start 2024-04-17T17:51:53.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.030+0000 7f5321400640 1 -- start start 2024-04-17T17:51:53.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.034+0000 7f5321400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f531c161b70 0x7f531c06dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:53.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.034+0000 7f5321400640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f531c06e6b0 con 0x7f531c0d0a70 2024-04-17T17:51:53.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.034+0000 7f5321400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f531c06e990 con 0x7f531c06e1a0 2024-04-17T17:51:53.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.034+0000 7f5321400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f531c161f50 con 0x7f531c161b70 2024-04-17T17:51:53.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.034+0000 7f5311e00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f531c06e1a0 0x7f531c0d0360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.152:45942/0 (socket says 172.21.15.152:45942) 2024-04-17T17:51:53.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.034+0000 7f5311e00640 1 -- 172.21.15.152:0/1119515088 learned_addr learned my addr 172.21.15.152:0/1119515088 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T17:51:53.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.034+0000 7f531a800640 1 --2- 172.21.15.152:0/1119515088 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f531c161b70 0x7f531c06dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:53.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.034+0000 7f5319e00640 1 -- 172.21.15.152:0/1119515088 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2218589688 0 0) 0x7f531c06e6b0 con 0x7f531c0d0a70 2024-04-17T17:51:53.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.034+0000 7f5319e00640 1 -- 172.21.15.152:0/1119515088 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5300003530 con 0x7f531c0d0a70 2024-04-17T17:51:53.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.034+0000 7f531a800640 1 -- 172.21.15.152:0/1119515088 >> v1:172.21.15.196:6789/0 conn(0x7f531c06e1a0 legacy=0x7f531c0d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:53.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.034+0000 7f531a800640 1 -- 172.21.15.152:0/1119515088 >> v1:172.21.15.152:6789/0 conn(0x7f531c0d0a70 legacy=0x7f531c0ad3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:53.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.034+0000 7f531a800640 1 -- 172.21.15.152:0/1119515088 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f531c06ec70 con 0x7f531c161b70 2024-04-17T17:51:53.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.042+0000 7f531a800640 1 --2- 172.21.15.152:0/1119515088 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f531c161b70 0x7f531c06dc60 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f530c0097f0 tx=0x7f530c01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5a2f644652304ce server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:53.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.046+0000 7f5319e00640 1 -- 172.21.15.152:0/1119515088 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f530c0b2070 con 0x7f531c161b70 2024-04-17T17:51:53.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.046+0000 7f5319e00640 1 -- 172.21.15.152:0/1119515088 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f530c0a9070 con 0x7f531c161b70 2024-04-17T17:51:53.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.046+0000 7f5319e00640 1 -- 172.21.15.152:0/1119515088 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f530c0ad880 con 0x7f531c161b70 2024-04-17T17:51:53.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.046+0000 7f5321400640 1 -- 172.21.15.152:0/1119515088 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f531c161b70 msgr2=0x7f531c06dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:53.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.046+0000 7f5321400640 1 --2- 172.21.15.152:0/1119515088 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f531c161b70 0x7f531c06dc60 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f530c0097f0 tx=0x7f530c01c450 comp rx=0 tx=0).stop 2024-04-17T17:51:53.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.046+0000 7f5321400640 1 -- 172.21.15.152:0/1119515088 shutdown_connections 2024-04-17T17:51:53.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.046+0000 7f5321400640 1 --2- 172.21.15.152:0/1119515088 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f531c161b70 0x7f531c06dc60 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:53.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.046+0000 7f5321400640 1 -- 172.21.15.152:0/1119515088 >> 172.21.15.152:0/1119515088 conn(0x7f531c0b3350 msgr2=0x7f531c0b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:53.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.046+0000 7f5321400640 1 -- 172.21.15.152:0/1119515088 shutdown_connections 2024-04-17T17:51:53.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.046+0000 7f5321400640 1 -- 172.21.15.152:0/1119515088 wait complete. 2024-04-17T17:51:53.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.046+0000 7f5321400640 1 Processor -- start 2024-04-17T17:51:53.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.046+0000 7f5321400640 1 -- start start 2024-04-17T17:51:53.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.050+0000 7f5321400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f531c06e1a0 0x7f531c0b0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:53.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.050+0000 7f5321400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f531c0d0a70 0x7f531c1fb530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:53.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.050+0000 7f5321400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f531c161b70 0x7f531c158650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:53.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.050+0000 7f5321400640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f531c0ae700 con 0x7f531c0d0a70 2024-04-17T17:51:53.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.050+0000 7f5321400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f531c0ae580 con 0x7f531c06e1a0 2024-04-17T17:51:53.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.050+0000 7f5321400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f531c16c1d0 con 0x7f531c161b70 2024-04-17T17:51:53.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.050+0000 7f5311e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f531c0d0a70 0x7f531c1fb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:53.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.050+0000 7f5311e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f531c0d0a70 0x7f531c1fb530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39852/0 (socket says 172.21.15.152:39852) 2024-04-17T17:51:53.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.050+0000 7f5311e00640 1 -- 172.21.15.152:0/4182378578 learned_addr learned my addr 172.21.15.152:0/4182378578 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T17:51:53.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.050+0000 7f531b200640 1 --2- 172.21.15.152:0/4182378578 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f531c161b70 0x7f531c158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:53.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.050+0000 7f531a800640 1 --2- 172.21.15.152:0/4182378578 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f531c06e1a0 0x7f531c0b0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:53.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.050+0000 7f5311e00640 1 -- 172.21.15.152:0/4182378578 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f531c161b70 msgr2=0x7f531c158650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:53.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.050+0000 7f5311e00640 1 --2- 172.21.15.152:0/4182378578 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f531c161b70 0x7f531c158650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:53.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.050+0000 7f5311e00640 1 -- 172.21.15.152:0/4182378578 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f531c06e1a0 msgr2=0x7f531c0b0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:53.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.050+0000 7f5311e00640 1 --2- 172.21.15.152:0/4182378578 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f531c06e1a0 0x7f531c0b0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:53.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.050+0000 7f5311e00640 1 -- 172.21.15.152:0/4182378578 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f531c156ff0 con 0x7f531c0d0a70 2024-04-17T17:51:53.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.050+0000 7f531b200640 1 --2- 172.21.15.152:0/4182378578 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f531c161b70 0x7f531c158650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T17:51:53.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.050+0000 7f5311e00640 1 --2- 172.21.15.152:0/4182378578 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f531c0d0a70 0x7f531c1fb530 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7f530400c3a0 tx=0x7f530400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:53.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.050+0000 7f5313400640 1 -- 172.21.15.152:0/4182378578 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5304017070 con 0x7f531c0d0a70 2024-04-17T17:51:53.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.050+0000 7f5313400640 1 -- 172.21.15.152:0/4182378578 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5304005cf0 con 0x7f531c0d0a70 2024-04-17T17:51:53.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.050+0000 7f5313400640 1 -- 172.21.15.152:0/4182378578 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53040072f0 con 0x7f531c0d0a70 2024-04-17T17:51:53.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.050+0000 7f5321400640 1 -- 172.21.15.152:0/4182378578 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f531c14d020 con 0x7f531c0d0a70 2024-04-17T17:51:53.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.054+0000 7f5321400640 1 -- 172.21.15.152:0/4182378578 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f531c14d8c0 con 0x7f531c0d0a70 2024-04-17T17:51:53.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.054+0000 7f5321400640 1 -- 172.21.15.152:0/4182378578 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f531c14d1f0 con 0x7f531c0d0a70 2024-04-17T17:51:53.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.058+0000 7f5313400640 1 -- 172.21.15.152:0/4182378578 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f530401a070 con 0x7f531c0d0a70 2024-04-17T17:51:53.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.058+0000 7f5313400640 1 --2- 172.21.15.152:0/4182378578 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f52f8068380 0x7f52f806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:53.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.058+0000 7f5313400640 1 -- 172.21.15.152:0/4182378578 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f5304085b00 con 0x7f531c0d0a70 2024-04-17T17:51:53.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.062+0000 7f531a800640 1 --2- 172.21.15.152:0/4182378578 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f52f8068380 0x7f52f806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:53.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.062+0000 7f531a800640 1 --2- 172.21.15.152:0/4182378578 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f52f8068380 0x7f52f806a840 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f530c0af000 tx=0x7f530c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:53.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.062+0000 7f5313400640 1 -- 172.21.15.152:0/4182378578 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f5304055bd0 con 0x7f531c0d0a70 2024-04-17T17:51:53.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.558+0000 7f5321400640 1 -- 172.21.15.152:0/4182378578 --> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f531c14dac0 con 0x7f52f8068380 2024-04-17T17:51:53.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.574+0000 7f5313400640 1 -- 172.21.15.152:0/4182378578 <== mgr.4104 v2:172.21.15.152:6832/3078522445 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f531c14dac0 con 0x7f52f8068380 2024-04-17T17:51:53.580 INFO:teuthology.orchestra.run.smithi152.stderr:instructed osd(s) 2 to deep-scrub 2024-04-17T17:51:53.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.578+0000 7f5321400640 1 -- 172.21.15.152:0/4182378578 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f52f8068380 msgr2=0x7f52f806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:53.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.578+0000 7f5321400640 1 --2- 172.21.15.152:0/4182378578 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f52f8068380 0x7f52f806a840 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f530c0af000 tx=0x7f530c008040 comp rx=0 tx=0).stop 2024-04-17T17:51:53.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.578+0000 7f5321400640 1 -- 172.21.15.152:0/4182378578 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f531c0d0a70 msgr2=0x7f531c1fb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:53.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.578+0000 7f5321400640 1 --2- 172.21.15.152:0/4182378578 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f531c0d0a70 0x7f531c1fb530 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7f530400c3a0 tx=0x7f530400c860 comp rx=0 tx=0).stop 2024-04-17T17:51:53.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.578+0000 7f5321400640 1 -- 172.21.15.152:0/4182378578 shutdown_connections 2024-04-17T17:51:53.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.578+0000 7f5321400640 1 --2- 172.21.15.152:0/4182378578 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f52f8068380 0x7f52f806a840 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:53.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.578+0000 7f5321400640 1 --2- 172.21.15.152:0/4182378578 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f531c161b70 0x7f531c158650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:53.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.578+0000 7f5321400640 1 --2- 172.21.15.152:0/4182378578 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f531c0d0a70 0x7f531c1fb530 unknown :-1 s=CLOSED pgs=2068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:53.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.578+0000 7f5321400640 1 --2- 172.21.15.152:0/4182378578 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f531c06e1a0 0x7f531c0b0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:53.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.578+0000 7f5321400640 1 -- 172.21.15.152:0/4182378578 >> 172.21.15.152:0/4182378578 conn(0x7f531c0b3350 msgr2=0x7f531c0aebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:53.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.582+0000 7f5321400640 1 -- 172.21.15.152:0/4182378578 shutdown_connections 2024-04-17T17:51:53.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:53.582+0000 7f5321400640 1 -- 172.21.15.152:0/4182378578 wait complete. 2024-04-17T17:51:53.633 INFO:tasks.ceph:Scrubbing osd.3 2024-04-17T17:51:53.633 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-17T17:51:54.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.042+0000 7f8831600640 1 Processor -- start 2024-04-17T17:51:54.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.042+0000 7f8831600640 1 -- start start 2024-04-17T17:51:54.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.046+0000 7f8831600640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f882c0d0970 0x7f882c072d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:54.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.046+0000 7f8831600640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f882c0d0770 con 0x7f882c15b630 2024-04-17T17:51:54.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.046+0000 7f8831600640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f882c15fb70 con 0x7f882c073250 2024-04-17T17:51:54.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.046+0000 7f8831600640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f882c0b4a00 con 0x7f882c0d0970 2024-04-17T17:51:54.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.046+0000 7f882a000640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f882c0d0970 0x7f882c072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:54.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.046+0000 7f882aa00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f882c15b630 0x7f882c0b42f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:54770/0 (socket says 172.21.15.152:54770) 2024-04-17T17:51:54.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.046+0000 7f882aa00640 1 -- 172.21.15.152:0/1309433980 learned_addr learned my addr 172.21.15.152:0/1309433980 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T17:51:54.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.046+0000 7f882a000640 1 -- 172.21.15.152:0/1309433980 >> v1:172.21.15.196:6789/0 conn(0x7f882c073250 legacy=0x7f882c06e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:54.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.046+0000 7f882a000640 1 -- 172.21.15.152:0/1309433980 >> v1:172.21.15.152:6789/0 conn(0x7f882c15b630 legacy=0x7f882c0b42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:54.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.046+0000 7f882a000640 1 -- 172.21.15.152:0/1309433980 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f882c15fe50 con 0x7f882c0d0970 2024-04-17T17:51:54.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.054+0000 7f882a000640 1 --2- 172.21.15.152:0/1309433980 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f882c0d0970 0x7f882c072d10 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7f88180097c0 tx=0x7f881801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5b8e663e55b309f server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:54.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.058+0000 7f8829600640 1 -- 172.21.15.152:0/1309433980 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88180ab430 con 0x7f882c0d0970 2024-04-17T17:51:54.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.058+0000 7f8829600640 1 -- 172.21.15.152:0/1309433980 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88180b0070 con 0x7f882c0d0970 2024-04-17T17:51:54.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.058+0000 7f8829600640 1 -- 172.21.15.152:0/1309433980 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88180ab7f0 con 0x7f882c0d0970 2024-04-17T17:51:54.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.058+0000 7f8831600640 1 -- 172.21.15.152:0/1309433980 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f882c0d0970 msgr2=0x7f882c072d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:54.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.058+0000 7f8831600640 1 --2- 172.21.15.152:0/1309433980 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f882c0d0970 0x7f882c072d10 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7f88180097c0 tx=0x7f881801c410 comp rx=0 tx=0).stop 2024-04-17T17:51:54.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.058+0000 7f8831600640 1 -- 172.21.15.152:0/1309433980 shutdown_connections 2024-04-17T17:51:54.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.058+0000 7f8831600640 1 --2- 172.21.15.152:0/1309433980 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f882c0d0970 0x7f882c072d10 unknown :-1 s=CLOSED pgs=2070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:54.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.058+0000 7f8831600640 1 -- 172.21.15.152:0/1309433980 >> 172.21.15.152:0/1309433980 conn(0x7f882c0cdd40 msgr2=0x7f882c0ce150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:54.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.058+0000 7f8831600640 1 -- 172.21.15.152:0/1309433980 shutdown_connections 2024-04-17T17:51:54.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.058+0000 7f8831600640 1 -- 172.21.15.152:0/1309433980 wait complete. 2024-04-17T17:51:54.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.062+0000 7f8831600640 1 Processor -- start 2024-04-17T17:51:54.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.062+0000 7f8831600640 1 -- start start 2024-04-17T17:51:54.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.066+0000 7f8831600640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f882c073250 0x7f882c0afcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:54.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.066+0000 7f8831600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f882c0d0970 0x7f882c14e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:54.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.066+0000 7f8831600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f882c15b630 0x7f882c0b4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:54.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.066+0000 7f8831600640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f882c06fab0 con 0x7f882c073250 2024-04-17T17:51:54.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.066+0000 7f8831600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f882c073660 con 0x7f882c0d0970 2024-04-17T17:51:54.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.066+0000 7f8831600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f882c06fc30 con 0x7f882c15b630 2024-04-17T17:51:54.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.066+0000 7f882aa00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f882c073250 0x7f882c0afcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:54.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.066+0000 7f882aa00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f882c073250 0x7f882c0afcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39870/0 (socket says 172.21.15.152:39870) 2024-04-17T17:51:54.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.066+0000 7f882aa00640 1 -- 172.21.15.152:0/1073569878 learned_addr learned my addr 172.21.15.152:0/1073569878 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T17:51:54.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.066+0000 7f882a000640 1 --2- 172.21.15.152:0/1073569878 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f882c0d0970 0x7f882c14e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:54.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.066+0000 7f882b400640 1 --2- 172.21.15.152:0/1073569878 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f882c15b630 0x7f882c0b4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:54.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.066+0000 7f882aa00640 1 -- 172.21.15.152:0/1073569878 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f882c15b630 msgr2=0x7f882c0b4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:54.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.066+0000 7f882aa00640 1 --2- 172.21.15.152:0/1073569878 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f882c15b630 0x7f882c0b4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:54.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.066+0000 7f882aa00640 1 -- 172.21.15.152:0/1073569878 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f882c0d0970 msgr2=0x7f882c14e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:54.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.066+0000 7f882aa00640 1 --2- 172.21.15.152:0/1073569878 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f882c0d0970 0x7f882c14e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:54.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.066+0000 7f882aa00640 1 -- 172.21.15.152:0/1073569878 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f882c0ae530 con 0x7f882c073250 2024-04-17T17:51:54.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.066+0000 7f882b400640 1 --2- 172.21.15.152:0/1073569878 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f882c15b630 0x7f882c0b4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T17:51:54.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.070+0000 7f882aa00640 1 --2- 172.21.15.152:0/1073569878 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f882c073250 0x7f882c0afcd0 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 crypto rx=0x7f881c00c500 tx=0x7f881c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:54.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.070+0000 7f8822a00640 1 -- 172.21.15.152:0/1073569878 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f881c017070 con 0x7f882c073250 2024-04-17T17:51:54.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.070+0000 7f8822a00640 1 -- 172.21.15.152:0/1073569878 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f881c005cf0 con 0x7f882c073250 2024-04-17T17:51:54.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.070+0000 7f8831600640 1 -- 172.21.15.152:0/1073569878 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f882c0af1f0 con 0x7f882c073250 2024-04-17T17:51:54.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.070+0000 7f8822a00640 1 -- 172.21.15.152:0/1073569878 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f881c0072f0 con 0x7f882c073250 2024-04-17T17:51:54.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.070+0000 7f8831600640 1 -- 172.21.15.152:0/1073569878 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f882c0b50c0 con 0x7f882c073250 2024-04-17T17:51:54.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.070+0000 7f8831600640 1 -- 172.21.15.152:0/1073569878 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f882c14ea30 con 0x7f882c073250 2024-04-17T17:51:54.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.074+0000 7f8822a00640 1 -- 172.21.15.152:0/1073569878 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f881c01a070 con 0x7f882c073250 2024-04-17T17:51:54.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.078+0000 7f8822a00640 1 --2- 172.21.15.152:0/1073569878 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f880c068380 0x7f880c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:54.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.078+0000 7f8822a00640 1 -- 172.21.15.152:0/1073569878 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f881c086350 con 0x7f882c073250 2024-04-17T17:51:54.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.078+0000 7f882a000640 1 --2- 172.21.15.152:0/1073569878 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f880c068380 0x7f880c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:54.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.078+0000 7f8822a00640 1 --2- 172.21.15.152:0/1073569878 >> [v2:172.21.15.152:6816/165717826,v1:172.21.15.152:6818/165717826] conn(0x7f880c06e820 0x7f880c070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:54.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.078+0000 7f8822a00640 1 -- 172.21.15.152:0/1073569878 --> [v2:172.21.15.152:6816/165717826,v1:172.21.15.152:6818/165717826] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f881c00ee50 con 0x7f880c06e820 2024-04-17T17:51:54.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.078+0000 7f8822a00640 1 -- 172.21.15.152:0/1073569878 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f881c086700 con 0x7f882c073250 2024-04-17T17:51:54.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.078+0000 7f882b400640 1 --2- 172.21.15.152:0/1073569878 >> [v2:172.21.15.152:6816/165717826,v1:172.21.15.152:6818/165717826] conn(0x7f880c06e820 0x7f880c070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:54.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.078+0000 7f882a000640 1 --2- 172.21.15.152:0/1073569878 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f880c068380 0x7f880c06a840 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f88180af000 tx=0x7f88180a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:54.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.078+0000 7f882b400640 1 --2- 172.21.15.152:0/1073569878 >> [v2:172.21.15.152:6816/165717826,v1:172.21.15.152:6818/165717826] conn(0x7f880c06e820 0x7f880c070c60 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:54.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.166+0000 7f8822a00640 1 -- 172.21.15.152:0/1073569878 <== osd.3 v2:172.21.15.152:6816/165717826 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f881c00ee50 con 0x7f880c06e820 2024-04-17T17:51:54.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.206+0000 7f8831600640 1 -- 172.21.15.152:0/1073569878 --> [v2:172.21.15.152:6816/165717826,v1:172.21.15.152:6818/165717826] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f882c068a30 con 0x7f880c06e820 2024-04-17T17:51:54.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.214+0000 7f8822a00640 1 -- 172.21.15.152:0/1073569878 <== osd.3 v2:172.21.15.152:6816/165717826 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f882c068a30 con 0x7f880c06e820 2024-04-17T17:51:54.217 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-17T17:51:54.217 INFO:teuthology.orchestra.run.smithi152.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-17T17:51:54.217 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-17T17:51:54.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.214+0000 7f8831600640 1 -- 172.21.15.152:0/1073569878 >> [v2:172.21.15.152:6816/165717826,v1:172.21.15.152:6818/165717826] conn(0x7f880c06e820 msgr2=0x7f880c070c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:54.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.214+0000 7f8831600640 1 --2- 172.21.15.152:0/1073569878 >> [v2:172.21.15.152:6816/165717826,v1:172.21.15.152:6818/165717826] conn(0x7f880c06e820 0x7f880c070c60 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:54.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.214+0000 7f8831600640 1 -- 172.21.15.152:0/1073569878 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f880c068380 msgr2=0x7f880c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:54.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.214+0000 7f8831600640 1 --2- 172.21.15.152:0/1073569878 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f880c068380 0x7f880c06a840 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f88180af000 tx=0x7f88180a7000 comp rx=0 tx=0).stop 2024-04-17T17:51:54.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.214+0000 7f8831600640 1 -- 172.21.15.152:0/1073569878 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f882c073250 msgr2=0x7f882c0afcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:54.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.214+0000 7f8831600640 1 --2- 172.21.15.152:0/1073569878 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f882c073250 0x7f882c0afcd0 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 crypto rx=0x7f881c00c500 tx=0x7f881c00c9c0 comp rx=0 tx=0).stop 2024-04-17T17:51:54.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.214+0000 7f882b400640 1 -- 172.21.15.152:0/1073569878 reap_dead start 2024-04-17T17:51:54.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.214+0000 7f8831600640 1 -- 172.21.15.152:0/1073569878 shutdown_connections 2024-04-17T17:51:54.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.214+0000 7f8831600640 1 -- 172.21.15.152:0/1073569878 >> 172.21.15.152:0/1073569878 conn(0x7f882c0cdd40 msgr2=0x7f882c0d1210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:54.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.214+0000 7f8831600640 1 -- 172.21.15.152:0/1073569878 shutdown_connections 2024-04-17T17:51:54.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.214+0000 7f8831600640 1 -- 172.21.15.152:0/1073569878 wait complete. 2024-04-17T17:51:54.264 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-17T17:51:54.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.666+0000 7f8b9bc00640 1 Processor -- start 2024-04-17T17:51:54.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.666+0000 7f8b9bc00640 1 -- start start 2024-04-17T17:51:54.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.670+0000 7f8b9bc00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f8b94145ea0 0x7f8b940d0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:54.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.670+0000 7f8b9bc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b94071790 0x7f8b94071be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:54.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.670+0000 7f8b9bc00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b940ccbb0 con 0x7f8b940d0790 2024-04-17T17:51:54.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.670+0000 7f8b9bc00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f8b94072120 con 0x7f8b94145ea0 2024-04-17T17:51:54.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.670+0000 7f8b9bc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f8b940cce90 con 0x7f8b94071790 2024-04-17T17:51:54.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.670+0000 7f8b93e00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f8b940d0790 0x7f8b940c7230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:54774/0 (socket says 172.21.15.152:54774) 2024-04-17T17:51:54.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.670+0000 7f8b93e00640 1 -- 172.21.15.152:0/3685609418 learned_addr learned my addr 172.21.15.152:0/3685609418 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T17:51:54.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.670+0000 7f8b99200640 1 --2- 172.21.15.152:0/3685609418 >> v2:172.21.15.152:3300/0 conn(0x7f8b94145ea0 0x7f8b940d0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:54.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.670+0000 7f8b99c00640 1 --2- 172.21.15.152:0/3685609418 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b94071790 0x7f8b94071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:54.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.670+0000 7f8b93400640 1 -- 172.21.15.152:0/3685609418 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1022069707 0 0) 0x7f8b940ccbb0 con 0x7f8b940d0790 2024-04-17T17:51:54.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.670+0000 7f8b93400640 1 -- 172.21.15.152:0/3685609418 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b7c003530 con 0x7f8b940d0790 2024-04-17T17:51:54.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.670+0000 7f8b99200640 1 -- 172.21.15.152:0/3685609418 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b94071790 msgr2=0x7f8b94071be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T17:51:54.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.670+0000 7f8b99200640 1 --2- 172.21.15.152:0/3685609418 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b94071790 0x7f8b94071be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:54.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.670+0000 7f8b99200640 1 -- 172.21.15.152:0/3685609418 >> v1:172.21.15.152:6789/0 conn(0x7f8b940d0790 legacy=0x7f8b940c7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:54.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.670+0000 7f8b99200640 1 -- 172.21.15.152:0/3685609418 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b940cd170 con 0x7f8b94145ea0 2024-04-17T17:51:54.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.674+0000 7f8b99200640 1 --2- 172.21.15.152:0/3685609418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b94145ea0 0x7f8b940d0250 secure :-1 s=READY pgs=2073 cs=0 l=1 rev1=1 crypto rx=0x7f8b88009d90 tx=0x7f8b8801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a43ebd8d1524a76c server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:54.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.674+0000 7f8b93400640 1 -- 172.21.15.152:0/3685609418 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b880b2070 con 0x7f8b94145ea0 2024-04-17T17:51:54.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.674+0000 7f8b93400640 1 -- 172.21.15.152:0/3685609418 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b880a5830 con 0x7f8b94145ea0 2024-04-17T17:51:54.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.674+0000 7f8b93400640 1 -- 172.21.15.152:0/3685609418 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b880a5c00 con 0x7f8b94145ea0 2024-04-17T17:51:54.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.678+0000 7f8b9bc00640 1 -- 172.21.15.152:0/3685609418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b94145ea0 msgr2=0x7f8b940d0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:54.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.678+0000 7f8b9bc00640 1 --2- 172.21.15.152:0/3685609418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b94145ea0 0x7f8b940d0250 secure :-1 s=READY pgs=2073 cs=0 l=1 rev1=1 crypto rx=0x7f8b88009d90 tx=0x7f8b8801c970 comp rx=0 tx=0).stop 2024-04-17T17:51:54.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.678+0000 7f8b9bc00640 1 -- 172.21.15.152:0/3685609418 shutdown_connections 2024-04-17T17:51:54.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.678+0000 7f8b9bc00640 1 --2- 172.21.15.152:0/3685609418 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b94071790 0x7f8b94071be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:54.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.678+0000 7f8b9bc00640 1 --2- 172.21.15.152:0/3685609418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b94145ea0 0x7f8b940d0250 unknown :-1 s=CLOSED pgs=2073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:54.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.678+0000 7f8b9bc00640 1 -- 172.21.15.152:0/3685609418 >> 172.21.15.152:0/3685609418 conn(0x7f8b940d2350 msgr2=0x7f8b940d2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:54.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.678+0000 7f8b9bc00640 1 -- 172.21.15.152:0/3685609418 shutdown_connections 2024-04-17T17:51:54.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.678+0000 7f8b9bc00640 1 -- 172.21.15.152:0/3685609418 wait complete. 2024-04-17T17:51:54.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.678+0000 7f8b9bc00640 1 Processor -- start 2024-04-17T17:51:54.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.678+0000 7f8b9bc00640 1 -- start start 2024-04-17T17:51:54.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.678+0000 7f8b9bc00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b94071790 0x7f8b9415bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:54.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.678+0000 7f8b9bc00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b940d0790 0x7f8b940c9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:54.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.678+0000 7f8b9bc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b94145ea0 0x7f8b940c9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:54.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.678+0000 7f8b9bc00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8b940c7ac0 con 0x7f8b940d0790 2024-04-17T17:51:54.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.678+0000 7f8b9bc00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8b940c7940 con 0x7f8b94071790 2024-04-17T17:51:54.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.678+0000 7f8b9bc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f8b94169490 con 0x7f8b94145ea0 2024-04-17T17:51:54.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.682+0000 7f8b93e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b940d0790 0x7f8b940c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:54.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.682+0000 7f8b93e00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b940d0790 0x7f8b940c9420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39876/0 (socket says 172.21.15.152:39876) 2024-04-17T17:51:54.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.682+0000 7f8b93e00640 1 -- 172.21.15.152:0/1563574938 learned_addr learned my addr 172.21.15.152:0/1563574938 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T17:51:54.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.682+0000 7f8b99200640 1 --2- 172.21.15.152:0/1563574938 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b94071790 0x7f8b9415bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:54.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.682+0000 7f8b99c00640 1 --2- 172.21.15.152:0/1563574938 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b94145ea0 0x7f8b940c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:54.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.682+0000 7f8b93e00640 1 -- 172.21.15.152:0/1563574938 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b94145ea0 msgr2=0x7f8b940c9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:54.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.682+0000 7f8b93e00640 1 --2- 172.21.15.152:0/1563574938 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b94145ea0 0x7f8b940c9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:54.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.682+0000 7f8b93e00640 1 -- 172.21.15.152:0/1563574938 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b94071790 msgr2=0x7f8b9415bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:54.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.682+0000 7f8b93e00640 1 --2- 172.21.15.152:0/1563574938 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b94071790 0x7f8b9415bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:54.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.682+0000 7f8b93e00640 1 -- 172.21.15.152:0/1563574938 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b940cc330 con 0x7f8b940d0790 2024-04-17T17:51:54.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.682+0000 7f8b93e00640 1 --2- 172.21.15.152:0/1563574938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b940d0790 0x7f8b940c9420 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 crypto rx=0x7f8b8000c480 tx=0x7f8b8000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:54.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.682+0000 7f8b90c00640 1 -- 172.21.15.152:0/1563574938 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b80017070 con 0x7f8b940d0790 2024-04-17T17:51:54.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.682+0000 7f8b90c00640 1 -- 172.21.15.152:0/1563574938 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b80005cf0 con 0x7f8b940d0790 2024-04-17T17:51:54.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.682+0000 7f8b9bc00640 1 -- 172.21.15.152:0/1563574938 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b940cc5d0 con 0x7f8b940d0790 2024-04-17T17:51:54.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.682+0000 7f8b90c00640 1 -- 172.21.15.152:0/1563574938 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b80007290 con 0x7f8b940d0790 2024-04-17T17:51:54.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.682+0000 7f8b9bc00640 1 -- 172.21.15.152:0/1563574938 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b94142300 con 0x7f8b940d0790 2024-04-17T17:51:54.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.686+0000 7f8b9bc00640 1 -- 172.21.15.152:0/1563574938 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b94068a30 con 0x7f8b940d0790 2024-04-17T17:51:54.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.686+0000 7f8b90c00640 1 -- 172.21.15.152:0/1563574938 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8b8001a070 con 0x7f8b940d0790 2024-04-17T17:51:54.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.686+0000 7f8b90c00640 1 --2- 172.21.15.152:0/1563574938 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8b74068380 0x7f8b7406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:54.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.686+0000 7f8b90c00640 1 -- 172.21.15.152:0/1563574938 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f8b80085f50 con 0x7f8b940d0790 2024-04-17T17:51:54.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.686+0000 7f8b99200640 1 --2- 172.21.15.152:0/1563574938 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8b74068380 0x7f8b7406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:54.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.690+0000 7f8b99200640 1 --2- 172.21.15.152:0/1563574938 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8b74068380 0x7f8b7406a840 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f8b880af000 tx=0x7f8b880a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:54.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.702+0000 7f8b90c00640 1 -- 172.21.15.152:0/1563574938 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f8b80021020 con 0x7f8b940d0790 2024-04-17T17:51:54.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.866+0000 7f8b9bc00640 1 -- 172.21.15.152:0/1563574938 --> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f8b940b2690 con 0x7f8b74068380 2024-04-17T17:51:54.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.882+0000 7f8b90c00640 1 -- 172.21.15.152:0/1563574938 <== mgr.4104 v2:172.21.15.152:6832/3078522445 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f8b940b2690 con 0x7f8b74068380 2024-04-17T17:51:54.887 INFO:teuthology.orchestra.run.smithi152.stderr:instructed osd(s) 3 to deep-scrub 2024-04-17T17:51:54.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.886+0000 7f8b9bc00640 1 -- 172.21.15.152:0/1563574938 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8b74068380 msgr2=0x7f8b7406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:54.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.886+0000 7f8b9bc00640 1 --2- 172.21.15.152:0/1563574938 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8b74068380 0x7f8b7406a840 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f8b880af000 tx=0x7f8b880a7070 comp rx=0 tx=0).stop 2024-04-17T17:51:54.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.886+0000 7f8b9bc00640 1 -- 172.21.15.152:0/1563574938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b940d0790 msgr2=0x7f8b940c9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:54.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.886+0000 7f8b9bc00640 1 --2- 172.21.15.152:0/1563574938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b940d0790 0x7f8b940c9420 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 crypto rx=0x7f8b8000c480 tx=0x7f8b8000c940 comp rx=0 tx=0).stop 2024-04-17T17:51:54.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.886+0000 7f8b9bc00640 1 -- 172.21.15.152:0/1563574938 shutdown_connections 2024-04-17T17:51:54.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.886+0000 7f8b9bc00640 1 --2- 172.21.15.152:0/1563574938 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8b74068380 0x7f8b7406a840 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:54.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.886+0000 7f8b9bc00640 1 --2- 172.21.15.152:0/1563574938 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b94145ea0 0x7f8b940c9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:54.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.886+0000 7f8b9bc00640 1 --2- 172.21.15.152:0/1563574938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b940d0790 0x7f8b940c9420 unknown :-1 s=CLOSED pgs=2074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:54.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.886+0000 7f8b9bc00640 1 --2- 172.21.15.152:0/1563574938 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b94071790 0x7f8b9415bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:54.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.886+0000 7f8b9bc00640 1 -- 172.21.15.152:0/1563574938 >> 172.21.15.152:0/1563574938 conn(0x7f8b940d2350 msgr2=0x7f8b9415f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:54.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.886+0000 7f8b9bc00640 1 -- 172.21.15.152:0/1563574938 shutdown_connections 2024-04-17T17:51:54.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:54.886+0000 7f8b9bc00640 1 -- 172.21.15.152:0/1563574938 wait complete. 2024-04-17T17:51:54.935 INFO:tasks.ceph:Scrubbing osd.4 2024-04-17T17:51:54.935 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-17T17:51:55.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.338+0000 7f2123a00640 1 Processor -- start 2024-04-17T17:51:55.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.338+0000 7f2123a00640 1 -- start start 2024-04-17T17:51:55.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.342+0000 7f2123a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f211c156b30 0x7f211c070440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:55.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.342+0000 7f2123a00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f211c0d04d0 0x7f211c070980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:55.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.342+0000 7f2123a00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f211c15d6d0 con 0x7f211c15cba0 2024-04-17T17:51:55.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.342+0000 7f2123a00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f211c0d0040 con 0x7f211c0d04d0 2024-04-17T17:51:55.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.342+0000 7f2123a00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f211c15d940 con 0x7f211c156b30 2024-04-17T17:51:55.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.342+0000 7f2121a00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f211c15cba0 0x7f211c15cfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:54782/0 (socket says 172.21.15.152:54782) 2024-04-17T17:51:55.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.342+0000 7f2121a00640 1 -- 172.21.15.152:0/3686133891 learned_addr learned my addr 172.21.15.152:0/3686133891 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T17:51:55.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.342+0000 7f2121000640 1 --2- 172.21.15.152:0/3686133891 >> v2:172.21.15.196:3300/0 conn(0x7f211c156b30 0x7f211c070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:55.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.342+0000 7f2113e00640 1 --2- 172.21.15.152:0/3686133891 >> v2:172.21.15.152:3300/0 conn(0x7f211c0d04d0 0x7f211c070980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:55.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.346+0000 7f2121000640 1 -- 172.21.15.152:0/3686133891 >> v2:172.21.15.152:3300/0 conn(0x7f211c0d04d0 msgr2=0x7f211c070980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T17:51:55.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.346+0000 7f2121000640 1 --2- 172.21.15.152:0/3686133891 >> v2:172.21.15.152:3300/0 conn(0x7f211c0d04d0 0x7f211c070980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:55.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.346+0000 7f2121000640 1 -- 172.21.15.152:0/3686133891 >> v1:172.21.15.152:6789/0 conn(0x7f211c15cba0 legacy=0x7f211c15cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:55.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.346+0000 7f211be00640 1 -- 172.21.15.152:0/3686133891 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 780951285 0 0) 0x7f211c15d6d0 con 0x7f211c15cba0 2024-04-17T17:51:55.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.346+0000 7f2121000640 1 -- 172.21.15.152:0/3686133891 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f211c0cf9f0 con 0x7f211c156b30 2024-04-17T17:51:55.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.354+0000 7f2121000640 1 --2- 172.21.15.152:0/3686133891 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f211c156b30 0x7f211c070440 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f211c068120 tx=0x7f210c01c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba78058fd18d1816 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:55.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.354+0000 7f211be00640 1 -- 172.21.15.152:0/3686133891 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f210c0b2070 con 0x7f211c156b30 2024-04-17T17:51:55.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.354+0000 7f211be00640 1 -- 172.21.15.152:0/3686133891 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f210c0a57e0 con 0x7f211c156b30 2024-04-17T17:51:55.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.354+0000 7f211be00640 1 -- 172.21.15.152:0/3686133891 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f210c0a5bb0 con 0x7f211c156b30 2024-04-17T17:51:55.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.354+0000 7f2123a00640 1 -- 172.21.15.152:0/3686133891 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f211c156b30 msgr2=0x7f211c070440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:55.359 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.354+0000 7f2123a00640 1 --2- 172.21.15.152:0/3686133891 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f211c156b30 0x7f211c070440 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f211c068120 tx=0x7f210c01c8a0 comp rx=0 tx=0).stop 2024-04-17T17:51:55.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.358+0000 7f2123a00640 1 -- 172.21.15.152:0/3686133891 shutdown_connections 2024-04-17T17:51:55.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.358+0000 7f2123a00640 1 --2- 172.21.15.152:0/3686133891 >> v2:172.21.15.152:3300/0 conn(0x7f211c0d04d0 0x7f211c070980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:55.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.358+0000 7f2123a00640 1 --2- 172.21.15.152:0/3686133891 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f211c156b30 0x7f211c070440 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:55.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.358+0000 7f2123a00640 1 -- 172.21.15.152:0/3686133891 >> 172.21.15.152:0/3686133891 conn(0x7f211c0724b0 msgr2=0x7f211c0728c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:55.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.358+0000 7f2123a00640 1 -- 172.21.15.152:0/3686133891 shutdown_connections 2024-04-17T17:51:55.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.358+0000 7f2123a00640 1 -- 172.21.15.152:0/3686133891 wait complete. 2024-04-17T17:51:55.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.362+0000 7f2123a00640 1 Processor -- start 2024-04-17T17:51:55.365 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.362+0000 7f2123a00640 1 -- start start 2024-04-17T17:51:55.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.362+0000 7f2123a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f211c0d04d0 0x7f211c158c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:55.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.362+0000 7f2123a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f211c156b30 0x7f211c15f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:55.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.362+0000 7f2123a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f211c15cba0 0x7f211c15f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:55.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.362+0000 7f2123a00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f211c0b4400 con 0x7f211c15cba0 2024-04-17T17:51:55.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.362+0000 7f2123a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f211c0b4280 con 0x7f211c0d04d0 2024-04-17T17:51:55.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.362+0000 7f2123a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f211c0b4580 con 0x7f211c156b30 2024-04-17T17:51:55.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.366+0000 7f2121a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f211c15cba0 0x7f211c15f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:55.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.366+0000 7f2121000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f211c0d04d0 0x7f211c158c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:55.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.366+0000 7f2121000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f211c0d04d0 0x7f211c158c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.152:46812/0 (socket says 172.21.15.152:46812) 2024-04-17T17:51:55.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.366+0000 7f2121000640 1 -- 172.21.15.152:0/2209774977 learned_addr learned my addr 172.21.15.152:0/2209774977 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T17:51:55.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.366+0000 7f2113e00640 1 --2- 172.21.15.152:0/2209774977 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f211c156b30 0x7f211c15f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:55.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.366+0000 7f2121a00640 1 -- 172.21.15.152:0/2209774977 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f211c156b30 msgr2=0x7f211c15f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:55.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.366+0000 7f2121a00640 1 --2- 172.21.15.152:0/2209774977 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f211c156b30 0x7f211c15f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:55.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.366+0000 7f2121a00640 1 -- 172.21.15.152:0/2209774977 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f211c0d04d0 msgr2=0x7f211c158c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:55.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.366+0000 7f2121a00640 1 --2- 172.21.15.152:0/2209774977 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f211c0d04d0 0x7f211c158c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:55.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.366+0000 7f2121a00640 1 -- 172.21.15.152:0/2209774977 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f211c159140 con 0x7f211c15cba0 2024-04-17T17:51:55.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.366+0000 7f2121a00640 1 --2- 172.21.15.152:0/2209774977 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f211c15cba0 0x7f211c15f610 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 crypto rx=0x7f211400c3e0 tx=0x7f211400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:55.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.366+0000 7f2119600640 1 -- 172.21.15.152:0/2209774977 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21140074e0 con 0x7f211c15cba0 2024-04-17T17:51:55.371 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.366+0000 7f2119600640 1 -- 172.21.15.152:0/2209774977 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21140047f0 con 0x7f211c15cba0 2024-04-17T17:51:55.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.366+0000 7f2119600640 1 -- 172.21.15.152:0/2209774977 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2114007680 con 0x7f211c15cba0 2024-04-17T17:51:55.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.366+0000 7f2123a00640 1 -- 172.21.15.152:0/2209774977 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f211c1593e0 con 0x7f211c15cba0 2024-04-17T17:51:55.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.366+0000 7f2123a00640 1 -- 172.21.15.152:0/2209774977 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f211c1599a0 con 0x7f211c15cba0 2024-04-17T17:51:55.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.370+0000 7f2123a00640 1 -- 172.21.15.152:0/2209774977 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f211c069140 con 0x7f211c15cba0 2024-04-17T17:51:55.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.370+0000 7f2119600640 1 -- 172.21.15.152:0/2209774977 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2114011070 con 0x7f211c15cba0 2024-04-17T17:51:55.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.374+0000 7f2119600640 1 --2- 172.21.15.152:0/2209774977 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f20f80683b0 0x7f20f806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:55.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.374+0000 7f2119600640 1 -- 172.21.15.152:0/2209774977 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f2114086ae0 con 0x7f211c15cba0 2024-04-17T17:51:55.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.374+0000 7f2121000640 1 --2- 172.21.15.152:0/2209774977 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f20f80683b0 0x7f20f806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:55.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.374+0000 7f2119600640 1 --2- 172.21.15.152:0/2209774977 >> [v2:172.21.15.196:6816/4080159297,v1:172.21.15.196:6817/4080159297] conn(0x7f20f806e850 0x7f20f8070c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:55.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.374+0000 7f2119600640 1 -- 172.21.15.152:0/2209774977 --> [v2:172.21.15.196:6816/4080159297,v1:172.21.15.196:6817/4080159297] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f20f8071360 con 0x7f20f806e850 2024-04-17T17:51:55.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.374+0000 7f2119600640 1 -- 172.21.15.152:0/2209774977 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f2114086f70 con 0x7f211c15cba0 2024-04-17T17:51:55.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.374+0000 7f2121000640 1 --2- 172.21.15.152:0/2209774977 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f20f80683b0 0x7f20f806a870 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f210c01c8e0 tx=0x7f210c0a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:55.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.374+0000 7f2113e00640 1 --2- 172.21.15.152:0/2209774977 >> [v2:172.21.15.196:6816/4080159297,v1:172.21.15.196:6817/4080159297] conn(0x7f20f806e850 0x7f20f8070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:55.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.374+0000 7f2113e00640 1 --2- 172.21.15.152:0/2209774977 >> [v2:172.21.15.196:6816/4080159297,v1:172.21.15.196:6817/4080159297] conn(0x7f20f806e850 0x7f20f8070c90 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:55.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.538+0000 7f2119600640 1 -- 172.21.15.152:0/2209774977 <== osd.4 v2:172.21.15.196:6816/4080159297 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f20f8071360 con 0x7f20f806e850 2024-04-17T17:51:55.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.554+0000 7f2123a00640 1 -- 172.21.15.152:0/2209774977 --> [v2:172.21.15.196:6816/4080159297,v1:172.21.15.196:6817/4080159297] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f211c073640 con 0x7f20f806e850 2024-04-17T17:51:55.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.586+0000 7f2119600640 1 -- 172.21.15.152:0/2209774977 <== osd.4 v2:172.21.15.196:6816/4080159297 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f211c073640 con 0x7f20f806e850 2024-04-17T17:51:55.590 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-17T17:51:55.591 INFO:teuthology.orchestra.run.smithi152.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-17T17:51:55.591 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-17T17:51:55.592 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.586+0000 7f2123a00640 1 -- 172.21.15.152:0/2209774977 >> [v2:172.21.15.196:6816/4080159297,v1:172.21.15.196:6817/4080159297] conn(0x7f20f806e850 msgr2=0x7f20f8070c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:55.592 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.586+0000 7f2123a00640 1 --2- 172.21.15.152:0/2209774977 >> [v2:172.21.15.196:6816/4080159297,v1:172.21.15.196:6817/4080159297] conn(0x7f20f806e850 0x7f20f8070c90 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:55.592 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.586+0000 7f2123a00640 1 -- 172.21.15.152:0/2209774977 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f20f80683b0 msgr2=0x7f20f806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:55.592 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.586+0000 7f2123a00640 1 --2- 172.21.15.152:0/2209774977 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f20f80683b0 0x7f20f806a870 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f210c01c8e0 tx=0x7f210c0a7070 comp rx=0 tx=0).stop 2024-04-17T17:51:55.592 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.586+0000 7f2123a00640 1 -- 172.21.15.152:0/2209774977 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f211c15cba0 msgr2=0x7f211c15f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:55.592 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.586+0000 7f2123a00640 1 --2- 172.21.15.152:0/2209774977 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f211c15cba0 0x7f211c15f610 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 crypto rx=0x7f211400c3e0 tx=0x7f211400c8a0 comp rx=0 tx=0).stop 2024-04-17T17:51:55.592 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.586+0000 7f2121a00640 1 -- 172.21.15.152:0/2209774977 reap_dead start 2024-04-17T17:51:55.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.586+0000 7f2123a00640 1 -- 172.21.15.152:0/2209774977 shutdown_connections 2024-04-17T17:51:55.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.586+0000 7f2123a00640 1 -- 172.21.15.152:0/2209774977 >> 172.21.15.152:0/2209774977 conn(0x7f211c0724b0 msgr2=0x7f211c15bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:55.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.590+0000 7f2123a00640 1 -- 172.21.15.152:0/2209774977 shutdown_connections 2024-04-17T17:51:55.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:55.590+0000 7f2123a00640 1 -- 172.21.15.152:0/2209774977 wait complete. 2024-04-17T17:51:55.621 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-17T17:51:56.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.022+0000 7f48f8a00640 1 Processor -- start 2024-04-17T17:51:56.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.022+0000 7f48f8a00640 1 -- start start 2024-04-17T17:51:56.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.026+0000 7f48f8a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f48f40b3a70 0x7f48f40ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:56.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.026+0000 7f48f8a00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48f40cd240 con 0x7f48f406c0c0 2024-04-17T17:51:56.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.026+0000 7f48f8a00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48f40d0200 con 0x7f48f415e810 2024-04-17T17:51:56.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.026+0000 7f48f8a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f48f415ebf0 con 0x7f48f40b3a70 2024-04-17T17:51:56.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.026+0000 7f48e9400640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f48f406c0c0 0x7f48f40b4080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:54794/0 (socket says 172.21.15.152:54794) 2024-04-17T17:51:56.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.026+0000 7f48e9400640 1 -- 172.21.15.152:0/2450555983 learned_addr learned my addr 172.21.15.152:0/2450555983 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T17:51:56.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.026+0000 7f48f2800640 1 --2- 172.21.15.152:0/2450555983 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f48f40b3a70 0x7f48f40ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:56.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.026+0000 7f48f1400640 1 -- 172.21.15.152:0/2450555983 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 261029441 0 0) 0x7f48f40cd240 con 0x7f48f406c0c0 2024-04-17T17:51:56.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.026+0000 7f48f1400640 1 -- 172.21.15.152:0/2450555983 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48d8003530 con 0x7f48f406c0c0 2024-04-17T17:51:56.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.026+0000 7f48f1400640 1 -- 172.21.15.152:0/2450555983 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 172950112 0 0) 0x7f48d8003530 con 0x7f48f406c0c0 2024-04-17T17:51:56.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.026+0000 7f48f1400640 1 -- 172.21.15.152:0/2450555983 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f48f40b3a70 msgr2=0x7f48f40ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T17:51:56.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.026+0000 7f48f1400640 1 --2- 172.21.15.152:0/2450555983 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f48f40b3a70 0x7f48f40ccc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:56.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.026+0000 7f48f1400640 1 -- 172.21.15.152:0/2450555983 >> v1:172.21.15.196:6789/0 conn(0x7f48f415e810 legacy=0x7f48f406b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:56.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.026+0000 7f48f1400640 1 -- 172.21.15.152:0/2450555983 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48f40cf440 con 0x7f48f406c0c0 2024-04-17T17:51:56.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.026+0000 7f48f1400640 1 -- 172.21.15.152:0/2450555983 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2973887244 0 0) 0x7f48dc001a00 con 0x7f48f406c0c0 2024-04-17T17:51:56.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.026+0000 7f48f1400640 1 -- 172.21.15.152:0/2450555983 >> v1:172.21.15.152:6789/0 conn(0x7f48f406c0c0 legacy=0x7f48f40b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:56.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.026+0000 7f48f1400640 1 --2- 172.21.15.152:0/2450555983 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f48d80039f0 0x7f48d8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:56.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.026+0000 7f48f1400640 1 --2- 172.21.15.152:0/2450555983 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48d80043a0 0x7f48d8004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:56.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.026+0000 7f48f1400640 1 --2- 172.21.15.152:0/2450555983 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f48f40b3a70 0x7f48d80050d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:56.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.026+0000 7f48f1400640 1 -- 172.21.15.152:0/2450555983 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f48f415ebf0 con 0x7f48d80043a0 2024-04-17T17:51:56.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.026+0000 7f48f1400640 1 -- 172.21.15.152:0/2450555983 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f48d800b9d0 con 0x7f48d80039f0 2024-04-17T17:51:56.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.026+0000 7f48f1400640 1 -- 172.21.15.152:0/2450555983 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f48d800bbd0 con 0x7f48f40b3a70 2024-04-17T17:51:56.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.030+0000 7f48e9400640 1 --2- 172.21.15.152:0/2450555983 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48d80043a0 0x7f48d8004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:56.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.030+0000 7f48e9400640 1 -- 172.21.15.152:0/2450555983 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f48f40b3a70 msgr2=0x7f48d80050d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T17:51:56.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.030+0000 7f48e9400640 1 --2- 172.21.15.152:0/2450555983 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f48f40b3a70 0x7f48d80050d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:56.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.030+0000 7f48e9400640 1 -- 172.21.15.152:0/2450555983 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f48d80039f0 msgr2=0x7f48d8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T17:51:56.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.030+0000 7f48f1e00640 1 --2- 172.21.15.152:0/2450555983 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f48d80039f0 0x7f48d8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:56.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.030+0000 7f48e9400640 1 --2- 172.21.15.152:0/2450555983 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f48d80039f0 0x7f48d8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:56.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.030+0000 7f48e9400640 1 -- 172.21.15.152:0/2450555983 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d8003530 con 0x7f48d80043a0 2024-04-17T17:51:56.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.030+0000 7f48f1e00640 1 --2- 172.21.15.152:0/2450555983 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f48d80039f0 0x7f48d8003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T17:51:56.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.034+0000 7f48e9400640 1 --2- 172.21.15.152:0/2450555983 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48d80043a0 0x7f48d8004870 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 crypto rx=0x7f48dc00a800 tx=0x7f48dc01d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ffb44df92e25446 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:56.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.034+0000 7f48f1400640 1 -- 172.21.15.152:0/2450555983 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48dc00a450 con 0x7f48d80043a0 2024-04-17T17:51:56.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.034+0000 7f48f1400640 1 -- 172.21.15.152:0/2450555983 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48dc0ad650 con 0x7f48d80043a0 2024-04-17T17:51:56.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.034+0000 7f48f1400640 1 -- 172.21.15.152:0/2450555983 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48dc0ada40 con 0x7f48d80043a0 2024-04-17T17:51:56.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.034+0000 7f48f8a00640 1 -- 172.21.15.152:0/2450555983 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48d80043a0 msgr2=0x7f48d8004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:56.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.034+0000 7f48f8a00640 1 --2- 172.21.15.152:0/2450555983 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48d80043a0 0x7f48d8004870 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 crypto rx=0x7f48dc00a800 tx=0x7f48dc01d300 comp rx=0 tx=0).stop 2024-04-17T17:51:56.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.034+0000 7f48f2800640 1 -- 172.21.15.152:0/2450555983 reap_dead start 2024-04-17T17:51:56.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.034+0000 7f48f8a00640 1 -- 172.21.15.152:0/2450555983 shutdown_connections 2024-04-17T17:51:56.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.034+0000 7f48f8a00640 1 -- 172.21.15.152:0/2450555983 >> 172.21.15.152:0/2450555983 conn(0x7f48f40cd4c0 msgr2=0x7f48f40cd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:56.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.034+0000 7f48f8a00640 1 -- 172.21.15.152:0/2450555983 shutdown_connections 2024-04-17T17:51:56.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.034+0000 7f48f8a00640 1 -- 172.21.15.152:0/2450555983 wait complete. 2024-04-17T17:51:56.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.038+0000 7f48f8a00640 1 Processor -- start 2024-04-17T17:51:56.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.038+0000 7f48f8a00640 1 -- start start 2024-04-17T17:51:56.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.042+0000 7f48f8a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f48d80043a0 0x7f48f40af140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:56.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.042+0000 7f48f8a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f48f4159390 0x7f48f414f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:56.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.042+0000 7f48f8a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48f40ad870 0x7f48f4160c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:56.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.042+0000 7f48f8a00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f48f4070d90 con 0x7f48f40ad870 2024-04-17T17:51:56.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.042+0000 7f48f8a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f48f40cfa00 con 0x7f48f4159390 2024-04-17T17:51:56.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.042+0000 7f48f8a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f48f40ccc60 con 0x7f48d80043a0 2024-04-17T17:51:56.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.042+0000 7f48f2800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48f40ad870 0x7f48f4160c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:56.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.042+0000 7f48e9400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f48f4159390 0x7f48f414f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:56.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.042+0000 7f48f1e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f48d80043a0 0x7f48f40af140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:56.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.042+0000 7f48e9400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f48f4159390 0x7f48f414f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.152:46826/0 (socket says 172.21.15.152:46826) 2024-04-17T17:51:56.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.042+0000 7f48e9400640 1 -- 172.21.15.152:0/260357153 learned_addr learned my addr 172.21.15.152:0/260357153 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T17:51:56.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.042+0000 7f48e9400640 1 -- 172.21.15.152:0/260357153 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f48d80043a0 msgr2=0x7f48f40af140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:56.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.042+0000 7f48e9400640 1 --2- 172.21.15.152:0/260357153 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f48d80043a0 0x7f48f40af140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:56.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.042+0000 7f48e9400640 1 -- 172.21.15.152:0/260357153 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48f40ad870 msgr2=0x7f48f4160c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:56.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.042+0000 7f48e9400640 1 --2- 172.21.15.152:0/260357153 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48f40ad870 0x7f48f4160c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:56.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.042+0000 7f48e9400640 1 -- 172.21.15.152:0/260357153 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48f414f8f0 con 0x7f48f4159390 2024-04-17T17:51:56.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.046+0000 7f48e9400640 1 --2- 172.21.15.152:0/260357153 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f48f4159390 0x7f48f414f3b0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f48dc001c80 tx=0x7f48d8005840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:56.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.046+0000 7f48eaa00640 1 -- 172.21.15.152:0/260357153 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48dc0bc070 con 0x7f48f4159390 2024-04-17T17:51:56.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.046+0000 7f48eaa00640 1 -- 172.21.15.152:0/260357153 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48dc001960 con 0x7f48f4159390 2024-04-17T17:51:56.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.046+0000 7f48eaa00640 1 -- 172.21.15.152:0/260357153 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48dc0b2040 con 0x7f48f4159390 2024-04-17T17:51:56.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.046+0000 7f48f8a00640 1 -- 172.21.15.152:0/260357153 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48f40ae0a0 con 0x7f48f4159390 2024-04-17T17:51:56.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.046+0000 7f48f8a00640 1 -- 172.21.15.152:0/260357153 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48f40ae660 con 0x7f48f4159390 2024-04-17T17:51:56.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.046+0000 7f48f8a00640 1 -- 172.21.15.152:0/260357153 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48f4069140 con 0x7f48f4159390 2024-04-17T17:51:56.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.050+0000 7f48eaa00640 1 -- 172.21.15.152:0/260357153 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f48dc0bf070 con 0x7f48f4159390 2024-04-17T17:51:56.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.050+0000 7f48eaa00640 1 --2- 172.21.15.152:0/260357153 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f48d00683b0 0x7f48d006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:56.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.050+0000 7f48eaa00640 1 -- 172.21.15.152:0/260357153 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f48dc1209c0 con 0x7f48f4159390 2024-04-17T17:51:56.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.050+0000 7f48f1e00640 1 --2- 172.21.15.152:0/260357153 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f48d00683b0 0x7f48d006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:56.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.050+0000 7f48f1e00640 1 --2- 172.21.15.152:0/260357153 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f48d00683b0 0x7f48d006a870 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f48e400bc90 tx=0x7f48e400b4a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:56.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.054+0000 7f48eaa00640 1 -- 172.21.15.152:0/260357153 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f48dc017010 con 0x7f48f4159390 2024-04-17T17:51:56.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.550+0000 7f48f8a00640 1 -- 172.21.15.152:0/260357153 --> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f48f415cff0 con 0x7f48d00683b0 2024-04-17T17:51:56.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.570+0000 7f48eaa00640 1 -- 172.21.15.152:0/260357153 <== mgr.4104 v2:172.21.15.152:6832/3078522445 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f48f415cff0 con 0x7f48d00683b0 2024-04-17T17:51:56.574 INFO:teuthology.orchestra.run.smithi152.stderr:instructed osd(s) 4 to deep-scrub 2024-04-17T17:51:56.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.574+0000 7f48f8a00640 1 -- 172.21.15.152:0/260357153 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f48d00683b0 msgr2=0x7f48d006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:56.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.574+0000 7f48f8a00640 1 --2- 172.21.15.152:0/260357153 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f48d00683b0 0x7f48d006a870 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f48e400bc90 tx=0x7f48e400b4a0 comp rx=0 tx=0).stop 2024-04-17T17:51:56.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.574+0000 7f48f8a00640 1 -- 172.21.15.152:0/260357153 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f48f4159390 msgr2=0x7f48f414f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:56.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.574+0000 7f48f8a00640 1 --2- 172.21.15.152:0/260357153 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f48f4159390 0x7f48f414f3b0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f48dc001c80 tx=0x7f48d8005840 comp rx=0 tx=0).stop 2024-04-17T17:51:56.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.574+0000 7f48f8a00640 1 -- 172.21.15.152:0/260357153 shutdown_connections 2024-04-17T17:51:56.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.574+0000 7f48f8a00640 1 --2- 172.21.15.152:0/260357153 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48f40ad870 0x7f48f4160c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:56.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.574+0000 7f48f8a00640 1 --2- 172.21.15.152:0/260357153 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f48f4159390 0x7f48f414f3b0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:56.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.574+0000 7f48f8a00640 1 --2- 172.21.15.152:0/260357153 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f48d00683b0 0x7f48d006a870 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:56.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.574+0000 7f48f8a00640 1 --2- 172.21.15.152:0/260357153 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f48d80043a0 0x7f48f40af140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:56.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.574+0000 7f48f8a00640 1 -- 172.21.15.152:0/260357153 >> 172.21.15.152:0/260357153 conn(0x7f48f40cd4c0 msgr2=0x7f48f406ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:56.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.574+0000 7f48f8a00640 1 -- 172.21.15.152:0/260357153 shutdown_connections 2024-04-17T17:51:56.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:56.574+0000 7f48f8a00640 1 -- 172.21.15.152:0/260357153 wait complete. 2024-04-17T17:51:56.628 INFO:tasks.ceph:Scrubbing osd.5 2024-04-17T17:51:56.628 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-17T17:51:57.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.030+0000 7f3c51600640 1 Processor -- start 2024-04-17T17:51:57.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.030+0000 7f3c51600640 1 -- start start 2024-04-17T17:51:57.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.030+0000 7f3c51600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c4c161d60 0x7f3c4c162be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:57.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.030+0000 7f3c51600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f3c4c06f6a0 0x7f3c4c071c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:57.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.030+0000 7f3c51600640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c4c15ef10 con 0x7f3c4c072140 2024-04-17T17:51:57.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.030+0000 7f3c51600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f3c4c15f840 con 0x7f3c4c06f6a0 2024-04-17T17:51:57.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.030+0000 7f3c51600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f3c4c15f1f0 con 0x7f3c4c161d60 2024-04-17T17:51:57.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.030+0000 7f3c4b400640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f3c4c072140 0x7f3c4c154d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:54802/0 (socket says 172.21.15.152:54802) 2024-04-17T17:51:57.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.030+0000 7f3c4b400640 1 -- 172.21.15.152:0/1232831229 learned_addr learned my addr 172.21.15.152:0/1232831229 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T17:51:57.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.030+0000 7f3c42000640 1 --2- 172.21.15.152:0/1232831229 >> v2:172.21.15.196:3300/0 conn(0x7f3c4c06f6a0 0x7f3c4c071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:57.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.030+0000 7f3c4aa00640 1 --2- 172.21.15.152:0/1232831229 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c4c161d60 0x7f3c4c162be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:57.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.030+0000 7f3c4aa00640 1 -- 172.21.15.152:0/1232831229 >> v2:172.21.15.196:3300/0 conn(0x7f3c4c06f6a0 msgr2=0x7f3c4c071c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T17:51:57.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.030+0000 7f3c4aa00640 1 --2- 172.21.15.152:0/1232831229 >> v2:172.21.15.196:3300/0 conn(0x7f3c4c06f6a0 0x7f3c4c071c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:57.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.030+0000 7f3c4aa00640 1 -- 172.21.15.152:0/1232831229 >> v1:172.21.15.152:6789/0 conn(0x7f3c4c072140 legacy=0x7f3c4c154d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:57.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.030+0000 7f3c4a000640 1 -- 172.21.15.152:0/1232831229 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 584337544 0 0) 0x7f3c4c15ef10 con 0x7f3c4c072140 2024-04-17T17:51:57.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.030+0000 7f3c4aa00640 1 -- 172.21.15.152:0/1232831229 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c4c15f4d0 con 0x7f3c4c161d60 2024-04-17T17:51:57.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.030+0000 7f3c42000640 1 --2- 172.21.15.152:0/1232831229 >> v2:172.21.15.196:3300/0 conn(0x7f3c4c06f6a0 0x7f3c4c071c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T17:51:57.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.042+0000 7f3c4aa00640 1 --2- 172.21.15.152:0/1232831229 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c4c161d60 0x7f3c4c162be0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c0097c0 tx=0x7f3c3c01c3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ab88d8489c60fa3 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:57.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.042+0000 7f3c4a000640 1 -- 172.21.15.152:0/1232831229 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c0b0070 con 0x7f3c4c161d60 2024-04-17T17:51:57.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.042+0000 7f3c4a000640 1 -- 172.21.15.152:0/1232831229 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c3c0ab600 con 0x7f3c4c161d60 2024-04-17T17:51:57.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.042+0000 7f3c4a000640 1 -- 172.21.15.152:0/1232831229 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c0ab9d0 con 0x7f3c4c161d60 2024-04-17T17:51:57.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.042+0000 7f3c51600640 1 -- 172.21.15.152:0/1232831229 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c4c161d60 msgr2=0x7f3c4c162be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:57.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.042+0000 7f3c51600640 1 --2- 172.21.15.152:0/1232831229 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c4c161d60 0x7f3c4c162be0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c0097c0 tx=0x7f3c3c01c3d0 comp rx=0 tx=0).stop 2024-04-17T17:51:57.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.042+0000 7f3c51600640 1 -- 172.21.15.152:0/1232831229 shutdown_connections 2024-04-17T17:51:57.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.042+0000 7f3c51600640 1 --2- 172.21.15.152:0/1232831229 >> v2:172.21.15.196:3300/0 conn(0x7f3c4c06f6a0 0x7f3c4c071c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:57.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.042+0000 7f3c51600640 1 --2- 172.21.15.152:0/1232831229 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c4c161d60 0x7f3c4c162be0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:57.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.042+0000 7f3c51600640 1 -- 172.21.15.152:0/1232831229 >> 172.21.15.152:0/1232831229 conn(0x7f3c4c0b3220 msgr2=0x7f3c4c0b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:57.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.042+0000 7f3c51600640 1 -- 172.21.15.152:0/1232831229 shutdown_connections 2024-04-17T17:51:57.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.042+0000 7f3c51600640 1 -- 172.21.15.152:0/1232831229 wait complete. 2024-04-17T17:51:57.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.046+0000 7f3c51600640 1 Processor -- start 2024-04-17T17:51:57.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.046+0000 7f3c51600640 1 -- start start 2024-04-17T17:51:57.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.050+0000 7f3c51600640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c4c06f6a0 0x7f3c4c156340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:57.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.050+0000 7f3c51600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c4c072140 0x7f3c4c14f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:57.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.050+0000 7f3c51600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c4c161d60 0x7f3c4c152520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:57.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.050+0000 7f3c51600640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3c4c06bb30 con 0x7f3c4c06f6a0 2024-04-17T17:51:57.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.050+0000 7f3c51600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f3c4c06b9b0 con 0x7f3c4c161d60 2024-04-17T17:51:57.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.050+0000 7f3c51600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f3c4c06bcb0 con 0x7f3c4c072140 2024-04-17T17:51:57.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.050+0000 7f3c4aa00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c4c06f6a0 0x7f3c4c156340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:57.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.050+0000 7f3c4aa00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c4c06f6a0 0x7f3c4c156340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39906/0 (socket says 172.21.15.152:39906) 2024-04-17T17:51:57.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.050+0000 7f3c4aa00640 1 -- 172.21.15.152:0/954750992 learned_addr learned my addr 172.21.15.152:0/954750992 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T17:51:57.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.050+0000 7f3c42000640 1 --2- 172.21.15.152:0/954750992 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c4c072140 0x7f3c4c14f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:57.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.050+0000 7f3c4b400640 1 --2- 172.21.15.152:0/954750992 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c4c161d60 0x7f3c4c152520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:57.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.050+0000 7f3c4aa00640 1 -- 172.21.15.152:0/954750992 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c4c072140 msgr2=0x7f3c4c14f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:57.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.050+0000 7f3c4aa00640 1 --2- 172.21.15.152:0/954750992 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c4c072140 0x7f3c4c14f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:57.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.050+0000 7f3c4aa00640 1 -- 172.21.15.152:0/954750992 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c4c161d60 msgr2=0x7f3c4c152520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:57.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.050+0000 7f3c4aa00640 1 --2- 172.21.15.152:0/954750992 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c4c161d60 0x7f3c4c152520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:57.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.050+0000 7f3c4aa00640 1 -- 172.21.15.152:0/954750992 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c4c14fa40 con 0x7f3c4c06f6a0 2024-04-17T17:51:57.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.050+0000 7f3c4b400640 1 --2- 172.21.15.152:0/954750992 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c4c161d60 0x7f3c4c152520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T17:51:57.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.054+0000 7f3c4aa00640 1 --2- 172.21.15.152:0/954750992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c4c06f6a0 0x7f3c4c156340 secure :-1 s=READY pgs=2080 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c0ae040 tx=0x7f3c3c01ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:57.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.054+0000 7f3c43400640 1 -- 172.21.15.152:0/954750992 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c0bb070 con 0x7f3c4c06f6a0 2024-04-17T17:51:57.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.054+0000 7f3c43400640 1 -- 172.21.15.152:0/954750992 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c3c004020 con 0x7f3c4c06f6a0 2024-04-17T17:51:57.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.054+0000 7f3c51600640 1 -- 172.21.15.152:0/954750992 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c4c0affe0 con 0x7f3c4c06f6a0 2024-04-17T17:51:57.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.054+0000 7f3c43400640 1 -- 172.21.15.152:0/954750992 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c0b0040 con 0x7f3c4c06f6a0 2024-04-17T17:51:57.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.054+0000 7f3c51600640 1 -- 172.21.15.152:0/954750992 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c4c0b05a0 con 0x7f3c4c06f6a0 2024-04-17T17:51:57.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.054+0000 7f3c51600640 1 -- 172.21.15.152:0/954750992 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3c4c068a30 con 0x7f3c4c06f6a0 2024-04-17T17:51:57.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.058+0000 7f3c43400640 1 -- 172.21.15.152:0/954750992 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3c3c003620 con 0x7f3c4c06f6a0 2024-04-17T17:51:57.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.058+0000 7f3c43400640 1 --2- 172.21.15.152:0/954750992 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3c280683b0 0x7f3c2806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:57.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.062+0000 7f3c43400640 1 -- 172.21.15.152:0/954750992 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f3c3c121770 con 0x7f3c4c06f6a0 2024-04-17T17:51:57.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.062+0000 7f3c42000640 1 --2- 172.21.15.152:0/954750992 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3c280683b0 0x7f3c2806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:57.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.062+0000 7f3c43400640 1 --2- 172.21.15.152:0/954750992 >> [v2:172.21.15.196:6800/3519444232,v1:172.21.15.196:6801/3519444232] conn(0x7f3c2806e850 0x7f3c28070c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:57.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.062+0000 7f3c43400640 1 -- 172.21.15.152:0/954750992 --> [v2:172.21.15.196:6800/3519444232,v1:172.21.15.196:6801/3519444232] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3c3c0ab600 con 0x7f3c2806e850 2024-04-17T17:51:57.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.062+0000 7f3c43400640 1 -- 172.21.15.152:0/954750992 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f3c3c121b20 con 0x7f3c4c06f6a0 2024-04-17T17:51:57.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.062+0000 7f3c4b400640 1 --2- 172.21.15.152:0/954750992 >> [v2:172.21.15.196:6800/3519444232,v1:172.21.15.196:6801/3519444232] conn(0x7f3c2806e850 0x7f3c28070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:57.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.062+0000 7f3c42000640 1 --2- 172.21.15.152:0/954750992 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3c280683b0 0x7f3c2806a870 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f3c34009580 tx=0x7f3c34009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:57.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.062+0000 7f3c4b400640 1 --2- 172.21.15.152:0/954750992 >> [v2:172.21.15.196:6800/3519444232,v1:172.21.15.196:6801/3519444232] conn(0x7f3c2806e850 0x7f3c28070c90 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:57.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.134+0000 7f3c43400640 1 -- 172.21.15.152:0/954750992 <== osd.5 v2:172.21.15.196:6800/3519444232 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3c3c0ab600 con 0x7f3c2806e850 2024-04-17T17:51:57.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.170+0000 7f3c51600640 1 -- 172.21.15.152:0/954750992 --> [v2:172.21.15.196:6800/3519444232,v1:172.21.15.196:6801/3519444232] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3c4c16a350 con 0x7f3c2806e850 2024-04-17T17:51:57.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.182+0000 7f3c43400640 1 -- 172.21.15.152:0/954750992 <== osd.5 v2:172.21.15.196:6800/3519444232 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f3c4c16a350 con 0x7f3c2806e850 2024-04-17T17:51:57.188 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-17T17:51:57.188 INFO:teuthology.orchestra.run.smithi152.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-17T17:51:57.188 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-17T17:51:57.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.186+0000 7f3c51600640 1 -- 172.21.15.152:0/954750992 >> [v2:172.21.15.196:6800/3519444232,v1:172.21.15.196:6801/3519444232] conn(0x7f3c2806e850 msgr2=0x7f3c28070c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:57.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.186+0000 7f3c51600640 1 --2- 172.21.15.152:0/954750992 >> [v2:172.21.15.196:6800/3519444232,v1:172.21.15.196:6801/3519444232] conn(0x7f3c2806e850 0x7f3c28070c90 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:57.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.186+0000 7f3c51600640 1 -- 172.21.15.152:0/954750992 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3c280683b0 msgr2=0x7f3c2806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:57.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.186+0000 7f3c51600640 1 --2- 172.21.15.152:0/954750992 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f3c280683b0 0x7f3c2806a870 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f3c34009580 tx=0x7f3c34009190 comp rx=0 tx=0).stop 2024-04-17T17:51:57.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.186+0000 7f3c51600640 1 -- 172.21.15.152:0/954750992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c4c06f6a0 msgr2=0x7f3c4c156340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:57.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.186+0000 7f3c51600640 1 --2- 172.21.15.152:0/954750992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c4c06f6a0 0x7f3c4c156340 secure :-1 s=READY pgs=2080 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c0ae040 tx=0x7f3c3c01ac10 comp rx=0 tx=0).stop 2024-04-17T17:51:57.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.186+0000 7f3c4b400640 1 -- 172.21.15.152:0/954750992 reap_dead start 2024-04-17T17:51:57.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.186+0000 7f3c51600640 1 -- 172.21.15.152:0/954750992 shutdown_connections 2024-04-17T17:51:57.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.186+0000 7f3c51600640 1 -- 172.21.15.152:0/954750992 >> 172.21.15.152:0/954750992 conn(0x7f3c4c0b3220 msgr2=0x7f3c4c15dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:57.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.186+0000 7f3c51600640 1 -- 172.21.15.152:0/954750992 shutdown_connections 2024-04-17T17:51:57.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.186+0000 7f3c51600640 1 -- 172.21.15.152:0/954750992 wait complete. 2024-04-17T17:51:57.237 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-17T17:51:57.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.438+0000 7f5be0c00640 1 Processor -- start 2024-04-17T17:51:57.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.438+0000 7f5be0c00640 1 -- start start 2024-04-17T17:51:57.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.442+0000 7f5be0c00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f5bdc070eb0 0x7f5bdc0cc920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:57.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.442+0000 7f5be0c00640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bdc0cea90 con 0x7f5bdc0cce60 2024-04-17T17:51:57.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.442+0000 7f5be0c00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bdc0ced50 con 0x7f5bdc160980 2024-04-17T17:51:57.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.442+0000 7f5be0c00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f5bdc0cf830 con 0x7f5bdc070eb0 2024-04-17T17:51:57.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.442+0000 7f5bd3e00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f5bdc0cce60 0x7f5bdc160270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:54806/0 (socket says 172.21.15.152:54806) 2024-04-17T17:51:57.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.442+0000 7f5bd3e00640 1 -- 172.21.15.152:0/3198061311 learned_addr learned my addr 172.21.15.152:0/3198061311 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T17:51:57.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.442+0000 7f5bdb400640 1 --2- 172.21.15.152:0/3198061311 >> v2:172.21.15.196:3300/0 conn(0x7f5bdc070eb0 0x7f5bdc0cc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:57.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.442+0000 7f5bdb400640 1 -- 172.21.15.152:0/3198061311 >> v1:172.21.15.196:6789/0 conn(0x7f5bdc160980 legacy=0x7f5bdc159640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:57.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.442+0000 7f5bdb400640 1 -- 172.21.15.152:0/3198061311 >> v1:172.21.15.152:6789/0 conn(0x7f5bdc0cce60 legacy=0x7f5bdc160270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:57.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.442+0000 7f5bdb400640 1 -- 172.21.15.152:0/3198061311 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bdc0cf030 con 0x7f5bdc070eb0 2024-04-17T17:51:57.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.446+0000 7f5bdb400640 1 --2- 172.21.15.152:0/3198061311 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5bdc070eb0 0x7f5bdc0cc920 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc0097c0 tx=0x7f5bcc01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e2f09c1ab982d3a server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:57.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.446+0000 7f5bdaa00640 1 -- 172.21.15.152:0/3198061311 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc0b0070 con 0x7f5bdc070eb0 2024-04-17T17:51:57.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.446+0000 7f5bdaa00640 1 -- 172.21.15.152:0/3198061311 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bcc0ab600 con 0x7f5bdc070eb0 2024-04-17T17:51:57.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.446+0000 7f5bdaa00640 1 -- 172.21.15.152:0/3198061311 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc0ab9d0 con 0x7f5bdc070eb0 2024-04-17T17:51:57.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.450+0000 7f5be0c00640 1 -- 172.21.15.152:0/3198061311 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5bdc070eb0 msgr2=0x7f5bdc0cc920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:57.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.450+0000 7f5be0c00640 1 --2- 172.21.15.152:0/3198061311 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5bdc070eb0 0x7f5bdc0cc920 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc0097c0 tx=0x7f5bcc01c4a0 comp rx=0 tx=0).stop 2024-04-17T17:51:57.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.450+0000 7f5be0c00640 1 -- 172.21.15.152:0/3198061311 shutdown_connections 2024-04-17T17:51:57.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.450+0000 7f5be0c00640 1 --2- 172.21.15.152:0/3198061311 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5bdc070eb0 0x7f5bdc0cc920 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:57.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.450+0000 7f5be0c00640 1 -- 172.21.15.152:0/3198061311 >> 172.21.15.152:0/3198061311 conn(0x7f5bdc0b3e40 msgr2=0x7f5bdc0b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:57.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.450+0000 7f5be0c00640 1 -- 172.21.15.152:0/3198061311 shutdown_connections 2024-04-17T17:51:57.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.450+0000 7f5be0c00640 1 -- 172.21.15.152:0/3198061311 wait complete. 2024-04-17T17:51:57.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.454+0000 7f5be0c00640 1 Processor -- start 2024-04-17T17:51:57.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.454+0000 7f5be0c00640 1 -- start start 2024-04-17T17:51:57.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.458+0000 7f5be0c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5bdc070eb0 0x7f5bdc0c93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:57.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.458+0000 7f5be0c00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bdc0cce60 0x7f5bdc0c5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:57.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.458+0000 7f5be0c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5bdc160980 0x7f5bdc166730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:57.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.458+0000 7f5be0c00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5bdc160d90 con 0x7f5bdc0cce60 2024-04-17T17:51:57.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.458+0000 7f5be0c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f5bdc0cf3a0 con 0x7f5bdc160980 2024-04-17T17:51:57.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.458+0000 7f5be0c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f5bdc0ce830 con 0x7f5bdc070eb0 2024-04-17T17:51:57.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.458+0000 7f5bdb400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5bdc070eb0 0x7f5bdc0c93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:57.462 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.458+0000 7f5bdb400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5bdc070eb0 0x7f5bdc0c93a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.152:58138/0 (socket says 172.21.15.152:58138) 2024-04-17T17:51:57.462 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.458+0000 7f5bdb400640 1 -- 172.21.15.152:0/2117347620 learned_addr learned my addr 172.21.15.152:0/2117347620 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T17:51:57.462 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.458+0000 7f5bd3e00640 1 --2- 172.21.15.152:0/2117347620 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bdc0cce60 0x7f5bdc0c5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:57.462 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.458+0000 7f5bdbe00640 1 --2- 172.21.15.152:0/2117347620 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5bdc160980 0x7f5bdc166730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:57.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.458+0000 7f5bdb400640 1 -- 172.21.15.152:0/2117347620 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5bdc160980 msgr2=0x7f5bdc166730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:57.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.458+0000 7f5bdb400640 1 --2- 172.21.15.152:0/2117347620 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5bdc160980 0x7f5bdc166730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:57.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.458+0000 7f5bdb400640 1 -- 172.21.15.152:0/2117347620 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bdc0cce60 msgr2=0x7f5bdc0c5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:57.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.458+0000 7f5bdb400640 1 --2- 172.21.15.152:0/2117347620 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bdc0cce60 0x7f5bdc0c5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:57.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.458+0000 7f5bdb400640 1 -- 172.21.15.152:0/2117347620 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bdc0c5b90 con 0x7f5bdc070eb0 2024-04-17T17:51:57.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.458+0000 7f5bd3e00640 1 --2- 172.21.15.152:0/2117347620 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bdc0cce60 0x7f5bdc0c5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T17:51:57.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.458+0000 7f5bdbe00640 1 --2- 172.21.15.152:0/2117347620 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5bdc160980 0x7f5bdc166730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T17:51:57.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.458+0000 7f5bdb400640 1 --2- 172.21.15.152:0/2117347620 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5bdc070eb0 0x7f5bdc0c93a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc0190b0 tx=0x7f5bcc019240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:57.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.458+0000 7f5bd3400640 1 -- 172.21.15.152:0/2117347620 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc0b0040 con 0x7f5bdc070eb0 2024-04-17T17:51:57.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.458+0000 7f5bd3400640 1 -- 172.21.15.152:0/2117347620 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bcc0bb070 con 0x7f5bdc070eb0 2024-04-17T17:51:57.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.458+0000 7f5be0c00640 1 -- 172.21.15.152:0/2117347620 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bdc165690 con 0x7f5bdc070eb0 2024-04-17T17:51:57.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.458+0000 7f5bd3400640 1 -- 172.21.15.152:0/2117347620 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc0b4870 con 0x7f5bdc070eb0 2024-04-17T17:51:57.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.458+0000 7f5be0c00640 1 -- 172.21.15.152:0/2117347620 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bdc165c50 con 0x7f5bdc070eb0 2024-04-17T17:51:57.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.462+0000 7f5be0c00640 1 -- 172.21.15.152:0/2117347620 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bdc075c10 con 0x7f5bdc070eb0 2024-04-17T17:51:57.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.466+0000 7f5bd3400640 1 -- 172.21.15.152:0/2117347620 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5bcc0ab4c0 con 0x7f5bdc070eb0 2024-04-17T17:51:57.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.466+0000 7f5bd3400640 1 --2- 172.21.15.152:0/2117347620 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5bb8068380 0x7f5bb806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:57.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.466+0000 7f5bd3400640 1 -- 172.21.15.152:0/2117347620 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f5bcc120530 con 0x7f5bdc070eb0 2024-04-17T17:51:57.471 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.466+0000 7f5bd3e00640 1 --2- 172.21.15.152:0/2117347620 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5bb8068380 0x7f5bb806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:57.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.470+0000 7f5bd3e00640 1 --2- 172.21.15.152:0/2117347620 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5bb8068380 0x7f5bb806a840 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc0b3c00 tx=0x7f5bc4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:57.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.470+0000 7f5bd3400640 1 -- 172.21.15.152:0/2117347620 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f5bcc016090 con 0x7f5bdc070eb0 2024-04-17T17:51:57.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.630+0000 7f5be0c00640 1 -- 172.21.15.152:0/2117347620 --> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f5bdc0c98e0 con 0x7f5bb8068380 2024-04-17T17:51:57.919 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.914+0000 7f5bd3400640 1 -- 172.21.15.152:0/2117347620 <== mgr.4104 v2:172.21.15.152:6832/3078522445 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5bdc0c98e0 con 0x7f5bb8068380 2024-04-17T17:51:57.920 INFO:teuthology.orchestra.run.smithi152.stderr:instructed osd(s) 5 to deep-scrub 2024-04-17T17:51:57.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.922+0000 7f5be0c00640 1 -- 172.21.15.152:0/2117347620 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5bb8068380 msgr2=0x7f5bb806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:57.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.922+0000 7f5be0c00640 1 --2- 172.21.15.152:0/2117347620 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5bb8068380 0x7f5bb806a840 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc0b3c00 tx=0x7f5bc4009040 comp rx=0 tx=0).stop 2024-04-17T17:51:57.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.922+0000 7f5be0c00640 1 -- 172.21.15.152:0/2117347620 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5bdc070eb0 msgr2=0x7f5bdc0c93a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:57.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.922+0000 7f5be0c00640 1 --2- 172.21.15.152:0/2117347620 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5bdc070eb0 0x7f5bdc0c93a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc0190b0 tx=0x7f5bcc019240 comp rx=0 tx=0).stop 2024-04-17T17:51:57.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.922+0000 7f5be0c00640 1 -- 172.21.15.152:0/2117347620 shutdown_connections 2024-04-17T17:51:57.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.922+0000 7f5be0c00640 1 --2- 172.21.15.152:0/2117347620 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5bdc160980 0x7f5bdc166730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:57.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.922+0000 7f5be0c00640 1 --2- 172.21.15.152:0/2117347620 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bdc0cce60 0x7f5bdc0c5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:57.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.922+0000 7f5be0c00640 1 --2- 172.21.15.152:0/2117347620 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5bb8068380 0x7f5bb806a840 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:57.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.922+0000 7f5be0c00640 1 --2- 172.21.15.152:0/2117347620 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5bdc070eb0 0x7f5bdc0c93a0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:57.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.922+0000 7f5be0c00640 1 -- 172.21.15.152:0/2117347620 >> 172.21.15.152:0/2117347620 conn(0x7f5bdc0b3e40 msgr2=0x7f5bdc0d01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:57.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.922+0000 7f5be0c00640 1 -- 172.21.15.152:0/2117347620 shutdown_connections 2024-04-17T17:51:57.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:57.922+0000 7f5be0c00640 1 -- 172.21.15.152:0/2117347620 wait complete. 2024-04-17T17:51:57.972 INFO:tasks.ceph:Scrubbing osd.6 2024-04-17T17:51:57.972 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-17T17:51:58.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.382+0000 7fba2a400640 1 Processor -- start 2024-04-17T17:51:58.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.382+0000 7fba2a400640 1 -- start start 2024-04-17T17:51:58.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.386+0000 7fba2a400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fba24141550 0x7fba240c7180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:58.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.386+0000 7fba2a400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba240cf2e0 0x7fba24141c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:58.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.386+0000 7fba2a400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba24143a40 con 0x7fba240c76c0 2024-04-17T17:51:58.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.386+0000 7fba2a400640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fba24143d00 con 0x7fba24141550 2024-04-17T17:51:58.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.386+0000 7fba2a400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fba24143fe0 con 0x7fba240cf2e0 2024-04-17T17:51:58.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.386+0000 7fba29000640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fba24141550 0x7fba240c7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:58.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.386+0000 7fba29000640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fba24141550 0x7fba240c7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54350/0 (socket says 172.21.15.152:54350) 2024-04-17T17:51:58.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.386+0000 7fba29000640 1 -- 172.21.15.152:0/3463359505 learned_addr learned my addr 172.21.15.152:0/3463359505 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T17:51:58.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.386+0000 7fba29a00640 1 --2- 172.21.15.152:0/3463359505 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba240cf2e0 0x7fba24141c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:58.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.386+0000 7fba29000640 1 -- 172.21.15.152:0/3463359505 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba240cf2e0 msgr2=0x7fba24141c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T17:51:58.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.386+0000 7fba29000640 1 --2- 172.21.15.152:0/3463359505 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba240cf2e0 0x7fba24141c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:58.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.386+0000 7fba29000640 1 -- 172.21.15.152:0/3463359505 >> v1:172.21.15.196:6789/0 conn(0x7fba240c76c0 legacy=0x7fba240cebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:58.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.386+0000 7fba29000640 1 -- 172.21.15.152:0/3463359505 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba241442c0 con 0x7fba24141550 2024-04-17T17:51:58.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.386+0000 7fba29a00640 1 --2- 172.21.15.152:0/3463359505 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba240cf2e0 0x7fba24141c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T17:51:58.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.390+0000 7fba29000640 1 --2- 172.21.15.152:0/3463359505 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba24141550 0x7fba240c7180 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 crypto rx=0x7fba18009870 tx=0x7fba1801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c0da9a279c28515 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:58.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.390+0000 7fba23400640 1 -- 172.21.15.152:0/3463359505 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba180ab650 con 0x7fba24141550 2024-04-17T17:51:58.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.390+0000 7fba23400640 1 -- 172.21.15.152:0/3463359505 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba180b0070 con 0x7fba24141550 2024-04-17T17:51:58.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.390+0000 7fba23400640 1 -- 172.21.15.152:0/3463359505 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba180aba10 con 0x7fba24141550 2024-04-17T17:51:58.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.394+0000 7fba2a400640 1 -- 172.21.15.152:0/3463359505 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba24141550 msgr2=0x7fba240c7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:58.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.394+0000 7fba2a400640 1 --2- 172.21.15.152:0/3463359505 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba24141550 0x7fba240c7180 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 crypto rx=0x7fba18009870 tx=0x7fba1801c560 comp rx=0 tx=0).stop 2024-04-17T17:51:58.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.394+0000 7fba2a400640 1 -- 172.21.15.152:0/3463359505 shutdown_connections 2024-04-17T17:51:58.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.394+0000 7fba2a400640 1 --2- 172.21.15.152:0/3463359505 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba240cf2e0 0x7fba24141c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:58.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.394+0000 7fba2a400640 1 --2- 172.21.15.152:0/3463359505 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba24141550 0x7fba240c7180 unknown :-1 s=CLOSED pgs=2082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:58.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.394+0000 7fba2a400640 1 -- 172.21.15.152:0/3463359505 >> 172.21.15.152:0/3463359505 conn(0x7fba2406bfb0 msgr2=0x7fba240b3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:58.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.394+0000 7fba2a400640 1 -- 172.21.15.152:0/3463359505 shutdown_connections 2024-04-17T17:51:58.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.394+0000 7fba2a400640 1 -- 172.21.15.152:0/3463359505 wait complete. 2024-04-17T17:51:58.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.398+0000 7fba2a400640 1 Processor -- start 2024-04-17T17:51:58.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.398+0000 7fba2a400640 1 -- start start 2024-04-17T17:51:58.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.402+0000 7fba2a400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba240c76c0 0x7fba24154870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:58.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.402+0000 7fba2a400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba240cf2e0 0x7fba241602f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:58.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.402+0000 7fba2a400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fba24141550 0x7fba2413bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:58.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.402+0000 7fba2a400640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fba24142b10 con 0x7fba240c76c0 2024-04-17T17:51:58.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.402+0000 7fba2a400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fba24142990 con 0x7fba24141550 2024-04-17T17:51:58.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.402+0000 7fba2a400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fba24142c90 con 0x7fba240cf2e0 2024-04-17T17:51:58.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.402+0000 7fba29000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba240c76c0 0x7fba24154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:58.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.402+0000 7fba29000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba240c76c0 0x7fba24154870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54360/0 (socket says 172.21.15.152:54360) 2024-04-17T17:51:58.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.402+0000 7fba29000640 1 -- 172.21.15.152:0/1305483699 learned_addr learned my addr 172.21.15.152:0/1305483699 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T17:51:58.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.402+0000 7fba23e00640 1 --2- 172.21.15.152:0/1305483699 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba240cf2e0 0x7fba241602f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:58.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.402+0000 7fba29a00640 1 --2- 172.21.15.152:0/1305483699 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fba24141550 0x7fba2413bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:58.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.402+0000 7fba29000640 1 -- 172.21.15.152:0/1305483699 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba240cf2e0 msgr2=0x7fba241602f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:58.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.402+0000 7fba29000640 1 --2- 172.21.15.152:0/1305483699 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba240cf2e0 0x7fba241602f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:58.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.402+0000 7fba29000640 1 -- 172.21.15.152:0/1305483699 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fba24141550 msgr2=0x7fba2413bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:58.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.402+0000 7fba29000640 1 --2- 172.21.15.152:0/1305483699 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fba24141550 0x7fba2413bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:58.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.402+0000 7fba29000640 1 -- 172.21.15.152:0/1305483699 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba24160b20 con 0x7fba240c76c0 2024-04-17T17:51:58.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.402+0000 7fba29a00640 1 --2- 172.21.15.152:0/1305483699 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fba24141550 0x7fba2413bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T17:51:58.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.402+0000 7fba23e00640 1 --2- 172.21.15.152:0/1305483699 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba240cf2e0 0x7fba241602f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T17:51:58.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.402+0000 7fba29000640 1 --2- 172.21.15.152:0/1305483699 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba240c76c0 0x7fba24154870 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 crypto rx=0x7fba180ad040 tx=0x7fba1801ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:58.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.402+0000 7fba20c00640 1 -- 172.21.15.152:0/1305483699 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba180abe60 con 0x7fba240c76c0 2024-04-17T17:51:58.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.402+0000 7fba20c00640 1 -- 172.21.15.152:0/1305483699 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba180b4800 con 0x7fba240c76c0 2024-04-17T17:51:58.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.402+0000 7fba20c00640 1 -- 172.21.15.152:0/1305483699 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba180b4bf0 con 0x7fba240c76c0 2024-04-17T17:51:58.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.406+0000 7fba2a400640 1 -- 172.21.15.152:0/1305483699 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba24160e00 con 0x7fba240c76c0 2024-04-17T17:51:58.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.406+0000 7fba2a400640 1 -- 172.21.15.152:0/1305483699 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba24139650 con 0x7fba240c76c0 2024-04-17T17:51:58.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.406+0000 7fba2a400640 1 -- 172.21.15.152:0/1305483699 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fba24075be0 con 0x7fba240c76c0 2024-04-17T17:51:58.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.410+0000 7fba20c00640 1 -- 172.21.15.152:0/1305483699 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fba180b3380 con 0x7fba240c76c0 2024-04-17T17:51:58.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.410+0000 7fba20c00640 1 --2- 172.21.15.152:0/1305483699 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fba04068380 0x7fba0406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:58.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.414+0000 7fba20c00640 1 -- 172.21.15.152:0/1305483699 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7fba18120dc0 con 0x7fba240c76c0 2024-04-17T17:51:58.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.414+0000 7fba23e00640 1 --2- 172.21.15.152:0/1305483699 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fba04068380 0x7fba0406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:58.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.414+0000 7fba20c00640 1 --2- 172.21.15.152:0/1305483699 >> [v2:172.21.15.196:6808/275739834,v1:172.21.15.196:6809/275739834] conn(0x7fba0406e820 0x7fba04070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:58.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.414+0000 7fba20c00640 1 -- 172.21.15.152:0/1305483699 --> [v2:172.21.15.196:6808/275739834,v1:172.21.15.196:6809/275739834] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fba180a7ea0 con 0x7fba0406e820 2024-04-17T17:51:58.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.414+0000 7fba20c00640 1 -- 172.21.15.152:0/1305483699 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fba181233e0 con 0x7fba240c76c0 2024-04-17T17:51:58.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.414+0000 7fba29a00640 1 --2- 172.21.15.152:0/1305483699 >> [v2:172.21.15.196:6808/275739834,v1:172.21.15.196:6809/275739834] conn(0x7fba0406e820 0x7fba04070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:58.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.414+0000 7fba23e00640 1 --2- 172.21.15.152:0/1305483699 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fba04068380 0x7fba0406a840 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fba240c88e0 tx=0x7fba10009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:58.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.414+0000 7fba29a00640 1 --2- 172.21.15.152:0/1305483699 >> [v2:172.21.15.196:6808/275739834,v1:172.21.15.196:6809/275739834] conn(0x7fba0406e820 0x7fba04070c60 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:58.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.602+0000 7fba20c00640 1 -- 172.21.15.152:0/1305483699 <== osd.6 v2:172.21.15.196:6808/275739834 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fba180a7ea0 con 0x7fba0406e820 2024-04-17T17:51:58.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.638+0000 7fba2a400640 1 -- 172.21.15.152:0/1305483699 --> [v2:172.21.15.196:6808/275739834,v1:172.21.15.196:6809/275739834] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fba2415f590 con 0x7fba0406e820 2024-04-17T17:51:58.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.646+0000 7fba20c00640 1 -- 172.21.15.152:0/1305483699 <== osd.6 v2:172.21.15.196:6808/275739834 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fba2415f590 con 0x7fba0406e820 2024-04-17T17:51:58.649 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-17T17:51:58.649 INFO:teuthology.orchestra.run.smithi152.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-17T17:51:58.649 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-17T17:51:58.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.646+0000 7fba2a400640 1 -- 172.21.15.152:0/1305483699 >> [v2:172.21.15.196:6808/275739834,v1:172.21.15.196:6809/275739834] conn(0x7fba0406e820 msgr2=0x7fba04070c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:58.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.646+0000 7fba2a400640 1 --2- 172.21.15.152:0/1305483699 >> [v2:172.21.15.196:6808/275739834,v1:172.21.15.196:6809/275739834] conn(0x7fba0406e820 0x7fba04070c60 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:58.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.646+0000 7fba2a400640 1 -- 172.21.15.152:0/1305483699 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fba04068380 msgr2=0x7fba0406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:58.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.646+0000 7fba2a400640 1 --2- 172.21.15.152:0/1305483699 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fba04068380 0x7fba0406a840 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fba240c88e0 tx=0x7fba10009040 comp rx=0 tx=0).stop 2024-04-17T17:51:58.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.646+0000 7fba2a400640 1 -- 172.21.15.152:0/1305483699 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba240c76c0 msgr2=0x7fba24154870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:58.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.646+0000 7fba2a400640 1 --2- 172.21.15.152:0/1305483699 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba240c76c0 0x7fba24154870 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 crypto rx=0x7fba180ad040 tx=0x7fba1801ada0 comp rx=0 tx=0).stop 2024-04-17T17:51:58.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.646+0000 7fba29a00640 1 -- 172.21.15.152:0/1305483699 reap_dead start 2024-04-17T17:51:58.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.646+0000 7fba2a400640 1 -- 172.21.15.152:0/1305483699 shutdown_connections 2024-04-17T17:51:58.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.646+0000 7fba2a400640 1 -- 172.21.15.152:0/1305483699 >> 172.21.15.152:0/1305483699 conn(0x7fba2406bfb0 msgr2=0x7fba240cebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:58.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.646+0000 7fba2a400640 1 -- 172.21.15.152:0/1305483699 shutdown_connections 2024-04-17T17:51:58.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:58.646+0000 7fba2a400640 1 -- 172.21.15.152:0/1305483699 wait complete. 2024-04-17T17:51:58.696 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-17T17:51:59.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.090+0000 7fc773800640 1 Processor -- start 2024-04-17T17:51:59.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.090+0000 7fc773800640 1 -- start start 2024-04-17T17:51:59.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.094+0000 7fc773800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc76c0b0230 0x7fc76c0cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:59.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.094+0000 7fc773800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc76c0b65b0 0x7fc76c0cb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:59.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.094+0000 7fc773800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc76c0cd340 con 0x7fc76c15c6f0 2024-04-17T17:51:59.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.094+0000 7fc773800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fc76c160d10 con 0x7fc76c0b65b0 2024-04-17T17:51:59.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.094+0000 7fc773800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fc76c160ff0 con 0x7fc76c0b0230 2024-04-17T17:51:59.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.094+0000 7fc770e00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fc76c15c6f0 0x7fc76c0ccc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.152:36686/0 (socket says 172.21.15.152:36686) 2024-04-17T17:51:59.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.094+0000 7fc770e00640 1 -- 172.21.15.152:0/1052352107 learned_addr learned my addr 172.21.15.152:0/1052352107 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T17:51:59.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.094+0000 7fc76be00640 1 --2- 172.21.15.152:0/1052352107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc76c0b0230 0x7fc76c0cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:59.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.094+0000 7fc771800640 1 --2- 172.21.15.152:0/1052352107 >> v2:172.21.15.196:3300/0 conn(0x7fc76c0b65b0 0x7fc76c0cb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:59.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.094+0000 7fc76b400640 1 -- 172.21.15.152:0/1052352107 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 258785664 0 0) 0x7fc76c0cd340 con 0x7fc76c15c6f0 2024-04-17T17:51:59.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.098+0000 7fc76b400640 1 -- 172.21.15.152:0/1052352107 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc754003530 con 0x7fc76c15c6f0 2024-04-17T17:51:59.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.098+0000 7fc771800640 1 -- 172.21.15.152:0/1052352107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc76c0b0230 msgr2=0x7fc76c0cb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T17:51:59.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.098+0000 7fc771800640 1 --2- 172.21.15.152:0/1052352107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc76c0b0230 0x7fc76c0cb1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:59.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.098+0000 7fc771800640 1 -- 172.21.15.152:0/1052352107 >> v1:172.21.15.196:6789/0 conn(0x7fc76c15c6f0 legacy=0x7fc76c0ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:59.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.098+0000 7fc771800640 1 -- 172.21.15.152:0/1052352107 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc76c0cc430 con 0x7fc76c0b65b0 2024-04-17T17:51:59.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.106+0000 7fc771800640 1 --2- 172.21.15.152:0/1052352107 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc76c0b65b0 0x7fc76c0cb6e0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fc764009d90 tx=0x7fc76401c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd6bf7e58113eeec server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:59.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.106+0000 7fc76b400640 1 -- 172.21.15.152:0/1052352107 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7640b2070 con 0x7fc76c0b65b0 2024-04-17T17:51:59.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.106+0000 7fc76b400640 1 -- 172.21.15.152:0/1052352107 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7640a5910 con 0x7fc76c0b65b0 2024-04-17T17:51:59.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.106+0000 7fc76b400640 1 -- 172.21.15.152:0/1052352107 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7640a5ce0 con 0x7fc76c0b65b0 2024-04-17T17:51:59.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.106+0000 7fc773800640 1 -- 172.21.15.152:0/1052352107 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc76c0b65b0 msgr2=0x7fc76c0cb6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:59.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.106+0000 7fc773800640 1 --2- 172.21.15.152:0/1052352107 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc76c0b65b0 0x7fc76c0cb6e0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fc764009d90 tx=0x7fc76401c940 comp rx=0 tx=0).stop 2024-04-17T17:51:59.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.106+0000 7fc773800640 1 -- 172.21.15.152:0/1052352107 shutdown_connections 2024-04-17T17:51:59.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.106+0000 7fc773800640 1 --2- 172.21.15.152:0/1052352107 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc76c0b65b0 0x7fc76c0cb6e0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:59.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.106+0000 7fc773800640 1 --2- 172.21.15.152:0/1052352107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc76c0b0230 0x7fc76c0cb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:59.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.106+0000 7fc773800640 1 -- 172.21.15.152:0/1052352107 >> 172.21.15.152:0/1052352107 conn(0x7fc76c0cd5d0 msgr2=0x7fc76c0cd9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:59.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.106+0000 7fc773800640 1 -- 172.21.15.152:0/1052352107 shutdown_connections 2024-04-17T17:51:59.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.106+0000 7fc773800640 1 -- 172.21.15.152:0/1052352107 wait complete. 2024-04-17T17:51:59.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.110+0000 7fc773800640 1 Processor -- start 2024-04-17T17:51:59.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.114+0000 7fc773800640 1 -- start start 2024-04-17T17:51:59.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.114+0000 7fc773800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc76c0b0230 0x7fc76c15afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:59.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.114+0000 7fc773800640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc76c0b65b0 0x7fc76c15f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:59.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.114+0000 7fc773800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc76c15c6f0 0x7fc76c1f7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:59.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.114+0000 7fc773800640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc76c0cf300 con 0x7fc76c0b65b0 2024-04-17T17:51:59.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.114+0000 7fc773800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc76c0cf180 con 0x7fc76c15c6f0 2024-04-17T17:51:59.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.114+0000 7fc773800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fc76c0cf480 con 0x7fc76c0b0230 2024-04-17T17:51:59.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.114+0000 7fc770e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc76c0b0230 0x7fc76c15afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:59.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.114+0000 7fc76be00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc76c0b65b0 0x7fc76c15f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:59.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.114+0000 7fc771800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc76c15c6f0 0x7fc76c1f7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:59.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.114+0000 7fc770e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc76c0b0230 0x7fc76c15afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.152:35502/0 (socket says 172.21.15.152:35502) 2024-04-17T17:51:59.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.114+0000 7fc770e00640 1 -- 172.21.15.152:0/727406719 learned_addr learned my addr 172.21.15.152:0/727406719 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T17:51:59.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.118+0000 7fc770e00640 1 -- 172.21.15.152:0/727406719 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc76c15c6f0 msgr2=0x7fc76c1f7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:59.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.118+0000 7fc770e00640 1 --2- 172.21.15.152:0/727406719 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc76c15c6f0 0x7fc76c1f7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:59.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.118+0000 7fc770e00640 1 -- 172.21.15.152:0/727406719 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc76c0b65b0 msgr2=0x7fc76c15f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:59.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.118+0000 7fc770e00640 1 --2- 172.21.15.152:0/727406719 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc76c0b65b0 0x7fc76c15f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:59.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.118+0000 7fc770e00640 1 -- 172.21.15.152:0/727406719 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc76c0c7dc0 con 0x7fc76c0b0230 2024-04-17T17:51:59.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.118+0000 7fc770e00640 1 --2- 172.21.15.152:0/727406719 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc76c0b0230 0x7fc76c15afe0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc76000c3c0 tx=0x7fc76000c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:59.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.118+0000 7fc768c00640 1 -- 172.21.15.152:0/727406719 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc760017070 con 0x7fc76c0b0230 2024-04-17T17:51:59.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.118+0000 7fc768c00640 1 -- 172.21.15.152:0/727406719 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc760005cf0 con 0x7fc76c0b0230 2024-04-17T17:51:59.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.118+0000 7fc773800640 1 -- 172.21.15.152:0/727406719 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc76c15fbd0 con 0x7fc76c0b0230 2024-04-17T17:51:59.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.118+0000 7fc768c00640 1 -- 172.21.15.152:0/727406719 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7600072f0 con 0x7fc76c0b0230 2024-04-17T17:51:59.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.118+0000 7fc773800640 1 -- 172.21.15.152:0/727406719 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc76c0c8060 con 0x7fc76c0b0230 2024-04-17T17:51:59.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.118+0000 7fc773800640 1 -- 172.21.15.152:0/727406719 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc76c069140 con 0x7fc76c0b0230 2024-04-17T17:51:59.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.122+0000 7fc768c00640 1 -- 172.21.15.152:0/727406719 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc76001a070 con 0x7fc76c0b0230 2024-04-17T17:51:59.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.126+0000 7fc768c00640 1 --2- 172.21.15.152:0/727406719 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc74c0683d0 0x7fc74c06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:51:59.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.126+0000 7fc768c00640 1 -- 172.21.15.152:0/727406719 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7fc760085b70 con 0x7fc76c0b0230 2024-04-17T17:51:59.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.126+0000 7fc76be00640 1 --2- 172.21.15.152:0/727406719 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc74c0683d0 0x7fc74c06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:51:59.131 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.126+0000 7fc76be00640 1 --2- 172.21.15.152:0/727406719 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc74c0683d0 0x7fc74c06a890 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fc76c0a1870 tx=0x7fc758009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:51:59.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.130+0000 7fc768c00640 1 -- 172.21.15.152:0/727406719 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7fc760055cc0 con 0x7fc76c0b0230 2024-04-17T17:51:59.620 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.614+0000 7fc773800640 1 -- 172.21.15.152:0/727406719 --> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fc76c0ce310 con 0x7fc74c0683d0 2024-04-17T17:51:59.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.618+0000 7fc768c00640 1 -- 172.21.15.152:0/727406719 <== mgr.4104 v2:172.21.15.152:6832/3078522445 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc76c0ce310 con 0x7fc74c0683d0 2024-04-17T17:51:59.621 INFO:teuthology.orchestra.run.smithi152.stderr:instructed osd(s) 6 to deep-scrub 2024-04-17T17:51:59.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.622+0000 7fc773800640 1 -- 172.21.15.152:0/727406719 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc74c0683d0 msgr2=0x7fc74c06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:59.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.622+0000 7fc773800640 1 --2- 172.21.15.152:0/727406719 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc74c0683d0 0x7fc74c06a890 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fc76c0a1870 tx=0x7fc758009190 comp rx=0 tx=0).stop 2024-04-17T17:51:59.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.622+0000 7fc773800640 1 -- 172.21.15.152:0/727406719 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc76c0b0230 msgr2=0x7fc76c15afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:51:59.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.622+0000 7fc773800640 1 --2- 172.21.15.152:0/727406719 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc76c0b0230 0x7fc76c15afe0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc76000c3c0 tx=0x7fc76000c880 comp rx=0 tx=0).stop 2024-04-17T17:51:59.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.622+0000 7fc773800640 1 -- 172.21.15.152:0/727406719 shutdown_connections 2024-04-17T17:51:59.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.622+0000 7fc773800640 1 --2- 172.21.15.152:0/727406719 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc76c15c6f0 0x7fc76c1f7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:59.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.622+0000 7fc773800640 1 --2- 172.21.15.152:0/727406719 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc76c0b65b0 0x7fc76c15f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:59.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.622+0000 7fc773800640 1 --2- 172.21.15.152:0/727406719 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7fc74c0683d0 0x7fc74c06a890 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:59.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.622+0000 7fc773800640 1 --2- 172.21.15.152:0/727406719 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc76c0b0230 0x7fc76c15afe0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:51:59.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.622+0000 7fc773800640 1 -- 172.21.15.152:0/727406719 >> 172.21.15.152:0/727406719 conn(0x7fc76c0cd5d0 msgr2=0x7fc76c06f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:51:59.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.622+0000 7fc773800640 1 -- 172.21.15.152:0/727406719 shutdown_connections 2024-04-17T17:51:59.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:51:59.622+0000 7fc773800640 1 -- 172.21.15.152:0/727406719 wait complete. 2024-04-17T17:51:59.676 INFO:tasks.ceph:Scrubbing osd.7 2024-04-17T17:51:59.676 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-17T17:52:00.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.094+0000 7f7eb2200640 1 Processor -- start 2024-04-17T17:52:00.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.094+0000 7f7eb2200640 1 -- start start 2024-04-17T17:52:00.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.098+0000 7f7eb2200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f7eac142660 0x7f7eac06ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:52:00.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.098+0000 7f7eb2200640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7eac0cd890 0x7f7eac0d0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:52:00.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.098+0000 7f7eb2200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7eac142a40 con 0x7f7eac0cfd90 2024-04-17T17:52:00.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.098+0000 7f7eb2200640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f7eac06d370 con 0x7f7eac0cd890 2024-04-17T17:52:00.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.098+0000 7f7eb2200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f7eac06bd90 con 0x7f7eac142660 2024-04-17T17:52:00.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.098+0000 7f7ea3e00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f7eac0cfd90 0x7f7eac0cd180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.152:36696/0 (socket says 172.21.15.152:36696) 2024-04-17T17:52:00.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.098+0000 7f7ea3e00640 1 -- 172.21.15.152:0/1446733355 learned_addr learned my addr 172.21.15.152:0/1446733355 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T17:52:00.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.098+0000 7f7eb1800640 1 --2- 172.21.15.152:0/1446733355 >> v2:172.21.15.152:3300/0 conn(0x7f7eac0cd890 0x7f7eac0d0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:52:00.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.098+0000 7f7eb0e00640 1 --2- 172.21.15.152:0/1446733355 >> v2:172.21.15.196:3300/0 conn(0x7f7eac142660 0x7f7eac06ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:52:00.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.098+0000 7f7eabe00640 1 -- 172.21.15.152:0/1446733355 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2055715520 0 0) 0x7f7eac142a40 con 0x7f7eac0cfd90 2024-04-17T17:52:00.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.098+0000 7f7eabe00640 1 -- 172.21.15.152:0/1446733355 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e90003530 con 0x7f7eac0cfd90 2024-04-17T17:52:00.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.102+0000 7f7eabe00640 1 -- 172.21.15.152:0/1446733355 <== mon.1 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3184647708 0 0) 0x7f7e90003530 con 0x7f7eac0cfd90 2024-04-17T17:52:00.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.102+0000 7f7eb0e00640 1 -- 172.21.15.152:0/1446733355 >> v2:172.21.15.152:3300/0 conn(0x7f7eac0cd890 msgr2=0x7f7eac0d0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T17:52:00.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.102+0000 7f7eb0e00640 1 --2- 172.21.15.152:0/1446733355 >> v2:172.21.15.152:3300/0 conn(0x7f7eac0cd890 0x7f7eac0d0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:52:00.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.102+0000 7f7eb0e00640 1 -- 172.21.15.152:0/1446733355 >> v1:172.21.15.196:6789/0 conn(0x7f7eac0cfd90 legacy=0x7f7eac0cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:52:00.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.102+0000 7f7eb0e00640 1 -- 172.21.15.152:0/1446733355 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7eac06c070 con 0x7f7eac142660 2024-04-17T17:52:00.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.110+0000 7f7eb0e00640 1 --2- 172.21.15.152:0/1446733355 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7eac142660 0x7f7eac06ce30 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f7eac0d0770 tx=0x7f7e9c01c790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9af6478851cdf174 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:52:00.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.110+0000 7f7eabe00640 1 -- 172.21.15.152:0/1446733355 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c0b2070 con 0x7f7eac142660 2024-04-17T17:52:00.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.110+0000 7f7eabe00640 1 -- 172.21.15.152:0/1446733355 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e9c0a55d0 con 0x7f7eac142660 2024-04-17T17:52:00.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.110+0000 7f7eabe00640 1 -- 172.21.15.152:0/1446733355 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e94001680 con 0x7f7eac142660 2024-04-17T17:52:00.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.110+0000 7f7eb2200640 1 -- 172.21.15.152:0/1446733355 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7eac142660 msgr2=0x7f7eac06ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:52:00.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.110+0000 7f7eb2200640 1 --2- 172.21.15.152:0/1446733355 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7eac142660 0x7f7eac06ce30 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f7eac0d0770 tx=0x7f7e9c01c790 comp rx=0 tx=0).stop 2024-04-17T17:52:00.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.110+0000 7f7eb2200640 1 -- 172.21.15.152:0/1446733355 shutdown_connections 2024-04-17T17:52:00.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.110+0000 7f7eb2200640 1 --2- 172.21.15.152:0/1446733355 >> v2:172.21.15.152:3300/0 conn(0x7f7eac0cd890 0x7f7eac0d0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:52:00.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.110+0000 7f7eb2200640 1 --2- 172.21.15.152:0/1446733355 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7eac142660 0x7f7eac06ce30 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:52:00.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.110+0000 7f7eb2200640 1 -- 172.21.15.152:0/1446733355 >> 172.21.15.152:0/1446733355 conn(0x7f7eac0d09e0 msgr2=0x7f7eac0d0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:52:00.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.110+0000 7f7eb2200640 1 -- 172.21.15.152:0/1446733355 shutdown_connections 2024-04-17T17:52:00.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.110+0000 7f7eb2200640 1 -- 172.21.15.152:0/1446733355 wait complete. 2024-04-17T17:52:00.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.114+0000 7f7eb2200640 1 Processor -- start 2024-04-17T17:52:00.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.114+0000 7f7eb2200640 1 -- start start 2024-04-17T17:52:00.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.118+0000 7f7eb2200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7eac0cd890 0x7f7eac141910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:52:00.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.118+0000 7f7eb2200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7eac0cfd90 0x7f7eac1567a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:52:00.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.118+0000 7f7eb2200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7eac142660 0x7f7eac06f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:52:00.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.118+0000 7f7eb2200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7eac06bb30 con 0x7f7eac142660 2024-04-17T17:52:00.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.118+0000 7f7eb2200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f7eac06b9b0 con 0x7f7eac0cd890 2024-04-17T17:52:00.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.118+0000 7f7eb2200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f7eac06f1a0 con 0x7f7eac0cfd90 2024-04-17T17:52:00.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.118+0000 7f7eb0e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7eac0cd890 0x7f7eac141910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:52:00.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.118+0000 7f7ea3e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7eac0cfd90 0x7f7eac1567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:52:00.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.118+0000 7f7eb0e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7eac0cd890 0x7f7eac141910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.152:35978/0 (socket says 172.21.15.152:35978) 2024-04-17T17:52:00.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.118+0000 7f7eb0e00640 1 -- 172.21.15.152:0/2698531990 learned_addr learned my addr 172.21.15.152:0/2698531990 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T17:52:00.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.118+0000 7f7eb1800640 1 --2- 172.21.15.152:0/2698531990 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7eac142660 0x7f7eac06f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:52:00.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.118+0000 7f7eb0e00640 1 -- 172.21.15.152:0/2698531990 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7eac0cfd90 msgr2=0x7f7eac1567a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:52:00.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.118+0000 7f7eb0e00640 1 --2- 172.21.15.152:0/2698531990 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7eac0cfd90 0x7f7eac1567a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:52:00.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.118+0000 7f7eb0e00640 1 -- 172.21.15.152:0/2698531990 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7eac142660 msgr2=0x7f7eac06f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:52:00.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.118+0000 7f7eb0e00640 1 --2- 172.21.15.152:0/2698531990 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7eac142660 0x7f7eac06f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:52:00.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.118+0000 7f7eb0e00640 1 -- 172.21.15.152:0/2698531990 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7eac161a30 con 0x7f7eac0cd890 2024-04-17T17:52:00.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.118+0000 7f7eb1800640 1 --2- 172.21.15.152:0/2698531990 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7eac142660 0x7f7eac06f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T17:52:00.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.118+0000 7f7eb0e00640 1 --2- 172.21.15.152:0/2698531990 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7eac0cd890 0x7f7eac141910 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c0b0040 tx=0x7f7e9c019530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:52:00.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.122+0000 7f7ea9600640 1 -- 172.21.15.152:0/2698531990 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c0bd020 con 0x7f7eac0cd890 2024-04-17T17:52:00.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.122+0000 7f7ea9600640 1 -- 172.21.15.152:0/2698531990 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e9c0b8690 con 0x7f7eac0cd890 2024-04-17T17:52:00.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.122+0000 7f7ea9600640 1 -- 172.21.15.152:0/2698531990 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c0b2040 con 0x7f7eac0cd890 2024-04-17T17:52:00.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.122+0000 7f7eb2200640 1 -- 172.21.15.152:0/2698531990 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7eac1571f0 con 0x7f7eac0cd890 2024-04-17T17:52:00.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.122+0000 7f7eb2200640 1 -- 172.21.15.152:0/2698531990 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7eac1577b0 con 0x7f7eac0cd890 2024-04-17T17:52:00.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.122+0000 7f7eb2200640 1 -- 172.21.15.152:0/2698531990 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7eac075be0 con 0x7f7eac0cd890 2024-04-17T17:52:00.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.126+0000 7f7ea9600640 1 -- 172.21.15.152:0/2698531990 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7e9c0c0020 con 0x7f7eac0cd890 2024-04-17T17:52:00.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.130+0000 7f7ea9600640 1 --2- 172.21.15.152:0/2698531990 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f7e880683d0 0x7f7e8806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:52:00.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.130+0000 7f7ea9600640 1 -- 172.21.15.152:0/2698531990 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f7e9c121590 con 0x7f7eac0cd890 2024-04-17T17:52:00.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.130+0000 7f7ea3e00640 1 --2- 172.21.15.152:0/2698531990 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f7e880683d0 0x7f7e8806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:52:00.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.130+0000 7f7ea9600640 1 --2- 172.21.15.152:0/2698531990 >> [v2:172.21.15.196:6824/307626968,v1:172.21.15.196:6825/307626968] conn(0x7f7e8806e870 0x7f7e88070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:52:00.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.130+0000 7f7ea9600640 1 -- 172.21.15.152:0/2698531990 --> [v2:172.21.15.196:6824/307626968,v1:172.21.15.196:6825/307626968] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7e88071380 con 0x7f7e8806e870 2024-04-17T17:52:00.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.130+0000 7f7ea9600640 1 -- 172.21.15.152:0/2698531990 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f7e9c128050 con 0x7f7eac0cd890 2024-04-17T17:52:00.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.130+0000 7f7ea3e00640 1 --2- 172.21.15.152:0/2698531990 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f7e880683d0 0x7f7e8806a890 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f7eac15f420 tx=0x7f7e940016e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:52:00.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.130+0000 7f7eb1800640 1 --2- 172.21.15.152:0/2698531990 >> [v2:172.21.15.196:6824/307626968,v1:172.21.15.196:6825/307626968] conn(0x7f7e8806e870 0x7f7e88070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:52:00.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.130+0000 7f7eb1800640 1 --2- 172.21.15.152:0/2698531990 >> [v2:172.21.15.196:6824/307626968,v1:172.21.15.196:6825/307626968] conn(0x7f7e8806e870 0x7f7e88070cb0 crc :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:52:00.179 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:52:00.185 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:52:00.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.226+0000 7f7ea9600640 1 -- 172.21.15.152:0/2698531990 <== osd.7 v2:172.21.15.196:6824/307626968 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7e88071380 con 0x7f7e8806e870 2024-04-17T17:52:00.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.266+0000 7f7eb2200640 1 -- 172.21.15.152:0/2698531990 --> [v2:172.21.15.196:6824/307626968,v1:172.21.15.196:6825/307626968] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7eac06e540 con 0x7f7e8806e870 2024-04-17T17:52:00.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.298+0000 7f7ea9600640 1 -- 172.21.15.152:0/2698531990 <== osd.7 v2:172.21.15.196:6824/307626968 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f7eac06e540 con 0x7f7e8806e870 2024-04-17T17:52:00.301 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-04-17T17:52:00.301 INFO:teuthology.orchestra.run.smithi152.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-17T17:52:00.301 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-04-17T17:52:00.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.298+0000 7f7eb2200640 1 -- 172.21.15.152:0/2698531990 >> [v2:172.21.15.196:6824/307626968,v1:172.21.15.196:6825/307626968] conn(0x7f7e8806e870 msgr2=0x7f7e88070cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:52:00.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.298+0000 7f7eb2200640 1 --2- 172.21.15.152:0/2698531990 >> [v2:172.21.15.196:6824/307626968,v1:172.21.15.196:6825/307626968] conn(0x7f7e8806e870 0x7f7e88070cb0 crc :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:52:00.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.298+0000 7f7eb2200640 1 -- 172.21.15.152:0/2698531990 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f7e880683d0 msgr2=0x7f7e8806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:52:00.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.298+0000 7f7eb2200640 1 --2- 172.21.15.152:0/2698531990 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f7e880683d0 0x7f7e8806a890 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f7eac15f420 tx=0x7f7e940016e0 comp rx=0 tx=0).stop 2024-04-17T17:52:00.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.298+0000 7f7eb2200640 1 -- 172.21.15.152:0/2698531990 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7eac0cd890 msgr2=0x7f7eac141910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:52:00.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.298+0000 7f7eb2200640 1 --2- 172.21.15.152:0/2698531990 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7eac0cd890 0x7f7eac141910 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c0b0040 tx=0x7f7e9c019530 comp rx=0 tx=0).stop 2024-04-17T17:52:00.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.298+0000 7f7eb1800640 1 -- 172.21.15.152:0/2698531990 reap_dead start 2024-04-17T17:52:00.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.298+0000 7f7eb2200640 1 -- 172.21.15.152:0/2698531990 shutdown_connections 2024-04-17T17:52:00.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.298+0000 7f7eb2200640 1 -- 172.21.15.152:0/2698531990 >> 172.21.15.152:0/2698531990 conn(0x7f7eac0d09e0 msgr2=0x7f7eac0b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:52:00.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.298+0000 7f7eb2200640 1 -- 172.21.15.152:0/2698531990 shutdown_connections 2024-04-17T17:52:00.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.298+0000 7f7eb2200640 1 -- 172.21.15.152:0/2698531990 wait complete. 2024-04-17T17:52:00.348 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-17T17:52:00.795 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.790+0000 7fec08600640 1 Processor -- start 2024-04-17T17:52:00.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.790+0000 7fec08600640 1 -- start start 2024-04-17T17:52:00.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.794+0000 7fec08600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec00145ea0 0x7fec000d0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:52:00.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.794+0000 7fec08600640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fec000d0790 0x7fec000c7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:52:00.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.794+0000 7fec08600640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec000ccbb0 con 0x7fec000c7770 2024-04-17T17:52:00.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.794+0000 7fec08600640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fec000cce90 con 0x7fec000d0790 2024-04-17T17:52:00.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.794+0000 7fec08600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fec000cd170 con 0x7fec00145ea0 2024-04-17T17:52:00.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.798+0000 7fec05c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec00145ea0 0x7fec000d0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:52:00.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.798+0000 7fec05c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec00145ea0 0x7fec000d0250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.152:35532/0 (socket says 172.21.15.152:35532) 2024-04-17T17:52:00.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.798+0000 7fec05c00640 1 -- 172.21.15.152:0/3017195947 learned_addr learned my addr 172.21.15.152:0/3017195947 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T17:52:00.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.798+0000 7fec05200640 1 --2- 172.21.15.152:0/3017195947 >> v2:172.21.15.152:3300/0 conn(0x7fec000d0790 0x7fec000c7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:52:00.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.798+0000 7fec05c00640 1 -- 172.21.15.152:0/3017195947 >> v2:172.21.15.152:3300/0 conn(0x7fec000d0790 msgr2=0x7fec000c7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T17:52:00.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.798+0000 7fec05c00640 1 --2- 172.21.15.152:0/3017195947 >> v2:172.21.15.152:3300/0 conn(0x7fec000d0790 0x7fec000c7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:52:00.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.798+0000 7fec05c00640 1 -- 172.21.15.152:0/3017195947 >> v1:172.21.15.196:6789/0 conn(0x7fec000c7770 legacy=0x7fec00071790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T17:52:00.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.798+0000 7fec05c00640 1 -- 172.21.15.152:0/3017195947 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec000cd450 con 0x7fec00145ea0 2024-04-17T17:52:00.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.802+0000 7fec05c00640 1 --2- 172.21.15.152:0/3017195947 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec00145ea0 0x7fec000d0250 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7febf40098a0 tx=0x7febf401c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fd637f4328f6105 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:52:00.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.802+0000 7febffe00640 1 -- 172.21.15.152:0/3017195947 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf40b0070 con 0x7fec00145ea0 2024-04-17T17:52:00.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.802+0000 7febffe00640 1 -- 172.21.15.152:0/3017195947 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febf40ab600 con 0x7fec00145ea0 2024-04-17T17:52:00.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.802+0000 7febffe00640 1 -- 172.21.15.152:0/3017195947 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf40ab9d0 con 0x7fec00145ea0 2024-04-17T17:52:00.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.802+0000 7fec08600640 1 -- 172.21.15.152:0/3017195947 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec00145ea0 msgr2=0x7fec000d0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:52:00.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.802+0000 7fec08600640 1 --2- 172.21.15.152:0/3017195947 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec00145ea0 0x7fec000d0250 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7febf40098a0 tx=0x7febf401c540 comp rx=0 tx=0).stop 2024-04-17T17:52:00.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.802+0000 7fec08600640 1 -- 172.21.15.152:0/3017195947 shutdown_connections 2024-04-17T17:52:00.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.802+0000 7fec08600640 1 --2- 172.21.15.152:0/3017195947 >> v2:172.21.15.152:3300/0 conn(0x7fec000d0790 0x7fec000c7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:52:00.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.802+0000 7fec08600640 1 --2- 172.21.15.152:0/3017195947 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec00145ea0 0x7fec000d0250 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:52:00.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.802+0000 7fec08600640 1 -- 172.21.15.152:0/3017195947 >> 172.21.15.152:0/3017195947 conn(0x7fec000d2350 msgr2=0x7fec000d2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:52:00.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.802+0000 7fec08600640 1 -- 172.21.15.152:0/3017195947 shutdown_connections 2024-04-17T17:52:00.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.802+0000 7fec08600640 1 -- 172.21.15.152:0/3017195947 wait complete. 2024-04-17T17:52:00.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.806+0000 7fec08600640 1 Processor -- start 2024-04-17T17:52:00.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.806+0000 7fec08600640 1 -- start start 2024-04-17T17:52:00.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.810+0000 7fec08600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec000c7770 0x7fec000b7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:52:00.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.810+0000 7fec08600640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec000d0790 0x7fec001407c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:52:00.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.810+0000 7fec08600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fec00145ea0 0x7fec0015b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:52:00.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.810+0000 7fec08600640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fec00071ea0 con 0x7fec000d0790 2024-04-17T17:52:00.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.810+0000 7fec08600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fec000c7b80 con 0x7fec00145ea0 2024-04-17T17:52:00.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.810+0000 7fec08600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fec00072020 con 0x7fec000c7770 2024-04-17T17:52:00.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.810+0000 7fec05c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec000c7770 0x7fec000b7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:52:00.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.810+0000 7fec05c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec000c7770 0x7fec000b7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.152:35546/0 (socket says 172.21.15.152:35546) 2024-04-17T17:52:00.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.810+0000 7fec05c00640 1 -- 172.21.15.152:0/2940433705 learned_addr learned my addr 172.21.15.152:0/2940433705 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T17:52:00.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.810+0000 7fec05200640 1 --2- 172.21.15.152:0/2940433705 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec000d0790 0x7fec001407c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:52:00.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.810+0000 7fec06600640 1 --2- 172.21.15.152:0/2940433705 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fec00145ea0 0x7fec0015b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:52:00.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.810+0000 7fec05c00640 1 -- 172.21.15.152:0/2940433705 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fec00145ea0 msgr2=0x7fec0015b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:52:00.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.810+0000 7fec05c00640 1 --2- 172.21.15.152:0/2940433705 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fec00145ea0 0x7fec0015b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:52:00.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.810+0000 7fec05c00640 1 -- 172.21.15.152:0/2940433705 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec000d0790 msgr2=0x7fec001407c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:52:00.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.810+0000 7fec05c00640 1 --2- 172.21.15.152:0/2940433705 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec000d0790 0x7fec001407c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:52:00.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.810+0000 7fec05c00640 1 -- 172.21.15.152:0/2940433705 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec000b6ab0 con 0x7fec000c7770 2024-04-17T17:52:00.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.810+0000 7fec06600640 1 --2- 172.21.15.152:0/2940433705 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fec00145ea0 0x7fec0015b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T17:52:00.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.810+0000 7fec05c00640 1 --2- 172.21.15.152:0/2940433705 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec000c7770 0x7fec000b7b30 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7febf401a170 tx=0x7febf40192e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:52:00.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.814+0000 7febfd600640 1 -- 172.21.15.152:0/2940433705 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf40b9020 con 0x7fec000c7770 2024-04-17T17:52:00.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.814+0000 7febfd600640 1 -- 172.21.15.152:0/2940433705 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febf40b1040 con 0x7fec000c7770 2024-04-17T17:52:00.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.814+0000 7febfd600640 1 -- 172.21.15.152:0/2940433705 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf40b0070 con 0x7fec000c7770 2024-04-17T17:52:00.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.814+0000 7fec08600640 1 -- 172.21.15.152:0/2940433705 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec000b6d90 con 0x7fec000c7770 2024-04-17T17:52:00.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.814+0000 7fec08600640 1 -- 172.21.15.152:0/2940433705 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fec000b7350 con 0x7fec000c7770 2024-04-17T17:52:00.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.814+0000 7fec08600640 1 -- 172.21.15.152:0/2940433705 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec00068a30 con 0x7fec000c7770 2024-04-17T17:52:00.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.818+0000 7febfd600640 1 -- 172.21.15.152:0/2940433705 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7febf40bc020 con 0x7fec000c7770 2024-04-17T17:52:00.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.818+0000 7febfd600640 1 --2- 172.21.15.152:0/2940433705 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7febe00683d0 0x7febe006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:52:00.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.822+0000 7febfd600640 1 -- 172.21.15.152:0/2940433705 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7febf4120640 con 0x7fec000c7770 2024-04-17T17:52:00.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.822+0000 7fec05200640 1 --2- 172.21.15.152:0/2940433705 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7febe00683d0 0x7febe006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:52:00.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.822+0000 7fec05200640 1 --2- 172.21.15.152:0/2940433705 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7febe00683d0 0x7febe006a890 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fec001424b0 tx=0x7febec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:52:00.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:00.826+0000 7febfd600640 1 -- 172.21.15.152:0/2940433705 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7febf40c3030 con 0x7fec000c7770 2024-04-17T17:52:01.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.318+0000 7fec08600640 1 -- 172.21.15.152:0/2940433705 --> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7fec000b36c0 con 0x7febe00683d0 2024-04-17T17:52:01.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.322+0000 7febfd600640 1 -- 172.21.15.152:0/2940433705 <== mgr.4104 v2:172.21.15.152:6832/3078522445 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fec000b36c0 con 0x7febe00683d0 2024-04-17T17:52:01.324 INFO:teuthology.orchestra.run.smithi152.stderr:instructed osd(s) 7 to deep-scrub 2024-04-17T17:52:01.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.326+0000 7fec08600640 1 -- 172.21.15.152:0/2940433705 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7febe00683d0 msgr2=0x7febe006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:52:01.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.326+0000 7fec08600640 1 --2- 172.21.15.152:0/2940433705 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7febe00683d0 0x7febe006a890 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fec001424b0 tx=0x7febec008040 comp rx=0 tx=0).stop 2024-04-17T17:52:01.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.326+0000 7fec08600640 1 -- 172.21.15.152:0/2940433705 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec000c7770 msgr2=0x7fec000b7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:52:01.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.326+0000 7fec08600640 1 --2- 172.21.15.152:0/2940433705 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec000c7770 0x7fec000b7b30 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7febf401a170 tx=0x7febf40192e0 comp rx=0 tx=0).stop 2024-04-17T17:52:01.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.326+0000 7fec08600640 1 -- 172.21.15.152:0/2940433705 shutdown_connections 2024-04-17T17:52:01.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.326+0000 7fec08600640 1 --2- 172.21.15.152:0/2940433705 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fec00145ea0 0x7fec0015b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:52:01.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.326+0000 7fec08600640 1 --2- 172.21.15.152:0/2940433705 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec000d0790 0x7fec001407c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:52:01.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.326+0000 7fec08600640 1 --2- 172.21.15.152:0/2940433705 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7febe00683d0 0x7febe006a890 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:52:01.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.326+0000 7fec08600640 1 --2- 172.21.15.152:0/2940433705 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec000c7770 0x7fec000b7b30 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:52:01.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.326+0000 7fec08600640 1 -- 172.21.15.152:0/2940433705 >> 172.21.15.152:0/2940433705 conn(0x7fec000d2350 msgr2=0x7fec000cb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:52:01.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.326+0000 7fec08600640 1 -- 172.21.15.152:0/2940433705 shutdown_connections 2024-04-17T17:52:01.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.326+0000 7fec08600640 1 -- 172.21.15.152:0/2940433705 wait complete. 2024-04-17T17:52:01.379 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T17:52:01.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.774+0000 7faeee000640 1 Processor -- start 2024-04-17T17:52:01.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.774+0000 7faeee000640 1 -- start start 2024-04-17T17:52:01.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.778+0000 7faeee000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faee8073420 0x7faee815cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:52:01.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.778+0000 7faeee000640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7faee806d450 0x7faee815d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:52:01.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.778+0000 7faeee000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faee815d640 con 0x7faee806d070 2024-04-17T17:52:01.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.778+0000 7faeee000640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7faee815d8f0 con 0x7faee806d450 2024-04-17T17:52:01.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.778+0000 7faeee000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7faee80cdd70 con 0x7faee8073420 2024-04-17T17:52:01.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.778+0000 7faee6a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faee8073420 0x7faee815cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:52:01.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.778+0000 7faee7400640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7faee806d070 0x7faee8072d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.152:36718/0 (socket says 172.21.15.152:36718) 2024-04-17T17:52:01.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.778+0000 7faee7400640 1 -- 172.21.15.152:0/1267946017 learned_addr learned my addr 172.21.15.152:0/1267946017 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T17:52:01.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.782+0000 7faee7e00640 1 --2- 172.21.15.152:0/1267946017 >> v2:172.21.15.152:3300/0 conn(0x7faee806d450 0x7faee815d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:52:01.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.782+0000 7faee6a00640 1 -- 172.21.15.152:0/1267946017 >> v2:172.21.15.152:3300/0 conn(0x7faee806d450 msgr2=0x7faee815d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T17:52:01.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.782+0000 7faee6a00640 1 --2- 172.21.15.152:0/1267946017 >> v2:172.21.15.152:3300/0 conn(0x7faee806d450 0x7faee815d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:52:01.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.782+0000 7faee6a00640 1 -- 172.21.15.152:0/1267946017 >> v1:172.21.15.196:6789/0 conn(0x7faee806d070 legacy=0x7faee8072d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:52:01.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.782+0000 7faee6a00640 1 -- 172.21.15.152:0/1267946017 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faee80ce050 con 0x7faee8073420 2024-04-17T17:52:01.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.782+0000 7faee6000640 1 -- 172.21.15.152:0/1267946017 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 976280455 0 0) 0x7faee815d640 con 0x7faee806d070 2024-04-17T17:52:01.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.790+0000 7faee6a00640 1 --2- 172.21.15.152:0/1267946017 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faee8073420 0x7faee815cbc0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7faed40097c0 tx=0x7faed401c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30eca513bce1a944 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:52:01.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.790+0000 7faee6000640 1 -- 172.21.15.152:0/1267946017 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed40b1070 con 0x7faee8073420 2024-04-17T17:52:01.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.790+0000 7faee6000640 1 -- 172.21.15.152:0/1267946017 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faed40a8050 con 0x7faee8073420 2024-04-17T17:52:01.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.790+0000 7faee6000640 1 -- 172.21.15.152:0/1267946017 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed40ac860 con 0x7faee8073420 2024-04-17T17:52:01.795 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.790+0000 7faeee000640 1 -- 172.21.15.152:0/1267946017 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faee8073420 msgr2=0x7faee815cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:52:01.795 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.790+0000 7faeee000640 1 --2- 172.21.15.152:0/1267946017 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faee8073420 0x7faee815cbc0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7faed40097c0 tx=0x7faed401c3e0 comp rx=0 tx=0).stop 2024-04-17T17:52:01.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.790+0000 7faeee000640 1 -- 172.21.15.152:0/1267946017 shutdown_connections 2024-04-17T17:52:01.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.790+0000 7faeee000640 1 --2- 172.21.15.152:0/1267946017 >> v2:172.21.15.152:3300/0 conn(0x7faee806d450 0x7faee815d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:52:01.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.790+0000 7faeee000640 1 --2- 172.21.15.152:0/1267946017 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faee8073420 0x7faee815cbc0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:52:01.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.790+0000 7faeee000640 1 -- 172.21.15.152:0/1267946017 >> 172.21.15.152:0/1267946017 conn(0x7faee80b31c0 msgr2=0x7faee80b35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:52:01.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.790+0000 7faeee000640 1 -- 172.21.15.152:0/1267946017 shutdown_connections 2024-04-17T17:52:01.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.790+0000 7faeee000640 1 -- 172.21.15.152:0/1267946017 wait complete. 2024-04-17T17:52:01.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.798+0000 7faeee000640 1 Processor -- start 2024-04-17T17:52:01.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.798+0000 7faeee000640 1 -- start start 2024-04-17T17:52:01.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.798+0000 7faeee000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faee806d070 0x7faee81385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:52:01.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.798+0000 7faeee000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faee806d450 0x7faee814e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:52:01.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.798+0000 7faeee000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faee8073420 0x7faee814c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:52:01.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.798+0000 7faeee000640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7faee806f520 con 0x7faee8073420 2024-04-17T17:52:01.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.798+0000 7faeee000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7faee806f3a0 con 0x7faee806d450 2024-04-17T17:52:01.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.798+0000 7faeee000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7faee806f6a0 con 0x7faee806d070 2024-04-17T17:52:01.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.798+0000 7faee7400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faee806d070 0x7faee81385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:52:01.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.802+0000 7faee7400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faee806d070 0x7faee81385d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.152:35562/0 (socket says 172.21.15.152:35562) 2024-04-17T17:52:01.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.802+0000 7faee7400640 1 -- 172.21.15.152:0/1982487044 learned_addr learned my addr 172.21.15.152:0/1982487044 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T17:52:01.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.802+0000 7faee6a00640 1 --2- 172.21.15.152:0/1982487044 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faee806d450 0x7faee814e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:52:01.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.802+0000 7faee7400640 1 -- 172.21.15.152:0/1982487044 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faee806d450 msgr2=0x7faee814e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:52:01.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.802+0000 7faee7400640 1 --2- 172.21.15.152:0/1982487044 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faee806d450 0x7faee814e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:52:01.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.802+0000 7faee7400640 1 -- 172.21.15.152:0/1982487044 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faee8073420 msgr2=0x7faee814c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:52:01.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.802+0000 7faee7e00640 1 --2- 172.21.15.152:0/1982487044 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faee8073420 0x7faee814c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:52:01.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.802+0000 7faee7400640 1 --2- 172.21.15.152:0/1982487044 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faee8073420 0x7faee814c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:52:01.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.802+0000 7faee7400640 1 -- 172.21.15.152:0/1982487044 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faee814ec00 con 0x7faee806d070 2024-04-17T17:52:01.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.802+0000 7faee6a00640 1 --2- 172.21.15.152:0/1982487044 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faee806d450 0x7faee814e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T17:52:01.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.802+0000 7faee7e00640 1 --2- 172.21.15.152:0/1982487044 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faee8073420 0x7faee814c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T17:52:01.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.802+0000 7faee7400640 1 --2- 172.21.15.152:0/1982487044 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faee806d070 0x7faee81385d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7faed80011f0 tx=0x7faed800c9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:52:01.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.802+0000 7faedf400640 1 -- 172.21.15.152:0/1982487044 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed8018070 con 0x7faee806d070 2024-04-17T17:52:01.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.802+0000 7faedf400640 1 -- 172.21.15.152:0/1982487044 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faed80074e0 con 0x7faee806d070 2024-04-17T17:52:01.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.802+0000 7faeee000640 1 -- 172.21.15.152:0/1982487044 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faee8138e40 con 0x7faee806d070 2024-04-17T17:52:01.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.802+0000 7faedf400640 1 -- 172.21.15.152:0/1982487044 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed8004a10 con 0x7faee806d070 2024-04-17T17:52:01.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.802+0000 7faeee000640 1 -- 172.21.15.152:0/1982487044 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7faee8139400 con 0x7faee806d070 2024-04-17T17:52:01.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.806+0000 7faeee000640 1 -- 172.21.15.152:0/1982487044 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faee80d21d0 con 0x7faee806d070 2024-04-17T17:52:01.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.806+0000 7faedf400640 1 -- 172.21.15.152:0/1982487044 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7faed801b070 con 0x7faee806d070 2024-04-17T17:52:01.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.806+0000 7faedf400640 1 --2- 172.21.15.152:0/1982487044 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7faec8068380 0x7faec806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:52:01.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.810+0000 7faedf400640 1 -- 172.21.15.152:0/1982487044 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7faed8085c00 con 0x7faee806d070 2024-04-17T17:52:01.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.810+0000 7faee6a00640 1 --2- 172.21.15.152:0/1982487044 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7faec8068380 0x7faec806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:52:01.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.810+0000 7faee6a00640 1 --2- 172.21.15.152:0/1982487044 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7faec8068380 0x7faec806a840 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7faed40ae000 tx=0x7faed40a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:52:01.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:01.810+0000 7faedf400640 1 -- 172.21.15.152:0/1982487044 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7faed8056290 con 0x7faee806d070 2024-04-17T17:52:02.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:02.298+0000 7faeee000640 1 -- 172.21.15.152:0/1982487044 --> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7faee8068a30 con 0x7faec8068380 2024-04-17T17:52:02.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:02.298+0000 7faedf400640 1 -- 172.21.15.152:0/1982487044 <== mgr.4104 v2:172.21.15.152:6832/3078522445 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13445 (secure 0 0 0) 0x7faed40bf4a0 con 0x7faec8068380 2024-04-17T17:52:02.303 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T17:52:02.303 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2024-04-17T17:52:02.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:02.302+0000 7faeee000640 1 -- 172.21.15.152:0/1982487044 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7faec8068380 msgr2=0x7faec806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:52:02.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:02.302+0000 7faeee000640 1 --2- 172.21.15.152:0/1982487044 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7faec8068380 0x7faec806a840 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7faed40ae000 tx=0x7faed40a7000 comp rx=0 tx=0).stop 2024-04-17T17:52:02.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:02.302+0000 7faeee000640 1 -- 172.21.15.152:0/1982487044 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faee806d070 msgr2=0x7faee81385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:52:02.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:02.302+0000 7faeee000640 1 --2- 172.21.15.152:0/1982487044 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faee806d070 0x7faee81385d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7faed80011f0 tx=0x7faed800c9b0 comp rx=0 tx=0).stop 2024-04-17T17:52:02.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:02.302+0000 7faeee000640 1 -- 172.21.15.152:0/1982487044 shutdown_connections 2024-04-17T17:52:02.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:02.302+0000 7faeee000640 1 --2- 172.21.15.152:0/1982487044 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faee8073420 0x7faee814c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:52:02.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:02.302+0000 7faeee000640 1 --2- 172.21.15.152:0/1982487044 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faee806d450 0x7faee814e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:52:02.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:02.302+0000 7faeee000640 1 --2- 172.21.15.152:0/1982487044 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7faec8068380 0x7faec806a840 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:52:02.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:02.302+0000 7faeee000640 1 --2- 172.21.15.152:0/1982487044 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faee806d070 0x7faee81385d0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:52:02.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:02.302+0000 7faeee000640 1 -- 172.21.15.152:0/1982487044 >> 172.21.15.152:0/1982487044 conn(0x7faee80b31c0 msgr2=0x7faee815e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:52:02.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:02.302+0000 7faeee000640 1 -- 172.21.15.152:0/1982487044 shutdown_connections 2024-04-17T17:52:02.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:02.302+0000 7faeee000640 1 -- 172.21.15.152:0/1982487044 wait complete. 2024-04-17T17:52:02.357 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":16392,"stamp":"2024-04-17T17:52:00.914038+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":12555216,"kb_used_data":5128,"kb_used_omap":3922,"kb_used_meta":12546093,"kb_avail":742419504,"statfs":{"total":773094113280,"available":760237572096,"internally_reserved":0,"allocated":5251072,"data_stored":2955096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4016990,"internal_metadata":12847199394},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003636"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":483,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-17T17:51:41.078371+0000","last_change":"2024-04-17T08:46:22.807988+0000","last_active":"2024-04-17T17:51:41.078371+0000","last_peered":"2024-04-17T17:51:41.078371+0000","last_clean":"2024-04-17T17:51:41.078371+0000","last_became_active":"2024-04-17T08:46:22.806843+0000","last_became_peered":"2024-04-17T08:46:22.806843+0000","last_unstale":"2024-04-17T17:51:41.078371+0000","last_undegraded":"2024-04-17T17:51:41.078371+0000","last_fullsized":"2024-04-17T17:51:41.078371+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T08:46:21.741557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T08:46:21.741557+0000","last_clean_scrub_stamp":"2024-04-17T08:46:21.741557+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:28:38.254696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834581395,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1541116,"kb_used_data":1076,"kb_used_omap":548,"kb_used_meta":1539483,"kb_avail":92830724,"statfs":{"total":96636764160,"available":95058661376,"internally_reserved":0,"allocated":1101824,"data_stored":812163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":561386,"internal_metadata":1576431382},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834581397,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1647420,"kb_used_data":496,"kb_used_omap":648,"kb_used_meta":1646263,"kb_avail":92724420,"statfs":{"total":96636764160,"available":94949806080,"internally_reserved":0,"allocated":507904,"data_stored":221795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":664377,"internal_metadata":1685773511},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834581395,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1300856,"kb_used_data":496,"kb_used_omap":755,"kb_used_meta":1299596,"kb_avail":93070984,"statfs":{"total":96636764160,"available":95304687616,"internally_reserved":0,"allocated":507904,"data_stored":221795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":773576,"internal_metadata":1330786872},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834581397,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1759740,"kb_used_data":496,"kb_used_omap":1137,"kb_used_meta":1758094,"kb_avail":92612100,"statfs":{"total":96636764160,"available":94834790400,"internally_reserved":0,"allocated":507904,"data_stored":221795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1164464,"internal_metadata":1800289104},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834581338,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1673400,"kb_used_data":496,"kb_used_omap":255,"kb_used_meta":1672640,"kb_avail":92698440,"statfs":{"total":96636764160,"available":94923202560,"internally_reserved":0,"allocated":507904,"data_stored":221795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":261991,"internal_metadata":1712783513},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834581346,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1699000,"kb_used_data":496,"kb_used_omap":276,"kb_used_meta":1698219,"kb_avail":92672840,"statfs":{"total":96636764160,"available":94896988160,"internally_reserved":0,"allocated":507904,"data_stored":221795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":283299,"internal_metadata":1738976605},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834581354,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1499320,"kb_used_data":496,"kb_used_omap":27,"kb_used_meta":1498788,"kb_avail":92872520,"statfs":{"total":96636764160,"available":95101460480,"internally_reserved":0,"allocated":507904,"data_stored":221795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28320,"internal_metadata":1534759264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834581346,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1434364,"kb_used_data":1076,"kb_used_omap":273,"kb_used_meta":1433006,"kb_avail":92937476,"statfs":{"total":96636764160,"available":95167975424,"internally_reserved":0,"allocated":1101824,"data_stored":812163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":279577,"internal_metadata":1467399143},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T17:52:02.360 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-17T08:46:21.741557+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=8, tm_min=46, tm_sec=21, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=17, tm_min=51, tm_sec=47, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T17:52:02.360 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-17T17:52:22.360 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T17:52:22.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.754+0000 7f4737200640 1 Processor -- start 2024-04-17T17:52:22.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.758+0000 7f4737200640 1 -- start start 2024-04-17T17:52:22.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.758+0000 7f4737200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f47380cf370 0x7f47381476c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:52:22.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.758+0000 7f4737200640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f473806d350 0x7f47380b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:52:22.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.758+0000 7f4737200640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4738162260 con 0x7f47381472e0 2024-04-17T17:52:22.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.758+0000 7f4737200640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f4738163020 con 0x7f473806d350 2024-04-17T17:52:22.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.758+0000 7f4737200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f4738162540 con 0x7f47380cf370 2024-04-17T17:52:22.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.762+0000 7f4735e00640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f47381472e0 0x7f47380cec60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:36566/0 (socket says 172.21.15.152:36566) 2024-04-17T17:52:22.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.762+0000 7f4735e00640 1 -- 172.21.15.152:0/1475757407 learned_addr learned my addr 172.21.15.152:0/1475757407 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T17:52:22.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.762+0000 7f4735400640 1 --2- 172.21.15.152:0/1475757407 >> v2:172.21.15.196:3300/0 conn(0x7f47380cf370 0x7f47381476c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:52:22.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.762+0000 7f4736800640 1 --2- 172.21.15.152:0/1475757407 >> v2:172.21.15.152:3300/0 conn(0x7f473806d350 0x7f47380b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:52:22.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.762+0000 7f4734a00640 1 -- 172.21.15.152:0/1475757407 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3396209982 0 0) 0x7f4738162260 con 0x7f47381472e0 2024-04-17T17:52:22.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.762+0000 7f4734a00640 1 -- 172.21.15.152:0/1475757407 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f471c003530 con 0x7f47381472e0 2024-04-17T17:52:22.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.762+0000 7f4735400640 1 -- 172.21.15.152:0/1475757407 >> v2:172.21.15.152:3300/0 conn(0x7f473806d350 msgr2=0x7f47380b2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T17:52:22.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.762+0000 7f4735400640 1 --2- 172.21.15.152:0/1475757407 >> v2:172.21.15.152:3300/0 conn(0x7f473806d350 0x7f47380b2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:52:22.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.762+0000 7f4735400640 1 -- 172.21.15.152:0/1475757407 >> v1:172.21.15.152:6789/0 conn(0x7f47381472e0 legacy=0x7f47380cec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:52:22.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.762+0000 7f4735400640 1 -- 172.21.15.152:0/1475757407 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4738162820 con 0x7f47380cf370 2024-04-17T17:52:22.774 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.770+0000 7f4735400640 1 --2- 172.21.15.152:0/1475757407 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f47380cf370 0x7f47381476c0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f47380cc7e0 tx=0x7f472401c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2a314e596d83f44 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:52:22.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.770+0000 7f4734a00640 1 -- 172.21.15.152:0/1475757407 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47240b0070 con 0x7f47380cf370 2024-04-17T17:52:22.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.770+0000 7f4734a00640 1 -- 172.21.15.152:0/1475757407 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47240ab600 con 0x7f47380cf370 2024-04-17T17:52:22.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.770+0000 7f4734a00640 1 -- 172.21.15.152:0/1475757407 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47240ab9d0 con 0x7f47380cf370 2024-04-17T17:52:22.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.774+0000 7f4737200640 1 -- 172.21.15.152:0/1475757407 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f47380cf370 msgr2=0x7f47381476c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:52:22.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.774+0000 7f4737200640 1 --2- 172.21.15.152:0/1475757407 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f47380cf370 0x7f47381476c0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f47380cc7e0 tx=0x7f472401c3f0 comp rx=0 tx=0).stop 2024-04-17T17:52:22.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.774+0000 7f4737200640 1 -- 172.21.15.152:0/1475757407 shutdown_connections 2024-04-17T17:52:22.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.774+0000 7f4737200640 1 --2- 172.21.15.152:0/1475757407 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f47380cf370 0x7f47381476c0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:52:22.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.774+0000 7f4737200640 1 --2- 172.21.15.152:0/1475757407 >> v2:172.21.15.152:3300/0 conn(0x7f473806d350 0x7f47380b2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:52:22.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.774+0000 7f4737200640 1 -- 172.21.15.152:0/1475757407 >> 172.21.15.152:0/1475757407 conn(0x7f47380b4b20 msgr2=0x7f4738071790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:52:22.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.774+0000 7f4737200640 1 -- 172.21.15.152:0/1475757407 shutdown_connections 2024-04-17T17:52:22.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.774+0000 7f4737200640 1 -- 172.21.15.152:0/1475757407 wait complete. 2024-04-17T17:52:22.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.778+0000 7f4737200640 1 Processor -- start 2024-04-17T17:52:22.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.778+0000 7f4737200640 1 -- start start 2024-04-17T17:52:22.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.782+0000 7f4737200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f473806d350 0x7f47380b62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:52:22.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.782+0000 7f4737200640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47380cf370 0x7f47380cce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:52:22.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.782+0000 7f4737200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f47381472e0 0x7f473815b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:52:22.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.782+0000 7f4737200640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f47380b3c20 con 0x7f47380cf370 2024-04-17T17:52:22.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.782+0000 7f4737200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f47380b3aa0 con 0x7f47381472e0 2024-04-17T17:52:22.785 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.782+0000 7f4737200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f473816b440 con 0x7f473806d350 2024-04-17T17:52:22.786 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.782+0000 7f4735400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47380cf370 0x7f47380cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:52:22.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.782+0000 7f4735e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f473806d350 0x7f47380b62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:52:22.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.782+0000 7f4735400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47380cf370 0x7f47380cce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43228/0 (socket says 172.21.15.152:43228) 2024-04-17T17:52:22.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.782+0000 7f4735400640 1 -- 172.21.15.152:0/375965542 learned_addr learned my addr 172.21.15.152:0/375965542 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T17:52:22.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.782+0000 7f4736800640 1 --2- 172.21.15.152:0/375965542 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f47381472e0 0x7f473815b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:52:22.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.782+0000 7f4735400640 1 -- 172.21.15.152:0/375965542 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f473806d350 msgr2=0x7f47380b62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:52:22.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.782+0000 7f4735400640 1 --2- 172.21.15.152:0/375965542 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f473806d350 0x7f47380b62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:52:22.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.782+0000 7f4735400640 1 -- 172.21.15.152:0/375965542 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f47381472e0 msgr2=0x7f473815b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:52:22.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.782+0000 7f4735400640 1 --2- 172.21.15.152:0/375965542 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f47381472e0 0x7f473815b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:52:22.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.782+0000 7f4735400640 1 -- 172.21.15.152:0/375965542 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47380cd6b0 con 0x7f47380cf370 2024-04-17T17:52:22.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.782+0000 7f4735400640 1 --2- 172.21.15.152:0/375965542 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47380cf370 0x7f47380cce10 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 crypto rx=0x7f4724019000 tx=0x7f4724019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:52:22.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.782+0000 7f472e000640 1 -- 172.21.15.152:0/375965542 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47240b8020 con 0x7f47380cf370 2024-04-17T17:52:22.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.782+0000 7f472e000640 1 -- 172.21.15.152:0/375965542 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47240b4610 con 0x7f47380cf370 2024-04-17T17:52:22.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.782+0000 7f472e000640 1 -- 172.21.15.152:0/375965542 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47240b0040 con 0x7f47380cf370 2024-04-17T17:52:22.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.782+0000 7f4737200640 1 -- 172.21.15.152:0/375965542 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47380cd950 con 0x7f47380cf370 2024-04-17T17:52:22.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.782+0000 7f4737200640 1 -- 172.21.15.152:0/375965542 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47380cdf10 con 0x7f47380cf370 2024-04-17T17:52:22.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.786+0000 7f4737200640 1 -- 172.21.15.152:0/375965542 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4738075c10 con 0x7f47380cf370 2024-04-17T17:52:22.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.790+0000 7f472e000640 1 -- 172.21.15.152:0/375965542 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f47240bb020 con 0x7f47380cf370 2024-04-17T17:52:22.795 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.790+0000 7f472e000640 1 --2- 172.21.15.152:0/375965542 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f4718068380 0x7f471806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:52:22.795 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.790+0000 7f472e000640 1 -- 172.21.15.152:0/375965542 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f4724120420 con 0x7f47380cf370 2024-04-17T17:52:22.795 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.790+0000 7f4735e00640 1 --2- 172.21.15.152:0/375965542 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f4718068380 0x7f471806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:52:22.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.794+0000 7f4735e00640 1 --2- 172.21.15.152:0/375965542 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f4718068380 0x7f471806a840 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f4728007fd0 tx=0x7f4728009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:52:22.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:22.834+0000 7f472e000640 1 -- 172.21.15.152:0/375965542 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f47240c2030 con 0x7f47380cf370 2024-04-17T17:52:23.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.314+0000 7f4737200640 1 -- 172.21.15.152:0/375965542 --> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f47380d18f0 con 0x7f4718068380 2024-04-17T17:52:23.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.318+0000 7f472e000640 1 -- 172.21.15.152:0/375965542 <== mgr.4104 v2:172.21.15.152:6832/3078522445 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13453 (secure 0 0 0) 0x7f47380d18f0 con 0x7f4718068380 2024-04-17T17:52:23.321 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T17:52:23.321 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2024-04-17T17:52:23.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.322+0000 7f4737200640 1 -- 172.21.15.152:0/375965542 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f4718068380 msgr2=0x7f471806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:52:23.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.322+0000 7f4737200640 1 --2- 172.21.15.152:0/375965542 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f4718068380 0x7f471806a840 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f4728007fd0 tx=0x7f4728009040 comp rx=0 tx=0).stop 2024-04-17T17:52:23.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.322+0000 7f4737200640 1 -- 172.21.15.152:0/375965542 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47380cf370 msgr2=0x7f47380cce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:52:23.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.322+0000 7f4737200640 1 --2- 172.21.15.152:0/375965542 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47380cf370 0x7f47380cce10 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 crypto rx=0x7f4724019000 tx=0x7f4724019190 comp rx=0 tx=0).stop 2024-04-17T17:52:23.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.322+0000 7f4737200640 1 -- 172.21.15.152:0/375965542 shutdown_connections 2024-04-17T17:52:23.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.322+0000 7f4737200640 1 --2- 172.21.15.152:0/375965542 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f47381472e0 0x7f473815b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:52:23.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.322+0000 7f4737200640 1 --2- 172.21.15.152:0/375965542 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47380cf370 0x7f47380cce10 unknown :-1 s=CLOSED pgs=2085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:52:23.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.322+0000 7f4737200640 1 --2- 172.21.15.152:0/375965542 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f4718068380 0x7f471806a840 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:52:23.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.322+0000 7f4737200640 1 --2- 172.21.15.152:0/375965542 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f473806d350 0x7f47380b62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:52:23.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.322+0000 7f4737200640 1 -- 172.21.15.152:0/375965542 >> 172.21.15.152:0/375965542 conn(0x7f47380b4b20 msgr2=0x7f4738140320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:52:23.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.322+0000 7f4737200640 1 -- 172.21.15.152:0/375965542 shutdown_connections 2024-04-17T17:52:23.328 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.322+0000 7f4737200640 1 -- 172.21.15.152:0/375965542 wait complete. 2024-04-17T17:52:23.377 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":16403,"stamp":"2024-04-17T17:52:22.920799+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":12555216,"kb_used_data":5128,"kb_used_omap":3922,"kb_used_meta":12546093,"kb_avail":742419504,"statfs":{"total":773094113280,"available":760237572096,"internally_reserved":0,"allocated":5251072,"data_stored":2955096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4016990,"internal_metadata":12847199394},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003836"},"pg_stats":[{"pgid":"1.0","version":"43'119","reported_seq":494,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-17T17:52:01.899694+0000","last_change":"2024-04-17T17:52:01.899726+0000","last_active":"2024-04-17T17:52:01.899694+0000","last_peered":"2024-04-17T17:52:01.899694+0000","last_clean":"2024-04-17T17:52:01.899694+0000","last_became_active":"2024-04-17T08:46:22.806843+0000","last_became_peered":"2024-04-17T08:46:22.806843+0000","last_unstale":"2024-04-17T17:52:01.899694+0000","last_undegraded":"2024-04-17T17:52:01.899694+0000","last_fullsized":"2024-04-17T17:52:01.899694+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'119","last_scrub_stamp":"2024-04-17T17:52:01.899625+0000","last_deep_scrub":"43'119","last_deep_scrub_stamp":"2024-04-17T17:52:01.899625+0000","last_clean_scrub_stamp":"2024-04-17T17:52:01.899625+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:00:12.528550+0000","scrub_duration":231,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834581400,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1541116,"kb_used_data":1076,"kb_used_omap":548,"kb_used_meta":1539483,"kb_avail":92830724,"statfs":{"total":96636764160,"available":95058661376,"internally_reserved":0,"allocated":1101824,"data_stored":812163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":561386,"internal_metadata":1576431382},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834581402,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1647420,"kb_used_data":496,"kb_used_omap":648,"kb_used_meta":1646263,"kb_avail":92724420,"statfs":{"total":96636764160,"available":94949806080,"internally_reserved":0,"allocated":507904,"data_stored":221795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":664377,"internal_metadata":1685773511},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834581400,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1300856,"kb_used_data":496,"kb_used_omap":755,"kb_used_meta":1299596,"kb_avail":93070984,"statfs":{"total":96636764160,"available":95304687616,"internally_reserved":0,"allocated":507904,"data_stored":221795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":773576,"internal_metadata":1330786872},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834581402,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1759740,"kb_used_data":496,"kb_used_omap":1137,"kb_used_meta":1758094,"kb_avail":92612100,"statfs":{"total":96636764160,"available":94834790400,"internally_reserved":0,"allocated":507904,"data_stored":221795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1164464,"internal_metadata":1800289104},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834581343,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1673400,"kb_used_data":496,"kb_used_omap":255,"kb_used_meta":1672640,"kb_avail":92698440,"statfs":{"total":96636764160,"available":94923202560,"internally_reserved":0,"allocated":507904,"data_stored":221795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":261991,"internal_metadata":1712783513},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834581350,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1699000,"kb_used_data":496,"kb_used_omap":276,"kb_used_meta":1698219,"kb_avail":92672840,"statfs":{"total":96636764160,"available":94896988160,"internally_reserved":0,"allocated":507904,"data_stored":221795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":283299,"internal_metadata":1738976605},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834581359,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1499320,"kb_used_data":496,"kb_used_omap":27,"kb_used_meta":1498788,"kb_avail":92872520,"statfs":{"total":96636764160,"available":95101460480,"internally_reserved":0,"allocated":507904,"data_stored":221795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28320,"internal_metadata":1534759264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834581350,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1434364,"kb_used_data":1076,"kb_used_omap":273,"kb_used_meta":1433006,"kb_avail":92937476,"statfs":{"total":96636764160,"available":95167975424,"internally_reserved":0,"allocated":1101824,"data_stored":812163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":279577,"internal_metadata":1467399143},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T17:52:23.378 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-17T17:52:23.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.774+0000 7f8d2c400640 1 Processor -- start 2024-04-17T17:52:23.778 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.774+0000 7f8d2c400640 1 -- start start 2024-04-17T17:52:23.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.778+0000 7f8d2c400640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f8d2406d450 0x7f8d2415d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:52:23.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.778+0000 7f8d2c400640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d2415d8f0 con 0x7f8d2406d070 2024-04-17T17:52:23.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.778+0000 7f8d2c400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d240cdd70 con 0x7f8d24073420 2024-04-17T17:52:23.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.778+0000 7f8d2c400640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f8d240ce050 con 0x7f8d2406d450 2024-04-17T17:52:23.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.778+0000 7f8d29000640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f8d24073420 0x7f8d2415cbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.152:41926/0 (socket says 172.21.15.152:41926) 2024-04-17T17:52:23.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.778+0000 7f8d29000640 1 -- 172.21.15.152:0/4063787727 learned_addr learned my addr 172.21.15.152:0/4063787727 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T17:52:23.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.778+0000 7f8d2a400640 1 --2- 172.21.15.152:0/4063787727 >> v2:172.21.15.152:3300/0 conn(0x7f8d2406d450 0x7f8d2415d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:52:23.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.778+0000 7f8d23e00640 1 -- 172.21.15.152:0/4063787727 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1297990790 0 0) 0x7f8d240cdd70 con 0x7f8d24073420 2024-04-17T17:52:23.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.778+0000 7f8d23e00640 1 -- 172.21.15.152:0/4063787727 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d0c003530 con 0x7f8d24073420 2024-04-17T17:52:23.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.778+0000 7f8d2a400640 1 -- 172.21.15.152:0/4063787727 >> v1:172.21.15.196:6789/0 conn(0x7f8d24073420 legacy=0x7f8d2415cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:52:23.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.778+0000 7f8d2a400640 1 -- 172.21.15.152:0/4063787727 >> v1:172.21.15.152:6789/0 conn(0x7f8d2406d070 legacy=0x7f8d24072d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:52:23.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.778+0000 7f8d23e00640 1 -- 172.21.15.152:0/4063787727 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3017379706 0 0) 0x7f8d2415d8f0 con 0x7f8d2406d070 2024-04-17T17:52:23.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.778+0000 7f8d2a400640 1 -- 172.21.15.152:0/4063787727 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d240ce330 con 0x7f8d2406d450 2024-04-17T17:52:23.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.786+0000 7f8d2a400640 1 --2- 172.21.15.152:0/4063787727 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d2406d450 0x7f8d2415d2d0 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c009d90 tx=0x7f8d1c01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c4066247ee48f75 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:52:23.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.790+0000 7f8d23e00640 1 -- 172.21.15.152:0/4063787727 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c0b2070 con 0x7f8d2406d450 2024-04-17T17:52:23.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.790+0000 7f8d23e00640 1 -- 172.21.15.152:0/4063787727 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d1c0a59a0 con 0x7f8d2406d450 2024-04-17T17:52:23.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.790+0000 7f8d23e00640 1 -- 172.21.15.152:0/4063787727 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c0a5d70 con 0x7f8d2406d450 2024-04-17T17:52:23.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.790+0000 7f8d2c400640 1 -- 172.21.15.152:0/4063787727 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d2406d450 msgr2=0x7f8d2415d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:52:23.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.790+0000 7f8d2c400640 1 --2- 172.21.15.152:0/4063787727 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d2406d450 0x7f8d2415d2d0 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c009d90 tx=0x7f8d1c01c940 comp rx=0 tx=0).stop 2024-04-17T17:52:23.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.790+0000 7f8d2c400640 1 -- 172.21.15.152:0/4063787727 shutdown_connections 2024-04-17T17:52:23.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.790+0000 7f8d2c400640 1 --2- 172.21.15.152:0/4063787727 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d2406d450 0x7f8d2415d2d0 unknown :-1 s=CLOSED pgs=2087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:52:23.795 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.790+0000 7f8d2c400640 1 -- 172.21.15.152:0/4063787727 >> 172.21.15.152:0/4063787727 conn(0x7f8d240b31c0 msgr2=0x7f8d240b35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:52:23.795 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.790+0000 7f8d2c400640 1 -- 172.21.15.152:0/4063787727 shutdown_connections 2024-04-17T17:52:23.795 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.790+0000 7f8d2c400640 1 -- 172.21.15.152:0/4063787727 wait complete. 2024-04-17T17:52:23.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.794+0000 7f8d2c400640 1 Processor -- start 2024-04-17T17:52:23.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.794+0000 7f8d2c400640 1 -- start start 2024-04-17T17:52:23.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.798+0000 7f8d2c400640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d2406d070 0x7f8d2414a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:52:23.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.798+0000 7f8d2c400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8d2406d450 0x7f8d2415b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:52:23.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.798+0000 7f8d2c400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8d24073420 0x7f8d2415bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:52:23.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.798+0000 7f8d2c400640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8d24169c10 con 0x7f8d2406d070 2024-04-17T17:52:23.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.798+0000 7f8d2c400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8d240ced40 con 0x7f8d24073420 2024-04-17T17:52:23.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.798+0000 7f8d2c400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f8d24169d90 con 0x7f8d2406d450 2024-04-17T17:52:23.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.798+0000 7f8d29a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d2406d070 0x7f8d2414a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:52:23.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.798+0000 7f8d29a00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d2406d070 0x7f8d2414a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43238/0 (socket says 172.21.15.152:43238) 2024-04-17T17:52:23.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.798+0000 7f8d29a00640 1 -- 172.21.15.152:0/2654297333 learned_addr learned my addr 172.21.15.152:0/2654297333 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T17:52:23.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.798+0000 7f8d29000640 1 --2- 172.21.15.152:0/2654297333 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8d2406d450 0x7f8d2415b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:52:23.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.798+0000 7f8d2a400640 1 --2- 172.21.15.152:0/2654297333 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8d24073420 0x7f8d2415bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:52:23.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.798+0000 7f8d29a00640 1 -- 172.21.15.152:0/2654297333 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8d2406d450 msgr2=0x7f8d2415b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:52:23.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.798+0000 7f8d29a00640 1 --2- 172.21.15.152:0/2654297333 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8d2406d450 0x7f8d2415b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:52:23.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.798+0000 7f8d29a00640 1 -- 172.21.15.152:0/2654297333 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8d24073420 msgr2=0x7f8d2415bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:52:23.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.798+0000 7f8d29a00640 1 --2- 172.21.15.152:0/2654297333 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8d24073420 0x7f8d2415bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:52:23.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.798+0000 7f8d29a00640 1 -- 172.21.15.152:0/2654297333 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d241664e0 con 0x7f8d2406d070 2024-04-17T17:52:23.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.798+0000 7f8d2a400640 1 --2- 172.21.15.152:0/2654297333 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8d24073420 0x7f8d2415bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T17:52:23.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.798+0000 7f8d29a00640 1 --2- 172.21.15.152:0/2654297333 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d2406d070 0x7f8d2414a920 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 crypto rx=0x7f8d1800c4b0 tx=0x7f8d1800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:52:23.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.802+0000 7f8d21600640 1 -- 172.21.15.152:0/2654297333 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d18005480 con 0x7f8d2406d070 2024-04-17T17:52:23.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.802+0000 7f8d21600640 1 -- 172.21.15.152:0/2654297333 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d18003600 con 0x7f8d2406d070 2024-04-17T17:52:23.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.802+0000 7f8d2c400640 1 -- 172.21.15.152:0/2654297333 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d240b43f0 con 0x7f8d2406d070 2024-04-17T17:52:23.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.802+0000 7f8d21600640 1 -- 172.21.15.152:0/2654297333 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d180039f0 con 0x7f8d2406d070 2024-04-17T17:52:23.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.802+0000 7f8d2c400640 1 -- 172.21.15.152:0/2654297333 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d240b49b0 con 0x7f8d2406d070 2024-04-17T17:52:23.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.802+0000 7f8d2c400640 1 -- 172.21.15.152:0/2654297333 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d24068a30 con 0x7f8d2406d070 2024-04-17T17:52:23.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.806+0000 7f8d21600640 1 -- 172.21.15.152:0/2654297333 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8d18003b90 con 0x7f8d2406d070 2024-04-17T17:52:23.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.806+0000 7f8d21600640 1 --2- 172.21.15.152:0/2654297333 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8d04068380 0x7f8d0406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:52:23.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.810+0000 7f8d21600640 1 -- 172.21.15.152:0/2654297333 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f8d180864d0 con 0x7f8d2406d070 2024-04-17T17:52:23.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.810+0000 7f8d29000640 1 --2- 172.21.15.152:0/2654297333 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8d04068380 0x7f8d0406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:52:23.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.810+0000 7f8d29000640 1 --2- 172.21.15.152:0/2654297333 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8d04068380 0x7f8d0406a840 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f8d240d1cf0 tx=0x7f8d10007d40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:52:23.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:23.822+0000 7f8d21600640 1 -- 172.21.15.152:0/2654297333 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f8d18056b60 con 0x7f8d2406d070 2024-04-17T17:52:24.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.318+0000 7f8d2c400640 1 -- 172.21.15.152:0/2654297333 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f8d240cd500 con 0x7f8d2406d070 2024-04-17T17:52:24.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.326+0000 7f8d21600640 1 -- 172.21.15.152:0/2654297333 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) ==== 123+0+0 (secure 0 0 0) 0x7f8d18056460 con 0x7f8d2406d070 2024-04-17T17:52:24.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.326+0000 7f8d21600640 1 -- 172.21.15.152:0/2654297333 <== mon.0 v2:172.21.15.152:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8d1805a810 con 0x7f8d2406d070 2024-04-17T17:52:24.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.330+0000 7f8d2c400640 1 -- 172.21.15.152:0/2654297333 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8d04068380 msgr2=0x7f8d0406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:52:24.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.330+0000 7f8d2c400640 1 --2- 172.21.15.152:0/2654297333 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8d04068380 0x7f8d0406a840 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f8d240d1cf0 tx=0x7f8d10007d40 comp rx=0 tx=0).stop 2024-04-17T17:52:24.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.330+0000 7f8d2c400640 1 -- 172.21.15.152:0/2654297333 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d2406d070 msgr2=0x7f8d2414a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:52:24.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.330+0000 7f8d2c400640 1 --2- 172.21.15.152:0/2654297333 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d2406d070 0x7f8d2414a920 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 crypto rx=0x7f8d1800c4b0 tx=0x7f8d1800c970 comp rx=0 tx=0).stop 2024-04-17T17:52:24.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.330+0000 7f8d2c400640 1 -- 172.21.15.152:0/2654297333 shutdown_connections 2024-04-17T17:52:24.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.334+0000 7f8d2c400640 1 --2- 172.21.15.152:0/2654297333 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8d24073420 0x7f8d2415bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:52:24.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.334+0000 7f8d2c400640 1 --2- 172.21.15.152:0/2654297333 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f8d04068380 0x7f8d0406a840 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:52:24.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.334+0000 7f8d2c400640 1 --2- 172.21.15.152:0/2654297333 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8d2406d450 0x7f8d2415b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:52:24.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.334+0000 7f8d2c400640 1 --2- 172.21.15.152:0/2654297333 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d2406d070 0x7f8d2414a920 unknown :-1 s=CLOSED pgs=2088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:52:24.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.334+0000 7f8d2c400640 1 -- 172.21.15.152:0/2654297333 >> 172.21.15.152:0/2654297333 conn(0x7f8d240b31c0 msgr2=0x7f8d240b35a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:52:24.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.334+0000 7f8d2c400640 1 -- 172.21.15.152:0/2654297333 shutdown_connections 2024-04-17T17:52:24.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.334+0000 7f8d2c400640 1 -- 172.21.15.152:0/2654297333 wait complete. 2024-04-17T17:52:24.384 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-17T17:52:24.384 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T17:52:24.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.786+0000 7f5c94000640 1 Processor -- start 2024-04-17T17:52:24.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.786+0000 7f5c94000640 1 -- start start 2024-04-17T17:52:24.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.790+0000 7f5c94000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f5c8c0c7230 0x7f5c8c0c76c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:52:24.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.790+0000 7f5c94000640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c8c0ccbb0 con 0x7f5c8c145ea0 2024-04-17T17:52:24.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.790+0000 7f5c94000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c8c0cce90 con 0x7f5c8c071790 2024-04-17T17:52:24.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.790+0000 7f5c94000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f5c8c0cd170 con 0x7f5c8c0c7230 2024-04-17T17:52:24.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.790+0000 7f5c90c00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f5c8c0c7230 0x7f5c8c0c76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:52:24.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.790+0000 7f5c92000640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f5c8c071790 0x7f5c8c0cd970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.152:41936/0 (socket says 172.21.15.152:41936) 2024-04-17T17:52:24.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.790+0000 7f5c90c00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f5c8c0c7230 0x7f5c8c0c76c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.152:55828/0 (socket says 172.21.15.152:55828) 2024-04-17T17:52:24.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.790+0000 7f5c92000640 1 -- 172.21.15.152:0/670256481 learned_addr learned my addr 172.21.15.152:0/670256481 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-04-17T17:52:24.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.790+0000 7f5c90c00640 1 -- 172.21.15.152:0/670256481 >> v1:172.21.15.196:6789/0 conn(0x7f5c8c071790 legacy=0x7f5c8c0cd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:52:24.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.790+0000 7f5c90c00640 1 -- 172.21.15.152:0/670256481 >> v1:172.21.15.152:6789/0 conn(0x7f5c8c145ea0 legacy=0x7f5c8c0d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:52:24.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.790+0000 7f5c90c00640 1 -- 172.21.15.152:0/670256481 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c8c0cd450 con 0x7f5c8c0c7230 2024-04-17T17:52:24.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.794+0000 7f5c90c00640 1 --2- 172.21.15.152:0/670256481 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5c8c0c7230 0x7f5c8c0c76c0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f5c780097c0 tx=0x7f5c7801c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3261c9959a6c7cb1 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:52:24.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.794+0000 7f5c8be00640 1 -- 172.21.15.152:0/670256481 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c780b0070 con 0x7f5c8c0c7230 2024-04-17T17:52:24.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.794+0000 7f5c8be00640 1 -- 172.21.15.152:0/670256481 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f5c780ab600 con 0x7f5c8c0c7230 2024-04-17T17:52:24.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.794+0000 7f5c8be00640 1 -- 172.21.15.152:0/670256481 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c780ab9f0 con 0x7f5c8c0c7230 2024-04-17T17:52:24.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.794+0000 7f5c94000640 1 -- 172.21.15.152:0/670256481 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5c8c0c7230 msgr2=0x7f5c8c0c76c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:52:24.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.794+0000 7f5c94000640 1 --2- 172.21.15.152:0/670256481 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5c8c0c7230 0x7f5c8c0c76c0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f5c780097c0 tx=0x7f5c7801c410 comp rx=0 tx=0).stop 2024-04-17T17:52:24.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.794+0000 7f5c94000640 1 -- 172.21.15.152:0/670256481 shutdown_connections 2024-04-17T17:52:24.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.794+0000 7f5c94000640 1 --2- 172.21.15.152:0/670256481 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5c8c0c7230 0x7f5c8c0c76c0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:52:24.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.794+0000 7f5c94000640 1 -- 172.21.15.152:0/670256481 >> 172.21.15.152:0/670256481 conn(0x7f5c8c0d2350 msgr2=0x7f5c8c0d2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:52:24.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.794+0000 7f5c94000640 1 -- 172.21.15.152:0/670256481 shutdown_connections 2024-04-17T17:52:24.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.794+0000 7f5c94000640 1 -- 172.21.15.152:0/670256481 wait complete. 2024-04-17T17:52:24.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.798+0000 7f5c94000640 1 Processor -- start 2024-04-17T17:52:24.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.802+0000 7f5c94000640 1 -- start start 2024-04-17T17:52:24.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.802+0000 7f5c94000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5c8c071790 0x7f5c8c141b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:52:24.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.802+0000 7f5c94000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c8c0c7230 0x7f5c8c0b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:52:24.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.802+0000 7f5c94000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5c8c145ea0 0x7f5c8c0b6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:52:24.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.802+0000 7f5c94000640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5c8c071fb0 con 0x7f5c8c0c7230 2024-04-17T17:52:24.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.802+0000 7f5c94000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f5c8c16acb0 con 0x7f5c8c071790 2024-04-17T17:52:24.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.802+0000 7f5c94000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f5c8c142070 con 0x7f5c8c145ea0 2024-04-17T17:52:24.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.802+0000 7f5c90c00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c8c0c7230 0x7f5c8c0b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:52:24.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.802+0000 7f5c90c00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c8c0c7230 0x7f5c8c0b64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43246/0 (socket says 172.21.15.152:43246) 2024-04-17T17:52:24.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.802+0000 7f5c90c00640 1 -- 172.21.15.152:0/3748824052 learned_addr learned my addr 172.21.15.152:0/3748824052 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-04-17T17:52:24.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.802+0000 7f5c92000640 1 --2- 172.21.15.152:0/3748824052 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5c8c145ea0 0x7f5c8c0b6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:52:24.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.802+0000 7f5c91600640 1 --2- 172.21.15.152:0/3748824052 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5c8c071790 0x7f5c8c141b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:52:24.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.806+0000 7f5c92000640 1 -- 172.21.15.152:0/3748824052 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5c8c071790 msgr2=0x7f5c8c141b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:52:24.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.806+0000 7f5c92000640 1 --2- 172.21.15.152:0/3748824052 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5c8c071790 0x7f5c8c141b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:52:24.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.806+0000 7f5c92000640 1 -- 172.21.15.152:0/3748824052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c8c0c7230 msgr2=0x7f5c8c0b64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:52:24.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.806+0000 7f5c92000640 1 --2- 172.21.15.152:0/3748824052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c8c0c7230 0x7f5c8c0b64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:52:24.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.806+0000 7f5c92000640 1 -- 172.21.15.152:0/3748824052 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c8c070870 con 0x7f5c8c145ea0 2024-04-17T17:52:24.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.806+0000 7f5c92000640 1 --2- 172.21.15.152:0/3748824052 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5c8c145ea0 0x7f5c8c0b6a20 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f5c8400caa0 tx=0x7f5c8400cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:52:24.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.806+0000 7f5c89600640 1 -- 172.21.15.152:0/3748824052 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c84017070 con 0x7f5c8c145ea0 2024-04-17T17:52:24.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.806+0000 7f5c89600640 1 -- 172.21.15.152:0/3748824052 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f5c8400ac00 con 0x7f5c8c145ea0 2024-04-17T17:52:24.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.806+0000 7f5c94000640 1 -- 172.21.15.152:0/3748824052 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c8c070b50 con 0x7f5c8c145ea0 2024-04-17T17:52:24.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.806+0000 7f5c89600640 1 -- 172.21.15.152:0/3748824052 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c84012400 con 0x7f5c8c145ea0 2024-04-17T17:52:24.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.806+0000 7f5c94000640 1 -- 172.21.15.152:0/3748824052 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c8c071110 con 0x7f5c8c145ea0 2024-04-17T17:52:24.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.810+0000 7f5c89600640 1 -- 172.21.15.152:0/3748824052 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5c8401a070 con 0x7f5c8c145ea0 2024-04-17T17:52:24.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.806+0000 7f5c94000640 1 -- 172.21.15.152:0/3748824052 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c8c068a30 con 0x7f5c8c145ea0 2024-04-17T17:52:24.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.810+0000 7f5c89600640 1 --2- 172.21.15.152:0/3748824052 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5c6c068380 0x7f5c6c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T17:52:24.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.810+0000 7f5c89600640 1 -- 172.21.15.152:0/3748824052 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f5c840865a0 con 0x7f5c8c145ea0 2024-04-17T17:52:24.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.810+0000 7f5c91600640 1 --2- 172.21.15.152:0/3748824052 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5c6c068380 0x7f5c6c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T17:52:24.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.814+0000 7f5c91600640 1 --2- 172.21.15.152:0/3748824052 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5c6c068380 0x7f5c6c06a840 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c0b70e0 tx=0x7f5c80009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T17:52:24.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:24.814+0000 7f5c89600640 1 -- 172.21.15.152:0/3748824052 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179810 (secure 0 0 0) 0x7f5c840565e0 con 0x7f5c8c145ea0 2024-04-17T17:52:25.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:25.402+0000 7f5c94000640 1 -- 172.21.15.152:0/3748824052 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5c8c0b36c0 con 0x7f5c8c145ea0 2024-04-17T17:52:25.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:25.402+0000 7f5c89600640 1 -- 172.21.15.152:0/3748824052 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+3878 (secure 0 0 0) 0x7f5c8405a8e0 con 0x7f5c8c145ea0 2024-04-17T17:52:25.407 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-04-17T17:52:25.407 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":20,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4973,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6835/1356093111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6833","nonce":1356093111},{"type":"v1","addr":"172.21.15.196:6835","nonce":1356093111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4982,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1048040532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":1048040532},{"type":"v1","addr":"172.21.15.152:6837","nonce":1048040532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5275,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6834/2151645018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":2151645018},{"type":"v1","addr":"172.21.15.196:6834","nonce":2151645018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":9760,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/719218087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":719218087},{"type":"v1","addr":"172.21.15.152:6835","nonce":719218087}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[]} 2024-04-17T17:52:25.408 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 20 2024-04-17T17:52:25.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:25.406+0000 7f5c94000640 1 -- 172.21.15.152:0/3748824052 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5c6c068380 msgr2=0x7f5c6c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:52:25.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:25.406+0000 7f5c94000640 1 --2- 172.21.15.152:0/3748824052 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5c6c068380 0x7f5c6c06a840 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c0b70e0 tx=0x7f5c80009040 comp rx=0 tx=0).stop 2024-04-17T17:52:25.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:25.406+0000 7f5c94000640 1 -- 172.21.15.152:0/3748824052 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5c8c145ea0 msgr2=0x7f5c8c0b6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T17:52:25.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:25.406+0000 7f5c94000640 1 --2- 172.21.15.152:0/3748824052 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5c8c145ea0 0x7f5c8c0b6a20 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f5c8400caa0 tx=0x7f5c8400cf60 comp rx=0 tx=0).stop 2024-04-17T17:52:25.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:25.406+0000 7f5c94000640 1 -- 172.21.15.152:0/3748824052 shutdown_connections 2024-04-17T17:52:25.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:25.406+0000 7f5c94000640 1 --2- 172.21.15.152:0/3748824052 >> [v2:172.21.15.152:6832/3078522445,v1:172.21.15.152:6833/3078522445] conn(0x7f5c6c068380 0x7f5c6c06a840 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:52:25.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:25.406+0000 7f5c94000640 1 --2- 172.21.15.152:0/3748824052 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5c8c145ea0 0x7f5c8c0b6a20 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:52:25.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:25.406+0000 7f5c94000640 1 --2- 172.21.15.152:0/3748824052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c8c0c7230 0x7f5c8c0b64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:52:25.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:25.406+0000 7f5c94000640 1 --2- 172.21.15.152:0/3748824052 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5c8c071790 0x7f5c8c141b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T17:52:25.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:25.406+0000 7f5c94000640 1 -- 172.21.15.152:0/3748824052 >> 172.21.15.152:0/3748824052 conn(0x7f5c8c0d2350 msgr2=0x7f5c8c0d1430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T17:52:25.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:25.410+0000 7f5c94000640 1 -- 172.21.15.152:0/3748824052 shutdown_connections 2024-04-17T17:52:25.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-04-17T17:52:25.410+0000 7f5c94000640 1 -- 172.21.15.152:0/3748824052 wait complete. 2024-04-17T17:52:25.463 DEBUG:tasks.cephfs.filesystem:already dead... 2024-04-17T17:52:25.464 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-17T17:52:25.464 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-17T17:52:25.464 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T17:52:30.288 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:52:30.295 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:52:31.566 INFO:tasks.ceph.mds.a:Stopped 2024-04-17T17:52:31.567 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-17T17:52:31.567 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T17:52:33.336 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2024-04-17T17:52:37.669 INFO:tasks.ceph.mds.c:Stopped 2024-04-17T17:52:37.669 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-17T17:52:37.669 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T17:52:39.746 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-04-17T17:52:39.747 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2024-04-17T17:52:43.771 INFO:tasks.ceph.mds.b:Stopped 2024-04-17T17:52:43.772 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-17T17:52:43.772 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T17:52:46.057 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-04-17T17:52:46.057 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-04-17T17:52:49.874 INFO:tasks.ceph.mds.d:Stopped 2024-04-17T17:52:49.874 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-17T17:52:49.874 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-17T17:52:49.875 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T17:52:52.285 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-04-17T17:52:52.285 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-04-17T17:52:55.976 INFO:tasks.ceph.osd.0:Stopped 2024-04-17T17:52:55.977 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-17T17:52:55.977 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T17:52:58.394 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-04-17T17:52:58.395 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-04-17T17:53:00.428 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:53:00.435 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:53:02.079 INFO:tasks.ceph.osd.1:Stopped 2024-04-17T17:53:02.080 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-17T17:53:02.080 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T17:53:04.403 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-04-17T17:53:04.403 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-04-17T17:53:08.182 INFO:tasks.ceph.osd.2:Stopped 2024-04-17T17:53:08.183 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-17T17:53:08.183 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T17:53:10.312 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-04-17T17:53:10.313 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-04-17T17:53:14.284 INFO:tasks.ceph.osd.3:Stopped 2024-04-17T17:53:14.285 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-17T17:53:14.285 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T17:53:16.120 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-04-17T17:53:16.120 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-04-17T17:53:20.387 INFO:tasks.ceph.osd.4:Stopped 2024-04-17T17:53:20.387 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-17T17:53:20.387 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T17:53:21.826 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-04-17T17:53:21.827 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-04-17T17:53:26.489 INFO:tasks.ceph.osd.5:Stopped 2024-04-17T17:53:26.489 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-17T17:53:26.489 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T17:53:27.532 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-04-17T17:53:30.560 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:53:30.566 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:53:32.590 INFO:tasks.ceph.osd.6:Stopped 2024-04-17T17:53:32.591 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-17T17:53:32.591 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T17:53:33.137 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-04-17T17:53:38.642 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-04-17T17:53:38.643 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-04-17T17:53:38.693 INFO:tasks.ceph.osd.7:Stopped 2024-04-17T17:53:38.694 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-17T17:53:38.694 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-17T17:53:38.694 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T17:53:44.047 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2024-04-17T17:53:44.047 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-04-17T17:53:44.797 INFO:tasks.ceph.mgr.y:Stopped 2024-04-17T17:53:44.797 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-17T17:53:44.798 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T17:53:49.351 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2024-04-17T17:53:49.351 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y has been restored 2024-04-17T17:53:50.899 INFO:tasks.ceph.mgr.x:Stopped 2024-04-17T17:53:50.899 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-17T17:53:50.900 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-17T17:53:50.900 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T17:53:54.553 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-04-17T17:53:54.554 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2024-04-17T17:53:57.002 INFO:tasks.ceph.mon.a:Stopped 2024-04-17T17:53:57.002 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-17T17:53:57.002 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T17:53:59.655 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-04-17T17:53:59.655 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-04-17T17:54:00.792 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:54:00.799 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:54:03.104 INFO:tasks.ceph.mon.b:Stopped 2024-04-17T17:54:03.104 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-17T17:54:03.104 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T17:54:04.656 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-04-17T17:54:04.656 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-04-17T17:54:09.205 INFO:tasks.ceph.mon.c:Stopped 2024-04-17T17:54:09.206 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-17T17:54:09.206 DEBUG:teuthology.orchestra.run.smithi152:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-04-17T17:54:09.437 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi152.front.sepia.ceph.com 2024-04-17T17:54:09.437 DEBUG:teuthology.orchestra.run.smithi152:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-17T17:54:09.657 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-04-17T17:54:09.912 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi152.front.sepia.ceph.com 2024-04-17T17:54:09.912 DEBUG:teuthology.orchestra.run.smithi152:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-17T17:54:10.429 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi152.front.sepia.ceph.com 2024-04-17T17:54:10.429 DEBUG:teuthology.orchestra.run.smithi152:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-17T17:54:10.915 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi152.front.sepia.ceph.com 2024-04-17T17:54:10.915 DEBUG:teuthology.orchestra.run.smithi152:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-17T17:54:11.455 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi196.front.sepia.ceph.com 2024-04-17T17:54:11.455 DEBUG:teuthology.orchestra.run.smithi196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-17T17:54:11.950 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi196.front.sepia.ceph.com 2024-04-17T17:54:11.950 DEBUG:teuthology.orchestra.run.smithi196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-17T17:54:12.299 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi196.front.sepia.ceph.com 2024-04-17T17:54:12.300 DEBUG:teuthology.orchestra.run.smithi196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-17T17:54:12.646 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi196.front.sepia.ceph.com 2024-04-17T17:54:12.646 DEBUG:teuthology.orchestra.run.smithi196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-17T17:54:12.951 INFO:tasks.ceph:Archiving mon data... 2024-04-17T17:54:12.952 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659946/data/mon.a.tgz 2024-04-17T17:54:12.952 DEBUG:teuthology.orchestra.run.smithi152:> mktemp 2024-04-17T17:54:12.973 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/tmp.34TJgMaPAy 2024-04-17T17:54:12.974 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.34TJgMaPAy 2024-04-17T17:54:13.272 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0666 /tmp/tmp.34TJgMaPAy 2024-04-17T17:54:13.391 DEBUG:teuthology.orchestra.remote:smithi152:/tmp/tmp.34TJgMaPAy is 551KB 2024-04-17T17:54:13.479 DEBUG:teuthology.orchestra.run.smithi152:> rm -fr /tmp/tmp.34TJgMaPAy 2024-04-17T17:54:13.499 DEBUG:teuthology.misc:Transferring archived files from smithi196:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659946/data/mon.b.tgz 2024-04-17T17:54:13.500 DEBUG:teuthology.orchestra.run.smithi196:> mktemp 2024-04-17T17:54:13.508 INFO:teuthology.orchestra.run.smithi196.stdout:/tmp/tmp.ENFqeud9VD 2024-04-17T17:54:13.508 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.ENFqeud9VD 2024-04-17T17:54:13.670 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 0666 /tmp/tmp.ENFqeud9VD 2024-04-17T17:54:13.775 DEBUG:teuthology.orchestra.remote:smithi196:/tmp/tmp.ENFqeud9VD is 557KB 2024-04-17T17:54:13.835 DEBUG:teuthology.orchestra.run.smithi196:> rm -fr /tmp/tmp.ENFqeud9VD 2024-04-17T17:54:13.845 DEBUG:teuthology.misc:Transferring archived files from smithi196:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659946/data/mon.c.tgz 2024-04-17T17:54:13.845 DEBUG:teuthology.orchestra.run.smithi196:> mktemp 2024-04-17T17:54:13.895 INFO:teuthology.orchestra.run.smithi196.stdout:/tmp/tmp.BwQtf3AH8X 2024-04-17T17:54:13.895 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.BwQtf3AH8X 2024-04-17T17:54:14.040 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 0666 /tmp/tmp.BwQtf3AH8X 2024-04-17T17:54:14.111 DEBUG:teuthology.orchestra.remote:smithi196:/tmp/tmp.BwQtf3AH8X is 557KB 2024-04-17T17:54:14.178 DEBUG:teuthology.orchestra.run.smithi196:> rm -fr /tmp/tmp.BwQtf3AH8X 2024-04-17T17:54:14.187 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-17T17:54:14.187 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-17T17:54:14.192 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-17T17:54:14.319 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-17T17:54:14.340 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-17T17:54:14.341 INFO:tasks.ceph:Archiving crash dumps... 2024-04-17T17:54:14.342 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659946/remote/smithi152/crash 2024-04-17T17:54:14.343 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-17T17:54:14.414 DEBUG:teuthology.misc:Transferring archived files from smithi196:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659946/remote/smithi196/crash 2024-04-17T17:54:14.415 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-17T17:54:14.433 INFO:tasks.ceph:Shutting down logrotate 2024-04-17T17:54:14.434 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:54:14.440 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T17:54:14.530 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-17T17:54:14.587 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-17T17:54:14.623 INFO:tasks.ceph:Compressing logs... 2024-04-17T17:54:14.623 DEBUG:teuthology.orchestra.run.smithi152:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-17T17:54:14.628 DEBUG:teuthology.orchestra.run.smithi196:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-17T17:54:14.688 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191019.log 2024-04-17T17:54:14.690 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35536.log 2024-04-17T17:54:14.692 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.191019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317311.log 2024-04-17T17:54:14.694 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.460380.log 2024-04-17T17:54:14.696 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.35536.log: /var/log/ceph/ceph-client.admin.317311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105594.log 2024-04-17T17:54:14.698 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.460380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226595.log 2024-04-17T17:54:14.700 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.33137.log 2024-04-17T17:54:14.701 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390061.log 2024-04-17T17:54:14.701 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27679.log 2024-04-17T17:54:14.702 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.1.33137.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-17T17:54:14.703 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39009.log 2024-04-17T17:54:14.704 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.27679.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-17T17:54:14.704 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.33256.log 2024-04-17T17:54:14.704 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27776.log 2024-04-17T17:54:14.705 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.3.33256.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-17T17:54:14.705 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84289.log 2024-04-17T17:54:14.706 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.27776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27751.log 2024-04-17T17:54:14.706 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27800.log 2024-04-17T17:54:14.707 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512653.log 2024-04-17T17:54:14.708 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.27751.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-17T17:54:14.708 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.27800.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-17T17:54:14.709 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321413.log 2024-04-17T17:54:14.709 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27727.log 2024-04-17T17:54:14.710 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27655.log 2024-04-17T17:54:14.710 INFO:teuthology.orchestra.run.smithi196.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.1.33137.log.gz 2024-04-17T17:54:14.711 INFO:teuthology.orchestra.run.smithi196.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.3.33256.log.gz 2024-04-17T17:54:14.711 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.27727.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-17T17:54:14.712 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401958.log 2024-04-17T17:54:14.712 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27631.log 2024-04-17T17:54:14.712 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.27655.log: /var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-17T17:54:14.713 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189295.log 2024-04-17T17:54:14.714 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.27631.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-17T17:54:14.714 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-17T17:54:14.715 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166801.log 2024-04-17T17:54:14.715 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-17T17:54:14.716 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-17T17:54:14.717 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27703.log 2024-04-17T17:54:14.717 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.226595.log: /var/log/ceph/ceph-client.admin.390061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179379.log 2024-04-17T17:54:14.718 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.105594.log: /var/log/ceph/ceph-client.admin.189295.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.191019.log.gz 2024-04-17T17:54:14.719 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.512653.log: 88.6% 79.1% -- replaced with /var/log/ceph/ceph-client.admin.317311.log.gz 2024-04-17T17:54:14.719 INFO:teuthology.orchestra.run.smithi152.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35536.log.gz 2024-04-17T17:54:14.719 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.321413.log: /var/log/ceph/ceph-client.admin.84289.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.512653.log.gz 2024-04-17T17:54:14.720 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.401958.log: /var/log/ceph/ceph-client.admin.166801.log: /var/log/ceph/ceph-client.admin.39009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221356.log 2024-04-17T17:54:14.721 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109877.log 2024-04-17T17:54:14.723 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.179379.log: /var/log/ceph/ceph-client.admin.221356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303587.log 2024-04-17T17:54:14.725 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180254.log 2024-04-17T17:54:14.727 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.109877.log: /var/log/ceph/ceph-client.admin.303587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.431974.log 2024-04-17T17:54:14.727 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.admin.27703.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.27679.log.gz 2024-04-17T17:54:14.728 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498857.log 2024-04-17T17:54:14.729 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.180254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312769.log 2024-04-17T17:54:14.731 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.431974.log: /var/log/ceph/ceph-client.admin.498857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.484283.log 2024-04-17T17:54:14.733 INFO:teuthology.orchestra.run.smithi196.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.27631.log.gz 2024-04-17T17:54:14.733 INFO:teuthology.orchestra.run.smithi196.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.27655.log.gz 2024-04-17T17:54:14.733 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231507.log 2024-04-17T17:54:14.734 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.312769.log: /var/log/ceph/ceph-client.admin.484283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34385.log 2024-04-17T17:54:14.736 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.231507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295000.log 2024-04-17T17:54:14.737 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose 79.1% -- /var/log/ceph/ceph-client.admin.171594.log 2024-04-17T17:54:14.737 INFO:teuthology.orchestra.run.smithi152.stderr: -- replaced with /var/log/ceph/ceph-client.admin.179379.log.gz 2024-04-17T17:54:14.738 INFO:teuthology.orchestra.run.smithi152.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.180254.log.gz 2024-04-17T17:54:14.739 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.295000.log: /var/log/ceph/ceph-client.admin.34385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401537.log 2024-04-17T17:54:14.740 INFO:teuthology.orchestra.run.smithi196.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.27727.log.gz 2024-04-17T17:54:14.740 INFO:teuthology.orchestra.run.smithi196.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.27751.log.gz 2024-04-17T17:54:14.740 INFO:teuthology.orchestra.run.smithi196.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.27703.log.gz 2024-04-17T17:54:14.740 INFO:teuthology.orchestra.run.smithi196.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.27776.log.gz 2024-04-17T17:54:14.740 INFO:teuthology.orchestra.run.smithi196.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.27800.log.gz 2024-04-17T17:54:14.741 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324737.log 2024-04-17T17:54:14.742 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.171594.log: /var/log/ceph/ceph-client.admin.401537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238581.log 2024-04-17T17:54:14.743 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.303587.log.gz 2024-04-17T17:54:14.743 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82059.log 2024-04-17T17:54:14.745 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.238581.log: /var/log/ceph/ceph-client.admin.324737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234389.log 2024-04-17T17:54:14.747 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.82059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499716.log 2024-04-17T17:54:14.749 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.234389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461515.log 2024-04-17T17:54:14.752 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.499716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333771.log 2024-04-17T17:54:14.754 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.461515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37755.log 2024-04-17T17:54:14.756 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.333771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229883.log 2024-04-17T17:54:14.756 INFO:teuthology.orchestra.run.smithi152.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.484283.log.gz 2024-04-17T17:54:14.758 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.37755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77534.log 2024-04-17T17:54:14.759 INFO:teuthology.orchestra.run.smithi152.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.105594.log.gz 2024-04-17T17:54:14.759 INFO:teuthology.orchestra.run.smithi152.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.109877.log.gz 2024-04-17T17:54:14.760 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233156.log 2024-04-17T17:54:14.760 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.229883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234380.log 2024-04-17T17:54:14.761 INFO:teuthology.orchestra.run.smithi152.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.84289.log.gz 2024-04-17T17:54:14.762 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.233156.log: /var/log/ceph/ceph-client.admin.77534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215164.log 2024-04-17T17:54:14.763 INFO:teuthology.orchestra.run.smithi152.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.461515.log.gz 2024-04-17T17:54:14.764 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177635.log 2024-04-17T17:54:14.765 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.234380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212929.log 2024-04-17T17:54:14.765 INFO:teuthology.orchestra.run.smithi152.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.333771.log.gz 2024-04-17T17:54:14.767 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.177635.log: /var/log/ceph/ceph-client.admin.215164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.482363.log 2024-04-17T17:54:14.767 INFO:teuthology.orchestra.run.smithi152.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.221356.log.gz 2024-04-17T17:54:14.768 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385926.log 2024-04-17T17:54:14.769 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.212929.log: 78.9% -- replaced with /var/log/ceph/ceph-client.admin.177635.log.gz 2024-04-17T17:54:14.770 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.482363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386742.log 2024-04-17T17:54:14.772 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.385926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229874.log 2024-04-17T17:54:14.773 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220543.log 2024-04-17T17:54:14.774 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.386742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.510059.log 2024-04-17T17:54:14.775 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.220543.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.234389.log.gz 2024-04-17T17:54:14.776 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.229874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38067.log 2024-04-17T17:54:14.776 INFO:teuthology.orchestra.run.smithi152.stderr: 79.5% -- replaced with /var/log/ceph/ceph-client.admin.189295.log.gz 2024-04-17T17:54:14.777 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.510059.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.401537.log.gz 2024-04-17T17:54:14.777 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35432.log 2024-04-17T17:54:14.779 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424870.log 2024-04-17T17:54:14.779 INFO:teuthology.orchestra.run.smithi152.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.231507.log.gz 2024-04-17T17:54:14.779 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.38067.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.401958.log.gz 2024-04-17T17:54:14.781 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.35432.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.233156.log.gz 2024-04-17T17:54:14.781 INFO:teuthology.orchestra.run.smithi152.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.234380.log.gz 2024-04-17T17:54:14.781 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477833.log 2024-04-17T17:54:14.782 INFO:teuthology.orchestra.run.smithi152.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35432.log.gz 2024-04-17T17:54:14.783 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.424870.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.220543.log.gz 2024-04-17T17:54:14.784 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91997.log 2024-04-17T17:54:14.784 INFO:teuthology.orchestra.run.smithi152.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.499716.log.gz 2024-04-17T17:54:14.786 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327926.log 2024-04-17T17:54:14.786 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.91997.log: /var/log/ceph/ceph-client.admin.477833.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.77534.log.gz 2024-04-17T17:54:14.788 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35380.log 2024-04-17T17:54:14.789 INFO:teuthology.orchestra.run.smithi152.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37755.log.gz 2024-04-17T17:54:14.789 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.480682.log 2024-04-17T17:54:14.790 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.327926.log: /var/log/ceph/ceph-client.admin.35380.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38067.log.gz 2024-04-17T17:54:14.791 INFO:teuthology.orchestra.run.smithi152.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35380.log.gz 2024-04-17T17:54:14.792 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34254.log 2024-04-17T17:54:14.792 INFO:teuthology.orchestra.run.smithi152.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39009.log.gz 2024-04-17T17:54:14.794 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.480682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421105.log 2024-04-17T17:54:14.795 INFO:teuthology.orchestra.run.smithi152.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.327926.log.gz 2024-04-17T17:54:14.796 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.34254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37515.log 2024-04-17T17:54:14.798 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.421105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440792.log 2024-04-17T17:54:14.800 INFO:teuthology.orchestra.run.smithi152.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.215164.log.gz 2024-04-17T17:54:14.801 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.37515.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-17T17:54:14.803 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.440792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98247.log 2024-04-17T17:54:14.804 INFO:teuthology.orchestra.run.smithi152.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37515.log.gz 2024-04-17T17:54:14.805 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127216.log 2024-04-17T17:54:14.806 INFO:teuthology.orchestra.run.smithi152.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34254.log.gz 2024-04-17T17:54:14.807 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.98247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231095.log 2024-04-17T17:54:14.809 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324331.log 2024-04-17T17:54:14.809 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.127216.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.421105.log.gz 2024-04-17T17:54:14.811 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.231095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387152.log 2024-04-17T17:54:14.813 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210852.log 2024-04-17T17:54:14.814 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.324331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.454012.log 2024-04-17T17:54:14.815 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.387152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228239.log 2024-04-17T17:54:14.817 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.454012.log: /var/log/ceph/ceph-client.admin.210852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37175.log 2024-04-17T17:54:14.819 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.228239.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.312769.log.gz 2024-04-17T17:54:14.819 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216828.log 2024-04-17T17:54:14.820 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400907.log 2024-04-17T17:54:14.822 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.216828.log: /var/log/ceph/ceph-client.admin.37175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361091.log 2024-04-17T17:54:14.823 INFO:teuthology.orchestra.run.smithi196.stderr: 94.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-17T17:54:14.823 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.400907.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.324331.log.gz 2024-04-17T17:54:14.824 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.451736.log 2024-04-17T17:54:14.826 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.361091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204279.log 2024-04-17T17:54:14.829 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.451736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39087.log 2024-04-17T17:54:14.831 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37123.log 2024-04-17T17:54:14.831 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.204279.log: /var/log/ceph/ceph-client.admin.39087.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.424870.log.gz 2024-04-17T17:54:14.833 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311553.log 2024-04-17T17:54:14.833 INFO:teuthology.orchestra.run.smithi152.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.171594.log.gz 2024-04-17T17:54:14.834 INFO:teuthology.orchestra.run.smithi152.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.431974.log.gz 2024-04-17T17:54:14.835 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236957.log 2024-04-17T17:54:14.835 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.37123.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.477833.log.gz 2024-04-17T17:54:14.837 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.311553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81193.log 2024-04-17T17:54:14.838 INFO:teuthology.orchestra.run.smithi152.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.216828.log.gz 2024-04-17T17:54:14.839 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.236957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386328.log 2024-04-17T17:54:14.840 INFO:teuthology.orchestra.run.smithi152.stderr: 78.8% -- replaced with /var/log/ceph/ceph-client.admin.226595.log.gz 2024-04-17T17:54:14.840 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185543.log 2024-04-17T17:54:14.842 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.386328.log: /var/log/ceph/ceph-client.admin.81193.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.295000.log.gz 2024-04-17T17:54:14.843 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.445481.log 2024-04-17T17:54:14.843 INFO:teuthology.orchestra.run.smithi152.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.400907.log.gz 2024-04-17T17:54:14.844 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333365.log 2024-04-17T17:54:14.846 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.185543.log: /var/log/ceph/ceph-client.admin.445481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329585.log 2024-04-17T17:54:14.848 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394986.log 2024-04-17T17:54:14.848 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.333365.log: /var/log/ceph/ceph-client.admin.329585.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.480682.log.gz 2024-04-17T17:54:14.849 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37305.log 2024-04-17T17:54:14.851 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.394986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401196.log 2024-04-17T17:54:14.853 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.37305.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37175.log.gz 2024-04-17T17:54:14.854 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36094.log 2024-04-17T17:54:14.856 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.401196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389229.log 2024-04-17T17:54:14.857 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164396.log 2024-04-17T17:54:14.859 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.36094.log: /var/log/ceph/ceph-client.admin.389229.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.212929.log.gz 2024-04-17T17:54:14.859 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250219.log 2024-04-17T17:54:14.860 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303989.log 2024-04-17T17:54:14.862 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.250219.log: /var/log/ceph/ceph-client.admin.164396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86391.log 2024-04-17T17:54:14.863 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.303989.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.440792.log.gz 2024-04-17T17:54:14.864 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.493314.log 2024-04-17T17:54:14.864 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.86391.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.185543.log.gz 2024-04-17T17:54:14.866 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383885.log 2024-04-17T17:54:14.867 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.419350.log 2024-04-17T17:54:14.869 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.383885.log: /var/log/ceph/ceph-client.admin.493314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38680.log 2024-04-17T17:54:14.869 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.419350.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.204279.log.gz 2024-04-17T17:54:14.869 INFO:teuthology.orchestra.run.smithi152.stderr: 78.9% -- replaced with /var/log/ceph/ceph-client.admin.166801.log.gz 2024-04-17T17:54:14.870 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222178.log 2024-04-17T17:54:14.871 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.38680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133189.log 2024-04-17T17:54:14.874 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.222178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104772.log 2024-04-17T17:54:14.874 INFO:teuthology.orchestra.run.smithi152.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.238581.log.gz 2024-04-17T17:54:14.876 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.133189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.445077.log 2024-04-17T17:54:14.877 INFO:teuthology.orchestra.run.smithi152.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.228239.log.gz 2024-04-17T17:54:14.877 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329154.log 2024-04-17T17:54:14.878 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.445077.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.229874.log.gz 2024-04-17T17:54:14.878 INFO:teuthology.orchestra.run.smithi152.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.231095.log.gz 2024-04-17T17:54:14.879 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.104772.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.229883.log.gz 2024-04-17T17:54:14.880 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34150.log 2024-04-17T17:54:14.881 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.432830.log 2024-04-17T17:54:14.882 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.329154.log: /var/log/ceph/ceph-client.admin.34150.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.210852.log.gz 2024-04-17T17:54:14.883 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200634.log 2024-04-17T17:54:14.884 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.432830.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.311553.log.gz 2024-04-17T17:54:14.885 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338971.log 2024-04-17T17:54:14.887 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.200634.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.91997.log.gz 2024-04-17T17:54:14.887 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442049.log 2024-04-17T17:54:14.888 INFO:teuthology.orchestra.run.smithi152.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.250219.log.gz 2024-04-17T17:54:14.889 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34496.log 2024-04-17T17:54:14.891 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.338971.log: /var/log/ceph/ceph-client.admin.442049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299489.log 2024-04-17T17:54:14.891 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.34496.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.303989.log.gz 2024-04-17T17:54:14.892 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168020.log 2024-04-17T17:54:14.893 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.299489.log: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.493314.log.gz 2024-04-17T17:54:14.894 INFO:teuthology.orchestra.run.smithi152.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.383885.log.gz 2024-04-17T17:54:14.894 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392516.log 2024-04-17T17:54:14.896 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420173.log 2024-04-17T17:54:14.898 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.392516.log: /var/log/ceph/ceph-client.admin.168020.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.419350.log.gz 2024-04-17T17:54:14.898 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155462.log 2024-04-17T17:54:14.899 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238987.log 2024-04-17T17:54:14.902 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.155462.log: /var/log/ceph/ceph-client.admin.420173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325635.log 2024-04-17T17:54:14.902 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.385926.log.gz 2024-04-17T17:54:14.904 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.454012.log.gz 2024-04-17T17:54:14.904 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.238987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36302.log 2024-04-17T17:54:14.905 INFO:teuthology.orchestra.run.smithi152.stderr:gzip/var/log/ceph/ceph-client.admin.325635.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.323924.log 2024-04-17T17:54:14.906 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.36302.log: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.387152.log.gz 2024-04-17T17:54:14.906 INFO:teuthology.orchestra.run.smithi152.stderr: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.389229.log.gz 2024-04-17T17:54:14.907 INFO:teuthology.orchestra.run.smithi152.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34150.log.gz 2024-04-17T17:54:14.908 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.386742.log.gz 2024-04-17T17:54:14.908 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.503996.log 2024-04-17T17:54:14.910 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.323924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.452694.log 2024-04-17T17:54:14.910 INFO:teuthology.orchestra.run.smithi152.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.390061.log.gz 2024-04-17T17:54:14.911 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.503996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.454824.log 2024-04-17T17:54:14.912 INFO:teuthology.orchestra.run.smithi152.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37123.log.gz 2024-04-17T17:54:14.913 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.452694.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37305.log.gz 2024-04-17T17:54:14.914 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136328.log 2024-04-17T17:54:14.915 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.454824.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38680.log.gz 2024-04-17T17:54:14.915 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.508319.log 2024-04-17T17:54:14.916 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.136328.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36094.log.gz 2024-04-17T17:54:14.917 INFO:teuthology.orchestra.run.smithi152.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36302.log.gz 2024-04-17T17:54:14.917 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156677.log 2024-04-17T17:54:14.919 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.508319.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.98247.log.gz 2024-04-17T17:54:14.919 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498000.log 2024-04-17T17:54:14.921 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101925.log 2024-04-17T17:54:14.922 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.498000.log: /var/log/ceph/ceph-client.admin.156677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172453.log 2024-04-17T17:54:14.924 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224916.log 2024-04-17T17:54:14.924 INFO:teuthology.orchestra.run.smithi152.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.81193.log.gz 2024-04-17T17:54:14.926 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.172453.log: /var/log/ceph/ceph-client.admin.101925.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.401196.log.gz 2024-04-17T17:54:14.926 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243525.log 2024-04-17T17:54:14.926 INFO:teuthology.orchestra.run.smithi152.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39087.log.gz 2024-04-17T17:54:14.928 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.224916.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.329585.log.gz 2024-04-17T17:54:14.928 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.296225.log 2024-04-17T17:54:14.930 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.462775.log 2024-04-17T17:54:14.931 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.243525.log: /var/log/ceph/ceph-client.admin.296225.log: 81.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.333365.log.gz -5 2024-04-17T17:54:14.931 INFO:teuthology.orchestra.run.smithi152.stderr: --verbose -- /var/log/ceph/ceph-client.admin.192632.log 2024-04-17T17:54:14.932 INFO:teuthology.orchestra.run.smithi152.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.386328.log.gz 2024-04-17T17:54:14.933 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.462775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224111.log 2024-04-17T17:54:14.933 INFO:teuthology.orchestra.run.smithi152.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34496.log.gz 2024-04-17T17:54:14.935 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.192632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38957.log 2024-04-17T17:54:14.935 INFO:teuthology.orchestra.run.smithi152.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.34385.log.gz 2024-04-17T17:54:14.936 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234795.log 2024-04-17T17:54:14.937 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.224111.log: /var/log/ceph/ceph-client.admin.38957.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.224916.log.gz 2024-04-17T17:54:14.937 INFO:teuthology.orchestra.run.smithi152.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.86391.log.gz 2024-04-17T17:54:14.938 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306160.log 2024-04-17T17:54:14.939 INFO:teuthology.orchestra.run.smithi152.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.323924.log.gz 2024-04-17T17:54:14.940 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.234795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295407.log 2024-04-17T17:54:14.941 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94502.log 2024-04-17T17:54:14.942 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.306160.log: /var/log/ceph/ceph-client.admin.295407.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.238987.log.gz 2024-04-17T17:54:14.943 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424058.log 2024-04-17T17:54:14.945 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.94502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437008.log 2024-04-17T17:54:14.945 INFO:teuthology.orchestra.run.smithi152.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38957.log.gz 2024-04-17T17:54:14.946 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.236957.log.gz 2024-04-17T17:54:14.946 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251542.log 2024-04-17T17:54:14.947 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.424058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38522.log 2024-04-17T17:54:14.947 INFO:teuthology.orchestra.run.smithi152.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.338971.log.gz 2024-04-17T17:54:14.949 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.251542.log: /var/log/ceph/ceph-client.admin.437008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360689.log 2024-04-17T17:54:14.951 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299082.log 2024-04-17T17:54:14.952 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.38522.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.394986.log.gz 2024-04-17T17:54:14.953 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96539.log 2024-04-17T17:54:14.954 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.360689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319363.log 2024-04-17T17:54:14.956 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.299082.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.325635.log.gz 2024-04-17T17:54:14.956 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.96539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306565.log 2024-04-17T17:54:14.956 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495031.log 2024-04-17T17:54:14.958 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.306565.log: /var/log/ceph/ceph-client.admin.319363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.489065.log 2024-04-17T17:54:14.960 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107327.log 2024-04-17T17:54:14.960 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.495031.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.420173.log.gz 2024-04-17T17:54:14.961 INFO:teuthology.orchestra.run.smithi152.stderr: 77.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.437008.log.gz -5 --verbose 2024-04-17T17:54:14.961 INFO:teuthology.orchestra.run.smithi152.stderr: -- /var/log/ceph/ceph-client.admin.105182.log 2024-04-17T17:54:14.961 INFO:teuthology.orchestra.run.smithi152.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.445481.log.gz 2024-04-17T17:54:14.962 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.107327.log: /var/log/ceph/ceph-client.admin.489065.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.451736.log.gz 2024-04-17T17:54:14.963 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471897.log 2024-04-17T17:54:14.963 INFO:teuthology.orchestra.run.smithi152.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.94502.log.gz 2024-04-17T17:54:14.963 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379305.log 2024-04-17T17:54:14.965 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.471897.log: /var/log/ceph/ceph-client.admin.105182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478240.log 2024-04-17T17:54:14.967 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-17T17:54:14.967 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.379305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252026.log 2024-04-17T17:54:14.969 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.478240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195671.log 2024-04-17T17:54:14.970 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.155462.log.gz 2024-04-17T17:54:14.971 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.252026.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.224111.log.gz 2024-04-17T17:54:14.971 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159189.log 2024-04-17T17:54:14.971 INFO:teuthology.orchestra.run.smithi152.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.156677.log.gz 2024-04-17T17:54:14.973 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82515.log 2024-04-17T17:54:14.973 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.195671.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.172453.log.gz 2024-04-17T17:54:14.973 INFO:teuthology.orchestra.run.smithi152.stderr: 79.1% -- replaced with /var/log/ceph/ceph-client.admin.96539.log.gz 2024-04-17T17:54:14.975 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.159189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320993.log 2024-04-17T17:54:14.977 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212082.log 2024-04-17T17:54:14.977 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.82515.log: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.192632.log.gz 2024-04-17T17:54:14.978 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.320993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303578.log 2024-04-17T17:54:14.979 INFO:teuthology.orchestra.run.smithi152.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.200634.log.gz 2024-04-17T17:54:14.980 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390882.log 2024-04-17T17:54:14.981 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457736.log 2024-04-17T17:54:14.983 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.212082.log: /var/log/ceph/ceph-client.admin.390882.log: /var/log/ceph/ceph-client.admin.303578.log: gzip -5 --verbose 90.2% -- /var/log/ceph/ceph-client.admin.174597.log 2024-04-17T17:54:14.983 INFO:teuthology.orchestra.run.smithi152.stderr: -- replaced with /var/log/ceph/ceph-client.admin.306160.log.gz 2024-04-17T17:54:14.984 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.457736.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.360689.log.gz 2024-04-17T17:54:14.984 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442916.log 2024-04-17T17:54:14.986 INFO:teuthology.orchestra.run.smithi152.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.361091.log.gz 2024-04-17T17:54:14.986 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38574.log 2024-04-17T17:54:14.987 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.174597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220953.log 2024-04-17T17:54:14.988 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.38574.log: /var/log/ceph/ceph-client.admin.442916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367592.log 2024-04-17T17:54:14.989 INFO:teuthology.orchestra.run.smithi152.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38522.log.gz 2024-04-17T17:54:14.990 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411296.log 2024-04-17T17:54:14.992 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.220953.log: /var/log/ceph/ceph-client.admin.367592.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.168020.log.gz 2024-04-17T17:54:14.992 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.296631.log 2024-04-17T17:54:14.994 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299091.log 2024-04-17T17:54:14.994 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.411296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237363.log 2024-04-17T17:54:14.997 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.299091.log: /var/log/ceph/ceph-client.admin.296631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236551.log 2024-04-17T17:54:14.998 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82050.log 2024-04-17T17:54:15.000 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.237363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439933.log 2024-04-17T17:54:15.002 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.236551.log: /var/log/ceph/ceph-client.admin.82050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36120.log 2024-04-17T17:54:15.002 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107789.log 2024-04-17T17:54:15.003 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.36120.log: 77.9%/var/log/ceph/ceph-client.admin.439933.log: -- replaced with /var/log/ceph/ceph-client.admin.299489.log.gz 2024-04-17T17:54:15.004 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 84.1% --verbose -- replaced with /var/log/ceph/ceph-client.admin.104772.log.gz -- 2024-04-17T17:54:15.004 INFO:teuthology.orchestra.run.smithi152.stderr: /var/log/ceph/ceph-client.admin.311139.log 2024-04-17T17:54:15.006 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187183.log 2024-04-17T17:54:15.008 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.107789.log: /var/log/ceph/ceph-client.admin.311139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254099.log 2024-04-17T17:54:15.008 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396127.log 2024-04-17T17:54:15.010 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.187183.log: /var/log/ceph/ceph-client.admin.254099.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.243525.log.gz 2024-04-17T17:54:15.010 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335883.log 2024-04-17T17:54:15.012 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.438713.log 2024-04-17T17:54:15.013 INFO:teuthology.orchestra.run.smithi152.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.127216.log.gz 2024-04-17T17:54:15.014 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.396127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227828.log 2024-04-17T17:54:15.014 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.335883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166275.log 2024-04-17T17:54:15.016 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.227828.log: /var/log/ceph/ceph-client.admin.438713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198165.log 2024-04-17T17:54:15.018 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457727.log 2024-04-17T17:54:15.020 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.166275.log: /var/log/ceph/ceph-client.admin.198165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.428825.log 2024-04-17T17:54:15.022 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112843.log 2024-04-17T17:54:15.023 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.428825.log: /var/log/ceph/ceph-client.admin.457727.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.101925.log.gz 2024-04-17T17:54:15.024 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308670.log 2024-04-17T17:54:15.025 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.112843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35198.log 2024-04-17T17:54:15.025 INFO:teuthology.orchestra.run.smithi152.stderr: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.295407.log.gz 2024-04-17T17:54:15.026 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.308670.log: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.296225.log.gz 2024-04-17T17:54:15.026 INFO:teuthology.orchestra.run.smithi152.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.107327.log.gz 2024-04-17T17:54:15.027 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306556.log 2024-04-17T17:54:15.029 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34972.log 2024-04-17T17:54:15.031 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.35198.log: /var/log/ceph/ceph-client.admin.306556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318946.log 2024-04-17T17:54:15.031 INFO:teuthology.orchestra.run.smithi152.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.220953.log.gz 2024-04-17T17:54:15.032 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.319363.log.gz 2024-04-17T17:54:15.032 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.34972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162666.log 2024-04-17T17:54:15.034 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.318946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37937.log 2024-04-17T17:54:15.034 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.392516.log.gz 2024-04-17T17:54:15.036 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.162666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512927.log 2024-04-17T17:54:15.038 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.37937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172859.log 2024-04-17T17:54:15.038 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.254099.log.gz 2024-04-17T17:54:15.039 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.512927.log: 79.1% -- replaced with /var/log/ceph/ceph-client.admin.308670.log.gz 2024-04-17T17:54:15.040 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.507869.log 2024-04-17T17:54:15.040 INFO:teuthology.orchestra.run.smithi152.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.512927.log.gz 2024-04-17T17:54:15.041 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.504903.log 2024-04-17T17:54:15.042 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.507869.log: /var/log/ceph/ceph-client.admin.172859.log: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.311139.log.gz 2024-04-17T17:54:15.043 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398399.log 2024-04-17T17:54:15.044 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.504903.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.212082.log.gz 2024-04-17T17:54:15.045 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.425285.log 2024-04-17T17:54:15.047 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.398399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.506195.log 2024-04-17T17:54:15.048 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437889.log 2024-04-17T17:54:15.049 INFO:teuthology.orchestra.run.smithi152.stderr: 79.5% -- replaced with /var/log/ceph/ceph-client.admin.303578.log.gz 2024-04-17T17:54:15.050 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.425285.log: /var/log/ceph/ceph-client.admin.506195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93265.log 2024-04-17T17:54:15.053 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.367592.log.gz 2024-04-17T17:54:15.053 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.437889.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.174597.log.gz 2024-04-17T17:54:15.053 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254500.log 2024-04-17T17:54:15.053 INFO:teuthology.orchestra.run.smithi152.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.159189.log.gz 2024-04-17T17:54:15.055 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.93265.log: gzip -5 --verbose -- 81.5% /var/log/ceph/ceph-client.admin.475798.log 2024-04-17T17:54:15.055 INFO:teuthology.orchestra.run.smithi152.stderr: -- replaced with /var/log/ceph/ceph-client.admin.437889.log.gz 2024-04-17T17:54:15.056 INFO:teuthology.orchestra.run.smithi152.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38574.log.gz 2024-04-17T17:54:15.057 INFO:teuthology.orchestra.run.smithi152.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.452694.log.gz 2024-04-17T17:54:15.057 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.500153.log 2024-04-17T17:54:15.057 INFO:teuthology.orchestra.run.smithi152.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.424058.log.gz 2024-04-17T17:54:15.058 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.475798.log: /var/log/ceph/ceph-client.admin.254500.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36120.log.gz 2024-04-17T17:54:15.058 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512875.log 2024-04-17T17:54:15.059 INFO:teuthology.orchestra.run.smithi152.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37937.log.gz 2024-04-17T17:54:15.060 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.500153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426976.log 2024-04-17T17:54:15.062 INFO:teuthology.orchestra.run.smithi152.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.299082.log.gz 2024-04-17T17:54:15.062 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.299091.log.gz 2024-04-17T17:54:15.062 INFO:teuthology.orchestra.run.smithi152.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.105182.log.gz 2024-04-17T17:54:15.062 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.512875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.504005.log 2024-04-17T17:54:15.064 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341272.log 2024-04-17T17:54:15.064 INFO:teuthology.orchestra.run.smithi152.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.512875.log.gz 2024-04-17T17:54:15.064 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.426976.log: /var/log/ceph/ceph-client.admin.504005.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.82050.log.gz 2024-04-17T17:54:15.065 INFO:teuthology.orchestra.run.smithi152.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.478240.log.gz 2024-04-17T17:54:15.066 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96137.log 2024-04-17T17:54:15.067 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194279.log 2024-04-17T17:54:15.068 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.341272.log: /var/log/ceph/ceph-client.admin.96137.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.93265.log.gz 2024-04-17T17:54:15.069 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360269.log 2024-04-17T17:54:15.070 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.454824.log.gz 2024-04-17T17:54:15.072 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.194279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191830.log 2024-04-17T17:54:15.073 INFO:teuthology.orchestra.run.smithi152.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.498000.log.gz 2024-04-17T17:54:15.074 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.360269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.431983.log 2024-04-17T17:54:15.075 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.236551.log.gz 2024-04-17T17:54:15.075 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.432830.log.gz 2024-04-17T17:54:15.076 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.191830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101916.log 2024-04-17T17:54:15.077 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210451.log 2024-04-17T17:54:15.077 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.237363.log.gz 2024-04-17T17:54:15.079 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.101916.log: /var/log/ceph/ceph-client.admin.431983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.444661.log 2024-04-17T17:54:15.080 INFO:teuthology.orchestra.run.smithi152.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.195671.log.gz 2024-04-17T17:54:15.081 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34975.log 2024-04-17T17:54:15.082 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.210451.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.198165.log.gz 2024-04-17T17:54:15.082 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.444661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169443.log 2024-04-17T17:54:15.083 INFO:teuthology.orchestra.run.smithi152.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.306556.log.gz 2024-04-17T17:54:15.083 INFO:teuthology.orchestra.run.smithi152.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.360269.log.gz 2024-04-17T17:54:15.084 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183519.log 2024-04-17T17:54:15.086 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.34975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.492908.log 2024-04-17T17:54:15.086 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.169443.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.442049.log.gz 2024-04-17T17:54:15.087 INFO:teuthology.orchestra.run.smithi152.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.442916.log.gz 2024-04-17T17:54:15.088 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- 81.7% /var/log/ceph/ceph-client.admin.204685.log 2024-04-17T17:54:15.089 INFO:teuthology.orchestra.run.smithi152.stderr: -- replaced with /var/log/ceph/ceph-client.admin.172859.log.gz 2024-04-17T17:54:15.089 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.183519.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.227828.log.gz 2024-04-17T17:54:15.090 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.492908.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.296631.log.gz 2024-04-17T17:54:15.090 INFO:teuthology.orchestra.run.smithi152.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.431983.log.gz 2024-04-17T17:54:15.090 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.450037.log 2024-04-17T17:54:15.091 INFO:teuthology.orchestra.run.smithi152.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.162666.log.gz 2024-04-17T17:54:15.092 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485162.log 2024-04-17T17:54:15.092 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.204685.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.396127.log.gz 2024-04-17T17:54:15.092 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237769.log 2024-04-17T17:54:15.093 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.485162.log: /var/log/ceph/ceph-client.admin.450037.log: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.320993.log.gz 2024-04-17T17:54:15.094 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397996.log 2024-04-17T17:54:15.096 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.502280.log 2024-04-17T17:54:15.097 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.237769.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35198.log.gz 2024-04-17T17:54:15.097 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366741.log/var/log/ceph/ceph-client.admin.397996.log: 2024-04-17T17:54:15.098 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415204.log 2024-04-17T17:54:15.100 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.366741.log: /var/log/ceph/ceph-client.admin.502280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416021.log 2024-04-17T17:54:15.101 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.415204.log: /var/log/ceph/ceph-client.admin.202411.log 2024-04-17T17:54:15.102 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.501012.log 2024-04-17T17:54:15.103 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.379305.log.gz 2024-04-17T17:54:15.104 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.202411.log: /var/log/ceph/ceph-client.admin.416021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182292.log 2024-04-17T17:54:15.105 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.501012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498866.log 2024-04-17T17:54:15.107 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.182292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95325.log 2024-04-17T17:54:15.109 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.498866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38171.log 2024-04-17T17:54:15.111 INFO:teuthology.orchestra.run.smithi152.stderr:gzip/var/log/ceph/ceph-client.admin.95325.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.81184.log 2024-04-17T17:54:15.112 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.38171.log: /var/log/ceph/ceph-client.admin.327050.log 2024-04-17T17:54:15.114 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.81184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193444.log 2024-04-17T17:54:15.115 INFO:teuthology.orchestra.run.smithi152.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.506195.log.gz 2024-04-17T17:54:15.115 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383488.log 2024-04-17T17:54:15.115 INFO:teuthology.orchestra.run.smithi152.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.507869.log.gz 2024-04-17T17:54:15.117 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.327050.log: /var/log/ceph/ceph-client.admin.193444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34784.log 2024-04-17T17:54:15.119 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.383488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491266.log 2024-04-17T17:54:15.119 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.438713.log.gz 2024-04-17T17:54:15.121 INFO:teuthology.orchestra.run.smithi152.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.444661.log.gz 2024-04-17T17:54:15.121 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.34784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36042.log 2024-04-17T17:54:15.123 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.491266.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.439933.log.gz 2024-04-17T17:54:15.123 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370485.log 2024-04-17T17:54:15.124 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.36042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103146.log 2024-04-17T17:54:15.126 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.370485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238978.log 2024-04-17T17:54:15.128 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.103146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36962.log 2024-04-17T17:54:15.130 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342730.log 2024-04-17T17:54:15.132 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.238978.log: /var/log/ceph/ceph-client.admin.36962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241026.log 2024-04-17T17:54:15.133 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.390882.log.gz 2024-04-17T17:54:15.134 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.342730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252017.log 2024-04-17T17:54:15.135 INFO:teuthology.orchestra.run.smithi152.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.398399.log.gz 2024-04-17T17:54:15.136 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.241026.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.411296.log.gz 2024-04-17T17:54:15.137 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414732.log 2024-04-17T17:54:15.137 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.397996.log.gz 2024-04-17T17:54:15.139 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.252017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395388.log 2024-04-17T17:54:15.141 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.414732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207138.log 2024-04-17T17:54:15.143 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.395388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91988.log 2024-04-17T17:54:15.145 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.207138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241423.log 2024-04-17T17:54:15.147 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400069.log 2024-04-17T17:54:15.148 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.91988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339816.log 2024-04-17T17:54:15.149 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.400069.log: /var/log/ceph/ceph-client.admin.241423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138158.log 2024-04-17T17:54:15.151 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.339816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35484.log 2024-04-17T17:54:15.152 INFO:teuthology.orchestra.run.smithi152.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.324737.log.gz 2024-04-17T17:54:15.153 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.138158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33758.log 2024-04-17T17:54:15.154 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105191.log 2024-04-17T17:54:15.156 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.35484.log: gzip/var/log/ceph/ceph-client.admin.33758.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.96548.log 2024-04-17T17:54:15.157 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185960.log 2024-04-17T17:54:15.158 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.96548.log: /var/log/ceph/ceph-client.admin.105191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439924.log 2024-04-17T17:54:15.160 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363649.log 2024-04-17T17:54:15.162 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.185960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302764.log 2024-04-17T17:54:15.163 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.439924.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.383488.log.gz 2024-04-17T17:54:15.164 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98256.log 2024-04-17T17:54:15.164 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.363649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198571.log 2024-04-17T17:54:15.165 INFO:teuthology.orchestra.run.smithi152.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.414732.log.gz 2024-04-17T17:54:15.166 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.98256.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.415204.log.gz 2024-04-17T17:54:15.166 INFO:teuthology.orchestra.run.smithi152.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.426976.log.gz 2024-04-17T17:54:15.166 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.302764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376221.log 2024-04-17T17:54:15.167 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.425285.log.gz 2024-04-17T17:54:15.167 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189304.log 2024-04-17T17:54:15.169 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.198571.log: /var/log/ceph/ceph-client.admin.376221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325644.log 2024-04-17T17:54:15.171 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.189304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160957.log 2024-04-17T17:54:15.171 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.503567.log 2024-04-17T17:54:15.173 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.160957.log: /var/log/ceph/ceph-client.admin.325644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38458.log 2024-04-17T17:54:15.175 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.503567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394174.log 2024-04-17T17:54:15.176 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.488246.log 2024-04-17T17:54:15.178 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.38458.log: /var/log/ceph/ceph-client.admin.394174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36805.log 2024-04-17T17:54:15.179 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.488246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33611.log 2024-04-17T17:54:15.180 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491257.log 2024-04-17T17:54:15.181 INFO:teuthology.orchestra.run.smithi152.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34972.log.gz 2024-04-17T17:54:15.181 INFO:teuthology.orchestra.run.smithi152.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34784.log.gz 2024-04-17T17:54:15.181 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.33611.log: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.318946.log.gz 2024-04-17T17:54:15.182 INFO:teuthology.orchestra.run.smithi152.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34975.log.gz 2024-04-17T17:54:15.182 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.36805.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.366741.log.gz 2024-04-17T17:54:15.183 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.513109.log 2024-04-17T17:54:15.183 INFO:teuthology.orchestra.run.smithi152.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.254500.log.gz 2024-04-17T17:54:15.184 INFO:teuthology.orchestra.run.smithi152.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.210451.log.gz 2024-04-17T17:54:15.186 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.491257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155860.log 2024-04-17T17:54:15.186 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.302764.log.gz 2024-04-17T17:54:15.186 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.513109.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.513109.log.gz 2024-04-17T17:54:15.187 INFO:teuthology.orchestra.run.smithi152.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.107789.log.gz 2024-04-17T17:54:15.188 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244339.log 2024-04-17T17:54:15.189 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37463.log 2024-04-17T17:54:15.190 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.155860.log: /var/log/ceph/ceph-client.admin.244339.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.363649.log.gz 2024-04-17T17:54:15.191 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305339.log 2024-04-17T17:54:15.193 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.37463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424464.log 2024-04-17T17:54:15.195 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.305339.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.182292.log.gz 2024-04-17T17:54:15.196 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.438704.log 2024-04-17T17:54:15.197 INFO:teuthology.orchestra.run.smithi152.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35484.log.gz 2024-04-17T17:54:15.197 INFO:teuthology.orchestra.run.smithi152.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.450037.log.gz 2024-04-17T17:54:15.198 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312760.log 2024-04-17T17:54:15.199 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.424464.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.183519.log.gz 2024-04-17T17:54:15.200 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.438704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189738.log 2024-04-17T17:54:15.201 INFO:teuthology.orchestra.run.smithi152.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37463.log.gz 2024-04-17T17:54:15.202 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.98256.log.gz 2024-04-17T17:54:15.202 INFO:teuthology.orchestra.run.smithi152.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36805.log.gz 2024-04-17T17:54:15.203 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.312760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472949.log 2024-04-17T17:54:15.204 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136319.log 2024-04-17T17:54:15.204 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.189738.log: /var/log/ceph/ceph-client.admin.472949.log: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.475798.log.gz 2024-04-17T17:54:15.206 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196086.log 2024-04-17T17:54:15.207 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385510.log 2024-04-17T17:54:15.208 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.136319.log: /var/log/ceph/ceph-client.admin.196086.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.339816.log.gz 2024-04-17T17:54:15.210 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34522.log 2024-04-17T17:54:15.210 INFO:teuthology.orchestra.run.smithi152.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.327050.log.gz 2024-04-17T17:54:15.212 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.385510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185552.log 2024-04-17T17:54:15.212 INFO:teuthology.orchestra.run.smithi152.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.101916.log.gz 2024-04-17T17:54:15.214 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.34522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251075.log 2024-04-17T17:54:15.214 INFO:teuthology.orchestra.run.smithi152.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.95325.log.gz 2024-04-17T17:54:15.216 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.185552.log: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.492908.log.gz 2024-04-17T17:54:15.216 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108653.log 2024-04-17T17:54:15.217 INFO:teuthology.orchestra.run.smithi152.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.491257.log.gz 2024-04-17T17:54:15.217 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.196086.log.gz 2024-04-17T17:54:15.218 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183916.log 2024-04-17T17:54:15.219 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183925.log 2024-04-17T17:54:15.219 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.251075.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.491266.log.gz 2024-04-17T17:54:15.220 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.183916.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.193444.log.gz 2024-04-17T17:54:15.221 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.108653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242679.log 2024-04-17T17:54:15.221 INFO:teuthology.orchestra.run.smithi152.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.96137.log.gz 2024-04-17T17:54:15.222 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190176.log 2024-04-17T17:54:15.224 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.183925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216837.log 2024-04-17T17:54:15.225 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.242679.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.207138.log.gz 2024-04-17T17:54:15.226 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.190176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84710.log 2024-04-17T17:54:15.228 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178075.log 2024-04-17T17:54:15.228 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.216837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38197.log 2024-04-17T17:54:15.229 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.178075.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.305339.log.gz 2024-04-17T17:54:15.230 INFO:teuthology.orchestra.run.smithi152.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.241423.log.gz 2024-04-17T17:54:15.230 INFO:teuthology.orchestra.run.smithi152.stderr:gzip/var/log/ceph/ceph-client.admin.84710.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.431149.log 2024-04-17T17:54:15.231 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.38197.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.237769.log.gz 2024-04-17T17:54:15.231 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.241026.log.gz 2024-04-17T17:54:15.231 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.185960.log.gz 2024-04-17T17:54:15.233 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495428.log 2024-04-17T17:54:15.233 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.187183.log.gz 2024-04-17T17:54:15.235 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.431149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196492.log 2024-04-17T17:54:15.236 INFO:teuthology.orchestra.run.smithi152.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.342730.log.gz 2024-04-17T17:54:15.238 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.495428.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.191830.log.gz 2024-04-17T17:54:15.238 INFO:teuthology.orchestra.run.smithi152.stderr: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.202411.log.gz 2024-04-17T17:54:15.238 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose 81.0% -- -- replaced with /var/log/ceph/ceph-client.admin.438704.log.gz /var/log/ceph/ceph-client.admin.389636.log 2024-04-17T17:54:15.238 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-04-17T17:54:15.240 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.196492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191010.log 2024-04-17T17:54:15.242 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.389636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300315.log 2024-04-17T17:54:15.243 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35458.log 2024-04-17T17:54:15.244 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.204685.log.gz 2024-04-17T17:54:15.245 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.300315.log: /var/log/ceph/ceph-client.admin.191010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214610.log 2024-04-17T17:54:15.248 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.35458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155056.log 2024-04-17T17:54:15.250 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.214610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374636.log 2024-04-17T17:54:15.252 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.155056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426985.log 2024-04-17T17:54:15.254 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.374636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496271.log 2024-04-17T17:54:15.256 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.426985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427863.log 2024-04-17T17:54:15.257 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479867.log 2024-04-17T17:54:15.259 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.427863.log: /var/log/ceph/ceph-client.admin.496271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138555.log 2024-04-17T17:54:15.261 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.479867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.513291.log 2024-04-17T17:54:15.263 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.138555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413779.log 2024-04-17T17:54:15.266 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.513291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181083.log 2024-04-17T17:54:15.266 INFO:teuthology.orchestra.run.smithi152.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.513291.log.gz 2024-04-17T17:54:15.268 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.413779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.501003.log 2024-04-17T17:54:15.270 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.181083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235227.log 2024-04-17T17:54:15.272 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.501003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449233.log 2024-04-17T17:54:15.274 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.235227.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.495031.log.gz 2024-04-17T17:54:15.275 INFO:teuthology.orchestra.run.smithi152.stderr: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.502280.log.gz 2024-04-17T17:54:15.275 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 83.5% -- replaced with /var/log/ceph/ceph-client.admin.503996.log.gz --verbose 2024-04-17T17:54:15.275 INFO:teuthology.orchestra.run.smithi152.stderr: -- /var/log/ceph/ceph-client.admin.429770.log 2024-04-17T17:54:15.275 INFO:teuthology.orchestra.run.smithi152.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.510059.log.gz 2024-04-17T17:54:15.276 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.449233.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.389636.log.gz 2024-04-17T17:54:15.277 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361530.log 2024-04-17T17:54:15.279 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.429770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.501441.log 2024-04-17T17:54:15.279 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366320.log 2024-04-17T17:54:15.281 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.501441.log: /var/log/ceph/ceph-client.admin.361530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187992.log 2024-04-17T17:54:15.283 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.366320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37149.log 2024-04-17T17:54:15.285 INFO:teuthology.orchestra.run.smithi152.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.424464.log.gz 2024-04-17T17:54:15.285 INFO:teuthology.orchestra.run.smithi152.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.482363.log.gz 2024-04-17T17:54:15.286 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476205.log 2024-04-17T17:54:15.286 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.187992.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.489065.log.gz 2024-04-17T17:54:15.286 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.37149.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.498857.log.gz 2024-04-17T17:54:15.288 INFO:teuthology.orchestra.run.smithi152.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.503567.log.gz 2024-04-17T17:54:15.288 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179388.log 2024-04-17T17:54:15.289 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.476205.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.488246.log.gz 2024-04-17T17:54:15.289 INFO:teuthology.orchestra.run.smithi152.stderr: 88.8% 89.9% -- replaced with /var/log/ceph/ceph-client.admin.34522.log.gz -- replaced with /var/log/ceph/ceph-client.admin.325644.log.gz 2024-04-17T17:54:15.289 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-04-17T17:54:15.289 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.445077.log.gz 2024-04-17T17:54:15.290 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499725.log 2024-04-17T17:54:15.290 INFO:teuthology.orchestra.run.smithi152.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.108653.log.gz 2024-04-17T17:54:15.293 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.179388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35172.log 2024-04-17T17:54:15.294 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.499725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339386.log 2024-04-17T17:54:15.297 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.35172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469235.log 2024-04-17T17:54:15.297 INFO:teuthology.orchestra.run.smithi152.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.476205.log.gz 2024-04-17T17:54:15.299 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.339386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34773.log 2024-04-17T17:54:15.302 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.469235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330861.log 2024-04-17T17:54:15.303 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.34773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312363.log 2024-04-17T17:54:15.306 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.330861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473771.log 2024-04-17T17:54:15.308 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.312363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.480691.log 2024-04-17T17:54:15.309 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242244.log 2024-04-17T17:54:15.311 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.480691.log: /var/log/ceph/ceph-client.admin.473771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316494.log 2024-04-17T17:54:15.313 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.242244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84719.log 2024-04-17T17:54:15.314 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227837.log 2024-04-17T17:54:15.316 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.316494.log: /var/log/ceph/ceph-client.admin.84719.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-17T17:54:15.317 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478249.log 2024-04-17T17:54:15.319 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.227837.log: /var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192226.log 2024-04-17T17:54:15.322 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.478249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157499.log 2024-04-17T17:54:15.323 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253693.log 2024-04-17T17:54:15.325 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.192226.log: /var/log/ceph/ceph-client.admin.157499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302350.log 2024-04-17T17:54:15.327 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.253693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413361.log 2024-04-17T17:54:15.329 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.302350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410028.log 2024-04-17T17:54:15.331 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.413361.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37149.log.gz 2024-04-17T17:54:15.331 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303998.log 2024-04-17T17:54:15.333 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.410028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373353.log 2024-04-17T17:54:15.334 INFO:teuthology.orchestra.run.smithi152.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.103146.log.gz 2024-04-17T17:54:15.335 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.303998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254919.log 2024-04-17T17:54:15.336 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393768.log 2024-04-17T17:54:15.339 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.373353.log: /var/log/ceph/ceph-client.admin.254919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229472.log 2024-04-17T17:54:15.341 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.393768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181480.log 2024-04-17T17:54:15.342 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365103.log 2024-04-17T17:54:15.344 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.229472.log: /var/log/ceph/ceph-client.admin.181480.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.178075.log.gz 2024-04-17T17:54:15.344 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100706.log 2024-04-17T17:54:15.347 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.365103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.422339.log 2024-04-17T17:54:15.349 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.100706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396778.log 2024-04-17T17:54:15.350 INFO:teuthology.orchestra.run.smithi152.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.187992.log.gz 2024-04-17T17:54:15.351 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.422339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140359.log 2024-04-17T17:54:15.352 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.190176.log.gz 2024-04-17T17:54:15.352 INFO:teuthology.orchestra.run.smithi152.stderr: 78.9% -- replaced with /var/log/ceph/ceph-client.admin.160957.log.gz 2024-04-17T17:54:15.354 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.396778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.489899.log 2024-04-17T17:54:15.355 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96128.log 2024-04-17T17:54:15.357 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.140359.log: /var/log/ceph/ceph-client.admin.489899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415610.log 2024-04-17T17:54:15.360 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.96128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.489483.log 2024-04-17T17:54:15.361 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.501432.log 2024-04-17T17:54:15.363 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.415610.log: /var/log/ceph/ceph-client.admin.489483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132740.log 2024-04-17T17:54:15.365 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.501432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215979.log 2024-04-17T17:54:15.367 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.132740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188869.log 2024-04-17T17:54:15.369 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.215979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176767.log 2024-04-17T17:54:15.371 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.188869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390873.log 2024-04-17T17:54:15.372 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491679.log 2024-04-17T17:54:15.374 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.176767.log: /var/log/ceph/ceph-client.admin.390873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498009.log 2024-04-17T17:54:15.375 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.428825.log.gz 2024-04-17T17:54:15.376 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.491679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332950.log 2024-04-17T17:54:15.376 INFO:teuthology.orchestra.run.smithi152.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.457727.log.gz 2024-04-17T17:54:15.377 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181886.log 2024-04-17T17:54:15.377 INFO:teuthology.orchestra.run.smithi152.stderr: 81.5%/var/log/ceph/ceph-client.admin.498009.log: -- replaced with /var/log/ceph/ceph-client.admin.472949.log.gz 2024-04-17T17:54:15.379 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.332950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398810.log 2024-04-17T17:54:15.380 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35354.log 2024-04-17T17:54:15.382 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.181886.log: /var/log/ceph/ceph-client.admin.398810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423203.log 2024-04-17T17:54:15.383 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239384.log 2024-04-17T17:54:15.385 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.35354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78127.log 2024-04-17T17:54:15.387 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.423203.log: gzip/var/log/ceph/ceph-client.admin.239384.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.428353.log 2024-04-17T17:54:15.387 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365905.log 2024-04-17T17:54:15.388 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.428353.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38197.log.gz 2024-04-17T17:54:15.389 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.78127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383069.log 2024-04-17T17:54:15.391 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36668.log 2024-04-17T17:54:15.391 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.365905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180263.log 2024-04-17T17:54:15.394 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.36668.log: /var/log/ceph/ceph-client.admin.383069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473762.log 2024-04-17T17:54:15.394 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208366.log 2024-04-17T17:54:15.396 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.473762.log: /var/log/ceph/ceph-client.admin.180263.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.495428.log.gz 2024-04-17T17:54:15.397 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233567.log 2024-04-17T17:54:15.397 INFO:teuthology.orchestra.run.smithi152.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.500153.log.gz 2024-04-17T17:54:15.398 INFO:teuthology.orchestra.run.smithi152.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.339386.log.gz 2024-04-17T17:54:15.399 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.208366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479054.log 2024-04-17T17:54:15.401 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109060.log 2024-04-17T17:54:15.404 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.479054.log: /var/log/ceph/ceph-client.admin.233567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360680.log 2024-04-17T17:54:15.404 INFO:teuthology.orchestra.run.smithi152.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.479054.log.gz 2024-04-17T17:54:15.405 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.109060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138564.log 2024-04-17T17:54:15.406 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.429770.log.gz 2024-04-17T17:54:15.408 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.360680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361939.log 2024-04-17T17:54:15.408 INFO:teuthology.orchestra.run.smithi152.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.169443.log.gz 2024-04-17T17:54:15.410 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.138564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308264.log 2024-04-17T17:54:15.411 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376487.log 2024-04-17T17:54:15.413 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.308264.log: /var/log/ceph/ceph-client.admin.361939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474177.log 2024-04-17T17:54:15.414 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.376487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399245.log 2024-04-17T17:54:15.416 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.474177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416465.log 2024-04-17T17:54:15.417 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512627.log 2024-04-17T17:54:15.419 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.416465.log: /var/log/ceph/ceph-client.admin.399245.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.312760.log.gz 2024-04-17T17:54:15.419 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212490.log 2024-04-17T17:54:15.419 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.512627.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.512627.log.gz 2024-04-17T17:54:15.421 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185135.log 2024-04-17T17:54:15.423 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.212490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320574.log 2024-04-17T17:54:15.424 INFO:teuthology.orchestra.run.smithi152.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.81184.log.gz 2024-04-17T17:54:15.426 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.185135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299900.log 2024-04-17T17:54:15.426 INFO:teuthology.orchestra.run.smithi152.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.235227.log.gz 2024-04-17T17:54:15.427 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302359.log 2024-04-17T17:54:15.429 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.320574.log: /var/log/ceph/ceph-client.admin.299900.log: 79.5% -- replaced with /var/log/ceph/ceph-client.admin.385510.log.gz 2024-04-17T17:54:15.429 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362806.log 2024-04-17T17:54:15.431 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.302359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472130.log 2024-04-17T17:54:15.433 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.362806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37594.log 2024-04-17T17:54:15.435 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.472130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310328.log 2024-04-17T17:54:15.437 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.37594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.484747.log 2024-04-17T17:54:15.438 INFO:teuthology.orchestra.run.smithi152.stderr: 79.5% -- replaced with /var/log/ceph/ceph-client.admin.183916.log.gz 2024-04-17T17:54:15.438 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.183925.log.gz 2024-04-17T17:54:15.440 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.310328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411305.log 2024-04-17T17:54:15.440 INFO:teuthology.orchestra.run.smithi152.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.185552.log.gz 2024-04-17T17:54:15.441 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382639.log 2024-04-17T17:54:15.441 INFO:teuthology.orchestra.run.smithi152.stderr: 84.3%/var/log/ceph/ceph-client.admin.484747.log: -- replaced with /var/log/ceph/ceph-client.admin.416465.log.gz 2024-04-17T17:54:15.443 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.411305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.470517.log 2024-04-17T17:54:15.443 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.400069.log.gz 2024-04-17T17:54:15.444 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.382639.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.396778.log.gz 2024-04-17T17:54:15.446 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227015.log 2024-04-17T17:54:15.446 INFO:teuthology.orchestra.run.smithi152.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.426985.log.gz 2024-04-17T17:54:15.448 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.470517.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.410028.log.gz 2024-04-17T17:54:15.448 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384300.log 2024-04-17T17:54:15.450 INFO:teuthology.orchestra.run.smithi152.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.431149.log.gz 2024-04-17T17:54:15.450 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5/var/log/ceph/ceph-client.admin.227015.log: --verbose -- /var/log/ceph/ceph-client.admin.165746.log 2024-04-17T17:54:15.452 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.384300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178509.log 2024-04-17T17:54:15.452 INFO:teuthology.orchestra.run.smithi152.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36962.log.gz 2024-04-17T17:54:15.454 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.165746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.497571.log 2024-04-17T17:54:15.456 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.178509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156280.log 2024-04-17T17:54:15.456 INFO:teuthology.orchestra.run.smithi152.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.365905.log.gz 2024-04-17T17:54:15.457 INFO:teuthology.orchestra.run.smithi152.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.308264.log.gz 2024-04-17T17:54:15.458 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.497571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177644.log 2024-04-17T17:54:15.460 INFO:teuthology.orchestra.run.smithi152.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.310328.log.gz 2024-04-17T17:54:15.460 INFO:teuthology.orchestra.run.smithi152.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.155860.log.gz 2024-04-17T17:54:15.461 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.156280.log: gzip -5 --verbose 81.4% -- -- replaced with /var/log/ceph/ceph-client.admin.299900.log.gz 2024-04-17T17:54:15.461 INFO:teuthology.orchestra.run.smithi152.stderr: /var/log/ceph/ceph-client.admin.167216.log 2024-04-17T17:54:15.462 INFO:teuthology.orchestra.run.smithi152.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.332950.log.gz 2024-04-17T17:54:15.464 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.177644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128088.log 2024-04-17T17:54:15.464 INFO:teuthology.orchestra.run.smithi152.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.140359.log.gz 2024-04-17T17:54:15.465 INFO:teuthology.orchestra.run.smithi152.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.244339.log.gz 2024-04-17T17:54:15.466 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.167216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475807.log 2024-04-17T17:54:15.469 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.128088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239790.log 2024-04-17T17:54:15.470 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95722.log 2024-04-17T17:54:15.471 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.239790.log: /var/log/ceph/ceph-client.admin.475807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456442.log 2024-04-17T17:54:15.473 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.95722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439112.log 2024-04-17T17:54:15.474 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.456442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401206.log 2024-04-17T17:54:15.476 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.439112.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.155056.log.gz 2024-04-17T17:54:15.476 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448812.log 2024-04-17T17:54:15.476 INFO:teuthology.orchestra.run.smithi152.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.181480.log.gz 2024-04-17T17:54:15.476 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.401206.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.181083.log.gz 2024-04-17T17:54:15.477 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375042.log 2024-04-17T17:54:15.478 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.448812.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35458.log.gz 2024-04-17T17:54:15.478 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-17T17:54:15.479 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.375042.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.449233.log.gz 2024-04-17T17:54:15.480 INFO:teuthology.orchestra.run.smithi152.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.475807.log.gz 2024-04-17T17:54:15.481 INFO:teuthology.orchestra.run.smithi152.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38171.log.gz 2024-04-17T17:54:15.481 INFO:teuthology.orchestra.run.smithi152.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.100706.log.gz 2024-04-17T17:54:15.481 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.483875.log 2024-04-17T17:54:15.482 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481518.log 2024-04-17T17:54:15.482 INFO:teuthology.orchestra.run.smithi152.stderr: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.96128.log.gz 2024-04-17T17:54:15.483 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.483875.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.128088.log.gz 2024-04-17T17:54:15.483 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-mon.a.log: gzip 90.0% -5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.109060.log.gz /var/log/ceph/ceph-client.admin.81599.log 2024-04-17T17:54:15.483 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-04-17T17:54:15.485 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.481518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243923.log 2024-04-17T17:54:15.487 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173294.log 2024-04-17T17:54:15.487 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.81599.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.191010.log.gz 2024-04-17T17:54:15.488 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.156280.log.gz 2024-04-17T17:54:15.488 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374645.log 2024-04-17T17:54:15.489 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.243923.log: /var/log/ceph/ceph-client.admin.173294.log: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.360680.log.gz 2024-04-17T17:54:15.490 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426567.log 2024-04-17T17:54:15.490 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.167216.log.gz 2024-04-17T17:54:15.491 INFO:teuthology.orchestra.run.smithi152.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.173294.log.gz 2024-04-17T17:54:15.492 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.451745.log 2024-04-17T17:54:15.492 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.374645.log: /var/log/ceph/ceph-client.admin.426567.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.238978.log.gz 2024-04-17T17:54:15.493 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512901.log 2024-04-17T17:54:15.494 INFO:teuthology.orchestra.run.smithi152.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.306565.log.gz 2024-04-17T17:54:15.496 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.451745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85125.log 2024-04-17T17:54:15.496 INFO:teuthology.orchestra.run.smithi152.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.413361.log.gz 2024-04-17T17:54:15.498 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.492497.log 2024-04-17T17:54:15.499 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.85125.log: /var/log/ceph/ceph-client.admin.512901.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.512901.log.gz 2024-04-17T17:54:15.499 INFO:teuthology.orchestra.run.smithi152.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.93663.log 2024-04-17T17:54:15.500 INFO:teuthology.orchestra.run.smithi152.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.376221.log.gz 2024-04-17T17:54:15.502 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.492497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185144.log 2024-04-17T17:54:15.504 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.93663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.436195.log 2024-04-17T17:54:15.506 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.185144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375051.log 2024-04-17T17:54:15.509 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.436195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417725.log 2024-04-17T17:54:15.509 INFO:teuthology.orchestra.run.smithi152.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.208366.log.gz 2024-04-17T17:54:15.511 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.375051.log: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.423203.log.gz 2024-04-17T17:54:15.511 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.480275.log 2024-04-17T17:54:15.512 INFO:teuthology.orchestra.run.smithi152.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.375042.log.gz 2024-04-17T17:54:15.512 INFO:teuthology.orchestra.run.smithi152.stderr: 78.9% -- replaced with /var/log/ceph/ceph-client.admin.439112.log.gz 2024-04-17T17:54:15.512 INFO:teuthology.orchestra.run.smithi152.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.374636.log.gz 2024-04-17T17:54:15.513 INFO:teuthology.orchestra.run.smithi152.stderr: 83.5% -- replaced with /var/log/ceph/ceph-client.admin.215979.log.gz 2024-04-17T17:54:15.513 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.417725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207544.log 2024-04-17T17:54:15.514 INFO:teuthology.orchestra.run.smithi152.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.374645.log.gz 2024-04-17T17:54:15.514 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.433293.log 2024-04-17T17:54:15.515 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.480275.log: /var/log/ceph/ceph-client.admin.207544.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.239790.log.gz 2024-04-17T17:54:15.516 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92404.log 2024-04-17T17:54:15.518 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154636.log 2024-04-17T17:54:15.518 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.433293.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.243923.log.gz 2024-04-17T17:54:15.518 INFO:teuthology.orchestra.run.smithi152.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.497571.log.gz 2024-04-17T17:54:15.519 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155869.log 2024-04-17T17:54:15.520 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.154636.log: /var/log/ceph/ceph-client.admin.92404.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.136319.log.gz 2024-04-17T17:54:15.520 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363213.log 2024-04-17T17:54:15.522 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311544.log 2024-04-17T17:54:15.524 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.155869.log: 83.7% -- replaced with /var/log/ceph/ceph-client.admin.484747.log.gz 2024-04-17T17:54:15.524 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.363213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.470526.log 2024-04-17T17:54:15.524 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108198.log 2024-04-17T17:54:15.527 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.470526.log: /var/log/ceph/ceph-client.admin.311544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338509.log 2024-04-17T17:54:15.528 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223065.log 2024-04-17T17:54:15.530 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.108198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34730.log 2024-04-17T17:54:15.531 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.338509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34574.log 2024-04-17T17:54:15.531 INFO:teuthology.orchestra.run.smithi152.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.34773.log.gz 2024-04-17T17:54:15.533 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.34730.log: /var/log/ceph/ceph-client.admin.223065.log: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.251075.log.gz 2024-04-17T17:54:15.533 INFO:teuthology.orchestra.run.smithi152.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35172.log.gz 2024-04-17T17:54:15.533 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376173.log 2024-04-17T17:54:15.534 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.453118.log 2024-04-17T17:54:15.536 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.34574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35588.log 2024-04-17T17:54:15.538 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.376173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129331.log 2024-04-17T17:54:15.539 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.453118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441199.log 2024-04-17T17:54:15.541 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.35588.log: gzip/var/log/ceph/ceph-client.admin.129331.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.39139.log 2024-04-17T17:54:15.543 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.441199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170286.log 2024-04-17T17:54:15.543 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.394174.log.gz 2024-04-17T17:54:15.544 INFO:teuthology.orchestra.run.smithi152.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.395388.log.gz 2024-04-17T17:54:15.544 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391293.log 2024-04-17T17:54:15.545 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.39139.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.411305.log.gz 2024-04-17T17:54:15.546 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216395.log 2024-04-17T17:54:15.548 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.170286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156271.log 2024-04-17T17:54:15.549 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.391293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.510068.log 2024-04-17T17:54:15.549 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.417725.log.gz 2024-04-17T17:54:15.550 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.156271.log: /var/log/ceph/ceph-client.admin.216395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397590.log 2024-04-17T17:54:15.551 INFO:teuthology.orchestra.run.smithi152.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.427863.log.gz 2024-04-17T17:54:15.552 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.510068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473364.log 2024-04-17T17:54:15.553 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36590.log 2024-04-17T17:54:15.555 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.397590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331722.log 2024-04-17T17:54:15.556 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.473364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252866.log 2024-04-17T17:54:15.557 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.331722.log: /var/log/ceph/ceph-client.admin.36590.log: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.390873.log.gz 2024-04-17T17:54:15.558 INFO:teuthology.orchestra.run.smithi152.stderr: 79.1% -- replaced with /var/log/ceph/ceph-client.admin.383069.log.gz 2024-04-17T17:54:15.558 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481946.log 2024-04-17T17:54:15.560 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38145.log 2024-04-17T17:54:15.563 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.481946.log: /var/log/ceph/ceph-client.admin.252866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325165.log 2024-04-17T17:54:15.564 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385103.log 2024-04-17T17:54:15.566 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.38145.log: /var/log/ceph/ceph-client.admin.325165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373785.log 2024-04-17T17:54:15.568 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205091.log 2024-04-17T17:54:15.570 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.385103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332959.log 2024-04-17T17:54:15.572 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.373785.log: /var/log/ceph/ceph-client.admin.205091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204676.log 2024-04-17T17:54:15.573 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.332959.log: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.422339.log.gz 2024-04-17T17:54:15.574 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228654.log 2024-04-17T17:54:15.577 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236542.log 2024-04-17T17:54:15.577 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.204676.log: /var/log/ceph/ceph-client.admin.228654.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.207544.log.gz 2024-04-17T17:54:15.578 INFO:teuthology.orchestra.run.smithi152.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.311544.log.gz 2024-04-17T17:54:15.579 INFO:teuthology.orchestra.run.smithi152.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.376173.log.gz 2024-04-17T17:54:15.579 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219667.log 2024-04-17T17:54:15.580 INFO:teuthology.orchestra.run.smithi152.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.189304.log.gz 2024-04-17T17:54:15.581 INFO:teuthology.orchestra.run.smithi152.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.242679.log.gz 2024-04-17T17:54:15.581 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.419766.log 2024-04-17T17:54:15.582 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38875.log 2024-04-17T17:54:15.582 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.332959.log.gz 2024-04-17T17:54:15.583 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.236542.log: /var/log/ceph/ceph-client.admin.419766.log: /var/log/ceph/ceph-client.admin.219667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477427.log 2024-04-17T17:54:15.585 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.419766.log.gz 2024-04-17T17:54:15.585 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.38875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34652.log 2024-04-17T17:54:15.587 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.513371.log 2024-04-17T17:54:15.588 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.477427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326589.log 2024-04-17T17:54:15.588 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.513371.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.485162.log.gz 2024-04-17T17:54:15.589 INFO:teuthology.orchestra.run.smithi152.stderr: 87.8%/var/log/ceph/ceph-client.admin.34652.log: -- replaced with /var/log/ceph/ceph-client.admin.513371.log.gz 2024-04-17T17:54:15.590 INFO:teuthology.orchestra.run.smithi152.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.448812.log.gz 2024-04-17T17:54:15.590 INFO:teuthology.orchestra.run.smithi152.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.480275.log.gz 2024-04-17T17:54:15.590 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159663.log 2024-04-17T17:54:15.593 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.326589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336338.log 2024-04-17T17:54:15.594 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330852.log 2024-04-17T17:54:15.595 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.159663.log: /var/log/ceph/ceph-client.admin.336338.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.39139.log.gz 2024-04-17T17:54:15.596 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240197.log 2024-04-17T17:54:15.596 INFO:teuthology.orchestra.run.smithi152.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36042.log.gz 2024-04-17T17:54:15.597 INFO:teuthology.orchestra.run.smithi152.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.180263.log.gz 2024-04-17T17:54:15.599 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.330852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.455221.log 2024-04-17T17:54:15.600 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254509.log 2024-04-17T17:54:15.601 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.455221.log: /var/log/ceph/ceph-client.admin.240197.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37594.log.gz 2024-04-17T17:54:15.601 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.227015.log.gz 2024-04-17T17:54:15.602 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372485.log 2024-04-17T17:54:15.605 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389238.log 2024-04-17T17:54:15.605 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.254509.log: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.92404.log.gz 2024-04-17T17:54:15.606 INFO:teuthology.orchestra.run.smithi152.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.93663.log.gz 2024-04-17T17:54:15.606 INFO:teuthology.orchestra.run.smithi152.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.236542.log.gz 2024-04-17T17:54:15.606 INFO:teuthology.orchestra.run.smithi152.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.492497.log.gz 2024-04-17T17:54:15.606 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79906.log 2024-04-17T17:54:15.607 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.389238.log: /var/log/ceph/ceph-client.admin.372485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498437.log 2024-04-17T17:54:15.607 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.79906.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.240197.log.gz 2024-04-17T17:54:15.609 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.198571.log.gz 2024-04-17T17:54:15.610 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.228654.log.gz 2024-04-17T17:54:15.610 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392109.log 2024-04-17T17:54:15.611 INFO:teuthology.orchestra.run.smithi152.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.229472.log.gz 2024-04-17T17:54:15.611 INFO:teuthology.orchestra.run.smithi152.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36590.log.gz 2024-04-17T17:54:15.611 INFO:teuthology.orchestra.run.smithi152.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.227837.log.gz 2024-04-17T17:54:15.611 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.205091.log.gz 2024-04-17T17:54:15.612 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316503.log 2024-04-17T17:54:15.613 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.498437.log: /var/log/ceph/ceph-client.admin.392109.log: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.439924.log.gz 2024-04-17T17:54:15.613 INFO:teuthology.orchestra.run.smithi152.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.433293.log.gz 2024-04-17T17:54:15.614 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.451745.log.gz 2024-04-17T17:54:15.615 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93672.log 2024-04-17T17:54:15.617 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.316503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461524.log 2024-04-17T17:54:15.619 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.93672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79443.log 2024-04-17T17:54:15.621 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.461524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391698.log 2024-04-17T17:54:15.621 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.79443.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.375051.log.gz 2024-04-17T17:54:15.623 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297854.log 2024-04-17T17:54:15.625 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.391698.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.204676.log.gz 2024-04-17T17:54:15.626 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224102.log 2024-04-17T17:54:15.626 INFO:teuthology.orchestra.run.smithi196.stderr: 94.6% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-17T17:54:15.628 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.297854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85586.log 2024-04-17T17:54:15.630 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.224102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99478.log 2024-04-17T17:54:15.632 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.138564.log.gz 2024-04-17T17:54:15.633 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.85586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34307.log 2024-04-17T17:54:15.635 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.99478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205497.log 2024-04-17T17:54:15.637 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.34307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313986.log 2024-04-17T17:54:15.639 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.205497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.298260.log 2024-04-17T17:54:15.641 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.313986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334185.log 2024-04-17T17:54:15.642 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109463.log 2024-04-17T17:54:15.644 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.298260.log: /var/log/ceph/ceph-client.admin.334185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232325.log 2024-04-17T17:54:15.646 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.109463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.450926.log 2024-04-17T17:54:15.649 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387563.log 2024-04-17T17:54:15.650 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.232325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138962.log 2024-04-17T17:54:15.652 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.450926.log: /var/log/ceph/ceph-client.admin.387563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.455230.log 2024-04-17T17:54:15.654 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.138962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85116.log 2024-04-17T17:54:15.657 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.455230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386733.log 2024-04-17T17:54:15.659 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495022.log 2024-04-17T17:54:15.661 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.85116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250634.log 2024-04-17T17:54:15.663 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.386733.log: /var/log/ceph/ceph-client.admin.495022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401327.log 2024-04-17T17:54:15.665 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309527.log 2024-04-17T17:54:15.667 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.401327.log: /var/log/ceph/ceph-client.admin.250634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240613.log 2024-04-17T17:54:15.669 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.309527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38119.log 2024-04-17T17:54:15.671 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.240613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174171.log 2024-04-17T17:54:15.673 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.391293.log.gz 2024-04-17T17:54:15.673 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34176.log 2024-04-17T17:54:15.674 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.38119.log: /var/log/ceph/ceph-client.admin.174171.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.428353.log.gz 2024-04-17T17:54:15.675 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139934.log 2024-04-17T17:54:15.677 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.34176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232736.log 2024-04-17T17:54:15.680 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.139934.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.477427.log.gz 2024-04-17T17:54:15.680 INFO:teuthology.orchestra.run.smithi152.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.479867.log.gz 2024-04-17T17:54:15.680 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.507443.log 2024-04-17T17:54:15.681 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.232736.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.483875.log.gz 2024-04-17T17:54:15.682 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313571.log 2024-04-17T17:54:15.682 INFO:teuthology.orchestra.run.smithi152.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.489899.log.gz 2024-04-17T17:54:15.683 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.507443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318125.log 89.7% 2024-04-17T17:54:15.684 INFO:teuthology.orchestra.run.smithi152.stderr: -- replaced with /var/log/ceph/ceph-client.admin.489483.log.gz 2024-04-17T17:54:15.684 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.313571.log: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.416021.log.gz 2024-04-17T17:54:15.686 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.513213.log 2024-04-17T17:54:15.688 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.318125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.504894.log 2024-04-17T17:54:15.690 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.513213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399664.log 2024-04-17T17:54:15.691 INFO:teuthology.orchestra.run.smithi152.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.513213.log.gz 2024-04-17T17:54:15.691 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191425.log 2024-04-17T17:54:15.693 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.504894.log: /var/log/ceph/ceph-client.admin.399664.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.250634.log.gz 2024-04-17T17:54:15.693 INFO:teuthology.orchestra.run.smithi152.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.318125.log.gz 2024-04-17T17:54:15.694 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446767.log 2024-04-17T17:54:15.696 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.191425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410483.log 2024-04-17T17:54:15.697 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101518.log 2024-04-17T17:54:15.697 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.254509.log.gz 2024-04-17T17:54:15.698 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.410483.log: /var/log/ceph/ceph-client.admin.446767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359798.log 2024-04-17T17:54:15.699 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210861.log 2024-04-17T17:54:15.701 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.359798.log: /var/log/ceph/ceph-client.admin.101518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.450477.log 2024-04-17T17:54:15.702 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.210861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219676.log 2024-04-17T17:54:15.703 INFO:teuthology.orchestra.run.smithi152.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.313571.log.gz 2024-04-17T17:54:15.703 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.450477.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.498866.log.gz 2024-04-17T17:54:15.704 INFO:teuthology.orchestra.run.smithi152.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.38875.log.gz 2024-04-17T17:54:15.704 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.326589.log.gz 2024-04-17T17:54:15.705 INFO:teuthology.orchestra.run.smithi152.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.330852.log.gz 2024-04-17T17:54:15.705 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36146.log 2024-04-17T17:54:15.707 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.219676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201538.log 2024-04-17T17:54:15.708 INFO:teuthology.orchestra.run.smithi152.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.456442.log.gz 2024-04-17T17:54:15.709 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132749.log 2024-04-17T17:54:15.709 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.36146.log: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.501012.log.gz 2024-04-17T17:54:15.710 INFO:teuthology.orchestra.run.smithi152.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.436195.log.gz 2024-04-17T17:54:15.710 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423619.log 2024-04-17T17:54:15.712 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.132749.log: /var/log/ceph/ceph-client.admin.201538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34437.log 2024-04-17T17:54:15.714 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.423619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.431560.log 2024-04-17T17:54:15.715 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342255.log 2024-04-17T17:54:15.717 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.431560.log: /var/log/ceph/ceph-client.admin.34437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36198.log 2024-04-17T17:54:15.720 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.342255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343643.log 2024-04-17T17:54:15.721 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5/var/log/ceph/ceph-client.admin.36198.log: --verbose -- /var/log/ceph/ceph-client.admin.225322.log 2024-04-17T17:54:15.723 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.343643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474577.log 2024-04-17T17:54:15.725 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.225322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37542.log 2024-04-17T17:54:15.728 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.474577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456888.log 2024-04-17T17:54:15.730 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.37542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38602.log 2024-04-17T17:54:15.732 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.456888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33426.log 2024-04-17T17:54:15.733 INFO:teuthology.orchestra.run.smithi196.stderr: 94.6% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-17T17:54:15.734 INFO:teuthology.orchestra.run.smithi152.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34176.log.gz 2024-04-17T17:54:15.734 INFO:teuthology.orchestra.run.smithi152.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35354.log.gz 2024-04-17T17:54:15.734 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.38602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103963.log 2024-04-17T17:54:15.736 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.33426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196947.log 2024-04-17T17:54:15.738 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.103963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27539.log 2024-04-17T17:54:15.739 INFO:teuthology.orchestra.run.smithi152.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.101518.log.gz 2024-04-17T17:54:15.740 INFO:teuthology.orchestra.run.smithi152.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36146.log.gz 2024-04-17T17:54:15.741 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.196947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383479.log 2024-04-17T17:54:15.742 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375860.log 2024-04-17T17:54:15.743 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.383479.log: /var/log/ceph/ceph-client.admin.27539.log: 79.9% -- replaced with /var/log/ceph/ceph-client.admin.84710.log.gz 2024-04-17T17:54:15.745 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.138158.log.gz 2024-04-17T17:54:15.745 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253273.log 2024-04-17T17:54:15.747 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.375860.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.105191.log.gz 2024-04-17T17:54:15.747 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448400.log 2024-04-17T17:54:15.749 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85984.log 2024-04-17T17:54:15.751 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.253273.log: /var/log/ceph/ceph-client.admin.448400.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.232325.log.gz 2024-04-17T17:54:15.751 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.191425.log.gz 2024-04-17T17:54:15.751 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.196947.log.gz 2024-04-17T17:54:15.752 INFO:teuthology.orchestra.run.smithi152.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.232736.log.gz 2024-04-17T17:54:15.752 INFO:teuthology.orchestra.run.smithi152.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.361939.log.gzgzip 2024-04-17T17:54:15.752 INFO:teuthology.orchestra.run.smithi152.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.340783.log 2024-04-17T17:54:15.753 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410492.log 2024-04-17T17:54:15.753 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.185144.log.gz 2024-04-17T17:54:15.755 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.340783.log: /var/log/ceph/ceph-client.admin.85984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195265.log 2024-04-17T17:54:15.756 INFO:teuthology.orchestra.run.smithi152.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.410483.log.gz 2024-04-17T17:54:15.756 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.410492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297448.log 2024-04-17T17:54:15.758 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494200.log 2024-04-17T17:54:15.760 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.195265.log: /var/log/ceph/ceph-client.admin.297448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176333.log 2024-04-17T17:54:15.761 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382218.log 2024-04-17T17:54:15.762 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.176333.log: /var/log/ceph/ceph-client.admin.494200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380996.log 2024-04-17T17:54:15.764 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137750.log 2024-04-17T17:54:15.765 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.382218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131013.log 2024-04-17T17:54:15.766 INFO:teuthology.orchestra.run.smithi152.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.164396.log.gz 2024-04-17T17:54:15.768 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.137750.log: /var/log/ceph/ceph-client.admin.380996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412523.log 2024-04-17T17:54:15.769 INFO:teuthology.orchestra.run.smithi152.stderr:gzip 92.3% -5 -- replaced with /var/log/ceph/ceph-client.admin.491679.log.gz --verbose 2024-04-17T17:54:15.769 INFO:teuthology.orchestra.run.smithi152.stderr: -- /var/log/ceph/ceph-client.admin.472958.log 2024-04-17T17:54:15.771 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.131013.log: /var/log/ceph/ceph-client.admin.412523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167614.log 2024-04-17T17:54:15.771 INFO:teuthology.orchestra.run.smithi152.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.498009.log.gz 2024-04-17T17:54:15.773 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.472958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315207.log 2024-04-17T17:54:15.776 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.167614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367152.log 2024-04-17T17:54:15.778 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.315207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109051.log 2024-04-17T17:54:15.780 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.367152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293786.log 2024-04-17T17:54:15.781 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415195.log 2024-04-17T17:54:15.783 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.109051.log: /var/log/ceph/ceph-client.admin.293786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157924.log 2024-04-17T17:54:15.786 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.415195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245204.log 2024-04-17T17:54:15.787 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.497580.log 2024-04-17T17:54:15.789 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.157924.log: /var/log/ceph/ceph-client.admin.245204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393330.log 2024-04-17T17:54:15.792 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.497580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175908.log 2024-04-17T17:54:15.794 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.393330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.506621.log 2024-04-17T17:54:15.796 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.175908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.513057.log 2024-04-17T17:54:15.798 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.506621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392924.log 2024-04-17T17:54:15.800 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.513057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388823.log 2024-04-17T17:54:15.800 INFO:teuthology.orchestra.run.smithi152.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.513057.log.gz 2024-04-17T17:54:15.801 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.392924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308679.log 2024-04-17T17:54:15.804 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.388823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79897.log 2024-04-17T17:54:15.806 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.308679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111589.log 2024-04-17T17:54:15.808 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.79897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206741.log 2024-04-17T17:54:15.809 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.111589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313165.log 2024-04-17T17:54:15.812 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.206741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448821.log 2024-04-17T17:54:15.813 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.430176.log 2024-04-17T17:54:15.816 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.448821.log: /var/log/ceph/ceph-client.admin.313165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33810.log 2024-04-17T17:54:15.818 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.430176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92413.log 2024-04-17T17:54:15.820 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.33810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447182.log 2024-04-17T17:54:15.822 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.92413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.500582.log 2024-04-17T17:54:15.824 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.447182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106883.log 2024-04-17T17:54:15.825 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319769.log 2024-04-17T17:54:15.827 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.106883.log: /var/log/ceph/ceph-client.admin.500582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359807.log 2024-04-17T17:54:15.829 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.319769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382630.log 2024-04-17T17:54:15.831 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.359807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84075.log 2024-04-17T17:54:15.832 INFO:teuthology.orchestra.run.smithi152.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.501441.log.gz 2024-04-17T17:54:15.833 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.382630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463994.log 2024-04-17T17:54:15.834 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.487354.log 2024-04-17T17:54:15.836 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.463994.log: /var/log/ceph/ceph-client.admin.84075.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.389238.log.gz 2024-04-17T17:54:15.837 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99894.log 2024-04-17T17:54:15.838 INFO:teuthology.orchestra.run.smithi152.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.383479.log.gz 2024-04-17T17:54:15.838 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.399664.log.gz 2024-04-17T17:54:15.838 INFO:teuthology.orchestra.run.smithi152.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.499725.log.gz 2024-04-17T17:54:15.840 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.487354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38784.log 2024-04-17T17:54:15.842 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.99894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37989.log 2024-04-17T17:54:15.844 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.38784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44157.log 2024-04-17T17:54:15.846 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.37989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.504455.log 2024-04-17T17:54:15.847 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.44157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161400.log 2024-04-17T17:54:15.849 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.504455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232745.log 2024-04-17T17:54:15.851 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.161400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110717.log 2024-04-17T17:54:15.853 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.232745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178518.log 2024-04-17T17:54:15.855 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.110717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.434170.log 2024-04-17T17:54:15.857 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.178518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427393.log 2024-04-17T17:54:15.859 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.434170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35675.log 2024-04-17T17:54:15.861 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.427393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194868.log 2024-04-17T17:54:15.863 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.35675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34982.log 2024-04-17T17:54:15.865 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99885.log 2024-04-17T17:54:15.865 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.194868.log: /var/log/ceph/ceph-client.admin.34982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512443.log 2024-04-17T17:54:15.867 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.99885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92830.log 2024-04-17T17:54:15.868 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363204.log 2024-04-17T17:54:15.870 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.512443.log: /var/log/ceph/ceph-client.admin.92830.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.512443.log.gz 2024-04-17T17:54:15.871 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36883.log 2024-04-17T17:54:15.873 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.363204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.422780.log 2024-04-17T17:54:15.875 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.36883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238166.log 2024-04-17T17:54:15.876 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.392109.log.gz 2024-04-17T17:54:15.877 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.422780.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.391698.log.gz 2024-04-17T17:54:15.878 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367998.log 2024-04-17T17:54:15.879 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.238166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216386.log 2024-04-17T17:54:15.881 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.367998.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.99894.log.gz 2024-04-17T17:54:15.881 INFO:teuthology.orchestra.run.smithi152.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.473364.log.gz 2024-04-17T17:54:15.882 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337669.log 2024-04-17T17:54:15.883 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90336.log 2024-04-17T17:54:15.885 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.216386.log: /var/log/ceph/ceph-client.admin.337669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241017.log 2024-04-17T17:54:15.888 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.90336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90327.log 2024-04-17T17:54:15.889 INFO:teuthology.orchestra.run.smithi152.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.302350.log.gz 2024-04-17T17:54:15.889 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184729.log 2024-04-17T17:54:15.890 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.241017.log: /var/log/ceph/ceph-client.admin.90327.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.448400.log.gz 2024-04-17T17:54:15.891 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206311.log 2024-04-17T17:54:15.894 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.184729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35562.log 2024-04-17T17:54:15.895 INFO:teuthology.orchestra.run.smithi152.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.38602.log.gz 2024-04-17T17:54:15.895 INFO:teuthology.orchestra.run.smithi152.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.455221.log.gz 2024-04-17T17:54:15.895 INFO:teuthology.orchestra.run.smithi152.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.170286.log.gz 2024-04-17T17:54:15.896 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37227.log 2024-04-17T17:54:15.897 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.35562.log: /var/log/ceph/ceph-client.admin.206311.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.455230.log.gz 2024-04-17T17:54:15.898 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330410.log 2024-04-17T17:54:15.899 INFO:teuthology.orchestra.run.smithi152.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.138962.log.gz 2024-04-17T17:54:15.900 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.37227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163516.log 2024-04-17T17:54:15.901 INFO:teuthology.orchestra.run.smithi152.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.225322.log.gz 2024-04-17T17:54:15.901 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163507.log 2024-04-17T17:54:15.904 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.330410.log: /var/log/ceph/ceph-client.admin.163516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38927.log 2024-04-17T17:54:15.904 INFO:teuthology.orchestra.run.smithi152.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.315207.log.gz 2024-04-17T17:54:15.904 INFO:teuthology.orchestra.run.smithi152.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37227.log.gz 2024-04-17T17:54:15.904 INFO:teuthology.orchestra.run.smithi152.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.78127.log.gz 2024-04-17T17:54:15.905 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.313986.log.gz 2024-04-17T17:54:15.905 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37253.log 2024-04-17T17:54:15.906 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.316503.log.gz 2024-04-17T17:54:15.907 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.38927.log: /var/log/ceph/ceph-client.admin.163507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413788.log 2024-04-17T17:54:15.907 INFO:teuthology.orchestra.run.smithi152.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.85984.log.gz 2024-04-17T17:54:15.908 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.37253.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.184729.log.gz 2024-04-17T17:54:15.909 INFO:teuthology.orchestra.run.smithi152.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.185135.log.gz 2024-04-17T17:54:15.909 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250210.log 2024-04-17T17:54:15.910 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.413788.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.137750.log.gz 2024-04-17T17:54:15.910 INFO:teuthology.orchestra.run.smithi152.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.238166.log.gz 2024-04-17T17:54:15.911 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423610.log 2024-04-17T17:54:15.911 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.359807.log.gz 2024-04-17T17:54:15.912 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.250210.log: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.239384.log.gz 2024-04-17T17:54:15.913 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130606.log 2024-04-17T17:54:15.915 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.423610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80348.log 2024-04-17T17:54:15.917 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234786.log 2024-04-17T17:54:15.917 INFO:teuthology.orchestra.run.smithi152.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.103963.log.gz 2024-04-17T17:54:15.918 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.130606.log: /var/log/ceph/ceph-client.admin.80348.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.156271.log.gz 2024-04-17T17:54:15.919 INFO:teuthology.orchestra.run.smithi152.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.422780.log.gz 2024-04-17T17:54:15.919 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109472.log 2024-04-17T17:54:15.920 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.410492.log.gz 2024-04-17T17:54:15.922 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.234786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478656.log 2024-04-17T17:54:15.922 INFO:teuthology.orchestra.run.smithi152.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.426567.log.gz 2024-04-17T17:54:15.922 INFO:teuthology.orchestra.run.smithi152.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.177644.log.gz 2024-04-17T17:54:15.923 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36250.log 2024-04-17T17:54:15.925 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.478656.log: /var/log/ceph/ceph-client.admin.109472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379296.log 2024-04-17T17:54:15.926 INFO:teuthology.orchestra.run.smithi152.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.504894.log.gz 2024-04-17T17:54:15.927 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307055.log 2024-04-17T17:54:15.927 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.36250.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36883.log.gz 2024-04-17T17:54:15.928 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161834.log 2024-04-17T17:54:15.930 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.379296.log: /var/log/ceph/ceph-client.admin.307055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183113.log 2024-04-17T17:54:15.931 INFO:teuthology.orchestra.run.smithi152.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.474177.log.gz 2024-04-17T17:54:15.931 INFO:teuthology.orchestra.run.smithi152.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.474577.log.gz 2024-04-17T17:54:15.931 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100300.log 2024-04-17T17:54:15.932 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.161834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38732.log 2024-04-17T17:54:15.934 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.100300.log: /var/log/ceph/ceph-client.admin.183113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34978.log 2024-04-17T17:54:15.934 INFO:teuthology.orchestra.run.smithi152.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.27539.log.gz 2024-04-17T17:54:15.936 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318955.log 2024-04-17T17:54:15.937 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412117.log 2024-04-17T17:54:15.937 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.38732.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33426.log.gz 2024-04-17T17:54:15.937 INFO:teuthology.orchestra.run.smithi152.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33758.log.gz 2024-04-17T17:54:15.938 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.318955.log: /var/log/ceph/ceph-client.admin.34978.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.79443.log.gz 2024-04-17T17:54:15.938 INFO:teuthology.orchestra.run.smithi152.stderr: 78.8% -- replaced with /var/log/ceph/ceph-client.admin.90327.log.gz 2024-04-17T17:54:15.939 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- 85.2% /var/log/ceph/ceph-client.admin.222640.log -- replaced with /var/log/ceph/ceph-client.admin.95722.log.gz 2024-04-17T17:54:15.939 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-04-17T17:54:15.941 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.412117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37703.log 2024-04-17T17:54:15.942 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111598.log 2024-04-17T17:54:15.944 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.222640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417309.log 2024-04-17T17:54:15.944 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.37703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37672.log 2024-04-17T17:54:15.946 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.417309.log: /var/log/ceph/ceph-client.admin.111598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172019.log 2024-04-17T17:54:15.947 INFO:teuthology.orchestra.run.smithi152.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.478656.log.gz 2024-04-17T17:54:15.948 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.37672.log: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.399245.log.gz 2024-04-17T17:54:15.949 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200643.log 2024-04-17T17:54:15.949 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.413788.log.gz 2024-04-17T17:54:15.951 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139925.log 2024-04-17T17:54:15.951 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.412117.log.gz 2024-04-17T17:54:15.953 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.172019.log: /var/log/ceph/ceph-client.admin.200643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328332.log 2024-04-17T17:54:15.955 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.139925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190167.log 2024-04-17T17:54:15.957 INFO:teuthology.orchestra.run.smithi152.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.245204.log.gz 2024-04-17T17:54:15.958 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.328332.log: 90.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.293786.log.gz 2024-04-17T17:54:15.958 INFO:teuthology.orchestra.run.smithi152.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.213365.log 2024-04-17T17:54:15.959 INFO:teuthology.orchestra.run.smithi152.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.250210.log.gz 2024-04-17T17:54:15.960 INFO:teuthology.orchestra.run.smithi152.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34978.log.gz 2024-04-17T17:54:15.960 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.190167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207147.log 2024-04-17T17:54:15.960 INFO:teuthology.orchestra.run.smithi152.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.318955.log.gz 2024-04-17T17:54:15.961 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.367998.log.gz 2024-04-17T17:54:15.962 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.213365.log: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.253273.log.gz 2024-04-17T17:54:15.962 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.433302.log 2024-04-17T17:54:15.964 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334591.log 2024-04-17T17:54:15.966 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.207147.log: /var/log/ceph/ceph-client.admin.433302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136806.log 2024-04-17T17:54:15.970 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.508778.log 2024-04-17T17:54:15.971 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.334591.log: /var/log/ceph/ceph-client.admin.136806.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.330410.log.gz 2024-04-17T17:54:15.971 INFO:teuthology.orchestra.run.smithi152.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.504005.log.gz 2024-04-17T17:54:15.971 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.441199.log.gz 2024-04-17T17:54:15.971 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254910.log 2024-04-17T17:54:15.971 INFO:teuthology.orchestra.run.smithi152.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38927.log.gz 2024-04-17T17:54:15.972 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.508778.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.100300.log.gz 2024-04-17T17:54:15.973 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481937.log 2024-04-17T17:54:15.974 INFO:teuthology.orchestra.run.smithi152.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.181886.log.gz 2024-04-17T17:54:15.974 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.254910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309118.log 2024-04-17T17:54:15.976 INFO:teuthology.orchestra.run.smithi152.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.361530.log.gz 2024-04-17T17:54:15.976 INFO:teuthology.orchestra.run.smithi152.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.139934.log.gz 2024-04-17T17:54:15.977 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39061.log 2024-04-17T17:54:15.979 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.481937.log: /var/log/ceph/ceph-client.admin.309118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306151.log 2024-04-17T17:54:15.980 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.39061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37568.log 2024-04-17T17:54:15.982 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.306151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137741.log 2024-04-17T17:54:15.983 INFO:teuthology.orchestra.run.smithi152.stderr:gzip/var/log/ceph/ceph-client.admin.37568.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.417318.log 2024-04-17T17:54:15.985 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.137741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301131.log 2024-04-17T17:54:15.986 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.392924.log.gz 2024-04-17T17:54:15.986 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.393768.log.gz 2024-04-17T17:54:15.986 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.505787.log 2024-04-17T17:54:15.988 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.301131.log: /var/log/ceph/ceph-client.admin.417318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443331.log 2024-04-17T17:54:15.990 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.505787.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.91988.log.gz 2024-04-17T17:54:15.990 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.434650.log 2024-04-17T17:54:15.991 INFO:teuthology.orchestra.run.smithi152.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37253.log.gz 2024-04-17T17:54:15.992 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.443331.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37568.log.gz 2024-04-17T17:54:15.992 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424067.log 2024-04-17T17:54:15.993 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.434650.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37672.log.gz 2024-04-17T17:54:15.994 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225728.log 2024-04-17T17:54:15.994 INFO:teuthology.orchestra.run.smithi152.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.85586.log.gz 2024-04-17T17:54:15.995 INFO:teuthology.orchestra.run.smithi152.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.96548.log.gz 2024-04-17T17:54:15.996 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.424067.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.84719.log.gz 2024-04-17T17:54:15.996 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213356.log 2024-04-17T17:54:15.997 INFO:teuthology.orchestra.run.smithi152.stderr: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.129331.log.gz 2024-04-17T17:54:15.998 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.487787.log 2024-04-17T17:54:16.000 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.225728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481098.log 2024-04-17T17:54:16.000 INFO:teuthology.orchestra.run.smithi152.stderr: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.136806.log.gz 2024-04-17T17:54:16.001 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.213356.log: 79.1% -- replaced with /var/log/ceph/ceph-client.admin.137741.log.gz 2024-04-17T17:54:16.002 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.487787.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.190167.log.gz 2024-04-17T17:54:16.002 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167623.log 2024-04-17T17:54:16.003 INFO:teuthology.orchestra.run.smithi152.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.478249.log.gz 2024-04-17T17:54:16.003 INFO:teuthology.orchestra.run.smithi152.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.172019.log.gz 2024-04-17T17:54:16.004 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.194868.log.gz 2024-04-17T17:54:16.005 INFO:teuthology.orchestra.run.smithi152.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.195265.log.gz 2024-04-17T17:54:16.005 INFO:teuthology.orchestra.run.smithi152.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.213356.log.gz 2024-04-17T17:54:16.005 INFO:teuthology.orchestra.run.smithi152.stderr: 90.0%/var/log/ceph/ceph-client.admin.481098.log: -- replaced with /var/log/ceph/ceph-client.admin.213365.log.gz 2024-04-17T17:54:16.005 INFO:teuthology.orchestra.run.smithi152.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.223065.log.gz 2024-04-17T17:54:16.006 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494191.log 2024-04-17T17:54:16.006 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.161834.log.gz 2024-04-17T17:54:16.006 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.433302.log.gz 2024-04-17T17:54:16.007 INFO:teuthology.orchestra.run.smithi152.stderr: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.80348.log.gz 2024-04-17T17:54:16.007 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33361.log 2024-04-17T17:54:16.008 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.494191.log: /var/log/ceph/ceph-client.admin.167623.log: 79.6% -- replaced with /var/log/ceph/ceph-client.admin.487787.log.gz 2024-04-17T17:54:16.009 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.434650.log.gz 2024-04-17T17:54:16.010 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.487345.log 2024-04-17T17:54:16.010 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.33361.log: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.496271.log.gz 2024-04-17T17:54:16.012 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36486.log 2024-04-17T17:54:16.012 INFO:teuthology.orchestra.run.smithi152.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.505787.log.gz 2024-04-17T17:54:16.012 INFO:teuthology.orchestra.run.smithi152.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.481937.log.gz 2024-04-17T17:54:16.013 INFO:teuthology.orchestra.run.smithi152.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34652.log.gz 2024-04-17T17:54:16.014 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.487345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38327.log 2024-04-17T17:54:16.017 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.36486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169868.log 2024-04-17T17:54:16.018 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512821.log 2024-04-17T17:54:16.019 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.38327.log: /var/log/ceph/ceph-client.admin.169868.log: gzip 80.7% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.328332.log.gz -- /var/log/ceph/ceph-client.admin.361948.log 2024-04-17T17:54:16.019 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-04-17T17:54:16.020 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.512821.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.512821.log.gz 2024-04-17T17:54:16.021 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512979.log 2024-04-17T17:54:16.023 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.361948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33704.log 2024-04-17T17:54:16.025 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.512979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37331.log 2024-04-17T17:54:16.026 INFO:teuthology.orchestra.run.smithi152.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.512979.log.gz 2024-04-17T17:54:16.027 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36936.log 2024-04-17T17:54:16.028 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.33704.log: /var/log/ceph/ceph-client.admin.37331.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-17T17:54:16.029 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.36936.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.384300.log.gz 2024-04-17T17:54:16.030 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.501861.log 2024-04-17T17:54:16.032 INFO:teuthology.orchestra.run.smithi152.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38732.log.gz 2024-04-17T17:54:16.032 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223666.log 2024-04-17T17:54:16.034 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-osd.3.log: gzip/var/log/ceph/ceph-client.admin.501861.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.376230.log 2024-04-17T17:54:16.035 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371177.log 2024-04-17T17:54:16.037 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.223666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202848.log 2024-04-17T17:54:16.037 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.376230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191416.log 2024-04-17T17:54:16.039 INFO:teuthology.orchestra.run.smithi196.stderr: 94.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-17T17:54:16.040 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.202848.log: /var/log/ceph/ceph-client.admin.371177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328341.log 2024-04-17T17:54:16.040 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.415610.log.gz 2024-04-17T17:54:16.041 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.191416.log: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.132749.log.gz 2024-04-17T17:54:16.041 INFO:teuthology.orchestra.run.smithi152.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35562.log.gz 2024-04-17T17:54:16.041 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416871.log 2024-04-17T17:54:16.042 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.424067.log.gz 2024-04-17T17:54:16.043 INFO:teuthology.orchestra.run.smithi152.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.494191.log.gz 2024-04-17T17:54:16.043 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392915.log 2024-04-17T17:54:16.045 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.328341.log: gzip/var/log/ceph/ceph-client.admin.416871.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.36356.log 2024-04-17T17:54:16.045 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.392915.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.494200.log.gz 2024-04-17T17:54:16.047 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240206.log 2024-04-17T17:54:16.049 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132276.log 2024-04-17T17:54:16.049 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.36356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335404.log 2024-04-17T17:54:16.051 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.132276.log: /var/log/ceph/ceph-client.admin.240206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211268.log 2024-04-17T17:54:16.053 INFO:teuthology.orchestra.run.smithi152.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.367152.log.gz 2024-04-17T17:54:16.054 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.335404.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.365103.log.gz 2024-04-17T17:54:16.054 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308273.log 2024-04-17T17:54:16.056 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.211268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236145.log 2024-04-17T17:54:16.058 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.488663.log 2024-04-17T17:54:16.060 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.308273.log: /var/log/ceph/ceph-client.admin.236145.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.254910.log.gz 2024-04-17T17:54:16.060 INFO:teuthology.orchestra.run.smithi152.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.330861.log.gz 2024-04-17T17:54:16.061 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375869.log 2024-04-17T17:54:16.061 INFO:teuthology.orchestra.run.smithi152.stderr: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.252866.log.gz 2024-04-17T17:54:16.062 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.488663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178952.log 2024-04-17T17:54:16.065 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.375869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104371.log 2024-04-17T17:54:16.065 INFO:teuthology.orchestra.run.smithi152.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.309118.log.gz 2024-04-17T17:54:16.067 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106462.log 2024-04-17T17:54:16.068 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.308273.log.gz 2024-04-17T17:54:16.068 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.178952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.483017.log 2024-04-17T17:54:16.070 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.104371.log: /var/log/ceph/ceph-client.admin.106462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180664.log 2024-04-17T17:54:16.071 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170716.log 2024-04-17T17:54:16.073 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.483017.log: /var/log/ceph/ceph-client.admin.180664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.433772.log 2024-04-17T17:54:16.076 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.170716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170277.log 2024-04-17T17:54:16.077 INFO:teuthology.orchestra.run.smithi152.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.207147.log.gz 2024-04-17T17:54:16.078 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.433772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364525.log 2024-04-17T17:54:16.079 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.425276.log 2024-04-17T17:54:16.081 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.170277.log: /var/log/ceph/ceph-client.admin.364525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102730.log 2024-04-17T17:54:16.082 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.425276.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.302359.log.gz 2024-04-17T17:54:16.083 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.454815.log 2024-04-17T17:54:16.084 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.102730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449639.log 2024-04-17T17:54:16.086 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.454815.log: gzip -5 --verbose -- 94.4% /var/log/ceph/ceph-client.admin.376270.log -- replaced with /var/log/ceph/ceph-client.admin.189738.log.gz 2024-04-17T17:54:16.087 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-04-17T17:54:16.089 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.449639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37833.log 2024-04-17T17:54:16.090 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.376270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214191.log 2024-04-17T17:54:16.092 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227426.log 2024-04-17T17:54:16.094 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.37833.log: /var/log/ceph/ceph-client.admin.214191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86798.log 2024-04-17T17:54:16.095 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398819.log 2024-04-17T17:54:16.096 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294183.log 2024-04-17T17:54:16.097 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.227426.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.328341.log.gz 2024-04-17T17:54:16.098 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.398819.log: /var/log/ceph/ceph-client.admin.86798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379723.log 2024-04-17T17:54:16.099 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.294183.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.362806.log.gz 2024-04-17T17:54:16.100 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327935.log 2024-04-17T17:54:16.101 INFO:teuthology.orchestra.run.smithi152.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38458.log.gz 2024-04-17T17:54:16.102 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.379723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157088.log 2024-04-17T17:54:16.103 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.490628.log 2024-04-17T17:54:16.105 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.327935.log: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.398819.log.gz 2024-04-17T17:54:16.106 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.157088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160966.log 2024-04-17T17:54:16.107 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.334591.log.gz 2024-04-17T17:54:16.107 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401949.log 2024-04-17T17:54:16.108 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.490628.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.343643.log.gz 2024-04-17T17:54:16.109 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310337.log 2024-04-17T17:54:16.111 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.160966.log: /var/log/ceph/ceph-client.admin.401949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34280.log 2024-04-17T17:54:16.112 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.430732.log 2024-04-17T17:54:16.113 INFO:teuthology.orchestra.run.smithi152.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33361.log.gz 2024-04-17T17:54:16.114 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.310337.log: /var/log/ceph/ceph-client.admin.34280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35406.log 2024-04-17T17:54:16.115 INFO:teuthology.orchestra.run.smithi152.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.234786.log.gz 2024-04-17T17:54:16.116 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.430732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34092.log 2024-04-17T17:54:16.118 INFO:teuthology.orchestra.run.smithi152.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34307.log.gz 2024-04-17T17:54:16.119 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38249.log 2024-04-17T17:54:16.119 INFO:teuthology.orchestra.run.smithi152.stderr: 78.6% -- replaced with /var/log/ceph/ceph-client.admin.102730.log.gz 2024-04-17T17:54:16.119 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.35406.log: gzip/var/log/ceph/ceph-client.admin.34092.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.374202.log 2024-04-17T17:54:16.121 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.38249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.445490.log 2024-04-17T17:54:16.123 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.374202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197759.log 2024-04-17T17:54:16.125 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.445490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.490363.log 2024-04-17T17:54:16.125 INFO:teuthology.orchestra.run.smithi152.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.191416.log.gz 2024-04-17T17:54:16.127 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.197759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427854.log 2024-04-17T17:54:16.129 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158754.log 2024-04-17T17:54:16.131 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.427854.log: /var/log/ceph/ceph-client.admin.490363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128099.log 2024-04-17T17:54:16.132 INFO:teuthology.orchestra.run.smithi152.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.163516.log.gz 2024-04-17T17:54:16.133 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.158754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325174.log 2024-04-17T17:54:16.134 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.236145.log.gz 2024-04-17T17:54:16.136 INFO:teuthology.orchestra.run.smithi152.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.297448.log.gz 2024-04-17T17:54:16.137 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.371177.log.gz 2024-04-17T17:54:16.137 INFO:teuthology.orchestra.run.smithi152.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.170277.log.gz 2024-04-17T17:54:16.137 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.128099.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.169868.log.gz 2024-04-17T17:54:16.137 INFO:teuthology.orchestra.run.smithi152.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.376487.log.gz 2024-04-17T17:54:16.137 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78951.log 2024-04-17T17:54:16.137 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110296.log 2024-04-17T17:54:16.139 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.78951.log: /var/log/ceph/ceph-client.admin.325174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.486003.log 2024-04-17T17:54:16.140 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.433772.log.gz 2024-04-17T17:54:16.140 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.110296.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.472958.log.gz 2024-04-17T17:54:16.141 INFO:teuthology.orchestra.run.smithi152.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.481098.log.gz 2024-04-17T17:54:16.141 INFO:teuthology.orchestra.run.smithi152.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.490628.log.gz 2024-04-17T17:54:16.142 INFO:teuthology.orchestra.run.smithi152.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.488663.log.gz 2024-04-17T17:54:16.142 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199380.log 2024-04-17T17:54:16.143 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.486003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401318.log 2024-04-17T17:54:16.145 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.199380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201100.log 2024-04-17T17:54:16.147 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.401318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301953.log 2024-04-17T17:54:16.149 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.201100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295814.log 2024-04-17T17:54:16.151 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.301953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33674.log 2024-04-17T17:54:16.152 INFO:teuthology.orchestra.run.smithi152.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.132740.log.gz 2024-04-17T17:54:16.153 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162241.log 2024-04-17T17:54:16.155 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.295814.log: /var/log/ceph/ceph-client.admin.33674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109886.log 2024-04-17T17:54:16.157 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.162241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368817.log 2024-04-17T17:54:16.159 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327520.log/var/log/ceph/ceph-client.admin.109886.log: 2024-04-17T17:54:16.161 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.368817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208357.log 2024-04-17T17:54:16.162 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34333.log 2024-04-17T17:54:16.164 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.327520.log: /var/log/ceph/ceph-client.admin.208357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162232.log 2024-04-17T17:54:16.166 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.34333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442510.log 2024-04-17T17:54:16.166 INFO:teuthology.orchestra.run.smithi152.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.106462.log.gz 2024-04-17T17:54:16.167 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381410.log 2024-04-17T17:54:16.169 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.162232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414723.log 2024-04-17T17:54:16.171 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.442510.log: /var/log/ceph/ceph-client.admin.381410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213771.log 2024-04-17T17:54:16.172 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36408.log 2024-04-17T17:54:16.173 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.414723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370476.log 2024-04-17T17:54:16.175 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.36408.log: /var/log/ceph/ceph-client.admin.213771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37963.log 2024-04-17T17:54:16.176 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.454003.log 2024-04-17T17:54:16.178 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.370476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35844.log 2024-04-17T17:54:16.179 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.37963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97849.log 2024-04-17T17:54:16.181 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.454003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328748.log 2024-04-17T17:54:16.183 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.35844.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.453118.log.gz 2024-04-17T17:54:16.183 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.97849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241838.log 2024-04-17T17:54:16.183 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.445490.log.gz 2024-04-17T17:54:16.184 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.328748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172868.log 2024-04-17T17:54:16.186 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.241838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196938.log 2024-04-17T17:54:16.188 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336799.log 2024-04-17T17:54:16.190 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.172868.log: /var/log/ceph/ceph-client.admin.196938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314798.log 2024-04-17T17:54:16.193 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.336799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129340.log 2024-04-17T17:54:16.194 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189729.log 2024-04-17T17:54:16.196 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.314798.log: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.316494.log.gz 2024-04-17T17:54:16.197 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.129340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37911.log 2024-04-17T17:54:16.197 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.253693.log.gz 2024-04-17T17:54:16.198 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- 90.1% /var/log/ceph/ceph-client.admin.208762.log 2024-04-17T17:54:16.198 INFO:teuthology.orchestra.run.smithi152.stderr: -- replaced with /var/log/ceph/ceph-client.admin.310337.log.gz 2024-04-17T17:54:16.199 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.37911.log: /var/log/ceph/ceph-client.admin.189729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364047.log 2024-04-17T17:54:16.201 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.208762.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.376270.log.gz 2024-04-17T17:54:16.202 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420578.log 2024-04-17T17:54:16.202 INFO:teuthology.orchestra.run.smithi152.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.327935.log.gz 2024-04-17T17:54:16.202 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.301953.log.gz 2024-04-17T17:54:16.203 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.507036.log 2024-04-17T17:54:16.204 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130597.log 2024-04-17T17:54:16.206 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.364047.log: /var/log/ceph/ceph-client.admin.507036.log: /var/log/ceph/ceph-client.admin.420578.log: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.251542.log.gz 2024-04-17T17:54:16.206 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.298680.log 2024-04-17T17:54:16.208 INFO:teuthology.orchestra.run.smithi152.stderr:gzip/var/log/ceph/ceph-client.admin.130597.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.444263.log 2024-04-17T17:54:16.210 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.298680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.430167.log 2024-04-17T17:54:16.214 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331299.log 2024-04-17T17:54:16.214 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.444263.log: /var/log/ceph/ceph-client.admin.430167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164387.log 2024-04-17T17:54:16.215 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.331299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.500144.log 2024-04-17T17:54:16.217 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474168.log 2024-04-17T17:54:16.219 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.164387.log: /var/log/ceph/ceph-client.admin.500144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171159.log 2024-04-17T17:54:16.220 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.474168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335413.log 2024-04-17T17:54:16.221 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161391.log 2024-04-17T17:54:16.222 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.335413.log: /var/log/ceph/ceph-client.admin.171159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36642.log 2024-04-17T17:54:16.224 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.161391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399254.log 2024-04-17T17:54:16.225 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242670.log 2024-04-17T17:54:16.227 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.399254.log: /var/log/ceph/ceph-client.admin.36642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338093.log 2024-04-17T17:54:16.228 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215572.log 2024-04-17T17:54:16.229 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.242670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437017.log 2024-04-17T17:54:16.231 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.215572.log: /var/log/ceph/ceph-client.admin.338093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.497141.log 2024-04-17T17:54:16.233 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447987.log 2024-04-17T17:54:16.234 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.437017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38840.log 2024-04-17T17:54:16.235 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.497141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437426.log 2024-04-17T17:54:16.237 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.447987.log: /var/log/ceph/ceph-client.admin.38840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228248.log 2024-04-17T17:54:16.238 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412934.log 2024-04-17T17:54:16.240 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.437426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202420.log 2024-04-17T17:54:16.240 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.228248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101112.log 2024-04-17T17:54:16.242 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.202420.log: /var/log/ceph/ceph-client.admin.412934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195680.log 2024-04-17T17:54:16.244 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474586.log 2024-04-17T17:54:16.245 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.101112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304910.log 2024-04-17T17:54:16.247 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.195680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410899.log 2024-04-17T17:54:16.248 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.474586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338500.log 2024-04-17T17:54:16.249 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.304910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315619.log 2024-04-17T17:54:16.251 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.410899.log: /var/log/ceph/ceph-client.admin.338500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.466636.log 2024-04-17T17:54:16.253 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.315619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209637.log 2024-04-17T17:54:16.255 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.466636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.451340.log 2024-04-17T17:54:16.257 INFO:teuthology.orchestra.run.smithi152.stderr:gzip/var/log/ceph/ceph-client.admin.209637.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.131410.log 2024-04-17T17:54:16.259 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.451340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474993.log 2024-04-17T17:54:16.261 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402369.log 2024-04-17T17:54:16.262 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.131410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96994.log 2024-04-17T17:54:16.264 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.474993.log: /var/log/ceph/ceph-client.admin.402369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.438307.log 2024-04-17T17:54:16.266 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.96994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187581.log 2024-04-17T17:54:16.269 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.438307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320167.log 2024-04-17T17:54:16.270 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235738.log 2024-04-17T17:54:16.272 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.187581.log: /var/log/ceph/ceph-client.admin.320167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512953.log 2024-04-17T17:54:16.274 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.235738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318532.log 2024-04-17T17:54:16.276 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.489890.log 2024-04-17T17:54:16.277 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.512953.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.512953.log.gz 2024-04-17T17:54:16.277 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.318532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233558.log 2024-04-17T17:54:16.279 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375463.log 2024-04-17T17:54:16.280 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.489890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36224.log 2024-04-17T17:54:16.281 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.233558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103554.log 2024-04-17T17:54:16.283 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.36224.log: /var/log/ceph/ceph-client.admin.375463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206732.log 2024-04-17T17:54:16.284 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106471.log 2024-04-17T17:54:16.286 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.103554.log: /var/log/ceph/ceph-client.admin.206732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35983.log 2024-04-17T17:54:16.288 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188860.log 2024-04-17T17:54:16.289 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.106471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341263.log 2024-04-17T17:54:16.291 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.35983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36276.log 2024-04-17T17:54:16.292 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.188860.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36224.log.gz 2024-04-17T17:54:16.293 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.341263.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-17T17:54:16.294 INFO:teuthology.orchestra.run.smithi152.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.157499.log.gz 2024-04-17T17:54:16.295 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35276.log 2024-04-17T17:54:16.296 INFO:teuthology.orchestra.run.smithi152.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.128099.log.gz 2024-04-17T17:54:16.296 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.36276.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.325165.log.gz 2024-04-17T17:54:16.297 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.130606.log.gz 2024-04-17T17:54:16.298 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-osd.1.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.474586.log.gz 2024-04-17T17:54:16.298 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332552.log 2024-04-17T17:54:16.299 INFO:teuthology.orchestra.run.smithi152.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.196938.log.gz 2024-04-17T17:54:16.300 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.35276.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.401318.log.gz 2024-04-17T17:54:16.300 INFO:teuthology.orchestra.run.smithi152.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.161391.log.gz 2024-04-17T17:54:16.301 INFO:teuthology.orchestra.run.smithi152.stderr:gzip 81.6% -- replaced with /var/log/ceph/ceph-client.admin.189729.log.gz -5 2024-04-17T17:54:16.301 INFO:teuthology.orchestra.run.smithi152.stderr: --verbose -- /var/log/ceph/ceph-client.admin.398408.log 2024-04-17T17:54:16.301 INFO:teuthology.orchestra.run.smithi152.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.162232.log.gz 2024-04-17T17:54:16.302 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.228248.log.gz 2024-04-17T17:54:16.303 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.332552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386337.log 2024-04-17T17:54:16.304 INFO:teuthology.orchestra.run.smithi152.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.235738.log.gz 2024-04-17T17:54:16.304 INFO:teuthology.orchestra.run.smithi152.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.233567.log.gz 2024-04-17T17:54:16.305 INFO:teuthology.orchestra.run.smithi152.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.233558.log.gz 2024-04-17T17:54:16.306 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.398408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311958.log 2024-04-17T17:54:16.306 INFO:teuthology.orchestra.run.smithi152.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.219667.log.gz 2024-04-17T17:54:16.307 INFO:teuthology.orchestra.run.smithi152.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33611.log.gz 2024-04-17T17:54:16.307 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371583.log 2024-04-17T17:54:16.308 INFO:teuthology.orchestra.run.smithi152.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.33704.log.gz 2024-04-17T17:54:16.308 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.386337.log: /var/log/ceph/ceph-client.admin.311958.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36356.log.gz 2024-04-17T17:54:16.310 INFO:teuthology.orchestra.run.smithi152.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36486.log.gz 2024-04-17T17:54:16.310 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471888.log 2024-04-17T17:54:16.310 INFO:teuthology.orchestra.run.smithi152.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.215572.log.gz 2024-04-17T17:54:16.311 INFO:teuthology.orchestra.run.smithi152.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.423610.log.gz 2024-04-17T17:54:16.311 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.371583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.513239.log 2024-04-17T17:54:16.313 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.471888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339807.log 2024-04-17T17:54:16.315 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168029.log 2024-04-17T17:54:16.316 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.513239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186767.log 2024-04-17T17:54:16.316 INFO:teuthology.orchestra.run.smithi152.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.513239.log.gz 2024-04-17T17:54:16.317 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.339807.log: /var/log/ceph/ceph-client.admin.168029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.452151.log 2024-04-17T17:54:16.319 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368808.log 2024-04-17T17:54:16.320 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.186767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173737.log 2024-04-17T17:54:16.322 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.368808.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.438307.log.gz 2024-04-17T17:54:16.322 INFO:teuthology.orchestra.run.smithi152.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.97849.log.gz/var/log/ceph/ceph-client.admin.452151.log: 2024-04-17T17:54:16.323 INFO:teuthology.orchestra.run.smithi152.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34280.log.gz 2024-04-17T17:54:16.323 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159654.log 2024-04-17T17:54:16.323 INFO:teuthology.orchestra.run.smithi152.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.110296.log.gz 2024-04-17T17:54:16.325 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240604.log 2024-04-17T17:54:16.326 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.173737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209628.log 2024-04-17T17:54:16.327 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.159654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417716.log 2024-04-17T17:54:16.329 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.209628.log: /var/log/ceph/ceph-client.admin.240604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.489074.log 2024-04-17T17:54:16.331 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38548.log 2024-04-17T17:54:16.332 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.417716.log: /var/log/ceph/ceph-client.admin.489074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221771.log 2024-04-17T17:54:16.333 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190573.log 2024-04-17T17:54:16.335 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.221771.log: /var/log/ceph/ceph-client.admin.38548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327529.log 2024-04-17T17:54:16.337 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.190573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38758.log 2024-04-17T17:54:16.339 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412943.log 2024-04-17T17:54:16.339 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.327529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.432390.log 2024-04-17T17:54:16.340 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.412943.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.388823.log.gz 2024-04-17T17:54:16.341 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.38758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33888.log 2024-04-17T17:54:16.343 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.432390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376496.log 2024-04-17T17:54:16.344 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211259.log 2024-04-17T17:54:16.344 INFO:teuthology.orchestra.run.smithi152.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.212490.log.gz 2024-04-17T17:54:16.345 INFO:teuthology.orchestra.run.smithi152.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.341263.log.gz 2024-04-17T17:54:16.345 INFO:teuthology.orchestra.run.smithi152.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.373785.log.gz/var/log/ceph/ceph-client.admin.376496.log: 2024-04-17T17:54:16.346 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.33888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391689.log 2024-04-17T17:54:16.348 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.298671.log 2024-04-17T17:54:16.348 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.211259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.482372.log 2024-04-17T17:54:16.349 INFO:teuthology.orchestra.run.smithi152.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.487345.log.gz 2024-04-17T17:54:16.350 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.298671.log: /var/log/ceph/ceph-client.admin.391689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479470.log 2024-04-17T17:54:16.352 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.482372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181074.log 2024-04-17T17:54:16.352 INFO:teuthology.orchestra.run.smithi152.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.158754.log.gz 2024-04-17T17:54:16.353 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.479470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311148.log 2024-04-17T17:54:16.355 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.386337.log.gz 2024-04-17T17:54:16.356 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330013.log 2024-04-17T17:54:16.356 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.181074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512521.log 2024-04-17T17:54:16.357 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.330013.log: /var/log/ceph/ceph-client.admin.311148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35302.log 2024-04-17T17:54:16.359 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.512521.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.512521.log.gz 2024-04-17T17:54:16.359 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311949.log 2024-04-17T17:54:16.360 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182707.log 2024-04-17T17:54:16.360 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.398408.log.gz 2024-04-17T17:54:16.361 INFO:teuthology.orchestra.run.smithi152.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.179388.log.gz 2024-04-17T17:54:16.362 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.311949.log: /var/log/ceph/ceph-client.admin.35302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412108.log 2024-04-17T17:54:16.364 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.182707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499296.log 2024-04-17T17:54:16.365 INFO:teuthology.orchestra.run.smithi152.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.34730.log.gz 2024-04-17T17:54:16.366 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.412108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231516.log 2024-04-17T17:54:16.369 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.499296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212073.log 2024-04-17T17:54:16.371 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.231516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131821.log 2024-04-17T17:54:16.373 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316035.log 2024-04-17T17:54:16.373 INFO:teuthology.orchestra.run.smithi152.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.497141.log.gz 2024-04-17T17:54:16.374 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.131821.log: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.364047.log.gz 2024-04-17T17:54:16.374 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.212073.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.368808.log.gz 2024-04-17T17:54:16.375 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168880.log 2024-04-17T17:54:16.375 INFO:teuthology.orchestra.run.smithi152.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.508778.log.gz 2024-04-17T17:54:16.377 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.316035.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.507036.log.gz 2024-04-17T17:54:16.378 INFO:teuthology.orchestra.run.smithi152.stderr:gzip 84.3% -- replaced with /var/log/ceph/ceph-client.admin.315619.log.gz -5 2024-04-17T17:54:16.378 INFO:teuthology.orchestra.run.smithi152.stderr: --verbose -- /var/log/ceph/ceph-client.admin.416474.log 2024-04-17T17:54:16.380 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.168880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447173.log 2024-04-17T17:54:16.380 INFO:teuthology.orchestra.run.smithi152.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.327529.log.gz 2024-04-17T17:54:16.382 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.416474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37071.log 2024-04-17T17:54:16.382 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.332552.log.gz 2024-04-17T17:54:16.383 INFO:teuthology.orchestra.run.smithi152.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.212073.log.gz 2024-04-17T17:54:16.383 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214601.log 2024-04-17T17:54:16.385 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.447173.log: /var/log/ceph/ceph-client.admin.37071.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.336338.log.gz 2024-04-17T17:54:16.386 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.488654.log 2024-04-17T17:54:16.388 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.214601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.484756.log 2024-04-17T17:54:16.390 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.488654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254090.log 2024-04-17T17:54:16.391 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157508.log 2024-04-17T17:54:16.391 INFO:teuthology.orchestra.run.smithi152.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.167614.log.gz 2024-04-17T17:54:16.393 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.254090.log: /var/log/ceph/ceph-client.admin.484756.log: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.208357.log.gz 2024-04-17T17:54:16.393 INFO:teuthology.orchestra.run.smithi152.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.208762.log.gz 2024-04-17T17:54:16.393 INFO:teuthology.orchestra.run.smithi152.stderr:gzip 90.2% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.182707.log.gz -- 2024-04-17T17:54:16.393 INFO:teuthology.orchestra.run.smithi152.stderr: /var/log/ceph/ceph-client.admin.79452.log 2024-04-17T17:54:16.394 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.167623.log.gz 2024-04-17T17:54:16.395 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.157508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181895.log 2024-04-17T17:54:16.395 INFO:teuthology.orchestra.run.smithi152.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35844.log.gz 2024-04-17T17:54:16.396 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104781.log 2024-04-17T17:54:16.398 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.181895.log: /var/log/ceph/ceph-client.admin.79452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111115.log 2024-04-17T17:54:16.399 INFO:teuthology.orchestra.run.smithi152.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.374202.log.gz 2024-04-17T17:54:16.399 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225737.log 2024-04-17T17:54:16.401 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.104781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307858.log 2024-04-17T17:54:16.403 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.111115.log: /var/log/ceph/ceph-client.admin.225737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.492506.log 2024-04-17T17:54:16.405 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.436601.log 2024-04-17T17:54:16.405 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.307858.log: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.216395.log.gz 2024-04-17T17:54:16.407 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.492506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330004.log 2024-04-17T17:54:16.408 INFO:teuthology.orchestra.run.smithi152.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38784.log.gz 2024-04-17T17:54:16.408 INFO:teuthology.orchestra.run.smithi152.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35302.log.gz 2024-04-17T17:54:16.408 INFO:teuthology.orchestra.run.smithi152.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35276.log.gz 2024-04-17T17:54:16.409 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.483866.log 2024-04-17T17:54:16.410 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.436601.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36276.log.gz 2024-04-17T17:54:16.410 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394977.log 2024-04-17T17:54:16.412 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.483866.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.155869.log.gz 2024-04-17T17:54:16.412 INFO:teuthology.orchestra.run.smithi152.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.471888.log.gz 2024-04-17T17:54:16.413 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.330004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512601.log 2024-04-17T17:54:16.413 INFO:teuthology.orchestra.run.smithi152.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.37703.log.gz 2024-04-17T17:54:16.413 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235236.log 2024-04-17T17:54:16.413 INFO:teuthology.orchestra.run.smithi152.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37989.log.gz 2024-04-17T17:54:16.414 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.512601.log: /var/log/ceph/ceph-client.admin.394977.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.512601.log.gz 2024-04-17T17:54:16.417 INFO:teuthology.orchestra.run.smithi152.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.104781.log.gz 2024-04-17T17:54:16.417 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.455638.log 2024-04-17T17:54:16.418 INFO:teuthology.orchestra.run.smithi152.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.186767.log.gz 2024-04-17T17:54:16.418 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.311148.log.gz 2024-04-17T17:54:16.418 INFO:teuthology.orchestra.run.smithi152.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.311949.log.gz 2024-04-17T17:54:16.418 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.235236.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.311958.log.gz 2024-04-17T17:54:16.419 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477436.log 2024-04-17T17:54:16.419 INFO:teuthology.orchestra.run.smithi152.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.190573.log.gz 2024-04-17T17:54:16.420 INFO:teuthology.orchestra.run.smithi152.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.306151.log.gz 2024-04-17T17:54:16.420 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383894.log 2024-04-17T17:54:16.420 INFO:teuthology.orchestra.run.smithi152.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33810.log.gz 2024-04-17T17:54:16.421 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.477436.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.385103.log.gz 93.6% 2024-04-17T17:54:16.421 INFO:teuthology.orchestra.run.smithi152.stderr: -- replaced with /var/log/ceph/ceph-client.admin.160966.log.gz 2024-04-17T17:54:16.421 INFO:teuthology.orchestra.run.smithi152.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.214601.log.gz 2024-04-17T17:54:16.423 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.455638.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.231516.log.gz 2024-04-17T17:54:16.423 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219245.log 2024-04-17T17:54:16.425 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.383894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440339.log 2024-04-17T17:54:16.427 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.219245.log: 79.1% -- replaced with /var/log/ceph/ceph-client.admin.481518.log.gz 2024-04-17T17:54:16.427 INFO:teuthology.orchestra.run.smithi152.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.477436.log.gz 2024-04-17T17:54:16.428 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338980.log 2024-04-17T17:54:16.428 INFO:teuthology.orchestra.run.smithi152.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.483866.log.gz 2024-04-17T17:54:16.431 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.440339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190582.log 2024-04-17T17:54:16.432 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128921.log 2024-04-17T17:54:16.434 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.190582.log: /var/log/ceph/ceph-client.admin.338980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362391.log 2024-04-17T17:54:16.436 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.128921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341771.log 2024-04-17T17:54:16.436 INFO:teuthology.orchestra.run.smithi152.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.447173.log.gz 2024-04-17T17:54:16.436 INFO:teuthology.orchestra.run.smithi152.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.159654.log.gz 2024-04-17T17:54:16.436 INFO:teuthology.orchestra.run.smithi152.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.162241.log.gz 2024-04-17T17:54:16.437 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.362391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210035.log 2024-04-17T17:54:16.438 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.341771.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.447182.log.gz 2024-04-17T17:54:16.439 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396136.log 2024-04-17T17:54:16.442 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.210035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.483438.log 2024-04-17T17:54:16.443 INFO:teuthology.orchestra.run.smithi152.stderr: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.111115.log.gz 2024-04-17T17:54:16.444 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173303.log 2024-04-17T17:54:16.444 INFO:teuthology.orchestra.run.smithi152.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.131821.log.gz 2024-04-17T17:54:16.445 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.396136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211666.log 2024-04-17T17:54:16.447 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.483438.log: /var/log/ceph/ceph-client.admin.173303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414251.log 2024-04-17T17:54:16.448 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387161.log 2024-04-17T17:54:16.451 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.211666.log: /var/log/ceph/ceph-client.admin.414251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100291.log 2024-04-17T17:54:16.451 INFO:teuthology.orchestra.run.smithi152.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.412108.log.gz 2024-04-17T17:54:16.453 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.387161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184323.log 2024-04-17T17:54:16.454 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410890.log 2024-04-17T17:54:16.455 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.100291.log: /var/log/ceph/ceph-client.admin.184323.log: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.178952.log.gz 2024-04-17T17:54:16.456 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205905.log 2024-04-17T17:54:16.458 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.410890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178943.log 2024-04-17T17:54:16.460 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.205905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.507878.log 2024-04-17T17:54:16.462 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.178943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381812.log 2024-04-17T17:54:16.464 INFO:teuthology.orchestra.run.smithi152.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.240613.log.gz 2024-04-17T17:54:16.464 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403180.log 2024-04-17T17:54:16.464 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.507878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34600.log 2024-04-17T17:54:16.466 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.403180.log: /var/log/ceph/ceph-client.admin.381812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38706.log 2024-04-17T17:54:16.468 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.34600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381821.log 2024-04-17T17:54:16.470 INFO:teuthology.orchestra.run.smithi152.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37071.log.gz 2024-04-17T17:54:16.470 INFO:teuthology.orchestra.run.smithi152.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37331.log.gz 2024-04-17T17:54:16.470 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384706.log 2024-04-17T17:54:16.471 INFO:teuthology.orchestra.run.smithi152.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.383894.log.gz 2024-04-17T17:54:16.471 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313580.log 2024-04-17T17:54:16.474 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.38706.log: /var/log/ceph/ceph-client.admin.384706.log: /var/log/ceph/ceph-client.admin.381821.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.416474.log.gz 2024-04-17T17:54:16.474 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.22730.log 2024-04-17T17:54:16.474 INFO:teuthology.orchestra.run.smithi152.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34600.log.gz 2024-04-17T17:54:16.475 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.451331.log 2024-04-17T17:54:16.477 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.313580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310734.log 2024-04-17T17:54:16.477 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph.tmp-client.admin.22730.log: /var/log/ceph/ceph-client.admin.451331.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.22730.log.gz 2024-04-17T17:54:16.478 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129779.log 2024-04-17T17:54:16.480 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.310734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449224.log 2024-04-17T17:54:16.481 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252468.log 2024-04-17T17:54:16.482 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.449224.log: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.507443.log.gz 2024-04-17T17:54:16.483 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.129779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372943.log 2024-04-17T17:54:16.485 INFO:teuthology.orchestra.run.smithi152.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.254090.log.gz 2024-04-17T17:54:16.486 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.252468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.510481.log 2024-04-17T17:54:16.487 INFO:teuthology.orchestra.run.smithi152.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.307858.log.gz 2024-04-17T17:54:16.488 INFO:teuthology.orchestra.run.smithi152.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.309527.log.gz 2024-04-17T17:54:16.488 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191821.log 2024-04-17T17:54:16.489 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.372943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94909.log 2024-04-17T17:54:16.491 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.191821.log: /var/log/ceph/ceph-client.admin.510481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188426.log 2024-04-17T17:54:16.493 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208771.log 2024-04-17T17:54:16.493 INFO:teuthology.orchestra.run.smithi152.stderr: 79.2% -- replaced with /var/log/ceph/ceph-client.admin.330004.log.gz 2024-04-17T17:54:16.494 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.94909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.505351.log 2024-04-17T17:54:16.496 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.188426.log: /var/log/ceph/ceph-client.admin.208771.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.334185.log.gz 2024-04-17T17:54:16.497 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98657.log 2024-04-17T17:54:16.497 INFO:teuthology.orchestra.run.smithi152.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.128921.log.gz 2024-04-17T17:54:16.499 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.505351.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.219245.log.gz 2024-04-17T17:54:16.499 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318134.log 2024-04-17T17:54:16.500 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.98657.log: 78.9% -- replaced with /var/log/ceph/ceph-client.admin.379296.log.gz 2024-04-17T17:54:16.501 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94105.log 2024-04-17T17:54:16.504 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.318134.log: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.451331.log.gz 2024-04-17T17:54:16.504 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193859.log 2024-04-17T17:54:16.504 INFO:teuthology.orchestra.run.smithi152.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.436601.log.gz 2024-04-17T17:54:16.506 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.94105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193850.log 2024-04-17T17:54:16.507 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.193859.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.455638.log.gz 2024-04-17T17:54:16.507 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.210861.log.gz 2024-04-17T17:54:16.508 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.513187.log 2024-04-17T17:54:16.510 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.193850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396769.log 2024-04-17T17:54:16.512 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380134.log 2024-04-17T17:54:16.514 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.513187.log: /var/log/ceph/ceph-client.admin.396769.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.513187.log.gz 2024-04-17T17:54:16.514 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33328.log 2024-04-17T17:54:16.515 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199795.log 2024-04-17T17:54:16.517 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.380134.log: /var/log/ceph/ceph-client.admin.33328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193047.log 2024-04-17T17:54:16.519 INFO:teuthology.orchestra.run.smithi152.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.92830.log.gz 2024-04-17T17:54:16.520 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.199795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178084.log 2024-04-17T17:54:16.522 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.193047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140368.log 2024-04-17T17:54:16.524 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.178084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198977.log 2024-04-17T17:54:16.526 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.140368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38812.log 2024-04-17T17:54:16.527 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379732.log 2024-04-17T17:54:16.529 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.198977.log: /var/log/ceph/ceph-client.admin.38812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397581.log 2024-04-17T17:54:16.531 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369628.log 2024-04-17T17:54:16.531 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.379732.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.33328.log.gz 2024-04-17T17:54:16.532 INFO:teuthology.orchestra.run.smithi152.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.38706.log.gz 2024-04-17T17:54:16.533 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.397581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370070.log 2024-04-17T17:54:16.535 INFO:teuthology.orchestra.run.smithi152.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.394977.log.gz 2024-04-17T17:54:16.535 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.509183.log 2024-04-17T17:54:16.536 INFO:teuthology.orchestra.run.smithi152.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37833.log.gz 2024-04-17T17:54:16.537 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.369628.log: /var/log/ceph/ceph-client.admin.370070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188435.log 2024-04-17T17:54:16.539 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.509183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.425691.log 2024-04-17T17:54:16.540 INFO:teuthology.orchestra.run.smithi152.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.85116.log.gz 2024-04-17T17:54:16.542 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207960.log 2024-04-17T17:54:16.543 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.188435.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.94105.log.gz 2024-04-17T17:54:16.543 INFO:teuthology.orchestra.run.smithi152.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36668.log.gz 2024-04-17T17:54:16.544 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.425691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456879.log 2024-04-17T17:54:16.544 INFO:teuthology.orchestra.run.smithi152.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.184323.log.gz 2024-04-17T17:54:16.545 INFO:teuthology.orchestra.run.smithi152.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.188426.log.gz 2024-04-17T17:54:16.546 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90797.log 2024-04-17T17:54:16.546 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.207960.log: /var/log/ceph/ceph-client.admin.456879.log: 79.9% -- replaced with /var/log/ceph/ceph-client.admin.99885.log.gz 2024-04-17T17:54:16.548 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421527.log 2024-04-17T17:54:16.550 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.90797.log: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.359798.log.gz 2024-04-17T17:54:16.550 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361521.log 2024-04-17T17:54:16.551 INFO:teuthology.orchestra.run.smithi152.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.449224.log.gz 2024-04-17T17:54:16.553 INFO:teuthology.orchestra.run.smithi152.stderr: 78.9% -- replaced with /var/log/ceph/ceph-client.admin.180664.log.gz 2024-04-17T17:54:16.553 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.384706.log.gz 2024-04-17T17:54:16.553 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.421527.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.379732.log.gz 2024-04-17T17:54:16.553 INFO:teuthology.orchestra.run.smithi152.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.178943.log.gz 2024-04-17T17:54:16.553 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222169.log 2024-04-17T17:54:16.555 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.35939.log 2024-04-17T17:54:16.557 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.361521.log: /var/log/ceph/ceph-client.admin.222169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201091.log 2024-04-17T17:54:16.557 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399655.log 2024-04-17T17:54:16.559 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.201091.log: /var/log/ceph/ceph-client.2.35939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34626.log 2024-04-17T17:54:16.561 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192235.log 2024-04-17T17:54:16.562 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.399655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132285.log 2024-04-17T17:54:16.563 INFO:teuthology.orchestra.run.smithi152.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.157508.log.gz 2024-04-17T17:54:16.564 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.34626.log: /var/log/ceph/ceph-client.admin.192235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91249.log 2024-04-17T17:54:16.566 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342721.log 2024-04-17T17:54:16.568 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.132285.log: /var/log/ceph/ceph-client.admin.91249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336808.log 2024-04-17T17:54:16.569 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485569.log 2024-04-17T17:54:16.571 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.336808.log: /var/log/ceph/ceph-client.admin.342721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467873.log 2024-04-17T17:54:16.574 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.485569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165273.log 2024-04-17T17:54:16.576 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.467873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378071.log 2024-04-17T17:54:16.577 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84066.log 2024-04-17T17:54:16.580 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.165273.log: /var/log/ceph/ceph-client.admin.378071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.453601.log 2024-04-17T17:54:16.582 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.84066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446776.log 2024-04-17T17:54:16.584 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.453601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418953.log 2024-04-17T17:54:16.586 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.446776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207553.log 89.8% 2024-04-17T17:54:16.586 INFO:teuthology.orchestra.run.smithi152.stderr: -- replaced with /var/log/ceph/ceph-client.admin.509183.log.gz 2024-04-17T17:54:16.588 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81590.log 2024-04-17T17:54:16.591 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.207553.log: /var/log/ceph/ceph-client.admin.418953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33505.log 2024-04-17T17:54:16.593 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.81590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.298269.log 2024-04-17T17:54:16.595 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.33505.log: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.193850.log.gz 2024-04-17T17:54:16.596 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.193859.log.gz 2024-04-17T17:54:16.596 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376182.log 2024-04-17T17:54:16.597 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.490372.log 2024-04-17T17:54:16.599 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.298269.log: gzip -5 --verbose --/var/log/ceph/ceph-client.admin.376182.log: /var/log/ceph/ceph-client.admin.397987.log 2024-04-17T17:54:16.601 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.490372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415601.log 2024-04-17T17:54:16.602 INFO:teuthology.orchestra.run.smithi152.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.362391.log.gz 2024-04-17T17:54:16.603 INFO:teuthology.orchestra.run.smithi152.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.207960.log.gz 2024-04-17T17:54:16.603 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.397987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154645.log 2024-04-17T17:54:16.605 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.415601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359385.log 2024-04-17T17:54:16.607 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.154645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235729.log 2024-04-17T17:54:16.607 INFO:teuthology.orchestra.run.smithi152.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.392915.log.gz 2024-04-17T17:54:16.608 INFO:teuthology.orchestra.run.smithi152.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.178518.log.gz 2024-04-17T17:54:16.609 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.359385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293777.log 2024-04-17T17:54:16.610 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336329.log 2024-04-17T17:54:16.612 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.235729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.493323.log 2024-04-17T17:54:16.614 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.293777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.508769.log 2024-04-17T17:54:16.615 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.336329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485153.log 2024-04-17T17:54:16.615 INFO:teuthology.orchestra.run.smithi152.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.397581.log.gz 2024-04-17T17:54:16.616 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.493323.log: /var/log/ceph/ceph-client.admin.508769.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.399655.log.gz 2024-04-17T17:54:16.617 INFO:teuthology.orchestra.run.smithi152.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.224102.log.gz 2024-04-17T17:54:16.617 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.488237.log 2024-04-17T17:54:16.618 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420587.log 2024-04-17T17:54:16.618 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.418953.log.gz 2024-04-17T17:54:16.621 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.485153.log: /var/log/ceph/ceph-client.admin.488237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179824.log 2024-04-17T17:54:16.622 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-17T17:54:16.623 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.199795.log.gz 2024-04-17T17:54:16.624 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.420587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201983.log 2024-04-17T17:54:16.626 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.179824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33259.log 2024-04-17T17:54:16.626 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328739.log 2024-04-17T17:54:16.628 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.372943.log.gz 2024-04-17T17:54:16.628 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.33259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.445068.log 2024-04-17T17:54:16.629 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1%/var/log/ceph/ceph-client.admin.201983.log: -- replaced with /var/log/ceph/ceph-client.admin.381821.log.gz 2024-04-17T17:54:16.629 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.328739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37620.log 2024-04-17T17:54:16.629 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.425691.log.gz 2024-04-17T17:54:16.631 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.445068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.445961.log 2024-04-17T17:54:16.633 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.37620.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.387161.log.gz 2024-04-17T17:54:16.633 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.435050.log 2024-04-17T17:54:16.633 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.445961.log: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.316035.log.gz 2024-04-17T17:54:16.634 INFO:teuthology.orchestra.run.smithi152.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.132276.log.gz 2024-04-17T17:54:16.635 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309923.log 2024-04-17T17:54:16.636 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198968.log 2024-04-17T17:54:16.636 INFO:teuthology.orchestra.run.smithi152.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.318134.log.gz 2024-04-17T17:54:16.638 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.435050.log: /var/log/ceph/ceph-client.admin.309923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159198.log 2024-04-17T17:54:16.640 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.198968.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.222169.log.gz 2024-04-17T17:54:16.640 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.465219.log 2024-04-17T17:54:16.641 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320176.log 2024-04-17T17:54:16.642 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.465219.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.309923.log.gz 2024-04-17T17:54:16.643 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.252468.log.gz 2024-04-17T17:54:16.643 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165282.log 2024-04-17T17:54:16.644 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.159198.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.328739.log.gz 2024-04-17T17:54:16.644 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.320176.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.190582.log.gz 2024-04-17T17:54:16.645 INFO:teuthology.orchestra.run.smithi152.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.336329.log.gz 2024-04-17T17:54:16.645 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318541.log 2024-04-17T17:54:16.646 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.313580.log.gz 2024-04-17T17:54:16.647 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36382.log 2024-04-17T17:54:16.647 INFO:teuthology.orchestra.run.smithi152.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.363204.log.gz 2024-04-17T17:54:16.648 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.165282.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.201091.log.gz 2024-04-17T17:54:16.649 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.318541.log: -- /var/log/ceph/ceph-client.admin.392100.log 2024-04-17T17:54:16.652 INFO:teuthology.orchestra.run.smithi152.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.370070.log.gz 2024-04-17T17:54:16.652 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340774.log 2024-04-17T17:54:16.652 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.36382.log: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.369628.log.gz 2024-04-17T17:54:16.652 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494602.log 2024-04-17T17:54:16.653 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.421527.log.gz 2024-04-17T17:54:16.654 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.340774.log: /var/log/ceph/ceph-client.admin.392100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203320.log 2024-04-17T17:54:16.656 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.494602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326580.log 2024-04-17T17:54:16.657 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.436204.log 2024-04-17T17:54:16.658 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.326580.log: /var/log/ceph/ceph-client.admin.203320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420164.log 2024-04-17T17:54:16.660 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.436204.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.298260.log.gz 2024-04-17T17:54:16.662 INFO:teuthology.orchestra.run.smithi152.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.174171.log.gz 2024-04-17T17:54:16.662 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251066.log 2024-04-17T17:54:16.662 INFO:teuthology.orchestra.run.smithi152.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.2.35939.log.gz 2024-04-17T17:54:16.662 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.298269.log.gz 2024-04-17T17:54:16.664 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.420164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472537.log 2024-04-17T17:54:16.664 INFO:teuthology.orchestra.run.smithi152.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33505.log.gz 2024-04-17T17:54:16.666 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.251066.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35406.log.gz 2024-04-17T17:54:16.666 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332543.log 2024-04-17T17:54:16.668 INFO:teuthology.orchestra.run.smithi152.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36382.log.gz 2024-04-17T17:54:16.668 INFO:teuthology.orchestra.run.smithi152.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.173303.log.gz 2024-04-17T17:54:16.669 INFO:teuthology.orchestra.run.smithi152.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.488237.log.gz 2024-04-17T17:54:16.669 INFO:teuthology.orchestra.run.smithi152.stderr: 88.9%/var/log/ceph/ceph-client.admin.472537.log: -- replaced with /var/log/ceph/ceph-client.admin.37620.log.gz 2024-04-17T17:54:16.669 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388387.log 2024-04-17T17:54:16.671 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97441.log 2024-04-17T17:54:16.672 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.332543.log: /var/log/ceph/ceph-client.admin.388387.log: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.293777.log.gz 2024-04-17T17:54:16.672 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34984.log 2024-04-17T17:54:16.673 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94096.log 2024-04-17T17:54:16.675 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.34984.log: /var/log/ceph/ceph-client.admin.97441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37279.log 2024-04-17T17:54:16.676 INFO:teuthology.orchestra.run.smithi152.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.202848.log.gz 2024-04-17T17:54:16.677 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.444670.log 2024-04-17T17:54:16.678 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.94096.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33259.log.gz 2024-04-17T17:54:16.679 INFO:teuthology.orchestra.run.smithi152.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.361521.log.gz 2024-04-17T17:54:16.680 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.37279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34991.log 2024-04-17T17:54:16.680 INFO:teuthology.orchestra.run.smithi152.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.165273.log.gz 2024-04-17T17:54:16.681 INFO:teuthology.orchestra.run.smithi152.stderr: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.435050.log.gz 2024-04-17T17:54:16.682 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.430732.log.gz 2024-04-17T17:54:16.682 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.444670.log: gzip -5 --verbose 81.3% -- /var/log/ceph/ceph-client.admin.313174.log 2024-04-17T17:54:16.683 INFO:teuthology.orchestra.run.smithi152.stderr: -- replaced with /var/log/ceph/ceph-client.admin.198968.log.gz 2024-04-17T17:54:16.685 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.34991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300720.log 2024-04-17T17:54:16.685 INFO:teuthology.orchestra.run.smithi152.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.154645.log.gz 2024-04-17T17:54:16.686 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.313174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112004.log 2024-04-17T17:54:16.689 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.300720.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.472537.log.gz 2024-04-17T17:54:16.689 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243932.log 2024-04-17T17:54:16.690 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.112004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226604.log 2024-04-17T17:54:16.692 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.243932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33914.log 2024-04-17T17:54:16.694 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38301.log 2024-04-17T17:54:16.696 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.226604.log: /var/log/ceph/ceph-client.admin.33914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187590.log 2024-04-17T17:54:16.697 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.503138.log 2024-04-17T17:54:16.699 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.38301.log: /var/log/ceph/ceph-client.admin.187590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469225.log 2024-04-17T17:54:16.701 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.503138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129770.log 2024-04-17T17:54:16.702 INFO:teuthology.orchestra.run.smithi152.stderr: 94.5% -- replaced with /var/log/ceph/ceph-client.admin.341272.log.gz 2024-04-17T17:54:16.703 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33583.log 2024-04-17T17:54:16.705 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.469225.log: /var/log/ceph/ceph-client.admin.129770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416012.log 2024-04-17T17:54:16.707 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.33583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467864.log 2024-04-17T17:54:16.710 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.416012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36831.log 2024-04-17T17:54:16.711 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34228.log 2024-04-17T17:54:16.713 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.467864.log: /var/log/ceph/ceph-client.admin.36831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37040.log 2024-04-17T17:54:16.716 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.34228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181489.log 2024-04-17T17:54:16.717 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441608.log 2024-04-17T17:54:16.719 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.37040.log: /var/log/ceph/ceph-client.admin.181489.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.453601.log.gz 2024-04-17T17:54:16.719 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421518.log 2024-04-17T17:54:16.722 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.441608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210442.log 2024-04-17T17:54:16.722 INFO:teuthology.orchestra.run.smithi152.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.416012.log.gz 2024-04-17T17:54:16.724 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.421518.log: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.493323.log.gz 2024-04-17T17:54:16.724 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334997.log 2024-04-17T17:54:16.727 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.210442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378884.log 2024-04-17T17:54:16.727 INFO:teuthology.orchestra.run.smithi152.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.251066.log.gz 2024-04-17T17:54:16.727 INFO:teuthology.orchestra.run.smithi152.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.34991.log.gz 2024-04-17T17:54:16.728 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.419757.log 2024-04-17T17:54:16.730 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.378884.log: /var/log/ceph/ceph-client.admin.334997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168465.log 2024-04-17T17:54:16.732 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.419757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230697.log 2024-04-17T17:54:16.732 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.318541.log.gz 2024-04-17T17:54:16.734 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439527.log 2024-04-17T17:54:16.735 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.168465.log: /var/log/ceph/ceph-client.admin.230697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387983.log 2024-04-17T17:54:16.737 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.439527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369224.log 2024-04-17T17:54:16.738 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33964.log 2024-04-17T17:54:16.739 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.387983.log: /var/log/ceph/ceph-client.admin.369224.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.494602.log.gz 2024-04-17T17:54:16.740 INFO:teuthology.orchestra.run.smithi152.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.495022.log.gz 2024-04-17T17:54:16.741 INFO:teuthology.orchestra.run.smithi152.stderr: 83.6% -- replaced with /var/log/ceph/ceph-client.admin.501861.log.gz 2024-04-17T17:54:16.741 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389645.log 2024-04-17T17:54:16.742 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447996.log 2024-04-17T17:54:16.744 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.389645.log: /var/log/ceph/ceph-client.admin.33964.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.328748.log.gz 2024-04-17T17:54:16.744 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400060.log 2024-04-17T17:54:16.746 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.447996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295009.log 2024-04-17T17:54:16.748 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187174.log 2024-04-17T17:54:16.750 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.400060.log: /var/log/ceph/ceph-client.admin.295009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233147.log 2024-04-17T17:54:16.750 INFO:teuthology.orchestra.run.smithi152.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.430167.log.gz 2024-04-17T17:54:16.750 INFO:teuthology.orchestra.run.smithi152.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.456879.log.gz 2024-04-17T17:54:16.751 INFO:teuthology.orchestra.run.smithi152.stderr: 89.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-17T17:54:16.751 INFO:teuthology.orchestra.run.smithi152.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.465219.log.gz 2024-04-17T17:54:16.752 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227417.log 2024-04-17T17:54:16.752 INFO:teuthology.orchestra.run.smithi152.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.332543.log.gz 2024-04-17T17:54:16.753 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.187174.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.201983.log.gz 2024-04-17T17:54:16.753 INFO:teuthology.orchestra.run.smithi152.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.419757.log.gz 2024-04-17T17:54:16.754 INFO:teuthology.orchestra.run.smithi152.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.421518.log.gz 2024-04-17T17:54:16.755 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.233147.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.436204.log.gz 2024-04-17T17:54:16.755 INFO:teuthology.orchestra.run.smithi152.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.420164.log.gz 2024-04-17T17:54:16.755 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231914.log 2024-04-17T17:54:16.757 INFO:teuthology.orchestra.run.smithi152.stderr: 87.8% 93.7% -- replaced with /var/log/ceph/ceph-client.admin.450477.log.gz 2024-04-17T17:54:16.757 INFO:teuthology.orchestra.run.smithi152.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33674.log.gz 2024-04-17T17:54:16.757 INFO:teuthology.orchestra.run.smithi152.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36250.log.gz 2024-04-17T17:54:16.757 INFO:teuthology.orchestra.run.smithi152.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.401327.log.gz 2024-04-17T17:54:16.758 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.227417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237760.log 2024-04-17T17:54:16.760 INFO:teuthology.orchestra.run.smithi152.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34228.log.gz 2024-04-17T17:54:16.760 INFO:teuthology.orchestra.run.smithi152.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.94096.log.gz 2024-04-17T17:54:16.760 INFO:teuthology.orchestra.run.smithi152.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37279.log.gz 2024-04-17T17:54:16.761 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.231914.log: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.187174.log.gz 2024-04-17T17:54:16.762 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.187590.log.gz 2024-04-17T17:54:16.762 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242235.log 2024-04-17T17:54:16.765 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.237760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136815.log 2024-04-17T17:54:16.767 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.242235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252459.log 2024-04-17T17:54:16.767 INFO:teuthology.orchestra.run.smithi152.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.227417.log.gz 2024-04-17T17:54:16.768 INFO:teuthology.orchestra.run.smithi152.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.230697.log.gz 2024-04-17T17:54:16.769 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.136815.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.233147.log.gz 2024-04-17T17:54:16.769 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411711.log 2024-04-17T17:54:16.770 INFO:teuthology.orchestra.run.smithi152.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.231914.log.gz 2024-04-17T17:54:16.771 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391284.log 2024-04-17T17:54:16.774 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.411711.log: /var/log/ceph/ceph-client.admin.252459.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.375463.log.gz 2024-04-17T17:54:16.774 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.422330.log 2024-04-17T17:54:16.776 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.391284.log: 90.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.444670.log.gz -5 2024-04-17T17:54:16.776 INFO:teuthology.orchestra.run.smithi152.stderr: --verbose -- /var/log/ceph/ceph-client.admin.309932.log 2024-04-17T17:54:16.778 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.422330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106874.log 2024-04-17T17:54:16.781 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.309932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37385.log 2024-04-17T17:54:16.782 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82506.log 2024-04-17T17:54:16.785 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.106874.log: /var/log/ceph/ceph-client.admin.37385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128503.log 2024-04-17T17:54:16.787 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.82506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319760.log 2024-04-17T17:54:16.788 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384697.log 2024-04-17T17:54:16.791 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.128503.log: /var/log/ceph/ceph-client.admin.319760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295823.log 2024-04-17T17:54:16.792 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.384697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363640.log 2024-04-17T17:54:16.794 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.295823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297457.log 2024-04-17T17:54:16.796 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27758.log 2024-04-17T17:54:16.798 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.363640.log: /var/log/ceph/ceph-client.admin.297457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112422.log 2024-04-17T17:54:16.801 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.27758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446361.log 2024-04-17T17:54:16.802 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78136.log 2024-04-17T17:54:16.804 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.112422.log: /var/log/ceph/ceph-client.admin.446361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169434.log 2024-04-17T17:54:16.805 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323915.log 2024-04-17T17:54:16.807 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.78136.log: /var/log/ceph/ceph-client.admin.169434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.296640.log 2024-04-17T17:54:16.810 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.323915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183104.log 2024-04-17T17:54:16.812 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.296640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472546.log 2024-04-17T17:54:16.814 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.183104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390462.log 2024-04-17T17:54:16.815 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366750.log 2024-04-17T17:54:16.817 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.390462.log: /var/log/ceph/ceph-client.admin.472546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203311.log 2024-04-17T17:54:16.820 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.366750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.484274.log 2024-04-17T17:54:16.822 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.203311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321404.log 2024-04-17T17:54:16.825 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.484274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442925.log 2024-04-17T17:54:16.825 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220944.log 2024-04-17T17:54:16.827 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.442925.log: /var/log/ceph/ceph-client.admin.321404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130192.log 2024-04-17T17:54:16.829 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.220944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512547.log 2024-04-17T17:54:16.831 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.130192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244773.log 2024-04-17T17:54:16.833 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.512547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199786.log 2024-04-17T17:54:16.834 INFO:teuthology.orchestra.run.smithi152.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.512547.log.gz 2024-04-17T17:54:16.835 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.244773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.435599.log 2024-04-17T17:54:16.838 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.199786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512045.log 2024-04-17T17:54:16.839 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304901.log 2024-04-17T17:54:16.840 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.435599.log: /var/log/ceph/ceph-client.admin.512045.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.512045.log.gz 2024-04-17T17:54:16.841 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402774.log 2024-04-17T17:54:16.844 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.304901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.508310.log 2024-04-17T17:54:16.846 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.402774.log: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.427854.log.gz 2024-04-17T17:54:16.846 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512750.log 2024-04-17T17:54:16.847 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200201.log 2024-04-17T17:54:16.848 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.512750.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.512750.log.gz 2024-04-17T17:54:16.850 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.508310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192641.log 2024-04-17T17:54:16.851 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512469.log 2024-04-17T17:54:16.851 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.200201.log: /var/log/ceph/ceph-client.admin.192641.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.378884.log.gz 2024-04-17T17:54:16.853 INFO:teuthology.orchestra.run.smithi152.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.508310.log.gz 2024-04-17T17:54:16.853 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512391.log 2024-04-17T17:54:16.855 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99076.log 2024-04-17T17:54:16.856 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.512391.log: /var/log/ceph/ceph-client.admin.512469.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.512391.log.gz 2024-04-17T17:54:16.858 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362400.log 2024-04-17T17:54:16.858 INFO:teuthology.orchestra.run.smithi152.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.512469.log.gz 2024-04-17T17:54:16.860 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.99076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378473.log 2024-04-17T17:54:16.862 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372079.log 2024-04-17T17:54:16.864 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.362400.log: /var/log/ceph/ceph-client.admin.378473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198156.log 2024-04-17T17:54:16.866 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238175.log 2024-04-17T17:54:16.867 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.372079.log: /var/log/ceph/ceph-client.admin.198156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485560.log 2024-04-17T17:54:16.869 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.238175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.505342.log 2024-04-17T17:54:16.871 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.485560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168871.log 2024-04-17T17:54:16.873 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.505342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199389.log 2024-04-17T17:54:16.875 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.168871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33862.log 2024-04-17T17:54:16.877 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.199389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512573.log 2024-04-17T17:54:16.879 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.33862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243516.log 2024-04-17T17:54:16.881 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.512573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305745.log 2024-04-17T17:54:16.882 INFO:teuthology.orchestra.run.smithi152.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.512573.log.gz 2024-04-17T17:54:16.883 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106006.log 2024-04-17T17:54:16.885 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.243516.log: /var/log/ceph/ceph-client.admin.305745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33836.log 2024-04-17T17:54:16.886 INFO:teuthology.orchestra.run.smithi152.stderr: 78.6% -- replaced with /var/log/ceph/ceph-client.admin.252459.log.gz 2024-04-17T17:54:16.886 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443801.log 2024-04-17T17:54:16.888 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.33836.log: /var/log/ceph/ceph-client.admin.106006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335874.log 2024-04-17T17:54:16.889 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.443801.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.298680.log.gz 2024-04-17T17:54:16.890 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365509.log 2024-04-17T17:54:16.892 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.335874.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.473762.log.gz 2024-04-17T17:54:16.893 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194859.log 2024-04-17T17:54:16.894 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.365509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301122.log 2024-04-17T17:54:16.897 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.194859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80777.log 2024-04-17T17:54:16.899 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.301122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34704.log 2024-04-17T17:54:16.899 INFO:teuthology.orchestra.run.smithi152.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.129770.log.gz 2024-04-17T17:54:16.900 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221365.log 2024-04-17T17:54:16.900 INFO:teuthology.orchestra.run.smithi152.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.500144.log.gz 2024-04-17T17:54:16.902 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.80777.log: /var/log/ceph/ceph-client.admin.34704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184738.log 2024-04-17T17:54:16.902 INFO:teuthology.orchestra.run.smithi152.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.176333.log.gz 2024-04-17T17:54:16.905 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.221365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.428816.log 2024-04-17T17:54:16.905 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.320176.log.gz 2024-04-17T17:54:16.906 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.184738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.492098.log 2024-04-17T17:54:16.908 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34778.log 2024-04-17T17:54:16.908 INFO:teuthology.orchestra.run.smithi152.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.420578.log.gz 2024-04-17T17:54:16.910 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.428816.log: /var/log/ceph/ceph-client.admin.492098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390471.log 2024-04-17T17:54:16.910 INFO:teuthology.orchestra.run.smithi152.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33836.log.gz 2024-04-17T17:54:16.911 INFO:teuthology.orchestra.run.smithi152.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37542.log.gz 2024-04-17T17:54:16.911 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.34778.log: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.505351.log.gz 2024-04-17T17:54:16.913 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33479.log 2024-04-17T17:54:16.914 INFO:teuthology.orchestra.run.smithi152.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.128503.log.gz 2024-04-17T17:54:16.914 INFO:teuthology.orchestra.run.smithi152.stderr:gzip 84.9% -5 -- replaced with /var/log/ceph/ceph-client.admin.206732.log.gz 2024-04-17T17:54:16.915 INFO:teuthology.orchestra.run.smithi152.stderr: --verbose -- /var/log/ceph/ceph-client.admin.456451.log 2024-04-17T17:54:16.916 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.390471.log: /var/log/ceph/ceph-client.admin.33479.log: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.340774.log.gz 2024-04-17T17:54:16.917 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345073.log 2024-04-17T17:54:16.918 INFO:teuthology.orchestra.run.smithi152.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.327520.log.gz 2024-04-17T17:54:16.919 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378062.log 2024-04-17T17:54:16.920 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.456451.log: /var/log/ceph/ceph-client.admin.345073.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.384697.log.gz 2024-04-17T17:54:16.921 INFO:teuthology.orchestra.run.smithi152.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.221365.log.gz 2024-04-17T17:54:16.921 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.184738.log.gz 2024-04-17T17:54:16.921 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.300720.log.gz 2024-04-17T17:54:16.921 INFO:teuthology.orchestra.run.smithi152.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.422330.log.gz 2024-04-17T17:54:16.922 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512417.log 2024-04-17T17:54:16.923 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.378062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241432.log 2024-04-17T17:54:16.924 INFO:teuthology.orchestra.run.smithi152.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.483017.log.gz 2024-04-17T17:54:16.924 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.512417.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.512417.log.gz 2024-04-17T17:54:16.925 INFO:teuthology.orchestra.run.smithi152.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.472546.log.gz 2024-04-17T17:54:16.925 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.402774.log.gz 2024-04-17T17:54:16.926 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94918.log 2024-04-17T17:54:16.927 INFO:teuthology.orchestra.run.smithi152.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.242235.log.gz 2024-04-17T17:54:16.927 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.453127.log 2024-04-17T17:54:16.929 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.94918.log: /var/log/ceph/ceph-client.admin.241432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33452.log 2024-04-17T17:54:16.931 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.453127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131830.log 2024-04-17T17:54:16.933 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.33452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175465.log 2024-04-17T17:54:16.935 INFO:teuthology.orchestra.run.smithi152.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.504903.log.gz 2024-04-17T17:54:16.936 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.131830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380554.log 2024-04-17T17:54:16.939 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.175465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360278.log 2024-04-17T17:54:16.941 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326114.log 2024-04-17T17:54:16.941 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.111598.log.gz 2024-04-17T17:54:16.942 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.130192.log.gz 2024-04-17T17:54:16.943 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.360278.log: /var/log/ceph/ceph-client.admin.380554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84298.log 2024-04-17T17:54:16.946 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.326114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429288.log 2024-04-17T17:54:16.947 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475390.log 2024-04-17T17:54:16.949 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.84298.log: /var/log/ceph/ceph-client.admin.429288.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.221771.log.gz 2024-04-17T17:54:16.950 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195274.log 2024-04-17T17:54:16.950 INFO:teuthology.orchestra.run.smithi152.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.27758.log.gz 2024-04-17T17:54:16.951 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37489.log 2024-04-17T17:54:16.953 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.475390.log: /var/log/ceph/ceph-client.admin.195274.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.237760.log.gz 2024-04-17T17:54:16.954 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.513005.log 2024-04-17T17:54:16.956 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.37489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373344.log 2024-04-17T17:54:16.958 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.513005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477028.log 2024-04-17T17:54:16.959 INFO:teuthology.orchestra.run.smithi152.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.513005.log.gz 2024-04-17T17:54:16.959 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332136.log 2024-04-17T17:54:16.960 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.373344.log: /var/log/ceph/ceph-client.admin.477028.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.321404.log.gz 2024-04-17T17:54:16.962 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.411711.log.gz 2024-04-17T17:54:16.962 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411702.log 2024-04-17T17:54:16.964 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.332136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319354.log 2024-04-17T17:54:16.965 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95731.log 2024-04-17T17:54:16.966 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.411702.log: /var/log/ceph/ceph-client.admin.319354.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.106006.log.gz 2024-04-17T17:54:16.967 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365500.log 2024-04-17T17:54:16.969 INFO:teuthology.orchestra.run.smithi152.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.378062.log.gz 2024-04-17T17:54:16.970 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.95731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101103.log 2024-04-17T17:54:16.972 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158320.log 2024-04-17T17:54:16.972 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.402369.log.gz 2024-04-17T17:54:16.973 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.365500.log: /var/log/ceph/ceph-client.admin.101103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439518.log 2024-04-17T17:54:16.975 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.158320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456046.log 2024-04-17T17:54:16.976 INFO:teuthology.orchestra.run.smithi152.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34704.log.gz 2024-04-17T17:54:16.978 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.439518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421114.log 2024-04-17T17:54:16.979 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426558.log 2024-04-17T17:54:16.979 INFO:teuthology.orchestra.run.smithi152.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.34778.log.gz 2024-04-17T17:54:16.981 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.456046.log: /var/log/ceph/ceph-client.admin.421114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.435608.log 2024-04-17T17:54:16.982 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.426558.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.429288.log.gz 2024-04-17T17:54:16.982 INFO:teuthology.orchestra.run.smithi152.stderr: 90.3% 85.3% -- replaced with /var/log/ceph/ceph-client.admin.366320.log.gz -- replaced with /var/log/ceph/ceph-client.admin.373344.log.gz 2024-04-17T17:54:16.982 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-04-17T17:54:16.983 INFO:teuthology.orchestra.run.smithi152.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.428816.log.gz 2024-04-17T17:54:16.983 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.330013.log.gz 2024-04-17T17:54:16.984 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326105.log 2024-04-17T17:54:16.985 INFO:teuthology.orchestra.run.smithi152.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.392100.log.gz 2024-04-17T17:54:16.985 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253282.log 2024-04-17T17:54:16.986 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.435608.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.332136.log.gz 2024-04-17T17:54:16.987 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403171.log 2024-04-17T17:54:16.988 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.326105.log: /var/log/ceph/ceph-client.admin.253282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.453383.log 2024-04-17T17:54:16.990 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.403171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38398.log 2024-04-17T17:54:16.993 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.453383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476621.log 2024-04-17T17:54:16.995 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.38398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367583.log 2024-04-17T17:54:16.996 INFO:teuthology.orchestra.run.smithi152.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.103554.log.gz 2024-04-17T17:54:16.996 INFO:teuthology.orchestra.run.smithi152.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.175465.log.gz 2024-04-17T17:54:16.998 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.476621.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.403171.log.gz 2024-04-17T17:54:16.998 INFO:teuthology.orchestra.run.smithi152.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.421114.log.gz 2024-04-17T17:54:16.999 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512776.log 2024-04-17T17:54:17.001 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.367583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394571.log 2024-04-17T17:54:17.003 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.512776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228645.log 2024-04-17T17:54:17.004 INFO:teuthology.orchestra.run.smithi152.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.512776.log.gz 2024-04-17T17:54:17.005 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305348.log 2024-04-17T17:54:17.006 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.394571.log: /var/log/ceph/ceph-client.admin.228645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387572.log 2024-04-17T17:54:17.008 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.305348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131419.log 2024-04-17T17:54:17.009 INFO:teuthology.orchestra.run.smithi152.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.453127.log.gz 2024-04-17T17:54:17.010 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.387572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437898.log 2024-04-17T17:54:17.010 INFO:teuthology.orchestra.run.smithi152.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.136815.log.gz 2024-04-17T17:54:17.011 INFO:teuthology.orchestra.run.smithi152.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.334997.log.gz 2024-04-17T17:54:17.013 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.131419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495866.log 2024-04-17T17:54:17.015 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.437898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212481.log 2024-04-17T17:54:17.017 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.495866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108644.log 2024-04-17T17:54:17.018 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96985.log 2024-04-17T17:54:17.020 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.212481.log: /var/log/ceph/ceph-client.admin.108644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198562.log 2024-04-17T17:54:17.022 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.96985.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.456046.log.gz 2024-04-17T17:54:17.022 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155453.log 2024-04-17T17:54:17.025 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.198562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196483.log 2024-04-17T17:54:17.025 INFO:teuthology.orchestra.run.smithi152.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33479.log.gz 2024-04-17T17:54:17.026 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232334.log 2024-04-17T17:54:17.027 INFO:teuthology.orchestra.run.smithi152.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33452.log.gz 2024-04-17T17:54:17.028 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.155453.log: /var/log/ceph/ceph-client.admin.196483.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37489.log.gz 2024-04-17T17:54:17.028 INFO:teuthology.orchestra.run.smithi152.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.479470.log.gz 2024-04-17T17:54:17.029 INFO:teuthology.orchestra.run.smithi152.stderr: 79.0% -- replaced with /var/log/ceph/ceph-client.admin.196483.log.gz 2024-04-17T17:54:17.029 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.513031.log 2024-04-17T17:54:17.030 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.360278.log.gz 2024-04-17T17:54:17.030 INFO:teuthology.orchestra.run.smithi152.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.228645.log.gz 2024-04-17T17:54:17.031 INFO:teuthology.orchestra.run.smithi152.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.399254.log.gz 2024-04-17T17:54:17.031 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160547.log 2024-04-17T17:54:17.032 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.232334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.460371.log 2024-04-17T17:54:17.032 INFO:teuthology.orchestra.run.smithi152.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.339807.log.gz 2024-04-17T17:54:17.034 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.160547.log: /var/log/ceph/ceph-client.admin.513031.log: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.345073.log.gz 2024-04-17T17:54:17.034 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463985.log 2024-04-17T17:54:17.036 INFO:teuthology.orchestra.run.smithi152.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.513031.log.gz 2024-04-17T17:54:17.036 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.513319.log 2024-04-17T17:54:17.037 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.460371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37014.log 2024-04-17T17:54:17.037 INFO:teuthology.orchestra.run.smithi152.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35588.log.gz 2024-04-17T17:54:17.037 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.437898.log.gz 2024-04-17T17:54:17.038 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.513319.log: /var/log/ceph/ceph-client.admin.463985.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.513319.log.gz 2024-04-17T17:54:17.038 INFO:teuthology.orchestra.run.smithi152.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38548.log.gz 2024-04-17T17:54:17.039 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310743.log 2024-04-17T17:54:17.039 INFO:teuthology.orchestra.run.smithi152.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.439518.log.gz 2024-04-17T17:54:17.040 INFO:teuthology.orchestra.run.smithi152.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.463985.log.gz 2024-04-17T17:54:17.041 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.37014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316913.log 2024-04-17T17:54:17.042 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.310743.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.476621.log.gz 2024-04-17T17:54:17.043 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217262.log 2024-04-17T17:54:17.043 INFO:teuthology.orchestra.run.smithi152.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.501432.log.gz 2024-04-17T17:54:17.043 INFO:teuthology.orchestra.run.smithi152.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.481946.log.gz 2024-04-17T17:54:17.045 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.316913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.425682.log 2024-04-17T17:54:17.046 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.217262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27656.log 2024-04-17T17:54:17.048 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170725.log 2024-04-17T17:54:17.049 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.425682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171585.log 2024-04-17T17:54:17.051 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.170725.log: /var/log/ceph/ceph-client.admin.27656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400474.log 2024-04-17T17:54:17.052 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128512.log 2024-04-17T17:54:17.054 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.171585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512495.log 2024-04-17T17:54:17.056 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.400474.log: /var/log/ceph/ceph-client.admin.128512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.507027.log 2024-04-17T17:54:17.057 INFO:teuthology.orchestra.run.smithi152.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.397590.log.gz 2024-04-17T17:54:17.057 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427384.log 2024-04-17T17:54:17.057 INFO:teuthology.orchestra.run.smithi152.stderr: 78.8% -- replaced with /var/log/ceph/ceph-client.admin.198562.log.gz 2024-04-17T17:54:17.058 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.507027.log: /var/log/ceph/ceph-client.admin.512495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33732.log 2024-04-17T17:54:17.060 INFO:teuthology.orchestra.run.smithi152.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.512495.log.gz 2024-04-17T17:54:17.060 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.427384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429297.log 2024-04-17T17:54:17.062 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.33732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381401.log 2024-04-17T17:54:17.063 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112431.log 2024-04-17T17:54:17.065 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.429297.log: /var/log/ceph/ceph-client.admin.381401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108189.log 2024-04-17T17:54:17.067 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205896.log 2024-04-17T17:54:17.068 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.112431.log: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.244773.log.gz 2024-04-17T17:54:17.069 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.108189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380143.log 2024-04-17T17:54:17.071 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299909.log 2024-04-17T17:54:17.073 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.205896.log: /var/log/ceph/ceph-client.admin.380143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93256.log 2024-04-17T17:54:17.073 INFO:teuthology.orchestra.run.smithi152.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.425682.log.gz 2024-04-17T17:54:17.074 INFO:teuthology.orchestra.run.smithi152.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.426558.log.gz 2024-04-17T17:54:17.074 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215581.log 2024-04-17T17:54:17.076 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.299909.log: /var/log/ceph/ceph-client.admin.93256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36564.log 2024-04-17T17:54:17.078 INFO:teuthology.orchestra.run.smithi152.stderr:gzip/var/log/ceph/ceph-client.admin.215581.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.450935.log 2024-04-17T17:54:17.079 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.506204.log 2024-04-17T17:54:17.081 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.36564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.513161.log 2024-04-17T17:54:17.083 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.450935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294602.log 2024-04-17T17:54:17.085 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.506204.log: /var/log/ceph/ceph-client.admin.513161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457300.log 2024-04-17T17:54:17.085 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.310743.log.gz 2024-04-17T17:54:17.086 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.131419.log.gz 2024-04-17T17:54:17.086 INFO:teuthology.orchestra.run.smithi152.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.513161.log.gz 2024-04-17T17:54:17.087 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182301.log 2024-04-17T17:54:17.088 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.294602.log: /var/log/ceph/ceph-client.admin.457300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36616.log 2024-04-17T17:54:17.089 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.316913.log.gz 2024-04-17T17:54:17.090 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.182301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184332.log 2024-04-17T17:54:17.092 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.36616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36779.log 2024-04-17T17:54:17.093 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.184332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155047.log 2024-04-17T17:54:17.095 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220131.log 2024-04-17T17:54:17.097 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.36779.log: /var/log/ceph/ceph-client.admin.155047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37807.log 2024-04-17T17:54:17.098 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34992.log 2024-04-17T17:54:17.099 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.220131.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.338980.log.gz 2024-04-17T17:54:17.100 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370079.log 2024-04-17T17:54:17.101 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.34992.log: /var/log/ceph/ceph-client.admin.37807.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.299909.log.gz 2024-04-17T17:54:17.101 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224518.log 2024-04-17T17:54:17.102 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.300315.log.gz 2024-04-17T17:54:17.103 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388396.log 2024-04-17T17:54:17.104 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.370079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333374.log 2024-04-17T17:54:17.106 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.388396.log: /var/log/ceph/ceph-client.admin.224518.log: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.388387.log.gz 2024-04-17T17:54:17.106 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.501870.log 2024-04-17T17:54:17.108 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.333374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294593.log 2024-04-17T17:54:17.108 INFO:teuthology.orchestra.run.smithi152.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.387983.log.gz 2024-04-17T17:54:17.108 INFO:teuthology.orchestra.run.smithi152.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.326105.log.gz 2024-04-17T17:54:17.109 INFO:teuthology.orchestra.run.smithi152.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.391284.log.gz 2024-04-17T17:54:17.110 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.501870.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.331722.log.gz 2024-04-17T17:54:17.110 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.390471.log.gz 2024-04-17T17:54:17.110 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38983.log 2024-04-17T17:54:17.112 INFO:teuthology.orchestra.run.smithi152.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.411702.log.gz 2024-04-17T17:54:17.113 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.294593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424473.log 2024-04-17T17:54:17.114 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.38983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77543.log 2024-04-17T17:54:17.116 INFO:teuthology.orchestra.run.smithi152.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38812.log.gz 2024-04-17T17:54:17.117 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.424473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44131.log 2024-04-17T17:54:17.118 INFO:teuthology.orchestra.run.smithi152.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.112431.log.gz 2024-04-17T17:54:17.118 INFO:teuthology.orchestra.run.smithi152.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38983.log.gz 2024-04-17T17:54:17.119 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.77543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39113.log 2024-04-17T17:54:17.121 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104362.log 2024-04-17T17:54:17.121 INFO:teuthology.orchestra.run.smithi152.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38145.log.gz 2024-04-17T17:54:17.123 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.44131.log: /var/log/ceph/ceph-client.admin.39113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317727.log 2024-04-17T17:54:17.123 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.131013.log.gz 2024-04-17T17:54:17.125 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.104362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.486012.log 2024-04-17T17:54:17.126 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92821.log 2024-04-17T17:54:17.126 INFO:teuthology.orchestra.run.smithi152.stderr: 87.8% 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38398.log.gz -- replaced with /var/log/ceph/ceph-client.admin.38327.log.gz 2024-04-17T17:54:17.127 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-04-17T17:54:17.127 INFO:teuthology.orchestra.run.smithi152.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.155047.log.gz 2024-04-17T17:54:17.127 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.486012.log: /var/log/ceph/ceph-client.admin.317727.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.460371.log.gz 2024-04-17T17:54:17.128 INFO:teuthology.orchestra.run.smithi152.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.155453.log.gz 2024-04-17T17:54:17.129 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138149.log 2024-04-17T17:54:17.131 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97840.log 2024-04-17T17:54:17.131 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.92821.log: /var/log/ceph/ceph-client.admin.138149.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.370079.log.gz 2024-04-17T17:54:17.131 INFO:teuthology.orchestra.run.smithi152.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.33732.log.gz 2024-04-17T17:54:17.133 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.430723.log 2024-04-17T17:54:17.135 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.97840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35250.log 2024-04-17T17:54:17.137 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.430723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236948.log 2024-04-17T17:54:17.138 INFO:teuthology.orchestra.run.smithi152.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.171159.log.gz 2024-04-17T17:54:17.138 INFO:teuthology.orchestra.run.smithi152.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.92821.log.gz 2024-04-17T17:54:17.139 INFO:teuthology.orchestra.run.smithi152.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.93256.log.gz 2024-04-17T17:54:17.140 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.35250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205082.log 2024-04-17T17:54:17.141 INFO:teuthology.orchestra.run.smithi152.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.138149.log.gz 2024-04-17T17:54:17.141 INFO:teuthology.orchestra.run.smithi152.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.208771.log.gz 2024-04-17T17:54:17.142 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.236948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172462.log 2024-04-17T17:54:17.143 INFO:teuthology.orchestra.run.smithi152.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.484756.log.gz 2024-04-17T17:54:17.145 INFO:teuthology.orchestra.run.smithi152.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.191821.log.gz 2024-04-17T17:54:17.146 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.205082.log: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.359385.log.gz 2024-04-17T17:54:17.146 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-17T17:54:17.149 INFO:teuthology.orchestra.run.smithi152.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.232334.log.gz 2024-04-17T17:54:17.149 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.172462.log: 83.6% -- replaced with /var/log/ceph/ceph-client.admin.205082.log.gz 2024-04-17T17:54:17.149 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.301131.log.gz 2024-04-17T17:54:17.149 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.380143.log.gz 2024-04-17T17:54:17.149 INFO:teuthology.orchestra.run.smithi152.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.375860.log.gz 2024-04-17T17:54:17.150 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.453592.log 2024-04-17T17:54:17.151 INFO:teuthology.orchestra.run.smithi152.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.131830.log.gz 2024-04-17T17:54:17.151 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233969.log 2024-04-17T17:54:17.152 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200192.log 2024-04-17T17:54:17.154 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.233969.log: /var/log/ceph/ceph-client.admin.453592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401546.log 2024-04-17T17:54:17.155 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337212.log 2024-04-17T17:54:17.157 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.200192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418538.log 2024-04-17T17:54:17.158 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.401546.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.294602.log.gz 2024-04-17T17:54:17.159 INFO:teuthology.orchestra.run.smithi152.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.294593.log.gzgzip 2024-04-17T17:54:17.159 INFO:teuthology.orchestra.run.smithi152.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.372070.log 2024-04-17T17:54:17.160 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.337212.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.157088.log.gz 2024-04-17T17:54:17.160 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.504446.log 2024-04-17T17:54:17.162 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.418538.log: /var/log/ceph/ceph-client.admin.372070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400465.log 2024-04-17T17:54:17.164 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.513395.log 2024-04-17T17:54:17.166 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.504446.log: /var/log/ceph/ceph-client.admin.400465.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.333374.log.gz 2024-04-17T17:54:17.166 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496280.log 2024-04-17T17:54:17.168 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.513395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34782.log 2024-04-17T17:54:17.168 INFO:teuthology.orchestra.run.smithi152.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.236948.log.gz 2024-04-17T17:54:17.169 INFO:teuthology.orchestra.run.smithi152.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.513395.log.gz 2024-04-17T17:54:17.169 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414260.log 2024-04-17T17:54:17.172 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.496280.log: /var/log/ceph/ceph-client.admin.34782.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-17T17:54:17.173 INFO:teuthology.orchestra.run.smithi152.stderr: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.104362.log.gz 2024-04-17T17:54:17.174 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188001.log 2024-04-17T17:54:17.175 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.414260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301542.log 2024-04-17T17:54:17.177 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-mds.c.log: /var/log/ceph/ceph-client.admin.188001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.433763.log 2024-04-17T17:54:17.178 INFO:teuthology.orchestra.run.smithi152.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37014.log.gz 2024-04-17T17:54:17.180 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.301542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128930.log 2024-04-17T17:54:17.182 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.433763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161825.log 2024-04-17T17:54:17.183 INFO:teuthology.orchestra.run.smithi152.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.506204.log.gz 2024-04-17T17:54:17.184 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127226.log 2024-04-17T17:54:17.185 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.128930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329145.log 2024-04-17T17:54:17.186 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.127226.log: /var/log/ceph/ceph-client.admin.161825.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.387572.log.gz 2024-04-17T17:54:17.187 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.435059.log 2024-04-17T17:54:17.189 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.329145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402765.log 2024-04-17T17:54:17.191 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193038.log 2024-04-17T17:54:17.192 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.435059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512849.log 2024-04-17T17:54:17.192 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.402765.log: /var/log/ceph/ceph-client.admin.193038.log: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.188435.log.gz 2024-04-17T17:54:17.193 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315628.log 2024-04-17T17:54:17.195 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.512849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34411.log 2024-04-17T17:54:17.197 INFO:teuthology.orchestra.run.smithi152.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.512849.log.gz 2024-04-17T17:54:17.197 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127681.log 2024-04-17T17:54:17.199 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.315628.log: /var/log/ceph/ceph-client.admin.34411.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-17T17:54:17.200 INFO:teuthology.orchestra.run.smithi152.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.378071.log.gz 2024-04-17T17:54:17.200 INFO:teuthology.orchestra.run.smithi152.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.415195.log.gz 2024-04-17T17:54:17.201 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165737.log 2024-04-17T17:54:17.203 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.127681.log: /var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179815.log 2024-04-17T17:54:17.203 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.424473.log.gz 2024-04-17T17:54:17.204 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418136.log 2024-04-17T17:54:17.205 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.179815.log: /var/log/ceph/ceph-client.admin.165737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163949.log 2024-04-17T17:54:17.207 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33784.log 2024-04-17T17:54:17.208 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.418136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313977.log 2024-04-17T17:54:17.210 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.163949.log: /var/log/ceph/ceph-client.admin.33784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.513265.log 2024-04-17T17:54:17.212 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440330.log 2024-04-17T17:54:17.213 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.313977.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34992.log.gz 2024-04-17T17:54:17.214 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.513265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372476.log 2024-04-17T17:54:17.214 INFO:teuthology.orchestra.run.smithi152.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34782.log.gz 2024-04-17T17:54:17.214 INFO:teuthology.orchestra.run.smithi152.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.220131.log.gz 2024-04-17T17:54:17.215 INFO:teuthology.orchestra.run.smithi152.stderr: 79.0% -- replaced with /var/log/ceph/ceph-client.admin.310734.log.gz 2024-04-17T17:54:17.218 INFO:teuthology.orchestra.run.smithi152.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.513265.log.gz 2024-04-17T17:54:17.218 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.440330.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.337212.log.gz 2024-04-17T17:54:17.218 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.317727.log.gz 2024-04-17T17:54:17.218 INFO:teuthology.orchestra.run.smithi152.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.313977.log.gz 2024-04-17T17:54:17.218 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36857.log 2024-04-17T17:54:17.219 INFO:teuthology.orchestra.run.smithi152.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.329145.log.gz 2024-04-17T17:54:17.219 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.301542.log.gz 2024-04-17T17:54:17.219 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.490637.log 2024-04-17T17:54:17.221 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.372476.log: /var/log/ceph/ceph-client.admin.36857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207951.log 2024-04-17T17:54:17.223 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.490637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372934.log 2024-04-17T17:54:17.224 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321002.log 2024-04-17T17:54:17.226 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.207951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38041.log 2024-04-17T17:54:17.226 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.372934.log: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.160547.log.gz 2024-04-17T17:54:17.228 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.321002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194270.log 2024-04-17T17:54:17.229 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.181895.log.gz 2024-04-17T17:54:17.230 INFO:teuthology.orchestra.run.smithi152.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.370476.log.gz 2024-04-17T17:54:17.230 INFO:teuthology.orchestra.run.smithi152.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.448821.log.gz 2024-04-17T17:54:17.230 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224509.log 2024-04-17T17:54:17.231 INFO:teuthology.orchestra.run.smithi152.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.92413.log.gz 2024-04-17T17:54:17.231 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.38041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103954.log 2024-04-17T17:54:17.233 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.224509.log: /var/log/ceph/ceph-client.admin.194270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412514.log 2024-04-17T17:54:17.235 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38901.log 2024-04-17T17:54:17.236 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.103954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226198.log 2024-04-17T17:54:17.238 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.412514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393759.log 2024-04-17T17:54:17.240 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.38901.log: /var/log/ceph/ceph-client.admin.226198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316026.log 2024-04-17T17:54:17.241 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.393759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197750.log 2024-04-17T17:54:17.243 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.316026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34202.log 2024-04-17T17:54:17.245 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.197750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168474.log 2024-04-17T17:54:17.247 INFO:teuthology.orchestra.run.smithi196.stderr: 95.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-17T17:54:17.247 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.34202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34769.log 2024-04-17T17:54:17.249 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.168474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158329.log 2024-04-17T17:54:17.251 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.34769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.513083.log 2024-04-17T17:54:17.253 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.452142.log 2024-04-17T17:54:17.253 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.158329.log: /var/log/ceph/ceph-client.admin.513083.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.513083.log.gz 2024-04-17T17:54:17.255 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512036.log 2024-04-17T17:54:17.255 INFO:teuthology.orchestra.run.smithi152.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.492098.log.gz 2024-04-17T17:54:17.257 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.452142.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35250.log.gz 2024-04-17T17:54:17.258 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.493793.log 2024-04-17T17:54:17.258 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.512036.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.512036.log.gz 2024-04-17T17:54:17.259 INFO:teuthology.orchestra.run.smithi152.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36857.log.gz 2024-04-17T17:54:17.259 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241829.log 2024-04-17T17:54:17.261 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.493793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164861.log 2024-04-17T17:54:17.262 INFO:teuthology.orchestra.run.smithi152.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38041.log.gz 2024-04-17T17:54:17.262 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479876.log 2024-04-17T17:54:17.263 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.241829.log: /var/log/ceph/ceph-client.admin.164861.log: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.456451.log.gz 2024-04-17T17:54:17.264 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214182.log 2024-04-17T17:54:17.265 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.479876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243118.log 2024-04-17T17:54:17.266 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38275.log 2024-04-17T17:54:17.267 INFO:teuthology.orchestra.run.smithi152.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.81590.log.gz 2024-04-17T17:54:17.268 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.243118.log: /var/log/ceph/ceph-client.admin.214182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35328.log 2024-04-17T17:54:17.269 INFO:teuthology.orchestra.run.smithi152.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.97840.log.gz 2024-04-17T17:54:17.270 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37646.log 2024-04-17T17:54:17.271 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.38275.log: /var/log/ceph/ceph-client.admin.35328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.431569.log 2024-04-17T17:54:17.273 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.510490.log 2024-04-17T17:54:17.275 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.37646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102739.log 2024-04-17T17:54:17.276 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.431569.log: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.194270.log.gz 2024-04-17T17:54:17.276 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474984.log 2024-04-17T17:54:17.278 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.510490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334582.log 2024-04-17T17:54:17.280 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.102739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166266.log 2024-04-17T17:54:17.281 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.474984.log: /var/log/ceph/ceph-client.admin.334582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167207.log 2024-04-17T17:54:17.283 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.492917.log 2024-04-17T17:54:17.285 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.166266.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.504446.log.gz 2024-04-17T17:54:17.285 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371168.log 2024-04-17T17:54:17.286 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.167207.log: /var/log/ceph/ceph-client.admin.492917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367989.log 2024-04-17T17:54:17.288 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230688.log 2024-04-17T17:54:17.289 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.371168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34766.log 2024-04-17T17:54:17.289 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.172462.log.gz 2024-04-17T17:54:17.289 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.230688.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.197750.log.gz 2024-04-17T17:54:17.291 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.367989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102332.log 2024-04-17T17:54:17.291 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.197759.log.gz 2024-04-17T17:54:17.292 INFO:teuthology.orchestra.run.smithi152.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34411.log.gz 2024-04-17T17:54:17.293 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.503576.log 2024-04-17T17:54:17.294 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.34766.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34333.log.gz 2024-04-17T17:54:17.294 INFO:teuthology.orchestra.run.smithi152.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.230688.log.gz 2024-04-17T17:54:17.294 INFO:teuthology.orchestra.run.smithi152.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34437.log.gz 2024-04-17T17:54:17.294 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.503147.log 2024-04-17T17:54:17.295 INFO:teuthology.orchestra.run.smithi152.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.233969.log.gz 2024-04-17T17:54:17.296 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.102332.log: /var/log/ceph/ceph-client.admin.503576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418127.log 2024-04-17T17:54:17.297 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.207553.log.gz 2024-04-17T17:54:17.297 INFO:teuthology.orchestra.run.smithi152.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.179815.log.gz 2024-04-17T17:54:17.298 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.503147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160538.log 2024-04-17T17:54:17.298 INFO:teuthology.orchestra.run.smithi152.stderr: 79.1% -- replaced with /var/log/ceph/ceph-client.admin.214182.log.gz 2024-04-17T17:54:17.299 INFO:teuthology.orchestra.run.smithi152.stderr: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.164861.log.gz 2024-04-17T17:54:17.299 INFO:teuthology.orchestra.run.smithi152.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.166266.log.gz 2024-04-17T17:54:17.300 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.418127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.493784.log 2024-04-17T17:54:17.300 INFO:teuthology.orchestra.run.smithi152.stderr: 78.9% -- replaced with /var/log/ceph/ceph-client.admin.224509.log.gz 2024-04-17T17:54:17.301 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.490854.log 2024-04-17T17:54:17.302 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.493784.log: /var/log/ceph/ceph-client.admin.160538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205488.log 2024-04-17T17:54:17.303 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.401546.log.gz 2024-04-17T17:54:17.304 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.490854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.486907.log 2024-04-17T17:54:17.305 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.431569.log.gz 2024-04-17T17:54:17.306 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491670.log 2024-04-17T17:54:17.306 INFO:teuthology.orchestra.run.smithi152.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.433763.log.gz 2024-04-17T17:54:17.307 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.205488.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.440330.log.gz 2024-04-17T17:54:17.307 INFO:teuthology.orchestra.run.smithi152.stderr:gzip 80.9% -5 --verbose -- /var/log/ceph/ceph-client.admin.37437.log -- replaced with /var/log/ceph/ceph-client.admin.241829.log.gz 2024-04-17T17:54:17.307 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-04-17T17:54:17.309 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.486907.log: /var/log/ceph/ceph-client.admin.491670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.422789.log 2024-04-17T17:54:17.311 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.37437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382227.log 2024-04-17T17:54:17.312 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.321002.log.gz 2024-04-17T17:54:17.313 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303160.log 2024-04-17T17:54:17.314 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.422789.log: /var/log/ceph/ceph-client.admin.382227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447579.log 2024-04-17T17:54:17.316 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.303160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103137.log 2024-04-17T17:54:17.318 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose 83.3% -- /var/log/ceph/ceph-client.admin.447588.log/var/log/ceph/ceph-client.admin.447579.log: 2024-04-17T17:54:17.318 INFO:teuthology.orchestra.run.smithi152.stderr: -- replaced with /var/log/ceph/ceph-client.admin.474984.log.gz 2024-04-17T17:54:17.320 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.103137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327059.log 2024-04-17T17:54:17.321 INFO:teuthology.orchestra.run.smithi152.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.193047.log.gz 2024-04-17T17:54:17.321 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173728.log 2024-04-17T17:54:17.322 INFO:teuthology.orchestra.run.smithi152.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.479876.log.gz 2024-04-17T17:54:17.323 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.447588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475399.log 2024-04-17T17:54:17.325 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.327059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300711.log 2024-04-17T17:54:17.326 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.475399.log: /var/log/ceph/ceph-client.admin.173728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369637.log 2024-04-17T17:54:17.329 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.300711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479063.log 2024-04-17T17:54:17.331 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.369637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209178.log 2024-04-17T17:54:17.333 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.479063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.466626.log 2024-04-17T17:54:17.335 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.209178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106015.log 2024-04-17T17:54:17.336 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388832.log 2024-04-17T17:54:17.338 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.106015.log: /var/log/ceph/ceph-client.admin.466626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441190.log 2024-04-17T17:54:17.341 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.388832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233978.log 2024-04-17T17:54:17.343 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.441190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.490845.log 2024-04-17T17:54:17.345 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.233978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442519.log 2024-04-17T17:54:17.347 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.490845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442040.log 2024-04-17T17:54:17.350 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.442519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35510.log 2024-04-17T17:54:17.351 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215988.log 2024-04-17T17:54:17.353 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.442040.log: /var/log/ceph/ceph-client.admin.35510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317718.log 2024-04-17T17:54:17.354 INFO:teuthology.orchestra.run.smithi152.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.497580.log.gz 2024-04-17T17:54:17.355 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.215988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130183.log 2024-04-17T17:54:17.357 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359394.log 2024-04-17T17:54:17.358 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.317718.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.447579.log.gz 2024-04-17T17:54:17.359 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.130183.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.446776.log.gz 2024-04-17T17:54:17.359 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374193.log 2024-04-17T17:54:17.361 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.359394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.296234.log 2024-04-17T17:54:17.364 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.374193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105603.log 2024-04-17T17:54:17.366 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.296234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94511.log 2024-04-17T17:54:17.368 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.105603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439121.log 2024-04-17T17:54:17.370 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.94511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364534.log 2024-04-17T17:54:17.372 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36068.log 2024-04-17T17:54:17.374 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.439121.log: /var/log/ceph/ceph-client.admin.364534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.487796.log 2024-04-17T17:54:17.376 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.36068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35224.log 2024-04-17T17:54:17.378 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.487796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78533.log 2024-04-17T17:54:17.380 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.432381.log 2024-04-17T17:54:17.382 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.35224.log: /var/log/ceph/ceph-client.admin.78533.log: gzip -5 --verbose -- 93.5% -- replaced with /var/log/ceph/ceph-client.admin.457300.log.gz 2024-04-17T17:54:17.382 INFO:teuthology.orchestra.run.smithi152.stderr: /var/log/ceph/ceph-client.admin.324728.log 2024-04-17T17:54:17.384 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.432381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245215.log 2024-04-17T17:54:17.386 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.324728.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34766.log.gz 2024-04-17T17:54:17.387 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164870.log 2024-04-17T17:54:17.389 INFO:teuthology.orchestra.run.smithi152.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34984.log.gz 2024-04-17T17:54:17.390 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.245215.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.317718.log.gz 2024-04-17T17:54:17.390 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36330.log 2024-04-17T17:54:17.391 INFO:teuthology.orchestra.run.smithi152.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.372476.log.gz 2024-04-17T17:54:17.391 INFO:teuthology.orchestra.run.smithi152.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.372934.log.gz 2024-04-17T17:54:17.391 INFO:teuthology.orchestra.run.smithi152.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.130183.log.gz 2024-04-17T17:54:17.391 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.327059.log.gz 2024-04-17T17:54:17.392 INFO:teuthology.orchestra.run.smithi152.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.38901.log.gz 2024-04-17T17:54:17.393 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456037.log 2024-04-17T17:54:17.395 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.164870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343200.log 2024-04-17T17:54:17.395 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.456037.log: /var/log/ceph/ceph-client.admin.36330.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.447588.log.gz 2024-04-17T17:54:17.396 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331308.log 2024-04-17T17:54:17.398 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.343200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413370.log 2024-04-17T17:54:17.400 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429761.log 2024-04-17T17:54:17.401 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.413370.log: /var/log/ceph/ceph-client.admin.331308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.436610.log 2024-04-17T17:54:17.403 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.429761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333780.log 2024-04-17T17:54:17.404 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.436610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224925.log 2024-04-17T17:54:17.405 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.333780.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.99478.log.gz 2024-04-17T17:54:17.406 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309109.log 2024-04-17T17:54:17.408 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478647.log 2024-04-17T17:54:17.410 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.224925.log: /var/log/ceph/ceph-client.admin.309109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494611.log 2024-04-17T17:54:17.412 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.478647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443322.log 2024-04-17T17:54:17.413 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193453.log 2024-04-17T17:54:17.415 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.494611.log: /var/log/ceph/ceph-client.admin.443322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36512.log 2024-04-17T17:54:17.417 INFO:teuthology.orchestra.run.smithi152.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.103137.log.gz 2024-04-17T17:54:17.418 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.193453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.462765.log 2024-04-17T17:54:17.419 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34980.log 2024-04-17T17:54:17.421 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.462765.log: /var/log/ceph/ceph-client.admin.36512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345082.log 2024-04-17T17:54:17.423 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34777.log 2024-04-17T17:54:17.424 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.34980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38015.log 2024-04-17T17:54:17.427 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.34777.log: /var/log/ceph/ceph-client.admin.345082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158763.log 2024-04-17T17:54:17.429 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.38015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375454.log 2024-04-17T17:54:17.430 INFO:teuthology.orchestra.run.smithi152.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.490854.log.gz 2024-04-17T17:54:17.431 INFO:teuthology.orchestra.run.smithi152.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.490845.log.gz 2024-04-17T17:54:17.432 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.158763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418944.log 2024-04-17T17:54:17.432 INFO:teuthology.orchestra.run.smithi152.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.491670.log.gz 2024-04-17T17:54:17.434 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204270.log 2024-04-17T17:54:17.436 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.418944.log: /var/log/ceph/ceph-client.admin.375454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220122.log 2024-04-17T17:54:17.437 INFO:teuthology.orchestra.run.smithi152.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.492917.log.gz 2024-04-17T17:54:17.437 INFO:teuthology.orchestra.run.smithi152.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.195680.log.gz 2024-04-17T17:54:17.438 INFO:teuthology.orchestra.run.smithi152.stderr:gzip/var/log/ceph/ceph-client.admin.204270.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.163110.log 2024-04-17T17:54:17.438 INFO:teuthology.orchestra.run.smithi152.stderr: 81.6%/var/log/ceph/ceph-client.admin.220122.log: -- replaced with /var/log/ceph/ceph-client.admin.205488.log.gz 2024-04-17T17:54:17.440 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320583.log 2024-04-17T17:54:17.443 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.163110.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.215988.log.gz 2024-04-17T17:54:17.443 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.164870.log.gz 2024-04-17T17:54:17.443 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.450468.log 2024-04-17T17:54:17.444 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.320583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376279.log 2024-04-17T17:54:17.445 INFO:teuthology.orchestra.run.smithi152.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.204270.log.gz 2024-04-17T17:54:17.445 INFO:teuthology.orchestra.run.smithi152.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.432381.log.gz 2024-04-17T17:54:17.445 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.450468.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.374193.log.gz 2024-04-17T17:54:17.445 INFO:teuthology.orchestra.run.smithi152.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.375454.log.gz 2024-04-17T17:54:17.446 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98666.log 2024-04-17T17:54:17.448 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.376279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230290.log 2024-04-17T17:54:17.450 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.98666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135916.log 2024-04-17T17:54:17.452 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.230290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385112.log 2024-04-17T17:54:17.453 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.135916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499287.log 2024-04-17T17:54:17.455 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.385112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446370.log 2024-04-17T17:54:17.457 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.499287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95316.log 2024-04-17T17:54:17.458 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.446370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138971.log 2024-04-17T17:54:17.460 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.95316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239393.log 2024-04-17T17:54:17.462 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.456888.log.gz 2024-04-17T17:54:17.462 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361100.log 2024-04-17T17:54:17.464 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.138971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.438298.log 2024-04-17T17:54:17.464 INFO:teuthology.orchestra.run.smithi152.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.469225.log.gz 2024-04-17T17:54:17.466 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.361100.log: /var/log/ceph/ceph-client.admin.239393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217271.log 2024-04-17T17:54:17.469 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.438298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185951.log 2024-04-17T17:54:17.471 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.217271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.483429.log 2024-04-17T17:54:17.473 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.185951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.513135.log 2024-04-17T17:54:17.474 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186776.log 2024-04-17T17:54:17.475 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.513135.log: /var/log/ceph/ceph-client.admin.483429.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.513135.log.gz 2024-04-17T17:54:17.476 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376132.log 2024-04-17T17:54:17.479 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.186776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512698.log 2024-04-17T17:54:17.481 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.376132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78960.log 2024-04-17T17:54:17.483 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80357.log 2024-04-17T17:54:17.484 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.512698.log: /var/log/ceph/ceph-client.admin.78960.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.512698.log.gz 2024-04-17T17:54:17.485 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163958.log 2024-04-17T17:54:17.488 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.80357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175474.log 2024-04-17T17:54:17.490 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.163958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186359.log 2024-04-17T17:54:17.491 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400916.log 2024-04-17T17:54:17.494 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.175474.log: /var/log/ceph/ceph-client.admin.186359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440783.log 2024-04-17T17:54:17.496 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.400916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.444254.log 2024-04-17T17:54:17.498 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.440783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36172.log 2024-04-17T17:54:17.500 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476214.log 2024-04-17T17:54:17.502 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.444254.log: /var/log/ceph/ceph-client.admin.36172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37729.log 2024-04-17T17:54:17.504 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.476214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339377.log 2024-04-17T17:54:17.505 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90788.log 2024-04-17T17:54:17.507 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.37729.log: /var/log/ceph/ceph-client.admin.339377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230281.log 2024-04-17T17:54:17.509 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.90788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.450046.log 2024-04-17T17:54:17.510 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.497150.log 2024-04-17T17:54:17.512 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.230281.log: /var/log/ceph/ceph-client.admin.450046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36460.log 2024-04-17T17:54:17.514 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.497150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362797.log 2024-04-17T17:54:17.516 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.36460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337221.log 2024-04-17T17:54:17.518 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.362797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380987.log 2024-04-17T17:54:17.520 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.337221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222631.log 2024-04-17T17:54:17.522 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.380987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294192.log 2024-04-17T17:54:17.524 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.486898.log 2024-04-17T17:54:17.525 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.222631.log: /var/log/ceph/ceph-client.admin.294192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251533.log 2024-04-17T17:54:17.527 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.486898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37781.log 2024-04-17T17:54:17.530 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.251533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.419359.log 2024-04-17T17:54:17.532 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.37781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.513345.log 2024-04-17T17:54:17.534 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.419359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177201.log 2024-04-17T17:54:17.536 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.513345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472139.log 2024-04-17T17:54:17.536 INFO:teuthology.orchestra.run.smithi152.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.513345.log.gz 2024-04-17T17:54:17.537 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369215.log 2024-04-17T17:54:17.539 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.177201.log: /var/log/ceph/ceph-client.admin.472139.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.418127.log.gz 2024-04-17T17:54:17.539 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203820.log 2024-04-17T17:54:17.540 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.413370.log.gz 2024-04-17T17:54:17.540 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38424.log 2024-04-17T17:54:17.542 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.369215.log: /var/log/ceph/ceph-client.admin.203820.log: 79.9% -- replaced with /var/log/ceph/ceph-client.admin.418944.log.gz 2024-04-17T17:54:17.542 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297863.log 2024-04-17T17:54:17.544 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.38424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.509174.log 2024-04-17T17:54:17.546 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.452685.log 2024-04-17T17:54:17.548 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.297863.log: /var/log/ceph/ceph-client.admin.509174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301944.log 2024-04-17T17:54:17.549 INFO:teuthology.orchestra.run.smithi152.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34980.log.gz 2024-04-17T17:54:17.551 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.452685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177210.log 2024-04-17T17:54:17.553 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.301944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449630.log 2024-04-17T17:54:17.555 INFO:teuthology.orchestra.run.smithi152.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.220122.log.gz 2024-04-17T17:54:17.555 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.177210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495875.log 2024-04-17T17:54:17.555 INFO:teuthology.orchestra.run.smithi152.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.320167.log.gz 2024-04-17T17:54:17.556 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.507434.log 2024-04-17T17:54:17.558 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.449630.log: /var/log/ceph/ceph-client.admin.495875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477842.log 2024-04-17T17:54:17.559 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303169.log 2024-04-17T17:54:17.561 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.507434.log: /var/log/ceph/ceph-client.admin.477842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307046.log 2024-04-17T17:54:17.563 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496711.log 2024-04-17T17:54:17.565 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.303169.log: /var/log/ceph/ceph-client.admin.307046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85993.log 2024-04-17T17:54:17.566 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410037.log 2024-04-17T17:54:17.568 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.496711.log: /var/log/ceph/ceph-client.admin.85993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78542.log 2024-04-17T17:54:17.569 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38628.log 2024-04-17T17:54:17.571 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.410037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175031.log 2024-04-17T17:54:17.572 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.78542.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.297854.log.gz 2024-04-17T17:54:17.573 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.38628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479461.log 2024-04-17T17:54:17.573 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.502718.log 2024-04-17T17:54:17.575 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.479461.log: /var/log/ceph/ceph-client.admin.175031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498428.log 2024-04-17T17:54:17.575 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.297863.log.gz 2024-04-17T17:54:17.577 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.502718.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.372079.log.gz 2024-04-17T17:54:17.577 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395397.log 2024-04-17T17:54:17.577 INFO:teuthology.orchestra.run.smithi152.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.333780.log.gz 2024-04-17T17:54:17.579 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.498428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441599.log 2024-04-17T17:54:17.581 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.395397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244330.log 2024-04-17T17:54:17.583 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33557.log 2024-04-17T17:54:17.584 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.441599.log: /var/log/ceph/ceph-client.admin.244330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305754.log 2024-04-17T17:54:17.586 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297042.log 2024-04-17T17:54:17.588 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.33557.log: /var/log/ceph/ceph-client.admin.305754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340286.log 2024-04-17T17:54:17.589 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229061.log 2024-04-17T17:54:17.591 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.297042.log: /var/log/ceph/ceph-client.admin.340286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33639.log 2024-04-17T17:54:17.593 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.229061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334988.log 2024-04-17T17:54:17.595 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.33639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186368.log 2024-04-17T17:54:17.596 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476612.log 2024-04-17T17:54:17.598 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.334988.log: /var/log/ceph/ceph-client.admin.186368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394165.log 2024-04-17T17:54:17.600 INFO:teuthology.orchestra.run.smithi152.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.175031.log.gz 2024-04-17T17:54:17.601 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.476612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366311.log 2024-04-17T17:54:17.603 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.394165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426161.log 2024-04-17T17:54:17.606 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.366311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210044.log 2024-04-17T17:54:17.608 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340277.log 2024-04-17T17:54:17.608 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.426161.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.130597.log.gz 2024-04-17T17:54:17.609 INFO:teuthology.orchestra.run.smithi152.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.449630.log.gz 2024-04-17T17:54:17.609 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.509584.log 2024-04-17T17:54:17.611 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.210044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244764.log 2024-04-17T17:54:17.612 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.340277.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33557.log.gz 2024-04-17T17:54:17.612 INFO:teuthology.orchestra.run.smithi152.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.161400.log.gz 2024-04-17T17:54:17.613 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85577.log 2024-04-17T17:54:17.613 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.509584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156686.log 2024-04-17T17:54:17.616 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.244764.log: /var/log/ceph/ceph-client.admin.85577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38372.log 2024-04-17T17:54:17.617 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175899.log 2024-04-17T17:54:17.618 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.156686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302755.log 2024-04-17T17:54:17.618 INFO:teuthology.orchestra.run.smithi152.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.369215.log.gz 2024-04-17T17:54:17.620 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.38372.log: /var/log/ceph/ceph-client.admin.175899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.434641.log 2024-04-17T17:54:17.620 INFO:teuthology.orchestra.run.smithi152.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.368817.log.gz 2024-04-17T17:54:17.622 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.302755.log: gzip 84.9% -5 --verbose -- /var/log/ceph/ceph-client.admin.307452.log -- replaced with /var/log/ceph/ceph-client.admin.362797.log.gz 2024-04-17T17:54:17.622 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-04-17T17:54:17.624 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.434641.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.252017.log.gz 2024-04-17T17:54:17.624 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157915.log 2024-04-17T17:54:17.625 INFO:teuthology.orchestra.run.smithi152.stderr: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.379723.log.gz 2024-04-17T17:54:17.627 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.307452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380545.log 2024-04-17T17:54:17.627 INFO:teuthology.orchestra.run.smithi152.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.229061.log.gz 2024-04-17T17:54:17.627 INFO:teuthology.orchestra.run.smithi152.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38424.log.gz 2024-04-17T17:54:17.627 INFO:teuthology.orchestra.run.smithi152.stderr: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.442510.log.gz 2024-04-17T17:54:17.628 INFO:teuthology.orchestra.run.smithi152.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.169434.log.gz 2024-04-17T17:54:17.629 INFO:teuthology.orchestra.run.smithi152.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.203820.log.gz 2024-04-17T17:54:17.629 INFO:teuthology.orchestra.run.smithi152.stderr: 83.7% -- replaced with /var/log/ceph/ceph-client.admin.203311.log.gz 2024-04-17T17:54:17.630 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.157915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252875.log 2024-04-17T17:54:17.630 INFO:teuthology.orchestra.run.smithi152.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.434641.log.gz 2024-04-17T17:54:17.630 INFO:teuthology.orchestra.run.smithi152.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38628.log.gz 2024-04-17T17:54:17.631 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.439527.log.gz 2024-04-17T17:54:17.632 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.380545.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.320583.log.gz 2024-04-17T17:54:17.633 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329594.log 2024-04-17T17:54:17.633 INFO:teuthology.orchestra.run.smithi152.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.476612.log.gz 2024-04-17T17:54:17.633 INFO:teuthology.orchestra.run.smithi152.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.105603.log.gz 2024-04-17T17:54:17.634 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38654.log 2024-04-17T17:54:17.637 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.252875.log: /var/log/ceph/ceph-client.admin.329594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169877.log 2024-04-17T17:54:17.637 INFO:teuthology.orchestra.run.smithi152.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.483429.log.gz 2024-04-17T17:54:17.639 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.38654.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.90788.log.gz 2024-04-17T17:54:17.639 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.454418.log 2024-04-17T17:54:17.642 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.169877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99067.log 2024-04-17T17:54:17.642 INFO:teuthology.orchestra.run.smithi152.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36408.log.gz 2024-04-17T17:54:17.644 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.454418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197353.log 2024-04-17T17:54:17.644 INFO:teuthology.orchestra.run.smithi152.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.479461.log.gz 2024-04-17T17:54:17.645 INFO:teuthology.orchestra.run.smithi152.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.177201.log.gz 2024-04-17T17:54:17.646 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.99067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.492089.log 2024-04-17T17:54:17.647 INFO:teuthology.orchestra.run.smithi152.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.160538.log.gz 2024-04-17T17:54:17.649 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.197353.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.163110.log.gz 2024-04-17T17:54:17.649 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.506612.log 2024-04-17T17:54:17.649 INFO:teuthology.orchestra.run.smithi152.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.163507.log.gz 2024-04-17T17:54:17.651 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.492089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37859.log 2024-04-17T17:54:17.653 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.506612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.483026.log 2024-04-17T17:54:17.653 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.156686.log.gz 2024-04-17T17:54:17.655 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.37859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227006.log 2024-04-17T17:54:17.655 INFO:teuthology.orchestra.run.smithi152.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.37437.log.gz 2024-04-17T17:54:17.656 INFO:teuthology.orchestra.run.smithi152.stderr: 78.8% -- replaced with /var/log/ceph/ceph-client.admin.94909.log.gz 2024-04-17T17:54:17.656 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174162.log 2024-04-17T17:54:17.657 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.227006.log: /var/log/ceph/ceph-client.admin.483026.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.94511.log.gz 2024-04-17T17:54:17.658 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36010.log 2024-04-17T17:54:17.659 INFO:teuthology.orchestra.run.smithi152.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.452142.log.gz 2024-04-17T17:54:17.659 INFO:teuthology.orchestra.run.smithi152.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.493784.log.gz 2024-04-17T17:54:17.660 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297051.log 2024-04-17T17:54:17.662 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.174162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37357.log 2024-04-17T17:54:17.662 INFO:teuthology.orchestra.run.smithi152.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.493793.log.gz 2024-04-17T17:54:17.663 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.36010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37097.log 2024-04-17T17:54:17.665 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.297051.log: /var/log/ceph/ceph-client.admin.37357.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.102332.log.gz 2024-04-17T17:54:17.665 INFO:teuthology.orchestra.run.smithi152.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.294183.log.gz 2024-04-17T17:54:17.665 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.486453.log 2024-04-17T17:54:17.666 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.294192.log.gz 2024-04-17T17:54:17.668 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.37097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424879.log 2024-04-17T17:54:17.669 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378482.log 2024-04-17T17:54:17.671 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.486453.log: /var/log/ceph/ceph-client.admin.424879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.509593.log 2024-04-17T17:54:17.673 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.424879.log.gz 2024-04-17T17:54:17.673 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.378482.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.131410.log.gz 2024-04-17T17:54:17.674 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385917.log 2024-04-17T17:54:17.675 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402360.log 2024-04-17T17:54:17.677 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.509593.log: /var/log/ceph/ceph-client.admin.385917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457291.log 2024-04-17T17:54:17.679 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.402360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202857.log 2024-04-17T17:54:17.681 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80768.log 2024-04-17T17:54:17.681 INFO:teuthology.orchestra.run.smithi152.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.210035.log.gz 2024-04-17T17:54:17.681 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.457291.log: /var/log/ceph/ceph-client.admin.202857.log: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.214191.log.gz 2024-04-17T17:54:17.682 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299498.log 2024-04-17T17:54:17.683 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.80768.log: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.338093.log.gz 2024-04-17T17:54:17.683 INFO:teuthology.orchestra.run.smithi152.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.220944.log.gz 2024-04-17T17:54:17.684 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477019.log 2024-04-17T17:54:17.684 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.210044.log.gz 2024-04-17T17:54:17.685 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.299498.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.329594.log.gz 2024-04-17T17:54:17.686 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307461.log 2024-04-17T17:54:17.688 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139277.log 2024-04-17T17:54:17.689 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34470.log 2024-04-17T17:54:17.689 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.477019.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.307452.log.gz 2024-04-17T17:54:17.689 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.139277.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.252875.log.gz 2024-04-17T17:54:17.690 INFO:teuthology.orchestra.run.smithi152.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38372.log.gz 2024-04-17T17:54:17.690 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.307461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162675.log 2024-04-17T17:54:17.691 INFO:teuthology.orchestra.run.smithi152.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.38840.log.gz 2024-04-17T17:54:17.691 INFO:teuthology.orchestra.run.smithi152.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.340277.log.gz 2024-04-17T17:54:17.692 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.34470.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.157915.log.gz 2024-04-17T17:54:17.692 INFO:teuthology.orchestra.run.smithi152.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.443801.log.gz 2024-04-17T17:54:17.692 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301533.log 2024-04-17T17:54:17.694 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.162675.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.454418.log.gz 2024-04-17T17:54:17.695 INFO:teuthology.orchestra.run.smithi152.stderr:gzip 77.8% -5 -- replaced with /var/log/ceph/ceph-client.admin.446361.log.gz 2024-04-17T17:54:17.695 INFO:teuthology.orchestra.run.smithi152.stderr: --verbose -- /var/log/ceph/ceph-client.admin.220534.log 2024-04-17T17:54:17.697 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.301533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229463.log 2024-04-17T17:54:17.698 INFO:teuthology.orchestra.run.smithi152.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36198.log.gz 2024-04-17T17:54:17.699 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448409.log 2024-04-17T17:54:17.701 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.220534.log: /var/log/ceph/ceph-client.admin.229463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426152.log 2024-04-17T17:54:17.703 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.448409.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.470517.log.gz 2024-04-17T17:54:17.703 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423212.log 2024-04-17T17:54:17.705 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.426152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443810.log 2024-04-17T17:54:17.705 INFO:teuthology.orchestra.run.smithi152.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37859.log.gz 2024-04-17T17:54:17.705 INFO:teuthology.orchestra.run.smithi152.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.492089.log.gz 2024-04-17T17:54:17.706 INFO:teuthology.orchestra.run.smithi152.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.242244.log.gz 2024-04-17T17:54:17.708 INFO:teuthology.orchestra.run.smithi152.stderr:gzip 84.4% -- replaced with /var/log/ceph/ceph-client.admin.99067.log.gz 2024-04-17T17:54:17.708 INFO:teuthology.orchestra.run.smithi152.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.36988.log 2024-04-17T17:54:17.708 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.423212.log: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.101103.log.gz 2024-04-17T17:54:17.709 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112834.log 2024-04-17T17:54:17.710 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.443810.log: /var/log/ceph/ceph-client.admin.36988.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.492506.log.gz 2024-04-17T17:54:17.711 INFO:teuthology.orchestra.run.smithi152.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37097.log.gz 2024-04-17T17:54:17.711 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.465228.log 2024-04-17T17:54:17.711 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.197353.log.gz 2024-04-17T17:54:17.712 INFO:teuthology.orchestra.run.smithi152.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37357.log.gz 2024-04-17T17:54:17.713 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100697.log 2024-04-17T17:54:17.714 INFO:teuthology.orchestra.run.smithi152.stderr: 81.0%/var/log/ceph/ceph-client.admin.112834.log: -- replaced with /var/log/ceph/ceph-client.admin.174162.log.gz 2024-04-17T17:54:17.714 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.192641.log.gz 2024-04-17T17:54:17.714 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418547.log 2024-04-17T17:54:17.717 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.100697.log: /var/log/ceph/ceph-client.admin.465228.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.243932.log.gz 2024-04-17T17:54:17.717 INFO:teuthology.orchestra.run.smithi152.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.380545.log.gz 2024-04-17T17:54:17.717 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.432821.log 2024-04-17T17:54:17.718 INFO:teuthology.orchestra.run.smithi152.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.199380.log.gz 2024-04-17T17:54:17.718 INFO:teuthology.orchestra.run.smithi152.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.229463.log.gz 2024-04-17T17:54:17.718 INFO:teuthology.orchestra.run.smithi152.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.320574.log.gz 2024-04-17T17:54:17.719 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225331.log 2024-04-17T17:54:17.721 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.418547.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.385917.log.gz 2024-04-17T17:54:17.721 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.432821.log: /var/log/ceph/ceph-client.admin.225331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35800.log 2024-04-17T17:54:17.721 INFO:teuthology.orchestra.run.smithi152.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.506612.log.gz 2024-04-17T17:54:17.723 INFO:teuthology.orchestra.run.smithi152.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.477019.log.gz 2024-04-17T17:54:17.723 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.444263.log.gz 2024-04-17T17:54:17.724 INFO:teuthology.orchestra.run.smithi152.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36010.log.gz 2024-04-17T17:54:17.724 INFO:teuthology.orchestra.run.smithi152.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.506621.log.gz 2024-04-17T17:54:17.725 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390052.log 2024-04-17T17:54:17.725 INFO:teuthology.orchestra.run.smithi152.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.457291.log.gz 2024-04-17T17:54:17.725 INFO:teuthology.orchestra.run.smithi152.stderr: 78.6% -- replaced with /var/log/ceph/ceph-client.admin.106874.log.gz 2024-04-17T17:54:17.725 INFO:teuthology.orchestra.run.smithi152.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.477028.log.gz 2024-04-17T17:54:17.726 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231104.log 2024-04-17T17:54:17.728 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.0.35800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36753.log 2024-04-17T17:54:17.730 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.390052.log: /var/log/ceph/ceph-client.admin.231104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314392.log 2024-04-17T17:54:17.731 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371574.log 2024-04-17T17:54:17.733 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.36753.log: /var/log/ceph/ceph-client.admin.314392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368402.log 2024-04-17T17:54:17.735 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.371574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393321.log 2024-04-17T17:54:17.737 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.368402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338102.log 2024-04-17T17:54:17.738 INFO:teuthology.orchestra.run.smithi152.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.472139.log.gz 2024-04-17T17:54:17.739 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36720.log 2024-04-17T17:54:17.740 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.393321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243109.log 2024-04-17T17:54:17.740 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.338102.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.423212.log.gz 2024-04-17T17:54:17.742 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.36720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.486462.log 2024-04-17T17:54:17.745 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.243109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496720.log 2024-04-17T17:54:17.746 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253684.log 2024-04-17T17:54:17.747 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.486462.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.474168.log.gz 2024-04-17T17:54:17.749 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.496720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163101.log 2024-04-17T17:54:17.751 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473355.log 2024-04-17T17:54:17.752 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.253684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249809.log 2024-04-17T17:54:17.753 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.295009.log.gz 2024-04-17T17:54:17.754 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.163101.log: /var/log/ceph/ceph-client.admin.473355.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.426152.log.gz 2024-04-17T17:54:17.754 INFO:teuthology.orchestra.run.smithi152.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.296640.log.gz 2024-04-17T17:54:17.754 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110708.log 2024-04-17T17:54:17.755 INFO:teuthology.orchestra.run.smithi152.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.109463.log.gz 2024-04-17T17:54:17.756 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.249809.log: /var/log/ceph/ceph-client.admin.35614.log 2024-04-17T17:54:17.759 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.110708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397185.log 2024-04-17T17:54:17.761 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.35614.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.220534.log.gz 2024-04-17T17:54:17.762 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387974.log 2024-04-17T17:54:17.764 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.397185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.502709.log 2024-04-17T17:54:17.765 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.387974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368411.log 2024-04-17T17:54:17.767 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.502709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295416.log 2024-04-17T17:54:17.768 INFO:teuthology.orchestra.run.smithi152.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.249809.log.gz 2024-04-17T17:54:17.770 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.368411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342246.log 2024-04-17T17:54:17.772 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.295416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212920.log 2024-04-17T17:54:17.774 INFO:teuthology.orchestra.run.smithi152.stderr: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.363640.log.gz 2024-04-17T17:54:17.774 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316904.log 2024-04-17T17:54:17.775 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.342246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133180.log 2024-04-17T17:54:17.777 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.316904.log: /var/log/ceph/ceph-client.admin.212920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197344.log 2024-04-17T17:54:17.777 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.366750.log.gz 2024-04-17T17:54:17.778 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.133180.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.368411.log.gz 2024-04-17T17:54:17.778 INFO:teuthology.orchestra.run.smithi152.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.253684.log.gz 2024-04-17T17:54:17.779 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139268.log 2024-04-17T17:54:17.781 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.197344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481527.log 2024-04-17T17:54:17.781 INFO:teuthology.orchestra.run.smithi152.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.316904.log.gz 2024-04-17T17:54:17.782 INFO:teuthology.orchestra.run.smithi152.stderr: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.209628.log.gz 2024-04-17T17:54:17.783 INFO:teuthology.orchestra.run.smithi152.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.301533.log.gz 2024-04-17T17:54:17.783 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.139268.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.307461.log.gz 2024-04-17T17:54:17.783 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314789.log 2024-04-17T17:54:17.784 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.481527.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.338102.log.gz 2024-04-17T17:54:17.784 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332127.log 2024-04-17T17:54:17.787 INFO:teuthology.orchestra.run.smithi152.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.112834.log.gz 2024-04-17T17:54:17.787 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.314789.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34470.log.gz 2024-04-17T17:54:17.787 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367161.log 2024-04-17T17:54:17.788 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.332127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101509.log 2024-04-17T17:54:17.789 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.367161.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.84298.log.gz 2024-04-17T17:54:17.791 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107336.log 2024-04-17T17:54:17.791 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.157924.log.gz 2024-04-17T17:54:17.793 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341762.log 2024-04-17T17:54:17.794 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.107336.log: /var/log/ceph/ceph-client.admin.101509.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.181074.log.gz 2024-04-17T17:54:17.795 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307867.log 2024-04-17T17:54:17.796 INFO:teuthology.orchestra.run.smithi152.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.183113.log.gz 2024-04-17T17:54:17.798 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.341762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250643.log 2024-04-17T17:54:17.798 INFO:teuthology.orchestra.run.smithi152.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.485560.log.gz 2024-04-17T17:54:17.799 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34783.log 2024-04-17T17:54:17.800 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110305.log 2024-04-17T17:54:17.802 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.307867.log: /var/log/ceph/ceph-client.admin.250643.log: /var/log/ceph/ceph-client.admin.34783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312354.log 2024-04-17T17:54:17.803 INFO:teuthology.orchestra.run.smithi152.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36988.log.gz 2024-04-17T17:54:17.804 INFO:teuthology.orchestra.run.smithi152.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33862.log.gz 2024-04-17T17:54:17.805 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.110305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86400.log 2024-04-17T17:54:17.805 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209169.log 2024-04-17T17:54:17.807 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.86400.log: /var/log/ceph/ceph-client.admin.312354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91258.log 2024-04-17T17:54:17.808 INFO:teuthology.orchestra.run.smithi152.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35983.log.gz 2024-04-17T17:54:17.808 INFO:teuthology.orchestra.run.smithi152.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.101509.log.gz/var/log/ceph/ceph-client.admin.209169.log: 2024-04-17T17:54:17.809 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337678.log 2024-04-17T17:54:17.811 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.91258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139528.log 2024-04-17T17:54:17.812 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334176.log 2024-04-17T17:54:17.813 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.139528.log: /var/log/ceph/ceph-client.admin.337678.log: 90.5% -- replaced with /var/log/ceph/ceph-client.0.35800.log.gz 2024-04-17T17:54:17.814 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249798.log 2024-04-17T17:54:17.815 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201974.log 2024-04-17T17:54:17.817 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.334176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.434179.log 2024-04-17T17:54:17.819 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.249798.log: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.194859.log.gz 2024-04-17T17:54:17.819 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111124.log 2024-04-17T17:54:17.820 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.201974.log: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.197344.log.gz 2024-04-17T17:54:17.821 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.78136.log.gz 2024-04-17T17:54:17.822 INFO:teuthology.orchestra.run.smithi152.stderr: 81.7%/var/log/ceph/ceph-client.admin.434179.log: -- replaced with /var/log/ceph/ceph-client.admin.163101.log.gz 2024-04-17T17:54:17.822 INFO:teuthology.orchestra.run.smithi152.stderr: 80.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.225728.log.gz 2024-04-17T17:54:17.822 INFO:teuthology.orchestra.run.smithi152.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.428344.log 2024-04-17T17:54:17.822 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.227426.log.gz 2024-04-17T17:54:17.823 INFO:teuthology.orchestra.run.smithi152.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.201974.log.gz 2024-04-17T17:54:17.824 INFO:teuthology.orchestra.run.smithi152.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.201538.log.gz 2024-04-17T17:54:17.825 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.111124.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.231104.log.gz 2024-04-17T17:54:17.825 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239799.log 2024-04-17T17:54:17.826 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.312363.log.gz 2024-04-17T17:54:17.827 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.295416.log.gz 2024-04-17T17:54:17.828 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.428344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206302.log 2024-04-17T17:54:17.829 INFO:teuthology.orchestra.run.smithi152.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.139268.log.gz 2024-04-17T17:54:17.829 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237354.log 2024-04-17T17:54:17.831 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.239799.log: /var/log/ceph/ceph-client.admin.206302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135907.log 2024-04-17T17:54:17.833 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86807.log 2024-04-17T17:54:17.834 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.135907.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.432821.log.gz 2024-04-17T17:54:17.834 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.237354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38223.log 2024-04-17T17:54:17.836 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.86807.log: 90.1% 81.3% -- replaced with /var/log/ceph/ceph-client.admin.176767.log.gz 2024-04-17T17:54:17.836 INFO:teuthology.orchestra.run.smithi152.stderr: -- replaced with /var/log/ceph/ceph-client.admin.434179.log.gz 2024-04-17T17:54:17.837 INFO:teuthology.orchestra.run.smithi152.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.481527.log.gz 2024-04-17T17:54:17.837 INFO:teuthology.orchestra.run.smithi152.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.489890.log.gz 2024-04-17T17:54:17.837 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324322.log 2024-04-17T17:54:17.838 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315216.log 2024-04-17T17:54:17.840 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.324322.log: /var/log/ceph/ceph-client.admin.38223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304419.log 2024-04-17T17:54:17.841 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127690.log 2024-04-17T17:54:17.843 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.315216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175040.log 2024-04-17T17:54:17.844 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.304419.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.240604.log.gz 2024-04-17T17:54:17.845 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.453374.log 2024-04-17T17:54:17.846 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.127690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37201.log 2024-04-17T17:54:17.848 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.453374.log: /var/log/ceph/ceph-client.admin.175040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512365.log 2024-04-17T17:54:17.849 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.418547.log.gz 2024-04-17T17:54:17.850 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.37201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481089.log 2024-04-17T17:54:17.852 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223074.log 2024-04-17T17:54:17.853 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.512365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.480284.log 2024-04-17T17:54:17.854 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.481089.log: /var/log/ceph/ceph-client.admin.223074.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.512365.log.gz 2024-04-17T17:54:17.855 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.502289.log 2024-04-17T17:54:17.858 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.480284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.445952.log 2024-04-17T17:54:17.859 INFO:teuthology.orchestra.run.smithi152.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.342246.log.gz 2024-04-17T17:54:17.860 INFO:teuthology.orchestra.run.smithi152.stderr: 77.9%/var/log/ceph/ceph-client.admin.502289.log: -- replaced with /var/log/ceph/ceph-client.admin.341762.log.gz 2024-04-17T17:54:17.860 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38093.log 2024-04-17T17:54:17.862 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.445952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.500573.log 2024-04-17T17:54:17.863 INFO:teuthology.orchestra.run.smithi152.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.414251.log.gz 2024-04-17T17:54:17.864 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.38093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174606.log 2024-04-17T17:54:17.865 INFO:teuthology.orchestra.run.smithi152.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.428344.log.gz 2024-04-17T17:54:17.866 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.500573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397176.log 2024-04-17T17:54:17.868 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211675.log 2024-04-17T17:54:17.869 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.174606.log: /var/log/ceph/ceph-client.admin.397176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416880.log 2024-04-17T17:54:17.871 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.211675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33531.log 2024-04-17T17:54:17.873 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.416880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365094.log 2024-04-17T17:54:17.873 INFO:teuthology.orchestra.run.smithi152.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.446767.log.gz 2024-04-17T17:54:17.875 INFO:teuthology.orchestra.run.smithi152.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.452685.log.gz 2024-04-17T17:54:17.875 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215173.log 2024-04-17T17:54:17.876 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.33531.log: /var/log/ceph/ceph-client.admin.365094.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34783.log.gz 2024-04-17T17:54:17.877 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.454409.log 2024-04-17T17:54:17.878 INFO:teuthology.orchestra.run.smithi152.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.474993.log.gz 2024-04-17T17:54:17.879 INFO:teuthology.orchestra.run.smithi152.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.312354.log.gz 2024-04-17T17:54:17.879 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.215173.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.307867.log.gz 2024-04-17T17:54:17.880 INFO:teuthology.orchestra.run.smithi152.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.314789.log.gz 2024-04-17T17:54:17.880 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107780.log 2024-04-17T17:54:17.882 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.454409.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.211268.log.gz 2024-04-17T17:54:17.882 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300306.log 2024-04-17T17:54:17.883 INFO:teuthology.orchestra.run.smithi152.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.503138.log.gz 2024-04-17T17:54:17.884 INFO:teuthology.orchestra.run.smithi152.stderr: 79.0% -- replaced with /var/log/ceph/ceph-client.admin.509584.log.gz 2024-04-17T17:54:17.885 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.107780.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.332127.log.gz 2024-04-17T17:54:17.885 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196077.log 2024-04-17T17:54:17.887 INFO:teuthology.orchestra.run.smithi152.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.335874.log.gz 2024-04-17T17:54:17.887 INFO:teuthology.orchestra.run.smithi152.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.338500.log.gz 2024-04-17T17:54:17.887 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39035.log 2024-04-17T17:54:17.888 INFO:teuthology.orchestra.run.smithi152.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.445952.log.gz 2024-04-17T17:54:17.888 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.300306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309518.log 2024-04-17T17:54:17.891 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.39035.log: /var/log/ceph/ceph-client.admin.196077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343191.log 2024-04-17T17:54:17.891 INFO:teuthology.orchestra.run.smithi152.stderr: 78.8% -- replaced with /var/log/ceph/ceph-client.admin.486003.log.gz 2024-04-17T17:54:17.892 INFO:teuthology.orchestra.run.smithi152.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.490363.log.gz 2024-04-17T17:54:17.894 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.309518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.505778.log 2024-04-17T17:54:17.894 INFO:teuthology.orchestra.run.smithi152.stderr: 94.9% -- replaced with /var/log/ceph/ceph-client.admin.139277.log.gz 2024-04-17T17:54:17.896 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.343191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201547.log 2024-04-17T17:54:17.898 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.505778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36434.log 2024-04-17T17:54:17.901 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.201547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137244.log 2024-04-17T17:54:17.902 INFO:teuthology.orchestra.run.smithi152.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33531.log.gz 2024-04-17T17:54:17.904 INFO:teuthology.orchestra.run.smithi152.stderr:gzip/var/log/ceph/ceph-client.admin.36434.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.226189.log 2024-04-17T17:54:17.905 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172028.log 2024-04-17T17:54:17.907 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.137244.log: /var/log/ceph/ceph-client.admin.226189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437417.log 2024-04-17T17:54:17.909 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.172028.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36434.log.gz 2024-04-17T17:54:17.909 INFO:teuthology.orchestra.run.smithi152.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.109051.log.gz 2024-04-17T17:54:17.909 INFO:teuthology.orchestra.run.smithi152.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.94918.log.gz 2024-04-17T17:54:17.910 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364056.log 2024-04-17T17:54:17.912 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.437417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203829.log 2024-04-17T17:54:17.914 INFO:teuthology.orchestra.run.smithi152.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.107780.log.gz 2024-04-17T17:54:17.915 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183510.log 2024-04-17T17:54:17.916 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.364056.log: /var/log/ceph/ceph-client.admin.203829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231923.log 2024-04-17T17:54:17.918 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.183510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365914.log 2024-04-17T17:54:17.921 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.231923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182698.log 2024-04-17T17:54:17.924 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.365914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99487.log 2024-04-17T17:54:17.925 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343652.log 2024-04-17T17:54:17.926 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.99487.log: /var/log/ceph/ceph-client.admin.182698.log: 79.1% -- replaced with /var/log/ceph/ceph-client.admin.196077.log.gz 2024-04-17T17:54:17.927 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512724.log 2024-04-17T17:54:17.930 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.343652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392507.log 81.0% 2024-04-17T17:54:17.930 INFO:teuthology.orchestra.run.smithi152.stderr: -- replaced with /var/log/ceph/ceph-client.admin.206302.log.gz 2024-04-17T17:54:17.932 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.512724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221762.log 2024-04-17T17:54:17.933 INFO:teuthology.orchestra.run.smithi152.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.512724.log.gz 2024-04-17T17:54:17.935 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.392507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34678.log 2024-04-17T17:54:17.937 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238572.log 2024-04-17T17:54:17.937 INFO:teuthology.orchestra.run.smithi152.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.430723.log.gz 2024-04-17T17:54:17.939 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.221762.log: /var/log/ceph/ceph-client.admin.34678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102323.log 2024-04-17T17:54:17.941 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180673.log 2024-04-17T17:54:17.943 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.238572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317320.log 2024-04-17T17:54:17.945 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.102323.log: /var/log/ceph/ceph-client.admin.180673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34359.log 2024-04-17T17:54:17.947 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.317320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213762.log 2024-04-17T17:54:17.949 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.34359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137253.log 2024-04-17T17:54:17.951 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331713.log 2024-04-17T17:54:17.953 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.213762.log: /var/log/ceph/ceph-client.admin.137253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97432.log 2024-04-17T17:54:17.954 INFO:teuthology.orchestra.run.smithi152.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.500582.log.gz 2024-04-17T17:54:17.955 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.331713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495437.log 2024-04-17T17:54:17.956 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.97432.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.497150.log.gz 2024-04-17T17:54:17.957 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36694.log 2024-04-17T17:54:17.958 INFO:teuthology.orchestra.run.smithi152.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.500573.log.gz 2024-04-17T17:54:17.958 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.431158.log 2024-04-17T17:54:17.960 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.495437.log: /var/log/ceph/ceph-client.admin.36694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378893.log 2024-04-17T17:54:17.962 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.431158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39189.log 2024-04-17T17:54:17.965 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.378893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384291.log 2024-04-17T17:54:17.967 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.39189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.489474.log 2024-04-17T17:54:17.968 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.384291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157097.log 2024-04-17T17:54:17.970 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.489474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171150.log 2024-04-17T17:54:17.972 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385519.log 2024-04-17T17:54:17.974 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.157097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176776.log 2024-04-17T17:54:17.974 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.171150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236136.log 2024-04-17T17:54:17.977 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.385519.log: /var/log/ceph/ceph-client.admin.176776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229052.log 2024-04-17T17:54:17.978 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373794.log 2024-04-17T17:54:17.980 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.236136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219236.log 2024-04-17T17:54:17.981 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.229052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36538.log 2024-04-17T17:54:17.983 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.373794.log: /var/log/ceph/ceph-client.admin.219236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37885.log 2024-04-17T17:54:17.985 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.36538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223675.log 2024-04-17T17:54:17.986 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383078.log 2024-04-17T17:54:17.988 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.37885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330419.log 2024-04-17T17:54:17.989 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.223675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39245.log 2024-04-17T17:54:17.991 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.383078.log: /var/log/ceph/ceph-client.admin.330419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103545.log 2024-04-17T17:54:17.992 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.0.39245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394580.log 2024-04-17T17:54:17.993 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421924.log 2024-04-17T17:54:17.995 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.103545.log: /var/log/ceph/ceph-client.admin.394580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.455629.log 2024-04-17T17:54:17.997 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.421924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.513421.log 2024-04-17T17:54:17.999 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.455629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176342.log 2024-04-17T17:54:18.000 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34548.log 2024-04-17T17:54:18.001 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.513421.log: /var/log/ceph/ceph-client.admin.176342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111995.log 2024-04-17T17:54:18.002 INFO:teuthology.orchestra.run.smithi152.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.513421.log.gz 2024-04-17T17:54:18.002 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314383.log 2024-04-17T17:54:18.004 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.34548.log: /var/log/ceph/ceph-client.admin.111995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37411.log 2024-04-17T17:54:18.006 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.314383.log: /var/log/ceph/ceph-client.admin.36910.log 2024-04-17T17:54:18.008 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.37411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139519.log 2024-04-17T17:54:18.010 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.36910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131004.log 2024-04-17T17:54:18.012 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.139519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304410.log 2024-04-17T17:54:18.015 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.131004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421933.log 2024-04-17T17:54:18.016 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.304410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166810.log 2024-04-17T17:54:18.018 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.421933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376123.log 2024-04-17T17:54:18.027 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.166810.log: /var/log/ceph/ceph-client.admin.376123.log: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.473355.log.gz 2024-04-17T17:54:18.028 INFO:teuthology.orchestra.run.smithi152.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.502718.log.gz 2024-04-17T17:54:18.047 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.378893.log.gz 2024-04-17T17:54:18.053 INFO:teuthology.orchestra.run.smithi152.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34678.log.gz 2024-04-17T17:54:18.054 INFO:teuthology.orchestra.run.smithi152.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34626.log.gz 2024-04-17T17:54:18.060 INFO:teuthology.orchestra.run.smithi152.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.365094.log.gz 2024-04-17T17:54:18.060 INFO:teuthology.orchestra.run.smithi152.stderr: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.309518.log.gz 2024-04-17T17:54:18.061 INFO:teuthology.orchestra.run.smithi152.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.364525.log.gz 2024-04-17T17:54:18.076 INFO:teuthology.orchestra.run.smithi152.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.131004.log.gz 2024-04-17T17:54:18.077 INFO:teuthology.orchestra.run.smithi152.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.510068.log.gz 2024-04-17T17:54:18.079 INFO:teuthology.orchestra.run.smithi152.stderr: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.182698.log.gz 2024-04-17T17:54:18.084 INFO:teuthology.orchestra.run.smithi152.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.455629.log.gz 2024-04-17T17:54:18.091 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.427393.log.gz 2024-04-17T17:54:18.093 INFO:teuthology.orchestra.run.smithi152.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.507027.log.gz 2024-04-17T17:54:18.097 INFO:teuthology.orchestra.run.smithi152.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36936.log.gz 2024-04-17T17:54:18.100 INFO:teuthology.orchestra.run.smithi152.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.99487.log.gz 2024-04-17T17:54:18.102 INFO:teuthology.orchestra.run.smithi152.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.229052.log.gz 2024-04-17T17:54:18.103 INFO:teuthology.orchestra.run.smithi152.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.163949.log.gz 2024-04-17T17:54:18.104 INFO:teuthology.orchestra.run.smithi152.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.213762.log.gz 2024-04-17T17:54:18.104 INFO:teuthology.orchestra.run.smithi152.stderr: 84.2% 90.1% -- replaced with /var/log/ceph/ceph-client.admin.241838.log.gz 2024-04-17T17:54:18.105 INFO:teuthology.orchestra.run.smithi152.stderr: -- replaced with /var/log/ceph/ceph-client.admin.217262.log.gz 2024-04-17T17:54:18.107 INFO:teuthology.orchestra.run.smithi152.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.432390.log.gz 2024-04-17T17:54:18.107 INFO:teuthology.orchestra.run.smithi152.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.215581.log.gz 2024-04-17T17:54:18.108 INFO:teuthology.orchestra.run.smithi152.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.488654.log.gz 2024-04-17T17:54:18.110 INFO:teuthology.orchestra.run.smithi152.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.496720.log.gz 2024-04-17T17:54:18.110 INFO:teuthology.orchestra.run.smithi152.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.170716.log.gz 2024-04-17T17:54:18.111 INFO:teuthology.orchestra.run.smithi152.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.171150.log.gz 2024-04-17T17:54:18.118 INFO:teuthology.orchestra.run.smithi152.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.215173.log.gz 2024-04-17T17:54:18.124 INFO:teuthology.orchestra.run.smithi152.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.391689.log.gz 2024-04-17T17:54:18.131 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.381410.log.gz 2024-04-17T17:54:18.133 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.417318.log.gz 2024-04-17T17:54:18.134 INFO:teuthology.orchestra.run.smithi152.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39035.log.gz 2024-04-17T17:54:18.135 INFO:teuthology.orchestra.run.smithi152.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39113.log.gz 2024-04-17T17:54:18.137 INFO:teuthology.orchestra.run.smithi152.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.300306.log.gz 2024-04-17T17:54:18.138 INFO:teuthology.orchestra.run.smithi152.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.381812.log.gz 2024-04-17T17:54:18.139 INFO:teuthology.orchestra.run.smithi152.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.415601.log.gz 2024-04-17T17:54:18.140 INFO:teuthology.orchestra.run.smithi152.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.177210.log.gz 2024-04-17T17:54:18.142 INFO:teuthology.orchestra.run.smithi152.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34769.log.gz 2024-04-17T17:54:18.143 INFO:teuthology.orchestra.run.smithi152.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.341771.log.gz 2024-04-17T17:54:18.156 INFO:teuthology.orchestra.run.smithi152.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.313165.log.gz 2024-04-17T17:54:18.157 INFO:teuthology.orchestra.run.smithi152.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.211666.log.gz 2024-04-17T17:54:18.158 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.319769.log.gz 2024-04-17T17:54:18.158 INFO:teuthology.orchestra.run.smithi152.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.372070.log.gz 2024-04-17T17:54:18.158 INFO:teuthology.orchestra.run.smithi152.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.334582.log.gz 2024-04-17T17:54:18.162 INFO:teuthology.orchestra.run.smithi152.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.422789.log.gz 2024-04-17T17:54:18.164 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.450935.log.gz 2024-04-17T17:54:18.167 INFO:teuthology.orchestra.run.smithi152.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.250643.log.gz 2024-04-17T17:54:18.170 INFO:teuthology.orchestra.run.smithi152.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.108644.log.gz 2024-04-17T17:54:18.173 INFO:teuthology.orchestra.run.smithi152.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35675.log.gz 2024-04-17T17:54:18.177 INFO:teuthology.orchestra.run.smithi152.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.237354.log.gz 2024-04-17T17:54:18.182 INFO:teuthology.orchestra.run.smithi152.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.238175.log.gz 2024-04-17T17:54:18.185 INFO:teuthology.orchestra.run.smithi152.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.135907.log.gz 2024-04-17T17:54:18.189 INFO:teuthology.orchestra.run.smithi152.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.326114.log.gz 2024-04-17T17:54:18.189 INFO:teuthology.orchestra.run.smithi152.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.86798.log.gz 2024-04-17T17:54:18.191 INFO:teuthology.orchestra.run.smithi152.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.102739.log.gz 2024-04-17T17:54:18.192 INFO:teuthology.orchestra.run.smithi152.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.394571.log.gz 2024-04-17T17:54:18.193 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.394580.log.gz 2024-04-17T17:54:18.196 INFO:teuthology.orchestra.run.smithi152.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38223.log.gz 2024-04-17T17:54:18.199 INFO:teuthology.orchestra.run.smithi152.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.193038.log.gz 2024-04-17T17:54:18.202 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.192235.log.gz 2024-04-17T17:54:18.202 INFO:teuthology.orchestra.run.smithi152.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.205497.log.gz 2024-04-17T17:54:18.202 INFO:teuthology.orchestra.run.smithi152.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.434170.log.gz 2024-04-17T17:54:18.203 INFO:teuthology.orchestra.run.smithi152.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.224518.log.gz 2024-04-17T17:54:18.206 INFO:teuthology.orchestra.run.smithi152.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.510481.log.gz 2024-04-17T17:54:18.206 INFO:teuthology.orchestra.run.smithi152.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.453592.log.gz 2024-04-17T17:54:18.206 INFO:teuthology.orchestra.run.smithi152.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.473771.log.gz 2024-04-17T17:54:18.211 INFO:teuthology.orchestra.run.smithi152.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.172028.log.gz 2024-04-17T17:54:18.217 INFO:teuthology.orchestra.run.smithi152.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36616.log.gz 2024-04-17T17:54:18.219 INFO:teuthology.orchestra.run.smithi152.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33784.log.gz 2024-04-17T17:54:18.220 INFO:teuthology.orchestra.run.smithi152.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34202.log.gz 2024-04-17T17:54:18.222 INFO:teuthology.orchestra.run.smithi152.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35328.log.gz 2024-04-17T17:54:18.225 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.127690.log.gz 2024-04-17T17:54:18.226 INFO:teuthology.orchestra.run.smithi152.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.401949.log.gz 2024-04-17T17:54:18.229 INFO:teuthology.orchestra.run.smithi152.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.324322.log.gz 2024-04-17T17:54:18.252 INFO:teuthology.orchestra.run.smithi152.stderr: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.398810.log.gz 2024-04-17T17:54:18.261 INFO:teuthology.orchestra.run.smithi152.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.239799.log.gz 2024-04-17T17:54:18.262 INFO:teuthology.orchestra.run.smithi152.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.223675.log.gz 91.1% 2024-04-17T17:54:18.262 INFO:teuthology.orchestra.run.smithi152.stderr: -- replaced with /var/log/ceph/ceph-client.admin.240206.log.gz 2024-04-17T17:54:18.265 INFO:teuthology.orchestra.run.smithi152.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.127681.log.gz 2024-04-17T17:54:18.279 INFO:teuthology.orchestra.run.smithi152.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.309109.log.gz 2024-04-17T17:54:18.281 INFO:teuthology.orchestra.run.smithi152.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.423619.log.gz 2024-04-17T17:54:18.282 INFO:teuthology.orchestra.run.smithi152.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.335404.log.gz 2024-04-17T17:54:18.282 INFO:teuthology.orchestra.run.smithi152.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.326580.log.gz 2024-04-17T17:54:18.283 INFO:teuthology.orchestra.run.smithi152.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.336799.log.gz 2024-04-17T17:54:18.285 INFO:teuthology.orchestra.run.smithi152.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.441190.log.gz 2024-04-17T17:54:18.286 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.442519.log.gz 2024-04-17T17:54:18.288 INFO:teuthology.orchestra.run.smithi152.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.324728.log.gz 2024-04-17T17:54:18.288 INFO:teuthology.orchestra.run.smithi152.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.445068.log.gz 2024-04-17T17:54:18.295 INFO:teuthology.orchestra.run.smithi152.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.138555.log.gz 2024-04-17T17:54:18.295 INFO:teuthology.orchestra.run.smithi152.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.202420.log.gz 2024-04-17T17:54:18.299 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.436610.log.gz 2024-04-17T17:54:18.300 INFO:teuthology.orchestra.run.smithi152.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.158329.log.gz 2024-04-17T17:54:18.303 INFO:teuthology.orchestra.run.smithi152.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.86400.log.gz 2024-04-17T17:54:18.317 INFO:teuthology.orchestra.run.smithi152.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.201547.log.gz 2024-04-17T17:54:18.320 INFO:teuthology.orchestra.run.smithi152.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37963.log.gz 2024-04-17T17:54:18.323 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.206741.log.gz 2024-04-17T17:54:18.326 INFO:teuthology.orchestra.run.smithi152.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.161825.log.gz 2024-04-17T17:54:18.326 INFO:teuthology.orchestra.run.smithi152.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.206311.log.gz 2024-04-17T17:54:18.337 INFO:teuthology.orchestra.run.smithi152.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.485569.log.gz 2024-04-17T17:54:18.343 INFO:teuthology.orchestra.run.smithi152.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.400060.log.gz 2024-04-17T17:54:18.343 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.168474.log.gz 2024-04-17T17:54:18.343 INFO:teuthology.orchestra.run.smithi152.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.164387.log.gz 2024-04-17T17:54:18.352 INFO:teuthology.orchestra.run.smithi152.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.167207.log.gz 2024-04-17T17:54:18.366 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.359394.log.gz 2024-04-17T17:54:18.366 INFO:teuthology.orchestra.run.smithi152.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.207951.log.gz 2024-04-17T17:54:18.370 INFO:teuthology.orchestra.run.smithi152.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.200192.log.gz 2024-04-17T17:54:18.383 INFO:teuthology.orchestra.run.smithi152.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.467864.log.gz 2024-04-17T17:54:18.414 INFO:teuthology.orchestra.run.smithi152.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.412934.log.gz 2024-04-17T17:54:18.417 INFO:teuthology.orchestra.run.smithi152.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.498437.log.gz 2024-04-17T17:54:18.425 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.445961.log.gz 2024-04-17T17:54:18.425 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.446370.log.gz 2024-04-17T17:54:18.441 INFO:teuthology.orchestra.run.smithi152.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.416880.log.gz 2024-04-17T17:54:18.448 INFO:teuthology.orchestra.run.smithi152.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.367989.log.gz 2024-04-17T17:54:18.448 INFO:teuthology.orchestra.run.smithi152.stderr: 78.9% -- replaced with /var/log/ceph/ceph-client.admin.316026.log.gz 2024-04-17T17:54:18.449 INFO:teuthology.orchestra.run.smithi152.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.210442.log.gz 2024-04-17T17:54:18.457 INFO:teuthology.orchestra.run.smithi152.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.128930.log.gz 2024-04-17T17:54:18.460 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.181489.log.gz 2024-04-17T17:54:18.461 INFO:teuthology.orchestra.run.smithi152.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.435599.log.gz 2024-04-17T17:54:18.496 INFO:teuthology.orchestra.run.smithi152.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36172.log.gz 2024-04-17T17:54:18.496 INFO:teuthology.orchestra.run.smithi152.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36330.log.gz 2024-04-17T17:54:18.512 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.193453.log.gz 2024-04-17T17:54:18.537 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.230290.log.gz 2024-04-17T17:54:18.538 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.226604.log.gz 2024-04-17T17:54:18.547 INFO:teuthology.orchestra.run.smithi152.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.438298.log.gz 2024-04-17T17:54:18.554 INFO:teuthology.orchestra.run.smithi152.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37385.log.gz 2024-04-17T17:54:18.555 INFO:teuthology.orchestra.run.smithi152.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35510.log.gz 2024-04-17T17:54:18.566 INFO:teuthology.orchestra.run.smithi152.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.490637.log.gz 2024-04-17T17:54:18.566 INFO:teuthology.orchestra.run.smithi152.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.479063.log.gz 2024-04-17T17:54:18.567 INFO:teuthology.orchestra.run.smithi152.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.235729.log.gz 2024-04-17T17:54:18.569 INFO:teuthology.orchestra.run.smithi152.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.501870.log.gz 2024-04-17T17:54:18.579 INFO:teuthology.orchestra.run.smithi152.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.475399.log.gz 2024-04-17T17:54:18.586 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.297457.log.gz 2024-04-17T17:54:18.588 INFO:teuthology.orchestra.run.smithi152.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.305745.log.gz 2024-04-17T17:54:18.593 INFO:teuthology.orchestra.run.smithi152.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.380134.log.gz 2024-04-17T17:54:18.598 INFO:teuthology.orchestra.run.smithi152.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.361100.log.gz 2024-04-17T17:54:18.601 INFO:teuthology.orchestra.run.smithi152.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36642.log.gz 2024-04-17T17:54:18.608 INFO:teuthology.orchestra.run.smithi152.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.202857.log.gz 2024-04-17T17:54:18.650 INFO:teuthology.orchestra.run.smithi152.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.486898.log.gz 2024-04-17T17:54:18.667 INFO:teuthology.orchestra.run.smithi152.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.342255.log.gz 2024-04-17T17:54:18.671 INFO:teuthology.orchestra.run.smithi152.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34574.log.gz 2024-04-17T17:54:18.678 INFO:teuthology.orchestra.run.smithi152.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.435059.log.gz 2024-04-17T17:54:18.679 INFO:teuthology.orchestra.run.smithi152.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.323915.log.gz 2024-04-17T17:54:18.680 INFO:teuthology.orchestra.run.smithi152.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.339377.log.gz 2024-04-17T17:54:18.682 INFO:teuthology.orchestra.run.smithi152.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.188001.log.gz 2024-04-17T17:54:18.684 INFO:teuthology.orchestra.run.smithi152.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.325174.log.gz 2024-04-17T17:54:18.685 INFO:teuthology.orchestra.run.smithi152.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.397987.log.gz 2024-04-17T17:54:18.685 INFO:teuthology.orchestra.run.smithi152.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.443322.log.gz 2024-04-17T17:54:18.687 INFO:teuthology.orchestra.run.smithi152.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.450926.log.gz 2024-04-17T17:54:18.687 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.336808.log.gz 2024-04-17T17:54:18.689 INFO:teuthology.orchestra.run.smithi152.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.314798.log.gz 2024-04-17T17:54:18.697 INFO:teuthology.orchestra.run.smithi152.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.380987.log.gz 2024-04-17T17:54:18.703 INFO:teuthology.orchestra.run.smithi152.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33583.log.gz 2024-04-17T17:54:18.705 INFO:teuthology.orchestra.run.smithi152.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.82506.log.gz 2024-04-17T17:54:18.705 INFO:teuthology.orchestra.run.smithi152.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33639.log.gz 2024-04-17T17:54:18.706 INFO:teuthology.orchestra.run.smithi152.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37781.log.gz 2024-04-17T17:54:18.707 INFO:teuthology.orchestra.run.smithi152.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37911.log.gz 2024-04-17T17:54:18.707 INFO:teuthology.orchestra.run.smithi152.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38015.log.gz 2024-04-17T17:54:18.714 INFO:teuthology.orchestra.run.smithi152.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.85577.log.gz 2024-04-17T17:54:18.716 INFO:teuthology.orchestra.run.smithi152.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.213771.log.gz 2024-04-17T17:54:18.717 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.85993.log.gz 2024-04-17T17:54:18.720 INFO:teuthology.orchestra.run.smithi152.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.97441.log.gz 2024-04-17T17:54:18.720 INFO:teuthology.orchestra.run.smithi152.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.78533.log.gz 2024-04-17T17:54:18.722 INFO:teuthology.orchestra.run.smithi152.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.477842.log.gz 2024-04-17T17:54:18.730 INFO:teuthology.orchestra.run.smithi152.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.387563.log.gz 2024-04-17T17:54:18.733 INFO:teuthology.orchestra.run.smithi152.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.393759.log.gz 2024-04-17T17:54:18.733 INFO:teuthology.orchestra.run.smithi152.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.227006.log.gz 2024-04-17T17:54:18.734 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.385519.log.gz 2024-04-17T17:54:18.736 INFO:teuthology.orchestra.run.smithi152.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.300711.log.gz 2024-04-17T17:54:18.737 INFO:teuthology.orchestra.run.smithi152.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.233978.log.gz 2024-04-17T17:54:18.738 INFO:teuthology.orchestra.run.smithi152.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.301944.log.gz 2024-04-17T17:54:18.741 INFO:teuthology.orchestra.run.smithi152.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.187581.log.gz 2024-04-17T17:54:18.746 INFO:teuthology.orchestra.run.smithi152.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.135916.log.gz 2024-04-17T17:54:18.767 INFO:teuthology.orchestra.run.smithi152.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.173737.log.gz 2024-04-17T17:54:18.769 INFO:teuthology.orchestra.run.smithi152.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.295823.log.gz 2024-04-17T17:54:18.780 INFO:teuthology.orchestra.run.smithi152.stderr: 95.5% -- replaced with /var/log/ceph/ceph-client.admin.401206.log.gz 2024-04-17T17:54:18.815 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.447996.log.gz 2024-04-17T17:54:18.822 INFO:teuthology.orchestra.run.smithi152.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.179824.log.gz 2024-04-17T17:54:18.824 INFO:teuthology.orchestra.run.smithi152.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.499287.log.gz 2024-04-17T17:54:18.835 INFO:teuthology.orchestra.run.smithi152.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.129340.log.gz 2024-04-17T17:54:18.836 INFO:teuthology.orchestra.run.smithi152.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.335413.log.gz 2024-04-17T17:54:18.872 INFO:teuthology.orchestra.run.smithi152.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37729.log.gz 2024-04-17T17:54:18.874 INFO:teuthology.orchestra.run.smithi152.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.33914.log.gz 2024-04-17T17:54:18.890 INFO:teuthology.orchestra.run.smithi152.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.165282.log.gz 2024-04-17T17:54:18.891 INFO:teuthology.orchestra.run.smithi152.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.188860.log.gz 2024-04-17T17:54:18.903 INFO:teuthology.orchestra.run.smithi152.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.450468.log.gz 2024-04-17T17:54:18.938 INFO:teuthology.orchestra.run.smithi152.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.462765.log.gz 2024-04-17T17:54:18.941 INFO:teuthology.orchestra.run.smithi152.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.429761.log.gz 2024-04-17T17:54:19.014 INFO:teuthology.orchestra.run.smithi152.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.442925.log.gz 2024-04-17T17:54:19.102 INFO:teuthology.orchestra.run.smithi152.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.417309.log.gz 2024-04-17T17:54:19.103 INFO:teuthology.orchestra.run.smithi152.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.419359.log.gz 2024-04-17T17:54:19.131 INFO:teuthology.orchestra.run.smithi152.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.412523.log.gz 2024-04-17T17:54:19.133 INFO:teuthology.orchestra.run.smithi152.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.394165.log.gz 2024-04-17T17:54:19.135 INFO:teuthology.orchestra.run.smithi152.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.369224.log.gz 2024-04-17T17:54:19.139 INFO:teuthology.orchestra.run.smithi152.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.476214.log.gz 2024-04-17T17:54:19.141 INFO:teuthology.orchestra.run.smithi152.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33964.log.gz 2024-04-17T17:54:19.143 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.378482.log.gz 2024-04-17T17:54:19.150 INFO:teuthology.orchestra.run.smithi152.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.495875.log.gz 2024-04-17T17:54:19.151 INFO:teuthology.orchestra.run.smithi152.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36831.log.gz 2024-04-17T17:54:19.164 INFO:teuthology.orchestra.run.smithi152.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.186359.log.gz 2024-04-17T17:54:19.164 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.184332.log.gz 2024-04-17T17:54:19.165 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.186368.log.gz 2024-04-17T17:54:19.167 INFO:teuthology.orchestra.run.smithi152.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.305754.log.gz 2024-04-17T17:54:19.167 INFO:teuthology.orchestra.run.smithi152.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.496711.log.gz 2024-04-17T17:54:19.168 INFO:teuthology.orchestra.run.smithi152.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.39061.log.gz 2024-04-17T17:54:19.175 INFO:teuthology.orchestra.run.smithi152.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.225331.log.gz 2024-04-17T17:54:19.177 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.224925.log.gz 2024-04-17T17:54:19.180 INFO:teuthology.orchestra.run.smithi152.stderr: 79.5% -- replaced with /var/log/ceph/ceph-client.admin.112422.log.gz 2024-04-17T17:54:19.185 INFO:teuthology.orchestra.run.smithi152.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.440783.log.gz 2024-04-17T17:54:19.190 INFO:teuthology.orchestra.run.smithi152.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.308679.log.gz 2024-04-17T17:54:19.192 INFO:teuthology.orchestra.run.smithi152.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.304901.log.gz 2024-04-17T17:54:19.196 INFO:teuthology.orchestra.run.smithi152.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.302755.log.gz 2024-04-17T17:54:19.205 INFO:teuthology.orchestra.run.smithi152.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.100697.log.gz 2024-04-17T17:54:19.205 INFO:teuthology.orchestra.run.smithi152.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.95316.log.gz 2024-04-17T17:54:19.224 INFO:teuthology.orchestra.run.smithi196.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-17T17:54:19.233 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.426161.log.gz 2024-04-17T17:54:19.240 INFO:teuthology.orchestra.run.smithi152.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.390052.log.gz 2024-04-17T17:54:19.271 INFO:teuthology.orchestra.run.smithi152.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.305348.log.gz 2024-04-17T17:54:19.277 INFO:teuthology.orchestra.run.smithi152.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.109472.log.gz 2024-04-17T17:54:19.297 INFO:teuthology.orchestra.run.smithi152.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.393321.log.gz 2024-04-17T17:54:19.298 INFO:teuthology.orchestra.run.smithi152.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.163958.log.gz 2024-04-17T17:54:19.301 INFO:teuthology.orchestra.run.smithi152.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.402360.log.gz 2024-04-17T17:54:19.352 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.397185.log.gz 2024-04-17T17:54:19.358 INFO:teuthology.orchestra.run.smithi152.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.84066.log.gz 2024-04-17T17:54:19.359 INFO:teuthology.orchestra.run.smithi152.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.382630.log.gz 2024-04-17T17:54:19.360 INFO:teuthology.orchestra.run.smithi152.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.211259.log.gz 2024-04-17T17:54:19.362 INFO:teuthology.orchestra.run.smithi152.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.441608.log.gz 2024-04-17T17:54:19.362 INFO:teuthology.orchestra.run.smithi152.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.297051.log.gz 2024-04-17T17:54:19.363 INFO:teuthology.orchestra.run.smithi152.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.209169.log.gz 2024-04-17T17:54:19.366 INFO:teuthology.orchestra.run.smithi152.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.337669.log.gz 2024-04-17T17:54:19.367 INFO:teuthology.orchestra.run.smithi152.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.211675.log.gz 2024-04-17T17:54:19.375 INFO:teuthology.orchestra.run.smithi152.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.169877.log.gz 2024-04-17T17:54:19.377 INFO:teuthology.orchestra.run.smithi152.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.393330.log.gz 2024-04-17T17:54:19.377 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.299498.log.gz 2024-04-17T17:54:19.380 INFO:teuthology.orchestra.run.smithi152.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.158763.log.gz 2024-04-17T17:54:19.386 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.362400.log.gz 2024-04-17T17:54:19.386 INFO:teuthology.orchestra.run.smithi152.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.475390.log.gz 2024-04-17T17:54:19.389 INFO:teuthology.orchestra.run.smithi152.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.480284.log.gz 2024-04-17T17:54:19.394 INFO:teuthology.orchestra.run.smithi152.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.503147.log.gz 2024-04-17T17:54:19.402 INFO:teuthology.orchestra.run.smithi152.stderr: 79.0% -- replaced with /var/log/ceph/ceph-client.admin.175899.log.gz 2024-04-17T17:54:19.418 INFO:teuthology.orchestra.run.smithi152.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36753.log.gz 2024-04-17T17:54:19.419 INFO:teuthology.orchestra.run.smithi152.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.95731.log.gz 2024-04-17T17:54:19.421 INFO:teuthology.orchestra.run.smithi152.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.106471.log.gz 2024-04-17T17:54:19.424 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.129779.log.gz 2024-04-17T17:54:19.425 INFO:teuthology.orchestra.run.smithi152.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34359.log.gz 2024-04-17T17:54:19.429 INFO:teuthology.orchestra.run.smithi152.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.199786.log.gz 2024-04-17T17:54:19.430 INFO:teuthology.orchestra.run.smithi152.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.226189.log.gz 2024-04-17T17:54:19.444 INFO:teuthology.orchestra.run.smithi152.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.158320.log.gz 2024-04-17T17:54:19.502 INFO:teuthology.orchestra.run.smithi152.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.509593.log.gz 2024-04-17T17:54:19.504 INFO:teuthology.orchestra.run.smithi152.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.483026.log.gz 2024-04-17T17:54:20.415 INFO:teuthology.orchestra.run.smithi152.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.440339.log.gz 2024-04-17T17:54:21.177 INFO:teuthology.orchestra.run.smithi152.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.178084.log.gz 2024-04-17T17:54:23.128 INFO:teuthology.orchestra.run.smithi152.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44157.log.gz 2024-04-17T17:54:23.128 INFO:teuthology.orchestra.run.smithi152.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44131.log.gz 2024-04-17T17:54:23.135 INFO:teuthology.orchestra.run.smithi152.stderr: 83.3% 80.8% -- replaced with /var/log/ceph/ceph-client.admin.249798.log.gz -- replaced with /var/log/ceph/ceph-client.admin.212920.log.gz 2024-04-17T17:54:23.135 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-04-17T17:54:23.135 INFO:teuthology.orchestra.run.smithi152.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.447987.log.gz 2024-04-17T17:54:23.135 INFO:teuthology.orchestra.run.smithi152.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.174606.log.gz 81.3% 2024-04-17T17:54:23.135 INFO:teuthology.orchestra.run.smithi152.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.301122.log.gz 2024-04-17T17:54:23.135 INFO:teuthology.orchestra.run.smithi152.stderr: -- replaced with /var/log/ceph/ceph-client.admin.128512.log.gz 2024-04-17T17:54:23.135 INFO:teuthology.orchestra.run.smithi152.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.454815.log.gz 2024-04-17T17:54:23.136 INFO:teuthology.orchestra.run.smithi152.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.368402.log.gz 2024-04-17T17:54:23.136 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.157097.log.gz 2024-04-17T17:54:23.136 INFO:teuthology.orchestra.run.smithi152.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.209637.log.gz 2024-04-17T17:54:23.136 INFO:teuthology.orchestra.run.smithi152.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.175040.log.gz 2024-04-17T17:54:23.136 INFO:teuthology.orchestra.run.smithi152.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.96985.log.gz 2024-04-17T17:54:23.136 INFO:teuthology.orchestra.run.smithi152.stderr: 83.4% -- replaced with /var/log/ceph/ceph-client.admin.97432.log.gz 2024-04-17T17:54:23.136 INFO:teuthology.orchestra.run.smithi152.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.138971.log.gz 2024-04-17T17:54:23.136 INFO:teuthology.orchestra.run.smithi152.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.205905.log.gz 2024-04-17T17:54:23.136 INFO:teuthology.orchestra.run.smithi152.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.392507.log.gz 2024-04-17T17:54:23.137 INFO:teuthology.orchestra.run.smithi152.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36779.log.gz 2024-04-17T17:54:23.137 INFO:teuthology.orchestra.run.smithi152.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.212481.log.gz 2024-04-17T17:54:23.137 INFO:teuthology.orchestra.run.smithi152.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.501003.log.gz 2024-04-17T17:54:23.137 INFO:teuthology.orchestra.run.smithi152.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38119.log.gz 2024-04-17T17:54:23.137 INFO:teuthology.orchestra.run.smithi152.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36538.log.gz 2024-04-17T17:54:23.137 INFO:teuthology.orchestra.run.smithi152.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.331713.log.gz 2024-04-17T17:54:30.235 INFO:teuthology.orchestra.run.smithi152.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.378473.log.gz 2024-04-17T17:54:30.235 INFO:teuthology.orchestra.run.smithi152.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.343191.log.gz 2024-04-17T17:54:30.235 INFO:teuthology.orchestra.run.smithi152.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.133180.log.gz 2024-04-17T17:54:30.235 INFO:teuthology.orchestra.run.smithi152.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.343652.log.gz 2024-04-17T17:54:30.236 INFO:teuthology.orchestra.run.smithi152.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.437417.log.gz 2024-04-17T17:54:30.236 INFO:teuthology.orchestra.run.smithi152.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.412514.log.gz 2024-04-17T17:54:30.236 INFO:teuthology.orchestra.run.smithi152.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.410890.log.gz 2024-04-17T17:54:30.236 INFO:teuthology.orchestra.run.smithi152.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.331299.log.gz 2024-04-17T17:54:30.236 INFO:teuthology.orchestra.run.smithi152.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.386733.log.gz 2024-04-17T17:54:30.236 INFO:teuthology.orchestra.run.smithi152.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.165737.log.gz 2024-04-17T17:54:30.236 INFO:teuthology.orchestra.run.smithi152.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.162675.log.gz 2024-04-17T17:54:30.236 INFO:teuthology.orchestra.run.smithi152.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.417716.log.gz 2024-04-17T17:54:30.236 INFO:teuthology.orchestra.run.smithi152.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.198156.log.gz 2024-04-17T17:54:30.237 INFO:teuthology.orchestra.run.smithi152.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.363213.log.gz 2024-04-17T17:54:30.237 INFO:teuthology.orchestra.run.smithi152.stderr: 79.0% -- replaced with /var/log/ceph/ceph-client.admin.319354.log.gz 2024-04-17T17:54:30.237 INFO:teuthology.orchestra.run.smithi152.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.396769.log.gz 2024-04-17T17:54:30.237 INFO:teuthology.orchestra.run.smithi152.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.340783.log.gz 2024-04-17T17:54:30.237 INFO:teuthology.orchestra.run.smithi152.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.78951.log.gz 2024-04-17T17:54:30.237 INFO:teuthology.orchestra.run.smithi152.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.390462.log.gz 2024-04-17T17:54:30.237 INFO:teuthology.orchestra.run.smithi152.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36720.log.gz 2024-04-17T17:54:30.237 INFO:teuthology.orchestra.run.smithi152.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.454409.log.gz 2024-04-17T17:54:30.237 INFO:teuthology.orchestra.run.smithi152.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.453374.log.gz 2024-04-17T17:54:30.238 INFO:teuthology.orchestra.run.smithi152.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.489474.log.gz 2024-04-17T17:54:30.238 INFO:teuthology.orchestra.run.smithi152.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.100291.log.gz 2024-04-17T17:54:30.238 INFO:teuthology.orchestra.run.smithi152.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.314383.log.gz 2024-04-17T17:54:30.238 INFO:teuthology.orchestra.run.smithi152.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37201.log.gz 2024-04-17T17:54:30.238 INFO:teuthology.orchestra.run.smithi152.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.384291.log.gz 2024-04-17T17:54:30.238 INFO:teuthology.orchestra.run.smithi152.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.168465.log.gz 2024-04-17T17:54:30.238 INFO:teuthology.orchestra.run.smithi152.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.373794.log.gz 2024-04-17T17:54:30.238 INFO:teuthology.orchestra.run.smithi152.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.507434.log.gz 2024-04-17T17:54:30.238 INFO:teuthology.orchestra.run.smithi152.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36910.log.gz 2024-04-17T17:54:30.239 INFO:teuthology.orchestra.run.smithi152.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.139519.log.gz 2024-04-17T17:54:30.239 INFO:teuthology.orchestra.run.smithi152.stderr: 93.4% 81.7% -- replaced with /var/log/ceph/ceph-client.admin.400474.log.gz 2024-04-17T17:54:30.239 INFO:teuthology.orchestra.run.smithi152.stderr: -- replaced with /var/log/ceph/ceph-client.admin.413779.log.gz 2024-04-17T17:54:30.239 INFO:teuthology.orchestra.run.smithi152.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.205896.log.gz 2024-04-17T17:54:30.239 INFO:teuthology.orchestra.run.smithi152.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.442040.log.gz 2024-04-17T17:54:30.239 INFO:teuthology.orchestra.run.smithi152.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.365914.log.gz 2024-04-17T17:54:30.239 INFO:teuthology.orchestra.run.smithi152.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.382639.log.gz 2024-04-17T17:54:30.239 INFO:teuthology.orchestra.run.smithi152.stderr: 80.0% -- replaced with /var/log/ceph/ceph-client.admin.103545.log.gz 2024-04-17T17:54:30.239 INFO:teuthology.orchestra.run.smithi152.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.137244.log.gz 2024-04-17T17:54:30.239 INFO:teuthology.orchestra.run.smithi152.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.98657.log.gz 2024-04-17T17:54:30.240 INFO:teuthology.orchestra.run.smithi152.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.334176.log.gz 2024-04-17T17:54:30.240 INFO:teuthology.orchestra.run.smithi152.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.481089.log.gz 2024-04-17T17:54:30.240 INFO:teuthology.orchestra.run.smithi152.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.480691.log.gz 2024-04-17T17:54:30.240 INFO:teuthology.orchestra.run.smithi152.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36512.log.gz 2024-04-17T17:54:30.240 INFO:teuthology.orchestra.run.smithi152.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.508769.log.gz 2024-04-17T17:54:30.240 INFO:teuthology.orchestra.run.smithi152.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.485153.log.gz 2024-04-17T17:54:30.240 INFO:teuthology.orchestra.run.smithi152.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.421924.log.gz 2024-04-17T17:54:30.240 INFO:teuthology.orchestra.run.smithi152.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.397176.log.gz 2024-04-17T17:54:30.240 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.315628.log.gz 2024-04-17T17:54:30.241 INFO:teuthology.orchestra.run.smithi152.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.243109.log.gz 2024-04-17T17:54:30.241 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.431158.log.gz 2024-04-17T17:54:30.241 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.313174.log.gz 2024-04-17T17:54:30.241 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.421933.log.gz 2024-04-17T17:54:30.241 INFO:teuthology.orchestra.run.smithi152.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.303160.log.gz 2024-04-17T17:54:30.241 INFO:teuthology.orchestra.run.smithi152.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38301.log.gz 2024-04-17T17:54:30.241 INFO:teuthology.orchestra.run.smithi152.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.418136.log.gz 2024-04-17T17:54:30.241 INFO:teuthology.orchestra.run.smithi152.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.331308.log.gz 2024-04-17T17:54:30.241 INFO:teuthology.orchestra.run.smithi152.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.80768.log.gz 2024-04-17T17:54:30.241 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.166810.log.gz 2024-04-17T17:54:30.242 INFO:teuthology.orchestra.run.smithi152.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.502289.log.gz 2024-04-17T17:54:30.242 INFO:teuthology.orchestra.run.smithi152.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.296234.log.gz 2024-04-17T17:54:30.242 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.195274.log.gz 2024-04-17T17:54:30.242 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.410899.log.gz 2024-04-17T17:54:30.242 INFO:teuthology.orchestra.run.smithi152.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.400465.log.gz 2024-04-17T17:54:30.242 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.307055.log.gz 2024-04-17T17:54:30.242 INFO:teuthology.orchestra.run.smithi152.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.171585.log.gz 2024-04-17T17:54:30.242 INFO:teuthology.orchestra.run.smithi152.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.222631.log.gz 2024-04-17T17:54:30.243 INFO:teuthology.orchestra.run.smithi152.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.102323.log.gz 2024-04-17T17:54:30.243 INFO:teuthology.orchestra.run.smithi152.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.111589.log.gz 2024-04-17T17:54:30.243 INFO:teuthology.orchestra.run.smithi152.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.371574.log.gz 2024-04-17T17:54:30.243 INFO:teuthology.orchestra.run.smithi152.stderr: 79.0% -- replaced with /var/log/ceph/ceph-client.admin.108189.log.gz 2024-04-17T17:54:30.243 INFO:teuthology.orchestra.run.smithi152.stderr: 79.6% -- replaced with /var/log/ceph/ceph-client.admin.498428.log.gz 2024-04-17T17:54:30.243 INFO:teuthology.orchestra.run.smithi152.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39189.log.gz 2024-04-17T17:54:30.243 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.451340.log.gz 2024-04-17T17:54:30.243 INFO:teuthology.orchestra.run.smithi152.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.198977.log.gz 2024-04-17T17:54:30.243 INFO:teuthology.orchestra.run.smithi152.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.340286.log.gz 2024-04-17T17:54:30.244 INFO:teuthology.orchestra.run.smithi152.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.98666.log.gz 2024-04-17T17:54:30.244 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.429297.log.gz 2024-04-17T17:54:30.244 INFO:teuthology.orchestra.run.smithi152.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.484274.log.gz 2024-04-17T17:54:30.244 INFO:teuthology.orchestra.run.smithi152.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.154636.log.gz 2024-04-17T17:54:30.244 INFO:teuthology.orchestra.run.smithi152.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34777.log.gz 2024-04-17T17:54:30.244 INFO:teuthology.orchestra.run.smithi152.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.369637.log.gz 2024-04-17T17:54:30.244 INFO:teuthology.orchestra.run.smithi152.stderr: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.425276.log.gz 2024-04-17T17:54:30.244 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.232745.log.gz 2024-04-17T17:54:30.244 INFO:teuthology.orchestra.run.smithi152.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.168871.log.gz 2024-04-17T17:54:30.244 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.437017.log.gz 2024-04-17T17:54:30.245 INFO:teuthology.orchestra.run.smithi152.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37411.log.gz 2024-04-17T17:54:30.245 INFO:teuthology.orchestra.run.smithi152.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.223666.log.gz 2024-04-17T17:54:30.245 INFO:teuthology.orchestra.run.smithi152.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.241017.log.gz 2024-04-17T17:54:30.245 INFO:teuthology.orchestra.run.smithi152.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.183510.log.gz 2024-04-17T17:54:30.245 INFO:teuthology.orchestra.run.smithi152.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.242670.log.gz 2024-04-17T17:54:30.245 INFO:teuthology.orchestra.run.smithi152.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.420587.log.gz 2024-04-17T17:54:30.245 INFO:teuthology.orchestra.run.smithi152.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.486453.log.gz 2024-04-17T17:54:30.245 INFO:teuthology.orchestra.run.smithi152.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.317320.log.gz 2024-04-17T17:54:30.245 INFO:teuthology.orchestra.run.smithi152.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.478647.log.gz 2024-04-17T17:54:30.245 INFO:teuthology.orchestra.run.smithi152.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.38758.log.gz 2024-04-17T17:54:30.246 INFO:teuthology.orchestra.run.smithi152.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.244330.log.gz 2024-04-17T17:54:30.246 INFO:teuthology.orchestra.run.smithi152.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.453383.log.gz 2024-04-17T17:54:30.246 INFO:teuthology.orchestra.run.smithi152.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.172868.log.gz 2024-04-17T17:54:30.246 INFO:teuthology.orchestra.run.smithi152.stderr: 89.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-17T17:54:30.246 INFO:teuthology.orchestra.run.smithi152.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.509174.log.gz 2024-04-17T17:54:30.246 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.231923.log.gz 2024-04-17T17:54:30.246 INFO:teuthology.orchestra.run.smithi152.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.79897.log.gz 2024-04-17T17:54:30.246 INFO:teuthology.orchestra.run.smithi152.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.192226.log.gz 2024-04-17T17:54:30.246 INFO:teuthology.orchestra.run.smithi152.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.295814.log.gz 2024-04-17T17:54:30.247 INFO:teuthology.orchestra.run.smithi152.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.414723.log.gz 2024-04-17T17:54:30.247 INFO:teuthology.orchestra.run.smithi152.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.441599.log.gz 2024-04-17T17:54:30.247 INFO:teuthology.orchestra.run.smithi152.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.489074.log.gz 2024-04-17T17:54:30.247 INFO:teuthology.orchestra.run.smithi152.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.243516.log.gz 2024-04-17T17:54:30.247 INFO:teuthology.orchestra.run.smithi152.stderr: 83.5% -- replaced with /var/log/ceph/ceph-client.admin.221762.log.gz 2024-04-17T17:54:30.247 INFO:teuthology.orchestra.run.smithi152.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.111995.log.gz 2024-04-17T17:54:30.247 INFO:teuthology.orchestra.run.smithi152.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.376182.log.gz 2024-04-17T17:54:30.247 INFO:teuthology.orchestra.run.smithi152.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.168029.log.gz 2024-04-17T17:54:30.247 INFO:teuthology.orchestra.run.smithi152.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.376123.log.gz 2024-04-17T17:54:30.247 INFO:teuthology.orchestra.run.smithi152.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.165746.log.gz 2024-04-17T17:54:30.248 INFO:teuthology.orchestra.run.smithi152.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.173728.log.gz 2024-04-17T17:54:30.248 INFO:teuthology.orchestra.run.smithi152.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38654.log.gz 2024-04-17T17:54:30.248 INFO:teuthology.orchestra.run.smithi152.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.387974.log.gz 2024-04-17T17:54:30.248 INFO:teuthology.orchestra.run.smithi152.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.236136.log.gz 2024-04-17T17:54:30.248 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.382227.log.gz 2024-04-17T17:54:30.248 INFO:teuthology.orchestra.run.smithi152.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.298671.log.gz 2024-04-17T17:54:30.248 INFO:teuthology.orchestra.run.smithi152.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.431560.log.gz 2024-04-17T17:54:30.248 INFO:teuthology.orchestra.run.smithi152.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.334988.log.gz 2024-04-17T17:54:30.248 INFO:teuthology.orchestra.run.smithi152.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.381401.log.gz 2024-04-17T17:54:30.249 INFO:teuthology.orchestra.run.smithi152.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.27656.log.gz 2024-04-17T17:54:30.249 INFO:teuthology.orchestra.run.smithi152.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.416871.log.gz 2024-04-17T17:54:30.249 INFO:teuthology.orchestra.run.smithi152.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.318532.log.gz 2024-04-17T17:54:30.249 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.437426.log.gz 2024-04-17T17:54:30.249 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.309932.log.gz 2024-04-17T17:54:30.249 INFO:teuthology.orchestra.run.smithi152.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.472130.log.gz 2024-04-17T17:54:30.249 INFO:teuthology.orchestra.run.smithi152.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.104371.log.gz 2024-04-17T17:54:30.249 INFO:teuthology.orchestra.run.smithi152.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.251533.log.gz 2024-04-17T17:54:30.249 INFO:teuthology.orchestra.run.smithi152.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.367583.log.gz 2024-04-17T17:54:30.250 INFO:teuthology.orchestra.run.smithi152.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.99076.log.gz 2024-04-17T17:54:30.250 INFO:teuthology.orchestra.run.smithi152.stderr: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.495866.log.gz 2024-04-17T17:54:30.250 INFO:teuthology.orchestra.run.smithi152.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.343200.log.gz 2024-04-17T17:54:30.250 INFO:teuthology.orchestra.run.smithi152.stderr: 83.8% -- replaced with /var/log/ceph/ceph-client.admin.91249.log.gz 2024-04-17T17:54:30.250 INFO:teuthology.orchestra.run.smithi152.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37040.log.gz 2024-04-17T17:54:30.250 INFO:teuthology.orchestra.run.smithi152.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.219236.log.gz 2024-04-17T17:54:30.250 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.239393.log.gz 2024-04-17T17:54:30.250 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.388832.log.gz 2024-04-17T17:54:30.250 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.226198.log.gz 2024-04-17T17:54:30.251 INFO:teuthology.orchestra.run.smithi152.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.178509.log.gz 2024-04-17T17:54:30.251 INFO:teuthology.orchestra.run.smithi152.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.244764.log.gz 2024-04-17T17:54:30.251 INFO:teuthology.orchestra.run.smithi152.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.490372.log.gz 2024-04-17T17:54:30.251 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.314392.log.gz 2024-04-17T17:54:30.251 INFO:teuthology.orchestra.run.smithi152.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.110717.log.gz 2024-04-17T17:54:30.251 INFO:teuthology.orchestra.run.smithi152.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.402765.log.gz 2024-04-17T17:54:30.251 INFO:teuthology.orchestra.run.smithi152.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.185951.log.gz 2024-04-17T17:54:30.251 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.199389.log.gz 2024-04-17T17:54:30.251 INFO:teuthology.orchestra.run.smithi152.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35224.log.gz 2024-04-17T17:54:30.251 INFO:teuthology.orchestra.run.smithi152.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.371168.log.gz 2024-04-17T17:54:30.252 INFO:teuthology.orchestra.run.smithi152.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.365500.log.gz 84.4% 2024-04-17T17:54:30.252 INFO:teuthology.orchestra.run.smithi152.stderr: -- replaced with /var/log/ceph/ceph-client.admin.319760.log.gz 2024-04-17T17:54:30.252 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.365509.log.gz 2024-04-17T17:54:30.252 INFO:teuthology.orchestra.run.smithi152.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34982.log.gz 2024-04-17T17:54:30.252 INFO:teuthology.orchestra.run.smithi152.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.466626.log.gz 2024-04-17T17:54:30.252 INFO:teuthology.orchestra.run.smithi152.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.238572.log.gz 2024-04-17T17:54:30.252 INFO:teuthology.orchestra.run.smithi152.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.103954.log.gz 2024-04-17T17:54:30.252 INFO:teuthology.orchestra.run.smithi152.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.342721.log.gz 2024-04-17T17:54:30.252 INFO:teuthology.orchestra.run.smithi152.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.448409.log.gz 2024-04-17T17:54:30.253 INFO:teuthology.orchestra.run.smithi152.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.216837.log.gz 2024-04-17T17:54:30.253 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.303169.log.gz 2024-04-17T17:54:30.253 INFO:teuthology.orchestra.run.smithi152.stderr: 79.0% -- replaced with /var/log/ceph/ceph-client.admin.110708.log.gz 2024-04-17T17:54:30.253 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.243118.log.gz 2024-04-17T17:54:30.253 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.241432.log.gz 90.1% 2024-04-17T17:54:30.253 INFO:teuthology.orchestra.run.smithi152.stderr: -- replaced with /var/log/ceph/ceph-client.admin.383078.log.gz 2024-04-17T17:54:30.253 INFO:teuthology.orchestra.run.smithi152.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33888.log.gz 2024-04-17T17:54:30.253 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.315216.log.gz 2024-04-17T17:54:30.254 INFO:teuthology.orchestra.run.smithi152.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.366311.log.gz 2024-04-17T17:54:30.254 INFO:teuthology.orchestra.run.smithi152.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36694.log.gz 2024-04-17T17:54:30.254 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.449639.log.gz 2024-04-17T17:54:30.254 INFO:teuthology.orchestra.run.smithi152.stderr: 79.1% -- replaced with /var/log/ceph/ceph-client.admin.505778.log.gz 2024-04-17T17:54:30.254 INFO:teuthology.orchestra.run.smithi152.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.444254.log.gz 2024-04-17T17:54:30.254 INFO:teuthology.orchestra.run.smithi152.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.304410.log.gz 2024-04-17T17:54:30.254 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.182301.log.gz 2024-04-17T17:54:30.254 INFO:teuthology.orchestra.run.smithi152.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.502709.log.gz 2024-04-17T17:54:30.254 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.414260.log.gz 2024-04-17T17:54:30.254 INFO:teuthology.orchestra.run.smithi152.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.503576.log.gz 2024-04-17T17:54:30.255 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.367161.log.gz 2024-04-17T17:54:30.255 INFO:teuthology.orchestra.run.smithi152.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.216386.log.gz 2024-04-17T17:54:30.255 INFO:teuthology.orchestra.run.smithi152.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.230281.log.gz 2024-04-17T17:54:30.255 INFO:teuthology.orchestra.run.smithi152.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.186776.log.gz 2024-04-17T17:54:30.255 INFO:teuthology.orchestra.run.smithi152.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.427384.log.gz 2024-04-17T17:54:30.255 INFO:teuthology.orchestra.run.smithi152.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37646.log.gz 2024-04-17T17:54:30.255 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.385112.log.gz 2024-04-17T17:54:30.255 INFO:teuthology.orchestra.run.smithi152.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.183104.log.gz 2024-04-17T17:54:30.255 INFO:teuthology.orchestra.run.smithi152.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36460.log.gz 2024-04-17T17:54:30.256 INFO:teuthology.orchestra.run.smithi152.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.487796.log.gz 2024-04-17T17:54:30.256 INFO:teuthology.orchestra.run.smithi152.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.78542.log.gz 2024-04-17T17:54:30.256 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.110305.log.gz 2024-04-17T17:54:30.256 INFO:teuthology.orchestra.run.smithi152.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36068.log.gz 2024-04-17T17:54:30.256 INFO:teuthology.orchestra.run.smithi152.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.494611.log.gz 2024-04-17T17:54:30.256 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.439121.log.gz 2024-04-17T17:54:30.256 INFO:teuthology.orchestra.run.smithi152.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.35614.log.gz 2024-04-17T17:54:30.256 INFO:teuthology.orchestra.run.smithi152.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.380996.log.gz 2024-04-17T17:54:30.256 INFO:teuthology.orchestra.run.smithi152.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.307046.log.gz 2024-04-17T17:54:30.257 INFO:teuthology.orchestra.run.smithi152.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.297042.log.gz 2024-04-17T17:54:30.257 INFO:teuthology.orchestra.run.smithi152.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.175908.log.gz 2024-04-17T17:54:30.257 INFO:teuthology.orchestra.run.smithi152.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.504455.log.gz 2024-04-17T17:54:30.257 INFO:teuthology.orchestra.run.smithi152.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.253282.log.gz 2024-04-17T17:54:30.257 INFO:teuthology.orchestra.run.smithi152.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.180673.log.gz 2024-04-17T17:54:30.257 INFO:teuthology.orchestra.run.smithi152.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.109886.log.gz 2024-04-17T17:54:30.257 INFO:teuthology.orchestra.run.smithi152.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36564.log.gz 2024-04-17T17:54:30.257 INFO:teuthology.orchestra.run.smithi152.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34548.log.gz 2024-04-17T17:54:30.257 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.139528.log.gz 2024-04-17T17:54:30.258 INFO:teuthology.orchestra.run.smithi152.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.175474.log.gz 2024-04-17T17:54:30.258 INFO:teuthology.orchestra.run.smithi152.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.137253.log.gz 2024-04-17T17:54:30.258 INFO:teuthology.orchestra.run.smithi152.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.209178.log.gz 2024-04-17T17:54:30.258 INFO:teuthology.orchestra.run.smithi152.stderr: 89.0% 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38249.log.gz -- replaced with /var/log/ceph/ceph-client.admin.38275.log.gz 2024-04-17T17:54:30.258 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-04-17T17:54:30.258 INFO:teuthology.orchestra.run.smithi152.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.132285.log.gz 2024-04-17T17:54:30.258 INFO:teuthology.orchestra.run.smithi152.stderr: 94.0% 95.6% -- replaced with /var/log/ceph/ceph-client.admin.435608.log.gz -- replaced with /var/log/ceph/ceph-client.admin.77543.log.gz 2024-04-17T17:54:30.258 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-04-17T17:54:30.258 INFO:teuthology.orchestra.run.smithi152.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.170725.log.gz 2024-04-17T17:54:30.259 INFO:teuthology.orchestra.run.smithi152.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.139925.log.gz 2024-04-17T17:54:30.259 INFO:teuthology.orchestra.run.smithi152.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.176342.log.gz 2024-04-17T17:54:30.259 INFO:teuthology.orchestra.run.smithi152.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.176776.log.gz 2024-04-17T17:54:30.259 INFO:teuthology.orchestra.run.smithi152.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.194279.log.gz 2024-04-17T17:54:30.259 INFO:teuthology.orchestra.run.smithi152.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.382218.log.gz 2024-04-17T17:54:30.259 INFO:teuthology.orchestra.run.smithi152.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37885.log.gz 2024-04-17T17:54:30.259 INFO:teuthology.orchestra.run.smithi152.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.454003.log.gz 2024-04-17T17:54:30.259 INFO:teuthology.orchestra.run.smithi152.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.101112.log.gz 2024-04-17T17:54:30.259 INFO:teuthology.orchestra.run.smithi152.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.375869.log.gz 93.4% 2024-04-17T17:54:30.259 INFO:teuthology.orchestra.run.smithi152.stderr: -- replaced with /var/log/ceph/ceph-client.admin.337678.log.gz 2024-04-17T17:54:30.260 INFO:teuthology.orchestra.run.smithi152.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.376279.log.gz 2024-04-17T17:54:30.260 INFO:teuthology.orchestra.run.smithi152.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.388396.log.gz 2024-04-17T17:54:30.260 INFO:teuthology.orchestra.run.smithi152.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.418538.log.gz 2024-04-17T17:54:30.260 INFO:teuthology.orchestra.run.smithi152.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.412943.log.gz 2024-04-17T17:54:30.260 INFO:teuthology.orchestra.run.smithi152.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.376230.log.gz 2024-04-17T17:54:30.260 INFO:teuthology.orchestra.run.smithi152.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.505342.log.gz 2024-04-17T17:54:30.260 INFO:teuthology.orchestra.run.smithi152.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.456037.log.gz 2024-04-17T17:54:30.260 INFO:teuthology.orchestra.run.smithi152.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.203320.log.gz 2024-04-17T17:54:30.260 INFO:teuthology.orchestra.run.smithi152.stderr: 95.3% 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37807.log.gz 2024-04-17T17:54:30.261 INFO:teuthology.orchestra.run.smithi152.stderr: -- replaced with /var/log/ceph/ceph-client.0.39245.log.gz 2024-04-17T17:54:30.261 INFO:teuthology.orchestra.run.smithi152.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.34092.log.gz 2024-04-17T17:54:30.261 INFO:teuthology.orchestra.run.smithi152.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.38093.log.gz 2024-04-17T17:54:30.261 INFO:teuthology.orchestra.run.smithi152.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.330419.log.gz 2024-04-17T17:54:30.261 INFO:teuthology.orchestra.run.smithi152.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.337221.log.gz 2024-04-17T17:54:30.261 INFO:teuthology.orchestra.run.smithi152.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.400916.log.gz 2024-04-17T17:54:30.261 INFO:teuthology.orchestra.run.smithi152.stderr: 94.9% -- replaced with /var/log/ceph/ceph-client.admin.364534.log.gz 2024-04-17T17:54:30.261 INFO:teuthology.orchestra.run.smithi152.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.483438.log.gz 2024-04-17T17:54:30.261 INFO:teuthology.orchestra.run.smithi152.stderr: 95.9% -- replaced with /var/log/ceph/ceph-client.admin.196492.log.gz 2024-04-17T17:54:30.262 INFO:teuthology.orchestra.run.smithi152.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.389645.log.gz 2024-04-17T17:54:30.262 INFO:teuthology.orchestra.run.smithi152.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.499296.log.gz 2024-04-17T17:54:33.728 INFO:teuthology.orchestra.run.smithi152.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.376132.log.gz 2024-04-17T17:54:33.729 INFO:teuthology.orchestra.run.smithi152.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.188869.log.gz 2024-04-17T17:54:33.732 INFO:teuthology.orchestra.run.smithi152.stderr: 96.2% -- replaced with /var/log/ceph/ceph-client.admin.496280.log.gz 2024-04-17T17:54:33.732 INFO:teuthology.orchestra.run.smithi152.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.admin.376496.log.gz 2024-04-17T17:54:33.842 INFO:teuthology.orchestra.run.smithi152.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.361948.log.gz 2024-04-17T17:54:38.233 INFO:teuthology.orchestra.run.smithi152.stderr: 94.6% -- replaced with /var/log/ceph/ceph-client.admin.371583.log.gz 2024-04-17T17:54:40.874 INFO:teuthology.orchestra.run.smithi152.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.495437.log.gz 2024-04-17T17:54:43.666 INFO:teuthology.orchestra.run.smithi196.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-17T17:54:48.086 INFO:teuthology.orchestra.run.smithi152.stderr: 94.8% -- replaced with /var/log/ceph/ceph-client.admin.93672.log.gz 2024-04-17T17:54:48.259 INFO:teuthology.orchestra.run.smithi152.stderr: 95.8% -- replaced with /var/log/ceph/ceph-client.admin.201100.log.gz 2024-04-17T17:54:48.561 INFO:teuthology.orchestra.run.smithi152.stderr: 95.9% -- replaced with /var/log/ceph/ceph-client.admin.234795.log.gz 2024-04-17T17:54:50.347 INFO:teuthology.orchestra.run.smithi152.stderr: 97.4% -- replaced with /var/log/ceph/ceph-client.admin.364056.log.gz 2024-04-17T17:54:54.187 INFO:teuthology.orchestra.run.smithi152.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.106015.log.gz 2024-04-17T17:54:54.748 INFO:teuthology.orchestra.run.smithi152.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.91258.log.gz 2024-04-17T17:54:54.857 INFO:teuthology.orchestra.run.smithi152.stderr: 97.7% -- replaced with /var/log/ceph/ceph-client.admin.304419.log.gz 2024-04-17T17:54:55.275 INFO:teuthology.orchestra.run.smithi152.stderr: 97.3% -- replaced with /var/log/ceph/ceph-client.admin.329154.log.gz 2024-04-17T17:54:59.922 INFO:teuthology.orchestra.run.smithi152.stderr: 94.5% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-17T17:55:02.971 INFO:teuthology.orchestra.run.smithi152.stderr: 97.7% -- replaced with /var/log/ceph/ceph-client.admin.303998.log.gz 2024-04-17T17:55:03.251 INFO:teuthology.orchestra.run.smithi152.stderr: 97.7% -- replaced with /var/log/ceph/ceph-client.admin.335883.log.gz 2024-04-17T17:55:05.456 INFO:teuthology.orchestra.run.smithi152.stderr: 97.1% -- replaced with /var/log/ceph/ceph-client.admin.304910.log.gz 2024-04-17T17:55:05.886 INFO:teuthology.orchestra.run.smithi152.stderr: 96.9% -- replaced with /var/log/ceph/ceph-client.admin.90797.log.gz 2024-04-17T17:55:06.052 INFO:teuthology.orchestra.run.smithi152.stderr: 96.9% -- replaced with /var/log/ceph/ceph-client.admin.106883.log.gz 2024-04-17T17:55:06.721 INFO:teuthology.orchestra.run.smithi152.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.487354.log.gz 2024-04-17T17:55:06.728 INFO:teuthology.orchestra.run.smithi152.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.108198.log.gz 2024-04-17T17:55:07.256 INFO:teuthology.orchestra.run.smithi152.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.507878.log.gz 2024-04-17T17:55:08.016 INFO:teuthology.orchestra.run.smithi152.stderr: 97.0% -- replaced with /var/log/ceph/ceph-client.admin.203829.log.gz 2024-04-17T17:55:08.067 INFO:teuthology.orchestra.run.smithi152.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.85125.log.gz 2024-04-17T17:55:08.719 INFO:teuthology.orchestra.run.smithi152.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.admin.430176.log.gz 2024-04-17T17:55:08.969 INFO:teuthology.orchestra.run.smithi152.stderr: 96.9% -- replaced with /var/log/ceph/ceph-client.admin.90336.log.gz 2024-04-17T17:55:10.534 INFO:teuthology.orchestra.run.smithi152.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.486012.log.gz 2024-04-17T17:55:12.749 INFO:teuthology.orchestra.run.smithi152.stderr: 94.6% -- replaced with /var/log/ceph/ceph-client.admin.78960.log.gz 2024-04-17T17:55:13.349 INFO:teuthology.orchestra.run.smithi152.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.486907.log.gz 2024-04-17T17:55:13.357 INFO:teuthology.orchestra.run.smithi152.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.223074.log.gz 2024-04-17T17:55:14.311 INFO:teuthology.orchestra.run.smithi152.stderr: 95.7% -- replaced with /var/log/ceph/ceph-client.admin.370485.log.gz 2024-04-17T17:55:14.426 INFO:teuthology.orchestra.run.smithi152.stderr: 97.5% -- replaced with /var/log/ceph/ceph-client.admin.380554.log.gz 2024-04-17T17:55:14.636 INFO:teuthology.orchestra.run.smithi152.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.222640.log.gz 2024-04-17T17:55:14.665 INFO:teuthology.orchestra.run.smithi152.stderr: 96.8% -- replaced with /var/log/ceph/ceph-client.admin.107336.log.gz 2024-04-17T17:55:15.248 INFO:teuthology.orchestra.run.smithi152.stderr: 97.4% -- replaced with /var/log/ceph/ceph-client.admin.252026.log.gz 2024-04-17T17:55:17.719 INFO:teuthology.orchestra.run.smithi152.stderr: 96.9% -- replaced with /var/log/ceph/ceph-client.admin.410037.log.gz 2024-04-17T17:55:19.855 INFO:teuthology.orchestra.run.smithi196.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-17T17:55:19.984 INFO:teuthology.orchestra.run.smithi152.stderr: 96.0% -- replaced with /var/log/ceph/ceph-client.admin.200201.log.gz 2024-04-17T17:55:19.987 INFO:teuthology.orchestra.run.smithi152.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.222178.log.gz 2024-04-17T17:55:20.818 INFO:teuthology.orchestra.run.smithi152.stderr: 97.7% -- replaced with /var/log/ceph/ceph-client.admin.82059.log.gz 2024-04-17T17:55:24.013 INFO:teuthology.orchestra.run.smithi152.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.112004.log.gz 2024-04-17T17:55:25.500 INFO:teuthology.orchestra.run.smithi152.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.486462.log.gz 2024-04-17T17:55:29.559 INFO:teuthology.orchestra.run.smithi152.stderr: 97.0% -- replaced with /var/log/ceph/ceph-client.admin.80777.log.gz 2024-04-17T17:55:31.409 INFO:teuthology.orchestra.run.smithi152.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.219676.log.gz 2024-04-17T17:55:33.962 INFO:teuthology.orchestra.run.smithi152.stderr: 95.4% -- replaced with /var/log/ceph/ceph-client.admin.86807.log.gz 2024-04-17T17:55:38.860 INFO:teuthology.orchestra.run.smithi196.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-17T17:55:43.298 INFO:teuthology.orchestra.run.smithi152.stderr: 97.7% -- replaced with /var/log/ceph/ceph-client.admin.372485.log.gz 2024-04-17T17:55:44.526 INFO:teuthology.orchestra.run.smithi152.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.452151.log.gz 2024-04-17T17:55:56.760 INFO:teuthology.orchestra.run.smithi152.stderr: 96.4% -- replaced with /var/log/ceph/ceph-client.admin.80357.log.gz 2024-04-17T17:56:11.637 INFO:teuthology.orchestra.run.smithi152.stderr: 97.9% -- replaced with /var/log/ceph/ceph-client.admin.450046.log.gz 2024-04-17T17:56:20.706 INFO:teuthology.orchestra.run.smithi196.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-17T17:56:23.538 INFO:teuthology.orchestra.run.smithi152.stderr: 97.0% -- replaced with /var/log/ceph/ceph-client.admin.96994.log.gz 2024-04-17T17:56:44.178 INFO:teuthology.orchestra.run.smithi196.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-17T17:56:44.181 INFO:teuthology.orchestra.run.smithi196.stderr: 2024-04-17T17:56:44.181 INFO:teuthology.orchestra.run.smithi196.stderr:real 2m29.511s 2024-04-17T17:56:44.181 INFO:teuthology.orchestra.run.smithi196.stderr:user 2m47.828s 2024-04-17T17:56:44.181 INFO:teuthology.orchestra.run.smithi196.stderr:sys 0m16.751s 2024-04-17T17:56:46.857 INFO:teuthology.orchestra.run.smithi152.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-17T17:57:02.230 INFO:teuthology.orchestra.run.smithi152.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.84075.log.gz 2024-04-17T17:57:03.772 INFO:teuthology.orchestra.run.smithi152.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.217271.log.gz 2024-04-17T17:57:15.982 INFO:teuthology.orchestra.run.smithi152.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.443810.log.gz 2024-04-17T17:57:28.815 INFO:teuthology.orchestra.run.smithi152.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.127226.log.gz 2024-04-17T17:57:28.817 INFO:teuthology.orchestra.run.smithi152.stderr: 94.5% -- replaced with /var/log/ceph/ceph-client.admin.159198.log.gz 2024-04-17T17:58:00.487 INFO:teuthology.orchestra.run.smithi152.stderr: 96.3% -- replaced with /var/log/ceph/ceph-client.admin.321413.log.gz 2024-04-17T17:58:47.609 INFO:teuthology.orchestra.run.smithi152.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.225737.log.gz 2024-04-17T17:59:03.489 INFO:teuthology.orchestra.run.smithi152.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.159663.log.gz 2024-04-17T17:59:26.959 INFO:teuthology.orchestra.run.smithi152.stderr: 96.2% -- replaced with /var/log/ceph/ceph-client.admin.200643.log.gz 2024-04-17T18:00:06.017 INFO:teuthology.orchestra.run.smithi152.stderr: 94.6% -- replaced with /var/log/ceph/ceph-client.admin.136328.log.gz 2024-04-17T18:00:32.322 INFO:teuthology.orchestra.run.smithi152.stderr: 95.2% -- replaced with /var/log/ceph/ceph-client.admin.338509.log.gz 2024-04-17T18:01:23.694 INFO:teuthology.orchestra.run.smithi152.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-17T18:02:40.089 INFO:teuthology.orchestra.run.smithi152.stderr: 96.2% -- replaced with /var/log/ceph/ceph-client.admin.168880.log.gz 2024-04-17T18:03:23.277 INFO:teuthology.orchestra.run.smithi152.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.140368.log.gz 2024-04-17T18:04:51.570 INFO:teuthology.orchestra.run.smithi152.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.111124.log.gz 2024-04-17T18:05:15.391 INFO:teuthology.orchestra.run.smithi152.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.admin.373353.log.gz 2024-04-17T18:05:32.896 INFO:teuthology.orchestra.run.smithi152.stderr: 94.5% -- replaced with /var/log/ceph/ceph-client.admin.443331.log.gz 2024-04-17T18:06:13.034 INFO:teuthology.orchestra.run.smithi152.stderr: 94.9% -- replaced with /var/log/ceph/ceph-client.admin.508319.log.gz 2024-04-17T18:06:54.202 INFO:teuthology.orchestra.run.smithi152.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.admin.79452.log.gz 2024-04-17T18:11:11.726 INFO:teuthology.orchestra.run.smithi152.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.471897.log.gz 2024-04-17T18:11:23.270 INFO:teuthology.orchestra.run.smithi152.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.81599.log.gz 2024-04-17T18:14:25.444 INFO:teuthology.orchestra.run.smithi152.stderr: 96.0% -- replaced with /var/log/ceph/ceph-client.admin.345082.log.gz 2024-04-17T18:15:51.573 INFO:teuthology.orchestra.run.smithi152.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.214610.log.gz 2024-04-17T18:17:48.723 INFO:teuthology.orchestra.run.smithi152.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.235236.log.gz 2024-04-17T18:18:47.976 INFO:teuthology.orchestra.run.smithi152.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.82515.log.gz 2024-04-17T18:19:12.312 INFO:teuthology.orchestra.run.smithi152.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.79906.log.gz 2024-04-17T18:19:12.620 INFO:teuthology.orchestra.run.smithi152.stderr: 90.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-17T18:19:32.104 INFO:teuthology.orchestra.run.smithi152.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.462775.log.gz 2024-04-17T18:20:49.034 INFO:teuthology.orchestra.run.smithi152.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.463994.log.gz 2024-04-17T18:21:25.072 INFO:teuthology.orchestra.run.smithi152.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.469235.log.gz 2024-04-17T18:21:48.099 INFO:teuthology.orchestra.run.smithi152.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.461524.log.gz 2024-04-17T18:21:56.521 INFO:teuthology.orchestra.run.smithi152.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.466636.log.gz 2024-04-17T18:22:05.362 INFO:teuthology.orchestra.run.smithi152.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.460380.log.gz 2024-04-17T18:22:24.340 INFO:teuthology.orchestra.run.smithi152.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.457736.log.gz 2024-04-17T18:22:30.687 INFO:teuthology.orchestra.run.smithi152.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.470526.log.gz 2024-04-17T18:22:49.707 INFO:teuthology.orchestra.run.smithi152.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.467873.log.gz 2024-04-17T18:22:50.271 INFO:teuthology.orchestra.run.smithi152.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.465228.log.gz 2024-04-17T18:24:29.070 INFO:teuthology.orchestra.run.smithi152.stderr: 95.6% -- replaced with /var/log/ceph/ceph-client.admin.254919.log.gz 2024-04-17T18:28:39.121 INFO:teuthology.orchestra.run.smithi152.stderr: 95.0% -- replaced with /var/log/ceph/ceph-client.admin.166275.log.gz 2024-04-17T18:30:19.032 INFO:teuthology.orchestra.run.smithi152.stderr: 95.8% -- replaced with /var/log/ceph/ceph-client.admin.403180.log.gz 2024-04-17T18:33:45.092 INFO:teuthology.orchestra.run.smithi152.stderr: 93.2% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-17T18:45:18.205 INFO:teuthology.orchestra.run.smithi152.stderr: 94.5% -- replaced with /var/log/ceph/ceph-client.admin.396136.log.gz 2024-04-17T18:46:27.375 INFO:teuthology.orchestra.run.smithi152.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-17T18:48:45.117 INFO:teuthology.orchestra.run.smithi152.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.395397.log.gz 2024-04-17T18:52:15.071 INFO:teuthology.orchestra.run.smithi152.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.245215.log.gz 2024-04-17T18:53:43.556 INFO:teuthology.orchestra.run.smithi152.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.133189.log.gz 2024-04-17T18:53:57.038 INFO:teuthology.orchestra.run.smithi152.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-17T18:55:30.783 INFO:teuthology.orchestra.run.smithi152.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-17T19:37:16.631 INFO:teuthology.orchestra.run.smithi152.stderr: 95.7% -- replaced with /var/log/ceph/ceph-client.admin.112843.log.gz 2024-04-17T19:48:31.592 INFO:teuthology.orchestra.run.smithi152.stderr: 97.0% -- replaced with /var/log/ceph/ceph-client.admin.510490.log.gz 2024-04-17T19:54:46.790 INFO:teuthology.orchestra.run.smithi152.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.482372.log.gz 2024-04-17T19:54:46.793 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-04-17T19:54:46.793 INFO:teuthology.orchestra.run.smithi152.stderr:real 120m32.160s 2024-04-17T19:54:46.793 INFO:teuthology.orchestra.run.smithi152.stderr:user 83m7.204s 2024-04-17T19:54:46.793 INFO:teuthology.orchestra.run.smithi152.stderr:sys 13m6.846s 2024-04-17T19:54:46.808 INFO:tasks.ceph:Archiving logs... 2024-04-17T19:54:46.809 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659946/remote/smithi152/log 2024-04-17T19:54:46.810 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-17T20:07:50.553 DEBUG:teuthology.misc:Transferring archived files from smithi196:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659946/remote/smithi196/log 2024-04-17T20:07:50.584 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-17T20:14:44.101 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-17T20:14:44.117 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-17T20:14:44.118 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-17T20:14:44.124 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-17T20:14:44.317 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-17T20:14:44.326 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-17T20:14:44.326 DEBUG:teuthology.orchestra.run.smithi152:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-17T20:14:44.332 DEBUG:teuthology.orchestra.run.smithi196:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-17T20:14:44.406 INFO:teuthology.orchestra.run.smithi196.stdout: remote refid st t when poll reach delay offset jitter 2024-04-17T20:14:44.406 INFO:teuthology.orchestra.run.smithi196.stdout:============================================================================== 2024-04-17T20:14:44.406 INFO:teuthology.orchestra.run.smithi196.stdout:+hv01.front.sepi 67.205.162.81 3 u 163 256 377 0.115 -1.712 0.472 2024-04-17T20:14:44.406 INFO:teuthology.orchestra.run.smithi196.stdout:+hv02.front.sepi 63.231.80.2 3 u 180 256 377 0.118 +1.343 0.267 2024-04-17T20:14:44.406 INFO:teuthology.orchestra.run.smithi196.stdout:*hv03.front.sepi 74.6.168.72 3 u 224 256 377 0.138 +0.870 0.816 2024-04-17T20:14:44.407 INFO:teuthology.orchestra.run.smithi196.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-04-17T20:14:44.430 INFO:teuthology.orchestra.run.smithi152.stdout: remote refid st t when poll reach delay offset jitter 2024-04-17T20:14:44.431 INFO:teuthology.orchestra.run.smithi152.stdout:============================================================================== 2024-04-17T20:14:44.431 INFO:teuthology.orchestra.run.smithi152.stdout:+hv01.front.sepi 67.205.162.81 3 u 64 512 377 0.307 -1.296 0.707 2024-04-17T20:14:44.431 INFO:teuthology.orchestra.run.smithi152.stdout:*hv02.front.sepi 63.231.80.2 3 u 72 512 377 0.229 +1.455 0.146 2024-04-17T20:14:44.431 INFO:teuthology.orchestra.run.smithi152.stdout:+hv03.front.sepi 74.6.168.72 3 u 270 512 377 0.199 +0.370 0.678 2024-04-17T20:14:44.431 INFO:teuthology.orchestra.run.smithi152.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-04-17T20:14:44.432 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-17T20:14:44.444 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-17T20:14:44.444 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-17T20:14:44.469 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-17T20:14:44.506 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-17T20:14:44.546 INFO:teuthology.task.internal:Duration was 42006.588296 seconds 2024-04-17T20:14:44.546 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-17T20:14:44.571 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-17T20:14:44.571 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-17T20:14:44.577 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-17T20:14:44.950 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-17T20:14:44.950 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi152.front.sepia.ceph.com 2024-04-17T20:14:44.950 DEBUG:teuthology.orchestra.run.smithi152:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-17T20:14:45.033 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi196.front.sepia.ceph.com 2024-04-17T20:14:45.034 DEBUG:teuthology.orchestra.run.smithi196:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-17T20:14:45.071 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-17T20:14:45.071 DEBUG:teuthology.orchestra.run.smithi152:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-17T20:14:45.077 DEBUG:teuthology.orchestra.run.smithi196:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-17T20:14:45.286 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-17T20:14:45.287 DEBUG:teuthology.orchestra.run.smithi152:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-17T20:14:45.292 DEBUG:teuthology.orchestra.run.smithi196:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-17T20:14:46.192 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-17T20:14:46.203 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-17T20:14:46.203 DEBUG:teuthology.orchestra.run.smithi152:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-17T20:14:46.273 DEBUG:teuthology.orchestra.run.smithi196:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-17T20:14:46.343 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-17T20:14:46.353 DEBUG:teuthology.orchestra.run.smithi152:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-17T20:14:46.359 DEBUG:teuthology.orchestra.run.smithi196:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-17T20:14:46.400 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern = core 2024-04-17T20:14:46.401 INFO:teuthology.orchestra.run.smithi196.stdout:kernel.core_pattern = core 2024-04-17T20:14:46.465 DEBUG:teuthology.orchestra.run.smithi152:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-17T20:14:46.528 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T20:14:46.529 DEBUG:teuthology.orchestra.run.smithi196:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-17T20:14:46.536 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T20:14:46.537 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-17T20:14:46.548 INFO:teuthology.task.internal:Transferring archived files... 2024-04-17T20:14:46.549 DEBUG:teuthology.misc:Transferring archived files from smithi152:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659946/remote/smithi152 2024-04-17T20:14:46.549 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-17T20:14:46.659 DEBUG:teuthology.misc:Transferring archived files from smithi196:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659946/remote/smithi196 2024-04-17T20:14:46.660 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-17T20:14:46.689 INFO:teuthology.task.internal:Removing archive directory... 2024-04-17T20:14:46.690 DEBUG:teuthology.orchestra.run.smithi152:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-17T20:14:46.708 DEBUG:teuthology.orchestra.run.smithi196:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-17T20:14:46.735 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-17T20:14:46.747 INFO:teuthology.task.internal:Not uploading archives. 2024-04-17T20:14:46.747 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-17T20:14:46.788 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-17T20:14:46.788 DEBUG:teuthology.orchestra.run.smithi152:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-17T20:14:46.794 DEBUG:teuthology.orchestra.run.smithi196:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-17T20:14:46.804 INFO:teuthology.orchestra.run.smithi196.stdout: 655428 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 17 20:14 /home/ubuntu/cephtest 2024-04-17T20:14:46.807 INFO:teuthology.orchestra.run.smithi152.stdout: 658119 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 17 20:14 /home/ubuntu/cephtest 2024-04-17T20:14:46.816 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-17T20:14:46.829 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-17T20:14:46.891 INFO:teuthology.nuke:Checking targets against current locks 2024-04-17T20:14:46.917 DEBUG:teuthology.nuke:shortname: smithi152 2024-04-17T20:14:46.918 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-17T20:14:46.941 DEBUG:teuthology.nuke:shortname: smithi196 2024-04-17T20:14:46.942 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-17T20:14:46.946 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659946', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-17 08:24:03.974166', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHu3KvyayiKpi7Ig+sxgXozqjMoZs7hbVJQXjG2i96yDzIKmoAglpzQXQvbMhMczqjk+bqc678bfDjzjMygyHHY='} 2024-04-17T20:14:46.969 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi196.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659946', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-17 08:24:03.972762', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMY0cG94j5lZZaMgNVTdcj44LaJ/9q+TQ7sKFsD+hgminMHD3DUlRcfoOy/g25Bt8Z+J7XYxsHA50RebIkM/v80='} 2024-04-17T20:14:46.998 INFO:teuthology.orchestra.console.smithi152:Power off 2024-04-17T20:14:46.998 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T20:14:47.062 INFO:teuthology.orchestra.console.smithi196:Power off 2024-04-17T20:14:47.063 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T20:14:47.135 DEBUG:teuthology.orchestra.console.smithi196:power off output: Chassis Power Control: Down/Off 2024-04-17T20:14:47.135 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T20:14:47.145 DEBUG:teuthology.orchestra.console.smithi152:power off output: Chassis Power Control: Down/Off 2024-04-17T20:14:47.145 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T20:14:47.159 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2024-04-17T20:14:47.178 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2024-04-17T20:14:51.160 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T20:14:51.179 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T20:14:51.270 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2024-04-17T20:14:51.289 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2024-04-17T20:14:55.274 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T20:14:55.290 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T20:14:55.387 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2024-04-17T20:14:55.400 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2024-04-17T20:14:59.390 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T20:14:59.400 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T20:14:59.501 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off 2024-04-17T20:14:59.510 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2024-04-17T20:14:59.603 INFO:teuthology.orchestra.console.smithi196:Power off completed 2024-04-17T20:14:59.611 INFO:teuthology.orchestra.console.smithi152:Power off completed 2024-04-17T20:14:59.717 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/xfstests-dev} duration: 42006.588295936584 failure_reason: 'Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev)' flavor: default mon.a-kernel-sha1: 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 mon.b-kernel-sha1: 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=164819eeb8ed43e38bfffab4084c4617 status: fail success: false 2024-04-17T20:14:59.717 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T20:14:59.805 INFO:teuthology.run:FAIL